The fifth day of Java big data learning -- while do while loop array method overload bubble sorting

review structure Sequential structureBranch structure ifLoop structure forSelect structure switch variable Member variablelocal variable The Fifth Day while Loop Structure: while (loop condition){ Circulatory body; } do-while Loop Structure: do{ Circulatory body; }while (cycle condition); Differences between the three cycles fo ...

Posted on Mon, 06 Dec 2021 20:04:37 -0500 by hesketh

scala -- examples of using Iterable sets, Seq sets, Set sets, and Map sets

1. Iterable 1.1 general Iteratable represents a set that can be iterated. It inherits the Traversable trait and is also the parent trait of other sets. Most importantly, it defines the method to obtain the iterator: def iterator: Iterator[A]. This is an abstract method. Its concrete implementation class needs to implement this method to reali ...

Posted on Mon, 06 Dec 2021 00:01:17 -0500 by lorddraco98

Senior big data Development Engineer - Hadoop learning notes

Hadoop advanced level YARN: Hadoop resource scheduling system What is YARN Apache Hadoop YARN(Yet Another Resource Negotiator) is a sub project of Hadoop, which is introduced to separate Hadoop 2.0 resource management and computing components.YARN has enough universality, and customers support other distributed computing modes. Analys ...

Posted on Sun, 05 Dec 2021 18:08:55 -0500 by snpo123

Matplotlib's 20 most valuable visualization projects

introduce These charts are grouped according to seven different scenarios of visualization objectives. Important features of valid charts: Convey correct and necessary information without distorting the facts.The design is simple and you don't have to work too hard to understand it.Support information from an aesthetic point of view rathe ...

Posted on Sun, 05 Dec 2021 13:44:30 -0500 by kutatishh

HADOOP learning notes

rpm -qa | grep vim // See what packages vim commands are in appear vim-minimal-7.4.160-4.el7.x86_64 yum install -y vim* //Install vim related packages rpm -qa | grep vim see HADOOP learning notes 1, Install virtual machine (CentOS) 2, Modify host name (host name of current virtual machine) 1. View the current host name Command: hos ...

Posted on Sun, 05 Dec 2021 08:12:39 -0500 by Rizla

3, Hive's DML data operation

3.1 data import 3.1.1 loading data into the table (Load) (1) Grammar load data [local] inpath 'path of data' [overwrite] into table student [partition (partcol1=val1,...)]; load data: indicates loading data Local: indicates loading data from local to hive table; Otherwise, load data from HDFS to hive table inpath: indicates the path to load d ...

Posted on Sun, 05 Dec 2021 02:14:14 -0500 by shinyo

stage-5 mode-1: E-commerce offline warehouse project

stage-5 mode-1: E-commerce offline warehouse project (top) introduce Notes on the actual operation of several warehouses project Job Question 1 This assignment requires the number of active members for the last seven consecutive days. I'm using small_startlog dataset, a three-day log: The log for one day is about 9k~1w pieces of data. S ...

Posted on Sat, 04 Dec 2021 12:34:43 -0500 by elentz

Digital China Innovation Competition (DCIC) - open source learning scheme for champion players of consumer credit score

Project introduction Technology introduction: data mining, feature engineering, machine learning, deep learning Title: Digital China Innovation Competition - consumer crowd portrait credit intelligence score credit score Match question connection Article background: co author of the third runner up scheme of - 58 intra city AI algorithm com ...

Posted on Fri, 03 Dec 2021 19:29:44 -0500 by gabe33

Design differences of WaterMark under Flink multi parallelism

Raising questions Will the position of WaterMark design affect the normal opening and closing of the window?Next, I simulated two scenarios (source parallelism is 1 and map parallelism is 2), which are1. Set watermark after source and open the window after passing through map2. Set watermark after the map, and then open the windowps: I have se ...

Posted on Fri, 03 Dec 2021 06:38:21 -0500 by $0.05$

Blog recommendation | effective management of data security - Pulsar Schema management

About Apache Pulsar Apache Pulsar is a top-level project of the Apache Software Foundation. It is a native distributed message flow platform for the next generation cloud. It integrates message, storage and lightweight functional computing. It adopts a separate architecture design of computing and storage, supports multi tenant, persistent stor ...

Posted on Thu, 02 Dec 2021 18:26:41 -0500 by vishakh369