MapReduce-Eclipse Learning Notes

Catalog 1. Configuration file 2. Code examples Code interpretation Errors and Solutions Practice MapReducer in eclipse under windows. eclipse environment collocation 1. Configuration file 1.xml configuration file 2.jar package Jar package under common, mapreduce, tools, yarn and jar package in bin in directory 2. Cod ...

Posted on Wed, 30 Jan 2019 03:24:14 -0500 by Showcase

Talk about direct grouping of storm

order This paper mainly studies direct grouping of storm. direct grouping Direct grouping is a special kind of grouping, which is directly specified by the upstream producer which task downstream receives the tuple it emits. The use of direct grouping has the following steps: 1. The upstream saves the taskId list of the downstream bolt in the p ...

Posted on Wed, 30 Jan 2019 02:51:15 -0500 by redrabbit

Spring MVC uploads files using MultipartFile

1. Basic introduction to MultipartFile MultipartFile is a relatively complete file upload component officially provided by Spring mvc. MultipartFile is an organizational interface whose implementation classes include org.springframework.web.multipart.commons.CommonsMultipartFile org.springframework.mock.web.MockMultipartFile     It is used in ...

Posted on Wed, 30 Jan 2019 02:42:15 -0500 by dicamille

springboot Configuration kafka Producer and Consumer Details

Add a new kafka dependency ar package under the original pom.xml dependency <!--kafka--> <dependency> <groupId>org.springframework.kafka</groupId> <artifactId>spring-kafka</artifactId> <version>1.1.1.RELEASE</version> </dependency> <dependency> <g ...

Posted on Tue, 29 Jan 2019 21:42:16 -0500 by first_lady_the_queen

Accessing remote server services using nodejs and Java

Now that this article uses Noejs and Java to access remote servers, let's start with another programming language, SAP ABAP (the programming language I use most in my daily work), to develop a service. This is my class that implements services in ABAP programming language: ZCL_DIS_HTTP_HANDLER This class implements a method HANDLE_REQUEST defi ...

Posted on Tue, 29 Jan 2019 20:30:15 -0500 by andylyon87

Operation of hive table

Creation of the hit table: CREATE [EXTERNAL] TABLE [IF NOT EXISTS] table_name [(col_name data_type [COMMENT col_comment], ...)] [COMMENT table_comment] [PARTITIONED BY (col_name data_type [COMMENT col_comment], ...)] [CLUSTERED BY (col_name, col_name, ...) [SORTED BY (col_name [ASC|DESC], ...)] INTO num_buckets BUCKET ...

Posted on Tue, 29 Jan 2019 18:27:16 -0500 by hotwire

ngrinder(2) stress test script groovy

Preface groovy script ngrinder Of groovy The script is a sequential structure. Users can complete various complex testing tasks by writing pre-set functions in the process of script execution. Processes and Threads of ngrinder ngrinder Use processes and threads to simulate multiple users. For example, if you set up the following tests. Only ...

Posted on Tue, 29 Jan 2019 17:57:14 -0500 by Thrakorzog

MapReduce's Simple Analysis of Mobile Network Recording and Partitioner Partitioning

overview 1.MapReduce Processing Mobile Internet Recording 2.Partitioner partition Last time I said about MapReduce Execution Process and Principle Now let's look at partitioning and a simple example 1.MapReduce Processing Mobile Internet Recording First we need to simulate a call log file Build a tel.log file on the Windows ...

Posted on Tue, 29 Jan 2019 14:06:15 -0500 by TVining

callLog Case of Large Data Telephone Log Analysis (2)

1. Front-end Implementation--Query Call Records According to Time Period ----------------------------------------- 1. Improving the dao class calllog.class of calllog ---------------------------------------------- package com.it18zhang.ssm.domain; /** * calllog domain class of standard javab ...

Posted on Tue, 29 Jan 2019 07:09:17 -0500 by ojav

Talk about the tick Tuple of storm

order This paper mainly studies tickTuple of storm. Example TickWordCountBolt public class TickWordCountBolt extends BaseBasicBolt { private static final Logger LOGGER = LoggerFactory.getLogger(TickWordCountBolt.class); Map<String, Integer> counts = new HashMap<String, Integer>(); @Override public Map<String, O ...

Posted on Tue, 29 Jan 2019 04:30:15 -0500 by rgpayne