MapperReduce serialization job - sorting

1 data source: the last product about simple statistics of mobile traffic     2. Requirements: sort in reverse order according to the total flow value, and then get the output 3. General logic (1) FlowSort class: for serialization and deserialization, the implementation of sorting logic interface (2) FlowSortMapper class: encapsulating data (3 ...

Posted on Tue, 26 May 2020 10:10:14 -0400 by TwistedLogix

The running in period of Flink and Hive

There is a lot of feedback from readers. Please refer to the previous article< Hive is finally waiting, Flink >When Flink is deployed and Hive is integrated, there are some bug s and compatibility problems. Although waiting, it is not available. So I added this article as a sister article. review In the previous article, the author use ...

Posted on Mon, 25 May 2020 03:57:37 -0400 by soccerstar_23

nginx lua scripts manipulate pits in file directories or default paths to files

BUG s have recently appeared online, and it is after server migration that a lua script that finds nginx cannot collect log data for nginx After sorting, it was found that because lua could not find the corresponding file, the nginx data could not be written to the file.That is, lua cannot create the create file directory and therefore cannot f ...

Posted on Fri, 22 May 2020 23:54:39 -0400 by davidx714

Configuring Maven skills in Eclipse

Configuring Maven in Eclipse Specify the path to configure and install maven Mavan local warehouse with Eclipse: Instead of the warehouse and setting we configured, you can also use the default one relation setting.xml file to configure setting.xml , plus Alibaba proxy imageIt will be slow to download jar directly from the address of the centr ...

Posted on Fri, 22 May 2020 12:14:10 -0400 by en

ThinKPHP6.0 hands on

Install ThinkPHP6.0 cd to the project directory, and then do the following Prepare to install the framework: composer create project topthink / think thinkphp6.0 cd switch to the thinkPHP6.0 directory of PHP project Modify configuration file:. Env configuration file / / copy example.env Change to your own Open debug mode: app in. env_ DEBUG = ...

Posted on Fri, 22 May 2020 10:08:32 -0400 by benny_g

Swagger permission control part 1: Implementation Based on Apache Shiro

Many articles mentioned that Swagger should be turned off in the production environment to prevent system resource leakage. Today, with my own experience in the development process, I share a method that can be implemented in just a few lines of code to allow Apache Shiro to take over Swagger authentication and authorization. If there is a bett ...

Posted on Fri, 22 May 2020 03:11:03 -0400 by K3nnnn

SpringBoot combines ShardingSphere for data slicing, read-write separation

ShardingSphere is an ecosystem of open source distributed database middleware solutions comprising three separate products, ShardingSphere-JDBC, ShardingSphere-Proxy and HardingSphere-Sidecar (planned).They all provide standardized data fragmentation, distributed transactions, and database governance capabilities that can be applied to a wide v ...

Posted on Thu, 21 May 2020 22:20:15 -0400 by nikbone

Submit Spark tasks remotely to yarn cluster

Reference article:How to submit spark tasks to yarn cluster remotely in idea Several modes of running spark tasks: 1, local mode, write code in idea and run directly. 2,standalone mode, need to jar package program, upload to cluster, spark-submit submit to cluster run 3,yarn mode (local,client,cluster) as above, also requires jar packa ...

Posted on Thu, 21 May 2020 20:09:40 -0400 by twilightnights

Beauty of mybatis source code: 1.3. Find a starting point for learning mybatis source code

Find the starting point of learning mybatis source code To learn the source code of mybatis, the first step must be to find a starting point for learning. First, we start with a simple Demo, re experience the way of using mybatis, and then we can start from it to learn the source code of mybatis. Hello World First of all, we will build a new He ...

Posted on Thu, 21 May 2020 02:36:29 -0400 by gleemonex

ELK 7.X Use kiana's built-in analysis module to display icon problem records

Built a set of elk by myself 7.x Version environment found that using filebeat to collect nginx or apapche could not customize the directory log directory. If you customize the log directory, it would not be segmented. If you use the default log location, it would be segmented The solution is hereby recorded Default load path [root@kangcw e ...

Posted on Mon, 18 May 2020 12:12:50 -0400 by abazoskib