My development diary

A few days ago, the company planned to develop a large platform integrating various management functions, and let me be responsible for the development of test related services. For the first time, I was really busy as a dog. The project was finally approved last week and officially entered the development stage this week. The general requireme ...

Posted on Mon, 15 Jun 2020 23:18:31 -0400 by jsschmitt

jenkins package deployment tool installation

Package download maven package download gradle package download ant package download node package download Configure environment #decompression tar zxf apache-maven-xxxx.tar.gz -C /usr/local tar zxf gradle-xxxx.tar.gz -C /usr/local tar zxf node-xxxxx.tar.gz -C /usr/local tar zxf apache-ant-xxxx.tar.gz -C /usr/local #Add envi ...

Posted on Sun, 14 Jun 2020 23:04:48 -0400 by mj99

Building analysis data lake with Apache Spark and Apache Hudi

Welcome to WeChat official account: ApacheHudi 1. Introduction Most modern data lakes are built on some kind of distributed file system (DFS), such as HDFS or cloud based storage, such as AWS S3. One of the basic principles to follow is the "write once read many" access model for files. This ...

Posted on Sun, 14 Jun 2020 22:39:40 -0400 by tozanni

Message type - normal message

General message RocketMQ provides three ways to send ordinary messages: reliable synchronous sending, reliable asynchronous sending and one-way sending. Reliable synchronous transmission Synchronous sending refers to the communication mode in which the sender sends data and sends the next packet a ...

Posted on Sat, 13 Jun 2020 00:38:15 -0400 by spicey

How RocketMQ.2-NameServer started

The previous article described the process of starting NameServer and broker with RocketMQ source code for single-machine deployment and sending and receiving messages. In fact, it is a simple quickstart. After the actual operation, the backend monarch has been able to carry out simple business messaging based on RocketMQ, completing small func ...

Posted on Fri, 12 Jun 2020 22:26:33 -0400 by maverickminds

Centos7 install apache server

Official website address: http://httpd.apache.org/ , take version 2.4.43 as an example Click Download to enter the relevant Download pageHere's another way to download: wget Download First we download dependency yum groupinstall "Development Tools" -y yum install libtool -y yum install expat-devel pcr ...

Posted on Thu, 11 Jun 2020 04:18:17 -0400 by knight

JustAuth practical document - Basic chapter

JustAuth actual combat document JustAuth, as you can see, is just a tool class library for third-party authorized login. It can let us get rid of the tedious third-party login SDK and make the login So easy! This column will introduce in detail how to use JustAuth to realize third-party login and how to use the advanced features of JustAuth. 🎉 ...

Posted on Thu, 11 Jun 2020 03:53:17 -0400 by daena76

Real-Time Label Development - Build a real-time user portrait from scratch

​ Data Access Access to data can be accessed by writing data to Kafka in real time, either directly or through real-time access methods such as oracle's ogg or mysql's binlog ogg Golden Gate (OGG) provides real-time capture, transformation and delivery of transaction data in heterogeneous environments. Through OGG, data from oracle can be writ ...

Posted on Wed, 10 Jun 2020 22:48:11 -0400 by swizenfeld

Add a SpringBootAdmin monitoring

0. Preface In the previous chapters, we first built a project framework, and then built a gateway project using nacos. There are not too many things configured in the gateway project. Now we will build another important project in Spring Cloud microservices spring boot admin 1. Introduction to spring boot admin Spring Boot Admin is used to mon ...

Posted on Wed, 10 Jun 2020 21:43:28 -0400 by ptolomea

Spark streaming reads the database data extracted from Flume by Kafka and saves it in HBase. Hive maps HBase for query

Recently, the company is working on real-time flow processing. The specific requirements are: real-time import of relevant data tables in relational databases (MySQL, Oracle) into HBase, and use Hive mapping HBase for data query. The company uses the big data cluster built by CDH6.3.1~ 1, Configure ...

Posted on Wed, 10 Jun 2020 00:55:16 -0400 by jcleary