2.Spring Cloud Initial Acquaintance - --- Eureka Service Registration and Consumption

Preface: 1. Introduction to Eureka: Spring Cloud Eureka uses Netflix Eureka to register and discover services. It includes both server-side components and client-side components, and both server-side and client-side are written in Java. So Eureka is mainly applicable to distributed systems implemented in Java or systems built in JVM-compatible ...

Posted on Fri, 25 Jan 2019 11:09:14 -0500 by aperantos

Hadoop: Common Friends and Second-degree Networking-1

Recently, because of the need of work, I have encountered such tasks as seeking common friends and second-degree contacts. Of course, the environment here is implemented by Hadoop MapReuce program. Now let's talk about how to find common friends and MR code. 1. Seeking Common Friends The data record format is as follows: A:B, ...

Posted on Fri, 25 Jan 2019 00:12:15 -0500 by noeledoran

Some Problems of Notebook in CDH

Catalog: 1. Statement of Important Matters 2. Notebook Configuration 3. Configuration of livy 4. Version of livy 5. The Version of spark 6. Page display 7. Reference Articles 1. Statement of Important Matters 1. The default python version of cdh5.14 is 2.6.6, and it must be upgraded to 2.7. The method is as f ...

Posted on Thu, 24 Jan 2019 16:15:13 -0500 by 9999

phoenix's configuration for creating secondary indexes for modification

Without any configuration, create a secondary index directly on phoenix, such as create index A_INDEX on "t_tablename"("from_account","to_account","quantity","status") include("from_account","to_account"); Then it will make a mistake: Error: ERROR 1029 (42Y88): Mutable secondary indexes must have the hbase.regionserver.wal.code ...

Posted on Thu, 24 Jan 2019 13:12:13 -0500 by mouse02

Spark programming practice

Use Scala and Java to write Spark programs. Spark programming Scala implementation sbt First install sbt unzip sbt-1.2.6.zip -d /usr/local/ Grant authority sudo chown –R hadoop /usr/local/ Add vim ~/.bashrc to the environment variable PATH. Execute sbt version to see if the installation is successful, and then downloa ...

Posted on Wed, 23 Jan 2019 21:18:14 -0500 by creet0n

java [Simulate the underlying implementation of MAP]

1.1 Arrays we have learned in both C and Java: Array is a continuous storage linear structure with the same type of elements and the same size. Advantages of arrays: Fast access speed Disadvantages of arrays: The length of the array must be known beforehand Insertion and deletion of elements is slow Space is usually limited. ...

Posted on Wed, 23 Jan 2019 08:54:15 -0500 by neon

Executor updated: app-20181031153851-0007/1 is now EXITED (Command exited with code 1)

Recently, I am trying to call spark locally and remotely through python and java. How to use java to call spark remotely can refer to another blog of mine: Idea's spark Environment Based on maven and java Language Experimental environment client colony centos standalone Four hadoop node clusters, ip 192.168.20. [61, 62, ...

Posted on Wed, 23 Jan 2019 02:39:14 -0500 by rougue

JVM parameter - Dsun.io.serialization.extendedDebugInfo

Some time ago, the company launched a project that needed to be migrated from docker to physical server. The project has been running well. When the file configuration was moved to the server, it logged in after booting and reported a serialization problem. java.lang.IllegalArgumentException: java.io.NotSerializableException: java.util.Propert ...

Posted on Mon, 21 Jan 2019 17:12:12 -0500 by stretchy

Apache 2.4.37 + MySQL 5.7 + PHP 7.31 Latest LAMP Architecture + Discuz Forum

Latest LAMP Architecture + Discuz Forum LAMP refers to the first letters of Linux (operating system), Apache HTTP server, MySQL (sometimes MariaDB, database software) and PHP (sometimes Perl or Python), which are commonly used to build web application platforms.This architecture has been tested for a long time, but over time, various software ...

Posted on Mon, 21 Jan 2019 12:42:14 -0500 by zbee

Using MapReduce to analyze and process log records under Hadoop

I. Introduction MapReduce is a high performance batch distributed computing framework for parallel analysis and processing of massive data. Compared with traditional methods, MapReduce is more inclined to solve problems brutally and deal with huge amounts of data in simple, rough and effective ways. By inputting, splitting and ...

Posted on Sun, 20 Jan 2019 23:33:12 -0500 by deezin