1. Introduction to Eureka:
Spring Cloud Eureka uses Netflix Eureka to register and discover services. It includes both server-side components and client-side components, and both server-side and client-side are written in Java. So Eureka is mainly applicable to distributed systems implemented in Java or systems built in JVM-compatible ...
Posted on Fri, 25 Jan 2019 11:09:14 -0500 by aperantos
Recently, because of the need of work, I have encountered such tasks as seeking common friends and second-degree contacts. Of course, the environment here is implemented by Hadoop MapReuce program. Now let's talk about how to find common friends and MR code.
1. Seeking Common Friends
The data record format is as follows:
Posted on Fri, 25 Jan 2019 00:12:15 -0500 by noeledoran
1. Statement of Important Matters
2. Notebook Configuration
3. Configuration of livy
4. Version of livy
5. The Version of spark
6. Page display
7. Reference Articles
1. Statement of Important Matters
1. The default python version of cdh5.14 is 2.6.6, and it must be upgraded to 2.7. The method is as f ...
Posted on Thu, 24 Jan 2019 16:15:13 -0500 by 9999
Without any configuration, create a secondary index directly on phoenix, such as
create index A_INDEX on "t_tablename"("from_account","to_account","quantity","status") include("from_account","to_account");
Then it will make a mistake:
Error: ERROR 1029 (42Y88): Mutable secondary indexes must have the hbase.regionserver.wal.code ...
Posted on Thu, 24 Jan 2019 13:12:13 -0500 by mouse02
Use Scala and Java to write Spark programs.
First install sbt
unzip sbt-1.2.6.zip -d /usr/local/
sudo chown –R hadoop /usr/local/
Add vim ~/.bashrc to the environment variable PATH.
Execute sbt version to see if the installation is successful, and then downloa ...
Posted on Wed, 23 Jan 2019 21:18:14 -0500 by creet0n
1.1 Arrays we have learned in both C and Java:
Array is a continuous storage linear structure with the same type of elements and the same size.
Advantages of arrays:
Fast access speed
Disadvantages of arrays:
The length of the array must be known beforehand
Insertion and deletion of elements is slow
Space is usually limited. ...
Posted on Wed, 23 Jan 2019 08:54:15 -0500 by neon
Recently, I am trying to call spark locally and remotely through python and java. How to use java to call spark remotely can refer to another blog of mine:
Idea's spark Environment Based on maven and java Language
Four hadoop node clusters, ip 192.168.20. [61, 62, ...
Posted on Wed, 23 Jan 2019 02:39:14 -0500 by rougue
Some time ago, the company launched a project that needed to be migrated from docker to physical server. The project has been running well. When the file configuration was moved to the server, it logged in after booting and reported a serialization problem.
java.lang.IllegalArgumentException: java.io.NotSerializableException: java.util.Propert ...
Posted on Mon, 21 Jan 2019 17:12:12 -0500 by stretchy
Latest LAMP Architecture + Discuz Forum
LAMP refers to the first letters of Linux (operating system), Apache HTTP server, MySQL (sometimes MariaDB, database software) and PHP (sometimes Perl or Python), which are commonly used to build web application platforms.This architecture has been tested for a long time, but over time, various software ...
Posted on Mon, 21 Jan 2019 12:42:14 -0500 by zbee
MapReduce is a high performance batch distributed computing framework for parallel analysis and processing of massive data. Compared with traditional methods, MapReduce is more inclined to solve problems brutally and deal with huge amounts of data in simple, rough and effective ways. By inputting, splitting and ...
Posted on Sun, 20 Jan 2019 23:33:12 -0500 by deezin