Big Data

flink real-time data warehouse

Common sense of e-commerce Since this project is based on e-commerce data, here is a simple popularization of some commo...
16:23 1 December 2021

Hive common functions, window functions, UDF, UDTF

1. System built-in function View the functions provided by the systemhive> show functions; Displays the usage of the...
12:21 28 November 2021

Research on storm source code analysis

2021SC@SDUSC ...
13:38 25 November 2021

KUBERNETES02_ Cluster installation logic, front-end environment, setting up one master and two slaves, and deploying dashboard access page

① . cluster installation logic ① We need to install kubelet (equivalent to the factory director), kubedm (to help progra...
9:52 22 November 2021

MySQL scheduled backup database

1, The mysqldump command backs up data MySQL ...
11:47 20 November 2021

hiveSQL execution plan (explain the most detailed in the whole network!!)

0 - Preface Hive SQL's execution plan describes the overall outline of the actual execution of SQL. Through the executio...
18:11 19 November 2021

Big data Kafka

1Kafka definition Kafka is a distributed Mess...
23:26 11 November 2021

Day4 - branch and loop summary

Today's talk includes if multi branch structure, ternary operator, for loop, while loop, continue and break. ...
15:02 14 October 2021

Business data collection_ Zero drift processing method (Flume+Kafka+HDFS)

I am a non college student. I can find a big data post after graduation. Although I major in big data, I basically rely ...
20:24 1 October 2021

Basic concepts and installation of hive learning

Basic concepts and installation of hive learning ...
12:43 29 September 2021

MySQL Timed Backup Database

In the process of data operation, data errors may occur, even the database may run into disruption. Effective timed back...
21:05 19 September 2021

Hive series - 5. Hive's data compression and data storage format

Copyright notice: This article is the original article of the blogger and follows the CC 4.0 BY-SA copyright agreement. ...
13:19 18 September 2021

An attempt to write a crawler

One background I have an idea recently. If I ...
0:32 14 September 2021

Flink streaming API

5. Flink streaming API Implicit transformation in Scala programming import org.apache.flink.streaming.api.scala._ impo...
20:29 6 September 2021

Building recommendation system based on collaborative filtering of users

1. Overview Before that, I introduced how to ...
0:30 26 June 2020

Kafka Quick Start-RdKafka Source Analysis

Kafka Quick Start (11) - RdKafka Source Analysis ...
20:23 14 June 2020

ORACLE EMCC 12.1.0.5 installation configuration

1. Linux 6 + emcc12.1.0.5 installation environment introduction ...
12:54 2 June 2020

Oracle RAC 12.2.0.1 Patch 30920127(Apr 2020)

Oracle RAC 12.2.0.1 Patch 30920127(Apr 2020) ...
12:04 18 May 2020

Kafka Core API Producer

Producer sends demos asynchronously stay Above The use of the AdminClient API was introduced, and now we know how to man...
13:35 17 May 2020

Failure handling of Oracle database startup report ORA-00600 [kkdlcob-objn-exists]

*Author's introduction*****Original Creator: Lose SeriouslyContact number: 18081072613WeChat, QQ:18081072613Reprint to i...
15:17 16 May 2020

Analysis of Hadoop YARN ResourceManager crash caused by data limit of ZooKeeper node

This problem makes us encounter again. It happens infrequently, but once it happens, it will cause resource manager serv...
10:38 10 May 2020

Python notes: drawing nine visual graphics with Pyecharts

First install the module conda install pyecharts perhaps ...
11:31 9 May 2020

scala and java mixed development package

How to package the mixed development of scala and java? F...
10:19 9 May 2020

Hadoop High Availability Environment Setup (QJM)

1. Virtual Machine Configuration host name NN DN ZK ZKFC JNN RM NM node1 * * * * node2 * * * * * * * node3 ...
14:02 7 May 2020

Flink's common Source and sink operations in stream processing

The source of flink on stream processing is basically the same as that on batch processing. There are four categories C...
10:54 7 May 2020

Java learning note 52 (network programming: UDP protocol case)

InetAddress class: Represents the IP address in the Inter...
3:36 5 May 2020

Android development 5: the principle of anonymous shared memory

Before reading, let's think about a question first. In Android system, how does the data of APP View deliver the Surface...
1:22 6 February 2020

Slow code Python? Hands on how to speed up your code by 30%

Yun Qi Hao: https://yqh.aliyun.comThe first-hand cloud information, the selected cloud enterprise case base of different industries, and the best prac...
6:58 13 January 2020

The first lesson of big data on the cloud: MaxCompute authorization and appearance operation hidden pit Guide

1, Sub account creation, AK information binding If you are the first time to log in to digital plus platform and use DataWorks with a sub account, you...
2:57 13 January 2020

Flink asynchronous contradiction - sharp Async I/O

Dimension table JOIN - a business scenario that cannot be bypassed In the process of Flink flow processing, it is often necessary to interact with ext...
14:23 10 January 2020