Spark_ Correct use of checkpoint in spark and its difference from cache

1.Spark performance tuning: use of checkPoint https://blog.csdn.net/leen0304/article/details/78718346   summary   Checkpoint means to establish checkpoints, similar to snapshots. For example, in spark computing, the computing process DAG is very long, and the server needs to complete the wh ...

Posted on Sun, 14 Jun 2020 00:48:31 -0400 by brokeDUstudent

Shell syntax specification

ver: 1.0 Blog: https://www.cnblogs.com/Rohn This paper introduces some syntax specifications of Shell programming. The main reference is Google's Shell syntax style. catalog background Which Shell to use When to use Shell notes Top level notes Function notes TODO comments format indent Line length and long string The Conduit l ...

Posted on Sat, 13 Jun 2020 21:45:00 -0400 by pjc2003

Getting started with kubernetes to the real-world Stateless controller

1. Learn more about controllers 1.1 Controller Overview Pod is the basis of all running applications or deploying services in kubernetes. It can be seen as a robot running in k8s. Applications running alone in Pod do not have advanced features, such as Pod cannot migrate automatically when a node fails, Pod multi-replica extends horizontally, ...

Posted on Sat, 13 Jun 2020 15:12:42 -0400 by hannnndy

13. Drive development -- spi bus

SPI The abbreviation of English Serial Peripheral interface, as the name implies, is Serial Peripheral interface. It was first defined by Motorola on its MC68HCXX series processor. SPI interface is mainly used in EEPROM, FLASH, real-time clock, AD converter, digital signal processor and digital signal d ...

Posted on Sat, 13 Jun 2020 06:04:53 -0400 by advancedfuture

The creation and derivation of learning note process and thread in Linux operating system

1, Foreword In the previous article, we analyzed the unified structure task of processes and threads in the kernel_ Struct, this article will continue to analyze the process, thread creation and derivation process. First, it introduces how to edit a program into an execution file and finally into a pr ...

Posted on Fri, 12 Jun 2020 23:34:39 -0400 by prashanth0626

Using LLVM to cross compile Linux kernel modules in Windows

Simple common hello program cross compile Click here. Environment construction I'm not doing well, or even stupid, but no one teaches me. The current skill is to compile a kernel module and Makefile in linux normally. After normal use, look for the specific command to execute for decomposition: (t ...

Posted on Fri, 12 Jun 2020 06:05:28 -0400 by spec36

kubernetes entry to combat Pod health check mechanism

1. Health examination 1.1 overview of health examination In the process of application running, errors are inevitable, such as program exceptions, software exceptions, hardware failures, network failures, etc. kubernetes provides Health Check mechanism, which automatically restarts the container when application exceptions are found, and remo ...

Posted on Fri, 12 Jun 2020 03:25:48 -0400 by nenena

[Linux command] Chapter 15 planning task (crontab) of "brother bird Linux foundation"

Chapter 15 planning tasks (crontab) 15.2 what is a planned task Remind regularly or when the conditions are met. 15.1.1 types of Linux planned tasks: at, cron Routine: matters to be done at regular intervals; Unexpected: not after this time Types of planned tasks: At: can handle commands that ...

Posted on Fri, 12 Jun 2020 01:27:11 -0400 by antwown

Spring Cloud: Kubernetes deployment management k8s Foundation

Install Kubernetes Install kubectl https://kubernetes.io/docs/tasks/tools/install-kubectl/ Take linux as an example 1. Download the first version curl -LO https://storage.googleapis.com/kubernetes-release/release/`curl -s https://storage.googleapis.com/kubernetes-release/release/stable.txt`/bin/linux/amd64/kubectl 2. Give exec ...

Posted on Fri, 12 Jun 2020 00:40:38 -0400 by ztkirby

Object-Oriented C Language Programming-DynamicLinkageGenericFunctions--Stealing Beams and Changing Columns in C Language

Article Directory `DynamicLinkageGenericFunctions` Constructors and Destructors Methods, Information, Classes, and Objects `new` `delete` `clone` `differ` `sizeOf` `main` summary `TIPS` DynamicLinkageGenericFunctions Code repository [Code repository]:Https://github.com/zzu-andrew/linux-sys/b ...

Posted on Thu, 11 Jun 2020 20:46:31 -0400 by AbsolutelyFreeW