Python practice [crawling bank website information]

Function realization Crawl the bank name and official website address of all banks (ignore if there is no official website), and write them into the database; Bank link: http://www.cbrc.gov.cn/china/jrjg/index.html Programming ideas 1. Use url to access the page and obtain the page information 2. Use regular expression to filter the page inf ...

Posted on Mon, 09 Dec 2019 22:52:32 -0500 by PureEvil

Python3 crawler development and use of agents to crawl WeChat public address

1. Objectives of this sectionOur main goal is to crawl the articles of WeChat public numbers by proxy, extract the text, date of publication, public numbers and so on. Crawling the source is Sogou WeChat. Its link is http://weixin.sogou.com/ , and then save the crawl results to the MySQL database. 2. PreparationsFirst, you need to prepare and r ...

Posted on Mon, 09 Dec 2019 17:52:30 -0500 by UnknownPlayer

Ubuntu 18.04.1 lts installation Hive

hive is a data warehouse tool based on Hadoop, which can map structured data files into a database table, and can convert SQL statements into MapReduce tasks to run. Its advantage is that it can quickly implement simple MapReduce statistics through SQL like statements. Install hive 1. Download and extract hive source program ...

Posted on Mon, 09 Dec 2019 11:36:11 -0500 by jeancharles

MySQL Event history

demand The Job history records of SQL Server are saved in msdb database, which is convenient to query the related Job definitions, plans and history records, while the events of MySQL have no history records. In order to check whether the event executes normally and the execution results, the following two steps are used to implement similar f ...

Posted on Mon, 09 Dec 2019 08:34:09 -0500 by Kibeth

MySQL schema design with multiple attributes and classifications

1. Guidance Reading This is a question and answer from B.How do you design the table structure and query when your data has multiple attributes/classifications? 2. Demand Description Occasionally, I will also browse B and reply to some interesting topics.Once I saw a topic like this: Links: https://www.zhihu.com/questio... [mysql] How do I q ...

Posted on Mon, 09 Dec 2019 06:31:35 -0500 by loftystew

mysql notes of front end Engineer

background Recently, I often participated in the background php project. Although I had taught myself php and mysql for a while when I graduated, I forgot about it even though it was useless for a long time. So I reviewed mysql again, and the front-end students can learn it together! mysql installation and operation install brew install mysql ...

Posted on Mon, 09 Dec 2019 04:41:55 -0500 by dhaselho

Getting started with databases

Knowledge Points Delta Reason for Using Database 1 Complexity of file operations 2 Synchronization 3 Concurrent Processing 4 Security Delta Database System (DBS) Database (DB) + Database Management System (DBS) + Database Application + Database Administrator (BDA) + End User Delta Database Management System-DBM Network Application Server We wan ...

Posted on Mon, 09 Dec 2019 00:36:00 -0500 by Straterra

kubernetes creates yaml, and pod service is always in ContainerCreating state

kubernetes creates yaml and pod service is always in ContainerCreating state The pod was successfully created through yaml, but the Running status is always displayed as ContainerCreating instead of Running [root@localhost k8s_work]# kubectl get pods NAME READY STATUS RESTARTS AGE myweb-tn33 0/1 ...

Posted on Mon, 09 Dec 2019 00:24:25 -0500 by TaosBill

MySQL persistent storage and failover of Kubernetes

I. planning Let's follow the previous document's architecture planning to do the following. IP role 192.168.1.200 k8s-master 192.168.1.201 k8s-node01 192.168.1.202 k8s-node02 192.168.1.203 k8s-store We demonstrate how to provide persistent storage for MySQL database, which is mainly divided into the following steps: Create PV an ...

Posted on Sun, 08 Dec 2019 21:45:25 -0500 by Shibby

mysql8 installation configuration in Linux CentOS7 system

MySQL is the most popular relational database management system in the world, which is developed by MySQL AB company in Sweden and owned by Oracle company at present. Today, I will record how to install and configure MySQL on the Linux CentOS 7 system. Catalog Environmental preparation Installation package Basic setup Syntax manipulation En ...

Posted on Sun, 08 Dec 2019 15:35:36 -0500 by mccark