Python crawler ajax crawls the content of Ma Yun's father's Micro blog

ajax crawling Sometimes when we use Requests to grab the page, the result may be different from what we see in the browser. We can see the normal page data in the browser, but we don't get the result using Requests. The reason is that Requests gets the original HTML document, while the page in the browser is the page passing by again The result ...

Posted on Sat, 22 Feb 2020 12:37:06 -0500 by fifin04

14, Learning Scrapy of distributed Crawlers

Scrapy framework Learning objectives Understand the skeleton. Learn how to write spider crawlers. Learn how to write Crawlspider. Learn how to write middleware. Learn pipeline to save data. Learn to use Scrapy with selenium. Learn to use IP proxy in scratch.Introduction to the Scrapy frameworkInstall ...

Posted on Sat, 22 Feb 2020 11:06:49 -0500 by Ludichrist

Code implementation phase

1, Encapsulate database operations: store all database operations in the dao package. (1) using single column pattern to design a tool class for database Connection and provide a Connection object. package dao; import com.mysql.jdbc.jdbc2.optional.MysqlDataSource; import javax.sql.DataSource; impo ...

Posted on Sat, 22 Feb 2020 09:07:01 -0500 by Beyond Reality

Build Ethereum private chain (Windows)

The purpose of building private chain: public network main chain can be used in blockchain development, but it will cause unnecessary money waste. Doing anything on the Ethereum chain consumes gas. So for experimental development, we usually do experiments on our own private chain. Geth client download Download address on official website: ...

Posted on Sat, 22 Feb 2020 08:02:42 -0500 by a-mo

spring boot -- an example of file upload and download

As for file upload and download, there are many better components that encapsulate in place for us now, and there are few things we need to do in practice. But here we will introduce the file upload based on the Commons file upload component and the file download based on the file stream. File upload ...

Posted on Sat, 22 Feb 2020 04:35:15 -0500 by dscuber9000

Detailed tutorial of Django connecting Mongodb (using mongoengine)

1, Understand MongoDB database? Introduction: MongoDB is written by C + + language. It is an open source database system based on distributed file storage. It is a document oriented database. It is JSON like data format, free and flexible. Advantages: scalable clustering, mass data storage, fast q ...

Posted on Sat, 22 Feb 2020 04:06:55 -0500 by liro

How to use python to make timestamp conversion tool

This article mainly introduces the relevant materials about how to use python to make time stamp conversion tools. In this article, the example code is introduced in detail, which has a certain reference value for your study or work. The friends who need it will learn together with the editor Preface: D ...

Posted on Fri, 21 Feb 2020 10:05:04 -0500 by richardk1

Vue practice [common problems in enterprise development]

1. Precautions and experience in using Vue framework 1.1 solve the problem that the dynamic routing parameters of Vue change and the page data is not updated Problem Description: When dynamic routes are encountered, such as / page/:id switching from / page/1 to / page/2, page components are not updated ...

Posted on Fri, 21 Feb 2020 06:19:29 -0500 by joshmaker

Introduction to ECharts

ECharts introduction notes 1. Configuration mode Independent version We can download echarts.min.js directly and use 2.First Demo Step 1: create an HTML page Create an HTML page and introduce echarts.min.js: <!DOCTYPE html> <html> <head> <meta charset="utf-8"> & ...

Posted on Fri, 21 Feb 2020 05:55:40 -0500 by Misery_Kitty

Cross domain authentication solution -- JWT picture and text tutorial

brief introduction JSON Web Token(JWT) is a very lightweight specification. This specification allows us to use JWT to pass safe and reliable information between users and servers. JJWT can be used to create and verify JWT in Java. 1, token creation: (1) Create maven project and introduce depende ...

Posted on Thu, 20 Feb 2020 22:29:02 -0500 by Syto