python crawler - the number of users who crawl B station online

During the National Day, I want to count the online population of bilibilibili website and write a simple crawler program. This paper mainly analyses the parameters returned by https://api.bilibili.com/x/web-interface/online to get the corresponding position of the number of people online. The key point of the program is the use of requests mod ...

Posted on Thu, 10 Oct 2019 10:28:09 -0400 by work_it_work

How to Read Direct Part Marking (DPM)

DPM(Direct Part Marking), translated into direct part marking in Chinese, refers to the permanent marking of text or readable symbols on the surface of industrial parts (such as automobile hub, circuit board, etc.), such as DataMatrix and QR two-dimensional code. This kind of bar code is difficult to identify. Dynamsoft Barcode Reader SDK v7.2 ...

Posted on Thu, 10 Oct 2019 10:18:55 -0400 by captain_scarlet87

Django's Request Data Format

Django default parsing format application/x-www-form-urlencoded Requirements: a. application/x-www-form-urlencoded b. The data format must also be: a = 1 & b = 1 What this article does is to retrieve in the background through different request data formats and different ways of sending requests. (Interested friends can read Django's re ...

Posted on Thu, 10 Oct 2019 08:00:37 -0400 by Miker

Pthon of Express Bird Logistics Single Number Instant Query api Function

Before writing express delivery, there were only examples of php and. net on the official website, and I used the relevant functions of python package to trample a lot of holes before I came out and shared my method. Firstly, the picture above shows the results. For technical documentation, please refer to the Express Bird website api: htt ...

Posted on Thu, 10 Oct 2019 07:14:46 -0400 by ashell

react integrates native redux

react integrates native redux(2) Preface stay react integrates native redux(1) A basic application framework has been completed, but when action is distributed, logic can not be written in action. In other words, action is always a json object and can not be a function. Although logic method can be written to change the value of state in view l ...

Posted on Thu, 10 Oct 2019 05:05:09 -0400 by MishieMoo

Analysis of AES Signature Interface in the same City

BACKGROUND: We need to get job information published on 58 cities, including job recruitment requirements, salary and welfare, company information, and contact information of recruiters. (Difficulty coefficient of intermediate reptiles)   Job Details Page Analysis Links to a job details page https://qy.m.58.com/m_detail/29379880488200/ ...

Posted on Wed, 09 Oct 2019 23:08:05 -0400 by raytri

Sending mail in scrapy Middleware

Background: I've written about sending e-mails through scrapy extensions and when the crawler closes. At that time, there was a problem that the MailSender object needed to return. This time you need to send mail in the middleware, but you can't use return casually in the middleware. import json import random import scrapy from scrapy.http impo ...

Posted on Wed, 09 Oct 2019 22:58:37 -0400 by Daniel.Conaghan1

Python Training Camp 45 days - Day08 (File Operation)

Catalog 1. Introduction to Document Operation 2. Reading and Writing of Documents 2.1 Text File 2.2 binary file 2.3 JSON file 3. Location, renaming and deletion of files 4. Relevant operations of folders 1. Introduction to Document Operation You should have heard a ...

Posted on Wed, 09 Oct 2019 22:50:36 -0400 by sheen.andola

JSONObject parses JSON data

Get the return result through http request, the result type is string, first converted to json. JSONObject jsonObject=JSONObject.parseObject(result); The results of json data are as follows: { "data": { "city": "Shenzhen", "temphigh": "25", "templow": "19", "updatetime": "2017-11-04 13:23:00", "tempnow": "24", ...

Posted on Wed, 09 Oct 2019 18:08:35 -0400 by remmargorp

Python 3+Requests+Excel Complete Interface Automation Framework

The framework uses Python 3 + Requests + Excel as a whole: Includes access to real-time token     1,------base   -------runmethond.py runmethond: encapsulating different requests import json import requests requests.packages.urllib3.disable_warnings() class RunMethod: def post_main(self, url, data, header=None): r ...

Posted on Wed, 09 Oct 2019 17:40:19 -0400 by stageguys