2021-12-06 python's requests tripartite library 1

abstract Prepare to systematically learn python's triple library, requests. The urllib that comes with python, urllib3, is not written. The reference book is another big guy System environment: MacOS, python3 Reference: Requests API;Reference Book Download; Preparatory knowledge Message structure of HTTP Reference material: https://ww ...

Posted on Mon, 06 Dec 2021 13:32:59 -0500 by kamasheto

Basic concepts and operations of asynchronous Crawlers

Catalog 1) Concepts: 2) Multi-threaded asynchronous Crawlers Open threads for related blocking operations First Second Third Full code: 3) Process Pool & Thread Pool 4) Multi-threaded and multi-process 5) Use aiohttp 1. Ordinary requests 2. Add Request Parameters 3. Customize User-Agent in Request Header 4. Custom cookies in ...

Posted on Fri, 03 Dec 2021 18:56:25 -0500 by les4017

In order not to get up early, clock in and sleep late, I sacrificed selenium

preface Every day I fantasize about how wonderful life would be if I could get money without going to work! It's not winter. For me and other night owls, it's really painful to get up early and punch in every day. I often bother my friends to punch in for me because I don't want to get up. Finally I think of the killer mace! 1, Pyth ...

Posted on Thu, 02 Dec 2021 21:19:50 -0500 by TRUCKIN

Python Selenium practice (Baidu, famous sayings, JD)

The configuration of selenium can be viewed Station B crawler tutorial 1, Open Baidu and search Open Baidu: from selenium.webdriver import Chrome web = Chrome() web.get('https://www.baidu.com') Find the input box in the developer tool: Enter the value to query and press enter: input_btn = web.find_element_by_ ...

Posted on Thu, 02 Dec 2021 18:33:13 -0500 by jdpatrick

LinkedList source code reading analysis

LinkedList source code reading analysis 1.1 LinkedList introduction LinkedList is a two-way linked list inherited from AbstractSequentialList. It can also be operated as a stack, queue, or double ended queue. LinkedList implements the List interface and can perform queue operations on it. LinkedList implements the Deque interface, that is, Li ...

Posted on Wed, 01 Dec 2021 01:10:40 -0500 by crosbystillsnas

Kafka (go) -- basic usage of producer consumer API

This article mainly explains the basic use and precautions of Producer API and Consumer API in Go Client sarama. 1. General For Kakfa related codes, see   Github Kafka has five core API s: Producer APIConsumer APIStream APIConnect APIAdmin API In the Go sarama client, only Producer, Consumer and admin API s are implemented tempora ...

Posted on Tue, 30 Nov 2021 22:40:02 -0500 by u0206787@nus.edu.sg

python learning notes | crawling examples, Douban film top250

preface The purpose of writing this article is to review and learn with you. The example code in the video takes the data of the Douban film top250 as an example. I will mark the code according to what I learned from the video for ease of understanding and learning from the video https://www.bilibili.com/video/BV12E411A7ZQ. . 1, Code ...

Posted on Tue, 30 Nov 2021 14:06:37 -0500 by Whitestripes9805

Crawler: URL resolution link

catalogue urlparse()   : Realize the identification and segmentation of URL urlparse() method other API usage urlunparse(): realize URL splicing urlsplit():   Parse the URL and add params and to the path urlunsplit()   : Complete link splicing urljoin(): completes the merge of links urlencode(): serialized as GET request ...

Posted on Sun, 28 Nov 2021 11:39:33 -0500 by DamienRoche

Make a game auxiliary script with Python and share complete programming ideas

1, Explain Description: This paper will take the 4455 Miniclip game "pet Lianliankan classic version 2" as a test case to quickly complete pairing by identifying small icons and simulating mouse clicks. It is helpful for students who are interested in learning game scripts. Operating environment: win10 / Python 3.5. Main modules: ...

Posted on Sun, 28 Nov 2021 08:07:35 -0500 by bigmichael

Pygame actual combat: upgraded 2048 games - unlocking new patterns can't stop at all

Introduction "Hey! Don't sleep, wake up! It's time to work ~" by - Mengya! ​ "Just woke up, boss, what can I do for you?" by - all members! Have you had a thorough understanding of the super detailed - simple version of 2048 shared with you in the last issue? Cough... It doesn't matter if you don't eat it thoroughly! ...

Posted on Fri, 26 Nov 2021 05:57:12 -0500 by kranthi117