Basic Python-Selenium operations

1. Introduction One core of selenium is WebDriver, which starts the target browser, binds to the specified port, and then communicates directly with it. Install selenium: pip install selenium The following errors may be encountered when using: 'geckodriver' executable needs to be in PATH 'chromedriver' executable needs to be in PATH The instr ...

Posted on Sun, 17 Nov 2019 19:51:47 -0500 by zdzislaw

selenium dynamic web page and request simple learning

I. Introduction selenium is a web application testing tool that can run directly in the browser, just like the user is operating. Two, documentapiurl Installation: enter the virtual environment, pip install selenium 3. Use selenium to log in to Weibo from selenium import webdriver from scrapy.selector import Selector import time ...

Posted on Fri, 15 Nov 2019 15:58:03 -0500 by Alffallen

Selenium Project Quick Start (Python-based)

Selenium is an automated test tool that allows us to drive browsers to perform specific actions, such as clicking, dropping down, and so on. This article will explain step by step from environment deployment to project development, including some problems that may be encountered during the process, all of which will be answered one by one. The ...

Posted on Thu, 14 Nov 2019 13:30:25 -0500 by Rob the R

Crawling the position information of the network based on selenium

1.selenium Selenium Is a tool for Web application testing. Selenium tests run directly in the browser, just as real users do. This feature provides a choice and direction for the development of crawlers. Because it depends on the browser itself, the premise of using the selenium Library of Python is that you need to download the corresponding ...

Posted on Mon, 11 Nov 2019 10:23:15 -0500 by mrjiggyhill

day02:requests crawling Douban movie information

I. requests crawling Douban movie information -Request url: https://movie.douban.com/top250 -Request method: get -Request header: user-agent cookiesII. selenium request Library 1. What is selenium? At first, it is an automatic testing tool, which drives the browser to perform some good operations. ...

Posted on Sat, 02 Nov 2019 22:54:03 -0400 by badman

16. Explanation of web crawler 2 - Phantom JS virtual browser + selenium module operation phantom JS

[http://bdy.lqkweb.com] [http://www.swpan.cn] [reproduced from: http://www.lqkweb.com] Phantom JS virtual browser phantomjs is a web kit headless browser based on js, that is, a browser without display interface. With this software, you can get any information loaded by js, that is, the information loaded asynchronously by browser. Download web ...

Posted on Sat, 02 Nov 2019 04:35:47 -0400 by sovtek

How to realize JD seckill in Python

Now the e-commerce is booming, and the activity pages are one after another. Generally, they are flash buying and seconds killing. It's exciting to watch this article. Little ape gaga Just uncover the veil of these seckill functions, show you the actual appearance, let's learn the code. #Python3.5 #coding:utf-8 #import scrapy from sel ...

Posted on Thu, 31 Oct 2019 14:41:13 -0400 by softsolvers

Selenium installation and element positioning

As for selenium, I have always been learning and using it before. When I encounter a problem, I don't make a whole and summary of the search. Now take some time to organize, so that you can see it later. Installation of selenium pip install selenuim Download driver Firefox driver: geckodriver Ch ...

Posted on Tue, 22 Oct 2019 15:11:04 -0400 by g00bster

Solutions for selenium, python 3 scrolling to the bottom of the page

When using selenium to get the page, you need to drag the scroll bar to the bottom of the page. Here are several methods. location_once_scrolled_into_view #coding=utf-8 from selenium import webdriver from selenium.webdriver.common.by import By from selenium.webdriver.common.keys import Keys from selenium.webdriver.support import expected_condi ...

Posted on Tue, 22 Oct 2019 10:12:36 -0400 by llcoollasa

Simulated landing on 12306 website

Catalog Simulated landing on 12306 website Get ready requirement analysis Implementation code Simulated landing on 12306 website Get ready Target website: https://kyfw.12306.cn/otn/login/init Install the PIL module: PIP3 install pilot or PIP3 -- default timeout = 100 install - U pilot th ...

Posted on Fri, 18 Oct 2019 15:58:22 -0400 by tphgangster