|
|
@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
## 运行环境
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- Chrome 版本 72.0.3626.109(正式版本) (64 位)
|
|
|
|
|
|
|
|
- Python 3.5.2 :: Anaconda 4.2.0 (64-bit)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## 前置库
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
核心库如下
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- requests
|
|
|
|
|
|
|
|
- fake_useragent
|
|
|
|
|
|
|
|
- BeautifulSoup
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
在当前目录下的控制台使用以下命令,批量安装上述相关的程序包
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
pip install -r requirements.txt
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## 使用方法
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 环境
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
配置代理的终端可以直接使用 `pip install -r requirements` 觉得下载速度慢,可以使用清华镜像源下载相关依赖 `pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple`
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 运行脚本main.py
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
将文件下载到本地,cmd进入该文件夹
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
![image-20240612112639165](./assets/image-20240612112639165.png)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
运行结果
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
![image-20240612112712557](./assets/image-20240612112712557.png)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
csv
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
![image-20240612112738818](./assets/image-20240612112738818.png)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
txt
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
![image-20240612112815789](./assets/image-20240612112815789.png)
|