You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
|
|
|
|
## 运行环境
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- Chrome 版本 72.0.3626.109（正式版本） （64 位）
|
|
|
|
|
|
- Python 3.5.2 :: Anaconda 4.2.0 (64-bit)
|
|
|
|
|
|
|
|
|
|
|
|
## 前置库
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
核心库如下
|
|
|
|
|
|
|
|
|
|
|
|
- requests
|
|
|
|
|
|
- fake_useragent
|
|
|
|
|
|
- BeautifulSoup
|
|
|
|
|
|
|
|
|
|
|
|
在当前目录下的控制台使用以下命令，批量安装上述相关的程序包
|
|
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
pip install -r requirements.txt
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## 使用方法
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 环境
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
配置代理的终端可以直接使用 `pip install -r requirements` 觉得下载速度慢，可以使用清华镜像源下载相关依赖 `pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple`
|
|
|
|
|
|
|
|
|
|
|
|
### 运行脚本main.py
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
将文件下载到本地，cmd进入该文件夹
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
运行结果
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
csv
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
txt
|
|
|
|
|
|
|
|
|
|
|
|
|
