首页
后端开发
Python
scrapy windows环境搭建+demo

scrapy windows环境搭建+demo

22 次浏览 0 条评论
zip
zip
windows下搭建scrapy文档，抓取项目demo，包含多级url下钻，代理ip设置，user-agent动态选择，保存抓取数据到json文件
zip
ScrapyCrawl-master.zip 预估大小：21个文件
folder
ScrapyCrawl-master 文件夹
file
python-3.5.2-amd64.exe 28.78MB
file
Twisted-17.9.0-cp35-cp35m-win_amd64.whl 2.91MB
file
Scrapy-1.5.0-py2.py3-none-any.whl 246KB
file
win10下scrapy搭建过程.doc 19KB
folder
scrapytest 文件夹
file
scrapy.cfg 264B
file
data.json 44KB
folder
scrapytest 文件夹
file
middlewares.py 582B
file
pipelines.py 808B
folder
spiders 文件夹
file
MySpider.py 2KB
folder
__pycache__ 文件夹
file
__init__.cpython-35.pyc 150B
file
MySpider.cpython-35.pyc 2KB
file
__init__.py 161B
folder
__pycache__ 文件夹
file
pipelines.cpython-35.pyc 1KB
file
__init__.cpython-35.pyc 142B
file
middlewares.cpython-35.pyc 863B
file
settings.cpython-35.pyc 5KB
file
items.cpython-35.pyc 498B
file
items.py 562B
file
__init__.py 1B
file
settings.py 9KB
file
README.md 13B
zip 文件大小：31.62MB