使用scrapy 爬取豆瓣top250 scrapy for douban top250
1,使用scrapy 爬取豆瓣电影top250
2,连接mongodb 保存数据
3,配置了随机请求头
4,配置了代理IP,(有用户密码和没有用户密码的需要不同的处理)
-
Notifications
You must be signed in to change notification settings - Fork 0
Wjun0/douban
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
scrapy for douban top250
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published