Content-Length: 208361 | pFad | http://github.com/cwjokaka/ok_ip_proxy_pool/commit/bb0db3645f85c758097a183d34248bfa8d052baa

7C Update README.md · cwjokaka/ok_ip_proxy_pool@bb0db36 · GitHub
Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
cwjokaka authored Oct 8, 2019
1 parent f21a85a commit bb0db36
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@ HEADERS = {
如果需要添加自定义代理爬虫,可通过以下步骤添加:

1. 进入src/spider/spiders.py
2. 添加自己的爬虫类,继承AbsSpider,实现它的do_crawl方法。注:请求需要**异步调用**
2. 添加自己的爬虫类,继承AbsSpider,实现它的do_crawl & get_page_range & get_urls方法,按需重写其他方法。
3. 用@spider_register修饰此类
4. 在配置文件setting.py的SPIDER['list']中添加此类名

Expand Down

0 comments on commit bb0db36

Please sign in to comment.








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://github.com/cwjokaka/ok_ip_proxy_pool/commit/bb0db3645f85c758097a183d34248bfa8d052baa

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy