Signals Deferred signal handlers Built-in signals reference Engine signals engine_started engine_stopped Item signals item_scraped item_dropped item_error Spider signals sp...

Item Pipelines 编写item pipeline process_item(self, item, spider) open_spider(self, spider) close_spider(spider) 将item写入JSON文件 启用一个Item Pipeline组件 在这里优化： 将item写入MongoDB I...

Item Pipeline Writing your own item pipeline Item pipeline example Price validation and dropping items with no prices Write items to a JSON file Write items to MongoDB Take scr...

Command line tool Configuration settings Default structure of Scrapy projects Sharing the root directory between projects Using the scrapy tool Creating projects Controlling p...

Command line tool Configuration settings Default structure of Scrapy projects Sharing the root directory between projects Using the scrapy tool Creating projects Controlling p...

Command line tool Configuration settings Default structure of Scrapy projects Sharing the root directory between projects Using the scrapy tool Creating projects Controlling p...

Common Practices Run Scrapy from a script Running multiple spiders in the same process Distributed crawls Avoiding getting banned Common Practices This section documents co...

Jobs: pausing and resuming crawls Job directory How to use it Keeping persistent state between batches Persistence gotchas Cookies expiration Request serialization Jobs: ...

Jobs: pausing and resuming crawls Job directory How to use it Keeping persistent state between batches Persistence gotchas Cookies expiration Request serialization Jobs: ...

Signals Deferred signal handlers Built-in signals reference engine_started engine_stopped item_scraped item_dropped item_error spider_closed spider_opened spider_idle spid...