Command line tool Configuration settings Default structure of Scrapy projects Sharing the root directory between projects Using the scrapy tool Creating projects Controlling pr...

Benchmarking Benchmarking Scrapy comes with a simple benchmarking suite that spawns a local HTTP server and crawls it at the maximum possible speed. The goal of this benchmarkin...

Benchmarking Benchmarking New in version 0.17. Scrapy comes with a simple benchmarking suite that spawns a local HTTP server and crawls it at the maximum possible speed. The g...

Frequently Asked Questions How does Scrapy compare to BeautifulSoup or lxml? Can I use Scrapy with BeautifulSoup? Did Scrapy “steal” X from Django? Does Scrapy work with HTTP pr...

Deploying Spiders Deploying to a Scrapyd Server Deploying to Scrapy Cloud Deploying Spiders This section describes the different options you have for deploying your Scrapy sp...

Deploying Spiders Deploying to a Scrapyd Server Deploying to Scrapy Cloud Deploying Spiders This section describes the different options you have for deploying your Scrapy sp...

Common Practices Run Scrapy from a script Running multiple spiders in the same process Distributed crawls Avoiding getting banned Common Practices This section documents co...

Scrapy 1.0 文档 获得帮助 第一步 基本概念 内置服务 解决特定问题 扩展Scrapy 其他 Scrapy 1.0 文档 本文档涵盖了所有Scrapy的内容。 获得帮助 遇到问题了？我们来帮您！ 查看下 FAQ ，这里有些常见的问题的解决办法。 寻找详细的信息？试试 索引 或者 模块索引 。 您可以在 scra...

Deploying Spiders Deploying to a Scrapyd Server Deploying to Scrapy Cloud Deploying Spiders This section describes the different options you have for deploying your Scrapyspi...

Deploying Spiders Deploying to a Scrapyd Server Deploying to Scrapy Cloud Deploying Spiders This section describes the different options you have for deploying your Scrapyspi...