Installation guide Supported Python versions Installing Scrapy Things that are good to know Using a virtual environment (recommended) Platform specific installation notes Windo...

Installation guide Supported Python versions Installing Scrapy Things that are good to know Using a virtual environment (recommended) Platform specific installation notes Windo...

Benchmarking Benchmarking New in version 0.17. Scrapy comes with a simple benchmarking suite that spawns a local HTTP serverand crawls it at the maximum possible speed. The go...

Deploying Spiders Deploying to a Scrapyd Server Deploying to Zyte Scrapy Cloud Deploying Spiders This section describes the different options you have for deploying your Scrap...

Deploying Spiders Deploying to a Scrapyd Server Deploying to Scrapy Cloud Deploying Spiders This section describes the different options you have for deploying your Scrapy sp...

Frequently Asked Questions How does Scrapy compare to BeautifulSoup or lxml? Can I use Scrapy with BeautifulSoup? What Python versions does Scrapy support? Did Scrapy “steal” X ...

Ubuntu 软件包 Ubuntu 软件包 0.10 新版功能. Scrapinghub 发布的apt-get可获取版本通常比Ubuntu里更新，并且在比 Github 仓库 (master & stable branches) 稳定的同时还包括了最新的漏洞修复。 用法: 把Scrapy签名的GPG密钥添加到APT的钥匙环中: sudo...

Common Practices Run Scrapy from a script Running multiple spiders in the same process Distributed crawls Avoiding getting banned Common Practices This section documents com...

Installation guide Supported Python versions Installing Scrapy Things that are good to know Using a virtual environment (recommended) Platform specific installation notes Windo...

Installation guide Installing Scrapy Things that are good to know Using a virtual environment (recommended) Platform specific installation notes Windows Ubuntu 14.04 or above ...