scrapy.org / docs

First steps

  • Scrapy at a glance
  • Installation guide
  • Scrapy Tutorial
  • Examples

Basic concepts

  • Command line tool
  • Spiders
  • Selectors
  • Items
  • Item Loaders
  • Scrapy shell
  • Item Pipeline
  • Feed exports
  • Requests and Responses
  • Link Extractors
  • Settings
  • Exceptions

Built-in services

  • Logging
  • Stats Collection
  • Sending e-mail
  • Telnet Console

Solving specific problems

  • Frequently Asked Questions
  • Debugging Spiders
  • Spiders Contracts
  • Common Practices
  • Broad Crawls
  • Using your browser's Developer Tools for scraping
  • Selecting dynamically-loaded content
  • Debugging memory leaks
  • Downloading and processing files and images
  • Deploying Spiders
  • AutoThrottle extension
  • Benchmarking
  • Jobs: pausing and resuming crawls
  • Coroutines
  • asyncio

Extending Scrapy

  • Architecture overview
  • Add-ons
  • Downloader Middleware
  • Spider Middleware
  • Extensions
  • Signals
  • Scheduler
  • Item Exporters
  • Download handlers
  • Components
  • Core API

All the rest

  • Release notes
  • Contributing to Scrapy
  • Versioning and API stability
Scrapy
  • 搜索

© 版权所有 Scrapy developers。 最后更新于 3月 30, 2026.

利用 Sphinx 构建，使用的 主题 由 Read the Docs 开发.