> ## Content Index
> Fetch the complete content index at: https://darkwebinformer.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# Scrapy - A fast high-level web crawling & scraping framework for Python
- URL: https://darkwebinformer.com/scrapy-a-fast-high-level-web-crawling-scraping-framework-for-python-2/
- Published: 2024-08-10T17:16:12.000Z
- Updated: 2025-09-04T22:27:52.000Z
- Author: Dark Web Informer
- Tags: Tools

Direct Link: <https://github.com/scrapy/scrapy>  
Last Updated: August 1st, 2024

### Overview

[](https://github.com/scrapy/scrapy#overview)

Scrapy is a BSD-licensed fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy is maintained by [Zyte](https://www.zyte.com/) (formerly Scrapinghub) and [many other contributors](https://github.com/scrapy/scrapy/graphs/contributors).

Check the Scrapy homepage at [https://scrapy.org](https://scrapy.org/) for more information, including a list of features.

### Requirements

[](https://github.com/scrapy/scrapy#requirements)

- Python 3.8+
- Works on Linux, Windows, macOS, BSD

### Install

[](https://github.com/scrapy/scrapy#install)

The quick way:

pip install scrapy

See the install section in the documentation at <https://docs.scrapy.org/en/latest/intro/install.html> for more details.

### Documentation

[](https://github.com/scrapy/scrapy#documentation)

Documentation is available online at <https://docs.scrapy.org/> and in the `docs` directory.

### Releases

[](https://github.com/scrapy/scrapy#releases)

You can check <https://docs.scrapy.org/en/latest/news.html> for the release notes.

### Community (blog, twitter, mail list, IRC)

[](https://github.com/scrapy/scrapy#community-blog-twitter-mail-list-irc)

See <https://scrapy.org/community/> for details.

### Contributing

[](https://github.com/scrapy/scrapy#contributing)

See <https://docs.scrapy.org/en/master/contributing.html> for details.

#### Code of Conduct

[](https://github.com/scrapy/scrapy#code-of-conduct)

Please note that this project is released with a Contributor [Code of Conduct](https://github.com/scrapy/scrapy/blob/master/CODE%5FOF%5FCONDUCT.md).

By participating in this project you agree to abide by its terms. Please report unacceptable behavior to [opensource@zyte.com](mailto:opensource@zyte.com).

### Companies using Scrapy

[](https://github.com/scrapy/scrapy#companies-using-scrapy)

See <https://scrapy.org/companies/> for a list.

### Commercial Support

[](https://github.com/scrapy/scrapy#commercial-support)

See <https://scrapy.org/support/> for details.