Skip to content
@scrapy-plugins

Scrapy Plugins

Plugins for the Scrapy framework

Popular repositories Loading

  1. scrapy-splash scrapy-splash Public

    Scrapy+Splash for JavaScript integration

    Python 3.2k 454

  2. scrapy-playwright scrapy-playwright Public

    🎭 Playwright integration for Scrapy

    Python 1.1k 119

  3. scrapy-djangoitem scrapy-djangoitem Public

    Scrapy extension to write scraped items using Django models

    Python 498 87

  4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

    Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

    Python 359 88

  5. scrapy-jsonrpc scrapy-jsonrpc Public

    Scrapy extension to control spiders using JSON-RPC

    Python 296 72

  6. scrapy-deltafetch scrapy-deltafetch Public

    Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

    Python 269 49

Repositories

Showing 10 of 32 repositories
  • scrapy-zyte-api Public

    Zyte API integration for Scrapy

    scrapy-plugins/scrapy-zyte-api’s past year of commit activity
    Python 36 BSD-3-Clause 20 11 4 Updated Dec 18, 2024
  • scrapy-playwright Public

    🎭 Playwright integration for Scrapy

    scrapy-plugins/scrapy-playwright’s past year of commit activity
    Python 1,054 BSD-3-Clause 119 19 2 Updated Nov 14, 2024
  • scrapy-zyte-smartproxy Public

    Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

    scrapy-plugins/scrapy-zyte-smartproxy’s past year of commit activity
    Python 359 BSD-3-Clause 88 6 (1 issue needs help) 2 Updated Nov 7, 2024
  • scrapy-spider-metadata Public
    scrapy-plugins/scrapy-spider-metadata’s past year of commit activity
    Python 4 MIT 2 2 0 Updated Oct 16, 2024
  • zyte-spidermon Public
    scrapy-plugins/zyte-spidermon’s past year of commit activity
    Python 0 0 0 0 Updated Sep 5, 2024
  • scrapy-settings-log Public Forked from further-reading/scrapy-settings-log

    An extension that allows a user to display all or some of their scrapy spider settings at runtime.

    scrapy-plugins/scrapy-settings-log’s past year of commit activity
    Python 0 GPL-3.0 4 0 0 Updated Aug 20, 2024
  • scrapy-feedexporter-dropbox Public

    Scrapy feed exporter for Dropbox

    scrapy-plugins/scrapy-feedexporter-dropbox’s past year of commit activity
    Python 1 3 0 0 Updated Jul 11, 2024
  • scrapy-crawlera-fetch Public archive

    Scrapy Downloader Middleware for Crawlera Fetch API

    scrapy-plugins/scrapy-crawlera-fetch’s past year of commit activity
    Python 8 BSD-3-Clause 10 5 5 Updated Jun 5, 2024
  • scrapy-feedexporter-azure-storage Public
    scrapy-plugins/scrapy-feedexporter-azure-storage’s past year of commit activity
    Python 2 5 0 3 Updated May 18, 2024
  • scrapy-feedexporter-onedrive Public

    Export to OneDrive

    scrapy-plugins/scrapy-feedexporter-onedrive’s past year of commit activity
    Python 1 1 0 0 Updated Feb 23, 2024
View all repositories

Top languages

Loading…