Owner

scrapy

10 indexed repositories · View on GitHub

• scrapy

  Scrapy, a fast high-level web crawling & scraping framework for Python.

  Python · 64416 stars

• scrapyd

  A service daemon to run Scrapy spiders

  Python · 3098 stars

• parsel

  Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

  Python · 1354 stars

• w3lib

  Python library of web-related functions

  HTML · 417 stars

• cssselect

  CSS Selectors for Python

  Python · 310 stars

• protego

  A pure-Python robots.txt parser with support for modern conventions.

  DIGITAL Command Language · 94 stars

• itemadapter

  Common interface for data container classes

  Python · 69 stars

• itemloaders

  Library to populate items using XPath and CSS with a convenient API

  Python · 49 stars

• scrapy-lint

  A linter for Scrapy projects.

  Python · 22 stars

• form2request

  Python library to build HTTP requests out of HTML forms

  Python · 5 stars