Web Crawling packages

Showing projects tagged as HTML, Text Processing, HTTP, Web Content Extracting, and Web Crawling

  • trafilatura

    6.7 8.8 Python
    Python & command-line tool to gather text on the Web: Crawling & scraping, content extraction, metadata. TXT, Markdown, CSV & XML output.
  • selectolax

    4.4 7.3 Cython
    Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).