Web Crawling packages

Showing projects tagged as Internet, Text Processing, Web Content Extracting, HTTP, and Web Crawling

  • trafilatura

    7.0 9.0 Python
    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
  • selectolax

    4.5 7.0 Cython
    Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).