Trafilatura is a Python package and command-line tool which seamlessly downloads, parses, and scrapes web page data: it can extract metadata, main body text and comments while preserving parts of the text formatting and page structure. The output can be converted to different formats.

Distinguishing between a whole page and the page's essential parts can help to alleviate many quality problems related to web text processing, by dealing with the noise caused by recurring elements (headers and footers, ads, links/blogroll, etc.).

The extractor aims to be precise enough in order not to miss texts or to discard valid documents. In addition, it must be robust, but also reasonably fast. With these objectives in mind, Trafilatura is designed to run in production on millions of web documents.

Programming language: Python
License: GNU General Public License v3.0 only
Latest version: v1.4.0

trafilatura alternatives and similar packages

Based on the "Web Content Extracting" category.
Alternatively, view trafilatura alternatives based on common mentions on social networks and blogs.

Do you think we are missing an alternative of trafilatura or a related project?

Add another 'Web Content Extracting' Package