Reddit::PostInfo - Reddit post information scraper
Overview of the Reddit::PostInfo scraper
Reddit::PostInfo - scraper for Reddit post information.Collects information about a post, including comments.
You can use automatic query expansion, substitution of subqueries from files, iteration over alphanumeric combinations, and lists to obtain the maximum possible number of results.
A-Parser functionality allows you to save Reddit::PostInfo scraper settings for future use (presets), set scraping schedules, and much more.
Results can be saved in any form and structure you need, thanks to the built-in powerful Template Toolkit templating engine, which allows applying additional logic to results and outputting data in various formats, including JSON, SQL, and CSV.
Collected data
- Post link
- Title and flair
- Rating, number of comments, and number of awards
- Creation date
- Community where the post is published
- Author and their flair
- Post content: markdown text, link to media content, and link to an external resource
- Whether the post is promotional
Array of comments:
- ID
- Parent ID
- Link
- Author
- Text (stripped of tags)
- Text (with tags)
Features
- Ability to limit the number of comments to scrape
Queries
One query option is supported:
Post links
Example:
https://www.reddit.com/r/Audi/comments/151atr5/audi_r8_high_speed_crash_294_km/
https://www.reddit.com/r/Lexus/comments/1dc7r2m/anyone_come_from_audi_to_lexus/
By default, the result will output information about the post without comments
Result output options
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit templating engine, which allows it to output results in any form, as well as in structured formats like CSV or JSON.
Possible settings
| Parameter | Default value | Description |
|---|---|---|
| Max comments count | 50 | Number of comments to scrape |