Skip to main content

Telegram::GroupScraper - Scraper for data from public Telegram groups

Telegram

Scraper Overview​

This scraper collects message data from public groups in Telegram. The Telegram group/chat scraper collects members who have posted in the group or for whom there is a service notification about joining the group. You can scrape all content from the required groups, specifically: text, images, video links, and obtain information about the publication date and author (name, profile link, avatar).

Its operation logic differs from other scrapers because it automatically adds queries to iterate through all messages in the group. Due to this, this scraper cannot be used together with any others in a single task.

Saving results is possible in any format and structure you need, thanks to the powerful built-in Template Toolkit which allows applying additional logic to results and outputting data in various formats, including JSON, SQL, and CSV.

Scraper Use Cases​

Collected Data​

Below are the data points that can be collected separately for public Telegram channels and Telegram groups.

What can be collected for Telegram channels​

The following data is available only for open (public) Telegram channels:

  • Message link
  • Message text
  • Message photo
  • Message video
  • Message date

What can be collected for Telegram groups​

The following data is available only for open (public) Telegram groups:

  • Message link
  • Author's name
  • Author's profile link
  • Author's avatar
  • Message text
  • Message photo
  • Message video
  • Message date
  • Members who posted in the group
  • Members from service notifications about joining the group

Use Cases​

  • Collecting a list of group members
  • Collecting the content of all messages in a group

Queries​

Queries should be specified as a link to a public (open) channel or group, for example:

https://t.me/a_parser

Output Results Examples​

A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, allowing it to output results in any form, as well as structured formats like CSV or JSON.

Default Output​

Result format:

$user_name($user_link): $message_text\n

Result example:

(https://t.me/aparser): To bypass the 10-request limit from one IP, you need to additionally scrape key= from the main page
(https://t.me/aparser): I'll take a look now
(https://t.me/aparser): <a href="http://a-parser.com/threads/1795/" target="_blank" rel="noopener">http://a-parser.com/threads/1795/</a>

Output to CSV Table​

Result format:

[% tools.CSVline(query, user_link, message_date, message_text) %]

Result example:

https://t.me/a_parser,https://t.me/Forby403,2016-11-05T05:01:09+00:00,"Settings - Save window size"
https://t.me/a_parser,https://t.me/Forby403,2016-11-05T05:14:47+00:00,"I run 20 tasks with 300 threads each, with a dynamic limit of 1200, they complete much faster because they all work simultaneously and there are no bottlenecks when few queries(threads) are left"
https://t.me/a_parser,https://t.me/Forby403,2016-11-05T05:27:06+00:00,"well, proxies included"

Results Processing​

A-Parser allows processing results directly during scraping; in this section, we have listed the most popular cases for the Telegram scraper.

Filtering Results by Word Occurrence in Message​

Example

You need to add a filter and select $message_text - Message text from the dropdown list. Select type RegEx match. In the regex field, enter the regex with the required words:

\bscraper\b|\bGoogle\b|\byandex\b|\bscraper\b|\bProxy\b|\bDorks\b

\b - word boundary

| - OR

is - regex flag

Download example

How to import an example into A-Parser

eJyVVN1v2jAQ/18sHjaJ8qFSacobRaLaxEpX6BOg6oovqVfH9myHgTL+952dkMC6
PewhVu53v/v2uWQe3Jt7sOjQO5asSmbiP0uYR4mZhfyK6+0V7iE3ElmXGbAObeCu
2LKmJMmd1YVZbC0YtETimEIhPeuWzB8MkrdUSB9V5D5oEpajc5Dhs8c9EWvCsmJb
zMFvXwnegSwCsl6/rIvB6DqN5yCco+ocRuSmRtYvv+i70zqTWAsHUBz3tfAfToIw
TFvSNcYTzgw+nVNHLak2gIZElWjjhVZUinDsuNmcOuGm2lKxhHfMsFd3v1EuYIdL
XfUPW3hK0j3koTEdDh6DtpdGRx8+9nxsKHAuQkSQVYQwsjbqkxI/YmOVJi79WoFu
anUeJx8dBPBwym7FOlFm5KKItt8qG5akIB12maNUp0CJ8D81ggYLXtt57ADhJdNq
LOUMdyhbWvR/WwjJ6X6NUzL6XBv+nTJ/5+PYlHceaof2p6UcGi9Rup1/ba24numM
KudhUFLkwpPsJrpQYTADAt8QTdOz+9CzXFtswnhbYBOc1smg4kRsJzY2LXRRxcVU
LsGtVqnI5pS/FRxPzEItaWfnaqLDRoayVCElTcXhY3s7xq6eQhCayt8ZT2KIUPlp
Y5nXWroviypVYwXdvpuQYE6NPI9au9yClE+Ps3MNa28UCa/eG5f0+76XYx+eq/eD
BUOPmaYbRWUdN83D0rxF5b+el6Q80si+u4fKIBQY6IRRp1zcseHxN9yRrow=
tip

See also:

Possible Settings​

note

General settings for all scrapers

ParameterDefault valueDescription
Max empty posts1000This parameter specifies how many consecutive empty (non-existent) messages must occur for scraping by the current query to stop
Start message number1This parameter specifies from which number to collect messages in the Telegram chat