Overview and Application
List by topic of all existing built-in scrapers in A-Parser with descriptions and links to their pages.
Search engine scrapers
| Scraper name | Description |
|---|---|
 SE::Google | Scraping all data from Google search results: links, anchors, snippets, Related keywords, scraping ad blocks. Multithreading, ReCaptcha bypass |
 SE::Yandex | Scraping all data from Yandex search results: links, anchors, snippets, Related keywords, scraping ad blocks. Maximum scraping depth |
 SE::AOL | Scraping all data from AOL search results: links, anchors, snippets |
 SE::Bing | Scraping all data from Bing search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
| SE::Baidu | Scraping all data from Baidu search results: links, anchors, snippets, Related keywords |
 SE::Dogpile | Scraping all data from Dogpile search results: links, anchors, snippets, Related keywords |
 SE::DuckDuckGo | Scraping all data from DuckDuckGo search results: links, anchors, snippets |
 SE::Seznam | Scraper for the Czech search engine seznam.cz: links, anchors, snippets, Related keywords |
 SE::Yahoo | Scraping all data from Yahoo search results: links, anchors, snippets, Related keywords, Maximum scraping depth |
 SE::Youtube | Scraping data from Youtube search results: links, title, description, username, preview image link, view count, video length |
 SE::Ask | Scraper for American Google search results via Ask.com: links, anchors, snippets, Related keywords |
 SE::Rambler | Scraping all data from Rambler search results: links, anchors, snippets |
 SE::Startpage | Scraping all data from Startpage search results: links, anchors, snippets |
Examples
🔗 Page indexing in Google and Yandex
Page indexing in Google and Yandex
🔗 Video: Scraping niche domains by keyword from Google
Video: Scraping niche domains by keyword from Google
🔗 Questions and answers from Google search results
Questions and answers from Google search results
🔗 Scraping niche domains by keyword from Google and obtaining various domain parameters
Scraping niche domains by keyword from Google and obtaining various domain parameters
🔗 Scraping Google News with date and converting it
Scraping Google News with date and converting it
🔗 Scraping only snippets from Google
Scraping only snippets from Google
🔗 Spell checking in Google
Spell checking in Google
🔗 Scraping links and anchors from Google to CSV
Scraping links and anchors from Google to CSV
🔗 Scraping text from Google search engine using a task chain
Scraping text from Google search engine using a task chain
🔗 Yandex cache scraper
Yandex cache scraper
🔗 Scraping only snippets from Yandex
Scraping only snippets from Yandex
🔗 Getting Yandex search results and result position number
Getting Yandex search results and result position number
🔗 Number of site pages in Yandex
Number of site pages in Yandex
🔗 Scraping keyword competition from Yandex
Scraping keyword competition from Yandex
🔗 Finding vacant niches in the RU internet segment
Finding vacant niches in the RU internet segment
Search engine rank scrapers
| Scraper name | Description |
|---|---|
 SE::Google::Position | Checking site positions by keywords in Google: links, list of all positions |
 SE::Yandex::Position | Checking site positions by keywords in Yandex: links, list of all positions |
 SE::Bing::Position | Checking site positions by keywords in Bing: links, list of all positions |
Examples
🔗 Getting site positions for multiple regions simultaneously
Getting site positions for multiple regions simultaneously
🔗 Getting site positions for multiple regions simultaneously
Getting site positions for multiple regions simultaneously
🔗 Overview of result presentation options
Overview of result presentation options
Search suggestion scrapers
| Scraper name | Description |
|---|---|
 SE::Google::Suggest | Google suggestion scraper: number of results per query, query suggestions, query type |
 SE::Yandex::Suggest | Yandex suggestion scraper: number of results per query, query suggestions |
 SE::Bing::Suggest | Bing suggestion scraper: number of results per query, query suggestions |
 SE::Aol::Suggest | Aol suggestion scraper: number of results per query, query suggestions |
 SE::Yahoo::Suggest | Yahoo suggestion scraper: number of results per query, query suggestions |
 SE::Youtube::Suggest | Youtube suggestion scraper: query suggestions |
Examples
🔗 Preset for scraping suggestions with the ability to exclude suggestions containing stop words from results
Preset for scraping suggestions with the ability to exclude suggestions containing stop words from results
Keyword scrapers
| Scraper name | Description |
|---|---|
 SE::Google::Trends | Google trending keywords scraper |
 SE::Yandex::WordCraft | Scraper for user queries and popular sites in Yandex search with Yandex Webmaster WordCraft |
 SE::Yandex::Wordstat | Scraper for keywords and impression statistics from wordstat.yandex.ru |
 SE::Yandex::Wordstat::ByDate | Scraper for Yandex WordStat impression statistics by months or weeks, keyword statistics |
 Rank::Bukvarix::Domain | Collecting keywords by domain from Bukvarix: keyword, frequency, position |
 Rank::Bukvarix::Keyword | Collecting keywords by keyword from Bukvarix: keyword, frequency, position |
 Rank::Ahrefs::KeywordDifficulty | Keyword difficulty, keywords, number of keywords |
 Rank::Ahrefs::KeywordGenerator | Ahrefs keyword collection: keyword ideas, questions with keywords |
 SE::Google::KeywordPlanner | Collecting suggestions, keywords, competition, min. and max. bids |
 SE::Yandex::Direct | Number of ads for a specific query, title, text and domain, links, anchors, tags |
Examples
🔗 Keyword seasonality
Keyword seasonality
🔗 Frequency estimation via WordStat
Frequency estimation via WordStat
🔗 Deep Wordstat scraping
Deep Wordstat scraping
🔗 Getting a list of Google Trends categories
Getting a list of Google Trends categories
🔗 Formatting Google Trends date
Formatting Google Trends date
Account registration
| Scraper name | Description |
|---|---|
 SE::Yandex::Register | Account registration in Yandex |
Examples
🔗 Getting a full list of Yandex regions
Getting a full list of Yandex regions
🔗 Automating Yandex account registration
Automating Yandex account registration
Site and domain parameter scrapers
| Scraper name | Description |
|---|---|
 SE::Google::TrustCheck | Checking site trust |
 SE::Google::Compromised | Checking for 'This site may be hacked' label |
 SE::Google::SafeBrowsing | Checking domain in Google blacklist |
 SE::Yandex::SafeBrowsing | Checking domain in Yandex blacklist |
 SE::Yandex::SQI | Checking Site Quality Index in Yandex |
 Net::Whois | Determines if a domain is registered or not, domain creation date, and registration expiration date |
 Net::Dns | Scraper resolves domains to IP addresses |
 Rank::Cms | Identifies all popular forums, blogs, CMS, guestbooks, wikis, and many other engine types |
 Rank::Archive | Scraper for the first and last caching date of a site in the web archive |
 Rank::MajesticSEO | Scraper for the number of backlinks from majesticseo.com |
 Rank::Mustat | Site traffic estimation, as well as domain cost and rating |
 Rank::Social::Signal | Social signals scraper |
 Rank::Curlie | Checking site presence in Curlie directory (DMOZ analog) |
 Rank::Ahrefs | ahrefs.com scraper |
 Rank::KeysSo | keys.so scraper |
 Rank::MOZ | MOZ scraper |
 SecurityTrails::Ip | Collects domains by IP |
 SecurityTrails::Domain | SecurityTrails scraper |
Examples
🔗 Scraping niche domains by keyword from Google and obtaining various domain parameters
Scraping niche domains by keyword from Google and obtaining various domain parameters
🔗 Site information
Site information
🔗 Net::Whois selecting custom data
Net::Whois selecting custom data
🔗 Getting Telegram notifications about domain registration expiration
Getting Telegram notifications about domain registration expiration
🔗 Collecting an email address database
Collecting an email address database
🔗 Determining a list of domains on an IP
Determining a list of domains on an IP
🔗 Determining CMS for 1,000,000 domains in 15 hours
Determining CMS for 1,000,000 domains in 15 hours
🔗 Scraping site domains by a specific CMS
Scraping site domains by a specific CMS
🔗 WordPress sites with subscriptions
WordPress sites with subscriptions
Various service scrapers
| Scraper name | Description |
|---|---|
| SE::Yandex::Register | Allows registering accounts in Yandex |
 SE::Bing::Translator | Translator via www.bing.com/translator/ service |
 SE::Google::Translate | Google Translator |
 SE::Yandex::Translate | Yandex Translator |
 SE::Bing::Images | Image scraper from Bing search engine |
 SE::Google::Images | Image scraper by Google keywords |
 SE::Google::ByImage | Image search by link |
 SE::Yandex::Images | Image scraper by Yandex keywords |
 SE::Yandex::ByImage | Image scraper by link from Yandex |
 SE::DuckDuckGo::Images | Image scraper from DuckDuckGo |
 SE::Dogpile::Images | Image scraper from Dogpile |
 Util::AntiGate | Captcha recognition via AntiGate service |
 Util::YandexRecognize | Captcha recognition from Yandex |
 Util::ReCaptcha2 | Recaptcha recognition from Anti-captcha.com, Rucaptcha.com, Capmonster, Capmonster.cloud, Xevil, 2captcha, R.I.P.captcha resources |
 SEO::Ping | Bulk sending of Ping requests to services supporting Weblog API (Google Blog Search, Feed Burner, Ping-o-Matic, etc.) |
 Check::RosKomNadzor | Checking site in Roskomnadzor database |
 SE::Yandex::Speller | Checking pages for text errors via Yandex.Speller |
 GooglePlay::Apps | Google Play apps scraper |
 Social::Instagram::Post | Instagram post data scraper |
 Social::Instagram::Profile | Instagram profile data scraper |
 Social::Instagram::Tag | Instagram post scraper by tags |
 Social::Instagram::Geo | Instagram post scraper in a specified location |
 Telegram::GroupScraper | Telegram public group data scraper |
 API::Server::Redis | Working with A-Parser via Redis |
 SE::Google::Cache | Checking page presence in Google cache |
| Social::Instagram::Geo | Instagram post scraper in a specified location |
 DeepL::Translator | Text translator via www.deepl.com service |
 CoinMarketCap::LastPrice | CoinMarketCap shop scraper: token name, current price in USD |
Examples
🔗 Automating Yandex account registration
Automating Yandex account registration
🔗 Comparing translator speeds
Comparing translator speeds
🔗 Using entire files as queries
Using entire files as queries
🔗 Loading files from a directory for translation in DeepL
Loading files from a directory for translation in DeepL
🔗 Downloading images of specified resolution and size
Downloading images of specified resolution and size
🔗 Creating JS scrapers. Working with CAPTCHA
Creating JS scrapers. Working with CAPTCHA
🔗 Creating JS scrapers. Working with ReCaptcha2
Creating JS scrapers. Working with ReCaptcha2
🔗 Example of working with SEO::Ping
Example of working with SEO::Ping
🔗 Location link scraper for Social::Instagram::Geo
Location link scraper for Social::Instagram::Geo
🔗 Scraping Instagram user information
Scraping Instagram user information
🔗 Scraping users of public groups in Telegram
Scraping users of public groups in Telegram
Shop scrapers
| Scraper name | Description |
|---|---|
 Shop::Amazon | amazon.com search results scraper |
 Shop::Yandex::Market | Yandex.Market scraper |
 Shop::AliExpress | Shop::AliExpress search results scraper |
 Shop::eBay | Ebay search results scraper |
 Shop::Wildberries::ProductsList | Wildberries product list scraper |
 Shop::Wildberries::ProductInfo | Wildberries product page scraper |
 Shop::Wildberries::Suggest | Wildberries search suggestion scraper |
| Shop::Yandex::Market | Products scraper from YANDEX.MARKET |
Examples
🔗 Scraping products from a website
Scraping products from a website
Map scrapers
| Scraper name | Description |
|---|---|
 Maps::Google | Google Maps scraper: organization name, address and coordinates, rating, number of reviews and price policy, website, phone, photo |
 Maps::Yandex | Yandex Maps scraper: organization name, address and coordinates, rating, number of reviews and price policy, website, phone, photo, social networks |
Examples
🔗 Scraping Google Maps to collect all organizations in a specific area
Scraping Google Maps to collect all organizations in a specific area
Content scrapers
| Scraper name | Description |
|---|---|
 Check::BackLink | Checks for the presence of your link(s) in a link database |
 HTML::LinkExtractor | Scraper of external and internal links from a specified site, can follow internal links up to a chosen level |
 HTML::ArticleExtractor | Article scraper |
 HTML::TextExtractor | Text block scraper |
 HTML::TextExtractor::LangDetect | Page language detection, without using third-party services |
 HTML::EmailExtractor | Scraping e-mail addresses from site pages |
 Net::HTTP | Downloads the specified page, supports multi-page scraping |
Examples
🔗 Checking if there are links to a page in Yandex cache
Checking if there are links to a page in Yandex cache
🔗 Deep site scraping based on HTML::LinkExtractor scraper
Deep site scraping based on HTML::LinkExtractor scraper
🔗 Video: Scraping Booking.com resource using Net::HTTP
Video: Scraping Booking.com resource using Net::HTTP
🔗 Periodic backlink check with appending results to a table
Periodic backlink check with appending results to a table
🔗 Deep site scraping based on HTML::LinkExtractor scraper
Deep site scraping based on HTML::LinkExtractor scraper
🔗 Collecting interlinked topics
Collecting interlinked topics
🔗 Finding site subdomains
Finding site subdomains
🔗 Scraping websites and saving image links
Scraping websites and saving image links
🔗 Generating sitemap.xml using JavaScript capabilities
Generating sitemap.xml using JavaScript capabilities
🔗 Getting site pages and checking indexing in Google and Yandex
Getting site pages and checking indexing in Google and Yandex
🔗 Analyzing page response speed on a website
Analyzing page response speed on a website
🔗 Scraping emails from contact pages
Scraping emails from contact pages
🔗 Checking text length on pages
Checking text length on pages
🔗 Transliteration
Transliteration