Skip to main content

Additional options for certain scrapers

Some scrapers support additional options that can be added via the settings context menu.

Additional options for the scraper

Parse all results​

This option is available for scrapers SE::GoogleSE::Google, SE::YandexSE::Yandex, SE::BingSE::Bing, SE::YahooSE::Yahoo and allows bypassing the 1000 results limit per query:

  • When scraping queries, A-Parser estimates the number of results in the SERP displayed by Google or Yandex
  • Depending on the number of results, the scraper adds many additional queries, thereby allowing it to scrape much more results (often all) for a single query

Parse to level​

This option is available for suggestion scrapers (e.g., SE::Google::SuggestSE::Google::Suggest), for the SE::Yandex::WordStatSE::Yandex::WordStat scraper, and for the HTML::LinkExtractorHTML::LinkExtractor link scraper:

  • For suggestion and Wordstat scrapers, it re-inserts scraped keywords back into queries, thereby allowing it to scrape all nested keywords up to the specified level
  • For the HTML::LinkExtractorHTML::LinkExtractor scraper, it re-inserts all internal site links into queries, allowing you to crawl the entire site and build its link map
note

For this option, it is mandatory to enable query deduplication; otherwise, a situation may occur where the scraper scrapes the same keywords or links in a loop

This option allows you to specify the ability to scrape in depth using related keywords. Supported by scrapers SE::GoogleSE::Google, SE::BingSE::Bing, SE::YahooSE::Yahoo.

Other options​

There are a number of additional options for different scrapers; more details about their purpose can be found in the documentation for each scraper:

  • Use Pages, Check Content, Check Next Page - options for the Net::HTTPNet::HTTP scraper
  • Parse People also ask - option for the SE::GoogleSE::Google scraper