Improvements
- Added DuckDuckGo position scraper:
SE::DuckDuckGo::Position - Added scraper for Yandex Balaboba:
SE::Yandex::Balaboba - Implemented work with XEvil through API Antigate v2
- Added transfer of Google cookies when the option ReCaptcha2 pass proxy is enabled in
SE::Google - Updated the list of domains in
SE::Yandex - Due to the fact that Yandex now always returns 10 results per page in
SE::Yandex removed parameter Links per page - In
HTML::LinkExtractor and
Check::BackLink added collecting of <a> tags - In
Shop::AliExpress added sessions support - In
HTML::EmailExtractor added option Skip meta tags, when enabled, tells the scraper not to collect mail in meta tags - In scraper
DeepL::Translator updated list of languages
Corrections due to changes in the issue
- Fixed typo definition in
SE::Yandex
SE::Yandex::WordStat - fixed authorization in HTTP mode- Fixed definition of ads in
SE::Yandex::Direct - Fixed
Shop::Wildberries::ProductsList when scraping by keywords
SE::Baidu - fixed work in cases when there are no results for a query
SE::Google,
SE::Yandex,
SE::Bing,
SE::Google::Images,
Rank::MajesticSEO,
Rank::MOZ,
Shop::AliExpress,
Shop::Amazon,
SE::Pinterest
Bug fixes
- Fixed region selection in
SE::Yandex - Fixed handling of url with Cyrillic in PAA
SE::Google - Fixed work of
SE::Google::KeywordPlanner, in some cases, the scraper did not see the response and erroneously repeated attempts - Fixed login error in scraper
SE::Yandex::Direct - In
SE::Yandex::Register fixed a bug when Yandex displayed an error about an incorrect phone number or about other problems
SE::Google::Translate - in some cases, scraping ended with an error- Fixed a bug with erroneous output of results in
Net::HTTP when collecting through a regular expression, in cases where one query finished successfully, and the other did not, and the second one displayed the results of the first one - Fixed bug with remaining Chrome processes after task completion on Windows 11
- Fixed availability fs.constants
