Improvements
- Added new scraper
Cloudflare::Radar, defines categories of domains - In scrapers
Util::ReCaptcha2,
Util::ReCaptcha3,
Util::hCaptcha added support of CaptchaAI - In
Rank::Ahrefs added page rating collection (URL rating) - Updated list of languages in
DeepL::Translator
Corrections due to changes in the issue
- Adaptation to changes in Google and Yandex layout
- Fixed collection of totalcount in
SE::Yandex for some queries - Fixed region selection in
SE::Yandex::Direct - Fixed work of
Rank::Ahrefs::KeywordGenerator with Country - United Kingdom - In
Shop::Yandex::Market some queries did not return any results
SE::Google::Images,
Rank::Ahrefs::KeywordGenerator,
Shop::Yandex::Market
Bug fixes
- Fixed unnecessary use of session on the last retry in
SE::Google - Fixed scraping of Yandex search results when there is only 1 result in the output
- Fixed error in
Telegram::GroupScraper, because of which not all names and links to logins were scraped - Fixed bug in
SE::Yandex::Position, due to which the query was erroneously searched along with the searched domain - Fixed problem in
Check::RosKomNadzor, due to which the proxy sometimes did not change during mass scraping - In
HTML::LinkExtractor fixed collection of internal links after redirect - Puppeteer: improved handling of sites requesting access in a modal dialog
