Improvements
- New scraper
Reddit::PostInfo - In
SE::Bing added support for related keywords block on the right - In
SE::YouTube::Video added option Login required is error - Improved work of
HTML::TextExtractor, some text blocks were skipped - Improved e-mail search in
HTML::EmailExtractor, e-mails with a name consisting of one character were not collected - Updated request headers in
Rank::MajesticSEO - In
Net::HTTP added IP ban processing when bypassing CF - In
Net::HTTP added option Try use HTTP/1.1 for Protocol error, which tells the scraper to repeat the request with HTTP/1.1 if HTTP/2 was enabled and a protocol error was received
Corrections due to changes in the issue
- Fixed work with captcha in
SE::Google::Images - Fixed pagination pass in
SE::Bing in some cases - Fixed scraping of subdomains in
SecurityTrails::Domain, now authorization is required - In
Shop::Wildberries::ProductsList additionally fixed receiving of $totalcount - Adapted to changes in sources:
SE::DuckDuckGo,
SE::Bing,
SE::You,
Shop::Yandex::Market
Fixes
- Fixed a bug when resolving captcha in
Check::RosKomNadzor - In
Util::SMS removed erroneous message about bad config - In
DeepL::Translator added Russian language, was mistakenly removed in previous versions - In
SE::Yandex::WordCraft fixed errors in the logic of work and fixed work with captcha - In
Shop::Wildberries::ProductsList corrected filling of $pages
