Improvements
- Added new scraper
Social::TikTok::Profile
SE::Yandex - added quick answers scraping- Added support for new Yandex captchas (click captcha) in next scrapers:
SE::Yandex::ByImage,
SE::Yandex::Images,
SE::Yandex::SQI,
Shop::Yandex::Market - In
Util::AntiGate the set of available options has changed - In
SE::Yandex added option AntiGate preset for old captcha. With its help, you can select an antigate preset for regular (old, one-image) captchas. - In
SE::Yandex::Translate added the ability to enable captcha solving - In
SE::Bing improved speed, reduced number of Short output errors, added sessions - In
SE::YouTube added option Advanced filters (param sp=), with which you can specify complex combinations of filters
Rank::KeysSo - added the ability to scrape with authorization, updated collected data- The ability to specify multiple API keys has been added to OpenAI scrapers
- WordStat scrapers: adaptation to changes in authorization, maximum number of pages increased to 50
- JS scrapers: added option skipProxySettingsInheritance for parser.request()
Corrections due to changes in the issue
SE::Google - PAA scraping has been fixed, SERP scraping has been adapted to changes in layout
SE::Yandex - adaptation to changes in layout- Fixed Safe search in
SE::Google::Images,
SE::Google - Fixed auto-solving Turnstile (option Provider=Auto (using Chrome) in
Util::Turnstile) - Fixed pagination in
SE::Yahoo - In
SE::YouTube fixed work of all filters, fixed mobile search scraping
Maps::Google,
SE::YouTube,
SE::Yahoo - fixed bypass of cookie policy agreement
SE::Google::ByImage,
SE::Dogpile,
SE::DuckDuckGo
Fixes
- Fixed work of
HTML::EmailExtractor in some cases - Fixed CF bypass in
Net::HTTP with Engine=HTTP - Fixed work of
SE::Google::Translate with Device=Desktop - Fixed errors in work of
SecurityTrails::Domain,
Cloudflare::Radar,
Rank::MOZ,
Rank::CMS,
Net::Whois - Fixed crashes when using a proxy from a disabled proxy checker
