Improvements
- New scrapers added:
SE::YouTube::Video - allows you to collect video data from YouTube (including subtitles)
Rank::BingAnalytics - scraper of data from Bing analytics in the Edge sidebar
- The following scrapers have been removed due to irrelevance: Rank::Alexa, Rank::Alexa::API, SE::MailRu, SE::MailRu::Position
- Fixed question-answer scraping (PAA) in
SE::Google - Improved handling of the 404 response code in
Rank::KeysSo - In
Rank::Ahrefs::KeywordDifficulty "shortage" has been added to the variables.
- In
Util::Turnstile CapSolver provider added - Turnstile pass proxy option added to all Ahrefs scrapers, more here
- Bukvarix scrapers have added the possibility to use their API key, more information here
- In
Maps::Google added possibility to receive a link to "I am the company owner"
- In
SE::Google::KeywordPlanner added ability to collect search volume trends, additional information here
- Language list updated in
DeepL::Translator - In
Social::Instagram::Profile the ability to collect with authorisation has been added - Improved cache detection in
SE::Google::Cache
- In
Net::Whois a new method for processing results for some domain zones has been added - Migration of embedded scrapers to JS APIv2 continues, with 10 scrapers rewritten in this release
Corrections due to changes in the issue
- Corrected operation
SE::Yandex::Register via Chrome, more information here - In
SE::Google no results were collected for News type, also corrected to get $totalcount when no results are available - Corrected operation
SE::Yandex::Position when selecting Search sites from (rstr=) - In
Shop::Yandex::Market corrected price scraping - Corrected and adapted to changes in sources:
SE::Google,
SE::Yandex::SQI,
Rank::KeysSo,
Cloudflare::Radar,
SE::Quora,
SE::Yandex::Translate,
Shop::AliExpress,
SE::Startpage,
Rank::Ahrefs
Corrections
- Fixed job freezing during restart
- Fixed an issue with sending an incorrectly resolved captcha message to
Util::AntiGate - In
CoinMarketCap::LastPrice was empty $data
Rank::Ahrefs::KeywordGenerator did not proceed to solving the captcha at a particular result format
- Corrected an error in
SE::Yandex::Direct::Frequency, which caused all requests to fail when using the accounts - Corrected
SEO::Ping - Fixed entity decoding in
Rank::MOZ - JS scrapers: corrected this.utils.urlFromHTML(), not all entities were decoded correctly
