Improvements
- Added new scrapers:
OpenAI::ChatGPT - scraper for ChatGPT
OpenAI::Completions - scarper for OpenAI Completions
SE::You - scraper for you.com
- In
Util::Turnstile added ability to solve captchas without using services
- In
SE::Google::KeywordPlanner added support for multi-accounts, as well as implemented batch scraping
- In
Social::Instagram::Post and
Social::Instagram::Geo added the ability to scrape with authorization
- In
SE::Bing added the ability to collect ads
- Added selection of data acquisition method in
SecurityTrails::IP - In
SE::Google::Images added tags scraping - Improved work of
SE::DuckDuckGo - In
Shop::Wildberries::ProductsList added the ability to scrape categories
Corrections due to changes in the issue
SE::Google - many adaptations to changes in layout on the source
Rank::KeysSo - fixed scraping of invalid results and links in Organic pages
Shop::Wildberries::ProductInfo - category scraping fixed
SE::Yandex::Direct - fixed pagination pass
SE::Seznam,
SE::Dogpile,
SE::Ask,
Rank::Ahrefs::TrafficChecker,
GooglePlay::Apps,
SE::Google::Images,
CoinMarketCap::LastPrice,
SE::DuckDuckGo::Images,
SE::Google::ByImage,
SecurityTrails::Domain
Fixes
- Fixed Cloudflare bypass
- Fied bug in
Rank::CMS, due to which some engines were not detected - Fixed work of
SE::Yandex::Suggest when 2nd method is selected - Fixed work of
Net::Whois with some domain zones - Fixed region selection in
SE::Yandex::Direct - JS scrapers: fixed work of threadDestroy()
