Improvements
- Added scraper
SE::Google::KeywordPlanner- collects suggest lists and keyword ideas
- for each keyword idea, the average number of requests per month, competition, search volumes, minimum and maximum bids are sraped
- there is the ability to specify multiple keywords in the query
- In
SE::Yandex::ByImage added function Get full links to page, which allows you to get real links to pages - In
SE::Yandex::SQI added variables to collect the number of reviews and ratings, as well as rating - Improved verification of captcha answers in Yandex scrapers
- Automatic limit increase on Linux OS
- Improved regular expression work
- When banning a proxy, more detailed information is now displayed in the task log
- Native NodeJS now in beta, many optimizations have been made, due to which in most scenarios this gives a maximum speed increase of 1.5-2 times, and a decrease in memory consumption by 2-4 times
- Starting from 1.2.822 all beta versions have Native NodeJS enabled, stable versions come out with oldnode enabled
- Native NodeJS: experimental support of HTTP/2 added
- Native NodeJS: updating Node.js to the current version
- JS scrapers: added option allow_dangerous_node_modules
- Fixed captcha download in
SE::Yandex - Fixed
Rank::Ahrefs: in $anchors variable $bl replaced with $domains - In
SE::Google fixed:- scraping of mobile news
- bug with duplication of links in the results
- scraping anchor in advertising, related keywords, and the first result in the search issuance did not always fall into serp
- In
SE::Google::Images fixed scraping of gif - Fixed
SE::Yandex::ByImage, removed flat variables $height and $width
SE::Yandex,
SE::Google::ByImage,
SE::DuckDuckGo,
Social::Instagram::Post,
Rank::Ahrefs,
Rank::Bukvarix::Domain,
SE::MailRu,
SE::Yandex::Suggest
- Fixed work of
Net::Whois with 3rd level domains, and improved verification of the received response - Fixed work of Extra query string in
SE::Bing - Fixed work of
Rank::SEMrush and
Rank::SerpStat::Keyword when received response without data - Fixed bug with variable types
- Fixed a bug where queries were mistakenly considered failed when a task was paused
- Fixed work of Bypass Cloudflare
- Fixed dynamic thread limit
- Fixed bug when using Request delay
- Fixed warning about exceeding the limit in the Queries field
- Fixed work of $tools.task.id in the result file name
- JS scrapers: getting sessions and http2 work fixed (bug appeared in one of the previous versions)
- JS scrapers: fixed page encoding detection
- Native NodeJS: fixed behavior for some errors
- Native NodeJS: fixed problem when updating A-Parser on Windows
- Native NodeJS: fixed work save_to_file
- Native NodeJS: fixed work of SOCKS5 proxies with authorization
- Native NodeJS: fixed data substitution after Query Builder