Improvements
- Aded new scraper
Telegram::GroupScraper, which collects message data from public groups in Telegram: text, date, author, links to photos and videos - Aded new scraper
Shop::eBay, which allows you to scrape search results on ebay.com - Changes in Google scrapers:
- Added $detected_geo variable, which contains information about geolocation
- Due to irrelevance, the following options have been removed:
- Old desktop computer (IE6) in Device
- Util::AntiGate preset
- Use digit captcha
- In
SE::Yandex max value of Pages count increased up to 25 - In
SE::Google::Images added support for new layout - In
Util::ReCaptcha2 added support capmonster.cloud - Scraper
SE::MailRu completely rewritten, added support for captcha and sessions and added collection of links to cached pages - Scraper
SE::Yandex::Direct completely rewritten, collection of tags and sitelinks with anchors added - A new template tool tools.task has been added, at the moment it can return task id and number of threads
- JS scrapers: this.query.add now support passing additional parameters
- Many fixes in
SE::Google, it now completely duplicates
SE::Google::Modern - Fixed scraping of $indexed in
Rank::MajesticSEO - In
Net::Whois fixed work with domain zone .sex - Fixed scraping of $title in
Shop::Yandex::Market
Shop::Amazon,
SE::Dogpile,
Rank::Ahrefs,
SE::Bing,
Rank::SEMrush,
SE::DuckDuckGo,
SE::DuckDuckGo::Images,
SE::Baidu
- In Google scrapers fixed a bug where the collected links were with a translator
- Randomization problems fixed in some cases
- Fixed bug in
Social::Instagram::Post which occurred when scraping only arrays - Fixed pagination pass issue that occurred in one of the previous versions
- JS parsers: fixed work with Node.js module socks