Improvements
- Improved Logs Viewer:
- Filter for failed/running tasks
- Sort by run time
- Support for pagination and search for logs
- Display parser and query
- Added new tools.memory - key/value storage in memory
- Added new scraper
SE::Yandex::SafeBrowsing, which allows you to check the site in Yandex blacklist - In
SE::Google::Trends implemented the ability to compare data for keywords - Logic improvements in
Shop::Amazon - Improved stability of JavaScript scrapers (v8 engine)
- JS scrapers: added method .addElement, which allows you to fill arrays in the results in a more convenient way
- JS scrapers: added option resultArraysWithObjects for this.parser.request, which allows to return an array of objects in the results when calling another scraper
- JS scrapers: added DNS response caching
- Fixed mobile output scraping in
SE::Google::Modern - Fixed
SE::DuckDuckGo::Images when working with some kinds of queries - Fixed scraping of 1 result in
SE::Yandex
SE::IxQuick,
SE::DuckDuckGo,
SE::Yandex::Translate,
SE::Bing::Suggest
- Fixed handling of empty requests in JavaScript scrapers
- Fixed display of images in the log, the problem appeared in one of the previous versions
- Fixed work with some types of proxies
- Fixed work of the Stop when found option in
SE::Yandex::Position - In
SE::Yandex when occurring errors in antigate did not change the proxy - Fixed parsing links to potentially dangerous sites in
SE::Yandex - JS scrapers: fixed work of check_content function with regular expressions that contain Cyrillic symbols
- JS scrapers: fixed freezing of threads when using tls
- JS scrapers: multiple fixes in the work of sockets