Improvements
- Added 4 new scrapers for Instagram
Social::Instagram::Post - scraping data about posts, including comments and users who liked the post
Social::Instagram::Profile - scraping profile data and list of posts
Social::Instagram::Tag - scraping posts by tags
Social::Instagram::Geo - scraping posts in a specific location
- Added 2 new scrapers for SerpStat
Rank::SerpStat::Keyword - scraping data by keyword
Rank::SerpStat::Domain - scraping data by domain/link
- Added support for fractional numbers in the macroes of substitutions {num}
- Added support for Node.js in tools.js, now you can use Node.js features (including modules) in conventional presets in all fields except Parse custom results, filters and Result builders
- Template Toolkit templates in scraper settings now work for all queries
- Stabilized work
SE::Google::Modern after changes by Google, due to which the number of ReCaptchas has slightly decreased
- Improved response checking in
Maps::Yandex, improved collection of images, and also added the ability to collect links to the organization's page - API: for oneRequest/bulkRequest added needData parameter indicating whether to pass data/pages in response, used to save memory, disabled by default
- Updated apps.json and user-agents.txt, it is also recommended to update these files when installing the update
- Fixed a situation in which SE::Google::Modern received 597 status code in response
- In
SE::Yandex fixed a situation in which “empty” links appeared in the results, and also fixed scraping snippets in the mobile type of serp - Fixed a rare issue with
SE::Google::Translate, when the scraper received 403 status in response - Fixed definition of query language in SE::Google::Translate
- Fixed work of
SE::YouTube, and also fixed collecting of $title - In
Rank::Social::Signal removed variable $linkedin_share due to cessation of support from LinkedIn - In
Shop::Yandex::Market fixed scraping $features for some types of queries - Fixed request url in
SE::DuckDuckGo
- Fixed bug in
Rank::Bukvarix::Domain, due to which in some cases the scraping was completed with an error - In scrapers Maps::* fixed work with negative coordinates
- In
Rank::SEMrush the error of determining the "success" of the request has been fixed - Fixed a bug in tools.js that occurred after updating V8
- API: fixed work of method getAccountsCount
- JS scrapers: fixed a bug with slash in check_content
Last edited: