General Information
A-Parser - scraper for professionals
A-Parser is a multithreaded scraper for search engines, site evaluation services, keywords, content (text, links, arbitrary data) and various other services (YouTube, images, translator...), A-Parser contains more than 110 built-in scrapers.
Key features of A-Parser include support for Windows/Linux platforms, a web interface with remote access capability, the ability to create your own scrapers without writing code, as well as the ability to create scrapers with complex logic in JavaScript / TypeScript with support for NodeJS modules.
Performance, proxy handling, CloudFlare protection bypass, a fast HTTP engine, support for Chrome management via puppeteer, scraper management via API and much more make A-Parser a unique solution; in this documentation, we will try to reveal all the advantages of A-Parser and ways to use it.
Use Cases
A-Parser is capable of solving many tasks; for convenience, we have divided them into categories by application areas, follow the links below for details
AI Integrations
SEO Specialists and Studios
For Business and Freelancers
For Developers
For Marketers
For E-commerce and marketplaces
For Affiliate Marketers
Features and Benefits
In this section, we have briefly listed the main advantages of A-Parser, more detailed information can be found at the link below
Overview of all features
⏩ A-Parser webinar: overview and Q&A
Multithreading and performance
- A-Parser runs on the latest versions of NodeJS and the V8 JavaScript engine
- AsyncHTTPX - proprietary HTTP engine implementation with support for HTTP/1.1 and HTTP/2, HTTPS/TLS, support for HTTP/SOCKS4/SOCKS5 proxies with optional authorization
- The scraper is capable of performing HTTP requests in almost unlimited number of simultaneous threads depending on the computer configuration and the task at hand
- Each task (set of queries) is scraped in the specified number of threads
- When using multiple scrapers in one task, each request to different scrapers is executed in different threads simultaneously
- The scraper can run multiple tasks in parallel
- Checking and loading proxies from sources also takes place in multithreaded mode
Creating your own scrapers
- Ability to create scrapers without writing code
- Use of regular expressions
- Support for multi-page scraping
- Content verification and next page detection
- User-agent replacement and the ability to change it randomly for each request
- Nested scraping - ability to substitute received results into queries
- Full-featured work with JSON: parsing and generation
- Ability to add your own JS functions and use them for processing received results directly in the scraper
Creating scrapers in JavaScript
- Rich built-in API based on async/await
- Support for TypeScript
- Ability to connect any NodeJS modules
- Chrome/Chromium management via puppeteer with support for separate proxies for each tab
Powerful tools for query and result generation
- Query Builder and Results Builder - allows modifying data (search and replace, extracting domain from link, transformations by regular expressions, XPath...)
- Substitution macros for queries - from file; iteration of words, characters, and numbers, including with a specified step
- Results filtering - by substring occurrence, equality, greater\less than
- Results deduplication - by string, by domain, by main domain (A-Parser knows all top-level domains, including those like co.uk, msk.ru)
- Powerful results templating engine based on Template Toolkit - allows outputting results in any convenient form (text, csv, html, xml, custom format)
- The scraper uses a system of presets - for each scraper, you can create many predefined settings for various situations
- Everything can be configured - no boundaries or restrictions
- Export and import of settings allows easy exchange of experience with other users