Glossary of Terms

Scraper

A scraper is a script that collects data from specified web resources based on given queries, processes them, and outputs the result in a default or specified format.

Built-in scrapers

Built-in scrapers are pre-installed scrapers available by default, whose functionality is maintained on an ongoing basis.

Custom JS scrapers

Custom JS scrapers are open-source scrapers written in JavaScript and available in the JS Scraper Editor, which can be exported and imported along with a task. Examples of such scrapers can be found in the Scraper and Preset Catalog.

Preset

A preset is both a saved task created in the Task Editor by selecting a combination of scrapers, settings, and options to perform a task, and individual scraper settings (settings preset).

Scraper settings

Scraper settings are options that can be edited or changed (overridden) for a different scraper algorithm to obtain a non-standard result.

Saved task

A saved task is a preset that has been saved and can be reused.

Thread config

A thread config is a set of thread settings that can be saved under a name and reused with different presets.

Threads

Threads are multiple contexts launched simultaneously for scraping, in which the scraper executes queries in parallel, rotates proxies according to a specific strategy defined in the Thread config, and logs the scraping execution process for each query.

Proxy checker

A proxy checker is a controller responsible for loading and checking proxies using a set of proxy checker settings.

Proxy

A proxy is a string/array of strings of a certain format (or a link to a string/array of strings) that allows hiding the real IP address by sending scraping requests and transferring data packets from the server to the client using an intermediate proxy server.

Result template

A result template is a template that defines the format and collected data of the result, set directly or using the built-in Template Toolkit engine.