SE::Yandex::Balaboba - Balaboba text scraper
Scraper overview
SE::Yandex::Balaboba - a text scraper for Balaboba.Retrieves texts from the service of the same name.
You can use automatic query multiplication, substitution of subqueries from files, iteration of alphanumeric combinations and lists to obtain the maximum possible number of results.
A-Parser functionality allows you to save SE::Yandex::Balaboba scraper settings for future use (presets), set a scraping schedule, and much more.
Saving results is possible in any form and structure you need, thanks to the built-in powerful Template Toolkit which allows applying additional logic to results and outputting data in various formats, including JSON, SQL, and CSV.
Collected data
- Generated text
- Style used to generate the text
- Image link
Capabilities
- Scrape unique texts with the ability to choose the text style (Style parameter):
Recipes (RU),Short stories (RU),Recipes (EN)and others - Choose a style number that can be seen in the browser and scrape with the desired text style if it is not in the style selection option (ID of custom style parameter)
Use cases
- Bulk collection of unique texts
Queries
Phrases from which generation will begin should be specified as queries, for example:
Once upon a time
Query substitutions
You can use built-in macros for automatic substitution of subqueries from files. For example, if we want to add a list of other words to each query, we specify several main queries:
Once upon a time
Fantasy
Tower defense
In the query format, we specify a substitution macro for additional words from the keywords.txt file; this method allows increasing query variability manifold:
{subs:keywords} $query
This macro will create as many additional queries as there are in the file for each original search query, which in total will give [number of original queries] x [number of queries in the Keywords file] = [total number of queries] as a result of the macro's operation.
For example, if the keywords.txt file contains:
free
online
As a result, the substitution macro will turn 3 main queries into 6:
free fantasy
online fantasy
free tower defense
online tower defense
free rpg
online rpg
Output results examples
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in arbitrary form, as well as structured, such as CSV or JSON.
Default output
Result format:
$style: $text\n
Result example:
Without style (RU): Once upon a time there were three little pigs, three brothers.
And each of them had a house.
They were very friendly pigs.
They helped each other in everything, and if anything happened to one of them, the other brother always came to the rescue.
One day it started snowing heavily, and the brothers decided to hide from it in their houses.
But then a gray wolf came around the corner.
He was hungry and saw that the houses had no doors.
Then the wolf decided to go into the first house and eat the pig.
The wolf quickly opened the door and looked inside.
Possible settings
| Parameter | Default value | Description |
|---|---|---|
| Style | Random (All languages) | Text style selection |
| ID of custom style | Set the style number for text generation | |
| Repeat if Balaboba reports about error | ☑ | Retry scraping if Balaboba showed an error message |
| Repeat if Balaboba reports about bad query | ☑ | Retry scraping if Balaboba showed a message due to an invalid query |