SE::Yahoo::Suggest - Yahoo Suggest Scraper
Overview of the scraper
Yahoo keyword suggestion scraper. The Yahoo suggestion scraper solves one of the main SEO tasks, namely the rapid automated acquisition of an expanded semantic core. Thanks to the SE::Yahoo::Suggest scraper, you can automatically collect keyword databases from Yahoo search engine suggestions by query. Using the SE::Yahoo::Suggest scraper, you can easily and quickly scrape Yahoo suggestions for a query based on the selected domain.
Thanks to the multithreading of A-Parser, the query processing speed can reach 7700 queries per minute, which on average allows obtaining up to 51000 results per minute.
You can use automatic query multiplication, substitution of subqueries from files, permutation of alphanumeric combinations and lists to obtain the maximum possible number of results. Using results filtering you can immediately clean the result by removing all unnecessary trash (using negative keywords).
A-Parser functionality allows you to save SE::Yahoo::Suggest scraping settings for future use (presets), set scraping schedules, and much more.
Saving results is possible in the form and structure you need, thanks to the built-in powerful Template Toolkit which allows applying additional logic to results and outputting data in various formats, including JSON, SQL, and CSV.
Collected data
- Number of results per query
- Query suggestions
Capabilities
- Domain selection
Use Cases
- Keyword database collection
Queries
Search phrases should be specified as queries, for example:
write essay
Football
Waterfall
Speak in english
Cats and dogs
forex
cheap essay
Query substitutions
You can use built-in macros for automatic substitution of subqueries from files; for example, if we want to add a list of other words to each query, we specify several main queries:
essay
article
thesis
In the query format, we specify a substitution macro for additional words from the file Keywords.txt; this method allows increasing query variability manifold:
{subs:Keywords} $query
This macro will create as many additional queries as there are in the file for each original search query, which will result in [number of original queries(domains)] x [number of queries in the Keywords file] = [total number of queries] as a result of the macro's operation.
For example, if the file Keywords.txt contains:
buy
cheap
As a result, the substitution macro will turn 3 main queries into 6:
buy essay
cheap essay
buy article
cheap article
buy thesis
cheap thesis
Output results examples
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in arbitrary form, as well as in structured formats like CSV or JSON
Exporting a list of suggestions
Same as in SE::Google::Suggest.
Output to a CSV table
Same as in SE::Google::Suggest.
Keyword competition
Saving in SQL format
Result format:
[% FOREACH results;
"INSERT INTO serp VALUES('" _ query _ "', '"; suggest _ "')\n";
END %]
Result example:
INSERT INTO serp VALUES('write essay', 'write essay for me')
INSERT INTO serp VALUES('write essay', 'write essay online')
INSERT INTO serp VALUES('write essay', 'write essay for you')
INSERT INTO serp VALUES('write essay', 'write essay free')
INSERT INTO serp VALUES('write essay', 'write essays')
INSERT INTO serp VALUES('write essay', 'write essay conclusion')
INSERT INTO serp VALUES('write essay', 'write essay on covid 19')
INSERT INTO serp VALUES('write essay', 'write essay today')
INSERT INTO serp VALUES('write essay', 'write essays for money')
INSERT INTO serp VALUES('write essay', 'write essay online for free')
...
Dumping results to JSON
Same as in SE::Google::Suggest.
Results processing
A-Parser allows processing results directly during scraping; in this section, we have listed the most popular cases for the SE::Yahoo::Suggest scraper
Parse to level option
Same as in SE::Google::Suggest.
Results filtering (using negative keywords)
Same as in SE::Google::Suggest.
Possible settings
| Parameter name | Default value | Description |
|---|---|---|
| Yahoo domain | sugg.search.yahoo.com | Selection of the Yahoo domain, allows choosing the search language |