SE::Quora - Quora search results scraper
Overview of the scraper
SE::Quora - Quora search results scraper.Collects results from the service of the same name.
You can use automatic query multiplication, substitution of subqueries from files, permutation of alphanumeric combinations and lists to obtain the maximum possible number of results.
A-Parser functionality allows you to save SE::Quora scraper settings for future use (presets), set scraping schedules, and much more.
Saving results is possible in the form and structure you need, thanks to the built-in powerful Template Toolkit which allows you to apply additional logic to results and output data in various formats, including JSON, SQL, and CSV.
Collected data
Quora has 6 types of results: Questions, Answers, Posts, Profiles, Topics, and Spaces. Each type has a different set of data, so in the scraper, each type is recorded in its own separate array. Depending on the type, the following are collected:
- Link to the question, question text, number of answers, and date
- Answer author, answer text, links to media in the answer, date and time of the answer, number of upvotes, views, and shares
- Link to the post, post title, post text, links to media in the post, name and profile link of the author, date and time of publication, number of upvotes, views, and shares
- and other data depending on the result type
Capabilities
- Selecting the required result type or scraping all at once
- Selecting the time range for results
Use Cases
- Any scenarios where you need to obtain data from Quora
Queries
You should specify keywords as queries, for example:
test
Output results examples
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, which allows it to output results in arbitrary form, as well as in structured formats like CSV or JSON
Default output
Result format:
$questions.format('$question\n')
Result example:
What is the best free online IQ test?
What is software testing?
How reliable is the DNA testing offered by sites like Ancestry.com or 23andMe?
How can I pass a urine drug test for meth?
How do you know if you're really smart without taking an IQ test?
Which is the best test series for CAT?
How reliable are online IQ tests?
Is software testing a good career choice?
What is the best test series for the GATE examination?
What is the best way to get my IQ checked online?
...
Obtaining cookies
Obtaining the mandatory option for authorization
Spoiler: how to find cookies?
- Go to quora.com and log in
- Open Developer Tools (F12) and refresh the page
- Go to the Network tab, find the request to quora.com
- Copy the entire cookie string
According to our tests, accounts are not banned (this may change in the future), but when scraping in more than 10 threads, Quora starts issuing errors and messages about too many requests. Therefore, it is recommended to scrape in a small number of threads or use cookies from multiple accounts.
Possible settings
| Parameter | Default value | Description |
|---|---|---|
| Pages count | 5 | Number of result pages |
| Results type | Questions | Result type |
| Results time | All time | Result time |
| Cookie | Field for specifying cookies from authorized accounts. You can specify cookies from multiple accounts; the scraper will randomly choose from them for each attempt. |