Улучшение Custom Proxy Delay

scrapefun

A-Parser Enterprise License
A-Parser Enterprise
It would be great if we could set how long to wait after a proxy has been used before it can be used again.

If you wait 30-45 seconds between each query per proxy you can pretty much scrape Google indefinitely without proxy ban (with dedicated/private proxies). So to be able to control this would really enhance the software.

Thanks!
 
After review of code I can confirm that use Max threads per proxy + Request delay(in parsers settings) is suitable for this case

It's work like this:
lock proxy for thread
wait some time before do request
release proxy lock
 
Назад
Верх