Google update?

[scrapefun]

Did Google make a change? A lot slower all of the sudden. 4 different proxy providers same result. Thanks.

 

[Support]

Yes, Google has become much more aggressive in banning queries and showing captcha more often.

 

[bielawa]

Hi! Did you find a new solution to this problem?

 

[scrapefun]

Not much if anything we can do until Google stops being so aggressive on blocking proxies. Usually happens a few times a year for 3-4 days and then they ease back again.

At the moment scraping mobile version does perform better than desktop but it is still slower than usual.

I did notice one server of mine that is running version 1.2.2662 is scraping faster than 1.2.2672 no idea why. (Aparser preset, proxies, and server hardware exactly the same)

 

[bielawa]

Are there any updates? I just updated script to 1.2.2704 and no changes. About 10% queries are ok - 20 retries, 2000 private proxy. Current settings with chrome browser & headless mode disabled.

 

[scrapefun]

Unfortunately no. Google has the bot detection throttled really high. Mobile scraping works a lot better than desktop.

The two jobs below have the exact same settings, proxies, keywords, etc. Only difference is the top task is Mobile and bottom is Desktop. This is also with using sessions disabled. Even worse performance for both mobile and desktop with sessions enabled.

Wish I only needed mobile results but I need desktop as well.

 

[scrapefun]

I know I'm beating a dead horse at this point but is there really nothing to be done with Google desktop scraping? I've tried a dozen different proxy sources and none of them work for desktop but they all work fine for Mobile Google scraping. Nothing changed at all with the sessions or the js redirect detection?

The obvious solution is to just scrape mobile but I need desktop unfortunately

Thanks, appreciate your patience with me!

 

[t3z01]

I know I'm beating a dead horse at this point but is there really nothing to be done with Google desktop scraping? I've tried a dozen different proxy sources and none of them work for desktop but they all work fine for Mobile Google scraping. Nothing changed at all with the sessions or the js redirect detection?

The obvious solution is to just scrape mobile but I need desktop unfortunately

Thanks, appreciate your patience with me!

do you have a telegram where we can talk and share ideas?

 

[scrapefun]

Try the latest Beta version in members area downloads. Works a lot better. Still some issues but they are still working on it.

 

[bielawa]

what settings are you using? with chrome - almost 0% succes. Now trying http + xevil for solving captchas

 

[scrapefun]

The latest updates are working with Google desktop and mobile. Most likely the issue is proxies. What kind of query are you making? Top 10? 100? One page or multiple? Any special parameters like "site:"?

 

[bielawa]

Hi, currently almost no-problems. Just proxies issue. right now i'm shuffling from 50 results per page * 2 pages or 100 results & 1 page. No site: parameter (yet).