Can google block you for too many search queries?

**TurnOfTide** · 02-08-2010, 06:18 PM

Similar to how yahoo will ip ban and give you a Http status code of 999 - chill the fuck out. Will google IP ban you or send you a captcha if you do too many google queries.... like say, 200 in a day, 500, 1k, 2k, etc. Or just do too many too fast. This has to do with a multi-threaded app which can potentially churn out a lot of queries.

**Audio** · 02-08-2010, 06:19 PM

yep, google does hit you with a captcha after a ton of queries too fast
im not sure about daily limits, but there is def rate limiting

**updapunx** · 02-08-2010, 06:19 PM

yeah, google throws up a similar page that says you are conducting too many searches and to protect the users of google they are temporarily stopping results from being displayed.

**GetThatLOLMoney** · 02-08-2010, 06:22 PM

Originally Posted by Audio

yep, google does hit you with a captcha after a ton of queries too fast
im not sure about daily limits, but there is def rate limiting

this and I'm pretty sure if you search certain types of strings they do it even quicker.

**TurnOfTide** · 02-08-2010, 06:23 PM

Also, once you complete the captcha... does it keep asking for it over and over or does it sort of give you some more chances to ask for more queries before another captcha? .....IIRC last time I was using tor (at least 2 years ago), it seemed to me like I had to enter that captcha more than once.

**psil** · 02-08-2010, 06:48 PM

Originally Posted by TurnOfTide

Also, once you complete the captcha... does it keep asking for it over and over or does it sort of give you some more chances to ask for more queries before another captcha? .....IIRC last time I was using tor (at least 2 years ago), it seemed to me like I had to enter that captcha more than once.

It depends on how the level of aggressiveness and the specific queries. Sometimes, you'll get one that lasts for a couple of pages of 10, sometimes you get hit once per page.

Use 100 results per page to save money on decaptcher.

**KOiN** · 02-08-2010, 06:58 PM

Originally Posted by Audio

yep, google does hit you with a captcha after a ton of queries too fast

**tric** · 02-08-2010, 10:00 PM

Use proxies, rotate thru google hosts, if possible stray from using any inurl: , intext: , intitle:, and add a decent pause between pages... other than that, use bing/yahoo.

Code:

www.google.com
216.239.51.100
216.239.51.101
216.239.51.104
216.239.51.107
216.239.51.115
216.239.51.184
216.239.51.19
216.239.51.44
216.239.51.81
216.239.51.83
216.239.51.84
216.239.51.99
216.239.59.100
216.239.59.101
216.239.59.102
216.239.59.103
216.239.59.104
216.239.59.107
216.239.59.115
216.239.59.147
216.239.59.17
216.239.59.18
216.239.59.184
216.239.59.19
216.239.59.44
216.239.59.81
216.239.59.83
216.239.59.84
216.239.59.99
64.233.161.100
64.233.161.101
64.233.161.102
64.233.161.104
64.233.161.107
64.233.161.115
64.233.161.147
64.233.161.18
64.233.161.184
64.233.161.19
64.233.161.44
64.233.161.81
64.233.161.83
64.233.161.84
64.233.161.91
64.233.161.99
64.233.167.104
64.233.167.107
64.233.167.115
64.233.167.147
64.233.167.18
64.233.167.184
64.233.167.19
64.233.167.44
64.233.167.81
64.233.167.83
64.233.167.84
64.233.167.91
64.233.167.99
64.233.169.104
64.233.169.107
64.233.169.115
64.233.169.184
64.233.169.19
64.233.169.44
64.233.169.81
64.233.169.83
64.233.169.84
64.233.169.99
64.233.171.100
64.233.171.101
64.233.171.102
64.233.171.104
64.233.171.107
64.233.171.115
64.233.171.147
64.233.171.18
64.233.171.184
64.233.171.19
64.233.171.44
64.233.171.81
64.233.171.83
64.233.171.84
64.233.171.99
64.233.179.100
64.233.179.101
64.233.179.104
64.233.179.107
64.233.179.115
64.233.179.184
64.233.179.19
64.233.179.44
64.233.179.81
64.233.179.83
64.233.179.84
64.233.179.91
64.233.179.93
64.233.179.99
64.233.183.103
64.233.183.104
64.233.183.107
64.233.183.115
64.233.183.147
64.233.183.17
64.233.183.18
64.233.183.184
64.233.183.19
64.233.183.44
64.233.183.81
64.233.183.83
64.233.183.84
64.233.183.91
64.233.183.93
64.233.183.99
64.233.185.100
64.233.185.101
64.233.185.104
64.233.185.107
64.233.185.115
64.233.185.184
64.233.185.189
64.233.185.19
64.233.185.44
64.233.185.81
64.233.185.83
64.233.185.84
64.233.185.99
64.233.187.104
64.233.187.107
64.233.187.115
64.233.187.184
64.233.187.19
64.233.187.44
64.233.187.81
64.233.187.83
64.233.187.84
64.233.187.91
64.233.187.93
64.233.187.99
64.233.189.104
64.233.189.107
64.233.189.115
64.233.189.44
64.233.189.81
64.233.189.83
64.233.189.84
66.102.1.104
66.102.1.107
66.102.1.115
66.102.1.184
66.102.1.44
66.102.1.81
66.102.1.83
66.102.1.84
66.102.1.91
66.102.1.93
66.102.9.100
66.102.9.101
66.102.9.102
66.102.9.104
66.102.9.107
66.102.9.115
66.102.9.147
66.102.9.18
66.102.9.184
66.102.9.81
66.102.9.83
66.102.9.84
66.102.9.99
66.249.81.100
66.249.81.101
66.249.81.102
66.249.81.104
66.249.81.107
66.249.81.115
66.249.81.147
66.249.81.18
66.249.81.19
66.249.81.44
66.249.81.81
66.249.81.83
66.249.81.84
66.249.81.99
66.249.83.100
66.249.83.101
66.249.83.104
66.249.83.107
66.249.83.115
66.249.83.184
66.249.83.19
66.249.83.44
66.249.83.81
66.249.83.83
66.249.83.84
66.249.83.99
66.249.89.104
66.249.89.107
66.249.89.115
66.249.89.184
66.249.89.19
66.249.89.44
66.249.89.81
66.249.89.83
66.249.89.84
66.249.89.99
66.249.91.104
66.249.91.107
66.249.91.115
66.249.91.147
66.249.91.18
66.249.91.184
66.249.91.19
66.249.91.44
66.249.91.81
66.249.91.83
66.249.91.84
66.249.91.91
66.249.91.93
66.249.91.99
66.249.93.100
66.249.93.101
66.249.93.104
66.249.93.107
66.249.93.115
66.249.93.184
66.249.93.19
66.249.93.44
66.249.93.81
66.249.93.83
66.249.93.84
66.249.93.91
66.249.93.93
66.249.93.99
72.14.205.100
72.14.205.101
72.14.205.102
72.14.205.104
72.14.205.107
72.14.205.115
72.14.205.147
72.14.205.184
72.14.205.189
72.14.205.19
72.14.205.44
72.14.205.81
72.14.205.83
72.14.205.84
72.14.205.99
72.14.207.100
72.14.207.101
72.14.207.104
72.14.207.107
72.14.207.115
72.14.207.184
72.14.207.19
72.14.207.44
72.14.207.81
72.14.207.83
72.14.207.84
72.14.207.91
72.14.207.99
72.14.209.101
72.14.209.104
72.14.209.107
72.14.209.115
72.14.209.184
72.14.209.19
72.14.209.44
72.14.209.81
72.14.209.83
72.14.209.84
72.14.209.99
72.14.211.100
72.14.211.101
72.14.211.104
72.14.211.107
72.14.211.115
72.14.211.184
72.14.211.19
72.14.211.44
72.14.211.81
72.14.211.83
72.14.211.84
72.14.211.99
72.14.215.101
72.14.215.104
72.14.215.107
72.14.215.115
72.14.215.184
72.14.215.19
72.14.215.44
72.14.215.81
72.14.215.83
72.14.215.84
72.14.215.99
72.14.217.101
72.14.217.102
72.14.217.104
72.14.217.107
72.14.217.115
72.14.217.147
72.14.217.184
72.14.217.19
72.14.217.44
72.14.217.81
72.14.217.83
72.14.217.84
72.14.217.99
72.14.219.100
72.14.219.104
72.14.219.107
72.14.219.115
72.14.219.44
72.14.219.81
72.14.219.83
72.14.219.84
72.14.221.101
72.14.221.102
72.14.221.104
72.14.221.107
72.14.221.115
72.14.221.147
72.14.221.18
72.14.221.184
72.14.221.19
72.14.221.44
72.14.221.81
72.14.221.83
72.14.221.84
72.14.221.91
72.14.221.93
72.14.221.99
72.14.223.100
72.14.223.101
72.14.223.102
72.14.223.104
72.14.223.107
72.14.223.115
72.14.223.147
72.14.223.18
72.14.223.184
72.14.223.19
72.14.223.44
72.14.223.81
72.14.223.83
72.14.223.84
72.14.223.99
72.14.235.100
72.14.235.101
72.14.235.102
72.14.235.104
72.14.235.107
72.14.235.115
72.14.235.147
72.14.235.18
72.14.235.184
72.14.235.19
72.14.235.44
72.14.235.81
72.14.235.83
72.14.235.84
72.14.235.99
72.14.253.100
72.14.253.101
72.14.253.102
72.14.253.104
72.14.253.107
72.14.253.115
72.14.253.147
72.14.253.18
72.14.253.184
72.14.253.19
72.14.253.44
72.14.253.81
72.14.253.83
72.14.253.84
72.14.253.99

**psil** · 02-08-2010, 10:50 PM

If you're using your own OCR, go after certain localizations of Google, as the captchas will be [0-9] only.

I know this works on the Russian and Ukranian Googles, although I'm not sure about the others.

**mil0x** · 02-09-2010, 08:14 AM

Run Hrefer without proxies and you'll see G bans IPs pretty fast. You can even hit the block manually by using some of the search terms pointed out by tric, seen it happen running certain FF plugins as well.

**xtldx** · 02-09-2010, 08:18 AM

I have a project that scrapes google maps for mileage, and I sent about 10-15k queries a day. In addition all the computers here search google hundreds of times a day. I've only see google limit us a few times in the past 5 years, but I would assume I'm pumping another 10k search queries to them a day. All coming from the same IP. However, google could have whitelisted me as far as I know. Its all legitimate search traffic (except the map scraping).