Hallo Jörg,
über die Requests und deren Herkunft wollen wir schon mehr wissen um überhaupt darüber nachdenken zu können wissen, ob es ein guter oder böser bot ist.
Möchte das hier ja nicht zuspammen, aber hier mal ein paar IPs von vielen mehr:
ip;auto_block;block_time;reason "62.157.32.4";"0";"1382104855";"Unknown Bot - Potsdam (Werder) - Telekom/Telefonica" "62.157.33.77";"0";"1382053533";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.34.113";"0";"1382060345";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.38.187";"0";"1382096063";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.39.84";"0";"1382096055";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.40.57";"0";"1382060841";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.41.146";"0";"1382096062";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.42.24";"0";"1382096052";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.42.30";"0";"1382095826";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.43.248";"0";"1382109396";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.44.58";"0";"1382060312";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.46.126";"0";"1382111679";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.48.108";"0";"1382096062";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.48.167";"0";"1348401262";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.49.111";"0";"1382099185";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.50.115";"0";"1382096055";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.50.155";"0";"1382096057";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.50.94";"0";"1382107242";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.51.145";"0";"1382099186";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.51.96";"0";"1382096058";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.54.108";"0";"1382053557";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.54.45";"0";"1382106847";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.54.79";"0";"1382056118";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.54.93";"0";"1382053547";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.55.16";"0";"1382051015";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.55.90";"0";"1382102247";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.56.110";"0";"1382096061";"Unknown Bot - Potsdam (Werder) - Telekom/Telefonica" "62.157.56.174";"0";"1382096054";"Unknown Bot - Potsdam (Werder) - Telekom/Telefonica" "62.157.56.73";"0";"1382096060";"Unknown Bot - Potsdam (Werder) - Telekom/Telefonica" "62.157.57.200";"0";"1382096054";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.57.217";"0";"1382056356";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.58.99";"0";"1382050948";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.59.79";"0";"1382096058";"Unknown Bot - Potsdam - Telekom/Telefonica" "62.157.60.39";"0";"1382096061";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.60.68";"0";"1382107242";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.63.111";"0";"1382061124";"Unknown Bot - Berlin - Telekom/Telefonica" "62.157.63.43";"0";"1382096007";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.105.224";"0";"1382095828";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.114.95";"0";"1382054295";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.118.71";"0";"1382096057";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.12.144";"0";"1382051033";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.120.189";"0";"1382060385";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.17.172";"0";"1382096056";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.17.203";"0";"1382096134";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.180.71";"0";"1382096062";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.43.145";"0";"1382108058";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.52.214";"0";"1382096063";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.53.63";"0";"1382053745";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.6.248";"0";"1382111680";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.63.140";"0";"1382096052";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.79.56";"0";"1382107242";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.82.78";"0";"1382106847";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.98.19";"0";"1382056184";"Unknown Bot - Berlin - Telekom/Telefonica" "77.12.99.242";"0";"1382096056";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.15.234";"0";"1382096053";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.164.86";"0";"1382100175";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.171.21";"0";"1382095896";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.19.82";"0";"1382061034";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.23.62";"0";"1382096054";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.240.254";"0";"1382112531";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.37.255";"0";"1382104856";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.45.2";"0";"1382096062";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.53.80";"0";"1382055707";"Unknown Bot - Berlin - Telekom/Telefonica" "77.185.59.74";"0";"1382109396";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.115.200";"0";"1382095799";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.205.131";"0";"1382059552";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.52.42";"0";"1382099185";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.57.74";"0";"1382096061";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.6.255";"0";"1382105215";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.64.186";"0";"1382060711";"Unknown Bot - Berlin - Telekom/Telefonica" "77.186.66.245";"0";"1382099186";"Unknown Bot - Berlin - Telekom/Telefonica" "77.188.103.254";"0";"1382033099";"Unknown Bot - Berlin - Telekom/Telefonica" "77.188.126.125";"0";"1382096058";"Unknown Bot - Berlin - Telekom/Telefonica" "77.188.70.182";"0";"1382102247";"Unknown Bot - City not found (DE) - Telekom/Telefonica" "77.188.76.152";"0";"1382096059";"Unknown Bot - Berlin - Telekom/Telefonica" "77.188.77.206";"0";"1382096059";"Unknown Bot - Berlin - Telekom/Telefonica" "77.188.77.245";"0";"1382096062";"Unknown Bot - Berlin - Telekom/Telefonica" "77.188.97.120";"0";"1348401286";"Unknown Bot - Berlin - Telekom/Telefonica" "78.52.68.128";"0";"1382095800";"Unknown Bot - City not found (DE) - Telekom/Telefonica" "78.52.68.68";"0";"1382104855";"Unknown Bot - Berlin - Telekom/Telefonica" "78.52.70.9";"0";"1382059756";"Unknown Bot - Berlin - Telekom/Telefonica" "79.193.135.136";"0";"1382096058";"Unknown Bot - Berlin - Telekom/Telefonica" "79.193.144.127";"0";"1382096063";"Unknown Bot - Berlin (Biesenthal) - Telekom/Telefonica" "79.193.151.85";"0";"1382054707";"Unknown Bot - Berlin - Telekom/Telefonica" "79.193.155.52";"0";"1382105348";"Unknown Bot - Berlin (Bestensee) - Telekom/Telefonica" "79.193.156.205";"0";"1382095830";"Unknown Bot - Berlin - Telekom/Telefonica" "79.193.165.115";"0";"1382059827";"Unknown Bot - Berlin - Telekom/Telefonica" "79.193.169.124";"0";"1382096061";"Unknown Bot - Berlin (Biesenthal) - Telekom/Telefonica" "79.193.186.69";"0";"1382099252";"Unknown Bot - Berlin (Borgsdorf) - Telekom/Telefonica" "79.193.188.72";"0";"1382096054";"Unknown Bot - Berlin (Wandlitz) - Telekom/Telefonica" "79.247.112.121";"0";"1382096053";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.112.143";"0";"1382102247";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.113.23";"0";"1382055697";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.114.116";"0";"1382096063";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.115.114";"0";"1382095752";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.115.17";"0";"1382096053";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.115.219";"0";"1382105215";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.115.249";"0";"1382104855";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.119.133";"0";"1382033108";"Unknown Bot - Berlin - Telekom/Telefonica" "79.247.119.141";"0";"1382112530";"Unknown Bot - City not found (DE) - Telekom/Telefonica"
Aus dem Serverlog ein Beispiel:
92.231.251.95 - - [18/Oct/2013:10:33:37 +0200] "GET /?news_suche=Prinz%20George HTTP/1.1" 200 45842 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10" 62.157.48.108 - - [18/Oct/2013:10:33:37 +0200] "GET /?news_suche=Prinz%20William HTTP/1.1" 200 47513 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10" 92.231.251.95 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&output=rss HTTP/1.1" 200 6481 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10" 77.185.45.2 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&nt=3 HTTP/1.1" 200 21242 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 92.225.90.24 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&output=rss HTTP/1.1" 200 6633 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&nt=4 HTTP/1.1" 200 21268 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&nt=0 HTTP/1.1" 200 46528 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&nt=7 HTTP/1.1" 200 46169 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 79.193.169.124 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&nt=5 HTTP/1.1" 200 48665 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 92.225.188.201 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=7&face=2 HTTP/1.1" 200 27875 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 77.185.45.2 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=7 HTTP/1.1" 200 48066 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 91.23.29.213 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=7&face=2 HTTP/1.1" 200 27507 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=5 HTTP/1.1" 200 48514 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 92.231.251.95 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=3 HTTP/1.1" 200 38345 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=4 HTTP/1.1" 200 37229 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 84.191.144.162 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=1 HTTP/1.1" 200 40025 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=2 HTTP/1.1" 200 32622 "-" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19) Gecko/2010102809 Iceweasel/3.0.6 (Debian-3.0.6-3)" 62.157.48.108 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+William&hpp=10&nt=6 HTTP/1.1" 200 31951 "-" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2" 91.23.56.64 - - [18/Oct/2013:10:33:38 +0200] "GET /?q=Prinz+George&hpp=10&nt=1 HTTP/1.1" 200 26914 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10"
Wo will ich hin? Wissen, was das ganze soll, denn ein guter Bot ist das sicherlich nicht.
Herzliche Grüße, Robert