| Filtering Scraping Amazon Bots [message #7715] |
Mon, 14 March 2016 09:30  |
Garry
 Messages: 6 Registered: January 2011
|
|
|
|
Hi I am getting a lot of visitors from some weird Amazon bot always in the format like
Hostname
ec2-54-198-253-195.compute-1.amazonaws.com
ec2-54-146-155-207.compute-1.amazonaws.com
(same format more addresses)
with an Agent like Mozilla/5.0 (Windows NT 6.1; WOW64; rv:28.0) Gecko/20100101 Firefox/28.0
Im not sure if this is a new bot or a scraper, it seems harmless I feel I want to count it as a bot and exclude them from my Stats
I tried adding in robot.php like
),
"alertsite" => array(
"icon" => "alertsite",
"title" => "Amazon",
"rule" => array(
"*compute-1\.amazonaws\.com" => "\\1"
),
"uri" => ""
),
Though that doesn't filter it out, may I ask how can I ad a Custom exclusion? or do this the right way, Thanks, Garry, Outback Central Australia
|
|
|
|
| Re: Filtering Scraping Amazon Bots [message #7716 is a reply to message #7715] |
Tue, 21 June 2016 11:31  |
|
|
| Garry wrote on Mon, 14 March 2016 09:30 |
with an Agent like Mozilla/5.0 (Windows NT 6.1; WOW64; rv:28.0) Gecko/20100101 Firefox/28.0
[ ... ]
Though that doesn't filter it out, may I ask how can I ad a Custom exclusion? or do this the right way, Thanks, Garry, Outback Central Australia
|
Hallo,
Unfortunately that is not possible, it only works with the user agent.
Gruß Jo
|
|
|
|