Search engines crawlers being blocked

Customer support forums for Atomic Protector (formerly Atomic Secured Linux). There is no such thing as a bad question here as long as it pertains to using Atomic Protector. Newbies feel free to get help getting started or asking questions that may be obvious. Regular users are asked to be gentle. :-)
Post Reply
dutchnet
New Forum User
New Forum User
Posts: 3
Joined: Thu Jun 05, 2014 6:29 pm
Location: Netherlands

Search engines crawlers being blocked

Unread post by dutchnet »

in the recent events screen the search engine crawlers like google and msn bots are being blocked on all our ASL servers.

some of the IP addresses being blocked:

66.249.65.139
66.249.67.133
66.249.67.95

from the config file /etc/asl/config

MODSEC_00_WHITELIST="no"
MODSEC_00_SEARCHENGINE="yes"
MODSEC_00_AUTOWHITELIST_SEARCHENGINE="yes"
MODSEC_00_ANTIEVASION="yes"
MODSEC_00_STRICT="no"
MODSEC_00_RBL="yes"


from /etc/resolv.conf

# Generated by NetworkManager
search dutch-net.com
nameserver 127.0.0.1
nameserver 80.84.230.153
nameserver 80.84.230.151
options single-request
Top
scott
Atomicorp Staff - Site Admin
Atomicorp Staff - Site Admin
Posts: 8355
Joined: Wed Dec 31, 1969 8:00 pm
Location: earth
Contact:
Contact scott

Re: Search engines crawlers being blocked

Unread post by scott »

Are you using nginx as a reverse proxy or ipv6 by any chance?
Top
Post Reply

Return to “Atomic Protector (formerly ASL)”