For anyone who has access to PHP, here is a very simple way to prevent a search engine from having access to your website:<br><span style="font-family: arial,sans-serif;"></span><br style="font-family: arial,sans-serif;">
<span style="font-family: arial,sans-serif;">To add another exclusion setting, add the user-agent name encapsed in single quotes ( <i>YES:</i> <b>'</b> <i>NO:</i> <b>"</b> <i>or</i> <b>`</b> ) <i>as it appears</i> in a $_SERVER['HTTP_USER_AGENT'] call. This shouldn't be too hard to find out.</span><br style="font-family: arial,sans-serif;">
<span style="font-family: arial,sans-serif;">Do not change anything that is in <b style="color: rgb(255, 0, 0);">red</b>.<br>Place this code AT THE TOP of any page to be protected.</span><span style="font-family: arial,sans-serif;"></span><b><span style="font-family: courier new,monospace; color: rgb(255, 102, 0);"></span></b><br>
<br style="font-family: courier new,monospace;">
<span style="font-family: arial,sans-serif;"><b>NOTE:</b> Default mode for any non-specified user-agent is ALLOW ACCESS<br>( Included are a few common search engines. )<br><br>Remember, this file is executed on the server, not client. This makes the entire process totally secure.<br>
<br></span>********************************************************************************<b><span style="font-family: courier new,monospace; color: rgb(255, 0, 0);"></span></b><b><span style="font-family: courier new,monospace; color: rgb(51, 204, 0);"><br>
<br></span><span style="font-family: courier new,monospace; color: rgb(255, 0, 0);"><?php</span><br style="font-family: courier new,monospace; color: rgb(255, 0, 0);"><span style="font-family: courier new,monospace; color: rgb(255, 0, 0);">$agent = strtoupper($_SERVER['HTTP_USER_AGENT']);</span><br style="font-family: courier new,monospace; color: rgb(255, 0, 0);">
</b><span style="font-family: courier new,monospace;"><b><span style="color: rgb(255, 0, 0);">$no_go = array(</span></b>'Googlebot','Yahoo','MSN','archiver','Ask','ZyBorg'<b style="color: rgb(255, 0, 0);">);</b></span><br style="font-family: courier new,monospace;">
<b><span style="font-family: courier new,monospace; color: rgb(255, 0, 0);">$len = count($no_go);</span><br style="font-family: courier new,monospace; color: rgb(255, 0, 0);"><span style="font-family: courier new,monospace; color: rgb(255, 0, 0);">for ($i=0;$i<$len;$i++) {</span></b><br style="font-family: courier new,monospace;">
<span style="font-family: courier new,monospace;"><b style="color: rgb(255, 0, 0);">if (strpos($agent,$no_go[$i])!==FALSE) {die('');}</b></span><b style="color: rgb(51, 51, 255);"><span style="font-family: courier new,monospace;"></span></b><br style="font-family: courier new,monospace;">
<b style="color: rgb(255, 0, 0);"><span style="font-family: courier new,monospace;">}</span><br style="font-family: courier new,monospace;"><span style="font-family: courier new,monospace;">?></span></b><b><span style="font-family: courier new,monospace; color: rgb(51, 204, 0);"></span></b><b><span style="font-family: courier new,monospace; color: rgb(255, 0, 0);"></span></b><br>