1 Theoretical possibility
1.1 /robots.txt – robots exclusion file
Create file /robots.txt:
User-agent: * Disallow: /
Search Engine Support: Google, Yahoo, Bing, …
1.2 Use page meta tags robots
<meta name="robots" content="noindex,nofollow" />
2 The only sure method
2.1 Password protected web – web server solution
Example for Apache server: httpd.apache.org/docs/2.0/programs/htpasswd.html
Create a file called .htpasswd:
user1:nbGwQ3aJkq3qE (e.g. user1:encrypt password1)
KxS Password Encrypter: www.kxs.net/support/htaccess_pw.html
Create a file .htaccess:
AuthName "Restricted Area" AuthType Basic AuthUserFile /mysite/.htpasswd AuthGroupFile /dev/null require valid-user
Upload .htpasswd (best) to the root or a non publically accessible directory on your server.
Upload .htaccess to the directory you wish to protect.
2.2 Password protected web – cms solution
Protected area for registered users dependent on a specific CMS.
2.3 Computers and Humans apart
Captcha: en.wikipedia.org/wiki/CAPTCHA
reCaptcha: recaptcha.net
Hidden tag: 15daysofjquery.com/safer-contact-forms-without-captchas/11/
Captcha alternatives: www.arraystudio.com/as-workshop/the-captcha-alternatives.html
Sources:
Detailed description of 6 methods to control what and how your content appears in search engines – 6 ways to stop Google and other search engines from indexing your site | Antezeta Web Marketing.
