#The quick way to prevent robots visiting your site is put these two lines into the /robots.txt file on your server:
#User-agent: *
#Disallow: /

User-agent: *
Disallow: /tmp
Disallow: /logs
Disallow: /test