View file robots.txt

## Robots File for Next Auto Index ##
User-agent: Googlebot
Disallow: 

User-agent: Googlebot-Image
Disallow: 

User-agent: Googlebot-Mobile
Disallow: 

User-agent: MSNBot
Disallow: 

User-agent: PSBot
Disallow: 

User-agent: Slurp
Disallow: 

User-agent: Yahoo-MMCrawler
Disallow: 

User-agent: yahoo-blogs/v3_9
Disallow: 

User-agent: teoma
Disallow: 

User-agent: Scrubby
Disallow: 

User-agent: ia_archiver
Disallow: 

Sitemap: /sitemap.xml