Learn more about robots.txt from Matt Cutts

Have you got these templates?