To create a robots.txt you will need RobotsTXT module. It creates the file for you, place it in your root directory and allows you to dynamically edit it without using Drupal.

Why Drupal? Everyone wants to know why choose Drupal, and how does it compare to WordPress and Joomla? A quick Web search will find endless comparisons and reviews.

Working with Drupal is not for the timid -- but these 10 free modules could make things easier for developers and administrators.