So you mean that index.php should serve the robots.txt file?
If so how about having a generic way of serving files directly trough index.php? The files could be defined in an array in a .ini file which the index.php checks before doing eZ publish kernel functionality.
Yes, we need a way of serving up system files like robots.txt and also to choose to have a 404 page give a 404 header so spiders will know to stop when they hit a 404.
This needs to be done via index.php. Paul just suggested to me that maybe we use the error module to sort through files like this?
Tony
Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development