# robots.txt to help search engines find static representation of Google Web Toolkit content # which is dynamic. NO CLOAKING IS BEING ATTEMPTED - we just want robots to find a static # representation of the dynamic page presented to regular clients by the URL http:/www.trcs.org.uk/ User-agent: * Disallow: /css/ Disallow: /dynamic/ Disallow: /static/ Disallow: /images/ Disallow: /membersforum/ Disallow: /php/ Disallow: /phpMyAdmin/ Disallow: /stats/ # Old site structure - needed to enable GoogleTools to remove broken links! Disallow: /about/ Disallow: /anims/ Disallow: /breeders_list/ Disallow: /contact/ Disallow: /gallery/ Disallow: /history/ Disallow: /home/ Disallow: /kitten_list/ Disallow: /links/ Disallow: /membership/ Disallow: /news/ Disallow: /rescue_rehome/ # Bots should now find index.php by default which should point them to static/index.html # I guess since our http server probably won't serve a listing /dynamic won't be found anyways!