# /robots.txt for http://www.aber.ac.uk/ # comments to www@aber.ac.uk # updated 13/11/07 by Simon Marshall # Last updated 15/09/09 by Simon Marshall User-agent: egothor Disallow: /en/site-map.php Disallow: /cy/site-map.php User-agent: * # Disallow: /cgi-bin/ Disallow: /en/student/examination-conventions-old/ Disallow: /cy/student/examination-conventions-old/ Disallow: /en/english/staff/wws/ Disallow: /~webwww/restricted/ Disallow: /web/restricted/ Disallow: /~infolib/ Disallow: /~ccuwww/ Disallow: /~syswww/ Disallow: /systems/ Disallow: /~pedwww/ Disallow: /accessible.php Disallow: /compsci/www/RoomBooking/ Disallow: /media/sections/go.php Disallow: /en/staff/personnel/ Disallow: /cy/staff/personnel/ Disallow: /is/ejournals/ Disallow: /en/staff/rae/ Disallow: /cy/staff/rae/ Disallow: /en/staff/court/ Disallow: /cy/staff/court/ Disallow: /cla/ Disallow: /en/inc/ Disallow: /cy/inc/ Disallow: /~arcwww/ Disallow: /~altwww/ # Leave this comment in. It just ensures that the file ends corectly.