# This robots file disallows all search robots from indexing the aidbase site. # A particular problem was noted with the MSN bot which seems to start indexing # the entire web through aidbase. # The file must live in the site root - i.e. with index.html. # See example at www.aidbase.org/robots.txt User-agent: * Disallow: /loband/page Disallow: /loband/filter Disallow: /loband/badpagereport Disallow: /loband/additional Disallow: /loband/postfeedback Disallow: /loband/test