Comment 15 for bug 266553

Another question: is there no standard (de-facto or
otherwise) for generic markup that tells indexers not to
index a particular section? IOW, for
ARCHIVE_INDEXING_ENABLE and ARCHIVE_INDEXING_DISABLE, is
there some generic value that would instruct most (all?)
indexers to ignore that section? Or does it necessarily
have to be indexer specific?

I'm thinking of the situation where you might have ht://Dig
installed locally, but your archives are still being
spidered by external indexers. It would be good if
something more generic could be added to Defaults.py.in