Comment 60 for bug 131094

/me starts lurking around at <email address hidden> :)

Another question. Do any of the other indexers out there work around this problem somehow? And if so, how?

I mean, the problem is many small write():s and blocks being allocated directly during write() instead of at page flush time, right? Can't you merge several write operations together? Or maybe you already do that "1000-5000 words at a time"? If not, could the on disk format be changed to allow for merging several write():s together?

Also, is it really necessary to fsync() so often?