We will plan to default to the in-memory index, but allow one to use the file-based index if the memory requirements are too high.