Once a week or month we should update the similarity.similarity summary table and re-generate the annoy indicies. This should happen in a way that a new index is built without taking down the current one and then it should be swapped into place in a single file move operation