Query reduction and old retrieval methods meet RAG

Abstract: A dive into the retrieval augmented generation for next token completion task. We explore how old retrieval methods compare and even outperform modern day dense retrievers. Show the immense potential of query reduction, and suggest a few methods for selecting the reduced subquery candidate.