Gestell has solved search-based reasoning Mar 31th, 2025
LLMs were made to be tools of knowledge and intelligence, not to search through messy databases. The current Retrieval Augmented Generation (’RAG‘) tooling that exists expects LLMs to be experts at search, and it resultantly fails to achieve results. Fundamentally, RAG is an overwhelming task for an LLM, the attempt to find truth in data devolves as more context of ’similar chunks‘ are shoved into a transformer, degrading the quality of the attention ranking mechanism