Build a 100% offline fast Retrieval Augmented Generation (RAG) system that runs without an internet connection, without cloud APIs, without OpenAI/Ollama Local RAG isn’t solved by just replacing OpenAI with a local open weights model. Document processing, embeddings, vector search, and inference all become part of the optimization problem. I tried Google LiteRT-LM GPU inference (+ streaming) with Qdrant Edge and compared it against the core Qdrant Client + Ollama pipeline.