siddhant

Knowledge / Generative AI

Retrieval-Augmented Generation

External knowledge retrieval combined with generative models.

By Siddhant Krishna · Published 2026-10-06 · Updated 2026-10-06

01

RAG Pipeline

A retrieval-augmented system first identifies potentially relevant external information and then conditions generation on that information.

q → retrieve(D,q) → context(C) → P(y|q,C)

02

Engineering Variables

  • Chunk size and overlap.
  • Embedding model.
  • Indexing strategy.
  • Retriever recall.
  • Reranking.
  • Context-window allocation.
  • Citation and provenance.
  • Freshness and document lifecycle.

References

  1. Lewis et al. (2020).
    https://arxiv.org/abs/2005.11401

Related

Contact

Get in Touch

Want to chat? Just shoot me a dm with a direct question on twitter and I'll respond whenever I can. I will ignore all soliciting.