Interview knowledge

RAG - Retrieval-Augmented Generation

Growingest.further readingStarted 6 Jul 20261 min read#ai#engineering

A model has to:

  • find every one of those
  • realise they're related
  • ignore 99% of everything else
  • remember them all
  • compare them

That's basically Retrieval-Augmented Generation (RAG), except your retrieval system is "the model's attention".

Sources