RAG vs fine-tuning
Should the model look your facts up, or learn a behaviour from examples?
Options weighed
Prompting only, RAG, fine-tuning, both
| Option | Facts change often | Answers must cite sources | Different users see different content |
|---|---|---|---|
| Prompting only | Good fit | Partial fit | Poor fit |
| RAG (retrieval) | Strong fit | Strong fit | Strong fit |
| Fine-tuning | Poor fit | Poor fit | Poor fit |
| RAG + fine-tuning | Strong fit | Strong fit | Strong fit |
What usually decides it
Whether the gap is knowledge that changes or behaviour that prompting cannot fix
Open the matrix: RAG vs fine-tuning