n4nAI

Topic

LlamaIndex Retrieval Evaluation & Metrics

12 posts on llamaindex retrieval evaluation & metrics — part of framework tutorials on the n4n AI blog.

Framework tutorialsGuide

Track RAG regression in LlamaIndex with evaluation metrics

A practical guide to building regression tests for LlamaIndex RAG pipelines using evaluation metrics, with code examples and common pitfalls.

5 min read
Framework tutorialsGuide

LlamaIndex batch evaluation runner explained

Learn to run batch evaluations in LlamaIndex with practical code examples, common pitfalls, and tradeoffs for retrieval and generation quality metrics.

5 min read
Framework tutorialsHow-to

Measure faithfulness in LlamaIndex RAG with n4n.ai

Learn to measure faithfulness in LlamaIndex RAG pipelines with a complete end-to-end tutorial including code, evaluation setup, and result interpretation.

3 min read
Framework tutorialsComparison

LlamaIndex retrieval evaluation: precision vs recall

A practical comparison of precision vs recall evaluation in LlamaIndex retrieval systems, with code examples and a decision framework for choosing the right metric.

5 min read
Framework tutorialsHow-to

LlamaIndex retrieval evaluation dataset generation

Generate synthetic evaluation datasets for LlamaIndex retrieval systems using LLMs, with runnable code for question generation, relevance labeling, and dataset validation.

3 min read
Framework tutorialsComparison

LlamaIndex FaithfulnessEvaluator vs RelevancyEvaluator

Compare LlamaIndex FaithfulnessEvaluator and RelevancyEvaluator across capabilities, cost, latency, and failure modes to pick the right RAG metric.

5 min read
Framework tutorialsGuide

LlamaIndex correctness evaluation for RAG answers

Learn how to evaluate RAG answer correctness with LlamaIndex — from basic LLM-as-judge to custom criteria, with code and common pitfalls.

5 min read
Framework tutorialsTutorial

Evaluate LlamaIndex RAG with Claude as judge on n4n.ai

Build a LlamaIndex RAG evaluation pipeline using Claude as an LLM judge, with runnable code for retrieval and generation metrics.

3 min read
Framework tutorialsGuide

LlamaIndex RelevancyEvaluator explained

A hands-on llamaindex relevancyevaluator tutorial covering setup, minimal code, output schema, judge model tradeoffs, and common pitfalls when evaluating RAG retrieval quality.

4 min read
Framework tutorialsTutorial

Evaluate LlamaIndex retrieval with hit rate and MRR

Hands-on llamaindex retrieval evaluation hit rate mrr tutorial: build a vector index, define a dataset, and measure retriever quality with code.

3 min read
Framework tutorialsTutorial

Building a RAG evaluation pipeline in LlamaIndex

A hands-on llamaindex rag evaluation pipeline tutorial: build retrieval and response eval with LlamaIndex, pytest, and OpenAI-compatible APIs.

2 min read
Framework tutorialsHow-to

Benchmark LlamaIndex retrievers with recall at k

A practical llamaindex retriever benchmark recall at k tutorial: create ground-truth eval sets, run retrieval, and compute recall@k in Python.

4 min read