Stay Confident
Subscribe to our weekly newsletter to stay confident in the AI systems you build.
Using LLMs for Synthetic Data Generation: The Definitive Guide
Everything you need to generate realistic synthetic datasets with LLMs: data evolution techniques, quality filtering, and code to build datasets from scratch.
Kritin Vongthongsri
How to Build an LLM Evaluation Framework, from Scratch
A step-by-step guide to building a robust, scalable LLM evaluation framework from scratch — metrics, test cases, and architecture, with DeepEval code examples.
Jeffrey Ip
Top LLM Benchmarks Explained: MMLU, HellaSwag, BBH, and Beyond
MMLU, HellaSwag, BBH, and beyond: what each top LLM benchmark measures, its limitations, and why these scores matter when choosing a model to build on.
Kritin Vongthongsri
LLM Testing in 2026: Top Methods and Strategies
LLM testing in 2026 spans unit-testing prompts, end-to-end evals, and regression tests. Learn the top methods, strategies, and best practices for testing LLMs at scale.
Jeffrey Ip
The Ultimate Guide to Fine-Tune LLaMA 3, With LLM Evaluations
Fine-tune LLaMA with Hugging Face, then use DeepEval and LLM evaluation metrics to measure whether the fine-tuned model actually improved over the base model.
Jeffrey Ip
RAG Evaluation: The Definitive Guide to Unit Testing RAG in CI/CD
Unit-test RAG applications in CI/CD with DeepEval: score retrieval and generation separately and block regressions on every commit before they reach production.
Jeffrey Ip
LLM Evaluation Metrics: The Ultimate LLM Evaluation Guide
LLM evaluation metrics include RAG metrics like faithfulness and answer relevancy, agent metrics, and LLM-as-a-judge, explained with working DeepEval code examples.
Jeffrey Ip
An Introduction to LLM Benchmarking
LLM benchmarks like MMLU and HellaSwag score models on standardized tasks. Learn what they measure, where they fall short, and how to choose the right LLM.
Jeffrey Ip
A Step-By-Step Guide to Evaluating an LLM Text Summarization Task
Evaluate LLM text summarization by building a custom metric that scores factual alignment and coverage against the source, with working DeepEval code examples.
Jeffrey Ip
Why OpenAI Assistants is a Big Win for LLM Evaluation
We built JudgmentalGPT, an in-house LLM-as-a-judge evaluator, on OpenAI's Assistants API. Here's why Assistants is a big win for LLM evaluation, with code.