Social Media Ideas for Evaluation

What is evaluation research? (methods and examples)

Few things derail a project faster than a team relying completely on guesses and instinct. It doesn’t matter whether you’ve got a team doing market research for a new product or yo...

Model Evaluation

In Supervised learning, we often indirectly optimize the outcome by seeing how well the machine learning model scores on the training data…Continue reading on Medium »

Engineering Closed-Loop Graph-RAG Systems, Part 4: Evaluating a Graph-RAG System

This article is part 4 of a 4-part series on 'Engineering Closed-Loop Graph-RAG Systems.' The simplest method to evaluate a RAG system is by asking yourself if your generated answe...

LLM Evaluation Frameworks Compared: How to Actually Measure What Your Model Does

In this article, you will learn how to evaluate LLM applications using the three dominant open-source frameworks — RAGAS, DeepEval, and Promptfoo — and why...

Goldens for your evals

Put Your Agent Evals in CI or Stop Calling Them Evals

Most teams I talk to have "evals." I ask them where the evals run. The answer is almost always the same: a notebook, a dashboard, a spreadsheet someone updates after a bad week. Th...