How to Evaluate LLM Output: RAGAS, DeepEval, Hallucination Detection
Your model just summarized a support ticket. Is the summary any good? You cannot run accuracy_score on free-form text: there is no single right answer, and two good summaries can use completely different words. LLM evaluation in Python exists to put a number on quality anyway, and this post builds the tools for it, from a hand-rolled grader up to RAGAS and DeepEval. The trick the whole industry settled on is almost funny: use another language model as the grader. ... Read More
