LLM as a judge

Read the Portuguese translation →

Mentioned in

• AI harness crash course
• Building the Safety Layer for AI Agents
• Microsoft Decision-1: Model for Fast Decision-Making
• Shipping AI Into 5 Major Banks Without a 12-Month Compliance Wait — Al Chen, Cisco
• Red Hat Tested Jev and the Results Are Awkward…
• Como avaliar corretamente qual o melhor modelo de I.A.?
• Using GPT to Judge GPT Is a Mistake, Here’s Why
• Evals in AI: A Deep Dive — Tejas Kumar, IBM
• The Model Swap Workshop: GPT-5.5 vs Kimi vs DeepSeek vs Mistral
• Voice of Reason from Kyutai on Top of GLM: Run Locally
• Why AI Writing Still Reads Like Slop — Louis-François Bouchard, Towards AI
• How to Test AI Agents When No Benchmark Exists — Nathanael Weill, Air Canada
• Decision Models para Evals: Testei a API da OpenAI
• How to Write Your First AI Eval - SallyAnn DeLucia, Arize AI
• The 3 Things Clay Measures on Every AI Agent
• 5 formas de usar JEV para construir Agentes melhores
• Three Questions Every Agent Engineer Should Be Able To Answer
• Evals for High-Stakes AI Agents — Doneyli De Jesus & Annabell Schäfer, Langfuse
• From Vibes to Production: Evaluating and Shipping AI Agents That Work 101 — Laurie Voss, Arize AI
• Your LLM App Returned 200 OK. It Was Still Wrong. — Marina Petzel, Datadog
• As maiores diferenças entre Haiku 5.5 e GPT 6 Luna
• LangChain + Jev Full Tutorial: Routing, Guardrails & Evals for $0.00002 a Decision
• Your LLM Judge Is a Confident Liar: Building Better Verifiers — Browserbase

Related

Anthropic, evals, prompt injection, OpenAI, PII, Jev, Claude Code, RAG, LangChain, traces, Microsoft, ClickHouse