Tag

#llm-evaluation

Posts tagged with llm-evaluation

2 posts

Text-to-SQL evaluation tests whether AI-generated SQL returns defensible answers on real warehouse data instead of just matching public benchmark scores.

Engineering • Aug 27, 2026 •12 min read

Text-to-SQL Evaluation That Catches Silent Wrong Answers

Public benchmarks say 89%, your warehouse says otherwise. Build a text-to-SQL evaluation with schema-specific oracles that catches silent wrong answers.

#text-to-sql #nl2sql +4

A decision framework for choosing between fine-tuning, RAG, and prompt engineering when working with small open-weight language models.

Guides • Jul 12, 2026 •13 min read

Fine-Tuning vs RAG vs Prompt Engineering Decision Framework

Fine-tuning vs RAG vs prompt engineering: run this eval-gated framework before training a custom model and inheriting its hidden maintenance tax.

#fine-tuning #rag +4