DataFunSummit

Jun 9, 2026 · Artificial Intelligence

From Gut Feelings to Measurable Metrics: Practicing the Rubrics‑Based Expert Knowledge Extraction and Annotation System CRAFT

The article analyzes the growing difficulty of evaluating large AI models, critiques traditional RLVR and RLHF approaches, introduces a Rubrics‑based evaluation paradigm, describes the design and three‑stage workflow of the CRAFT system, reports math‑domain experiments showing up to 6.2 percentage‑point gains, and outlines future extensions to other domains.