UniCode: Augmenting Evaluation for Code Reasoning
UniCode transforms seed programming problems into structurally augmented variants, builds robust test suites without human-written reference solutions, and diagnoses where code …
Xinyue zheng
•
•
4 min read
The Illusion of Mastery: Breaking the Cycle of Benchmark Memorization with Generative Evaluation
Modern AI models that score perfectly on standardized benchmarks often fail in real-world applications. This post argues for generative evaluation: dynamic, diverse, and verifiable …
MCU: An Evaluation Framework for Open-Ended Game Agents
ICML 2025 Spotlight. A generative evaluation framework for open-ended game agents in Minecraft, featuring scalable task generation and multi-dimensional AutoEval.
Xinyue zheng