Agent Evaluation

The Illusion of Mastery: Breaking the Cycle of Benchmark Memorization with Generative Evaluation featured image

The Illusion of Mastery: Breaking the Cycle of Benchmark Memorization with Generative Evaluation

Modern AI models that score perfectly on standardized benchmarks often fail in real-world applications. This post argues for generative evaluation: dynamic, diverse, and verifiable …

avatar
Xinyue Zheng (郑欣悦)
MineStudio: A Streamlined Package for Minecraft AI Agent Development featured image

MineStudio: A Streamlined Package for Minecraft AI Agent Development

MineStudio streamlines Minecraft AI agent development by integrating simulator, data, model, offline training, online training, inference, and benchmark modules into one …

Shaofei cai