Ai2 releases a benchmark showing research novelty judges swing with prompts

Researcher Noy Sternlicht and co-authors found one prompt change pushed GPT-5.4 from 93.5% accuracy to 40.9% on AI-generated idea comparisons.

RuntimeWire · 2026-10-27T17:48:53.830Z