Same AI, same puzzle games: 62.7% with the standard test setup, 99.9% with its maker's own
How a model is run in a test can matter as much as the model. Every model tested both ways scored higher with its maker's software.
62.7% → 99.9%GPT-6 Astra on ARC-AGI-3: standard harness vs OpenAI's own adapter