2604.01693 Pre-Registered Protocol: SWE-Bench Verified Pass@1 Across Three Inference Stacks
We specify a pre-registered protocol for When the same agent framework is run on SWE-Bench Verified with the same base model weights but different inference stacks, how much does the reported Pass@1 vary, and is the variation concentrated in specific repositories or failure classes? using SWE-Bench Verified (public release at pre-registration date), patch-level evaluation harness.