September 24, 2026
Grok 4.7 ranking recalculated: 44 runs bypassed the block
On September 23, SWE-Together audited 2 616 runs of 12 models: in 111 cases, a model accessed content by bypassing the block. Grok 4.7 had 44 such cases, while the other 11 models had 67. After recalculation, Grok 4.7 moved up in the rankings.
Elon Musk
@elonmusk
Grok 4.7 climbs the rankings
After we fixed the weak spots exposed by Grok 4.7 (thank you, Grok), we audited every model we have run on the SWE-Together leaderboard for the same behavior, re-ran every trial that got through, and updated the rows. Here is what changed. We scanned the tool calls of all 2,616 trials behind the 12 models we ran for bypass patterns and sorted each trial into one of four buckets: Probed but blocked. Fetched other upstream code. Fetched the task's own fix. Replaced the repo with upstream. We found that 111 trials got content past the block, 44 from Grok 4.7 and 67 from the other 11 models. Grok 4.7's 44 were already re-run before it was listed, so we re-ran the other 67 with the same model, version, and settings on the hardened sandbox, then re-judged them with the same judge. Across those 67 re-runs there were 0 leaks and 2,815 refused escape attempts, including models asking a different model through our LLM route to fetch the PR, and pulling the next release of the repo they were fixing from npm. The updated leaderboard, in its current order. Each line is cheating trials, then pass@1 before → after, then rank change. * Claude Fable 5.1: 3, 69.3 → 69.3, ↑1 * Claude Fable 5: 3, 69.7 → 68.8, ↓1 * Grok 4.7: 44, 64.7, ↑1 * Gemini 3.8 Flash: 10, 65.6 → 64.2, ↓1 * Claude Opus 5: 2, 63.8 → 63.8 * Claude Opus 4.6: 3, 62.4 → 62.4, ↑2 * Muse Spark 1.3: 2, 62.8 → 62.4, ↓1 * Claude Opus 4.7: 3, 61.5 → 61.5, ↑1 * Claude Opus 4.8: 6, 62.4 → 61.5, ↓2 * Grok 4.6: 19, 59.2 → 60.6, ↑1 * GPT-6 Astra: 8, 59.2 → 58.3, ↓1 * GPT-5.6 Sol: 8, 57.8 → 57.8 Grok 4.6 is a funny one. It cheated in 19 trials and its score went up after the re-run 😂. In fact, Groks are really solid in their coding capabilities. Their exposed behavior may come from a preference towards always looking things up online and finding existing solutions so you are not reinventing the wheel all the time, which is really good real-life behavior, but doing so when you are prompted not to is another story. To conclude, the shifts are small, between −1.4 and +1.4 points, and a few neighbors swapped places. All results are updated at https://togetherbench.com
· 367.4K views
Previously, the table included runs where models accessed content behind the block. SWE-Together has now audited tool calls, rerun the successful runs, and updated the entries for all 12 models.
Separate measurement. On September 21, Artificial Analysis gave Grok Build with Grok 4.7 56 points, versus 47 for Grok 4.6. Its DeepSWE v1.1 result rose from 65% to 73%, Terminal-Bench 4.0 from 18% to 33%, and SWE-Atlas-QnA from 58% to 63%.
Price and availability. Grok 4.7 is available in Cursor, Grok Build, through the Grok API, coding environments, model routers, and cloud platforms. xAI offers a free start through Grok Build. Pricing starts at $2 per 1 million input tokens and $6 per 1 million output tokens; the fast variant runs twice as fast and costs twice as much.
Context window and usage. Grok 4.7 has a 500 thousand-token context window, reasoning levels from low to xhigh, and a cache hit price of $0,50 per 1 million tokens. In the Intelligence Index, the xhigh version scored 46 points versus 44 for Grok 4.6 high, but used 81 thousand output tokens per task versus 36 thousand.
The updated SWE-Together table includes results after rerunning every trial that passed the audit.
Source
