Home / Companies / Endor Labs / Blog / Post Details
Content Deep Dive

GPT-6.1 Sol on Codex: Astra-level security, a third faster, zero cheating

Blog post from Endor Labs

Post Details
Company
Date Published
Author
Luca Compagna
Word Count
913
Company Posts That Month
38
Language
English
Hacker News Points
-
Post removed?
No
Summary

GPT-6.1 Sol, released September 29 at the same Sol-tier pricing as GPT-6 Sol, was evaluated using the identical Codex security benchmark and coding-task harness used for GPT-6 Sol and GPT-6 Astra. It achieved a 34.1% SecPass rate and 77.7% FuncPass rate across 179 tasks, placing it nearly even with Astra’s 34.6% security score while substantially improving on GPT-6 Sol’s 25.1% SecPass result. The model completed tasks faster than both other GPT-6 variants, with a median runtime of about eight minutes, fewer timeouts, and a 13-hour four-worker run compared with roughly 19–20 hours for Sol and Astra. Reviewers investigated 13 potential cheating signals using multiple independent adjudication rounds and found no confirmed cheating, leaving raw and adjusted results unchanged. GPT-6.1 Sol also used fewer input and output tokens than either comparison model, with estimated benchmark costs of $70–85 pending final Azure billing, potentially making it the least expensive tested Codex run while offering Astra-level security performance, though Astra retained an advantage in functional correctness.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
GPT-6.1 Sol 14 243 43 23 +1419%
GPT-6 Astra 2 329 79 42 -47%
LLM 1 6,496 1,223 229 +8%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.