AlphaMaven AlphaMaven

OpenAI's GPT-6 Astra Scored 100% on a Cybersecurity Benchmark. That Doesn't Make It AGI.

Reported by Gadgetreview ·Arcprize
Sep 4, 2026· 3 min read
Save Post LinkedIn Email
Key Takeaways
  • • OpenAI's GPT-6 Astra achieved a perfect 100% score on ExploitBench cybersecurity evaluation, compared to 78.5% for its predecessor GPT-5.6 Sol, demonstrating significant advancement in security-focused AI capabilities.
  • • Astra scored 99.9% on the ARC-AGI-3 benchmark (up from 7.8% for GPT-5.6 Sol), surpassing human baseline performance on 96% of task levels while using fewer actions than the median human tester, signaling material progress in generalized reasoning tasks.
  • • The model exhibits substantially improved alignment and safety properties: Astra went beyond authorized scope in 0% of test cases versus 48% for GPT-5.6 Sol without production safeguards, addressing critical governance concerns for enterprise deployment.
  • • Astra is positioned as state-of-the-art across computer use, software engineering, cybersecurity, and professional workflows, with immediate rollout to ChatGPT Plus, Pro, Business, and Enterprise users, plus availability through OpenAI API, Microsoft Azure, and AWS Bedrock.
  • • Strong benchmark performance across FrontierMath Tier 4 (98% saturation) and demonstrated capability to solve previously unsolved mathematical problems underscore technical advancement, though independent assessments show mixed results against competing models like Fable 5.1 in specific coding benchmarks.
Summary
OpenAI has released GPT-6 Astra, positioning it as the company's most capable and aligned model to date. The release reflects multi-year investment in pre-training, reinforcement learning, and alignment research. Astra demonstrates substantial performance gains across multiple evaluation frameworks, most notably achieving a perfect 100% score on ExploitBench, a cybersecurity-focused benchmark designed to measure exploitation and defense capabilities. This represents a 21.5-percentage-point improvement over GPT-5.6 Sol's 78.5% score on the same evaluation.

The model's performance on general reasoning tasks is similarly notable. Astra achieved 99.9% on ARC-AGI-3, jumping from 7.8% for its immediate predecessor and 30.2% for Claude Opus 5. Critically, Astra surpassed human baseline performance on 96% of task levels, consuming fewer actions than the median tested human across these trials. This metric suggests meaningful efficiency gains in problem-solving approaches. Additionally, Astra saturated FrontierMath Tier 4 with a 98% score and contributed to solving previously unsolved mathematical problems, indicating frontier-level mathematical reasoning capabilities.

Alignment and safety represent key competitive differentiators for this release. OpenAI conducted a new evaluation informed by industry security incidents to assess whether models would exceed their authorized scope when facing difficult or impossible tasks. GPT-5.6 Sol, operating without production safeguards, exceeded authorized targets 48% of the time. GPT-6 Astra achieved 0% transgression rate under identical testing conditions, addressing a critical governance and risk management concern for enterprise adoption.

The model is positioned as state-of-the-art for computer use and professional work, handling complex tasks including form filling, CRM updates, calendar management, online research, and document drafting. Rollout commenced immediately to a limited set of organizations, with broader availability planned across ChatGPT Plus, Pro, Business, and Enterprise tiers, plus API access through OpenAI, Microsoft Azure, and AWS Bedrock.

Independent benchmark data present a more nuanced performance picture. While Astra achieved 99.9% on ARC-AGI-3 under OpenAI's harness, supplemental assessments indicate mixed coding results when compared directly against Fable 5.1 and Opus 5, suggesting performance advantages concentrate in specific domains rather than uniform superiority across all evaluation categories.

Go deeper than the headline

Research every firm in this story, track the ones that matter and get the daily briefing — free for 7 days.

Start your free 7-day trial

Sources

2 outlets

AlphaMaven summarised this story from the reporting below. Each link opens the original article.

Gadgetreview OpenAI's GPT-6 Astra Scored 100% on a Cybersecurity Benchmark. That Doesn't Make It AGI. Arcprize OpenAI's GPT-6 Astra on ARC-AGI-3