A model in the suite · OpenAI

GPT-5.6 Sol

OpenAI · GPT · GPT-5.6 Sol / high reasoning effort / Suite 2.0 API harness · 2026-07-10

74/100
Strict suite averageNo legacy score · 4 benchmarks

GPT-5.6 Sol / high reasoning effort / Suite 2.0 API harness

Copies GPT-5.6 Sol's full data pack — paste it into ChatGPT, Claude, or any AI to talk it through.

How GPT-5.6 Sol handled each benchmark

Score, capability radar, and the honest read on what it nailed and where it slipped. Hit Overlay to drop other models onto the same axes.

Dingo & Co. Knowledge Work

A 23-deliverable consulting brief: research, financial reconciliation, regulatory analysis, decks and spreadsheets. Tests whether a model can run an entire knowledge-work engagement end to end.

93
Near Mastery

Near-mastery result. The run produced a complete, coherent, board-usable Dingo & Co. work package and handled the benchmark's legal, ethical, absurdity, import, TAM, and numerical traps with unusually strong judgment. The main deductions are for limited independent verification of some source/image/permission claims, the need for real legal review before external release, and a minor mobile dashboard tab clipping defect.

OverlayDownload radar
Instr. FollowingArtifact ValiditySource IntegrityResearch GroundingSemantic JudgmentQuant. Reas.Visual StorytellingUX ReviewabilityProd. ReadinessSpeed
1GPT-5.6 Sol93
2GPT-5.6 Luna90
3GPT-5.6 Terra88
4GLM 5.2 (OpenRouter)88
5Claude Fable 581
6Claude Sonnet 5 (xhigh)81
7Claude Opus 4.880
8GPT-5.578
9Gemini 3.5 Flash (High) Fast62
10Grok 4.555
11Opus 4.754
12Sonnet 4.652
13Gemini 3.1 Pro38

What it nailed

  • Complete, multi-format work package with all required artifacts present.
  • Excellent handling of the benchmark's central canaries: dingo/litter-box absurdity, Alaska mismatch, import-market creation, regulatory ambiguity, and ethics.
  • Strong quantitative reconciliation of conflicting revenue, unit, launch, budget, import, CAC, TAM, and attach-rate signals.
  • Official-source-heavy regulatory research with required jurisdiction coverage and cautious hold/verify posture.
  • Copy, personas, investor FAQ, GTM plan, and risk assessment are specific to this unusual market rather than generic pet-tech filler.

Where it slipped

  • Minor mobile dashboard navigation clipping was observed by one visual judge.
  • Some verification-sensitive claims, including source access dates, image/media usage counts, and testimonial permission status, are model-authored and would need independent confirmation.
  • External publication would still require counsel review, agency/source recency checks, and final pricing verification.
  • PDF one-pager and deck visual quality are supported by artifacts/screenshots and file size, but only the dashboard received explicit operator visual-quality findings in the provided evidence.
Wall clock 22m 39s

Car Wash Operations

A filthy operational dataset — ghost records, orphaned orders, typo'd customers, raw enum variants. Tests judgment under messy real-world data: what gets fixed, quarantined, or wrongly promoted.

55
Interesting but Unreliable

This is a broad and useful audit scaffold with a real SQLite/provenance layer and a polished static reviewer UI, but it fails enough planted business-data canaries to be unreliable as a migration package. The strongest evidence supports good inventorying, schema construction, and reviewer presentation; the weakest evidence is in semantic reconciliation: typo-order names, department codes, and the SVC-007 service-code conflict are not handled to benchmark standard, and the DB sample shows an actual header row imported as a canonical job. The benchmark-specific primary-canary cap limits the strict score to 55.

OverlayDownload radar
Instr. FollowingArtifact ValiditySource IntegritySemantic JudgmentQuant. Reas.UX ReviewabilityProd. ReadinessSpeed
1Claude Fable 588
2Claude Opus 4.886
3Claude Sonnet 5 (xhigh)64
4GPT-5.6 Sol55
5GPT-5.6 Terra55
6GPT-5.555
7GPT-5.6 Luna55
8GLM 5.2 (OpenRouter)55
9Grok 4.555
10Gemini 3.5 Flash (High) Fast51
11GPT-5.451
12Opus 4.748

What it nailed

  • Produced all required primary artifacts, including a working SQLite database, rebuild script, documentation, review UI, and screenshots.
  • Built a substantial normalized schema with source inventory, provenance, conflicts, rejected items, and review queues.
  • Good source-file accounting with hashes, duplicate tracking, processing statuses, and sensitive-file skip fields.
  • Implements useful normalization for service aliases, effective-dated prices, statuses, payment methods, and corrupted JSON recovery.
  • Frontend renders successfully and is generally polished, with only a minor mobile clipping issue reported.

Where it slipped

  • Primary canaries around typo-order merging, department code normalization, and the SVC-007/The Works conflict are missed or not credibly evidenced.
  • A spreadsheet header row appears as a canonical completed job, which is a hard data-quality defect.
  • Entity resolution is too conservative and does not show robust fuzzy matching for the planted order-name typos.
  • Multimodal/image extraction appears partly placeholder/OCR-advisory, with limited evidence that handwritten receipt canaries were semantically reconciled.
  • Several validation and idempotency claims are self-reported rather than independently measured.
Misses Three Or More Primary Canaries
Wall clock 15m 29s

Brick — The AI LEGO Build

59
Interesting But Unreliable

Equal-weight mean of four isolated Brick case scores: 100-piece-lunar-rover=71.5, 250-piece-rescue-helicopter=54, 500-piece-cyberpunk-food-stall=60, 1000-piece-airship-research-station=50 -> 58.88.

OverlayDownload radar
Instr. FollowingArtifact ValiditySource IntegritySemantic JudgmentQuant. Reas.Spatial Reas.Visual StorytellingUX ReviewabilityProd. ReadinessSpeed
1Claude Fable 588
2Claude Opus 4.882
3Claude Sonnet 5 (xhigh)78
4GPT-5.6 Sol59
5Gemini 3.5 Flash (High) Fast56
6GPT-5.6 Terra54
7GPT-5.6 Luna50
8GLM 5.2 (OpenRouter)50
9Grok 4.547

What it nailed

  • [100-piece-lunar-rover] Complete isolated-case artifact with a responsive single-file animated assembly guide.
  • [100-piece-lunar-rover] Extractable embedded kitSpec with exactly 100 parts matching the declared piece count.
  • [100-piece-lunar-rover] Clear 25-step, four-pieces-per-step structure with manifest, instructions, JSON view, chapters, and playback UI.
  • [100-piece-lunar-rover] Completed rover is visually legible, well lit, and recognizable as a compact lunar rover.
  • [250-piece-rescue-helicopter] Complete required isolated-case artifact delivered as a single runnable index.html.
  • [250-piece-rescue-helicopter] Exact 250-piece declared and extracted kitSpec count.
  • [250-piece-rescue-helicopter] Polished visual presentation with recognizable rescue-helicopter silhouette, studs, rotors, skids, landing pad, and responsive UI.
  • [250-piece-rescue-helicopter] Structured guide includes chapters, 56 steps, manifest/data drawer, instruction text, and expected playback controls.
  • [500-piece-cyberpunk-food-stall] Delivered the required isolated-case index.html with an inline kitSpec and a complete browser-based Three.js guide.
  • [500-piece-cyberpunk-food-stall] Exact 500-piece count was independently confirmed by runtime extraction.
  • [500-piece-cyberpunk-food-stall] Strong visual concept: recognizable cyberpunk food stall with neon palette, studs, signage, awning/roof elements, and recording-friendly completed views.
  • [500-piece-cyberpunk-food-stall] Reviewer-facing UI is substantial, with chapter rail, step card, scrubber, playback controls, speed control, completion view, and kit data modal.
  • [1000-piece-airship-research-station] Required isolated-case artifact is present as a single runnable HTML file.
  • [1000-piece-airship-research-station] Runtime extraction found an inline structured kit spec with exactly 1000 parts.
  • [1000-piece-airship-research-station] The concept and silhouette are strong: airship, research station, docking gantry, balloon, gondola, propellers, cargo pod, and instruments are represented.
  • [1000-piece-airship-research-station] The UI is polished and includes the expected assembly-guide controls, chapters, manifest/instruction panels, and responsive desktop/mobile layout.
  • [1000-piece-airship-research-station] Rendered completed-state visuals are substantial and show recognizable brick-like geometry.

Where it slipped

  • [100-piece-lunar-rover] Measured strict connectivity is poor: 33% of parts are floating and the build splits into 35 strict components.
  • [100-piece-lunar-rover] Near_miss_count=557 indicates many pieces were placed approximately or by lateral contact rather than true stud engagement.
  • [100-piece-lunar-rover] Some visually plausible exterior rails, controls, sensors, and science-rack details are not mechanically attached under the validator.
  • [100-piece-lunar-rover] Minor mobile presentation defects: hero text overlap and partial clipping of the complete-model control.
  • [100-piece-lunar-rover] Working controls are visually present, but exhaustive interaction verification is not independently documented.
  • [250-piece-rescue-helicopter] Authoritative mechanical validation shows structural collapse: 76% of pieces are floating under strict stud coupling.
  • [250-piece-rescue-helicopter] The model is visually coherent but not a reliable physical interlocking-brick kit.
  • [250-piece-rescue-helicopter] Very high near_miss_count indicates approximate spatial placement rather than precise stud-grid engagement.
  • [250-piece-rescue-helicopter] Minor rendered-state issues: starting screenshots can show the full helicopter while progress reads 0/250, and mobile controls can crowd the instruction card.
  • [500-piece-cyberpunk-food-stall] Core physical buildability is weak under strict validation: 51% of parts are floating and the model fragments into 155 strict components.
  • [500-piece-cyberpunk-food-stall] High near_miss_count shows many pieces were placed approximately rather than snapped to strict stud-coupling positions.
  • [500-piece-cyberpunk-food-stall] Build sequence cannot be considered mechanically reliable because many final placements are not actually connected.
  • [500-piece-cyberpunk-food-stall] Minor visual issue: dark neon styling makes some pieces harder to distinguish.
  • [500-piece-cyberpunk-food-stall] Control functionality is visible and likely implemented, but not independently interaction-validated for every control in the provided evidence.
  • [1000-piece-airship-research-station] Authoritative mechanical validation reports 70.2% floating parts, so the build is not physically reliable under strict stud coupling.
  • [1000-piece-airship-research-station] The model is fragmented into 432 components, with the largest component only 239 parts out of 1000.
  • [1000-piece-airship-research-station] 3374 near misses indicate many pieces were placed approximately rather than precisely engaged on the stud grid.
  • [1000-piece-airship-research-station] The artifact's 'KIT VERIFIED' presentation is contradicted by measured connectivity.
  • [1000-piece-airship-research-station] Operator findings mark a major assembly-state defect: the initial state already appears completed with 100% progress.
  • [1000-piece-airship-research-station] Hero/subtitle text overlaps or is crowded by the 3D model in some desktop/mobile views.
Measured Structural CollapseSevere Physical ImplausibilitySevere Physical ImplausibilityMeasured Structural CollapseSevere Physical ImplausibilityOperator Major Primary Artifact
Wall clock 40m 33s

Artemis II Mission Visualization

89
Excellent

Excellent Artemis II visualization package: complete, source-rich, locally runnable, visually polished, and mission-specific. It falls just short of near-mastery because factual source support was not independently verified and the mobile layout has minor readability/truncation issues.

OverlayDownload radar
Instr. FollowingArtifact ValiditySource IntegrityResearch GroundingSemantic JudgmentQuant. Reas.Spatial Reas.Visual StorytellingUX ReviewabilityProd. ReadinessSpeed
1GPT-5.6 Sol89
2GPT-5.6 Luna87
3Claude Fable 586
4GPT-5.6 Terra86
5GPT-5.579
6Claude Opus 4.876
7Claude Sonnet 5 (xhigh)71
8Opus 4.760
9GLM 5.2 (OpenRouter)58
10Grok 4.555
11Gemini 3.5 Flash (High) Fast54

What it nailed

  • Complete end-to-end package with fact sheet, source ledger, interactive visualization, docs, local assets, and screenshots.
  • Strong mission-specific storytelling across 14 phases rather than a generic orbit scene.
  • Polished desktop visual composition with a nonblank 3D lunar scene, timeline, HUD metrics, and narrative card.
  • Good editorial discipline: planned versus actual values, corrected totals, and preliminary postflight findings are explicitly labeled.

Where it slipped

  • No independent source-link or claim-support validation was provided, so detailed postflight factual claims still need external audit before publication.
  • Minor mobile presentation issues: truncated subtitle/status text, line-clamped event description, and some very small or low-contrast labels.
  • The 3D visualization is an editorial/compressed reconstruction, not a physically scaled navigation simulation.
Wall clock 13m 7s