From drawing comprehension
to designs that work.
Architecture, parametric CAD and structural modeling demand different tests. Explore what each benchmark measures, how it grades, and where the evidence stops.
Read the drawing
Find dimensions, references and conflicts across documents.
Edit the geometry
Make the requested change while preserving protected features.
Check the behavior
Test constraints, assemblies or a declared physical response.
- AEC-Bench196 tasksArchitecture & CAD
Drawing navigation and cross-document project coordination. Curated answers and structured checks; some defects are injected into public project records.
architecturedocument-coordinationstructured checksSource reference · integration not included - Architecture & CAD
Drawing perception, OCR, counting and spatial questions. A drawing-reading benchmark rather than a CAD editing environment.
architecturedrawing-understandingquestion-answer scoringSource reference · integration not included - DrafterBench1,920 tasksArchitecture & CAD
Civil-engineering drawing revision tasks. Grades recorded tool arguments; final CAD geometry is not independently checked by that scoring method.
architecturedrawing-editingtool-call checksSource reference · integration not included - Architecture & CAD
Industrial CadQuery generation, reasoning and targeted editing. 17,900 execution-verified programs across 106 families; unseen-family transfer remains difficult.
cadparametric-editingexecution + geometrySource reference · integration not included - CADBench · MIT DeCoDE18,000 tasksArchitecture & CAD
18,000 evaluation samples across five input modalities. Measures reconstruction, executable programs and compactness. Separate from BenchCAD.
cadreconstructionexecution + geometrySource reference · integration not included - CADEngBench600 tasksArchitecture & CAD
Parametric parts, controlled edits, assemblies and declared physics checks. 600 part tasks; only 164 parts support full L3 FEA. Solver assumptions are benchmark-assigned.
cadstructural-engineeringconstraints + FEASource reference · integration not included - BMEval / AutoBM128 tasksArchitecture & CAD
Simulation-executable building models in OpenSeesPy. Grades execution and period checks against empirical references; passing is not engineering certification.
structural-engineeringexecution + period checksSource reference · integration not included - Architecture & CAD
CAD generation and editing with public inputs and private leaderboard reference artifacts. Official grading requires its hosted evaluation setup.
cadparametric-editingprivate reference gradingSource reference · integration not included
Directory checked 9 October 2026. Counts and results are author-reported. Source links do not mean these benchmarks are integrated into Delta Grounds or reproduced here. A solver result establishes behavior under the declared assumptions.