OpenAI touts big gains in COBOL migration with GPT-6 models
OpenAI says the latest GPT-6 models score far higher on new benchmarks that test migrating legacy code such as COBOL to modern languages.
OpenAI announced on Monday that its latest models, including GPT-6 Astra and GPT-5.6 Sol, show substantial improvements in migrating legacy programming languages to newer ones, according to gizmodo.com.
The company introduced two new benchmarks to measure the work. MultiLangBench tests whether a model can build SQLite from scratch in a given language, while a second test checks whether a model can migrate COBOL programs to C++, Java, Kotlin, Python or Rust without changing their behavior.
OpenAI said GPT-6 scored the highest on MultiLangBench with an average pass rate of about 87%. On the COBOL migration test, GPT-6.1 Sol with high reasoning effort came close to 100%, according to the company.
OpenAI said the research was guided by feedback from developers and enterprise customers. The company did not provide a timeline for when the benchmark results would be reflected in products.
Why COBOL still matters
COBOL was invented in 1959 and still handles 95% of all ATM transactions, giving companies a strong incentive to find faster ways to modernize old code. Earlier this year, Anthropic wrote in a blog post that its Claude Code tool could help businesses modernize COBOL codebases in quarters instead of years; Bloomberg reported the same day that IBM shares fell 13% after the post, their biggest single-day slide since 2000.
Quick answers
What are MultiLangBench and the COBOL migration test?
They are two benchmarks OpenAI created. MultiLangBench tests building SQLite from scratch in a given language, and the second tests migrating COBOL programs to C++, Java, Kotlin, Python or Rust without changing behavior.
How well did OpenAI's models score on the benchmarks?
OpenAI says GPT-6 had the highest MultiLangBench average pass rate at about 87%, and that GPT-6.1 Sol with high reasoning effort scored very close to 100% on the COBOL migration test.