Advertise
AIComputers

OpenAI touts big gains in COBOL migration with GPT-6 models

OpenAI says the latest GPT-6 models score far higher on new benchmarks that test migrating legacy code such as COBOL to modern languages.

OpenAI announced on Monday that its latest models, including GPT-6 Astra and GPT-5.6 Sol, show substantial improvements in migrating legacy programming languages to newer ones, according to gizmodo.com.

The company introduced two new benchmarks to measure the work. MultiLangBench tests whether a model can build SQLite from scratch in a given language, while a second test checks whether a model can migrate COBOL programs to C++, Java, Kotlin, Python or Rust without changing their behavior.

OpenAI said GPT-6 scored the highest on MultiLangBench with an average pass rate of about 87%. On the COBOL migration test, GPT-6.1 Sol with high reasoning effort came close to 100%, according to the company.

OpenAI said the research was guided by feedback from developers and enterprise customers. The company did not provide a timeline for when the benchmark results would be reflected in products.

Why COBOL still matters

COBOL was invented in 1959 and still handles 95% of all ATM transactions, giving companies a strong incentive to find faster ways to modernize old code. Earlier this year, Anthropic wrote in a blog post that its Claude Code tool could help businesses modernize COBOL codebases in quarters instead of years; Bloomberg reported the same day that IBM shares fell 13% after the post, their biggest single-day slide since 2000.

Quick answers

What are MultiLangBench and the COBOL migration test?

They are two benchmarks OpenAI created. MultiLangBench tests building SQLite from scratch in a given language, and the second tests migrating COBOL programs to C++, Java, Kotlin, Python or Rust without changing behavior.

How well did OpenAI's models score on the benchmarks?

OpenAI says GPT-6 had the highest MultiLangBench average pass rate at about 87%, and that GPT-6.1 Sol with high reasoning effort scored very close to 100% on the COBOL migration test.

Source