Advertise
ComputersAI

Microsoft blames July gateway patch for November 12 Microsoft 365 outage

More than 80% of network gateway servers stopped responding at the worst point, and a containment mechanism failed, Microsoft said in a preliminary analysis.

Microsoft has attributed the November 12 Microsoft 365 outage to a bug in a gateway update that began rolling out in July, compounded by higher network traffic and reduced server capacity, according to a preliminary root-cause analysis published by the company. Executive Charles Lamanna posted the analysis on X on November 16.

At the worst point of the incident, more than 80% of network gateway servers stopped responding. The faulty patch affected only the network gateway and not general Windows environments, Microsoft said.

Two factors raised the load on the gateway. About 15 hours before the outage, Teams traffic was switched to the main gateway also used by Exchange Online. Separately, about 14% of gateway server capacity was unavailable because of a problem the previous day.

Containment failed, mail recovered last

The failure spread across the gateway infrastructure in under two hours, and the isolation mechanism meant to contain it did not work. Microsoft built an update that reverted the faulty processing, then took servers out of service in groups, applied the update, restarted them and returned them gradually.

Teams, OneDrive and SharePoint were protected by switching them to a separate gateway. Exchange Online could not be moved the same way, so mail recovery took longer. Microsoft said it plans to publish a final post-incident report with more detail.

Quick answers

What caused the November 12 Microsoft 365 outage?

Microsoft said a bug in a gateway update that began rolling out in July, combined with increased network traffic and reduced server capacity, caused the outage.

Which services were affected by the Microsoft 365 outage?

The incident hit the network gateway used by services including Exchange Online, Teams, OneDrive and SharePoint. Teams, OneDrive and SharePoint were moved to a separate gateway, while Exchange Online could not be and took longer to recover.

Will Microsoft publish a final report on the outage?

Yes. Microsoft said it plans to publish a final post-incident report with more detail.

Source