MacStadium experienced a severe network transport outage today from approximately 8AM to 10AM UTC.
The root issue was isolated to a network flood originating on our provider’s layer 2 transport network which provides connectivity to multiple upstream carriers.
As core routers were restored, the network flood propagated throughout the remaining fiber rings. It was at this point that the root source of the flood was detected and corrected.
Partial service was available at multiple points during the outage and full service was restored to all network systems by 10AM UTC.
No further issues are expected related to this outage.
This was initially believed to be a hardware failure and was reported as such to customers. We can confirm that there was no hardware fault with MacStadium systems.