2025-11-14: PPO partial service outage

On Friday , 14 November 2025, PPO experienced a brief service interruption affecting a portion of our customers. The issue was caused by a failure on Amazon Web Services (AWS), where one of our database servers became unavailable due to an AWS infrastructure problem in the region where we are hosted.

At 08:50, our monitoring systems detected an unusual spike in errors. Shortly thereafter, we saw that customers connected to one of our database servers were unable to log in. We quickly confirmed that the database server was not responding and was failing the built-in health checks on AWS. At the same time, AWS published an alert in their console stating that there was an infrastructure issue in the eu-west-1 region that caused a number of EC2 servers (virtual machines) to become unavailable — including ours. Because of this AWS failure, the affected server could not process requests, which meant that the customers hosted on that server were temporarily unable to use PPO.

To restore service as quickly as possible, we restarted the affected server, which caused AWS to move it onto healthy underlying hardware. This resolved the problem immediately. By 09:09, PPO was fully operational again for all affected customers.
We would like to apologize for any inconvenience that resulted from this incident.

A man in a dark suit jacket and white collared shirt smiles at the camera against a plain white background. The image is in black and white.

Author: Jan Uys

Jan was PPO's first employee and has been with Project Portfolio Office for over 10 years. Jan is currently the manager of the DevOps team.