Prismatic Web Application Hard Crashing

Incident Report for Prismatic

Resolved

At approximately 8:57am CT an update to the Prismatic web application was deployed that contained updated dependencies. Unfortunately there was a misconfiguration that was not problematic in development and CI environments, but caused crashes in the production environments. The Prismatic engineering team received alerts immediately upon release that there were problems and immediately started rolling back to the previous version. Full functionality was restored by 9:30am CT. The Prismatic engineering team is investigating root cause and will properly address this issue and further investigate how to improve the test coverage so as to minimize the likelihood and impact of similar situations in the future.

Posted Dec 17, 2024 - 16:00 UTC