Facility Services built something with customer data and no permissions

“Vercel probably handles backups.”— HR Generalist

Reason:

Officially because Friday at 11:20 seemed like a reasonable time to deploy. Presented in a town hall as "innovation".

Built by:

Chen, someone from Procurement

Build time:

a long Thursday

Built with:

Vue, for personal reasons

Database:

MongoDB where every document has a different schema

Authentication:

email magic links to Bastian's personal Gmail

Deployment:

deployed straight to production on a Wednesday, no staging

Responsible:

whoever still has the admin password

Documentation:

a PDF exported from PowerPoint

Security situation:

the data protection officer does not know it exists

Future disaster:

It will cause Head of Operations to request an immediate status meeting.

Age: 2.8 years · originally expected to last 4 weeks · 2 owners so far · survived 3 reorganisations · last meaningful change 74 days ago

Rated common mostly because: 4 departments depend on it, alive 34x longer than intended, 16% chance of becoming business critical.