Resolved
Services are all now back to normal
Monitoring
Monitoring services after fix deployed and failover to read replica completed.
Identified
Post deployment database backfill activities caused anomalous database load leading to severe contention and downtime. Contention was resolved by promoting read replica to master writer instance.
Investigating
Early warning alarms around master database load triggered. On call engineer pinged, investigation started.