During this window, one of our engineers was executing a scheduled InformaCast deployment. During this deployment, we encountered an unexpected error. The established procedure during such an event is to immediately escalate to a senior engineer to assess the error and its potential impact. This process was not followed and remediation steps were taken instead, which temporarily left InformaCast with too few copies of a critical service for cloud to on-premises notification to function.

Steps are being taken to reinforce training around deployment communications, escalating to senior engineers or management when the unexpected occurs, and the importance of following established procedures.