Piano Software Status Page

Jun 9, 2026 · resolved Jun 10

**Incident explanation:** <ul><li>The latency was caused by an issue on our cloud data platform provider&#x27;s side. An internal infrastructure configuration change introduced resource contention that affected workloads with high ingestion concurrency, leading to elevated response times and intermittent timeouts when loading files. The change has been reverted by the provider, and ingestion performance has fully returned to its normal baseline.</li></ul> **Actions performed:** <ul><li>Opened and tracked an incident with our data platform provider and provided detailed monitoring evidence to support their investigation.</li><li>Deployed mitigations on our streaming ingestion stack (increased service scaling and improved handling of stalled ingestion calls) to limit customer impact during the incident.</li><li>Temporarily tuned ingestion timeout and retry settings to keep file loading as stable as possible while the root cause was being addressed.</li><li>Continuously monitored ingestion latency and error rates until performance returned to normal.</li><li>Confirmed full recovery, then reverted the temporary configuration to restore standard behaviour and avoid masking any future issues.</li></ul> **Actions to come:** <ul><li>Continued close monitoring of ingestion latency over the coming days to confirm lasting stability.</li><li>Keep the temporary mitigation patterns configurable in the code so they can be re-applied quickly should a similar provider-side degradation occur.</li></ul>

May 29, 2026 · resolved May 29

RCA report for the incident is available at [**this link**](https://docs.piano.io/wp-content/uploads/2026/06/2026-05-29-RCA-Content-Crawler-Service-Disruption-1.pdf).

May 28, 2026 · resolved May 29

RCA report for the incident is available at [**this link**](https://docs.piano.io/wp-content/uploads/2026/06/2026-05-28-RCA-Audience-API-Failures-happening-in-Europe-environment.pdf).

May 20, 2026 · resolved May 20

The incident has been resolved. All services are operating normally. Between approximately 09:58 and 10:11 UTC, users in the US region may have experienced issues accessing the Piano Dashboard, signing in via Piano ID, or completing checkout flows. This was caused by a routine configuration update to our US environment that introduced a conflict and disrupted traffic routing to the affected services. Our team identified the issue, rolled back the change, and confirmed full recovery shortly after. To prevent this from happening again, we are reviewing our release process and will validate the change in a controlled manner before re-applying it. We apologize for the inconvenience and thank you for your patience.

May 15, 2026 · resolved May 16

This incident has been resolved.