Visibility into failures while working remotely about ci HOT 4 CLOSED

@jamieklassen mentioned having flake attempts be part of a weekly report to our slack channel, which I think would be a really good idea. The weekly report can include things like the percentage of downtime for jobs that had a lot of downtime within the week and also for tests that had flaked tests (which should be reported in the build output). Exactly how we can fetch that data, I'm not exactly sure yet but I think it would be important to monitor that information because we don't want to ignore any test failures.

from ci.

Here's a bit of a prototype for tracking flakes in a metrics store (hopefully it works equally well with grafana or datadog or wavefront or whatever thanks to opentelemetry... 🤞): https://github.com/jamieklassen/flake-reporting

from ci.

This issue has had no activity for a while. It has been labeled stale, and will be closed in one week.

from ci.

This issue has had no activity for a while. It has been labeled stale, and will be closed in one week.

from ci.