Catching silent data loss using BigQuery's native ML and Write API

(robertsahlin.substack.com)

2 points | by boxer_shorts 12 hours ago ago

1 comments

  • boxer_shorts 12 hours ago

    We needed a way to detect ingestion anomalies across 200+ microservices without building a separate ML stack. It turns out BigQuery already tracks every row written in WRITE_API_TIMELINE, and its built-in AI.DETECT_ANOMALIES (powered by Google’s TimesFM) can handle the detection.