The issue has been resolved and BigQuery syncs should be functioning normally again.
Root cause analysis: The Census engineering team made a change to our BigQuery connector that inadvertently caused it to need excess permissions which most customers have not grated to the Census BigQuery Service Account. Our monitoring tools detected this change as the source of an elevated sync failure rate. Operators reverted the sync engine to the previous version of the code that did not require these additional permissions.
Posted Jun 07, 2023 - 21:43 UTC
Monitoring
A new release of code caused all syncs using BigQuery as a source to fail. We have reverted this release and identified the code at fault.
Posted Jun 07, 2023 - 21:29 UTC
Investigating
We are investigating an increased failure rate in Census Reverse ETL syncs