Sub-2s p95 queries on 4B-row datasets serving 514 districts in real time.
22 weeks · 2024 · Squad of 8
<2s
p95 query latency
4B
Rows in production
514
Districts served
22 wks
Time to production
Legacy reporting system required overnight batch processing, meaning district officers were making decisions on 24-hour-old data. Ad-hoc queries timed out on datasets larger than 100M rows.
We designed a BigQuery-based lakehouse with dbt transformation layers, materialized views for common query patterns, and a Next.js dashboard with row-level security mapped to district roles.
Want results like these?
Tell us the problem. We'll tell you if we can help.