Would you prefer SDK-based validation or UI-based validation?
If you had to choose one primary workflow for data quality checks: A) SDK-first (Python, API calls) B) UI-first (upload files, explore issues visually) Which one fits your workflow better, and why?
How do you currently validate data in your pipelines?
Curious how everyone here validates data today. Do you use: custom scripts dbt tests Great Expectations nothing at all manual checks What’s working, what’s painful, and what’s missing?
What’s the biggest silent data failure you’ve faced?
Data engineers — what’s the worst silent data failure you’ve ever dealt with? Schema drift? Null explosions? Type mismatches? I’m collecting real stories to understand how teams catch (or miss) these issues today. What happened, and how did you discover it?
Built a Lightweight Excel Monitoring Tool — Would Love Feedback
Hi Product Hunt! 👋 I’m excited to share something I’ve been building: ThresholdIQ — a lightweight KPI simulator and anomaly detector for Excel/CSV data. Most teams still rely on spreadsheets for their most important metrics. But spreadsheets don’t warn you when something looks off. You only notice issues after they’ve caused damage. I wanted a simple way to upload a file and instantly see:...
Static thresholds are dead. Let’s talk about window‑based alerting
Most monitoring tools still rely on static thresholds — “Alert me if Sales > 10,000” or “Trigger Critical if Inventory < 500.” But real systems don’t behave in straight lines. Traffic spikes, seasonality shifts, and user behaviour changes every hour. That’s why we built window‑based alerting inside ThresholdIQ. Instead of looking at a single row of data, we evaluate patterns over time using...
How do you get alerts from Excel without using a BI tool?
If your KPIs live in Excel or Google Sheets, how do you get automatic alerts? Right now most options are: Manual checking Complex BI setup Writing scripts Zapier automations I’m exploring a simpler way to: Upload a spreadsheet Set 3-tier thresholds (Warning / Critical / Emergency) Get alerts when numbers cross limits Before I launch — what would you need to see for this to be useful?