Forge - Foxtrot communications
by•
Forge is an advanced JSON data processing engine for Cloud Datawarehouses. Forge seeks to bridge the gap between highly flexible and feature driven NoSql powered applications and the scalable analytical processing capabilities of Sql powered data warehouses.
Replies
I was inspired due to my own frustrations with processing and analyzing JSON data in BigQuery. I realized that a programmatic and general-purpose solution to JSON data processing was possible and I got to work. forge is the result.
Reliable Schema Evolution and Data Processing for NoSQL
Metadata-Driven Parsing: Forge never processes your raw data directly. It securely queries your data warehouse for the hierarchical JSON metadata of your stored blobs.
Optimized Query Generation: Based on the metadata, Forge constructs and issues highly optimized queries back to your data warehouse to facilitate the efficient and reliable parsing of the JSON data.
Guaranteed Schema Adaptation: Unmanaged schema drift can cost organizations hundreds of thousands to over a million dollars annually in broken processes, failed reports, and engineering time spent on manual fixes, according to industry analysis.
Forge automatically discovers and appends any new columns to processed tables. It also intelligently cleans and corrects damaged or malformed JSON objects, ensuring high-quality, reliable data for all downstream models.This means that your software engineers are free to innovate and deploy new features without breaking downstream data models.
Secure & Lightweight: The isolated, ephemeral execution model is inherently secure. Powered by Google Cloud infrastructure, Forge guarantees enterprise-level reliability and data isolation.