All activity
Streaming JSON is a set of Rust libraries for parsing and transforming JSON using a sliding window approach, without loading the full document into memory. It includes: - "RJiter": a streaming JSON parser - "scan_json": trigger actions during parsing by matching keys and nested structures - "id_transform": copy input to output, a base for JSON rewriting - "ddb_convert": convert JSON to/from DynamoDB format, 12× faster than Python and 2× faster than a baseline Rust implementation
Streaming JSON in RustTerabytes of JSON, kilobytes of memory
Oleg Parashchenkoleft a comment
Processing JSON at scale is hard. There are many streaming JSON parsers, but once you add even simple business logic on top of them, the code quickly becomes complex and messy. "Streaming JSON" is a Rust project designed to balance high performance with clean, usable APIs. It lets you: - Process huge JSON files (even terabytes) using only a few kilobytes of memory - Build streaming...
Streaming JSON in RustTerabytes of JSON, kilobytes of memory