Saga: a platform for continuous construction and serving of knowledge at scale
Apple's hybrid batch-incremental knowledge graph platform. Key inspiration for building smarter connections in this garden.
arxiv.org ↗ (opens in new window)Apple’s knowledge graph platform, published at SIGMOD 2022. The core insight is a hybrid batch-incremental design: a stable graph rebuilt periodically, overlaid with a live graph for real-time facts, plus human curations that hot-fix both.
Key ideas that transfer to smaller-scale knowledge systems: delta processing (only reprocess what changed), extended triples with provenance metadata, blocking + similarity for efficient linking, and confidence scoring for auto-generated links.
Follow-up paper (SIGMOD 2023): Growing and serving large open-domain knowledge graphs, which adds graph embeddings, fact ranking, and semantic annotation of external content.