Thesis: Partial State in Dataflow-Based Materialized Views
Why Hacker News recommends it
HN points to it, including Gjengset himself, as a more digestible way into partially-stateful dataflow than the thesis text, mostly in caching and database threads.
What it is
Jon Gjengset's 2020 PhD dissertation presentation at MIT on partial state in dataflow-based materialized views, the idea behind the Noria database. The Q&A is cut out.
Recommended by 1 HN commenters across 1 different months, 2020 to 2024.
What Hacker News said
Recommends Jonhoo · 2022-11 · on “How PlanetScale Boost serves SQL queries faster”
:wave: Author of the paper this work is based on here. I'm so excited to see dynamic, partially-stateful data-flow for incremental materialized view maintenance becoming more wide-spread! I continue to think it's a _great_ idea, and the speed-ups (and complexity reduction) it can yield are pretty immense, so seeing more folks building on the idea makes me very happy. The PlanetScale blog post references my original "Noria" OSDI paper ( [LINK] ), but I'd actually recommend my PhD thesis instead ( [LINK] ), as it goes much deeper about some of the technical challenges and solutions involved. It also has a chapter (Appendix A) that covers how it all works by analogy, which the less-technical am
Cites kondu · 2020-10 · on “Differential Dataflow”
this is also one of the main ideas behind Noria[1] (built by @jonhoo, who also gave his PhD dissertation[2] on this recently) [1] [LINK] [2] [this video]
Cites dpcx · 2024-02 · on “Readyset: A MySQL and Postgres wire-compatible caching layer”
Pretty sure that this is the database that Jon Gjengset[0] was working on as part of his thesis project. There have been several videos shared by him during talks about the system. It's a really interesting concept. edit: Here's[1] a video where he talks about the concept [0]: [LINK] [1]: [this video]