Modernizing Compiler Design for Carbon Toolchain - Chandler Carruth - CppNow 2023
Why Hacker News recommends it
Recommended as a recent take on rethinking compiler architecture, and cited in discussions of flattened ASTs and fast lexers.
What it is
Chandler Carruth's CppNow 2023 talk on modernizing compiler design for the Carbon toolchain, using data-oriented design and modern hardware assumptions. It covers lexing, parsing and compact data structures aimed at compiler performance.
Recommended by 1 HN commenters across 1 different months, 2023 to 2025.
What Hacker News said
Recommends di4na · 2023-08 · on “How to speed up the Rust compiler in August 2023”
No but it is endemic to how we think about compilers up to now, and especially when the rust compiler arch was massively developed, more than 10 years ago. I recommend a watch of this for a recent take on trying to change how we think of these. It is an open research field [this video]
Cites pas · 2024-08 · on “Rhombus: Macro-extensible language with conventional syntax built on Racket”
Cache the position of quotes/apostrophes, etc. Optimizing for your edge case would require everyone writing and reading code to conform to this extra thing, which seems completely unnecessary. Machines are pretty fast. [this video] Modernizing Compiler Design for Carbon Toolchain - Chandler Carruth - CppNow 2023
Cites wrsh07 · 2025-01 · on “Flattening ASTs and other compiler data structures (2023)”
Chandler discusses it in this video though! [this video] You get some traversals for free with this layout (preorder, reverse post order). Can search for subtrees with string searching algorithms or more complex things with regex.
Cites norskeld · 2025-07 · on “Strategies for Fast Lexers”
Is lexing ever a bottleneck though? Even if you push for lexing and parsing 10M lines/second [1], I'd argue that semantic analysis and codegen (for AOT-compiled languages) will dominate the timings. That said, there's no reason not to squeeze every bit of performance out of it! [1]: In this talk about the Carbon language, Chandler Carruth shows and explains some goals/challenges regarding performance: [this video]