Cache Shiki tokenization across streaming updates
architecture · hero
Highlighting streamed code blocks
streaming-highlight
CodeToTokensOptions → TokensResult
✦
✦
✦
✦
✦
✦
✦
✦
✦
✦
/
What could this change break?
What should I review most carefully?
Drag to select a region · Space to pan · Drop a screenshot
↵
fix(shiki): tokenize an unchanged fence once while a document streams
comarkdown/comark #616
· 2 diagrams
Start the walkthrough
W
Fit the whole strip
1
Copy share link
Switch to light
Loading comments
Loading screenshots
How to move around
Ask about this canvas
/
Star
100%
Cache Shiki tokenization across streaming updates
Architecture
Highlighting streamed code blocks
Data flow
Resume walkthrough
↵
This diagram has a walkthrough
scroll to move through it
swipe to move through it