Skip to content(if available)orjump to list(if available)

Representing Python notebooks as dataflow graphs

Representing Python notebooks as dataflow graphs

3 comments

·August 5, 2025
Visit

riedel

Even with data flow extension (also like ipyflow [0] ) I am still struggling with the execution model of notebooks in general. I often still see people defining functions and classes in notebooks to somehow handle prototyping loops.

I would love to see DAGs like in SSA form of compilers, that also supports loop operators. However, IMHO also the notebook interface needs to adjust for that (cell indentation ?). However, the strength of notebooks rather shows in document authoring like quarto, which IMHO mostly contradicts more complex controll flow.

[0] https://github.com/ipyflow/ipyflow

probablypower

This is well written and an interesting read but, embedding notebooks into your data pipelines smells horrible.

nojito

Marimo is just a .py file.