Skip to content(if available)orjump to list(if available)

Catgrad: A categorical deep learning compiler

Catgrad: A categorical deep learning compiler

2 comments

·February 3, 2025
Visit

tripplyons

How does this compare to the XLA's ability to compile full training steps from JAX?

abeppu

So, learning about the categorical structure is interesting, but is there a specific advantage to seeing these concepts directly informing the implementation vs as a post-hoc way of explaining what autodiff is doing? E.g. Tensorflow is creating and transforming graphs of computation. Despite being written before most of the categorical work cited was done, isn't it doing the "same" thing, but we just wouldn't find names or comments in the code that closely align with the categorical work?