Skip to content(if available)orjump to list(if available)

Automatic Differentiation Can Be Incorrect

Automatic Differentiation Can Be Incorrect

4 comments

·September 18, 2025
Visit

Lerc

With floats getting smaller and smaller in ML, It's hard to imagine anyone failing to learn this as one of their early experiences in the field.

The focus should not be on the possibility of error, but managing the error to be within acceptable limits. There's a hour long video there, and it's 3am, so I'm not sure how much of this covers management. Anyone familiar with it care to say?

ComplexSystems

This article is saying that it can be numerically unstable in certain situations, not that it's theoretically incorrect.

omnicognate

Yeah, perhaps the actual title would be better: "The Numerical Analysis of Differentiable Similation". (Rather than the subtitle, which is itself a poor rewording of the actual subtitle in the video.)

NooneAtAll3

[video]?