Calculus for ML
Derivatives, gradients, Jacobians, and Hessians, all computed numerically so you can verify any formula by hand. You will build finite differences, Newton and RK methods, Lagrange multipliers, and convolution integrals. Designed for learners who want optimization and backprop to rest on real calculus rather than hand-waving.
Your progress
0/24 · 0%Path readiness 0%Easy 0% · Medium 0% · Hard 0%
Continue path · Numerical DerivativeWhat you will learn
- Approximate derivatives and integrals with finite differences and quadrature
- Build gradients, partials, Jacobians, and Hessians numerically
- Apply the chain rule and matrix calculus to ML losses
- Solve ODEs and take transforms used in signal and generative models
Before you start
1Derivatives and Integrals
Numerical differentiation and integration: forward differences, trapezoidal and Simpson rules, midpoint quadrature, and directional derivatives.
- Easy
- Easy
- Easy
- Midpoint RuleEasyca-009Calculus
- Simpson RuleEasyca-010Calculus
- Easy
Stage checkpoint
0/2 to passA checkpoint is a short retrieval test drawn from this stage: solve 2 of 3 from memory to mark the stage complete. The stage stays open either way.
- Midpoint RuleEasy
- Simpson RuleEasy
- Directional DerivativeEasy
2Gradients and Newton's Method
From one variable to many: numerical gradients, Newton's method in one and several steps, partial derivatives of quadratic forms, and the Hessian of a quadratic.
- Medium
- Medium
- Medium
- Medium
- Medium
- Medium
Stage checkpoint
0/2 to passA checkpoint is a short retrieval test drawn from this stage: solve 2 of 3 from memory to mark the stage complete. The stage stays open either way.
- Partial Derivatives of a Quadratic FormMedium
- Numerical Gradient of 2D FunctionMedium
- Hessian of a Quadratic FormMedium
3Multivariable Calculus for Backprop
The tools behind backprop and constrained optimization: mixed partials, gradient-descent steps, softmax gradients, Jacobians, Hessians, and Lagrange multipliers.
- Medium
- Medium
- Medium
- Jacobian MatrixHardca-004Calculus
- Hessian MatrixHardca-005Calculus
- Hard
Stage checkpoint
0/2 to passA checkpoint is a short retrieval test drawn from this stage: solve 2 of 3 from memory to mark the stage complete. The stage stays open either way.
4ODEs and Transforms
Continuous dynamics and frequency-domain tools: Euler and Runge-Kutta steps, convolution integrals, Fourier coefficients, and inverse Laplace transforms.
- Easy
- RK4 One StepMediumca-267Calculus
- Hard
- Hard
- Hard
- Hard
Stage checkpoint
0/2 to passA checkpoint is a short retrieval test drawn from this stage: solve 2 of 3 from memory to mark the stage complete. The stage stays open either way.
Capstone
Pen and paperClose the path with one real artifact from the catalog.
A handwritten final check: derive the classic limit with the small-angle approximation or L'Hopital's rule.