Tag

matrix calculus

0 views collected around this technical thread.

Model Perspective
Model Perspective
Nov 11, 2022 · Fundamentals

Unlock Linear Algebra & Matrix Calculus: Curated Resources for Python Learners

This article compiles a series of Chinese WeChat posts covering linear algebra, calculus, matrix‑vector differentiation, and Python libraries such as NumPy and SciPy, providing direct links for each topic to help learners deepen their mathematical and programming foundations.

NumPyPythonSciPy
0 likes · 4 min read
Unlock Linear Algebra & Matrix Calculus: Curated Resources for Python Learners
Model Perspective
Model Perspective
Oct 10, 2022 · Fundamentals

Matrix-to-Matrix Derivatives: Definitions, Differential Method & Examples

This article explains the definition of matrix‑to‑matrix derivatives, introduces the vectorization‑based differential approach using Kronecker products, presents key matrix‑vectorization properties, and walks through detailed examples illustrating how to compute such derivatives, highlighting their role and limitations in machine‑learning optimization.

Kronecker productVectorizationderivative
0 likes · 5 min read
Matrix-to-Matrix Derivatives: Definitions, Differential Method & Examples
Model Perspective
Model Perspective
Oct 4, 2022 · Fundamentals

Unlocking Matrix Differential Calculus: A Practical Guide to Trace‑Based Derivatives

This article introduces matrix differential calculus, explains its relationship to scalar and vector differentials, outlines key properties such as addition, multiplication, transpose, trace and determinant rules, and demonstrates how to compute matrix‑vector derivatives using trace tricks.

Tracederivativesdifferential
0 likes · 6 min read
Unlocking Matrix Differential Calculus: A Practical Guide to Trace‑Based Derivatives
Model Perspective
Model Perspective
Sep 21, 2022 · Fundamentals

Understanding Matrix and Vector Derivatives: Layouts and Jacobians Explained

This article introduces matrix and vector differentiation, explains the nine possible derivative cases, clarifies numerator and denominator layouts, and shows how Jacobian and gradient matrices arise, providing a concise foundation for machine‑learning calculus.

Jacobiandenominator layoutgradient
0 likes · 8 min read
Understanding Matrix and Vector Derivatives: Layouts and Jacobians Explained