Implicit Function Theorem

The Implicit Function Theorem guarantees that equations $F(\mathbf{x}, \mathbf{y}) = \mathbf{0}$ can be solved locally for $\mathbf{y}$ as a function of $\mathbf{x}$ when the Jacobian with respect to $\mathbf{y}$ is nonsingular. This powerful result is essential for constrained optimization, differential equations, and understanding constraint manifolds. It generalizes the implicit differentiation from calculus.

Statement

Theorem10.1Implicit Function Theorem

Let $F : \mathbb{R}^{n+m} \to \mathbb{R}^m$ be continuously differentiable, and suppose $F(\mathbf{a}, \mathbf{b}) = \mathbf{0}$ . Write $(\mathbf{x}, \mathbf{y}) \in \mathbb{R}^n \times \mathbb{R}^m$ . If the Jacobian matrix

$\frac{\partial F}{\partial \mathbf{y}}(\mathbf{a}, \mathbf{b}) \quad \text{(the } m \times m \text{ matrix of partials w.r.t. } \mathbf{y}\text{)}$

is invertible, then there exist neighborhoods $U$ of $\mathbf{a}$ and $V$ of $\mathbf{b}$ and a continuously differentiable function $g : U \to V$ such that:

$g(\mathbf{a}) = \mathbf{b}$ .
For all $\mathbf{x} \in U$ and $\mathbf{y} \in V$ , $F(\mathbf{x}, \mathbf{y}) = \mathbf{0}$ iff $\mathbf{y} = g(\mathbf{x})$ .
The derivative of $g$ is

$Jg(\mathbf{x}) = -\left[\frac{\partial F}{\partial \mathbf{y}}(\mathbf{x}, g(\mathbf{x}))\right]^{-1} \frac{\partial F}{\partial \mathbf{x}}(\mathbf{x}, g(\mathbf{x})).$

RemarkSolving for y in terms of x

The theorem says: if $\frac{\partial F}{\partial \mathbf{y}}$ is invertible, the constraint $F(\mathbf{x}, \mathbf{y}) = \mathbf{0}$ locally defines $\mathbf{y}$ as a smooth function of $\mathbf{x}$ .

Examples

ExampleCircle: x² + y² = 1

Let $F(x, y) = x^2 + y^2 - 1$ . Then $\frac{\partial F}{\partial y} = 2y$ , which is nonzero when $y \neq 0$ . At $(0, 1)$ , $\frac{\partial F}{\partial y}(0, 1) = 2 \neq 0$ , so the Implicit Function Theorem guarantees that near $(0, 1)$ , we can solve for $y$ as a function of $x$ : $y = g(x) = \sqrt{1 - x^2}$ (taking the positive square root).

Moreover, $g'(x) = -\frac{\frac{\partial F}{\partial x}}{\frac{\partial F}{\partial y}} = -\frac{2x}{2y} = -\frac{x}{\sqrt{1 - x^2}}$ (implicit differentiation formula).

ExampleTwo constraints in R³

Let $F(x, y, z) = (x^2 + y^2 + z^2 - 1, x + y + z)$ . At $(\frac{1}{\sqrt{3}}, \frac{1}{\sqrt{3}}, \frac{1}{\sqrt{3}})$ , we can check that $\frac{\partial F}{\partial (y, z)}$ is invertible. Thus locally, $(y, z)$ can be expressed as functions of $x$ satisfying both constraints.

Proof idea

RemarkProof via Inverse Function Theorem

Define $G(\mathbf{x}, \mathbf{y}) = (\mathbf{x}, F(\mathbf{x}, \mathbf{y}))$ . The Jacobian of $G$ at $(\mathbf{a}, \mathbf{b})$ has the form

$JG = \begin{pmatrix} I_n & 0 \\ \frac{\partial F}{\partial \mathbf{x}} & \frac{\partial F}{\partial \mathbf{y}} \end{pmatrix}.$

Since $\frac{\partial F}{\partial \mathbf{y}}$ is invertible, $JG$ is invertible. By the Inverse Function Theorem, $G$ has a local inverse $G^{-1}(\mathbf{x}, \mathbf{w}) = (\mathbf{x}, h(\mathbf{x}, \mathbf{w}))$ . Setting $\mathbf{w} = \mathbf{0}$ gives $g(\mathbf{x}) = h(\mathbf{x}, \mathbf{0})$ , which solves $F(\mathbf{x}, \mathbf{y}) = \mathbf{0}$ .

Applications

ExampleLagrange multipliers

The Implicit Function Theorem justifies the method of Lagrange multipliers: constraints locally define a manifold parametrized by free variables, and the gradient of the objective function restricted to this manifold can be computed using implicit differentiation.

ExampleExistence of solutions to differential equations

The IFT is used to prove existence of solutions to differential equations: the equation $\frac{dy}{dx} = f(x, y)$ can be rewritten as $F(x, y, y') = y' - f(x, y) = 0$ , and the IFT (or implicit function theorem for ODEs) guarantees local solutions.

Summary

The Implicit Function Theorem:

Solves $F(\mathbf{x}, \mathbf{y}) = \mathbf{0}$ for $\mathbf{y} = g(\mathbf{x})$ locally when $\frac{\partial F}{\partial \mathbf{y}}$ is invertible.
Provides formula for derivative: $g' = -[\frac{\partial F}{\partial \mathbf{y}}]^{-1} \frac{\partial F}{\partial \mathbf{x}}$ .
Proved via Inverse Function Theorem.
Applications: Lagrange multipliers, differential equations, manifolds.

See Implicit Function Theorem proof and Inverse Function Theorem.