Kantorovich inequality
In mathematics, the Kantorovich inequality is a particular case of the Cauchy–Schwarz inequality, which is itself a generalization of the triangle inequality.
The triangle inequality states that the length of two sides of any triangle, added together, will be equal to or greater than the length of the third side. In simplest terms, the Kantorovich inequality translates the basic idea of the triangle inequality into the terms and notational conventions of linear programming. (See vector space, inner product, and normed vector space for other examples of how the basic ideas inherent in the triangle inequality—line segment and distance—can be generalized into a broader context.)
More formally, the Kantorovich inequality can be expressed this way:
- Let
- Let
- Then
The Kantorovich inequality is used in convergence analysis; it bounds the convergence rate of Cauchy's steepest descent.
Equivalents of the Kantorovich inequality have arisen in a number of different fields. For instance, the Cauchy–Schwarz–Bunyakovsky inequality and the Wielandt inequality are equivalent to the Kantorovich inequality and all of these are, in turn, special cases of the Hölder inequality.
The Kantorovich inequality is named after Soviet economist, mathematician, and Nobel Prize winner Leonid Kantorovich, a pioneer in the field of linear programming.
There is also Matrix version of the Kantorovich inequality due to Marshall and Olkin (1990). Its extensions and their applications to statistics are available; see e.g. Liu and Neudecker (1999) and Liu et al. (2022).
See also
- Cauchy–Schwarz inequality – Mathematical inequality relating inner products and norms
References
- Weisstein, Eric W. "Kantorovich Inequality". MathWorld.
- Cauchy-Schwarz inequality at PlanetMath.
- Mathematical Programming Glossary entry on "Kantorovich inequality"
- Marshall, A. W. and Olkin, I., Matrix versions of the Cauchy and Kantorovich inequalities. Aequationes Mathematicae 40 (1990) 89–93.
- Liu, Shuangzhe and Neudecker, Heinz, A survey of Cauchy-Schwarz and Kantorovich-type matrix inequalities. Statistical Papers 40 (1999) 55-73.
- Liu, Shuangzhe, Leiva, Víctor, Zhuang, Dan, Ma, Tiefeng and Figueroa-Zúñiga, Jorge I., Matrix differential calculus with applications in the multivariate linear model and its diagnostics. Journal of Multivariate Analysis 188 (2022) 104849. https://doi.org/10.1016/j.jmva.2021.104849