Hook length formula
In combinatorial mathematics, the hook length formula is a formula for the number of standard Young tableaux whose shape is a given Young diagram. It has applications in diverse areas such as representation theory, probability, and algorithm analysis; for example, the problem of longest increasing subsequences. A related formula gives the number of semi-standard Young tableaux, which is a specialization of a Schur polynomial.
Definitions and statement
Let be a partition of . It is customary to interpret graphically as a Young diagram, namely a left-justified array of square cells with rows of lengths . A (standard) Young tableau of shape is a filling of the cells of the Young diagram with all the integers , with no repetition, such that each row and each column form increasing sequences. For the cell in position , in the th row and th column, the hook is the set of cells such that and or and . The hook length is the number of cells in .
The hook length formula expresses the number of standard Young tableaux of shape , denoted by or , as
where the product is over all cells of the Young diagram.
Examples
The figure on the right shows hook lengths for the cells in the Young diagram , corresponding to the partition 9 = 4 + 3 + 1 + 1. The hook length formula gives the number of standard Young tableaux as:
A Catalan number counts Dyck paths with steps going up (U) interspersed with steps going down (D), such that at each step there are never more preceding D's than U's. These are in bijection with the Young tableaux of shape : a Dyck path corresponds to the tableau whose first row lists the positions of the U-steps, while the second row lists the positions of the D-steps. For example, UUDDUD correspond to the tableaux with rows 125 and 346.
This shows that , so the hook formula specializes to the well-known product formula
History
There are other formulas for , but the hook length formula is particularly simple and elegant. A less convenient formula expressing in terms of a determinant was deduced independently by Frobenius and Young in 1900 and 1902 respectively using algebraic methods.[1][2] MacMahon found an alternate proof for the Young–Frobenius formula in 1916 using difference methods.[3]
The hook length formula itself was discovered in 1953 by Frame, Robinson, and Thrall as an improvement to the Young–Frobenius formula. Sagan[4] describes the discovery as follows.
One Thursday in May of 1953, Robinson was visiting Frame at Michigan State University. Discussing the work of Staal (a student of Robinson), Frame was led to conjecture the hook formula. At first Robinson could not believe that such a simple formula existed, but after trying some examples he became convinced, and together they proved the identity. On Saturday they went to the University of Michigan, where Frame presented their new result after a lecture by Robinson. This surprised Thrall, who was in the audience, because he had just proved the same result on the same day!
Despite the simplicity of the hook length formula, the Frame–Robinson–Thrall proof is not very insightful and does not provide any intuition for the role of the hooks. The search for a short, intuitive explanation befitting such a simple result gave rise to many alternate proofs.[5] Hillman and Grassl gave the first proof that illuminates the role of hooks in 1976 by proving a special case of the Stanley hook-content formula, which is known to imply the hook length formula.[6] Greene, Nijenhuis, and Wilf found a probabilistic proof using the hook walk in which the hook lengths appear naturally in 1979.[7] Remmel adapted the original Frame–Robinson–Thrall proof into the first bijective proof for the hook length formula in 1982.[8] A direct bijective proof was first discovered by Franzblau and Zeilberger in 1982.[9] Zeilberger also converted the Greene–Nijenhuis–Wilf hook walk proof into a bijective proof in 1984.[10] A simpler direct bijection was announced by Pak and Stoyanovskii in 1992, and its complete proof was presented by the pair and Novelli in 1997.[11][12][4]
Meanwhile, the hook length formula has been generalized in several ways. R. M. Thrall found the analogue to the hook length formula for shifted Young Tableaux in 1952.[13] Sagan gave a shifted hook walk proof for the hook length formula for shifted Young tableaux in 1980.[14] Sagan and Yeh proved the hook length formula for binary trees using the hook walk in 1989.[15] Proctor gave a poset generalization (see below).
Probabilistic proof
Knuth's heuristic argument
The hook length formula can be understood intuitively using the following heuristic, but incorrect, argument suggested by D. E. Knuth.[16] Given that each element of a tableau is the smallest in its hook and filling the tableau shape at random, the probability that cell will contain the minimum element of the corresponding hook is the reciprocal of the hook length. Multiplying these probabilities over all and gives the formula. This argument is fallacious since the events are not independent.
Knuth's argument is however correct for the enumeration of labellings on trees satisfying monotonicity properties analogous to those of a Young tableau. In this case, the 'hook' events in question are in fact independent events.
Probabilistic proof using the hook walk
This is a probabilistic proof found by C. Greene, A. Nijenhuis, and H. S. Wilf in 1979.[7] Define
We wish to show that . First,
where the sum runs over all Young diagrams obtained from by deleting one corner cell. (The maximal entry of the Young tableau of shape occurs at one of its corner cells, so deleting it gives a Young tableaux of shape .)
We define and , so it is enough to show the same recurrence
which would imply by induction. The above sum can be viewed as a sum of probabilities by writing it as
We therefore need to show that the numbers define a probability measure on the set of Young diagrams with . This is done in a constructive way by defining a random walk, called the hook walk, on the cells of the Young diagram , which eventually selects one of the corner cells of (which are in bijection with diagrams for which ). The hook walk is defined by the following rules.
- Pick a cell uniformly at random from cells. Start the random walk from there.
- Successor of current cell is chosen uniformly at random from the hook .
- Continue until you reach a corner cell .
Proposition: For a given corner cell of , we have
where .
Given this, summing over all corner cells gives as claimed.
Connection to representations of the symmetric group
The hook length formula is of great importance in the representation theory of the symmetric group , where the number is known to be equal to the dimension of the complex irreducible representation associated to .
Detailed discussion
The complex irreducible representations of the symmetric group are indexed by partitions of (see Specht module) . Their characters are related to the theory of symmetric functions via the Hall inner product:
where is the Schur function associated to and is the power-sum symmetric function of the partition associated to the cycle decomposition of . For example, if then .
Since the identity permutation has the form in cycle notation, , the formula says
The expansion of Schur functions in terms of monomial symmetric functions uses the Kostka numbers:
Then the inner product with is , because . Note that is equal to , so that from considering the regular representation of , or combinatorially from the Robinson–Schensted–Knuth correspondence.
The computation also shows that:
This is the expansion of in terms of Schur functions using the coefficients given by the inner product, since . The above equality can be proven also checking the coefficients of each monomial at both sides and using the Robinson–Schensted–Knuth correspondence or, more conceptually, looking at the decomposition of by irreducible modules, and taking characters. See Schur–Weyl duality.
Proof of hook formula using Frobenius formula[17]
By the above considerations
so that
where is the Vandermonde determinant.
For the partition , define for . For the following we need at least as many variables as rows in the partition, so from now on we work with variables .
Each term is equal to
(See Schur function.) Since the vector is different for each partition, this means that the coefficient of in , denoted , is equal to . This is known as the Frobenius Character Formula, which gives one of the earliest proofs.[17]
It remains only to simplify this coefficient. Multiplying
and
we conclude that our coefficient as
which can be written as
The latter sum is equal to the following determinant
which column-reduces to a Vandermonde determinant, and we obtain the formula
Note that is the hook length of the first box in each row of the Young diagram, and this expression is easily transformed into the desired form : one shows , where the latter product runs over the th row of the Young diagram.
Connection to longest increasing subsequences
The hook length formula also has important applications to the analysis of longest increasing subsequences in random permutations. If denotes a uniformly random permutation of order , denotes the maximal length of an increasing subsequence of , and denotes the expected (average) value of , Anatoly Vershik and Sergei Kerov[18] and independently Benjamin F. Logan and Lawrence A. Shepp[19] showed that when is large, is approximately equal to . This answers a question originally posed by Stanislaw Ulam. The proof is based on translating the question via the Robinson–Schensted correspondence to a problem about the limiting shape of a random Young tableau chosen according to Plancherel measure. Since the definition of Plancherel measure involves the quantity , the hook length formula can then be used to perform an asymptotic analysis of the limit shape and thereby also answer the original question.
The ideas of Vershik–Kerov and Logan–Shepp were later refined by Jinho Baik, Percy Deift and Kurt Johansson, who were able to achieve a much more precise analysis of the limiting behavior of the maximal increasing subsequence length, proving an important result now known as the Baik–Deift–Johansson theorem. Their analysis again makes crucial use of the fact that has a number of good formulas, although instead of the hook length formula it made use of one of the determinantal expressions.
Related formulas
The formula for the number of Young tableaux of shape was originally derived from the Frobenius determinant formula in connection to representation theory:[20]
Hook lengths can also be used to give a product representation to the generating function for the number of reverse plane partitions of a given shape.[21] If λ is a partition of some integer p, a reverse plane partition of n with shape λ is obtained by filling in the boxes in the Young diagram with non-negative integers such that the entries add to n and are non-decreasing along each row and down each column. The hook lengths can be defined as with Young tableaux. If πn denotes the number of reverse plane partitions of n with shape λ, then the generating function can be written as
Stanley discovered another formula for the same generating function.[22] In general, if is any poset with elements, the generating function for reverse -partitions is
where is a polynomial such that is the number of linear extensions of .
In the case of a partition , we are considering the poset in its cells given by the relation
- .
So a linear extension is simply a standard Young tableau, i.e.
Proof of hook formula using Stanley's formula
Combining the two formulas for the generating functions we have
Both sides converge inside the disk of radius one and the following expression makes sense for
It would be violent to plug in 1, but the right hand side is a continuous function inside the unit disk and a polynomial is continuous everywhere so at least we can say
Applying L'Hôpital's rule times yields the hook length formula
Semi-standard tableaux hook length formula
The Schur polynomial is the generating function of semistandard Young tableaux with shape and entries in . Specializing this to gives the number of semi-standard tableaux, which can be written in terms of hook lengths:
The Young diagram corresponds to an irreducible representation of the special linear group , and the Schur polynomial is also the character of the diagonal matrix acting on this representation. The above specialization is thus the dimension of the irreducible representation, and the formula is an alternative to the more general Weyl dimension formula.
We may refine this by taking the principal specialization of the Schur function in the variables :
where for the conjugate partition .
Skew shape formula
There is a generalization of this formula for skew shapes, [23]
where the sum is taken over excited diagrams of shape and boxes distributed according to .
A variation on the same theme is given by Okounkov and Olshanski[24] of the form
where is the so-called shifted Schur function .
Generalization to d-complete posets
Young diagrams can be considered as finite order ideals in the poset , and standard Young tableaux are their linear extensions. Robert Proctor has given a generalization of the hook length formula to count linear extensions of a larger class of posets generalizing both trees and skew diagrams.[25][26]
References
- G. Frobenius. Uber die charaktere der symmetrischer gruppe, Preuss. &ad. Wk. sitz. (1900), 516–534.
- A. Young. Quantitative substitutional analysis II, Proc. London Math. Sot., Ser. 1, 35 (1902), 361–397.
- P. A. MacMahon. “Combinatory Analysis,” Cambridge Univ. Press, London/New York, 1916; reprinted by Chelsea, New York, 1960.
- Sagan, Bruce (2001). The Symmetric Group. Representations, Combinatorial Algorithms, and Symmetric Functions, 2nd edition. Springer-Verlag. ISBN 0-387-95067-2.
- Knuth, Donald (1973). The Art of Computer Programming, Volume 3: Sorting and Searching, 3rd Edition, Addison–Wesley, p. 63
- Hillman, A. P.; Grassl, R. M. (1976). "Reverse plane partitions and tableau hook numbers". Journal of Combinatorial Theory. Series A. 21 (2): 216–221. doi:10.1016/0097-3165(76)90065-0.
- Greene, Curtis; Nijenhuis, Albert; Wilf, Herbert S. (1979). "A probabilistic proof of a formula for the number of Young tableaux of a given shape". Advances in Mathematics. 31 (1): 104–109. doi:10.1016/0001-8708(79)90023-9.
- J. B. Remmel. Bijective proofs of formulae for the number of standard Young tableaux, Linear and Multilinear Algebra 11 (1982), 45–100.
- Franzblau, D. S. and Zeilberger, D. (1982). A bijective proof of the hook-length formula. J. Algorithms 3, 317–343.
- Zeilberger, Doron (1984). "A short hook-lengths bijection inspired by the Greene–Nijenhuis–Wilf proof". Discrete Mathematics. 51 (1): 101–108. doi:10.1016/0012-365X(84)90027-X.
- Pak, I. M. and Stoyanovskii, A. V. (1992). A bijective proof of the hook-length formula. Funct. Anal. Appl. 24.
- Novelli, J.-C., Pak, I. M. and Stoyanovskii, A. V. (1997). A direct bijective proof of the hook-length formula. Discrete Mathematics and Theoretical Computer Science 1, 1997, 53–67.
- R. M. Thrall. A combinatorial problem, Michigan Math. J. 1 (1952), 81–88.
- Sagan, B. On selecting a random shifted Young tableau. J. Algorithms 1, 3 (1980), 213–234.
- Sagan, B. E., and Yeh, Y. N. Probabilistic algorithms for trees. Fibonacci Quart. 27, 3 (1989), 201–208.
- Knuth, Donald (1973), The Art of Computer Programming, Volume 3: Sorting and Searching, 3rd Edition, Addison–Wesley, p. 63, ISBN 0-201-03803-X.
- Fulton, William, 1939- (1991). Representation theory : a first course. Harris, Joe, 1951-. New York: Springer-Verlag. pp. 49–50. ISBN 0387974954. OCLC 22861245.
{{cite book}}
: CS1 maint: multiple names: authors list (link) - Vershik, A. M.; Kerov, C. V. (1977), "Asymptotics of the Plancheral measure of the symmetric group and a limiting form for Young tableaux", Dokl. Akad. Nauk SSSR 233: 1024–1027
- Logan, B. F.; Shepp, L. A. (1977). "A variational problem for random Young tableaux". Advances in Mathematics. 26 (2): 206–222. doi:10.1016/0001-8708(77)90030-5.
- Knuth, Donald (1973), The Art of Computer Programming, vol. 3 (1 ed.), Addison–Wesley, pp. 61–62
- Stanley, Richard P. (1971), "Theory and applications of plane partitions, 2", Studies in Applied Mathematics, 50: 259–279, doi:10.1002/sapm1971503259
- R.P. Stanley, "Ordered Structures and Partitions" PhD Thesis, Harvard University, 1971
- Morales, Alejandro H.; Pak, Igor; Panova, Greta (2018). "Hook formulas for skew shapes I. q-analogues and bijections". Journal of Combinatorial Theory. Series A. 154: 350–405. doi:10.1016/j.jcta.2017.09.002.
- Okounkov, A. and Olshanski, G. Shifted Schur functions, Algebra I Analiz, 9.2 (1997), 73-146.
- Proctor, Robert (1999). "Dynkin diagram classification of λ-minuscule Bruhat lattices and of d-complete posets". Journal of Algebraic Combinatorics. 9: 61–94. doi:10.1023/A:1018615115006.
- Kim, Jang Soo; Yoo, Meesue (2019). "Hook length property of d-complete posets via q-integrals". Journal of Combinatorial Theory. Series A. 162: 167–221. arXiv:1708.09109. doi:10.1016/j.jcta.2018.11.003. S2CID 57759574.
External links
- The Surprising Mathematics of Longest Increasing Subsequences by Dan Romik. Contains discussions of the hook length formula and several of its variants, with applications to the mathematics of longest increasing subsequences.