arXiv++ Combinatorics

We prove a constant term conjecture of Robbins and Zeilberger (J. Combin. Theory Ser. A 66 (1994), 17-27), by translating the problem into a determinant evaluation problem and evaluating the determinant. This determinant generalizes the determinant that gives the number of all totally symmetric self-complementary plane partitions contained in a $(2n)\times(2n)\times(2n)$ box and that was used by Andrews (J. Combin. Theory Ser. A 66 (1994), 28-39) and Andrews and Burge (Pacific J. Math. 158 (1993), 1-14) to compute this number explicitly. The evaluation of the generalized determinant is independent of Andrews and Burge's computations, and therefore in particular constitutes a new solution to this famous enumeration problem. We also evaluate a related determinant, thus generalizing another determinant identity of Andrews and Burge (loc. cit.). By translating some of our determinant identities into constant term identities, we obtain several new constant term identities.

We compute the number of all rhombus tilings of a hexagon with sides $a,b+1,c,a+1,b,c+1$, of which the central triangle is removed, provided $a,b,c$ have the same parity. The result is a product of four numbers, each of which counts the number of plane partitions inside a given box. The proof uses nonintersecting lattice paths and a new identity for Schur functions, which is proved by means of the minor summation formula of Ishikawa and Wakayama. A symmetric generalization of this identity is stated as a conjecture.