random
7100 papers tagged with this keyword
An Introduction to Wishart Matrix Moments
Published in Foundations and Trends in Machine Learning, Volume 11, No. 2, pages: 97-218, (2018)
• View Publication
• BIB
These lecture notes provide a comprehensive, self-contained introduction to the analysis of Wishart matrix moments. This study may act as an introduction to some particular aspects of random matrix theory, or as a self-contained exposition of Wishart matrix moments. Random matrix theory plays a central role in statistical physics, computational mathematics and engineering sciences, including data assimilation, signal processing, combinatorial optimization, compressed sensing, econometrics and mathematical finance, among numerous others. The mathematical foundations of the theory of random matrices lies at the intersection of combinatorics, non-commutative algebra, geometry, multivariate functional and spectral analysis, and of course statistics and probability theory. As a result, most of the classical topics in random matrix theory are technical, and mathematically difficult to penetrate for non-experts and regular users and practitioners. The technical aim of these notes is to review and extend some important results in random matrix theory in the specific context of real random Wishart matrices. This special class of Gaussian-type sample covariance matrix plays an important role in multivariate analysis and in statistical theory. We derive non-asymptotic formulae for the full matrix moments of real valued Wishart random matrices. As a corollary, we derive and extend a number of spectral and trace-type results for the case of non-isotropic Wishart random matrices. We also derive the full matrix moment analogues of some classic spectral and trace-type moment results. For example, we derive semi-circle and Marchencko-Pastur-type laws in the non-isotropic and full matrix cases. Laplace matrix transforms and matrix moment estimates are also studied, along with new spectral and trace concentration-type inequalities.
A short proof of a lower bound for Turán numbers
Let $F$ be a strictly balanced $r$-uniform hypergraph with $e>2$ edges and $r$-density $m$. We give a new short proof of the fact that the Turán number $\ex(n, F)$ is greater than $c\, n^{r-1/m} (\log n)^{1/(e-1)}$ where $c$ depends only on $F$. The previous proof of this for $r=2$ by Bohman and Keevash and for $r \ge 3$ by Bennett and Bohman used a random greedy process and its analysis using the differential equations method. Our proof uses elementary probabilistic arguments together with a (nontrivial) classical result about independent sets in hypergraphs.
Improved approximation of layout problems on random graphs
Published
• View Publication
• BIB
Inspired by previous work of Diaz, Petit, Serna, and Trevisan (Approximating layout problems on random graphs Discrete Mathematics, 235, 2001, 245--253), we show that several well-known graph layout problems are approximable to within a factor arbitrarily close to 1 of the optimal with high probability for random graphs drawn from an Erdös-Renyi distribution with appropriate sparsity conditions. Moreover, we show that the same results hold for the analogous problems on directed acyclic graphs.
Spitzer's identity for discrete random walks
Published
• View Publication
• BIB
Spitzer's identity describes the position of a reflected random walk over time in terms of a bivariate transform. Among its many applications in probability theory are congestion levels in queues and random walkers in physics. We present a new derivation of Spitzer's identity under the assumption that the increments of the random walk have bounded jumps to the left. This mild assumption facilitates a proof of Spitzer's identity that only uses basic properties of analytic functions and contour integration. The main novelty, believed to be of broader interest, is a reversed approach that recognizes a factored polynomial expression as the outcome of Cauchy's formula.
The spread of fire on a random multigraph
Published in Adv. Appl. Probab. 51 (2019) 1-40
• View Publication
• BIB
We study a model for the destruction of a random network by fire. Suppose that we are given a multigraph of minimum degree at least 2 having real-valued edge-lengths. We pick a uniform point from along the length and set it alight; the edges of the multigraph burn at speed 1. If the fire reaches a vertex of degree 2, the fire gets directly passed on to the neighbouring edge; a vertex of degree at least 3, however, passes the fire either to all of its neighbours or none, each with probability $1/2$. If the fire goes out before the whole network is burnt, we again set fire to a uniform point. We are interested in the number of fires which must be set in order to burn the whole network, and the number of points which are burnt from two different directions. We analyse these quantities for a random multigraph having $n$ vertices of degree 3 and $α(n)$ vertices of degree 4, where $α(n)/n \to 0$ as $n \to \infty$, with i.i.d. standard exponential edge-lengths. Depending on whether $α(n) \gg \sqrt{n}$ or $α(n)=O(\sqrt{n})$, we prove that as $n \to \infty$ these quantities converge jointly in distribution when suitably rescaled to either a pair of constants or to (complicated) functionals of Brownian motion.
We use our analysis of this model to make progress towards a conjecture of Aronson, Frieze and Pittel concerning the number of vertices which remain unmatched when we use the Karp-Sipser algorithm to find a matching on the Erdős-Rényi random graph.
Exceptional Lattice Green's Functions
The three exceptional lattices, $E_6$, $E_7$, and $E_8$, have attracted much attention due to their anomalously dense and symmetric structures which are of critical importance in modern theoretical physics. Here, we study the electronic band structure of a single spinless quantum particle hopping between their nearest-neighbor lattice points in the tight-binding limit. Using Markov chain Monte Carlo methods, we numerically sample their lattice Green's functions, densities of states, and random walk return probabilities. We find and tabulate a plethora of Van Hove singularities in the densities of states, including degenerate ones in $E_6$ and $E_7$. Finally, we use brute force enumeration to count the number of distinct closed walks of length up to eight, which gives the first eight moments of the densities of states.
Finding tight Hamilton cycles in random hypergraphs faster
Published in Combinator. Probab. Comp. 30 (2021) 239-257
• View Publication
• BIB
In an $r$-uniform hypergraph on $n$ vertices a tight Hamilton cycle consists of $n$ edges such that there exists a cyclic ordering of the vertices where the edges correspond to consecutive segments of $r$ vertices. We provide a first deterministic polynomial time algorithm, which finds a.a.s. tight Hamilton cycles in random $r$-uniform hypergraphs with edge probability at least $C \log^3n/n$. Our result partially answers a question of Dudek and Frieze [Random Structures & Algorithms 42 (2013), 374-385] who proved that tight Hamilton cycles exists already for $p=ω(1/n)$ for $r=3$ and $p=(e + o(1))/n$ for $r\ge 4$ using a second moment argument. Moreover our algorithm is superior to previous results of Allen, Böttcher, Kohayakawa and Person [Random Structures & Algorithms 46 (2015), 446-465] and Nenadov and Škorić [arXiv:1601.04034] in various ways: the algorithm of Allen et al. is a randomised polynomial time algorithm working for edge probabilities $p\ge n^{-1+\varepsilon}$, while the algorithm of Nenadov and Škorić is a randomised quasipolynomial time algorithm working for edge probabilities $p\ge C\log^8n/n$.
Biased halfspaces, noise sensitivity, and local Chernoff inequalities
A halfspace is a function $f\colon\{-1,1\}^n \rightarrow \{0,1\}$ of the form $f(x)=\mathbb{1}(a\cdot x>t)$, where $\sum_i a_i^2=1$.
We show that if $f$ is a halfspace with $\mathbb{E}[f]=ε$ and $a'=\max_i |a_i|$, then the degree-1 Fourier weight of $f$ is
$W^1(f)=Θ(ε^2 \log(1/ε))$, and the maximal influence of $f$ is $I_{\max}(f)=Θ(ε\min(1,a' \sqrt{\log(1/ε)}))$.
These results, which determine the exact asymptotic order of $W^1(f)$ and $I_{\max}(f)$, provide sharp generalizations of theorems proved by Matulef, O'Donnell, Rubinfeld, and Servedio, and settle a conjecture posed by Kalai, Keller and Mossel.
In addition, we present a refinement of the definition of noise sensitivity which takes into consideration the bias of the function, and show that (like in the unbiased case) halfspaces are noise resistant, and, in the other direction, any noise resistant function is well correlated with a halfspace.
Our main tools are 'local' forms of the classical Chernoff inequality, like the following one proved by Devroye and Lugosi (2008):
Let $\{ x_i \}$ be independent random variables uniformly distributed in $\{-1,1\}$, and let $a_i\in\mathbb{R}_+$ be such that $\sum_i a_{i}^{2}=1$.
If for some $t\geq 0$ we have $\Pr[\sum_{i} a_i x_i > t]=ε$, then $\Pr[\sum_{i} a_i x_i>t+δ]\leq \fracε{2}$ holds for $δ\leq c/\sqrt{\log(1/ε)}$, where $c$ is a universal constant.
The satisfiability threshold for random linear equations
Published
• View Publication
• BIB
Let $A$ be a random $m\times n$ matrix over the finite field $F_q$ with precisely $k$ non-zero entries per row and let $y\in F_q^m$ be a random vector chosen independently of $A$. We identify the threshold $m/n$ up to which the linear system $A x=y$ has a solution with high probability and analyse the geometry of the set of solutions. In the special case $q=2$, known as the random $k$-XORSAT problem, the threshold was determined by [Dubois and Mandler 2002, Dietzfelbinger et al. 2010, Pittel and Sorkin 2016], and the proof technique was subsequently extended to the cases $q=3,4$ [Falke and Goerdt 2012]. But the argument depends on technically demanding second moment calculations that do not generalise to $q>3$. Here we approach the problem from the viewpoint of a decoding task, which leads to a transparent combinatorial proof.
On subgraphs of random Cayley sum graphs
Published
• View Publication
• BIB
We prove that asymptotically almost surely, the random Cayley sum graph over a finite abelian group $G$ has edge density close to the expected one on every induced subgraph of size at least $\log^c |G|$, for any fixed $c > 1$ and $|G|$ large enough.
An extension of the Moran process using type-specific connection graphs
Published
• View Publication
• BIB
The Moran process, as studied by [Lieberman, E., Hauert, C. and Nowak, M. Evolutionary dynamics on graphs. Nature 433, pp. 312-316 (2005)], is a stochastic process modeling the spread of genetic mutations in populations. In this process, agents of a two-type population (i.e. mutants and residents) are associated with the vertices of a graph. Initially, only one vertex chosen uniformly at random is a mutant, with fitness $r > 0$, while all other individuals are residents, with fitness $1$. In every step, an individual is chosen with probability proportional to its fitness, and its state (mutant or resident) is passed on to a neighbor which is chosen uniformly at random. In this paper, we introduce and study a generalization of the model of Lieberman et al. by assuming that different types of individuals perceive the population through different graphs, namely $G_R(V,E_R)$ for residents and $G_M(V,E_M)$ for mutants. In this model, we study the fixation probability, i.e. the probability that eventually only mutants remain in the population, for various pairs of graphs. First, we transfer known results from the original single-graph model of Lieberman et al. to our 2-graph model. Among them, we provide a generalization of the Isothermal Theorem of Lieberman et al., that gives sufficient conditions for a pair of graphs to have the same fixation probability as a pair of cliques. Next, we give a 2-player strategic game view of the process where player payoffs correspond to fixation and/or extinction probabilities. In this setting, we attempt to identify best responses for each player and give evidence that the clique is the most beneficial graph for both players. Finally, we examine the possibility of efficient approximation of the fixation probability and provide a FPRAS for the special case where the mutant graph is complete.
Cohen--Lenstra heuristics for torsion in homology of random complexes
Published
• View Publication
• BIB
We study torsion in homology of the random $d$-complex $Y \sim Y_d(n,p)$ experimentally. Our experiments suggest that there is almost always a moment in the process where there is an enormous burst of torsion in homology $H_{d-1}(Y)$. This moment seems to coincide with the phase transition studied in \cite{AL,LP,LP3} , where cycles in $H_d(Y)$ first appear with high probability.
Our main study is the limiting distribution on the $q$-part of the torsion subgroup of $H_{d-1}(Y)$ for small primes $q$. We find strong evidence for a limiting Cohen--Lenstra distribution, where the probability that the $q$-part is isomorphic to a given $q$-group $H$ is inversely proportional to the order of the automorphism group $|\mbox{Aut}(H)|$.
We also study the torsion in homology of the uniform random $\Q$-acyclic $2$-complex. This model is analogous to a uniform spanning tree on a complete graph, but more complicated topologically since Kalai showed that the expected order of the torsion group is exponentially large in $n^2$ \cite{Kalai}. We give experimental evidence that in this model also, the torsion is Cohen--Lenstra distributed in the limit.
High dimensional expanders and coset geometries
Published
• View Publication
• BIB
High dimensional expanders is a vibrant emerging field of study. Nevertheless, the only known construction of bounded degree high dimensional expanders is based on Ramanujan complexes, whereas one dimensional bounded degree expanders are abundant.
In this work, we construct new families of bounded degree high dimensional expanders obeying the local spectral expansion property. This property has a number of important consequences, including geometric overlapping, fast mixing of high dimensional random walks, agreement testing and agreement expansion. Our construction also yields new families of expander graphs which are close to the Ramanujan bound, i.e., their spectral gap is close to optimal.
The construction is quite elementary and it is presented in a self contained manner; This is in contrary to the highly involved previously known construction of the Ramanujan complexes. The construction is also very symmetric (such symmetry properties are not known for Ramanujan complexes) ; The symmetry of the construction could be used, for example, in order to obtain good symmetric LDPC codes that were previously based on Ramanujan graphs.
The main tool that we use for is the theory of coset geometries. Coset geometries arose as a tool for studying finite simple groups. Here, we show that coset geometries arise in a very natural manner for groups of elementary matrices over any finitely generated algebra over a commutative unital ring. In other words, we show that such groups act simply transitively on the top dimensional face of a pure, partite, clique complex.
Geometry of large Boltzmann outerplanar maps
We study the phase diagram of random outerplanar maps sampled according to non-negative Boltzmann weights that are assigned to each face of a map. We prove that for certain choices of weights the map looks like a rescaled version of its boundary when its number of vertices tends to infinity. The Boltzmann outerplanar maps are then shown to converge in the Gromov-Hausdorff sense towards the $α$-stable looptree introduced by Curien and Kortchemski (2014), with the parameter $α$ depending on the specific weight-sequence. This allows us to describe the transition of the asymptotic geometric shape from a deterministic circle to the Brownian tree.
One-step Estimation of Networked Population Size: Respondent-Driven Capture-Recapture with Anonymity
Published
• View Publication
• BIB
Population size estimates for hidden and hard-to-reach populations are particularly important when members are known to suffer from disproportion health issues or to pose health risks to the larger ambient population in which they are embedded. Efforts to derive size estimates are often frustrated by a range of factors that preclude conventional survey strategies, including social stigma associated with group membership or members' involvement in illegal activities.
This paper extends prior research on the problem of network population size estimation, building on established survey/sampling methodologies commonly used with hard-to-reach groups. Three novel one-step, network-based population size estimators are presented, to be used in the context of uniform random sampling, respondent-driven sampling, and when networks exhibit significant clustering effects. Provably sufficient conditions for the consistency of these estimators (in large configuration networks) are given. Simulation experiments across a wide range of synthetic network topologies validate the performance of the estimators, which are seen to perform well on a real-world location-based social networking data set with significant clustering. Finally, the proposed schemes are extended to allow them to be used in settings where participant anonymity is required. Systematic experiments show favorable tradeoffs between anonymity guarantees and estimator performance.
Taken together, we demonstrate that reasonable population estimates can be derived from anonymous respondent driven samples of 250-750 individuals, within ambient populations of 5,000-40,000. The method thus represents a novel and cost-effective means for health planners and those agencies concerned with health and disease surveillance to estimate the size of hidden populations. Limitations and future work are discussed in the concluding section.
Colored discrete spaces: higher dimensional combinatorial maps and quantum gravity
Published
• View Publication
• BIB
In any dimension $D$, the Euclidean Einstein-Hilbert action, which describes gravity in the absence of matter, can be discretized over random discrete spaces obtained by gluing families of polytopes together in all possible ways. In the physical limit of small Newton constant, only the spaces which maximize the mean curvature survive. In two dimensions, this results in a theory of random discrete spheres, which converge in the continuum limit towards the Brownian sphere, a random fractal space interpreted as a quantum random space-time. In this limit, the continuous Liouville theory of $D=2$ quantum gravity is recovered.
Previous results in higher dimension regarded triangulations - gluings of tetrahedra or $D$-dimensional generalizations, leading to the continuum random tree, or gluings of simple colored building blocks of small sizes, for which multi-trace matrix model results are recovered. This work aims at providing combinatorial tools which would allow a systematic study of richer building blocks and of the spaces they generate in the continuum. We develop a bijection with stacked two-dimensional discrete surfaces, and detail how it can be used to classify discrete spaces according to their mean curvature and topology.
A number of blocks are analyzed, including the new infinite family of bi-pyramids, as well as toroidal and $D$-dimensional generalizations. The relation to random tensor models is detailed. A central concern is the lowest bound on the number of ($D-2$)-cells for any given blocks, or equivalently the right scaling for the associated tensor model to have a well-behaved $1/N$ expansion. We also apply our bijection to the identification of the graphs contributing at any order to the $2n$-point functions of the colored SYK model, and to the enumeration of generalized unicellular maps - spaces obtained from a single building block - according to their mean curvature.
On Mixing Behavior of a Family of Random Walks Determined by a Linear Recurrence
Published
• View Publication
• BIB
We study random walks on the integers mod $G_n$ that are determined by an integer sequence $\{ G_n \}_{n \geq 1}$ generated by a linear recurrence relation. Fourier analysis provides explicit formulas to compute the eigenvalues of the transition matrices and we use this to bound the mixing time of the random walks.
Adding random edges to create the square of a Hamilton cycle
We consider how many random edges need to be added to a graph of order $n$ with minimum degree $αn$ in order that it contains the square of a Hamilton cycle w.h.p..
Combinatorial Miller-Hagberg Algorithm for Randomization of Dense Networks
Published
• View Publication
• BIB
We propose a slightly revised Miller-Hagberg (MH) algorithm that efficiently generates a random network from a given expected degree sequence. The revision was to replace the approximated edge probability between a pair of nodes with a combinatorically calculated edge probability that better captures the likelihood of edge presence especially where edges are dense. The computational complexity of this combinatorial MH algorithm is still in the same order as the original one. We evaluated the proposed algorithm through several numerical experiments. The results demonstrated that the proposed algorithm was particularly good at accurately representing high-degree nodes in dense, heterogeneous networks. This algorithm may be a useful alternative of other more established network randomization methods, given that the data are increasingly becoming larger and denser in today's network science research.
Random numerical semigroups and a simplicial complex of irreducible semigroups
Published
• View Publication
• BIB
We examine properties of random numerical semigroups under a probabilistic model inspired by the Erdos-Renyi model for random graphs. We provide a threshold function for cofiniteness, and bound the expected embedding dimension, genus, and Frobenius number of random semigroups. Our results follow, surprisingly, from the construction of a very natural shellable simplicial complex whose facets are in bijection with irreducible numerical semigroups of a fixed Frobenius number and whose $h$-vector determines the probability that a particular element lies in the semigroup.