hyper-geometric distribution
A Note on Optimal Sampling Strategy for Structural Variant Detection Using Optical Mapping
Li, Weiwei, Hannig, Jan, Jones, Corbin
A Note on Optimal Sampling Strategy for Structural V ariant Detection Using Optical Mapping Weiwei Li Department of Statistics and Operations Research University of North Carolina at Chapel Hill weiweili@live.unc.edu Abstract Structural variants compose the majority of human genetic variation, but are difficult to assess using current genomic sequencing technologies. Optical mapping technologies, which measure the size of chromosomal fragments between labeled markers, offer an alternative approach. As these technologies mature towards becoming clinical tools, there is a need to develop an approach for determining the optimal strategy for sampling biological material in order to detect a variant at some threshold. Here we develop an optimization approach using a simple, yet realistic, model of the genomic mapping process using a hyper-geometric distribution and probabilistic concentration inequalities. Our approach is both computationally and analytically tractable and includes a novel approach to getting tail bounds of hyper-geometric distribution. We show that if a genomic mapping technology can sample most of the chromosomal fragments within a sample, comparatively little biological material is needed to detect a variant at high confidence. 1 Introduction Structural variants (SV), insertions, deletions, translocations, copy number variants, are by far the most common types of human genetic variation (Chaisson et al., 2015). They have been linked to large number of heritable disorders (Hurles et al., 2008). Technology to assay the presence or absence of these variants has steadily improved in ease and resolution (Huddleston and Eichler, 2016; Audano et al., 2019).
New probabilistic interest measures for association rules
Hahsler, Michael, Hornik, Kurt
Mining association rules is an important technique for discovering meaningful patterns in transaction databases. Many different measures of interestingness have been proposed for association rules. However, these measures fail to take the probabilistic properties of the mined data into account. In this paper, we start with presenting a simple probabilistic framework for transaction data which can be used to simulate transaction data when no associations are present. We use such data and a real-world database from a grocery outlet to explore the behavior of confidence and lift, two popular interest measures used for rule mining. The results show that confidence is systematically influenced by the frequency of the items in the left hand side of rules and that lift performs poorly to filter random noise in transaction data. Based on the probabilistic framework we develop two new interest measures, hyper-lift and hyper-confidence, which can be used to filter or order mined association rules. The new measures show significantly better performance than lift for applications where spurious rules are problematic.