Technology
Taxonomy-Based Discovery and Annotation of Functional Areas in the City
Vaca, Carmen Karina (Escuela Superior Politecnica del Litoral, ESPOL, Facultad de Ingeniería en Electricidad y Computacion) | Quercia, Daniele (University of Cambridge) | Bonchi, Francesco (Yahoo Labs) | Fraternali, Piero (Politecnico di Milano)
Mapping the functional use of city areas (e.g., mapping clusters of hotels or of electronic shops) enables a variety of applications (e.g., innovative way-finding tools). To do that mapping, researchers have recently processed geo-referenced data with spatial clustering algorithms. These algorithms usually perform two consecutive steps: they cluster nearby points on the map, and then assign labels (e.g., 'electronics') to the resulting clusters. When applied in the city context, these algorithms do not fully work, not least because they consider the two steps of clustering and labeling as separate. Since there is no reason to keep those two steps separate, we propose a framework that clusters points based not only on their density but also on their semantic relatedness. We evaluate this framework upon Foursquare data in the cities of Barcelona, Milan, and London. We find that it is more effective than the baseline method of DBSCAN in discovering functional areas. We complement that quantitative evaluation with a user study involving 111 participants in the three cities. Finally, to illustrate the generalizability of our framework, we process temporal data with it and successfully discover seasonal uses of the city.
Event-Based Clustering for Reducing Labeling Costs of Event-related Microposts
Schulz, Axel (DB Mobiliy Logistics AG and Technische Universität Darmstadt) | Janssen, Frederik (Technische Universität Darmstadt) | Ristoski, Petar (University of Mannheim) | Fürnkranz, Johannes (Technische Universität Darmstadt)
Automatically identifying the event type of event-related information in the sheer amount of social media data makes machine learning inevitable. However, this is highly dependent on (1) the number of correctly labeled instances and (2) labeling costs. Active learning has been proposed to reduce the number of instances to label. Albeit the thematic dimension is already used, other metadata such as spatial and temporal information that is helpful for achieving a more fine-grained clustering is currently not taken into account. In this paper, we present a novel event-based clustering strategy that makes use of temporal, spatial, and thematic metadata to determine instances to label. An evaluation on incident-related tweets shows that our selection strategy for active learning outperforms current state-of-the-art approaches even with few labeled instances.
An Ethnomethodologically-Informed Approach to Interface Design for Social Interactions around Video Online
Zawilska, Anna (University of Oxford) | Albury, Steven (University of Oxford)
With the emergence of video on community media sites such as YouTube or TED, there is a need to understand interactions by community participants around video in order to maximise the potential of these systems to support communities and create meaningful interactions online. In this paper, we illustrate how ethnomethodologically-informed studies of the social interactions among a small group of co-located participants around video may be used to inform the design of an online video interface which may support interactions by a large distributed group of participants. Our point of view is grounded in the idea that the interactional accomplishments of a co-located group remain relevant at a distributed level, thereby allowing an ethnomethodologically-informed approach to arrive at effective implications for design of online systems. A strength of this approach is the potential to create implications which are properly grounded in a set of observations of the precise ways in which people interact to accomplish social interaction around video. For the purpose of illustration, we perform an analysis of a fragment of video data collected from a quasi-naturalistic experiment of a co-located group collaboratively annotating a video, from which we propose a number of design implications for a video annotation interface.
Analysis and Prediction of Question Topic Popularity in Community Q&A Sites: A Case Study of Quora
Maity, Suman Kalyan (Indian Institute of Technology Kharagpur) | Sahni, Jot Sarup Singh (Indian Institute of Technology Kharagpur) | Mukherjee, Animesh (Indian Institute of Technology Kharagpur)
In the past few years, Quora a community-driven social platform for question and answering, has grown exponentially from a small community of users into one of the largest and reliable source of Q&A on the Internet. Quora has a built-in social structure integrated to its backbone; users can follow each other, follow question, topics etc. Apart from the social connections that Quora provides, it has developed a knowledge base nicely organized via hierarchy and relatedness of topics. In this paper, we consider a massive dataset of more than four years and analyze the dynamics of topical growth over time; how various factors affect the popularity of a topic or its acceptance in Q&A community. We also propose a regression model to predict the popularity of the topics and discuss the important discriminating features. We achieve a high prediction accuracy (correlation coefficient ~0.773) with low root mean square error (~1.065). We further categorize thetopics into a few broad classes by implementing a simple Latent Dirichlet Allocation (LDA) model on the question texts associated with the topics. In comparison to the data sample with no categorization, this stratification of the topics enhances the prediction accuracies for several categories. However, for certain categories there seems to a slight decrease in the accuracy values and we present an in-depth discussion analyzing the cause for the same pointing out potential ways for improvement. We believe that this thorough measurement study will have a direct application to a service like recommending trending topics in Quora.
Predicting Speech Acts in MOOC Forum Posts
Arguello, Jaime (University of North Carolina at Chapel Hill) | Shaffer, Kyle (University of North Carolina at Chapel Hill)
Students in a Massive Open Online Course (MOOC) interact with each other and the course staff through online discussion forums. While discussion forums play a central role in MOOCs, they also pose a challenge for instructors. The large number of student posts makes it difficult for an instructor to know where to intervene to answer questions, resolve issues, and provide feedback. In this work, we focus on automatically predicting speech acts in MOOC forum posts. Our speech act categories describe the purpose or function of the post in the ongoing discussion. Specifically, we address three main research questions. First, we investigate whether crowdsourced workers can reliably label MOOC forum posts using our speech act definitions. Second, we investigate whether our speech acts can help predict instructor interventions and assignment completion and performance. Finally, we investigate which types of features (derived from the post content, author, and surrounding context) are most effective for predicting our different speech act categories.
Analyzing and Detecting Opinion Spam on a Large-scale Dataset via Temporal and Spatial Patterns
Li, Huayi (University of Illinois at Chicago) | Chen, Zhiyuan (University of Illinois at Chicago) | Mukherjee, Arjun (University of Houston) | Liu, Bing (University of Illinois at Chicago) | Shao, Jidong (Dianping Inc.)
Although opinion spam (or fake review) detection has attracted significant research attention in recent years, the problem is far from solved. One key reason is that there is no large-scale ground truth labeled dataset available for model building. Some review hosting sites such as Yelp.com and Dianping.com have built fake review filtering systems to ensure the quality of their reviews, but their algorithms are trade secrets. Working with Dianping, we present the first large-scale analysis of restaurant reviews filtered by Dianping's fake review filtering system. Along with the analysis, we also propose some novel temporal and spatial features for supervised opinion spam detection. Our results show that these features significantly outperform existing state-of-art features.
Exploratory Access to Wikipedia through Faceted Dynamic Taxonomies
Sacco, Giovanni Maria (Universita')
Users currently access Wikipedia through two traditional paradigms, text search and hypertext navigation. We believe that user access can be significantly improved by supporting a systematic conceptual exploration of the knowledge base through dynamic taxonomies with a faceted taxonomy organization. This approach allows the easy manipulation of sets of documents and the systematic and intuitive exploration of complex knowledge bases.
Sync-Rank: Robust Ranking, Constrained Ranking and Rank Aggregation via Eigenvector and Semidefinite Programming Synchronization
We consider the classic problem of establishing a statistical ranking of a set of n items given a set of inconsistent and incomplete pairwise comparisons between such items. Instantiations of this problem occur in numerous applications in data analysis (e.g., ranking teams in sports data), computer vision, and machine learning. We formulate the above problem of ranking with incomplete noisy information as an instance of the group synchronization problem over the group SO(2) of planar rotations, whose usefulness has been demonstrated in numerous applications in recent years. Its least squares solution can be approximated by either a spectral or a semidefinite programming (SDP) relaxation, followed by a rounding procedure. We perform extensive numerical simulations on both synthetic and real-world data sets, showing that our proposed method compares favorably to other algorithms from the recent literature. Existing theoretical guarantees on the group synchronization problem imply lower bounds on the largest amount of noise permissible in the ranking data while still achieving exact recovery. We propose a similar synchronization-based algorithm for the rank-aggregation problem, which integrates in a globally consistent ranking pairwise comparisons given by different rating systems on the same set of items. We also discuss the problem of semi-supervised ranking when there is available information on the ground truth rank of a subset of players, and propose an algorithm based on SDP which recovers the ranks of the remaining players. Finally, synchronization-based ranking, combined with a spectral technique for the densest subgraph problem, allows one to extract locally-consistent partial rankings, in other words, to identify the rank of a small subset of players whose pairwise comparisons are less noisy than the rest of the data, which other methods are not able to identify.
The Gram-Charlier A Series based Extended Rule-of-Thumb for Bandwidth Selection in Univariate and Multivariate Kernel Density Estimations
The article derives a novel Gram-Charlier A (GCA) Series based Extended Rule-of-Thumb (ExROT) for bandwidth selection in Kernel Density Estimation (KDE). There are existing various bandwidth selection rules achieving minimization of the Asymptotic Mean Integrated Square Error (AMISE) between the estimated probability density function (PDF) and the actual PDF. The rules differ in a way to estimate the integration of the squared second order derivative of an unknown PDF $(f(\cdot))$, identified as the roughness $R(f''(\cdot))$. The simplest Rule-of-Thumb (ROT) estimates $R(f''(\cdot))$ with an assumption that the density being estimated is Gaussian. Intuitively, better estimation of $R(f''(\cdot))$ and consequently better bandwidth selection rules can be derived, if the unknown PDF is approximated through an infinite series expansion based on a more generalized density assumption. As a demonstration and verification to this concept, the ExROT derived in the article uses an extended assumption that the density being estimated is near Gaussian. This helps use of the GCA expansion as an approximation to the unknown near Gaussian PDF. The ExROT for univariate KDE is extended to that for multivariate KDE. The required multivariate AMISE criteria is re-derived using elementary calculus of several variables, instead of Tensor calculus. The derivation uses the Kronecker product and the vector differential operator to achieve the AMISE expression in vector notations. There is also derived ExROT for kernel based density derivative estimator.
Properties of the Least Squares Temporal Difference learning algorithm
This paper presents four different ways of looking at the well-known Least Squares Temporal Differences (LSTD) algorithm for computing the value function of a Markov Reward Process, each of them leading to different insights: the operator-theory approach via the Galerkin method, the statistical approach via instrumental variables, the linear dynamical system view as well as the limit of the TD iteration. We also give a geometric view of the algorithm as an oblique projection. Furthermore, there is an extensive comparison of the optimization problem solved by LSTD as compared to Bellman Residual Minimization (BRM). We then review several schemes for the regularization of the LSTD solution. We then proceed to treat the modification of LSTD for the case of episodic Markov Reward Processes.