Information Extraction
CoVA: Context-aware Visual Attention for Webpage Information Extraction
Kumar, Anurendra, Morabia, Keval, Wang, Jingjin, Chang, Kevin Chen-Chuan, Schwing, Alexander
Webpage information extraction (WIE) is an important step to create knowledge bases. For this, classical WIE methods leverage the Document Object Model (DOM) tree of a website. However, use of the DOM tree poses significant challenges as context and appearance are encoded in an abstract manner. To address this challenge we propose to reformulate WIE as a context-aware Webpage Object Detection task. Specifically, we develop a Context-aware Visual Attention-based (CoVA) detection pipeline which combines appearance features with syntactical structure from the DOM tree. To study the approach we collect a new large-scale dataset of e-commerce websites for which we manually annotate every web element with four labels: product price, product title, product image and background. On this dataset we show that the proposed CoVA approach is a new challenging baseline which improves upon prior state-of-the-art methods.
Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research
Gruetzemacher, Ross, Paradice, David
AI is widely thought to be poised to transform business, yet current perceptions of the scope of this transformation may be myopic. Recent progress in natural language processing involving transformer language models (TLMs) offers a potential avenue for AI-driven business and societal transformation that is beyond the scope of what most currently foresee. We review this recent progress as well as recent literature utilizing text mining in top IS journals to develop an outline for how future IS research can benefit from these new techniques. Our review of existing IS literature reveals that suboptimal text mining techniques are prevalent and that the more advanced TLMs could be applied to enhance and increase IS research involving text data, and to enable new IS research topics, thus creating more value for the research community. This is possible because these techniques make it easier to develop very powerful custom systems and their performance is superior to existing methods for a wide range of tasks and applications. Further, multilingual language models make possible higher quality text analytics for research in multiple languages. We also identify new avenues for IS research, like language user interfaces, that may offer even greater potential for future IS research.
Real-Time Stock News Sentiment Analyzer
Investing in the Stock Market is a great way of tackling Inflation. Inflation refers to the rise in the prices of most goods and services of daily or common use, such as food, clothing, housing, recreation, transport, consumer staples, etc. Basically, with 100 rupees you won't be able to buy as many vada pavs (wadapavs) as you could last year. In the pandemic-struck financial year of 2020–2021 a whopping 142 lakh new investors have started trading in the stock market. One key skill required to make good investments in the stock market is being able to correctly analyze news related to the finance and the business sector. Which company is diversifying its sectors or which company is showing signs of heading towards bankruptcy?
Sentiment Analysis with Scikit-learn and GCP
For this project, I wanted to design a model that would do a simple classification of whether a phrase is positive or negative. Since I'm only looking for a binary result, I chose to use Sklearn's logistic regression module. If you were trying to predict more than two labels, you would have to use a different ML model. The data used is a corpus of 5,000 movie reviews -- 2,500 positive and 2,500 negative. The model has an accuracy of 90% and probably performs better with text that is similar to a review because it would more like the training data.
Distributionally Robust Classifiers in Sentiment Analysis
Li, Shilun, Li, Renee, Zhang, Carina
In this paper, we propose sentiment classification models based on BERT integrated with DRO (Distributionally Robust Classifiers) to improve model performance on datasets with distributional shifts. We added 2-Layer Bi-LSTM, projection layer (onto simplex or Lp ball), and linear layer on top of BERT to achieve distributionally robustness. We considered one form of distributional shift (from IMDb dataset to Rotten Tomatoes dataset). We have confirmed through experiments that our DRO model does improve performance on our test set with distributional shift from the training set.
The R package sentometrics to compute, aggregate and predict with textual sentiment
Ardia, David, Bluteau, Keven, Borms, Samuel, Boudt, Kris
We provide a hands-on introduction to optimized textual sentiment indexation using the R package sentometrics. Textual sentiment analysis is increasingly used to unlock the potential information value of textual data. The sentometrics package implements an intuitive framework to efficiently compute sentiment scores of numerous texts, to aggregate the scores into multiple time series, and to use these time series to predict other variables. The workflow of the package is illustrated with a built-in corpus of news articles from two major U.S. journals to forecast the CBOE Volatility Index.
Introducing Myself
I decided to sign up to Medium "by the other side" with the aim to publish my AI for Finance projects and empower my knowledge in these sectors, thanks to this great community! I love to analyse stocks and alternative assets prices and making inference using regressions, ensemble methods and sentiment analysis. I may still be not so capable of using Medium but I'll give it a shot! I'm so excited to start this!
Sentimental Analysis in Machine Learning
Sentimental Analysis helps in quickly analyzing the numerous amount of data. Since Artificial Intelligence and its advanced technologies have started influencing different sectors. A lot of research work is taking place for developing different tools that can evolve Artificial Intelligence and Machine Learning more stronger. And Sentiment Analysis is one such topic that has created a buzz in the field of scientific and market research in the field of Natural Language Processing and Machine Learning with the help of its amazing applications. Basically, Sentiment Analysis is a Machine Learning tool.
Integrating diverse extraction pathways using iterative predictions for Multilingual Open Information Extraction
Kotnis, Bhushan, Gashteovski, Kiril, Lawrence, Carolin, Rubio, Daniel Oñoro, Rodriguez-Tembras, Vanesa, Takamoto, Makoto, Niepert, Mathias
In this paper we investigate a simple hypothesis for the Open Information Extraction (OpenIE) task, that it may be easier to extract some elements of an triple if the extraction is conditioned on prior extractions which may be easier to extract. We successfully exploit this and propose a neural multilingual OpenIE system that iteratively extracts triples by conditioning extractions on different elements of the triple leading to a rich set of extractions. The iterative nature of MiLIE also allows for seamlessly integrating rule based extraction systems with a neural end-to-end system leading to improved performance. MiLIE outperforms SOTA systems on multiple languages ranging from Chinese to Galician thanks to it's ability of combining multiple extraction pathways. Our analysis confirms that it is indeed true that certain elements of an extraction are easier to extract than others. Finally, we introduce OpenIE evaluation datasets for two low resource languages namely Japanese and Galician.
Making Document-Level Information Extraction Right for the Right Reasons
Tang, Liyan, Rajan, Dhruv, Mohan, Suyash, Pradhan, Abhijeet, Bryan, R. Nick, Durrett, Greg
Document-level information extraction is a flexible framework compatible with applications where information is not necessarily localized in a single sentence. For example, key features of a diagnosis in radiology a report may not be explicitly stated, but nevertheless can be inferred from the report's text. However, document-level neural models can easily learn spurious correlations from irrelevant information. This work studies how to ensure that these models make correct inferences from complex text and make those inferences in an auditable way: beyond just being right, are these models "right for the right reasons?" We experiment with post-hoc evidence extraction in a predict-select-verify framework using feature attribution techniques. While this basic approach can extract reasonable evidence, it can be regularized with small amounts of evidence supervision during training, which substantially improves the quality of extracted evidence. We evaluate on two domains: a small-scale labeled dataset of brain MRI reports and a large-scale modified version of DocRED (Yao et al., 2019) and show that models' plausibility can be improved with no loss in accuracy.