Africa
A Review on Method Entities in the Academic Literature: Extraction, Evaluation, and Application
Wang, Yuzhuo, Zhang, Chengzhi, Li, Kai
In scientific research, the method is an indispensable means to solve scientific problems and a critical research object. With the advancement of sciences, many scientific methods are being proposed, modified, and used in academic literature. The authors describe details of the method in the abstract and body text, and key entities in academic literature reflecting names of the method are called method entities. Exploring diverse method entities in a tremendous amount of academic literature helps scholars understand existing methods, select the appropriate method for research tasks, and propose new methods. Furthermore, the evolution of method entities can reveal the development of a discipline and facilitate knowledge discovery. Therefore, this article offers a systematic review of methodological and empirical works focusing on extracting method entities from full-text academic literature and efforts to build knowledge services using these extracted method entities. Definitions of key concepts involved in this review were first proposed. Based on these definitions, we systematically reviewed the approaches and indicators to extract and evaluate method entities, with a strong focus on the pros and cons of each approach. We also surveyed how extracted method entities are used to build new applications. Finally, limitations in existing works as well as potential next steps were discussed.
Recovering network topology and dynamics via sequence characterization
Guerreiro, Lucas, Silva, Filipi N., Amancio, Diego R.
Sequences arise in many real-world scenarios; thus, identifying the mechanisms behind symbol generation is essential to understanding many complex systems. This paper analyzes sequences generated by agents walking on a networked topology. Given that in many real scenarios, the underlying processes generating the sequence is hidden, we investigate whether the reconstruction of the network via the co-occurrence method is useful to recover both the network topology and agent dynamics generating sequences. We found that the characterization of reconstructed networks provides valuable information regarding the process and topology used to create the sequences. In a machine learning approach considering 16 combinations of network topology and agent dynamics as classes, we obtained an accuracy of 87% with sequences generated with less than 40% of nodes visited. More extensive sequences turned out to generate improved machine learning models. Our findings suggest that the proposed methodology could be extended to classify sequences and understand the mechanisms behind sequence generation.
Efficient Implementation of Non-linear Flow Law Using Neural Network into the Abaqus Explicit FEM code
Pantalé, Olivier, Mha, Pierre Tize, Tongne, Amèvi
Machine learning techniques are increasingly used to predict material behavior in scientific applications and offer a significant advantage over conventional numerical methods. In this work, an Artificial Neural Network (ANN) model is used in a finite element formulation to define the flow law of a metallic material as a function of plastic strain, plastic strain rate and temperature. First, we present the general structure of the neural network, its operation and focus on the ability of the network to deduce, without prior learning, the derivatives of the flow law with respect to the model inputs. In order to validate the robustness and accuracy of the proposed model, we compare and analyze the performance of several network architectures with respect to the analytical formulation of a Johnson-Cook behavior law for a 42CrMo4 steel. In a second part, after having selected an Artificial Neural Network architecture with $2$ hidden layers, we present the implementation of this model in the Abaqus Explicit computational code in the form of a VUHARD subroutine. The predictive capability of the proposed model is then demonstrated during the numerical simulation of two test cases: the necking of a circular bar and a Taylor impact test. The results obtained show a very high capability of the ANN to replace the analytical formulation of a Johnson-Cook behavior law in a finite element code, while remaining competitive in terms of numerical simulation time compared to a classical approach.
Coalgebraic Fuzzy geometric logic
Das, Litan Kumar, Ray, Kumar Sankar, Mali, Prakash Chandra
The paper aims to develop a framework for coalgebraic fuzzy geometric logic by adding modalities to the language of fuzzy geometric logic. Using the methods of coalgebra, the modal operators are introduced in the language of fuzzy geometric logic. To define the modal operators, we introduce a notion of fuzzy-open predicate lifting. Based on coalgebras for an endofunctor $T$ on the category $\textbf{Fuzzy-Top}$ of fuzzy topological spaces and fuzzy continuous maps, we build models for the coalgebraic fuzzy geometric logic. Bisimulations for the defined models are discussed in this work.
Investigating Reasons for Disagreement in Natural Language Inference
Jiang, Nan-Jiang, de Marneffe, Marie-Catherine
We investigate how disagreement in natural language inference (NLI) annotation arises. We developed a taxonomy of disagreement sources with 10 categories spanning 3 high-level classes. We found that some disagreements are due to uncertainty in the sentence meaning, others to annotator biases and task artifacts, leading to different interpretations of the label distribution. We explore two modeling approaches for detecting items with potential disagreement: a 4-way classification with a "Complicated" label in addition to the three standard NLI labels, and a multilabel classification approach. We found that the multilabel classification is more expressive and gives better recall of the possible interpretations in the data.
Traffic Congestion Prediction Using Machine Learning Techniques
Yasir, Rafed Muhammad, Nower, Dr. Naushin, Shoyaib, Dr. Mohammad
The prediction of traffic congestion can serve a crucial role in making future decisions. Although many studies have been conducted regarding congestion, most of these could not cover all the important factors (e.g., weather conditions). We proposed a prediction model for traffic congestion that can predict congestion based on day, time and several weather data (e.g., temperature, humidity). To evaluate our model, it has been tested against the traffic data of New Delhi. With this model, congestion of a road can be predicted one week ahead with an average RMSE of 1.12. Therefore, this model can be used to take preventive measure beforehand.
reStructured Pre-training
In this work, we try to decipher the internal connection of NLP technology development in the past decades, searching for essence, which rewards us with a (potential) new learning paradigm for NLP tasks, dubbed as reStructured Pre-training (RST). In such a paradigm, the role of data will be re-emphasized, and model pre-training and fine-tuning of downstream tasks are viewed as a process of data storing and accessing. Based on that, we operationalize the simple principle that a good storage mechanism should not only have the ability to cache a large amount of data but also consider the ease of access. We achieve this by pre-training models over restructured data that consist of a variety of valuable information instead of raw data after overcoming several engineering challenges. Experimentally, RST models not only surpass strong competitors (e.g., T0) on 52/55 popular datasets from a variety of NLP tasks (e.g., classification, information extraction, fact retrieval, text generation, etc.) without fine-tuning on downstream tasks, but also achieve superior performance in National College Entrance Examination - English (Gaokao-English), the most authoritative examination in China, which millions of students will attend every year. Specifically, the proposed system Qin () achieves 40 points higher than the average scores made by students and 15 points higher than GPT3 with 1/16 parameters. In particular, Qin gets a high score of 138.5 (the full mark is 150) in the 2018 English exam (national paper III). We have released the Gaokao Benchmark with an online submission platform that contains ten annotated English papers from 2018-2021 so far (and will be expanded annually), which allows more AI models to attend Gaokao, establishing a relatively fair test bed for human and AI competition and helping us better understand where we are. We test our model in the 2022 College Entrance Examination English that happened a few days ago (2022.06.08), and it gets a total score of 134 (v.s.
Multi-Scale Attention-based Multiple Instance Learning for Classification of Multi-Gigapixel Histology Images
Wibawa, Made Satria, Lo, Kwok-Wai, Young, Lawrence, Rajpoot, Nasir
Histology images with multi-gigapixel of resolution yield rich information for cancer diagnosis and prognosis. Most of the time, only slide-level label is available because pixel-wise annotation is labour intensive task. In this paper, we propose a deep learning pipeline for classification in histology images. Using multiple instance learning, we attempt to predict the latent membrane protein 1 (LMP1) status of nasopharyngeal carcinoma (NPC) based on haematoxylin and eosin-stain (H&E) histology images. We utilised attention mechanism with residual connection for our aggregation layers. In our 3-fold cross-validation experiment, we achieved average accuracy, AUC and F1-score 0.936, 0.995 and 0.862, respectively. This method also allows us to examine the model interpretability by visualising attention scores. To the best of our knowledge, this is the first attempt to predict LMP1 status on NPC using deep learning.
AI In Healthcare Highlights & Milestones Summer 2022
This is my new AI in Healthcare Highlights & Milestones Report for Summer 2022. This report includes an overview of advances made during the summer across the healthcare spectrum including important studies, regulatory clearances, fundraising, partnerships, and growth in the AI ecosystem worldwide. This summer scientists demonstrated how they successfully used AI in many areas including: to reduce sepsis deaths, to predict cardiac events, to detect breast cancer, to detect lung cancer, to detects osteoporosis, to detect Parkinson's, to monitor diabetic retinopathy, to detect heart disease, to detect bladder cancer, to enable pathology, to detect fractures, and to monitor Parkinson's using the Apple Watch. In July scientists in Germany published a large scale study demonstrating that radiologists working with AI were more accurate detecting breast cancer than radiologists working without AI, and vice versa - the AI was more accurate when working with a radiologist than when working independently. The study was led by Vara, a German company, in collaboration with radiologists at the Essen University Hospital in Germany and the Memorial Sloan Kettering Cancer Center in New York. Vara's AI is has been used by radiologists in German breast screening centers for two years and is used in 30% of Germany's breast cancer screening centers. Vara's AI software is also used to screen for breast cancer in a hospital in Mexico and in a hospital in Greece.