Oceania
Machine Learning Towards Intelligent Systems: Applications, Challenges, and Opportunities
Injadat, MohammadNoor, Moubayed, Abdallah, Nassif, Ali Bou, Shami, Abdallah
The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to understand such large amounts of data. Machine learning (ML) provides a mechanism for humans to process large amounts of data, gain insights about the behavior of the data, and make more informed decision based on the resulting analysis. ML has applications in various fields. This review focuses on some of the fields and applications such as education, healthcare, network security, banking and finance, and social media. Within these fields, there are multiple unique challenges that exist. However, ML can provide solutions to these challenges, as well as create further research opportunities. Accordingly, this work surveys some of the challenges facing the aforementioned fields and presents some of the previous literature works that tackled them. Moreover, it suggests several research opportunities that benefit from the use of ML to address these challenges.
Neurocognitive Informatics Manifesto
Theoretical and abstract approaches to information have made great advances, but human information processing is still unmatched in many areas, including information management, representation and understanding. Neurocognitive informatics is a new, emerging field that should help to improve the matching of artificial and natural systems, and inspire better computational algorithms to solve problems that are still beyond the reach of machines. In this position paper examples of neurocognitive inspirations and promising directions in this area are given.
Stabilized Nested Rollout Policy Adaptation
Cazenave, Tristan, Sevestre, Jean-Baptiste, Toulemont, Matthieu
Nested Rollout Policy Adaptation (NRPA) is a Monte Carlo search algorithm for single player games. In this paper we propose to modify NRPA in order to improve the stability of the algorithm. Experiments show it improves the algorithm for different application domains: SameGame, Traveling Salesman with Time Windows and Expression Discovery.
Detecting Hostile Posts using Relational Graph Convolutional Network
Sarthak, null, Shukla, Shikhar, Mittal, Govind, Arya, Karm Veer
This work is based on the submission to the competition Hindi Constraint conducted by AAAI@2021 for detection of hostile posts in Hindi on social media platforms. Here, a model is presented for detection and classification of hostile posts and further classify into fake, offensive, hate and defamation using Relational Graph Convolutional Networks. Unlike other existing work, our approach is focused on using semantic meaning along with contextutal information for better classification. The results from AAAI@2021 indicates that the proposed model is performing at par with Google's XLM-RoBERTa on the given dataset. Our best submission with RGCN achieves an F1 score of 0.97 (7th Rank) on coarse-grained evaluation and achieved best performance on identifying fake posts. Among all submissions to the challenge, our classification system with XLM-Roberta secured 2nd rank on fine-grained classification.
Disentangling homophily, community structure and triadic closure in networks
Network homophily, the tendency of similar nodes to be connected, and transitivity, the tendency of two nodes being connected if they share a common neighbor, are conflated properties in network analysis, since one mechanism can drive the other. Here we present a generative model and corresponding inference procedure that is capable of distinguishing between both mechanisms. Our approach is based on a variation of the stochastic block model (SBM) with the addition of triadic closure edges, and its inference can identify the most plausible mechanism responsible for the existence of every edge in the network, in addition to the underlying community structure itself. We show how the method can evade the detection of spurious communities caused solely by the formation of triangles in the network, and how it can improve the performance of link prediction when compared to the pure version of the SBM without triadic closure.
Land Use Detection & Identification using Geo-tagged Tweets
Geo-tagged tweets can potentially help with sensing the interaction of people with their surrounding environment. Based on this hypothesis, this paper makes use of geotagged tweets in order to ascertain various land uses with a broader goal to help with urban/city planning. The proposed method utilises supervised learning to reveal spatial land use within cities with the help of Twitter activity signatures. Specifically, the technique involves using tweets from three cities of Australia namely Brisbane, Melbourne and Sydney. Analytical results are checked against the zoning data provided by respective city councils and a good match is observed between the predicted land use and existing land zoning by the city councils. We show that geo-tagged tweets contain features that can be useful for land use identification.
Robust Blockchained Federated Learning with Model Validation and Proof-of-Stake Inspired Consensus
Chen, Hang, Asif, Syed Ali, Park, Jihong, Shen, Chien-Chung, Bennis, Mehdi
Federated learning (FL) is a promising distributed learning solution that only exchanges model parameters without revealing raw data. However, the centralized architecture of FL is vulnerable to the single point of failure. In addition, FL does not examine the legitimacy of local models, so even a small fraction of malicious devices can disrupt global training. To resolve these robustness issues of FL, in this paper, we propose a blockchain-based decentralized FL framework, termed VBFL, by exploiting two mechanisms in a blockchained architecture. First, we introduced a novel decentralized validation mechanism such that the legitimacy of local model updates is examined by individual validators. Second, we designed a dedicated proof-of-stake consensus mechanism where stake is more frequently rewarded to honest devices, which protects the legitimate local model updates by increasing their chances of dictating the blocks appended to the blockchain. Together, these solutions promote more federation within legitimate devices, enabling robust FL. Our emulation results of the MNIST classification corroborate that with 15% of malicious devices, VBFL achieves 87% accuracy, which is 7.4x higher than Vanilla FL.
Internet of Everything enabled solution for COVID-19, its new variants and future pandemics: Framework, Challenges, and Research Directions
Khowaja, Sunder Ali, Khuwaja, Parus, Dev, Kapal
After affecting the world in unexpected ways, COVID-19 has started mutating which is evident with the insurgence of its new variants. The governments, hospitals, schools, industries, and humans, in general, are looking for a potential solution in the vaccine which will eventually be available but its timeline for eradicating the virus is yet unknown. Several researchers have encouraged and recommended the use of good practices such as physical healthcare monitoring, immunity-boosting, personal hygiene, mental healthcare, and contact tracing for slowing down the spread of the virus. In this article, we propose the use of wearable/mobile sensors integrated with the Internet of Everything to cover the spectrum of good practices in an automated manner. We present hypothetical frameworks for each of the good practice modules and propose the COvid-19 Resistance Framework using the Internet of Everything (CORFIE) to tie all the individual modules in a unified architecture. We envision that CORFIE would be influential in assisting people with the new normal for current and future pandemics as well as instrumental in halting the economic losses, respectively. We also provide potential challenges and their probable solutions in compliance with the proposed CORFIE.
Curriculum-Meta Learning for Order-Robust Continual Relation Extraction
Wu, Tongtong, Li, Xuekai, Li, Yuan-Fang, Haffari, Reza, Qi, Guilin, Zhu, Yujin, Xu, Guoqiang
Continual relation extraction is an important task that focuses on extracting new facts incrementally from unstructured text. Given the sequential arrival order of the relations, this task is prone to two serious challenges, namely catastrophic forgetting and order-sensitivity. We propose a novel curriculum-meta learning method to tackle the above two challenges in continual relation extraction. We combine meta learning and curriculum learning to quickly adapt model parameters to a new task and to reduce interference of previously seen tasks on the current task. We design a novel relation representation learning method through the distribution of domain and range types of relations. Such representations are utilized to quantify the difficulty of tasks for the construction of curricula. Moreover, we also present novel difficulty-based metrics to quantitatively measure the extent of order-sensitivity of a given model, suggesting new ways to evaluate model robustness. Our comprehensive experiments on three benchmark datasets show that our proposed method outperforms the state-of-the-art techniques. The code is available at the anonymous GitHub repository: https://github.com/wutong8023/AAAI_CML.
Tubulin glycylation controls axonemal dynein activity, flagellar beat, and male fertility
Physiological functions of the microtubule cytoskeleton are expected to be regulated by a variety of posttranslational tubulin modifications. For instance, tubulin glycylation is almost exclusively found in cilia and flagella, but its role in the function of these organelles remains unclear. Gadadhar et al. now demonstrate in mice that glycylation, although nonessential for the formation of cilia and flagella, coordinates the beat waveform of sperm flagella. This activity is a prerequisite for progressive sperm swimming and thus for male fertility. At the ultrastructural level, lack of glycylation perturbed the distribution of axonemal dynein conformations, which may explain the observed defects in flagellar beat. Science , this issue p. [eabd4914][1] ### INTRODUCTION Microtubules are key components of the eukaryotic cytoskeleton. Although they are involved in a wide variety of functions, microtubules are structurally highly similar across most cell types and organisms. It was suggested that a “tubulin code,” formed by combinations of tubulin posttranslational modifications, adapts individual microtubules to specific functions within living cells. However, clear-cut functional and mechanistic data verifying this concept are still scarce. Glycylation is among the least explored posttranslational modifications of tubulin and has, so far, exclusively been found on microtubules of cilia and flagella from a variety of species. Previous work has suggested that glycylation might be essential for cilia and flagella, but mechanistic insight remains lacking. ### RATIONALE Two enzymes from the tubulin-tyrosine ligase-like (TTLL) family, TTLL3 and TTLL8, are essential to initiate glycylation of tubulin in mammals. To entirely abolish glycylation at the organism level and to determine its physiological function, we generated a double-knockout mouse lacking both glycylating enzymes ( Ttll3−/−Ttll8−/− ). Inactivation of these two enzymes led to a lack of glycylation in all analyzed cilia and flagella. This allowed us to investigate the role of glycylation in the function of these organelles. ### RESULTS Despite the absence of glycylation in Ttll3−/−Ttll8−/− mice, no gross defects were observed at the organism and tissue levels. Motile ependymal cilia in brain ventricles as well as motile cilia in the respiratory tract were present and appeared normal. Sperm flagella were also assembled normally, and sperm were able to swim. However, in vitro fertility assays showed that male Ttll3−/−Ttll8−/− mice were subfertile. Computer-assisted sperm analyses revealed motility defects of Ttll3−/−Ttll8−/− sperm. Further analyses showed that lack of glycylation leads to perturbed flagellar beat patterns, causing Ttll3−/−Ttll8−/− sperm to swim predominantly along circular paths. This is highly unusual for mammalian sperm and interferes with their ability to reach the oocyte for fertilization. To determine the molecular mechanisms underlying this aberrant flagellar beat, we used cryo–electron tomography. The three-dimensional structure of the 96-nm repeat of the Ttll3−/−Ttll8−/− sperm axoneme showed no aberrations in its overall assembly. By contrast, the structure of both outer and inner dynein arms (ODAs and IDAs) was perturbed in Ttll3−/−Ttll8−/− flagella. Classification analysis showed that the incidence and distribution of pre-powerstroke and post-powerstroke conformations of ODAs and IDAs were altered in Ttll3−/−Ttll8−/− sperm. These ultrastructural findings indicate that glycylation is required to efficiently control the dynein powerstroke cycle, which is essential for the generation of a physiological flagellar beat. ### CONCLUSION Our work shows that tubulin glycylation regulates the beat of mammalian flagella by modulating axonemal dynein motor activity. Lack of glycylation leads to perturbed sperm motility and male subfertility in mice. Considering that human sperm are more susceptible than mouse sperm to deficiencies in sperm motility, our findings imply that a perturbation of tubulin glycylation could underlie some forms of male infertility in humans. ![Figure][2] Tubulin glycylation controls sperm motility. ( A ) Microtubules in sperm flagella are rich in tubulin posttranslational modifications. Mice deficient for the glycylating enzymes TTLL3 and TTLL8 lack glycylation. ( B ) Mammalian sperm swim in linear paths. In the absence of glycylation, abnormal, mostly circular swimming patterns are observed, which impede progressive swimming. ( C ) Absence of glycylation leads to perturbed distribution of axonemal dynein conformations in Ttll3−/−Ttll8−/− flagella, which impedes normal flagellar beating. Posttranslational modifications of the microtubule cytoskeleton have emerged as key regulators of cellular functions, and their perturbations have been linked to a growing number of human pathologies. Tubulin glycylation modifies microtubules specifically in cilia and flagella, but its functional and mechanistic roles remain unclear. In this study, we generated a mouse model entirely lacking tubulin glycylation. Male mice were subfertile owing to aberrant beat patterns of their sperm flagella, which impeded the straight swimming of sperm cells. Using cryo–electron tomography, we showed that lack of glycylation caused abnormal conformations of the dynein arms within sperm axonemes, providing the structural basis for the observed dysfunction. Our findings reveal the importance of microtubule glycylation for controlled flagellar beating, directional sperm swimming, and male fertility. [1]: /lookup/doi/10.1126/science.abd4914 [2]: pending:yes