Goto

Collaborating Authors

 Education


Using ChatGPT to Design Language Material and Exercises

#artificialintelligence

As stated, educators often misperceive emerging technologies and newly introduced platforms as the saviors of language pedagogy, but this is not the case. Prior to criticizing something new, we think it is important to have a solid understanding of how it works and what good it might accomplish. We are not arguing that lecturers and teachers must all know about AR for language education. As teachers, we all know to let students go and explore and amaze us with their creations. We argue that AR can be motivating and provide a more immersive language learning experience.


Artificial intelligence is not the end of high-school English

#artificialintelligence

If you've been on social media lately, you've doubtless encountered fictional stories and essays generated by "ChatGPT," an artificial intelligence program that can generate remarkably solid pieces of prose in response to prompts both serious and whimsical, and can do so instantly and in any imaginable style. Others, mostly writers and teachers, are filled with existential dread. "My life--and the lives of thousands of other teachers and professors, tutors and administrators--is about to drastically change," wrote English teacher Daniel Herman in The Atlantic. My hunch is that's a lot less true than he thinks. For starters, let's immediately dispense with the idea that artificial intelligence will make writing instruction obsolete.


GWRBoost:A geographically weighted gradient boosting method for explainable quantification of spatially-varying relationships

arXiv.org Artificial Intelligence

The geographically weighted regression (GWR) is an essential tool for estimating the spatial variation of relationships between dependent and independent variables in geographical contexts. However, GWR suffers from the problem that classical linear regressions, which compose the GWR model, are more prone to be underfitting, especially for significant volume and complex nonlinear data, causing inferior comparative performance. Nevertheless, some advanced models, such as the decision tree and the support vector machine, can learn features from complex data more effectively while they cannot provide explainable quantification for the spatial variation of localized relationships. To address the above issues, we propose a geographically gradient boosting weighted regression model, GWRBoost, that applies the localized additive model and gradient boosting optimization method to alleviate underfitting problems and retains explainable quantification capability for spatially-varying relationships between geographically located variables. Furthermore, we formulate the computation method of the Akaike information score for the proposed model to conduct the comparative analysis with the classic GWR algorithm. Simulation experiments and the empirical case study are applied to prove the efficient performance and practical value of GWRBoost. The results show that our proposed model can reduce the RMSE by 18.3% in parameter estimation accuracy and AICc by 67.3% in the goodness of fit.


Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking

arXiv.org Artificial Intelligence

Masked language modeling (MLM) has been widely used for pre-training effective bidirectional representations, but incurs substantial training costs. In this paper, we propose a novel concept-based curriculum masking (CCM) method to efficiently pre-train a language model. CCM has two key differences from existing curriculum learning approaches to effectively reflect the nature of MLM. First, we introduce a carefully-designed linguistic difficulty criterion that evaluates the MLM difficulty of each token. Second, we construct a curriculum that gradually masks words related to the previously masked words by retrieving a knowledge graph. Experimental results show that CCM significantly improves pre-training efficiency. Specifically, the model trained with CCM shows comparative performance with the original BERT on the General Language Understanding Evaluation benchmark at half of the training cost.


Offline Reinforcement Learning for Visual Navigation

arXiv.org Artificial Intelligence

Reinforcement learning can enable robots to navigate to distant goals while optimizing user-specified reward functions, including preferences for following lanes, staying on paved paths, or avoiding freshly mowed grass. However, online learning from trial-and-error for real-world robots is logistically challenging, and methods that instead can utilize existing datasets of robotic navigation data could be significantly more scalable and enable broader generalization. In this paper, we present ReViND, the first offline RL system for robotic navigation that can leverage previously collected data to optimize user-specified reward functions in the real-world. We evaluate our system for off-road navigation without any additional data collection or fine-tuning, and show that it can navigate to distant goals using only offline training from this dataset, and exhibit behaviors that qualitatively differ based on the user-specified reward function.


Distributed-Training-and-Execution Multi-Agent Reinforcement Learning for Power Control in HetNet

arXiv.org Artificial Intelligence

In heterogeneous networks (HetNets), the overlap of small cells and the macro cell causes severe cross-tier interference. Although there exist some approaches to address this problem, they usually require global channel state information, which is hard to obtain in practice, and get the sub-optimal power allocation policy with high computational complexity. To overcome these limitations, we propose a multi-agent deep reinforcement learning (MADRL) based power control scheme for the HetNet, where each access point makes power control decisions independently based on local information. To promote cooperation among agents, we develop a penalty-based Q learning (PQL) algorithm for MADRL systems. By introducing regularization terms in the loss function, each agent tends to choose an experienced action with high reward when revisiting a state, and thus the policy updating speed slows down. In this way, an agent's policy can be learned by other agents more easily, resulting in a more efficient collaboration process. Simulation results show that our proposed PQL can learn the desired power control policy from a dynamic environment where the locations of users change episodically and outperform existing DTE MADRL algorithms. The authors are with the Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, U.K. (e-mail: k.xu21@imperial.ac.uk; huynh.nguyen@imperial.ac.uk; geoffrey.li@imperial.ac.uk) In conventional cellular networks, a macro base station (BS) needs to provide access to the core network for all user devices (UDs) in the cell.


Constitutional AI: Harmlessness from AI Feedback

arXiv.org Artificial Intelligence

As AI systems become more capable, we would like to enlist their help to supervise other AIs. We experiment with methods for training a harmless AI assistant through self-improvement, without any human labels identifying harmful outputs. The only human oversight is provided through a list of rules or principles, and so we refer to the method as 'Constitutional AI'. The process involves both a supervised learning and a reinforcement learning phase. In the supervised phase we sample from an initial model, then generate self-critiques and revisions, and then finetune the original model on revised responses. In the RL phase, we sample from the finetuned model, use a model to evaluate which of the two samples is better, and then train a preference model from this dataset of AI preferences. We then train with RL using the preference model as the reward signal, i.e. we use 'RL from AI Feedback' (RLAIF). As a result we are able to train a harmless but non-evasive AI assistant that engages with harmful queries by explaining its objections to them. Both the SL and RL methods can leverage chain-of-thought style reasoning to improve the human-judged performance and transparency of AI decision making. These methods make it possible to control AI behavior more precisely and with far fewer human labels.


CAINNFlow: Convolutional block Attention modules and Invertible Neural Networks Flow for anomaly detection and localization tasks

arXiv.org Artificial Intelligence

Detection of object anomalies is crucial in industrial processes, but unsupervised anomaly detection and localization is particularly important due to the difficulty of obtaining a large number of defective samples and the unpredictable types of anomalies in real life. Among the existing unsupervised anomaly detection and localization methods, the NF-based scheme has achieved better results. However, the two subnets (complex functions) $s_{i}(u_{i})$ and $t_{i}(u_{i})$ in NF are usually multilayer perceptrons, which need to squeeze the input visual features from 2D flattening to 1D, destroying the spatial location relationship in the feature map and losing the spatial structure information. In order to retain and effectively extract spatial structure information, we design in this study a complex function model with alternating CBAM embedded in a stacked $3\times3$ full convolution, which is able to retain and effectively extract spatial structure information in the normalized flow model. Extensive experimental results on the MVTec AD dataset show that CAINNFlow achieves advanced levels of accuracy and inference efficiency based on CNN and Transformer backbone networks as feature extractors, and CAINNFlow achieves a pixel-level AUC of $98.64\%$ for anomaly detection in MVTec AD.


KDnuggets News, December 14: 3 Free Machine Learning Courses for Beginners • The …

#artificialintelligence

3 Free Machine Learning Courses for Beginners • The Complete Machine Learning Study Roadmap • Five Ways to do Conditional Filtering in Pandas …


KDnuggets News, December 14: 3 Free Machine Learning Courses for Beginners • The Complete Machine Learning Study Roadmap - KDnuggets

#artificialintelligence

3 Free Machine Learning Courses for Beginners • The Complete Machine Learning Study Roadmap • Five Ways to do Conditional Filtering in Pandas • What Are Moment-Generating Functions? • The 5 Rules For Good Data Science Project Documentation