Goto

Collaborating Authors

 Education


Cultivating social emotional learning in the metaverse

#artificialintelligence

Cultivating social emotional learning in the metaverse Nandini Chatterjee Singh and Anantha Duraiappah 19 November 2022 "Can't live this lifeless life anymore. Screens, lectures, messages, mails, marks, deadlines, expectations, this room, that laptop, religion, restrictions, health, family, feelings, theories, equations, numbers ... and me, reasons are many. These were the last words of a young student from a premier institution in India before he took his life. He was a young man in his prime who should have been happy and enjoying life. Was this a one-off incident?


Towards AI: The World's Leading AI And Technology Publication - AI Summary

#artificialintelligence

The Towards AI team is committed to publishing unbiased AI and technology-related articles. Our goal is to be an impartial source of information for thought-leaders and decision-makers around the world. We have thousands of contributing writers from university professors, researchers, graduate students, industry experts, and enthusiasts. We receive millions of visits per year, have several thousands of followers across social media, and thousands of subscribers. Originally published on Towards AI the World's Leading AI and Technology News and Media Company.


Top Online Courses for 2023

#artificialintelligence

Would you like to take advantage of the best online courses for accelerating your career, taught by qualified professionals with job assistance? Well, you've come to the right place! First, I am starting discussion about Clinical SAS and then one by one will cover all. If you are among those who in 2023 have decided to face the challenge of presenting yourself to some oppositions of the Health Care, Clinical Research or Pharmaceutical organization this Clinical SAS knowledge can help you. Statistical Analysis System or SAS is mainly a statistical software that is used for Business analytical purpose, Data management, and in Predictive analysis also.


Manager Machine Learning Engineering

#artificialintelligence

About your future team Nexient is on a mission: To rid the world of crappy software, one sprint at a time1-on-1 mentorship, training and advice to help users land their next job. Pay only if you succeed in getting hired and start work at a high-paying job first. Ready to find your dream job? This culture of teamwork and curiosity is fueled by a product-minded approach to our work, crafting extraordinary custom software solutions and growing careers along the way Our clients range from some of America's favorite brands in retail, healthcare, financial services to fast-emerging disruptors โ€“ You might have read about us in the NY TimesAd: Use this free career assessment test to figure it out. We're also recognized as a Gartner Cool Vendor, HFS Hot Vendor, and America's leading 100% US1-on-1 mentorship, training and advice to help users land their next job.


Deep transfer operator learning for partial differential equations under conditional shift

arXiv.org Artificial Intelligence

These authors contributed equally to this work. Abstract Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power limitations, and dataset distribution mismatches. We propose a new TL framework for task-specific learning (functional regression in partial differential equations (PDEs)) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of target data. Inspired by the conditional embedding operator theory, we minimize the statistical distance between labeled target data and the surrogate prediction on unlabeled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various TL scenarios involving nonlinear PDEs under diverse conditions due to shift in the geometric domain and model dynamics. TL framework enables fast and efficient learning of heterogeneous tasks despite significant differences between the source and target domains. Deep learning has been successfully employed to simulate computationally expensive complex physical processes described by partial differential equations (PDEs) and achieve superior performance that allows the acceleration of numerous tasks including uncertainty quantification (UQ), risk modeling and design optimization [1-6]. Despite this success, the predictive performance of such models is often limited by the availability of labeled data used for training. However, in many cases collecting large and sufficient labeled datasets can be computationally intractable (e.g., when high-fidelity or multiscale models are considered). Furthermore, learning in isolation, i.e., training a single predictive model for different but related tasks, can be extremely expensive. To tackle this bottleneck, knowledge between relevant domains can be leveraged in a framework known as transfer learning (TL) [7]. In this scenario, information from a model trained on a specific domain (source) with sufficient labeled data can be transferred to a different but closely related domain (target) for which only a small number of training data is available.


Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metric

arXiv.org Artificial Intelligence

Combining the Color and Event cameras (also called Dynamic Vision Sensors, DVS) for robust object tracking is a newly emerging research topic in recent years. Existing color-event tracking framework usually contains multiple scattered modules which may lead to low efficiency and high computational complexity, including feature extraction, fusion, matching, interactive learning, etc. In this paper, we propose a single-stage backbone network for Color-Event Unified Tracking (CEUTrack), which achieves the above functions simultaneously. Given the event points and RGB frames, we first transform the points into voxels and crop the template and search regions for both modalities, respectively. Then, these regions are projected into tokens and parallelly fed into the unified Transformer backbone network. The output features will be fed into a tracking head for target object localization. Our proposed CEUTrack is simple, effective, and efficient, which achieves over 75 FPS and new SOTA performance. To better validate the effectiveness of our model and address the data deficiency of this task, we also propose a generic and large-scale benchmark dataset for color-event tracking, termed COESOT, which contains 90 categories and 1354 video sequences. Additionally, a new evaluation metric named BOC is proposed in our evaluation toolkit to evaluate the prominence with respect to the baseline methods. We hope the newly proposed method, dataset, and evaluation metric provide a better platform for color-event-based tracking. The dataset, toolkit, and source code will be released on: \url{https://github.com/Event-AHU/COESOT}.


Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models

arXiv.org Artificial Intelligence

Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial visual stimuli with well-separated, static regions of interest, while most analyses in the context of complex visual stimuli, such as most natural scenes, rely on laborious and time-consuming manual annotation. This paper studies using computer vision tools for "attention decoding", the task of assessing the locus of a participant's overt visual attention over time. We provide a publicly available Multiple Object Eye-Tracking (MOET) dataset, consisting of gaze data from participants tracking specific objects, annotated with labels and bounding boxes, in crowded real-world videos, for training and evaluating attention decoding algorithms. We also propose two end-to-end deep learning models for attention decoding and compare these to state-of-the-art heuristic methods.


Surface Form Competition: Why the Highest Probability Answer Isn't Always Right

arXiv.org Artificial Intelligence

Large language models have shown promising results in zero-shot settings (Brown et al.,2020; Radford et al., 2019). For example, they can perform multiple choice tasks simply by conditioning on a question and selecting the answer with the highest probability. However, ranking by string probability can be problematic due to surface form competition-wherein different surface forms compete for probability mass, even if they represent the same underlying concept, e.g. "computer" and "PC." Since probability mass is finite, this lowers the probability of the correct answer, due to competition from other strings that are valid answers (but not one of the multiple choice options). We introduce Domain Conditional Pointwise Mutual Information, an alternative scoring function that directly compensates for surface form competition by simply reweighing each option according to a term that is proportional to its a priori likelihood within the context of the specific zero-shot task. It achieves consistent gains in zero-shot performance over both calibrated (Zhao et al., 2021) and uncalibrated scoring functions on all GPT-2 and GPT-3 models over a variety of multiple choice datasets.


Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders

arXiv.org Artificial Intelligence

Knowledge distillation (KD) has been a ubiquitous method for model compression to strengthen the capability of a lightweight model with the transferred knowledge from the teacher. In particular, KD has been employed in quantization-aware training (QAT) of Transformer encoders like BERT to improve the accuracy of the student model with the reduced-precision weight parameters. However, little is understood about which of the various KD approaches best fits the QAT of Transformers. In this work, we provide an in-depth analysis of the mechanism of KD on attention recovery of quantized large Transformers. In particular, we reveal that the previously adopted MSE loss on the attention score is insufficient for recovering the self-attention information. Therefore, we propose two KD methods; attention-map and attention-output losses. Furthermore, we explore the unification of both losses to address task-dependent preference between attention-map and output losses. The experimental results on various Transformer encoder models demonstrate that the proposed KD methods achieve state-of-the-art accuracy for QAT with sub-2-bit weight quantization.


DYNAFED: Tackling Client Data Heterogeneity with Global Dynamics

arXiv.org Artificial Intelligence

The Federated Learning (FL) paradigm is known to face challenges under heterogeneous client data. Local training on non-iid distributed data results in deflected local optimum, which causes the client models drift further away from each other and degrades the aggregated global model's performance. A natural solution is to gather all client data onto the server, such that the server has a global view of the entire data distribution. Unfortunately, this reduces to regular training, which compromises clients' privacy and conflicts with the purpose of FL. In this paper, we put forth an idea to collect and leverage global knowledge on the server without hindering data privacy. We unearth such knowledge from the dynamics of the global model's trajectory. Specifically, we first reserve a short trajectory of global model snapshots on the server. Then, we synthesize a small pseudo dataset such that the model trained on it mimics the dynamics of the reserved global model trajectory. Afterward, the synthesized data is used to help aggregate the deflected clients into the global model. We name our method Dynafed, which enjoys the following advantages: 1) we do not rely on any external on-server dataset, which requires no additional cost for data collection; 2) the pseudo data can be synthesized in early communication rounds, which enables Dynafed to take effect early for boosting the convergence and stabilizing training; 3) the pseudo data only needs to be synthesized once and can be directly utilized on the server to help aggregation in subsequent rounds. Experiments across extensive benchmarks are conducted to showcase the effectiveness of Dynafed. We also provide insights and understanding of the underlying mechanism of our method.