Education
ChatGPT and Works Scholarly: Best Practices and Legal Pitfalls in Writing with AI
Tomlinson, Bill, Torrance, Andrew W., Black, Rebecca W.
Recent advances in artificial intelligence (AI) have raised questions about whether the use of AI is appropriate and legal in various professional contexts. Here, we present a perspective on how scholars may approach writing in conjunction with AI, and offer approaches to evaluating whether or not such AI-writing violates copyright or falls within the safe harbor of fair use. We present a set of best practices for standard of care with regard to plagiarism, copyright, and fair use. As AI is likely to grow more capable in the coming years, it is appropriate to begin integrating AI into scholarly writing activities. We offer a framework for establishing sound legal and scholarly foundations.
Preliminary results of a therapeutic lab for promoting autonomies in autistic children
Gena, Cristina, Damiano, Rossana, Mattutino, Claudio, Mazzei, Alessandro, Meirone, Andrea, Mazzotta, Loredana, Nazzario, Matteo, Ricci, Valeria, Brighenti, Stefania, Liscio, Federica, Petriglia, Francesco
This extended abstract describes the preliminary quantitative and qualitative results coming from a therapeutic laboratory focused on the use of the Pepper robot to promote autonomies and functional acquisitions in highly functioning (Asperger) children with autism. The participants recruited were four highly functioning (Asperger) children, aged between 11 and 13 years. There have been in total 16 lab sessions, all recorded by a fixed camera, in addition to the Pepper's 2D cameras. Furthermore, trainees filled out evaluation forms provided by psychotherapists, noting the children autonomy's progress in a diary with the helping of rating scales [1]. These notes were then reworked to draw up shared reports, reflecting on the behavior's evolution and progress of the children meeting by meeting.
Family Theories in Child-Robot Interactions: Understanding Families as a Whole for Child-Robot Interaction Design
Cagiltay, Bengisu, Mutlu, Bilge, Kerr, Margaret
In this work, we discuss a theoretically motivated family-centered design approach for child-robot interactions, adapted by Family Systems Theory (FST) and Family Ecological Model (FEM). Long-term engagement and acceptance of robots in the home is influenced by factors that surround the child and the family, such as child-sibling-parent relationships and family routines, rituals, and values. A family-centered approach to interaction design is essential when developing in-home technology for children, especially for social agents like robots with which they can form connections and relationships. We review related literature in family theories and connect it with child-robot interaction and child-computer interaction research. We present two case studies that exemplify how family theories, FST and FEM, can inform the integration of robots into homes, particularly research into child-robot and family-robot interaction. Finally, we pose five overarching recommendations for a family-centered design approach in child-robot interactions.
Federated Ensemble-Directed Offline Reinforcement Learning
Rengarajan, Desik, Ragothaman, Nitin, Kalathil, Dileep, Shakkottai, Srinivas
Federated learning is an approach wherein clients learn collaboratively by sharing their locally trained models (not their data) with a federating agent, which periodically combines their models and returns the federated model to the clients for further refinement (Kairouz et al., 2021; Wang et al., 2021). Federated learning has seen much success in supervised learning applications due to its ability to generate well-trained models using small amounts of data at each client while preserving privacy and reducing the usage of communication resources. Recently, there is a growing interest in employing federated learning for online RL problems where each client collects data online by following its own Markovian trajectory, while simultaneously updating the model parameters (Khodadadian et al., 2022; Nadiger et al., 2019; Qi et al., 2021). However, such an online learning approach requires sequential interactions with the environment or the simulator, which may not be feasible in many real-world applications. Instead, each clients may have pre-collected operational data generated according to a client-specific behavior policy. The federated offline reinforcement learning problem is to learn the optimal policy using these heterogeneous offline data sets distributed across the clients and collected by different unknown behavior policies, without sharing the data explicitly. The framework of offline reinforcement learning (Levine et al., 2020) offers a way to learn the policy only using the offline data collected according a behavior policy, without any direct interactions with the environment. However, naively combining an off-the-shelf offline RL algorithm such as TD3-BC (Fujimoto & Gu, 2021) with an off-the-shelf federated supervised learning approach such as FedAvg (McMahan et al., 2017) will lead to a poorly performing policy, as we show later (see Figure 1-3). Federated offline RL is significantly more challenging than its supervised learning counterpart and the centralized offline RL because of the following reasons.
A framework for the emergence and analysis of language in social learning agents
Wieczorek, Tobias J., Tchumatchenko, Tatjana, Carvajal, Carlos Wert, Eggl, Maximilian F.
Artificial neural networks (ANNs) are increasingly used as research models, but questions remain about their generalizability and representational invariance. Biological neural networks under social constraints evolved to enable communicable representations, demonstrating generalization capabilities. This study proposes a communication protocol between cooperative agents to analyze the formation of individual and shared abstractions and their impact on task performance. This communication protocol aims to mimic language features by encoding high-dimensional information through low-dimensional representation. Using grid-world mazes and reinforcement learning, teacher ANNs pass a compressed message to a student ANN for better task completion. Through this, the student achieves a higher goal-finding rate and generalizes the goal location across task worlds. Further optimizing message content to maximize student reward improves information encoding, suggesting that an accurate representation in the space of messages requires bi-directional input. This highlights the role of language as a common representation between agents and its implications on generalization capabilities.
Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge
Varadarajan, Vasudha, Juhng, Swanie, Mahwish, Syeda, Liu, Xiaoran, Luby, Jonah, Luhmann, Christian, Schwartz, H. Andrew
While transformer-based systems have enabled greater accuracies with fewer training examples, data acquisition obstacles still persist for rare-class tasks -- when the class label is very infrequent (e.g. < 5% of samples). Active learning has in general been proposed to alleviate such challenges, but choice of selection strategy, the criteria by which rare-class examples are chosen, has not been systematically evaluated. Further, transformers enable iterative transfer-learning approaches. We propose and investigate transfer- and active learning solutions to the rare class problem of dissonance detection through utilizing models trained on closely related tasks and the evaluation of acquisition strategies, including a proposed probability-of-rare-class (PRC) approach. We perform these experiments for a specific rare class problem: collecting language samples of cognitive dissonance from social media. We find that PRC is a simple and effective strategy to guide annotations and ultimately improve model accuracy while transfer-learning in a specific order can improve the cold-start performance of the learner but does not benefit iterations of active learning.
The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and Millennial Generation teachers?
Chan, Cecilia Ka Yuk, Lee, Katherine K. W.
The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and Millennial Generation teachers? Abstract This study aimed to explore the experiences, perceptions, knowledge, concerns, and intentions of Gen Z students with Gen X and Gen Y teachers regarding the use of generative AI (GenAI) in higher education. A sample of students and teachers were recruited to investigate the above using a survey consisting of both open and closed questions. The findings showed that Gen Z participants were generally optimistic about the potential benefits of GenAI, including enhanced productivity, efficiency, and personalized learning, and expressed intentions to use GenAI for various educational purposes. Gen X and Gen Y teachers acknowledged the potential benefits of GenAI but expressed heightened concerns about overreliance, ethical and pedagogical implications, emphasizing the need for proper guidelines and policies to ensure responsible use of the technology. The study highlighted the importance of combining technology with traditional teaching methods to provide a more effective learning experience. Implications of the findings include the need to develop evidence-based guidelines and policies for GenAI integration, foster critical thinking and digital literacy skills among students, and promote responsible use of GenAI technologies in higher education. Keywords: ChatGPT; Generative AI; AI Literacy; Risks; Advantages; Holistic competencies; Challenges; Benefits 1. Introduction Generation Z (Gen Z) students have largely replaced Millennials in undergraduate programmes, with institutions of higher education now primarily enrolling students from the former (Seemiller & Grace, 2016; Shatto & Erwin, 2016). With educators welcoming a new cohort of students to campus, there is a growing concern regarding how to effectively teach this'always-on' generation; for example, a study by Pearson (2018) showed that almost half of all Gen Z-ers (47%) spend a minimum of three hours daily on YouTube. The Gen Z population, much like its predecessors - the Silent and Baby Boomer generations, followed by Generation X (Gen X) and Generation Y (also known as Millennials) - has its own unique, distinct characteristics that have been shaped by information communication technologies, social and cultural shifts, and financial volatility. As such, it is crucial for higher education institutions to effectively engage with Gen Z, in order for scholars, teachers, and university staff to understand their aforementioned characteristics (Seemiller & Grace, 2017; Shatto & Erwin, 2016; Shorey et al., 2021) and in turn, effectively and ethically integrate generative AI (GenAI) technologies into the curriculum.
Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methods
Adamyan, Alen, Harutyunyan, Erik
There are various optimization techniques in the realm of 3D, including point cloud-based approaches that use mesh, texture, and voxels which optimize how you store, and how do calculate in 3D. These techniques employ methods such as feed-forward networks, 3D convolutions, graph neural networks, transformers, and sparse tensors. However, the field of 3D is one of the most computationally expensive fields, and these methods have yet to achieve their full potential due to their large capacity, complexity, and computation limits. This paper proposes the application of knowledge distillation techniques, especially for sparse tensors in 3D deep learning, to reduce model sizes while maintaining performance. We analyze and purpose different loss functions, including standard methods and combinations of various losses, to simulate the performance of state-of-the-art models of different Sparse Convolutional NNs. Our experiments are done on the standard ScanNet V2 dataset, and we achieved around 2.6\% mIoU difference with a 4 times smaller model and around 8\% with a 16 times smaller model on the latest state-of-the-art spacio-temporal convents based models.
Bayesian Reinforcement Learning with Limited Cognitive Load
Arumugam, Dilip, Ho, Mark K., Goodman, Noah D., Van Roy, Benjamin
Cognitive science aims to identify the principles and mechanisms that underlie adaptive behavior. An important part of this endeavor is the development of unifying, normative theories that specify "design principles" that guide or constrain how intelligent systems respond to their environment [Marr, 1982, Anderson, 1990, Lewis et al., 2014, Griffiths et al., 2015, Gershman et al., 2015]. For example, accounts of learning, cognition, and decision-making often posit a function that an organism is optimizing--e.g., maximizing long-term reward or minimizing prediction error--and test plausible algorithms that achieve this--e.g., a particular learning rule or inference process. Historically, normative theories in cognitive science have been developed in tandem with new formal approaches in computer science and statistics. This partnership has been fruitful even given differences in scientific goals (e.g., engineering artificial intelligence versus reverse-engineering biological intelligence). Normative theories play a key role in facilitating cross-talk between different disciplines by providing a shared set of mathematical, analytical, and conceptual tools for describing computational problems and how to solve them [Ho and Griffiths, 2022]. This paper is written in the spirit of such cross-disciplinary fertilization. Here, we review recent work in computer science [Arumugam and Van Roy, 2021a, 2022] that develops a novel approach for unifying three distinct mathematical frameworks that will be familiar to many cognitive scientists (Figure 1).
VideoOFA: Two-Stage Pre-Training for Video-to-Text Generation
Chen, Xilun, Yu, Lili, Xiong, Wenhan, Oğuz, Barlas, Mehdad, Yashar, Yih, Wen-tau
We propose a new two-stage pre-training framework for video-to-text generation tasks such as video captioning and video question answering: A generative encoder-decoder model is first jointly pre-trained on massive image-text data to learn fundamental vision-language concepts, and then adapted to video data in an intermediate video-text pre-training stage to learn video-specific skills such as spatio-temporal reasoning. As a result, our VideoOFA model achieves new state-of-the-art performance on four Video Captioning benchmarks, beating prior art by an average of 9.7 points in CIDEr score. It also outperforms existing models on two open-ended Video Question Answering datasets, showcasing its generalization capability as a universal video-to-text model.