This paper outlines three projects that lay the foundation for a trans-disciplinary approach to the creation of interactive, multi-sensory devices combining biofeedback, virtual reality, and physical/virtual human-machine interactions. We explore new possibilities for interoperability and enhancing interoception and mindfulness with potential research contributions for novel personal, professional and medical applications.

We have developed a visualization system of dementia care skills based on multimodal communication features. The purpose of our system is to provide effective learning of dementia care to trainees. As dementia care skills are difficult to visualize and describe, they are hard to acquire for trainees. We focus on HumanitudeR; a non-pharmacological comprehensive intervention with verbal and non-verbal communication, which is a care methodology of French-origin for the vulnerable elderlies. The multimodal methodology utilizes four techniques to relate to elderly with dementia (i.e., gaze, speak, touch, opportunities to stand on their feet). We analyzed the care videos of Humanitude instructors to extract multimodal communication features. We designed and filmed video contents demonstrating the extracted features. These have shown to be effective, in combination with practice and reflection, to acquire dementia care skills. The trainees could use the system for self-reflection and teaching.

Conference calls represent a natural but limited communication channel between people. Lack of visual contact and limited bandwidth impoverish social cues people typically use to moderate their behavior. This paper presents a system capable of providing timely aural feedback enabling meeting participants to check themselves. The system is able to sense and recognize problems, reason about them, and make decisions on how and when to provide feedback based on an interaction policy. While a hand-crafted policy based on expert insight can be used, it is non-optimal and can be brittle. Instead, we use reinforcement learning to build a system that can adapt to users by interacting with them. To evaluate the system, we first conduct a user study and demonstrate its utility in getting meeting participants to contribute more equally. We then validate the adaptive feedback policy by demonstrating the agent's ability to adapt its action choices to different types of users.

We report here on our previous research on the evolution of commitment behaviour in the one-off and iterated prisoner's dilemma and relate it to the issue of designing non-human autonomous online systems. We show that it was necessary to introduce an apology/forgiveness mechanism in the iterated case since without this restorative mechanism strategies evolve that take revenge when the agreement fails. As before in online interaction systems, apology and forgiveness seem to provide important mechanisms to repair trust. As such, these result provide, next to the insight into our own moral and ethical considerations, ideas into how (and also why) similar mechanisms can be designed into the repertoire of actions that can be taken by non-human autonomous agents.

Robot designers commonly emphasize humanlikeness as an important design feature to make robots social or user-friendly. To understand how users make sense of the design characteristics of robots, we asked 6 participants to classify and interpret the appearance of existing robots in relation to their function and potential usefulness. All the robots had humanlike aspects in their design, and participants most commonly remarked on these humanlike features of the robots. However, the commonsense logic of the “Uncanny Valley” (UV) in HRI design, which suggests that robots should be similar to humans to some degree without being too humanlike, was not supported by participant comments, which did not correlate humanlikeness to user-friendliness in line with the UV hypothesis. Rather, participants related the design features of robots to their everyday contexts, and focused their commentary on context-dependent design implications. As a result, we suggest our understanding of the design characteristics of robots should include the perspectives of users from the earliest stages of design so we can understand their contextual interpretations of different design characteristics. Open and modularized technical platforms could support the inclusion of users in the creation of future social robots.

We consider the problem of robot path planning in an environment where the location and geometry of obstacles are initially unknown while reusing relevant knowledge about collision avoidance learned from robots’ previous navigational experience. Our main hypothesis in this paper is that the path planning times for a robot can be reduced if it can refer to previous maneuvers it used to avoid collisions with obstacles during earlier missions, and adapt that information to avoid obstacles during its current navigation. To verify this hypothesis,we propose an algorithm called LearnerRRT that first uses a feature matching algorithm called Sample ConsensusInitial Alignment (SAC-IA) to efficiently match currently encountered obstacle features with past obstacle features, and, then uses an experience based learning technique to adapt previously recorded robot obstacle avoidance trajectories corresponding to the matched feature, to the current scenario. The feature matching and machine learning techniques are integrated into the robot’s path planner so that the robot can rapidly and seamlessly update its path to circumvent an obstacle it encounters, in real-time, and continue to move towards its goal. We have conducted several experiments using a simulated Coroware Corobot robot within the Webots simulator to verify the performance of our proposed algorithm,with different start and goal locations, and different obstacle geometries and placements, as well as compared our approach to a state-of-the-art sampling based path planner. Our results show that the proposed algorithm LearnerRRT performs much better than InformedRRT*. When given the same time, our algorithm finished its task successfully whereas Informed RRT* could only achieve 10-20 percent of the optimal distance.

This paper describes a possible new scheme for a user with mental health problems to identify his/her own mental state and control it. For that purpose, we propose an indirect biofeedback system which encodes physiological information in terms of color and shape, and enables the user to grasp his/her inner state and to proactively change and control it by using breathing techniques. Those methods facilitate the user to self-control his/her autonomic nervous system. Here, we discuss indirect representation and placebo effect.

Interprofessional Collaboration in dementia care is an important theme. But there are few Support systems that make it possible to share and raise awareness of the situation of the person with dementia. Therefore, using a dementia inspection method named Action Observation Sheet (AOS), we devel-oped an Interprofessional Collaborative System to raise awareness. We have conducted practical experiments to confirm if the system is effective for family and staff. The results show the system to be effective to increase awareness. The family and staff could use the results provided by the system to support people with dementia with more understanding.

In this position paper we introduce our approach to positive computing by developing and integrating methods for future assistant and companion agents which could help us a) avoid making mistakes due to biases caused by insufficient knowledge, b) be more empathic and righteous, c) be more sensitive and thoughtful. We present text processing techniques for automatic discovery of possible reasoning errors and provide hints to make users doubt their beliefs when there is a possibility of harm. We present existing sources and methods, discuss on how natural language processing technologies could contribute to various aspects of well-being by giving examples of systems we develop, and describe the strengths and weaknesses of our approach.

This paper reports a cradle sound system creating and reproducing sounds and music appropriate for human sleep with heartbeat and respiration signals sensed by biological sensors. To get further supporting evidence, we started a study aiming at exploring what sound attributes, such as waveforms, tones, and tempos, are necessary for a sound capable of improving sleep latency. We expected that a cradle sound whose tempo was slightly slower than those of heartbeat and respiration could slow them and could promote natural sleep. Subjects listening to this sound during their sleep showed: (1) Multiple sound types with different tones have an effect to shorten sleep latency. (2) Remarkable effects are observed in subjects with long sleep latency. (3) Sustained synthetic chord used for inducing respiration did not improve sleep latency. (4) There is no correlation between subject’s sensibility evaluation to sound and the effect shortening sleep latency.