Augmented Cyberspace Exploiting Real-time Biological Sensor Fusion

In Web-based CSCW (Computer-Supported Cooperative Work) often including cooperative learning, remote members communicate their intentions in cyberspace, using textual sentences, pictures and voice. However, often, communication between members cannot be correctly done and interface errors occur. Different from face-to-face communication, partners' situations including their interest, concentration, boredom, and tiredness cannot be easily transmitted. Oversight and mishearing of remote partners is often overlooked. Besides, it is further difficult to understand their real intentions sufficiently. To overcome these problems, “Augmented Cyberspace” for dependable Web-based CSCW Systems, is proposed, which is also applicable to system such as e-learning, e-commerce, etc. This assesses situations of remote users through timely fusing information of multiple biological sensors and the related contexts. By exploiting the timely assessment, the system augments the cyberspace through emphasizing the situation of remote users or providing warnings in conventional media such as text, image, and voice. Experimental results showed the necessity and feasibility of such assessment by information fusion of multiple sensors.