sonntag
Sonntag
With advancements in technology, smartphones can already serve as memory aids. Electronic calendars are of great use in time-based memory tasks. In this project, we enter the mixed reality realm for helping dementia patients. Dementia is a general term for a decline in mental ability severe enough to interfere with daily life. Memory loss is an example.
Sonntag
Cognitive assistance may be valuable in applications that reduce costs and improve quality in healthcare systems. Use cases and scenarios include persuasion, i.e., the design, development and evaluation of interactive technologies aimed at changing users' attitudes or behaviours through persuasion, but not through coercion or deception. We motivate persuasion for healthcare systems and propose solutions from an artificial intelligence (AI) perspective for conceptual design and system implementation. The goal is to develop an IoT (Internet-Of-Things) toolbox towards AI-based persuasive technologies for healthcare systems.
Interactive Cognitive Assessment Tools: A Case Study on Digital Pens for the Clinical Assessment of Dementia
Interactive cognitive assessment tools may be valuable for doctors and therapists to reduce costs and improve quality in healthcare systems. Use cases and scenarios include the assessment of dementia. In this paper, we present our approach to the semi-automatic assessment of dementia. We describe a case study with digital pens for the patients including background, problem description and possible solutions. We conclude with lessons learned when implementing digital tests, and a generalisation for use outside the cognitive impairments field.
Kognit: Intelligent Cognitive Enhancement Technology by Cognitive Models and Mixed Reality for Dementia Patients
Sonntag, Daniel (German Research Center for AI (DFKI))
With advancements in technology, smartphones can already serve as memory aids. Electronic calendars are of great use in time-based memory tasks. In this project, we enter the mixed reality realm for helping dementia patients. Dementia is a general term for a decline in mental ability severe enough to interfere with daily life. Memory loss is an example. Here, mixed reality refers to the merging of real and virtual worlds to produce new episodic memory visualisations where physical and digital objects co-exist and interact in real-time. Cognitive models are approximations of a patient's mental abilities and limitations involving conscious mental activities (such as thinking, understanding, learning, and remembering). External representations of episodic memory help patients and caregivers coordinate their actions with one another. We advocate distributed cognition, which involves the coordination between individuals, artefacts and the environment, in four main implementations of artificial intelligence technology in the Kognit storyboard: (1) speech dialogue and episodic memory retrieval; (2) monitoring medication management and tracking an elder's behaviour (e.g., drinking water); (3) eye tracking and modelling cognitive abilities; and (4) serious game development towards active memory training. We discuss the storyboard, use cases and usage scenarios, and some implementation details of cognitive models and mixed reality hardware for the patient. The purpose of future studies is to determine the extent to which cognitive enhancement technology can be used to decrease caregiver burden.
Recommending Missing Symbols of Augmentative and Alternative Communication by Means of Explicit Semantic Analysis
Voros, Gyula (Eotvos Lorand University) | Rabi, Peter (Eotvos Lorand University) | Pinter, Balazs (Eotvos Lorand University) | Sarkany, Andras (Eotvos Lorand University) | Sonntag, Daniel (German Research Center for Artificial Intelligence) | Lorincz, Andras (Eotvos Lorand University)
For people constrained to picture based communication, the expression of interest in a question answering (QA) or information retrieval (IR)scenario is highly limited. Traditionally, alternative and augmentative communication (AAC) methods (such as gestures and communication boards) are utilised. But only few systems allow users to produce whole utterances or sentences that consist of multiple words; work to generate them automatically is a promising direction in the big data context.In this paper, we provide a dedicated access method for the open-domain QA and IR context. We propose a method for the user to search for additional symbols to be added to the communication board in real-time while using access to big data sources and context based filtering when the desired symbol is missing. The user can select a symbol that is associated with the desired concept and the system searches for images on the Internet - here, in Wikipedia - with the purpose of retrieving an appropriate symbol or picture. Querying for candidates is performed by estimating semantic relatedness between text fragments using explicit semantic analysis (ESA).
Applications of an Ontology Engineering Methodology
Sonntag, Daniel (German Research Center for AI (DFKI)) | Wennerberg, Pinar (Siemens AG) | Zillner, Sonja (Siemens AG)
This paper examines first ideas on the applicability of Linked Data, in particular a subset of the Linked Open Drug Data (LODD), to connect radiology, human anatomy, and drug information for improved medical image annotation and subsequent search. One outcome of our ontology engineering methodology is the alignment between radiology-related OWL ontologies (FMA and RadLex). These can be used to provide new connections in the medicine-related linked data cloud. A use case scenario is provided that demonstrates the benefits of the approach by enabling the radiologist to query and explore related data, e.g., medical images and drugs. The diagnosis is on a special type of cancer (lymphoma).
Linked Data Integration for Semantic Dialogue and Backend Access
Sonntag, Daniel (German Research Center for AI (DFKI)) | Kiesel, Malte (German Research Center for AI (DFKI))
Over the last several years, the market for speech technology has seen significant developments (Pieraccini and Huerta We learned some lessons which we use as guidelines 2005) and powerful commercial off-the-shelf solutions for in the development of multimodal dialogue systems where speech recognition (ASR) or speech synthesis (TTS). Further users can combine speech and gestures when using multiple application scenarios, more diverse and dynamic information interaction devices. In earlier projects (Wahlster 2003; Reithinger sources, and more complex prototype systems need et al. 2005) we integrated different sub-components to be addressed in the context of QA. Dialogue-based QA allows to multimodal interaction systems. Other lessons served as a user to pose questions in natural speech, followed by guidelines in the development of semantic dialogue systems answers presented in a concise form (Sonntag et al. 2007).