You are here


About CaMeLi Motivation | Objectives

 TO1: Analysis and definition of elderly needs and requirements with regard to i) the daily activity categories: Care & Wellness, Guidance services ii) a Virtual Partner model considering patterns, already practiced by the elderly through out the life, in interacting, collaborating and sharing with a real partner in carrying out the identified daily activities. The analysis gives also emphasis on trust and individual privacy protection requirements. A series of use case scenarios will be specified and the most appropriate services for each category will be selected before any technical design and implementation starts.

TO2: User Emotion based Computer Interaction addressing emotion recognition based on multi-modal input signals. The emotional state of the elderly provides important information on his needs and allows from one side the adaptation of the provided services and from the other side comforts the elderly as he feels understood. CaMeLi, using the video cameras of the tablets, will be able to “read” emotions expressed on the elderly’s face, when he is talking and interacting with the Avatar. Automated algorithms will be developed to analyze and combine multi-modal signals from facial expressions and voice intonation to recognize a person’s emotional state while interacting with the system. An existing state-of-art tool (i.e FaceReader TM ) will be used and customized to analyze the key points as well as the texture of the face and combine this with voice intonation analysis (i.e. a rising tone vs. a falling tone) for an accurate classification of the current emotional state (i.e. happy, sad, scared, disgusted, surprised, and angry, neutral).

TO3: Intelligent , Intuitive Human -Computer Interaction and Multi-modal Dialogue state of the art human-computer interaction technologies (Avatar interface, dialogue) developed and tested in other initiatives (i.e. PlayMancer European project in which the partner UniGe has participated) will be enhanced and adapted to operate on CaMeLi’s distributed tablet based environment. To allow the user to interact with the system in a natural and intuitive way, the Avatar interface will support functionality for conversational understanding based on speech and real-time generation of synthesized speech developed using existing commercial speech recognition tools (ex. Siri). In order to engage the elder in an a relevant, human-like conversation the avatar interface will also be able to express a large spectrum of emotions, (i.e, joy, anger, neutral state, sad, happy) through face expressions with lifelike motion and voice intonations, matching the conversation context and synchronized with the synthesized speech.

TO4: User behavior and environment analysis. Develop algorithms for real-time environment context analysis (i.e. object recognition) and understanding of human behavior (i.e. posture ,activity recognition) based on video monitoring. Home environment context analysis software will identify different objects and their location in the home, like chairs, books, glasses, dishes etc. User behavior analysis software will identify posture and different activities of the user, like sitting, sleeping, reading etc as well as identify if the user is behaves in non-conformant way (like going from repeatedly from one place to another). The user behavior and environment analysis outputs will be used by top-level reasoning algorithms for analysis and decision for the action to be taken.

TO5: Design and Development of Home daily Services. A set of interoperable software services will be developed to improve the quality of life and autonomy of the elder and aid in the execution of determined daily life activities at home. The services are organized into two functional categories: Care & Wellness and Guidance. The design will follow the Service Oriented Architecture (SOA) concept. The Care & Wellness activities services consider initially the following daily activities: shopping assistance (i.e. by involving informal carers), basic household management and personal support (like open the window when you wake up, wash your teeth) through advising, memory assistance and reminders for compensating light cognitive degradation, skills and knowledge exchange among the elderly related to daily activities support. The Guidance services consider initially: stimulation and support to maintain a healthy lifestyle including physical exercise, dietary organization and preparation of meals, assistance in locating objects at home and follow-up of a daily activities plan (including household and leisure activities). Respecting the autonomy of the elderly, the availability of the services will be defined and managed by the elderly or/and by the informal carers who will be able to make personal choices.

TO6: Virtual Partner (ViP). Development of a Virtual Partner (ViP) able to show a wide variety of human-like understanding and responding and solicit the  appropriate services to answer the user’s needs/requests offering real time complimentary feedback through voice and a wide spectrum of animated facial expressions. The functionality is based on a real-time multimodal event recognition and feedback component, which implements the top-level decision making logic. The “action selection” which determines what the avatar should be doing at each moment in time is based on the ongoing verbal dialogue, non-verbal communication signs (facial expressions, voice intonation) and context information (home environment,   user behavior) .Data characterizing the ViP’s “character” are defined in a personalized elder-specific profile which is built based on information defining interaction and collaboration ways with a human partner.

TO7: Collaborative Care (Co-Care) Tool Adaptation and enhancement of the elderly centric web based social care community network (SoCo-net), developed in the frame of the AAL Co-Living project, coordinated by the ORBIS end user organization participating in CaMeLi, to enable formal and informal carers’ home daily activities support to the elderly. The new Co-Care tool will promote collaboration and communication between the elder and formal/informal carers, but also between formal and informal care. Alerting and information both between the elderly and formal and informal carers will be make through an intelligent dispatching/routine system described in TO8.

TO8: Intelligent dispatching information system Design and development of an intelligent system dispatching/routing alerts and information, to both the elderly and formal and informal carers, in the sense of instant communication and mobilization of all kinds of relevant daily activities support services. The dispatching will be based on the priority of a triggered event based on behaviour changes of the elderly physical and emotional state considering context awareness. The priority of a triggered event will be defined based on a number of characteristics that will be defined beforehand.

Theme by Danetsoft and Danang Probo Sayekti inspired by Maksimer