Print

SFB 1320: Everyday Activity Science and Engineering (EASE)

Funding: Deutsche Forschungsgemeinschaft (DFG)

Website: EASE

Project period: 2017-2025 (Phase 1&2)

Cooperation partner: BIPS - Statistical Methods for Causal Inference Research Group

logo ease 2019

People master everyday tasks with ease. They manipulate objects in their environment and can deal with incomplete information (e.g. instructions) and unfamiliar circumstances (e.g. a new object or tool). The EASE Collaborative Research Center examines how robotic agents can master manipulation tasks at the competence level of humans.

The subproject H1 examines how humans flexibly adapt their sensorimotor behavior to the variety of conditions and contexts being imposed by everyday scenarios. This adaptation extends over several levels, reaching from task conditions, over object and tool properties, to on-the-fly adjustments of sensorimotor parameters. Causal relations are essential for these adaptive properties.

H1: Sensorimotor and Causal Human Activity Models for Cognitive Architectures

The goal of subproject H1 is to identify and model the causal structures and relations that underlie context-sensitive sensorimotor adaptation. To achieve this goal, we will investigate sensorimotor behavior in natural settings where the context determines the planning, adaptation and execution of the task. As a result we will develop suitable Causal Sensory-Motor Models (CSMMs) which are based on causal probabilistic graphs. CSMMs will model the execution of everyday tasks in a household context and will serve as a basis for the planning, execution, and prediction of arm and hand movements, and, on a higher level, action sequences. The structural dependencies and the functional relations incorporated in the CSMMs will facilitate learning and improve generalizability.

H1 CSMM web picture

Publications:

Filter publications:
2023
[7] Representing (Dis)Similarities Between Prediction and Fixation Maps Using Intersection-over-Union Features (, ), In Proceedings of the 2023 Symposium on Eye Tracking Research and Applications, Association for Computing Machinery, . [bibtex] [abstract] [pdf] [doi]
2021
[6] Object Manipulations in VR Show Task- and Object-Dependent Modulation of Motor Patterns (, ), In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, ACM, . [bibtex] [abstract] [doi]
2020
[5] From Human to Robot Everyday Activity (, , , , , , , , , , , ), In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), . [bibtex] [abstract] [doi]
[4] Categorization of Contact Events as Intended or Unintended usingPre-Contact Kinematic Features (, , ), In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), . [bibtex] [doi]
[3] Pre-Contact Kinematic Features for the Categorization of Contact Events as Intended or Unintended (, , ), In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), . [bibtex] [doi]
2019
[2] Adaptivity of End Effector Motor Control Under Different Sensory Conditions: Experiments with Humans in Virtual Reality and Robotic Applications (, , ), In Frontiers in Robotics and AI, . [bibtex] [abstract] [pdf] [doi]
2018
[1] Exploring Human Kinematic Control for Robotics Applications: The Role of Afferent Sensory Information in a Precision Task (, , ), In IROS 2018: Workshop - Towards Robots that Exhibit Manipulation Intelligence, . [bibtex] [abstract]
FaLang translation system by Faboba