Sequential learning of the relationship between action and visual feedback using a rolling ball game with conflicting rotational transformations on a tablet device

Y Tsutsumi1, A Nakamura2, M Tanaka3, T Yoshida4

1Science and Technology for Future Life, Tokyo Denki University, Japan
2Department of Robotics and Mechatronics, Tokyo Denki University, Japan
3Tokyo Institute of Technology, Japan
4Department of Mechanical Sciences and Engineering, Tokyo Institute of Technology, Japan

Contact: tsutsumi@is.fr.dendai.ac.jp

How do humans learn the relationship between their actions and visual feedback when operating an object under a physically unpredictable model? Using a simple rolling ball game on a tablet device, we developed a system that can produce novel action–feedback relationships for participants by changing the ball-rolling direction. Participants operated the ball with specific rotation transformation from a natural gravity-based direction to hit a static target. Learning was evaluated by hit count and entropy estimates from x- and y-axis acceleration history. Results were separable into two distinct categories: one for learning action–feedback relationships similar to those we already have, such as 10° rotation, and another for different action–feedback relationships, such as 90° and greater rotation. Our findings support the view that participants were able to learn novel action–feedback relationships separate from already established relationships or their inner model and that tablet manipulation entropy is a good indicator to show this. Also, we have shown that our application is a handy tool to investigate the relationship between human actions and visual feedback.

Up Home