Recognition of Hand Actions Using Body-Conducted Sounds

28. März 2014
CITEC, room 1.015


We consider the shop floor as a new area where ICT is spreading, and aim to support work with mobile devices. For example, Tokyo's infrastructure is getting older because it was built at the time of the Tokyo Olympics in 1964, so work to check and repair such equipment is essential. Introducing ICT in such a shop floor, it is expected that the log of the working process will be recorded automatically without interrupting work for process control. We think that the system should recognize several works such as tool operations or handling of machines. Then we propose the method to recognize the workers contact behavior to the tools and machines by examining the vibration conducted through the body from muscle activity and the impact between the finger and the tool.