Human Pose Estimation And Its Application in HCI

Code: Github.

Human Pose Estimation is a method of extracting human key points from a given image or video. We analyze a variety of existing Human Posture Estimation models and select the OpenPose model to realize behavior recognition based on Human Posture Estimation and design specific applications of human-computer interaction in smart home scenarios.

(1) With the use of the Human Posture Estimation model, we analyze the scenario of fall detection of the elderly living alone. The background subtraction method is used to subtract the background of the input image in the specific scene of the elderly living alone, which helps to improve the accuracy of the OpenPose Human Pose Estimation model in single-person detection. In this project, rule-based and learning-based methods are developed respectively to process the human body’s key points obtained from the OpenPose model to achieve fall detection. This paper develops the function of sending warning emails automatically to inform the family members of the elderly living alone that the elderly may have fallen.

(2) With the use of the Human Posture Estimation model, we analyze the bad posture detection scenario of children watching TV. After subtracting the background, this project uses a rule-based method to process the human body key points obtained from the OpenPose model. The rule-based method realizes the detection of bad posture and notification of the bad posture of children watching TV. This project also provides an API for related TV or Smart Home Device manufacturers.