Skip to content

This is a sample program that recognizes hand signs and finger gestures with a simple MLP using the detected key points. Handpose is estimated using MediaPipe.

Notifications You must be signed in to change notification settings

GhoshRitika/go1-gesture-command

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

59 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Go1-Gesture-Command

This repository contains two packages for using hand gestures to send motion commands to the Unitree Go1:

  • ros2_hgr
    • A ROS2 Python package with code forked from Kinivi's repository linked here (insert link here) that uses computer vision, Mediapipe, and a machine learning model to detect 8 different hand gestures.
  • go1_cmd
    • A ROS2 C++ package that utilizes pre-defined finger positions to mimic gestures in the robot hand.

Dependencies

Launch

ros2 launch ros2_hgr hgr.launch.xml

  • The ros2_hgr launch file has defaults set to run the hgr_node with your computer's built-in webcam.

Grasp Gestures

  1. Open Palms
  2. Close fist
  3. One pointer
  4. Pinch Index Finger
  5. Pinch Middle Finger
  6. 3 Finger Grasp
  7. 4 Finger Grasp
gestures.mp4
  • Author of Fork: Ava Zahedi

About

This is a sample program that recognizes hand signs and finger gestures with a simple MLP using the detected key points. Handpose is estimated using MediaPipe.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 84.6%
  • Python 12.5%
  • C++ 2.5%
  • CMake 0.4%