Keypoint Annotation

What is keypoint annotation?

Keypoint annotation consists of various particularly numbered points called keypoints which are connected by edges. They are a great way of tracking variations between objects which always have the same structure (e.g. human figures and facial features). The output are the x, y coordinates of the numbered keypoints always in the same order.

Before image alt After image alt
Before image alt After image alt

Where can it be used?

Keypoint annotations are very well suited for movement tracking and prediction, human body parts detection, gesture and facial recognition, pose identification for AR/VR, or even in sign language transcription. 

  • Medical: tracking instruments in robotic-assisted surgery
  • Geospatial: monitoring crane movement on construction sites
  • Automotive: tracking the movement of pedestrians on the street
  • Industrial: detecting hand gestures of manufacturing workers
  • Agriculture: tracking the movement of livestock
  • Retail: detecting shopper actions in smart supermarkets
Before image alt After image alt

The Pros

  • Once the skeleton is set up on the annotation tool, the only thing needed is to adjust the nodes and annotation becomes much easier. 
  • Keypoints are helpful for annotators not to forget any node from the sequence.

The Cons

  • Objects must have the same regular structure in order for this annotation type to be useful.
  • Edge cases where some keypoints are not visible (e.g. human is turned to the side) may produce confusion in the model.
Before image alt After image alt
Before image alt After image alt

Our Tips

  • When defining the annotation instructions, determine whether hidden keypoints need to be deleted or their position has to be deduced by the labeler.
  • You can define certain proportions (e.g. expected edge length) so as to make sure your model does not detect keypoints that fall outside of what is common sense.
  • It is important to set clear guidelines on which side should be considered “left” and “right” (e.g. should annotators label the data from their point of view or from the object’s) because errors in interpretation might frequently happen.
Before image alt After image alt

Tools and Platforms for Keypoint Annotation

Alegion logo
Diffgram logo
KILI Technology logo
Manthano logo logo
SuperAnnotate logo
V7 labs logo
What data would you like to have annotated?

Use cases

Illustration shows Geospatial annotation
Illustration shows Medical annotation
Illustration shows Automotive annotation
Illustration shows Industry annotation
Illustration shows AgriTech annotation
Illustration shows Retail annotation

Interested in having your dataset annotated with keypoints?
Get in touch with our team at Humans in the Loop and a project manager will advise you on the best strategy!