Skip to content

keypoint support for map#3348

Open
SebastianJanampa wants to merge 2 commits intoLightning-AI:masterfrom
SebastianJanampa:feat-keypoint-map
Open

keypoint support for map#3348
SebastianJanampa wants to merge 2 commits intoLightning-AI:masterfrom
SebastianJanampa:feat-keypoint-map

Conversation

@SebastianJanampa
Copy link
Copy Markdown

@SebastianJanampa SebastianJanampa commented Mar 25, 2026

What does this PR do?

Fixes #1361

Before submitting
  • Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure to update the docs?
  • Did you write any new necessary tests?
PR review

This PR adds support for the human pose keypoint estimation metric (mAP). The only problem I found is that it will only work for COCO keypoints (17 keypoints) because tor torchmetrics relies on pycocotools. A solution could be to migrate or incorporate xtcocotools to support other keypoint datasets (e.g., CrowdPose).

I added additional tests to verify that the keypoint estimation works correctly, though I am not sure these tests are sufficient (this is my first PR, so I apologize if I am missing anything). Also, I created two JSON files, but I don't know how to upload them since torchmetrics downloads all the testing JSON files from an AWS account.

Did you have fun?

Yeap 😃

Make sure you had fun coding 🙃


📚 Documentation preview 📚: https://torchmetrics--3348.org.readthedocs.build/en/3348/

@SebastianJanampa
Copy link
Copy Markdown
Author

The unittests checks fail because the repo does not have the JSON files I use to test the mAP for keypoints

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add OKS metric

1 participant