Add robotics pipeline tag and improve model card
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,31 +1,60 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
| 3 |
tags:
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
---
|
| 9 |
|
| 10 |
# Human Universal Grasping (HUG)
|
| 11 |
|
| 12 |
-
|
| 13 |
|
| 14 |
-
- π **Paper**: [
|
| 15 |
- π **Website**: [grasping.io](https://grasping.io)
|
| 16 |
- π» **Code**: [github.com/kevinywu/hug](https://github.com/kevinywu/hug)
|
| 17 |
|
| 18 |
-
##
|
| 19 |
|
| 20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
## Usage
|
| 23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
```bash
|
| 25 |
hf download kevinywu/hug hug_full.safetensors --local-dir checkpoints/
|
| 26 |
```
|
| 27 |
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
## Citation
|
| 31 |
|
|
@@ -36,4 +65,4 @@ See the [code repo](https://github.com/kevinywu/hug) for inference instructions.
|
|
| 36 |
journal={arXiv preprint arXiv:2606.17054},
|
| 37 |
year={2026}
|
| 38 |
}
|
| 39 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
pipeline_tag: robotics
|
| 4 |
tags:
|
| 5 |
+
- robotics
|
| 6 |
+
- grasping
|
| 7 |
+
- learning-from-humans
|
| 8 |
+
- dexterous-manipulation
|
| 9 |
---
|
| 10 |
|
| 11 |
# Human Universal Grasping (HUG)
|
| 12 |
|
| 13 |
+
HUG is a flow-matching model that generates diverse human grasps for any user-specified object in a single RGB-D image. By learning from a large-scale egocentric dataset of human grasps (1M-HUGs), the model can predict human-like grasps that can be retargeted to various robot hands for zero-shot manipulation.
|
| 14 |
|
| 15 |
+
- π **Paper**: [Human Universal Grasping](https://arxiv.org/abs/2606.17054)
|
| 16 |
- π **Website**: [grasping.io](https://grasping.io)
|
| 17 |
- π» **Code**: [github.com/kevinywu/hug](https://github.com/kevinywu/hug)
|
| 18 |
|
| 19 |
+
## Installation
|
| 20 |
|
| 21 |
+
The codebase is tested on Ubuntu 22.04/24.04, CUDA 12.8, PyTorch 2.9.1, and Python 3.10.
|
| 22 |
+
|
| 23 |
+
```bash
|
| 24 |
+
# 1) Environment setup
|
| 25 |
+
conda env create -f environment.yaml && conda activate hug
|
| 26 |
+
pip install torch==2.9.1 torchvision==0.24.1 torchaudio==2.9.1 --index-url https://download.pytorch.org/whl/cu128
|
| 27 |
+
pip install torch-cluster -f https://data.pyg.org/whl/torch-2.9.1+cu128.html
|
| 28 |
+
pip install --no-build-isolation git+https://github.com/mattloper/chumpy.git@580566e
|
| 29 |
+
pip install -e .
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
Please refer to the [official repository](https://github.com/kevinywu/hug) for instructions on downloading required assets like MANO models.
|
| 33 |
|
| 34 |
## Usage
|
| 35 |
|
| 36 |
+
### Download Weights
|
| 37 |
+
|
| 38 |
+
Download the full model weights (`.safetensors`) using the `huggingface-cli`:
|
| 39 |
+
|
| 40 |
```bash
|
| 41 |
hf download kevinywu/hug hug_full.safetensors --local-dir checkpoints/
|
| 42 |
```
|
| 43 |
|
| 44 |
+
### Inference
|
| 45 |
+
|
| 46 |
+
HUG predicts human grasps in MANO form. You can run the interactive application to predict grasps for objects in the camera frame:
|
| 47 |
+
|
| 48 |
+
```bash
|
| 49 |
+
CKPT=checkpoints/hug_full.safetensors
|
| 50 |
+
DATA=data/hug_bench/
|
| 51 |
+
|
| 52 |
+
# Launch the app: click an object to predict a grasp
|
| 53 |
+
python -m hug.app --checkpoint-path "$CKPT" --dataset-path "$DATA" --save-pred
|
| 54 |
+
|
| 55 |
+
# Visualize saved predictions
|
| 56 |
+
python -m hug.visualize_predictions --dataset-path "$DATA"
|
| 57 |
+
```
|
| 58 |
|
| 59 |
## Citation
|
| 60 |
|
|
|
|
| 65 |
journal={arXiv preprint arXiv:2606.17054},
|
| 66 |
year={2026}
|
| 67 |
}
|
| 68 |
+
```
|