Add robotics pipeline tag and improve model card

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +39 -10
README.md CHANGED
@@ -1,31 +1,60 @@
1
  ---
2
  license: mit
 
3
  tags:
4
- - robotics
5
- - grasping
6
- - learning-from-humans
7
- - dexterous-manipulation
8
  ---
9
 
10
  # Human Universal Grasping (HUG)
11
 
12
- Learning dexterous multifingered grasping entirely from human data.
13
 
14
- - πŸ“„ **Paper**: [arXiv:2606.17054](https://arxiv.org/abs/2606.17054)
15
  - 🌐 **Website**: [grasping.io](https://grasping.io)
16
  - πŸ’» **Code**: [github.com/kevinywu/hug](https://github.com/kevinywu/hug)
17
 
18
- ## Files
19
 
20
- - `hug_full.safetensors` β€” full model weights (EMA, bf16).
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  ## Usage
23
 
 
 
 
 
24
  ```bash
25
  hf download kevinywu/hug hug_full.safetensors --local-dir checkpoints/
26
  ```
27
 
28
- See the [code repo](https://github.com/kevinywu/hug) for inference instructions.
 
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
  ## Citation
31
 
@@ -36,4 +65,4 @@ See the [code repo](https://github.com/kevinywu/hug) for inference instructions.
36
  journal={arXiv preprint arXiv:2606.17054},
37
  year={2026}
38
  }
39
- ```
 
1
  ---
2
  license: mit
3
+ pipeline_tag: robotics
4
  tags:
5
+ - robotics
6
+ - grasping
7
+ - learning-from-humans
8
+ - dexterous-manipulation
9
  ---
10
 
11
  # Human Universal Grasping (HUG)
12
 
13
+ HUG is a flow-matching model that generates diverse human grasps for any user-specified object in a single RGB-D image. By learning from a large-scale egocentric dataset of human grasps (1M-HUGs), the model can predict human-like grasps that can be retargeted to various robot hands for zero-shot manipulation.
14
 
15
+ - πŸ“„ **Paper**: [Human Universal Grasping](https://arxiv.org/abs/2606.17054)
16
  - 🌐 **Website**: [grasping.io](https://grasping.io)
17
  - πŸ’» **Code**: [github.com/kevinywu/hug](https://github.com/kevinywu/hug)
18
 
19
+ ## Installation
20
 
21
+ The codebase is tested on Ubuntu 22.04/24.04, CUDA 12.8, PyTorch 2.9.1, and Python 3.10.
22
+
23
+ ```bash
24
+ # 1) Environment setup
25
+ conda env create -f environment.yaml && conda activate hug
26
+ pip install torch==2.9.1 torchvision==0.24.1 torchaudio==2.9.1 --index-url https://download.pytorch.org/whl/cu128
27
+ pip install torch-cluster -f https://data.pyg.org/whl/torch-2.9.1+cu128.html
28
+ pip install --no-build-isolation git+https://github.com/mattloper/chumpy.git@580566e
29
+ pip install -e .
30
+ ```
31
+
32
+ Please refer to the [official repository](https://github.com/kevinywu/hug) for instructions on downloading required assets like MANO models.
33
 
34
  ## Usage
35
 
36
+ ### Download Weights
37
+
38
+ Download the full model weights (`.safetensors`) using the `huggingface-cli`:
39
+
40
  ```bash
41
  hf download kevinywu/hug hug_full.safetensors --local-dir checkpoints/
42
  ```
43
 
44
+ ### Inference
45
+
46
+ HUG predicts human grasps in MANO form. You can run the interactive application to predict grasps for objects in the camera frame:
47
+
48
+ ```bash
49
+ CKPT=checkpoints/hug_full.safetensors
50
+ DATA=data/hug_bench/
51
+
52
+ # Launch the app: click an object to predict a grasp
53
+ python -m hug.app --checkpoint-path "$CKPT" --dataset-path "$DATA" --save-pred
54
+
55
+ # Visualize saved predictions
56
+ python -m hug.visualize_predictions --dataset-path "$DATA"
57
+ ```
58
 
59
  ## Citation
60
 
 
65
  journal={arXiv preprint arXiv:2606.17054},
66
  year={2026}
67
  }
68
+ ```