File size: 3,676 Bytes
2f97e95
 
80a2432
 
 
2f97e95
 
2ba2064
80a2432
2f97e95
 
80a2432
 
 
 
 
 
 
 
 
 
 
7113ed1
 
 
 
80a2432
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7113ed1
80a2432
 
7113ed1
 
 
 
 
80a2432
 
7113ed1
80a2432
 
 
 
7113ed1
80a2432
 
 
 
7113ed1
80a2432
 
 
 
7113ed1
80a2432
 
 
 
7113ed1
80a2432
 
 
 
 
 
 
 
7113ed1
 
80a2432
 
 
 
 
 
 
 
 
 
 
7113ed1
 
 
 
 
 
 
 
 
 
 
 
 
 
80a2432
 
 
 
 
7113ed1
80a2432
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
---
title: README
emoji: 🧥
colorFrom: indigo
colorTo: green
sdk: static
pinned: false
license: mit
short_description: Open-source fashion intelligence and visual search.
---

<section>
  <h1>HopitAI</h1>
  <p>
    HopitAI builds open-source fashion intelligence models for visual search,
    product matching, catalog retrieval, and ecommerce discovery.
  </p>
</section>

<section>
  <h2>MODA Fashion Retrieval</h2>
  <p>
    MODA is a family of fashion retrieval models covering both halves of the
    problem: finding products from an image, and finding products from a text
    description. Every model and result is MIT licensed and reproducible from
    the public repository.
  </p>
  <p>
    <a href="https://huggingface.co/spaces/HopitAI/moda-fashion-search">Try the interactive demo</a>
    ·
    <a href="https://github.com/hopit-ai/Moda">View the GitHub repo</a>
    ·
    <a href="https://huggingface.co/HopitAI/moda-fashion-deepfashion2">Start with DeepFashion2</a>
  </p>
</section>

<section>
  <h2>Featured Models</h2>
  <table>
    <tr>
      <th>Model</th>
      <th>Task</th>
      <th>Best for</th>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/HopitAI/moda-fashionsiglip-multiview-203m">MODA-FashionSigLIP-MultiView-203M</a></td>
      <td>Text to image</td>
      <td>Searching a catalog in plain language. Multi-view retrieval system over the frozen FashionSigLIP checkpoint, adding zero parameters.</td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/HopitAI/moda-fashion-distilled">MODA-Fashion-Distilled</a></td>
      <td>Image to image</td>
      <td>Best overall quality</td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/HopitAI/moda-fashion-distilled-512d">MODA-Fashion-Distilled-512d</a></td>
      <td>Image to image</td>
      <td>Compact vector search indexes</td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/HopitAI/moda-fashion-deepfashion2">MODA-Fashion-DeepFashion2</a></td>
      <td>Image to image</td>
      <td>Simple reproducible recipe</td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/HopitAI/moda-fashion-vision-fp16">MODA-Fashion-Vision-FP16</a></td>
      <td>Image to image</td>
      <td>Smaller edge and mobile deployment</td>
    </tr>
    <tr>
      <td><a href="https://huggingface.co/HopitAI/moda-fashion-matryoshka">MODA-Fashion-Matryoshka</a></td>
      <td>Image to image</td>
      <td>Flexible embedding dimensions</td>
    </tr>
  </table>
</section>

<section>
  <h2>Quick Start</h2>

Image to image, for finding visually similar products:

```bash
huggingface-cli download HopitAI/moda-fashion-deepfashion2 --local-dir ./moda-fashion-deepfashion2
```

```python
import open_clip

model, preprocess_train, preprocess_val = open_clip.create_model_and_transforms(
    "hf-hub:HopitAI/moda-fashion-deepfashion2"
)
```

Text to image, for searching a catalog in plain language:

```bash
pip install "git+https://huggingface.co/HopitAI/moda-fashionsiglip-multiview-203m"
```

```python
from moda_fashionsiglip_multiview import ModaFashionSigLIP

retriever = ModaFashionSigLIP.from_pretrained()
index = retriever.build_index(image_paths, item_ids=item_ids)
results = retriever.search("red floral summer dress", index, top_k=5)[0]
```
</section>

<section>
  <h2>Use Cases</h2>
  <ul>
    <li>Search a fashion catalog with a natural-language query.</li>
    <li>Find visually similar products in a fashion catalog.</li>
    <li>Match street-style looks to shoppable items.</li>
    <li>Deduplicate product images across marketplaces.</li>
    <li>Build embedding indexes for ecommerce search and recommendations.</li>
  </ul>
</section>