Spaces:

DebasishDhal99
/

Embedding-Visualization

Running on Zero

App Files Files Community

Embedding-Visualization

1.04 MB

Ctrl+K

Ctrl+K

3 contributors

History: 19 commits

DebasishDhal99's picture

feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k)

36a72e5 3 days ago

.github
fix: Fix Hugging Face username in workflow 19 days ago
absolute_sinusoidal_position_embedding
feat: added bare mimimum implementation of absolute sinusoidal positional encoding 29 days ago
relative_pos_embedding
feat: added bare minimum rel-position embedding 22 days ago
rope_implementation
Added visualization for rope implementation 19 days ago
src
feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 3 days ago
tests
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding 11 days ago
.gitignore

4.65 kB
feat: basic setup with docker, no real code has been added for visualization yet 12 days ago
Dockerfile

277 Bytes
feat: basic setup with docker, no real code has been added for visualization yet 12 days ago
README.md

1.83 kB
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 11 days ago
app.py

24.5 kB
feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 3 days ago
compose.yaml

106 Bytes
feat: basic setup with docker, no real code has been added for visualization yet 12 days ago
requirements.txt

113 Bytes
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding 11 days ago