FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-32
2B • Updated • 46
Edit Models filters
Model Tree
Apps
Inference Providers
Models
226
Active filters: built-with-llama
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-32
2B • Updated • 28
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-64
2B • Updated • 26
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-64
2B • Updated • 96
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-128
2B • Updated • 33
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-128
2B • Updated • 28
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-32
13B • Updated • 22
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-32
13B • Updated • 16
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-64
12B • Updated • 18
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-64
12B • Updated • 17
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-128
11B • Updated • 17
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-128
11B • Updated • 16
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-32
67B • Updated • 23
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-64
61B • Updated • 15
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-64
61B • Updated • 20
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-128
58B • Updated • 21
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-32
69B • Updated • 21
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-128
58B • Updated • 18
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-32
3B • Updated • 43
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-64
3B • Updated • 184
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-128
3B • Updated • 26
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 169
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5
8B • Updated • 51
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 57
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Aasym-SpQ-R1R2-SmQ-0.5
8B • Updated • 85
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 62
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5
8B • Updated • 45
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 43
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 54
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 116