rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated about 1 month ago • 6
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8 Text Generation • Updated Apr 2 • 8
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8 Text Generation • Updated Feb 8 • 5
rungalileo/xlm-roberta-base-misogyny-sexism-tweets-quantized-traced Text Classification • Updated Dec 14, 2023 • 4