Sawyer Bowerman

soyrsoyr's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated 2 models about 12 hours ago

soyrsoyr/Qwen3.8-27B-W4A16-AWQ-GPTQ

Image-Text-to-Text • 11B • Updated about 12 hours ago • 6.32k • 2

soyrsoyr/Qwen3.8-27B-FP8-dynamic

Image-Text-to-Text • 27B • Updated about 12 hours ago • 28

New activity in soyrsoyr/Qwen3.8-27B-W4A16-AWQ-GPTQ 1 day ago

4× RTX 3090 vLLM/Marlin results: ~66 tok/s, TP4, 256K context

1

#1 opened 1 day ago by

mwyborski

published 2 models 1 day ago

soyrsoyr/Qwen3.8-27B-W4A16-AWQ-GPTQ

Image-Text-to-Text • 11B • Updated about 12 hours ago • 6.32k • 2

soyrsoyr/Qwen3.8-27B-FP8-dynamic

Image-Text-to-Text • 27B • Updated about 12 hours ago • 28

updated a collection 1 day ago

Quantized Models

Collection

Bunch of good models • 9 items • Updated 1 day ago

updated a model 3 days ago

soyrsoyr/Muse-Glimmer-30B-W4A16-AWQ-GPTQ

Image-Text-to-Text • 8B • Updated 3 days ago • 1k

updated a collection 4 days ago

Tiny Models

Collection

Tiny models used for testing • 18 items • Updated 4 days ago • 2

updated a model 4 days ago

inference-optimization/Qwen3-VL-Reranker-0.1B-tiny

98.7M • Updated 4 days ago • 11

published a model 4 days ago

inference-optimization/Qwen3-VL-Reranker-0.1B-tiny

98.7M • Updated 4 days ago • 11

updated a collection 4 days ago

Tiny Models

Collection

Tiny models used for testing • 18 items • Updated 4 days ago • 2

updated a model 4 days ago

inference-optimization/granite-vision-4.1-0.2B-tiny

0.2B • Updated 4 days ago • 10

published a model 4 days ago

inference-optimization/granite-vision-4.1-0.2B-tiny

0.2B • Updated 4 days ago • 10

updated a collection 4 days ago

Tiny Models

Collection

Tiny models used for testing • 18 items • Updated 4 days ago • 2

updated a model 4 days ago

inference-optimization/gemma-4-unified-0.8B-tiny

0.8B • Updated 4 days ago • 12

published a model 4 days ago

inference-optimization/gemma-4-unified-0.8B-tiny

0.8B • Updated 4 days ago • 12

updated a collection 4 days ago

LLM Compressor testing

Collection

14 items • Updated 4 days ago