Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Paper • 2606.20945 • Published • 55
alex
alexalml
·
AI & ML interests
None yet
Recent Activity
upvoted a paper 1 day ago
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention liked a model 24 days ago
FrontiersMind/Nandi-Mini-V1.1-600M-Intermediate-Checkpoint-400GT liked a model 29 days ago
FrontiersMind/Nandi-Mini-V1.1-600M-Early-Checkpoint-250GTOrganizations
None yet