shijiecao's picture

7 4

shijiecao

shijiecao

·

AI & ML interests

None yet

Recent Activity

liked a model 8 days ago

XiaomiMiMo/MiMo-V2.5-Pro

upvoted a paper about 1 month ago

Universal YOCO for Efficient Depth Scaling

upvoted a paper 3 months ago

HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing

View all activity

Organizations

None yet

authored 2 papers 11 months ago

BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation

Paper • 2402.10631 • Published Feb 16, 2024 • 2

SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs

Paper • 2410.13276 • Published Oct 17, 2024 • 29