State Space Models

state-spaces's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

tridao 

authored 2 papers 4 days ago

Speculative Speculative Decoding

Paper • 2603.03251 • Published Mar 3 • 3

Mamba-3: Improved Sequence Modeling using State Space Principles

Paper • 2603.15569 • Published Mar 16 • 6

tridao 

authored a paper 8 days ago

FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling

Paper • 2603.05451 • Published Mar 5 • 1

tridao 

authored a paper about 1 year ago

M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models

Paper • 2504.10449 • Published Apr 14, 2025 • 15

tridao 

authored a paper over 1 year ago

RedPajama: an Open Dataset for Training Large Language Models

Paper • 2411.12372 • Published Nov 19, 2024 • 59

ArthurZ 

posted an update over 1 year ago

view post

Post

6200

Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support!

Contributions are welcome to support more models! 🔥

🔥

15

15

❤️

5

5

🤯

3

3

🤝

3

3

+

Reply

tridao 

authored a paper almost 2 years ago

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Paper • 2408.15237 • Published Aug 27, 2024 • 42

mamba-checkpoints 

authored a paper almost 2 years ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 68

albertgu 

authored a paper about 2 years ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 68

mamba-checkpoints 

updated a model about 2 years ago

state-spaces/mamba-2.8b

3B • Updated May 11, 2024 • 958 • 150

ArthurZ 

authored a paper about 2 years ago

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11, 2024 • 49

albertgu 

authored a paper over 2 years ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5, 2024 • 14

tridao 

authored a paper over 2 years ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5, 2024 • 14

ArthurZ 

posted an update over 2 years ago

view post

Post

mamba is now available in transformers. Thanks to @tridao and @albertgu for this brilliant model! 🚀 and the amazing mamba-ssm kernels powering this!
Checkout the collection here:
state-spaces/transformers-compatible-mamba-65e7b40ab87e5297e45ae406

• 
• 
• 
• 5 replies

·

🤝

10

10

❤️

7

7

+

Reply

ArthurZ 

updated 6 models over 2 years ago

state-spaces/mamba-2.8b-hf

Text Generation • 3B • Updated Mar 6, 2024 • 8.46k • 121

state-spaces/mamba-1.4b-hf

Text Generation • 1B • Updated Mar 6, 2024 • 34.7k • 16

state-spaces/mamba-790m-hf

Text Generation • 0.8B • Updated Mar 6, 2024 • 6.71k • 4

state-spaces/mamba-370m-hf

Text Generation • 0.4B • Updated Mar 6, 2024 • 7.46k • 17

state-spaces/mamba-130m-hf

Text Generation • 0.1B • Updated Mar 6, 2024 • 894k • 73

state-spaces/mamba-390m-hf

Updated Mar 6, 2024