ssmits
/

Qwen2-7B-embed-base

Feature Extraction

text-embeddings-inference

Model card Files Files and versions

Qwen2-7B-embed-base

This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. It's intended to be used as a base for embedding tasks and further fine-tuning.

Model Details

Base model: Qwen2.5-7B-Instruct
The 'lm_head' layer has been removed
Maintains the original model's norm layers
Suitable for embedding tasks and custom head additions

Downloads last month: 10

Safetensors

Model size

7B params

Tensor type

F16

·