which settings can make the intfloat/e5-base-v2 using GPU?
#8
by WeiZhenKun - opened
ml.g5.xlarge is used on aws sagemaker, but it seems that intfloat/e5-base-v2 does not use the GPU to generate embddings?
Simply move the model to the GPU device like all other models.
model.cuda()
# Then you can generate the embeddings
ok, thanks
WeiZhenKun changed discussion status to closed