Instructions to use microsoft/Magma-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/Magma-8B with Transformers:
# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("microsoft/Magma-8B", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Edit 536 lines due to type mismatch error when evaluation
#14
by shoveling42 - opened
The specific error message is as follows:
RuntimeError: Index put requires the source and destination dtypes match, got BFloat16 for the destination and Float for the source.