Instructions to use lex-hue/LexGPT-V2.5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lex-hue/LexGPT-V2.5 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="lex-hue/LexGPT-V2.5")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("lex-hue/LexGPT-V2.5") model = AutoModelForCausalLM.from_pretrained("lex-hue/LexGPT-V2.5") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use lex-hue/LexGPT-V2.5 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lex-hue/LexGPT-V2.5" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lex-hue/LexGPT-V2.5", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/lex-hue/LexGPT-V2.5
- SGLang
How to use lex-hue/LexGPT-V2.5 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "lex-hue/LexGPT-V2.5" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lex-hue/LexGPT-V2.5", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "lex-hue/LexGPT-V2.5" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lex-hue/LexGPT-V2.5", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use lex-hue/LexGPT-V2.5 with Docker Model Runner:
docker model run hf.co/lex-hue/LexGPT-V2.5
Model Card
Model Name: LexGPT-V2.5
Overview:
Purpose: This general-purpose language model serves as a powerful tool for personal exploration and learning in the domain of AI development. Its rapid evolution suggests the potential to surpass the performance of some established state-of-the-art models. Status: The model remains under active development, with continuous improvements leading to more robust capabilities. The next major iteration is undergoing rigorous testing and is expected to release this weekend (Saturday or Sunday). Skills: LexGPT-2.5 demonstrates impressive reasoning abilities, excelling in STEM (Science, Technology, Engineering, and Math) related fields. Surprisingly, it also possesses a capacity for imaginative engagement, making it surprisingly adept at roleplaying scenarios.
Evaluation: MT-BENCH scores indicate LexGPT-2.5's rapid progress. While it has yet to fully surpass GPT-3.5, its current performance is remarkably close and demonstrates significant potential for further improvement.
MT-BENCH SCORE:
First turn
| model | turn | score |
|---|---|---|
| gpt-4 | 1 | 8.956250 |
| claude-v1 | 1 | 8.150000 |
| LexGPT-V2.5 | 1 | 8.075949 |
| gpt-3.5-turbo | 1 | 8.075000 |
| vicuna-13b-v1.3 | 1 | 6.812500 |
Second turn
| model | turn | score |
|---|---|---|
| gpt-4 | 2 | 9.0250 |
| gpt-3.5-turbo | 2 | 7.8125 |
| LexGPT-V2.5 | 2 | 7.7500 |
| claude-v1 | 2 | 7.6500 |
| vicuna-13b-v1.3 | 2 | 5.9625 |
Average
| model | score |
|---|---|
| gpt-4 | 8.990625 |
| gpt-3.5-turbo | 7.943750 |
| LexGPT-V2.5 | 7.920530 |
| claude-v1 | 7.900000 |
| vicuna-13b-v1.3 | 6.387500 |
Intended Use:
Primary Use: Designed for general language generation tasks and to facilitate the creator's personal explorations in AI development. It offers a valuable sandbox for experimentation and learning. Potential Additional Uses: The model's STEM proficiency and roleplaying ability suggest it might find applications in educational tools or creative writing assistants. Potential Risks: As with many powerful language models, there's a potential for the generation of harmful, biased, or offensive content. Careful monitoring and the implementation of appropriate safeguards are essential.
Ethical Considerations
The model is largely uncensored, emphasizing user responsibility to avoid using it for illegal or intentionally harmful purposes. Ongoing evaluation during development is crucial for identifying and addressing potential biases in the model's generated outputs. Transparency and regular updates to this model card will foster ethical awareness in its use.
Additional Notes
LexGPT-2.5 showcases impressive progress, rapidly approaching the capabilities of GPT-3.5 and hinting at significant untapped potential. The creator welcomes questions, feedback, and collaboration to continue developing this model responsibly.
- Downloads last month
- 3
