Instructions to use OMCHOKSI108/Paralay1.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use OMCHOKSI108/Paralay1.1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "OMCHOKSI108/Paralay1.1") - Transformers
How to use OMCHOKSI108/Paralay1.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="OMCHOKSI108/Paralay1.1") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("OMCHOKSI108/Paralay1.1", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use OMCHOKSI108/Paralay1.1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OMCHOKSI108/Paralay1.1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OMCHOKSI108/Paralay1.1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/OMCHOKSI108/Paralay1.1
- SGLang
How to use OMCHOKSI108/Paralay1.1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OMCHOKSI108/Paralay1.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OMCHOKSI108/Paralay1.1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OMCHOKSI108/Paralay1.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OMCHOKSI108/Paralay1.1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Studio
How to use OMCHOKSI108/Paralay1.1 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for OMCHOKSI108/Paralay1.1 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for OMCHOKSI108/Paralay1.1 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for OMCHOKSI108/Paralay1.1 to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="OMCHOKSI108/Paralay1.1", max_seq_length=2048, ) - Docker Model Runner
How to use OMCHOKSI108/Paralay1.1 with Docker Model Runner:
docker model run hf.co/OMCHOKSI108/Paralay1.1
Model Card for Paralay1.1
Paralay1.1 is a LoRA/QLoRA fine-tuned cybersecurity assistant adapter based on unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit. It is designed for defensive cybersecurity guidance, including incident response, log analysis, MITRE ATT&CK explanation, malware-defense investigation planning, cloud-security checklists, and general cyber-risk assessment.
This repository contains the PEFT LoRA adapter, not a full merged standalone model. To use it, load the base model and then attach this adapter.
Model Details
Model Description
Paralay1.1 is a supervised fine-tuned instruction-following adapter trained on cybersecurity conversation data. The model was fine-tuned using Unsloth, TRL SFTTrainer, PEFT LoRA adapters, and 4-bit quantized Qwen2.5-1.5B-Instruct.
The intended behavior is to provide structured, practical, and safety-aware defensive cybersecurity responses. The model is not intended to provide offensive exploitation instructions, malware creation, credential theft guidance, or unauthorized access assistance.
- Developed by: Om Choksi
- Shared by: OMCHOKSI108
- Model type: PEFT LoRA adapter / QLoRA fine-tuned causal language model adapter
- Base model:
unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit - Language(s): Primarily English
- Domain: Defensive cybersecurity
- License: Not specified
- Finetuned from model:
unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit
Model Sources
- Repository:
OMCHOKSI108/Paralay1.1 - Dataset:
OMCHOKSI108/cybersecdata - Demo: Not available
- Paper: Not available
Uses
Direct Use
Paralay1.1 can be used as a defensive cybersecurity assistant for:
- Incident response planning
- Phishing incident triage
- Suspicious log pattern explanation
- MITRE ATT&CK technique explanation
- Cloud misconfiguration response checklists
- Malware and ransomware investigation planning
- Security hardening recommendations
- Threat-intelligence style summaries
Example use cases:
- “A user clicked a suspicious link and entered credentials. Give an incident response plan.”
- “Analyze repeated failed SSH logins followed by one successful login.”
- “Explain MITRE ATT&CK T1059 with detection ideas.”
- “Give a checklist for an exposed AWS S3 bucket incident.”
Downstream Use
This adapter can be integrated into:
- Cybersecurity learning assistants
- SOC analyst support tools
- Defensive security chatbots
- Internal security training demos
- Incident response documentation helpers
- Lightweight local or cloud-hosted cyber assistant prototypes
Out-of-Scope Use
This model should not be used for:
- Malware generation
- Credential theft
- Phishing campaign generation
- Reverse shell or payload creation
- Bypassing antivirus or endpoint protection
- Unauthorized vulnerability exploitation
- Instructions to attack real systems
- Automated offensive cyber operations
The model is a small fine-tuned adapter and should not be treated as a complete security decision-making system.
Bias, Risks, and Limitations
Paralay1.1 has several important limitations:
- It is based on a 1.5B parameter instruction model, so reasoning depth is limited compared with larger LLMs.
- It may hallucinate threat actor names, CVEs, IOCs, or MITRE mappings.
- It may provide incomplete or overly generic security advice.
- Safety behavior is not fully reliable.
- The notebook evaluation showed that the model sometimes responded unsafely to misuse-style prompts.
- The model should not be used as the only source for real incident response decisions.
- Outputs should be reviewed by a qualified cybersecurity professional before operational use.
Safety Limitation Observed During Evaluation
A simple safety evaluation was performed on five cyber misuse prompts. The average safety score was 0.6 / 1.0. Some unsafe or partially unsafe responses were observed for requests involving phishing, keylogging, and reverse-shell style content.
Because of this, downstream applications should add an external safety filter, stronger refusal system prompt, or policy layer before exposing the model to users.
Recommendations
Users should:
- Use a strong defensive system prompt.
- Add a safety classifier or rule-based filter for harmful cyber requests.
- Verify all technical claims before use.
- Avoid using this model for real-world incident response without expert review.
- Treat generated IOCs, CVEs, and threat attribution as unverified unless independently confirmed.
- Use retrieval-augmented generation if accurate current threat intelligence is required.
How to Get Started with the Model
Install dependencies:
pip install unsloth transformers peft accelerate bitsandbytes
- Downloads last month
- 25
Model tree for OMCHOKSI108/Paralay1.1
Base model
Qwen/Qwen2.5-1.5B