ontology-response

This model is a fine-tuned version of scales-okn/docket-language-model on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.0012
• Accuracy: 1.0
• F1: 1.0
• Precision: 1.0
• Recall: 1.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 3e-05
• train_batch_size: 2
• eval_batch_size: 8
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 8
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.06
• num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1	Precision	Recall
0.0011	0.71	100	0.0284	0.9892	0.9822	0.9881	0.9765
0.0004	1.43	200	0.0012	1.0	1.0	1.0	1.0
0.0003	2.14	300	0.0144	0.9964	0.9942	0.9884	1.0
0.0002	2.86	400	0.0182	0.9964	0.9942	0.9884	1.0
0.0001	3.57	500	0.0146	0.9964	0.9942	0.9884	1.0
0.0046	4.29	600	0.0164	0.9964	0.9942	0.9884	1.0
0.0001	5.0	700	0.0189	0.9964	0.9942	0.9884	1.0

Framework versions

• Transformers 4.19.2
• Pytorch 1.11.0+cu113
• Datasets 1.18.3
• Tokenizers 0.11.0

Public release information

This model is released by the SCALES Open Knowledge Network under the GNU General Public License v3.0. It is derived from scales-okn/docket-language-model and is intended for research and development involving legal-document classification or information extraction. It is not legal advice.

The organization has reviewed the release decision and confirmed that the model's training data and resulting weights are legally and ethically releasable. Users are responsible for evaluating accuracy, bias, privacy, and fitness for their own use.

The repository includes PyTorch .bin artifacts. Hugging Face's server-side security scan reported no file issues before publication. As with any serialized model artifact, load it only with maintained libraries and in an appropriately isolated environment.