vulnerability-severity-classification-roberta-base

This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 2.0502
• Accuracy: 0.8139
• F1 Macro: 0.7431
• Low Precision: 0.6397
• Low Recall: 0.4924
• Low F1: 0.5565
• Medium Precision: 0.8410
• Medium Recall: 0.8714
• Medium F1: 0.8559
• High Precision: 0.8123
• High Recall: 0.8011
• High F1: 0.8067
• Critical Precision: 0.7592
• Critical Recall: 0.7477
• Critical F1: 0.7534

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 3e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1 Macro	Low Precision	Low Recall	Low F1	Medium Precision	Medium Recall	Medium F1	High Precision	High Recall	High F1	Critical Precision	Critical Recall	Critical F1
2.7509	1.0	15759	2.5739	0.7341	0.6469	0.5294	0.3716	0.4367	0.7947	0.8050	0.7998	0.7148	0.7127	0.7137	0.6192	0.6570	0.6375
2.3507	2.0	31518	2.4020	0.7609	0.6754	0.5901	0.3763	0.4595	0.7847	0.8626	0.8218	0.7920	0.6852	0.7348	0.6399	0.7385	0.6857
1.6387	3.0	47277	2.1924	0.7858	0.7093	0.6319	0.4335	0.5142	0.8197	0.8558	0.8374	0.7971	0.7467	0.7711	0.6734	0.7614	0.7147
1.2756	4.0	63036	2.0808	0.8042	0.7289	0.6554	0.4562	0.5380	0.8217	0.8792	0.8495	0.8022	0.7858	0.7939	0.7730	0.6991	0.7342
1.5348	5.0	78795	2.0502	0.8139	0.7431	0.6397	0.4924	0.5565	0.8410	0.8714	0.8559	0.8123	0.8011	0.8067	0.7592	0.7477	0.7534

Framework versions

• Transformers 5.5.0
• Pytorch 2.11.0+cu130
• Datasets 4.8.4
• Tokenizers 0.22.2