cedricbonhomme commited on
Commit
ec3413b
·
verified ·
1 Parent(s): 1a8f8d3

End of training

Browse files
Files changed (3) hide show
  1. README.md +17 -18
  2. emissions.csv +1 -1
  3. model.safetensors +1 -1
README.md CHANGED
@@ -7,31 +7,30 @@ tags:
7
  model-index:
8
  - name: vulnerability-description-generation-gpt2
9
  results: []
10
- datasets:
11
- - CIRCL/vulnerability
12
  ---
13
 
14
- # vulnerability-description-generation-gpt2
 
15
 
16
- This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on the dataset [CIRCL/vulnerability](https://huggingface.co/datasets/CIRCL/vulnerability).
17
 
 
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.8180
20
 
21
  ## Model description
22
 
23
- It is a text generation model and is aimed to assist in writing vulnerability descriptions.
 
 
24
 
 
25
 
26
- ## How to get started with the model
27
 
28
- ```python
29
- from transformers import pipeline
30
- pipe = pipeline("text-generation", model="CIRCL/vulnerability-description-generation-gpt2")
31
 
32
- >>> print(pipe("A new vulnerability in OpenSSL allows", max_length=300))
33
- [{'generated_text': 'A new vulnerability in OpenSSL allows remote attackers to create insecure connections. The impact of this vulnerability is that one or more TLS connections will be created under one username or one username/logon in a session for which another username or logon is valid. An attacker that can control the username or logon string of an openSSL host can effectively manipulate the OpenSSL host in a way that enables the attacker to create arbitrary openSSL connections by calling `http-server-create` in a non-secure sequence across other hosts. The vulnerability may be used to perform a man-in-the-middle attack, making the attacker completely different to the attacker. An exploitation may include MITM attacks and man-in-the-middle attacks. NOTE: the vendor states that "SUSE OpenSSL\'s implementation of \'openSSL_connect`, is not vulnerable to MITM attacks. If the attack vector is a MITM attack, OpenSSL will work under any circumstances." The CVE has been assigned for tracking purposes. In no way does the vendor\'s position change that an OpenSSL client should not use openSSL in the context of another OpenSSL server, but an attacker must choose the vulnerability according to their configuration if they are to exploit their attack. NOTE: the vendor indicates that it has considered the impact of this vulnerability "moderate". If by any measure, an OpenSSL client is susceptible to MITM attacks, that vulnerability would be considered low because it would be difficult to exploit a vulnerability that'}]
34
- ```
35
 
36
  ### Training hyperparameters
37
 
@@ -49,14 +48,14 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:-----:|:-----:|:---------------:|
52
- | 1.0054 | 1.0 | 24218 | 1.9465 |
53
- | 0.9361 | 2.0 | 48436 | 1.8464 |
54
- | 0.9119 | 3.0 | 72654 | 1.8180 |
55
 
56
 
57
  ### Framework versions
58
 
59
  - Transformers 4.49.0
60
  - Pytorch 2.6.0+cu124
61
- - Datasets 3.3.2
62
- - Tokenizers 0.21.0
 
7
  model-index:
8
  - name: vulnerability-description-generation-gpt2
9
  results: []
 
 
10
  ---
11
 
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
 
15
+ # vulnerability-description-generation-gpt2
16
 
17
+ This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.8131
20
 
21
  ## Model description
22
 
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
 
27
+ More information needed
28
 
29
+ ## Training and evaluation data
30
 
31
+ More information needed
 
 
32
 
33
+ ## Training procedure
 
 
34
 
35
  ### Training hyperparameters
36
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:-----:|:---------------:|
51
+ | 0.9951 | 1.0 | 24295 | 1.9421 |
52
+ | 0.9311 | 2.0 | 48590 | 1.8412 |
53
+ | 0.914 | 3.0 | 72885 | 1.8131 |
54
 
55
 
56
  ### Framework versions
57
 
58
  - Transformers 4.49.0
59
  - Pytorch 2.6.0+cu124
60
+ - Datasets 3.4.0
61
+ - Tokenizers 0.21.1
emissions.csv CHANGED
@@ -1,2 +1,2 @@
1
  timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
- 2025-03-10T12:21:01,codecarbon,558e1049-e05c-4f87-b302-8f455d39b3c2,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,21965.787705404684,0.38321849426453464,1.7446153054199084e-05,42.5,186.38144146822282,94.34470081329346,0.2591390341620463,2.8062088269096535,0.5752332953131148,3.640581156384813,Luxembourg,LUX,luxembourg,,,Linux-6.8.0-48-generic-x86_64-with-glibc2.39,3.12.3,2.8.3,64,AMD EPYC 9124 16-Core Processor,2,2 x NVIDIA L40S,6.1294,49.6113,251.58586883544922,machine,N,1.0
 
1
  timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
+ 2025-03-17T18:53:58,codecarbon,2e554580-3447-4028-991b-71bd54001dca,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,22114.162368467078,0.3858206972910065,1.744676967015283e-05,42.5,191.22333896726084,94.34470081329346,0.2608827419818561,2.825319493587102,0.5790998866487858,3.6653021222177444,Luxembourg,LUX,luxembourg,,,Linux-6.8.0-48-generic-x86_64-with-glibc2.39,3.12.3,2.8.3,64,AMD EPYC 9124 16-Core Processor,2,2 x NVIDIA L40S,6.1294,49.6113,251.58586883544922,machine,N,1.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9dfe950e711bedaa2e076f7f3b67d275b831229d9ca3495ab4dc8980d1b5e38d
3
  size 497774208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9fa86fb368d16620dea5250610beac43ee4e9ca14cec409e223e17250a4f5ee
3
  size 497774208