Hugging Face's logo

kugler
/
gbert-base-amdi-synset

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Model card Files
xet
 Community
kugler commited on
Commit
2e1836b
·
verified ·
1 Parent(s): afc0730

kugler/gbert-base-amdi-synset

Browse files
Files changed (4) hide show
  1. README.md +85 -0
  2. config.json +158 -0
  3. model.safetensors +3 -0
  4. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ - f1
8
+ - precision
9
+ - recall
10
+ model-index:
11
+ - name: gbert-base-amdi-synset
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # gbert-base-amdi-synset
19
+
20
+ This model was trained from scratch on the None dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.6415
23
+ - Accuracy: 0.8330
24
+ - F1: 0.6477
25
+ - Precision: 0.6550
26
+ - Recall: 0.6579
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 5e-05
46
+ - train_batch_size: 48
47
+ - eval_batch_size: 48
48
+ - seed: 42
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - num_epochs: 10
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
56
+ |:-------------:|:------:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
57
+ | 3.3175 | 0.4587 | 50 | 2.2214 | 0.5594 | 0.2286 | 0.2022 | 0.2872 |
58
+ | 1.5824 | 0.9174 | 100 | 1.1227 | 0.6867 | 0.3880 | 0.4003 | 0.4337 |
59
+ | 0.9358 | 1.3761 | 150 | 0.8457 | 0.7866 | 0.5421 | 0.5293 | 0.5807 |
60
+ | 0.7884 | 1.8349 | 200 | 0.7147 | 0.7762 | 0.5535 | 0.5538 | 0.5913 |
61
+ | 0.6245 | 2.2936 | 250 | 0.6656 | 0.8055 | 0.5663 | 0.5539 | 0.6033 |
62
+ | 0.5484 | 2.7523 | 300 | 0.6216 | 0.7986 | 0.5762 | 0.5789 | 0.6072 |
63
+ | 0.462 | 3.2110 | 350 | 0.5902 | 0.8227 | 0.6267 | 0.6206 | 0.6518 |
64
+ | 0.4089 | 3.6697 | 400 | 0.6369 | 0.8072 | 0.5902 | 0.5842 | 0.6126 |
65
+ | 0.368 | 4.1284 | 450 | 0.6189 | 0.8158 | 0.6296 | 0.6384 | 0.6613 |
66
+ | 0.3232 | 4.5872 | 500 | 0.6415 | 0.8330 | 0.6477 | 0.6550 | 0.6579 |
67
+ | 0.2836 | 5.0459 | 550 | 0.6373 | 0.8124 | 0.6341 | 0.6491 | 0.6609 |
68
+ | 0.2212 | 5.5046 | 600 | 0.6843 | 0.8090 | 0.6315 | 0.6471 | 0.6501 |
69
+ | 0.2228 | 5.9633 | 650 | 0.5933 | 0.8365 | 0.6625 | 0.6898 | 0.6686 |
70
+ | 0.1838 | 6.4220 | 700 | 0.6382 | 0.8313 | 0.6452 | 0.6472 | 0.6626 |
71
+ | 0.1527 | 6.8807 | 750 | 0.6471 | 0.8330 | 0.6601 | 0.6751 | 0.6772 |
72
+ | 0.1393 | 7.3394 | 800 | 0.6751 | 0.8227 | 0.6279 | 0.6339 | 0.6434 |
73
+ | 0.1082 | 7.7982 | 850 | 0.6689 | 0.8382 | 0.6608 | 0.6836 | 0.6772 |
74
+ | 0.0812 | 8.2569 | 900 | 0.7124 | 0.8296 | 0.6670 | 0.6785 | 0.6802 |
75
+ | 0.0836 | 8.7156 | 950 | 0.7201 | 0.8244 | 0.6446 | 0.6597 | 0.6574 |
76
+ | 0.0816 | 9.1743 | 1000 | 0.7253 | 0.8296 | 0.6478 | 0.6722 | 0.6567 |
77
+ | 0.0645 | 9.6330 | 1050 | 0.7236 | 0.8262 | 0.6425 | 0.6655 | 0.6521 |
78
+
79
+
80
+ ### Framework versions
81
+
82
+ - Transformers 4.45.2
83
+ - Pytorch 2.3.1+cu121
84
+ - Datasets 2.20.0
85
+ - Tokenizers 0.20.3
config.json ADDED
@@ -0,0 +1,158 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "/media/data/models/gbert-base",
3
+ "architectures": [
4
+ "BertForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "s24528",
13
+ "1": "s11270",
14
+ "10": "s14251",
15
+ "11": "s42158",
16
+ "12": "s29644",
17
+ "13": "sxxxxx",
18
+ "14": "s7419",
19
+ "15": "s6399",
20
+ "16": "s73683",
21
+ "17": "s13438",
22
+ "18": "s7282",
23
+ "19": "s41895",
24
+ "2": "s47771",
25
+ "20": "s50968",
26
+ "21": "s106689",
27
+ "22": "s33154",
28
+ "23": "s6029",
29
+ "24": "s25993",
30
+ "25": "s15791",
31
+ "26": "s47572",
32
+ "27": "s26149",
33
+ "28": "s10855",
34
+ "29": "s10206",
35
+ "3": "s10649",
36
+ "30": "s25245",
37
+ "31": "s30016",
38
+ "32": "s33676",
39
+ "33": "s50922",
40
+ "34": "s41951",
41
+ "35": "s7930",
42
+ "36": "s11625",
43
+ "37": "s110427",
44
+ "38": "s10313",
45
+ "39": "s64010",
46
+ "4": "s107180",
47
+ "40": "s42868",
48
+ "41": "s26446",
49
+ "42": "s9697",
50
+ "43": "s46736",
51
+ "44": "s73727",
52
+ "45": "s10919",
53
+ "46": "s9650",
54
+ "47": "s107850",
55
+ "48": "s33599",
56
+ "49": "s63143",
57
+ "5": "s9544",
58
+ "50": "s12102",
59
+ "51": "s75975",
60
+ "52": "s33132",
61
+ "53": "s107685",
62
+ "54": "s37889",
63
+ "55": "s25671",
64
+ "56": "s6390",
65
+ "57": "s33659",
66
+ "58": "s110889",
67
+ "59": "s69017",
68
+ "6": "s23151",
69
+ "60": "s106690",
70
+ "61": "s10937",
71
+ "62": "s106691",
72
+ "63": "s85055",
73
+ "7": "s11307",
74
+ "8": "s10304",
75
+ "9": "s9426"
76
+ },
77
+ "initializer_range": 0.02,
78
+ "intermediate_size": 3072,
79
+ "label2id": {
80
+ "s10206": 29,
81
+ "s10304": 8,
82
+ "s10313": 38,
83
+ "s10649": 3,
84
+ "s106689": 21,
85
+ "s106690": 60,
86
+ "s106691": 62,
87
+ "s107180": 4,
88
+ "s107685": 53,
89
+ "s107850": 47,
90
+ "s10855": 28,
91
+ "s10919": 45,
92
+ "s10937": 61,
93
+ "s110427": 37,
94
+ "s110889": 58,
95
+ "s11270": 1,
96
+ "s11307": 7,
97
+ "s11625": 36,
98
+ "s12102": 50,
99
+ "s13438": 17,
100
+ "s14251": 10,
101
+ "s15791": 25,
102
+ "s23151": 6,
103
+ "s24528": 0,
104
+ "s25245": 30,
105
+ "s25671": 55,
106
+ "s25993": 24,
107
+ "s26149": 27,
108
+ "s26446": 41,
109
+ "s29644": 12,
110
+ "s30016": 31,
111
+ "s33132": 52,
112
+ "s33154": 22,
113
+ "s33599": 48,
114
+ "s33659": 57,
115
+ "s33676": 32,
116
+ "s37889": 54,
117
+ "s41895": 19,
118
+ "s41951": 34,
119
+ "s42158": 11,
120
+ "s42868": 40,
121
+ "s46736": 43,
122
+ "s47572": 26,
123
+ "s47771": 2,
124
+ "s50922": 33,
125
+ "s50968": 20,
126
+ "s6029": 23,
127
+ "s63143": 49,
128
+ "s6390": 56,
129
+ "s6399": 15,
130
+ "s64010": 39,
131
+ "s69017": 59,
132
+ "s7282": 18,
133
+ "s73683": 16,
134
+ "s73727": 44,
135
+ "s7419": 14,
136
+ "s75975": 51,
137
+ "s7930": 35,
138
+ "s85055": 63,
139
+ "s9426": 9,
140
+ "s9544": 5,
141
+ "s9650": 46,
142
+ "s9697": 42,
143
+ "sxxxxx": 13
144
+ },
145
+ "layer_norm_eps": 1e-12,
146
+ "max_position_embeddings": 512,
147
+ "model_type": "bert",
148
+ "num_attention_heads": 12,
149
+ "num_hidden_layers": 12,
150
+ "pad_token_id": 0,
151
+ "position_embedding_type": "absolute",
152
+ "problem_type": "single_label_classification",
153
+ "torch_dtype": "float32",
154
+ "transformers_version": "4.45.2",
155
+ "type_vocab_size": 2,
156
+ "use_cache": true,
157
+ "vocab_size": 31102
158
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a7d63c64e507c0d4156650265a7ca702b5f43a04ca18ca0112f14197c476fb4
3
+ size 439931120
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6db6db66899cc5c021af6e10d62e074da71ef7ae2897fba3b647c9bd938155db
3
+ size 5240