End of training

README.md

@@ -0,0 +1,95 @@
+---
+license: apache-2.0
+base_model: t5-base
+tags:
+- generated_from_trainer
+datasets:
+- glue
+metrics:
+- accuracy
+model-index:
+- name: t5-base_cola_dense_epochs-5
+  results:
+  - task:
+      name: Text Classification
+      type: text-classification
+    dataset:
+      name: glue
+      type: glue
+      config: cola
+      split: validation
+      args: cola
+    metrics:
+    - name: Accuracy
+      type: accuracy
+      value: 0.8341323106423778
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# t5-base_cola_dense_epochs-5
+
+This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on the glue dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4393
+- Accuracy: 0.8341
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 32
+- eval_batch_size: 64
+- seed: 0
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 20
+- num_epochs: 5
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|
+| 0.575         | 0.19  | 50   | 0.5685          | 0.6913   |
+| 0.4799        | 0.37  | 100  | 0.6161          | 0.7670   |
+| 0.4941        | 0.56  | 150  | 0.4668          | 0.8063   |
+| 0.3837        | 0.75  | 200  | 0.4712          | 0.8169   |
+| 0.4198        | 0.93  | 250  | 0.5438          | 0.7996   |
+| 0.349         | 1.12  | 300  | 0.4618          | 0.8265   |
+| 0.3347        | 1.31  | 350  | 0.4630          | 0.8226   |
+| 0.3325        | 1.49  | 400  | 0.4581          | 0.8313   |
+| 0.3595        | 1.68  | 450  | 0.5653          | 0.7948   |
+| 0.4087        | 1.87  | 500  | 0.4393          | 0.8341   |
+| 0.2669        | 2.05  | 550  | 0.5241          | 0.8322   |
+| 0.2887        | 2.24  | 600  | 0.5042          | 0.8351   |
+| 0.2552        | 2.43  | 650  | 0.4713          | 0.8418   |
+| 0.238         | 2.61  | 700  | 0.4694          | 0.8428   |
+| 0.325         | 2.8   | 750  | 0.5176          | 0.8360   |
+| 0.285         | 2.99  | 800  | 0.5266          | 0.8265   |
+| 0.2099        | 3.17  | 850  | 0.5147          | 0.8437   |
+| 0.2645        | 3.36  | 900  | 0.4951          | 0.8380   |
+| 0.2851        | 3.54  | 950  | 0.4945          | 0.8370   |
+| 0.3277        | 3.73  | 1000 | 0.4828          | 0.8360   |
+
+
+### Framework versions
+
+- Transformers 4.34.1
+- Pytorch 2.1.0+cu118
+- Datasets 2.14.6
+- Tokenizers 0.14.1

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:99fbfd5173233023f3bb6feea5f41f6ff9521b4375d7fe19ec2d45d608cf4b12
+oid sha256:667076d4aae6ff0aba402256169efd93f8a25029a8ba40ee72f777640a76f310
 size 894094686