chuuhtetnaing/myanmar-pos-dataset
Viewer ⢠Updated ⢠41k ⢠35
Fine-tuned myanmar-text-segmentation-model for Myanmar Part-of-Speech tagging.
| Epoch | Training Loss | Validation Loss | Precision | Recall | F1 | Accuracy |
|---|---|---|---|---|---|---|
| 1 | 0.7611 | 0.5417 | 0.8000 | 0.8422 | 0.8205 | 0.8557 |
| 2 | 0.3736 | 0.3170 | 0.8879 | 0.9040 | 0.8959 | 0.9123 |
| 3 | 0.3015 | 0.2764 | 0.9000 | 0.9143 | 0.9071 | 0.9219 |
| 4 | 0.2589 | 0.2562 | 0.9067 | 0.9189 | 0.9127 | 0.9265 |
| 5 | 0.2504 | 0.2473 | 0.9104 | 0.9219 | 0.9161 | 0.9285 |
| 6 | 0.2209 | 0.2403 | 0.9141 | 0.9237 | 0.9189 | 0.9311 |
| 7 | 0.2253 | 0.2341 | 0.9168 | 0.9256 | 0.9212 | 0.9328 |
| 8 | 0.2361 | 0.2319 | 0.9183 | 0.9264 | 0.9223 | 0.9337 |
| 9 | 0.2140 | 0.2305 | 0.9180 | 0.9268 | 0.9224 | 0.9336 |
| 10 | 0.2199 | 0.2311 | 0.9184 | 0.9265 | 0.9224 | 0.9337 |
| Parameter | Value |
|---|---|
| Base Model | chuuhtetnaing/myanmar-text-segmentation-model |
| Total Epochs | 10 |
| Total Steps | 650 |
| Best F1 | 0.9224 |
from transformers import pipeline
pos = pipeline("token-classification", model="chuuhtetnaing/myanmar-pos-model", grouped_entities=True)
segments = pos("ááźááşááŹáááŻááşááśáááşáĄáážáąáˇááąáŹááşáĄáŹáážáá˝ááşáááşáážááááşá")
result = []
for segment in segments:
pos_tag = segment['entity_group']
word = segment['word']
result.append(word + "/" + pos_tag)
result = " ".join(result)
print(result)
# ááźááşááŹáááŻááşááś/n áááş/ppm áĄáážáąáˇááąáŹááş/n áĄáŹááž/n áá˝ááş/ppm áááş/v áážááááşá/part
Trained on chuuhtetnaing/myanmar-pos-dataset dataset.
| POS Tag | Description | Examples |
|---|---|---|
| abb | Abbreviation | áĄáá (Basic Education High School), á.á (Confidentiality) |
| adj | Adjective | áá˛áááˇáş (brave), áážá (beautiful), áá˝ááşááźááş (noble) |
| adv | Adverb | ááźáąá¸ááźáąá¸ (slow), áááşá¸áááşá¸ (less) |
| conj | Conjunction | áážááˇáş (and), áááŻáˇááźáąáŹááˇáş (therefore), áááŻáˇáááŻááş (or) |
| fw | Foreign Word | 1, 2, 3, Myanmar, BBC, Google, ăăŁăłăăź, çź ç¸ |
| int | Interjection | áĄáááąá¸ (Oh My God!) |
| n | Noun | ááťáąáŹááşá¸ (school), á áŹáĄáŻááş (book), ááąáŤáşáĄáąáŹááşáááşá¸á áŻááźááş, áá˝ááşáááşááąá¸ (freedom) |
| num | Number | á (1), á (2), á (3), áá (10), ááá (100) |
| part | Particle | ááťáŹá¸, áá˛áˇ, áááˇáş, ááááˇáş, áááŻááş |
| ppm | Post-positional Marker | áááş, á, áááŻ, áĄáŹá¸, áááŻáˇ, áážáŹ, áá˝ááş |
| pron | Pronoun | ááťá˝ááşááąáŹáş (I), ááťá˝ááşá (I), áááş (you), áá° (he), áá°á (she) |
| punc | Punctuation | á, á, (, ), , _, ', " |
| sb | Symbol | ?, #, &, %, $, ÂŁ, ÂĽ, đ, Ď, á, +, Ă, @ |
| tn | Text Number | áá áş (one), áážá áş (two), ááŻáśá¸ (three), áá áşááŹ, áá áşááąáŹááş |
| v | Verb | áá°áᎠ(help), áááŻááşáᏠ(observe), áĄáŹá¸ááąá¸ (encourage) |
Base model
FacebookAI/xlm-roberta-base