farasa segmentation #174
-
|
Hi, Based on your experience, which model is better for Named entity recognition and why: a BERT model with or without farasa segmentation. Does segmentation affect sequence labeling tasks? Many thanks |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
for NER i would go for a BERT without segmentation. in our paper we experimented with both, and found out that segmentation was hurting performance. We guessed that it is caused by the label being put on the "ال" (or other prefixes) at the beginning of most words. |
Beta Was this translation helpful? Give feedback.
-
|
Ok. Thank u very much for ur answer |
Beta Was this translation helpful? Give feedback.
for NER i would go for a BERT without segmentation.
in our paper we experimented with both, and found out that segmentation was hurting performance. We guessed that it is caused by the label being put on the "ال" (or other prefixes) at the beginning of most words.