Enhancing the Turkish stop word list with additional common words

[HakanBayazitHabes]

Description

This pull request proposes the addition of several frequently used Turkish stopwords to the stopwords.txt file. These words are commonly considered non-informative in NLP tasks and are consistent with standard Turkish stopword sets.

• Words like şu, şöyle, şayet, and öz were added

• Alphabetically sorted for consistency

• Based on analysis of multiple Turkish NLP resources

This enhancement improves coverage and ensures better compatibility with text processing tasks involving Turkish.

[stefanvodita]

I think we need to know more around how the list came about and we need some evidence that the new list is better. I'm also unable to tell if the new words are reasonably considered stop words, but maybe a Turkish speaker could weigh in.

[stefanvodita]

We should have something similar specifying how we sourced the list.

[bahadirborasahin]

@stefanvodita

I think we need to know more around how the list came about and we need some evidence that the new list is better. I'm also unable to tell if the new words are reasonably considered stop words, but maybe a Turkish speaker could weigh in.

I had concerns earlier about malformed entries like keţke or onlarýn yet they seem to be fixed in this revision. The suggested words make sense in Turkish (as a stopword), however, I find chance of occurrence of some of them very low if that matters, cuppadak, cumburlok, cumbadak?

@HakanBayazitHabes

Based analysis of multiple Turkish NLP resources

Can we give references to those studies? I am specifically wondering whether we should add all kinds of adverbs/zarf as stopwords as they can potentially provide context? (for example doğru/accurate/true/factual)