Skip to content

computationalstylistics/tidystopwords

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

tidystopwords: R package for multilingual stopwords

Authors: Silvie Cinková*, Maciej Eder
License: GPL-3

An R package containing customizable lists of stopwords in multiple languages; it attempts to follow tidy data principles.

The idea behind this package is to provide stopwords for less-resourced languages as well as give the user control over the stopword selection with respect to parts of speech. For the purposes of this package, stopwords are defined as forms of function words from closed parts of speech (e.g. prepositions, conjunctions, auxiliary verbs, and pronouns). The core generate_stoplist() function relies on multilingual_stopwords(), a large data frame derived from the current release of the Universal Dependencies Treebanks. We have included all languages. The data comes encoded in UTF-8. The vocabulary coverage for each language depends on the size, textual diversity, and annotation quality of the available treebanks. No manual post-editing was performed.

Installation

Install the package directly from the GitHub repository:

library(devtools)
install_github("computationalstylistics/stopwoRds", build_vignettes = TRUE)

About

Customizable lists of stopwords in multiple languages

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages