- ✨ Add fullwidth punctuation to support CJK 23
- 📦 Ignore command line dependencies from go vendoring
- 🐛 Sentence tokenizer would incorrectly parse a spaced ellipsis ". . ." as multiple sentences 16
- 🐛 Fixed regression that caused text that didn't end in punctuation to get cropped 75af2bb
- 🐛 Fixed issue where the WordTokenizer would crop off the last word 15
- Word Tokenizer: iterate over string by runes in word tokenizer
- Use gopkg.in instead of github package for the english package
- Added a few more tests
- Caching all regular expression compilations for performance optimizations
- Updated documentation to satisfy
go lint - A+ score on goreportcard: https://goreportcard.com/report/github.com/neurosnap/sentences
- Initial release