Skip to content

Commit 60d970c

Browse files
committedJul 30, 2020
add tokenization image
1 parent 5ed70a1 commit 60d970c

File tree

2 files changed

+4
-0
lines changed

2 files changed

+4
-0
lines changed
 

‎README.md

+4
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,10 @@ tokenizer.process_data('samples/data.txt', clean = True, segment = True, normali
2626
```
2727

2828
### Tokenization
29+
<p align="center">
30+
<img src = "logo_tokenizers.png" width = "200px"/>
31+
</p>
32+
2933
```python
3034
import tkseem as tk
3135
tokenizer = tk.WordTokenizer()

‎logo_tokenizers.png

14.8 KB
Loading

0 commit comments

Comments
 (0)