Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parsing the French Wiktionary #223

Closed
wants to merge 15 commits into from
Closed

Parsing the French Wiktionary #223

Show file tree
Hide file tree
Changes from 9 commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
cadf5b4
change langcode for Toki pona to 'tok'
empiriker Mar 23, 2023
e8ef0ee
add linkage_subtitles, other_subtitles and pos_subtitles for French
empiriker Mar 23, 2023
98560ae
add French words and check for French form descriptions
empiriker Mar 23, 2023
dde4806
add basic support for parsing the French Wiktionary project
empiriker Mar 23, 2023
3c58a1a
add zh_pron_tags to French data for dependency reasons
empiriker Mar 23, 2023
96c6560
Merge branch 'master' of https://github.com/empiriker/wiktextract
empiriker Mar 23, 2023
43d9fbb
extract source from template 'exemple'
empiriker Mar 23, 2023
b31df12
remove print statement
empiriker Mar 23, 2023
d1642c7
move French logic for extract_examples to separate function, extract …
empiriker Mar 24, 2023
0368147
remove French logic from (not used downstream)
empiriker Mar 27, 2023
ac62df0
extract categorical tags before parsing glosses and examples
empiriker Mar 27, 2023
f00ef13
replace zh_pron_tags with empty dictionary
empiriker Mar 27, 2023
f43109e
allow additional spaces in header regex
empiriker Mar 28, 2023
dc48227
add extensive list for categorical and tag templates
empiriker Mar 29, 2023
ce0a311
move notes in glosses to 'note' field; deal with missing gloss templa…
empiriker Apr 6, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
426,531 changes: 426,531 additions & 0 deletions wiktextract/data/fr/french_words.txt
View file
Open in desktop

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion wiktextract/data/fr/language_names_to_codes.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5407,7 +5407,7 @@
"Tokelauien": "tkl",
"Tokharien A": "xto",
"Tokharien B": "txb",
"Toki pona": "tokipona",
"Toki pona": "tok",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is not used and can be deleted.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for pointing this out. I deleted the file.

"Tolaki": "lbw",
"Tolomako": "tlm",
"Tolowa": "tol",
Expand Down
3 changes: 3 additions & 0 deletions wiktextract/data/fr/languages.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15872,6 +15872,9 @@
"tokipona": [
"Toki pona"
],
"tok": [
"Toki pona"
],
"tol": [
"Tolowa"
],
Expand Down
13 changes: 13 additions & 0 deletions wiktextract/data/fr/linkage_subtitles.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
{
"synonymes": "synonyms",
"quasi-synonymes": "synonyms",
"hyperonymes": "hypernyms",
"hyponymes": "hyponyms",
"holonymes": "holonyms",
"meronymes": "meronyms",
"troponymes": "troponyms",
"antonymes": "antonyms",
"voir": "related",
"dérivés": "derived",
"abréviations": "abbreviations"
}
9 changes: 9 additions & 0 deletions wiktextract/data/fr/other_subtitles.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
{
"compounds": "composé",
"etymology": ["étymologie"],
"translations": "traductions",
"ignored_sections": ["racine", "voir aussi"],
"inflection_sections": ["conjugaison"],
"pronunciation": ["prononciation"],
"sense": "mot lui-même"
}
Loading