Implement I18n for scholia

[curibe]

Description

In this PR, i18n will be implemented for all HTML files for header tags. This PR requires several steps:

1. Set the language as a cookie
2. Find all tags (h1,h2,h3,h4,h5) that have id and insert the attribute data-i18n in all of it, for using the jQuery.i18n API
3. Create a JSON file following the banana format. This JSON must contain all data-i18n attributes for every language
4. Insert the selected language (and the [AUTO_LANGUAGE]) for every SPARQL file that require it
5. Insert the selected language({{ g.lang_code }}) for every SPARQL file that contain the sentence FILTER (LANG(...

Testing

• STEP4: Command to validate if there are SPARQL files without {{ g.lang_code }} in sentence ....FILTER ( LANG(?xxxxxx)= ...

   grep  -r -n -E --include="*.sparql" -E "wikibase:language" . --color=always | sort | grep -v "{{ g.lang_code }},\[AUTO_LANGUAGE\],en"

• STEP5: Command to validate if there are SPARQL files without {{ g.lang_code }} in sentence ....FILTER ( LANG(?xxxxxx)= ...

   (grep  -r -i -n  --include="*.sparql" -E "FILTER[[:space:]]*\((LANG)" . --color=always | grep -v -E "g.lang_code") < $(ls scholia/app/templates/*.sparql)

Checklist

These steps will be implemented for all files, filtering it by different aspects.

✔️ 👁️‍🗨️ STEP 1: SET LANGUAGE AS COOKIE
Create a cookie and select the language using a dropdown menu. The cookie is settled as a query string.

✔️ STEP 2: HTML files
Aspects to consider to inserting data-i18n in h1,h2,h3,h4 and h5 headers for every HTML respective file

Click here to expand to see all files

• 404
• about
• arxiv_to_quickstatements
• author
• authors
• award
• ❌ base (Not contain headers)
• catalogue
• chemical
• cito
• clinical
• complex
• countries
• country
• dataset
• disease
• event
• ❌ faq (Not contain headers)
• gene
• index
• lexeme
• location
• organization
• organizations
• pathway
• printer
• project
• property
• protein
• publisher
• search
• series
• software
• sponsor
• taxon
• text
• ❌ tools (Not contain headers)
• topic
• topics
• use
• venue
• venues
• work
• works

✔️ 👁️‍🗨️ STEP 3: CREATE JSON
A file with name template.json was created. This file contains all data-i18n attributes inside all HTML files until now. Also, there is a python script to extract all data-i18n attributes from html files and create the json file using the banana format

✔️ STEP 4: LANGUAGE INSIDE SPARQL (wikibase:language)
In SPARQL files with sentence ..bd:serviceParam wikibase:language " ...languages list... " , it will be inserted/replaced the triplet "{{ g.lang_code,[AUTO_LANGUAGE],en, ..." at the beginning of _languages_list". For example:

 SERVICE wikibase:label { bd:serviceParam wikibase:language "{{ g.lang_code }},[AUTO_LANGUAGE],en,da,de,es,fr,jp,no,ru,sv,zh". }

There are 244 files in total with this sentence. You can check it using the following commands:

# to see files and matched lines
grep  -r -n -E --include="*.sparql" -E "wikibase:language" . --color=always | sort
# to see the filenames only
grep  -r -n -E --include="*.sparql" -E "wikibase:language" . -l --color=always | sort

✔️ STEP 5: LANGUAGE INSIDE SPARQL (FILTER( LANG)
In these files, FILTER (LANG(?xxxxx) = 'en' will be replaced by FILTER (LANG(?xxxxx) = '{{ g.lang_code }}'

Click here to expand to see all files

• 1. author_events.sparql
• 2. author_list-of-publications.sparql
• 3. author_other-locations.sparql
• 4. author_pages-per-year.sparql
• 5. author_review-statistics.sparql
• 6. authors_citations-per-publication-year.sparql
• 7. authors_list-of-jointly-authored-works.sparql
• 8. authors_works-per-publication-year.sparql
• 9. author_timeline.sparql
• 10. author_venue-statistics-chart.sparql
• 11. author_venue-statistics.sparql
• 12. award_locations-of-recipients.sparql
• 13. chemical_class_recent-literature.sparql
• 14. chemical_element_recent-literature.sparql
• 15. chemical_physchem-properties.sparql
• 16. chemical_recent-literature.sparql
• 17. clinical-trial_data.sparql
• 18. complex_articles-by-year.sparql
• 19. complex_articles-recent.sparql
• 20. complex_participants.sparql
• 21. country_locations-as-topics.sparql
• 22. country_narrative-locations.sparql
• 23. dataset_list-of-authors.sparql
• 24. disease_related-diseases.sparql
• 25. event_proceedings.sparql
• 26. event_recent-publications.sparql
• 27. event_series_proceedings-publications.sparql
• 28. event_series_recent-publications.sparql
• 29. event_series_timeline.sparql
• 30. gene_variants.sparql
• 31. organization_awards.sparql
• 32. organization_page-production.sparql
• 33. organization_recent-literature.sparql
• 34. pathway_participants.sparql
• 35. pathway_recent-articles.sparql
• 36. project_recent-articles.sparql
• 37. project_timeline.sparql
• 38. protein_cofunctional-proteins.sparql
• 39. protein_similar-proteins.sparql
• 40. publisher_editor-photos.sparql
• 41. publisher_editors.sparql
• 42. publisher_journals.sparql
• 43. taxon_parent-taxa.sparql
• 44. taxon_tree.sparql
• 45. topic_author-awards.sparql
• 46. topic_earliest-published-works.sparql
• 47. topic_publications-per-year.sparql
• 48. topic_recently-published-works.sparql
• 49. topics_list-of-works.sparql
• 50. venue_cito_articles-by-intention.sparql
• 51. venue_recently-published-works.sparql
• 52. work_citation-graph.sparql
• 53. work_data.sparql
• 54. work_list-of-authors.sparql
• 55. work_timeline.sparql

PD: command to obtain the above list:

(grep  -r -i -n -l --include="*.sparql" -E "FILTER[[:space:]]*\((LANG)" . --color=always | sort | awk -F"/" 'BEGIN{FS="/"; OFS="/"} {$1="https://github.com/WDscholia/scholia/blob/master"; print " - [ ] "NR ".  [" $5 "]" "(" $0 ")" }' | less) < $(ls scholia/app/templates/*.sparql)

[Daniel-Mietchen]

I had a first look and noticed that the language selector currently only works for invocations of SERVICE but not in cases where other mechanisms are used to get labels or descriptions. This leads to odd mixtures of scripts, as shown below for
https://scholia.toolforge.org/topics/Q808,Q202864,Q8071861,Q22138769 with the language set to Russian:

Here, the entries in the "Topics" column in the second table should have Russian labels, which could be achieved by replacing the en in places like

    ?topic rdfs:label ?topic_label .
    FILTER(LANG(?topic_label) = 'en')

with {{ g.lang_code }} as well.

I see that the box for the topics aspect is not ticked in the list contained in the opening comment of this PR, though, and am wondering what those ticked or unticked boxes actually mean — I would expect all aspects to be handled consistently.

[Daniel-Mietchen]

These changes look good so far, @curibe !

[codacy-production]

Codacy has a fix for the issue: Replace ↹ with ··

Suggested change

	* See https://github.com/wikimedia/jquery.i18n/wiki/Specification#wiki-Message_File_Loading
	* See https://github.com/wikimedia/jquery.i18n/wiki/Specification#wiki-Message_File_Loading

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹↹')|(' with ······")|("

Suggested change

	')|(' +
	")|(" +

[codacy-production]

Codacy has a fix for the issue: Replace ↹$.extend(· with ··$.extend(

Suggested change

	$.extend( $.i18n.fallbacks, {
	$.extend($.i18n.fallbacks, {

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹↹↹↹operation·=·node[·0· with ··········operation·=·node[0

Suggested change

	operation = node[ 0 ].toLowerCase();
	operation = node[0].toLowerCase();

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹'bat-smg':·[·'sgs',·'lt'· with ····"bat-smg":·["sgs",·"lt"

Suggested change

	'bat-smg': [ 'sgs', 'lt' ],
	"bat-smg": ["sgs", "lt"],

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹ with ····

Suggested change

	* applying replacements and template functions when appropriate
	* applying replacements and template functions when appropriate

[codacy-production]

Codacy has a fix for the issue: Replace ↹if·(typeof·define·===·'function' with ··if·(typeof·define·===·"function"

Suggested change

	if (typeof define === 'function' && define.amd) {
	if (typeof define === "function" && define.amd) {

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹ with ····

Suggested change

	*/
	*/

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹↹↹↹ with ··········

Suggested change

	break;
	break;

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹_n_·=·makeStringParser('n' with ······_n_·=·makeStringParser("n"

Suggested change

	_n_ = makeStringParser('n'),
	_n_ = makeStringParser("n"),

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹arn:·[·'es'· with ····arn:·["es"

Suggested change

	arn: [ 'es' ],
	arn: ["es"],

[codacy-production]

Codacy has a fix for the issue: Replace ·function·(·$· with function·($

Suggested change

	( function ( $ ) {
	(function ($) {

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹ with ······

Suggested change

	value = makeRegexParser(/^\d+/),
	value = makeRegexParser(/^\d+/),

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹'de-formal':·[·'de'· with ····"de-formal":·["de"

Suggested change

	'de-formal': [ 'de' ],
	"de-formal": ["de"],

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹this.language·=·$.i18n.languages[·String.locale·]·||·$.i18n.languages[·'default'· with ····this.language·=⏎······$.i18n.languages[String.locale]·||·$.i18n.languages["default"

Suggested change

	this.language = $.i18n.languages[ String.locale ] || $.i18n.languages[ 'default' ];
	this.language =

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹bqi:·[·'fa'· with ····bqi:·["fa"

Suggested change

	bqi: [ 'fa' ],
	bqi: ["fa"],

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹ with ····

Suggested change

	define(factory);
	define(factory);

[codacy-production]

Codacy has a fix for the issue: Replace ↹ with ··

Suggested change

	* @param {Object} options
	* @param {Object} options

[codacy-production]

Codacy has a fix for the issue: Replace ↹ with ··

Suggested change

	* TODO: Does not handle BIDI control characters inside the text.
	* TODO: Does not handle BIDI control characters inside the text.

[codacy-production]

Codacy has a fix for the issue: Replace ↹↹ab:·[·'ru'· with ····ab:·["ru"

Suggested change

	ab: [ 'ru' ],
	ab: ["ru"],