Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Integrate code from April to November 2023 (#38)
* improve test coverage * update aiohttp * improve online translator * upload current work on french and english translators * upload current work on french and english translators * fix test * fine tune nllb helper even further * add some more jobs, fix some bugs in nllb translation * transform api.translation.v2.function.definition into separate modules grouped by method * fix unit tests following refactoring * add rabbitmq workers * add rabbitmq async_put to read_write cache layer * fix nonetype errors * rm unused script * upload current work * put rabbitmq in api * fix rabbbitmq lib * fix remove_enrichment_artefacts, improve irc bot to use rabbitmq * refactor translation_v2 to externalise publisher part, add rabbitmq.py lib * fix: prefix in translator, fix producer * adjust consumers and producer, init webconsumer * initialise inside separate thread, handle channel closed errors * apply some fixes on rmq workers and producers * fix requirements for python 3.10 * fix config by adding new keys * add postprocessor to accept from a given source wiki * fix: source wiki is in first element * fix: minor fixes and enhancements on rmq functions * fix: add classical syriac language label * do not call same function twice if the arguments are the same * add json to allow build_language_statistics to run * also filter ou the {{l}}-labelled lists * fix: enwikt entry processor: skip language section if a language code was not found * save changes on old laptop * fix: duplicated files by error * fix: add ability to set queue in webconsumer * fix: light fixes * fix: temp_triage_2 -> translated * fix: add haproxy config * fix: use haproxy as load balancer * fix: add postgrest in /bin * fix: conf -> ini * fix: rearrange install/test script to add the installation of haproxy and supervisor * bugfix: bug on definition found by unit test, let's see if it's actually genuine * fix: change supervisor "root" placeholder to "user" * add ctranslator in docker containers * add rabbitmq entry translator * rearrange supervisor script * add jenkins * add nllb backend override * fix conf to add a user jenkins instance * add 1 more entry translator worker * copy postgrest * supervisor: add container + tweak autostart options * Revert "add nllb backend override" This reverts commit 6693736. * solve conflicts * rm old parameters * invert condition * invert condition: do so as sudo * reload supervisor without -y * fix: renderer tests were not run * fix: more unit tests on section delete * fix: disable debug at this time, use 'edit' queue for create_page_from_list.py * fix: filter output for nllb translation bugs * feat: translate individual words * fix: do not translate if word already in malagasy * fix: use whiteilst for translation * fix: wrong variable * fix: re-enable one-word translations * fix: strip whitespaces for whitelist checks * build(deps): bump redis from 3.5.3 to 4.4.4 Bumps [redis](https://github.com/redis/redis-py) from 3.5.3 to 4.4.4. - [Release notes](https://github.com/redis/redis-py/releases) - [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES) - [Commits](redis/redis-py@3.5.3...v4.4.4) --- updated-dependencies: - dependency-name: redis dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> * Publish developments from April-July 2023 (#34) * improve test coverage * update aiohttp * improve online translator * upload current work on french and english translators * upload current work on french and english translators * fix test * fine tune nllb helper even further * add some more jobs, fix some bugs in nllb translation * transform api.translation.v2.function.definition into separate modules grouped by method * fix unit tests following refactoring * add rabbitmq workers * add rabbitmq async_put to read_write cache layer * fix nonetype errors * rm unused script * upload current work * put rabbitmq in api * fix rabbbitmq lib * fix remove_enrichment_artefacts, improve irc bot to use rabbitmq * refactor translation_v2 to externalise publisher part, add rabbitmq.py lib * fix: prefix in translator, fix producer * adjust consumers and producer, init webconsumer * initialise inside separate thread, handle channel closed errors * apply some fixes on rmq workers and producers * fix requirements for python 3.10 * fix config by adding new keys * add postprocessor to accept from a given source wiki * fix: source wiki is in first element * fix: minor fixes and enhancements on rmq functions * fix: add classical syriac language label * do not call same function twice if the arguments are the same * add json to allow build_language_statistics to run * manala ny anaran'ny mpiasa-miasa wiki (: --------- Co-authored-by: Rado Andrianjanahary <> Co-authored-by: Rado <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: Rado Andrianjanahary <> Co-authored-by: Rado <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
- Loading branch information