feat: [DHIS2-18310] enable non-Gregorian calendars in views & lists & forms #3900

alaa-yahia · 2024-12-05T00:21:30Z

Implements DHIS2-18310 & DHIS2-18311 & DHIS2-18309 & DHIS2-18868

Modified clientToList, clientToForm and clientToView converters to handle local format conversions (DHIS2-18310)
Modified FormToClient converter to handle ISO format (DHIS2-18309)
Ensure that all “Last updated” calculations are working when local calendar is used
Ensure all date pickers (form and working list) are using local calendar.
Enable non-Gregorian calendars in working list filters DHIS2-18311
Fix search for a trackedEntity by a DATETIME & AGE attributes DHIS2-18868

package.json

src/core_modules/capture-core/components/FiltersForTypes/Date/DateFilter.component.js

simonadomnisoru · 2024-12-12T16:15:43Z

Hi @alaa-yahia,
I noticed two issues with the Age field:

When selecting a date from the calendar, the year, months, and days are filled with incorrect values. (i.e. In the video below, I selected today's date from the Ethiopian calendar, so the year, months, and day should have been filled with 0).
When typing a value into the days field, the calendar is filled with the gregorian value of the date.

Screen.Recording.2024-12-12.at.16.51.40.mov

In the video above I used the Ethiopian calendar. Can you have a look? Thank you!

JoakimSM

A good start, but some things we will have to work a bit more on.

In addition to the individual comments we should convert the "last updated" tooltips from ISO to local calendar (I saw this in both the stages and events Widget and the enrollment Widget). Had a very quick look at the stages and events Widget and for now I think you can use something like moment(fromServerDate(updatedAt)).toISOString() and put the result into the clientToView converter of type DATETIME (we should probably also use the serverToClient converter, but this will be checked and resolved in separate ticket)

src/core_modules/capture-core/components/FiltersForTypes/Date/DateFilter.component.js

src/core_modules/capture-core/converters/clientToView.js

src/core_modules/capture-core/converters/formToClient.js

src/core_modules/capture-core/components/D2Form/field/configs/dateField/getDateFieldConfig.js

src/core_modules/capture-ui/AgeField/AgeField.component.js

…ent date (#3905) feat: typing the date when editing enrollment and incident date

JoakimSM

In addition to other comments:

We should fix the logic in getDateRangeValidator and getDateTimeRangeValidator. These validators are being used in the search form when using tracked entity attributes of value type date and dateTime. We should replace the parseDate logic and leverage the validation done in the ui library component.
Don't use parseDate on local dates. I think this means that we should remove parseDate from the codebase in its entirety (I didn't see any valid reason to use it anymore, but let me know if I missed something)

src/core_modules/capture-ui/AgeField/AgeField.component.js

src/core_modules/capture-core/utils/converters/date/convertLocalToIsoCalendar.js

src/core_modules/capture-core/converters/formToClient.js

JoakimSM · 2025-01-08T10:16:59Z

src/core_modules/capture-ui/AgeField/AgeField.component.js

-    const parseData = dateValue && onParseDate(dateValue);
+
+function getCalculatedValues(dateValue: ?string): AgeValues {
+    const parseData = dateValue && parseDate(dateValue);


We can't use the parseDate function as is because it is using moment internally (and we are passing in a date from a local calendar type). Let's use the following approach here:

In handleDateBlur in this file, let's make sure we check the validation that is passed in from the component and only invoke getCalculatedVaules if the date is valid (currently, the app crashing sometimes with invalid dates). The validation executed in the component is the source of truth for whether the date is valid or not.

Don't use parseDate here. After point .1, the value passed in to getCalculatedValues should always be valid and you should be able to use convertStringToTemporal directly.

In general, we should replace parseDate in our codebase if it is being used on dates of local calendar types.

simonadomnisoru

Hi @alaa-yahia, I found a few bugs that I hope you can look into. I tested with the Ethiopian and Nepalese calendars. Thank you!

src/core_modules/capture-ui/AgeField/AgeField.component.js

...-core/components/WidgetStagesAndEvents/Stages/Stage/StageOverview/StageOverview.component.js

simonadomnisoru · 2025-01-14T09:28:32Z

src/core_modules/capture-core/converters/clientToList.js

@@ -5,21 +5,20 @@ import i18n from '@dhis2/d2-i18n';
 import { Tag } from '@dhis2/ui';
 import { PreviewImage } from 'capture-ui';
 import { dataElementTypes, type DataElement } from '../metaData';
-import { convertMomentToDateFormatString } from '../utils/converters/date';
+import { convertIsoToLocalCalendar } from '../utils/converters/date';
 import { stringifyNumber } from './common/stringifyNumber';
 import { MinimalCoordinates } from '../components/MinimalCoordinates';
 import { TooltipOrgUnit } from '../components/Tooltips/TooltipOrgUnit';

 function convertDateForListDisplay(rawValue: string): string {


On the search page, the currentSearchTerms are not converted correctly. I think the problem arises when using the clientToList converter in the SearchResultsHeader.component. In the screenshot bellow, the label Birth date: 05-05-2017 -> 07-05-2017 should be displayed.

DATE the issue is fixed now ✅

DATETIME I was unable to test because the search does not work for this attribute type. I created a separate bug ticket because this issue is occurring on master DHIS2-18868.

AGE the currentSearchTerms are not being converted correctly. Could you have a look at it?

@JoakimSM @simonadomnisoru Both AGE and DATETIME searches don't work in master. I can add a converter for AGE that returns the same value passed (as it is getting the local value instead of the ISO one), but it doesn't seem right. Also, DATE is receiving the client value, its converter is being used in working list filters, while DATE_RANGE is receiving the local value.

src/core_modules/capture-core/components/WidgetEnrollment/Date/Date.component.js

…lendar

…non-gregorian-calendars-in-views-and-lists

alaa-yahia · 2025-01-16T01:49:07Z

@simonadomnisoru I've pushed bug fixes addressing your feedbacks. Could you take another look when you have a time?
Thank you

src/core_modules/capture-core/components/WidgetEnrollment/WidgetEnrollment.component.js

simonadomnisoru · 2025-01-20T11:25:25Z

src/core_modules/capture-core/converters/clientToList.js

@@ -5,21 +5,20 @@ import i18n from '@dhis2/d2-i18n';
 import { Tag } from '@dhis2/ui';
 import { PreviewImage } from 'capture-ui';
 import { dataElementTypes, type DataElement } from '../metaData';
-import { convertMomentToDateFormatString } from '../utils/converters/date';
+import { convertIsoToLocalCalendar } from '../utils/converters/date';
 import { stringifyNumber } from './common/stringifyNumber';
 import { MinimalCoordinates } from '../components/MinimalCoordinates';
 import { TooltipOrgUnit } from '../components/Tooltips/TooltipOrgUnit';

 function convertDateForListDisplay(rawValue: string): string {


DATE the issue is fixed now ✅

DATETIME I was unable to test because the search does not work for this attribute type. I created a separate bug ticket because this issue is occurring on master DHIS2-18868.

AGE the currentSearchTerms are not being converted correctly. Could you have a look at it?

sonarqubecloud · 2025-01-31T15:00:22Z

Quality Gate failed

Failed conditions
10 New issues
10 New Code Smells (required ≤ 0)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

alaa-yahia requested a review from a team as a code owner December 5, 2024 00:21

alaa-yahia force-pushed the DHIS2-18310-enable-non-gregorian-calendars-in-views-and-lists branch from 8983fd7 to 0294f8d Compare December 5, 2024 11:00

simonadomnisoru reviewed Dec 10, 2024

View reviewed changes

JoakimSM reviewed Dec 18, 2024

View reviewed changes

alaa-yahia requested review from JoakimSM and simonadomnisoru December 23, 2024 08:34

alaa-yahia and others added 16 commits January 6, 2025 12:37

feat: enable non gregorian calendars in views and lists

136430d

fix: working list filters to use gregorian

b8fd941

fix: working list filter runtime error when dd-mm-yyyy format is passed

e378551

fix: missing rules engine in dependencies

8e44c3c

fix: working list filter not displaying local date

1f2518d

fix: reduce the complexity of getUpdatedValue

9a3d609

chore: refactor working lists filter component

3a3d0b2

fix: convert age values to local date

53ef00e

feat: [DHIS2 15466] typing the date when editing enrollment and incid…

1d3faa6

…ent date (#3905) feat: typing the date when editing enrollment and incident date

fix: age values not filled correctly

7968ea7

fix: keep local calendar date in state in working list filters

e8d226f

fix: rename calendarMaxMoment to calendarMax

8ce68dd

fix: remove formating lines

b0dc55c

fix: day value not giving correct result in age field

2cc70be

fix: flow errors

383c66f

fix: display local time in tooltips

013db2c

alaa-yahia force-pushed the DHIS2-18310-enable-non-gregorian-calendars-in-views-and-lists branch from da9bf63 to 013db2c Compare January 6, 2025 11:22

fix: date is not valid error not displayed

8dd1110

JoakimSM reviewed Jan 8, 2025

View reviewed changes

alaa-yahia added 4 commits January 9, 2025 13:42

fix: remove app specific objects

209860c

refactor: simplify converters logic

c8d1fbd

fix: logic of dateRange & dateTimeRange validators

9805435

chore: pass format and calendar as props

d67810b

simonadomnisoru reviewed Jan 14, 2025

View reviewed changes

alaa-yahia added 5 commits January 16, 2025 01:36

fix: status label in the StagesAndEvents widget display ISO date

068c3ef

fix: currentSearchTerms are not converted correctly

cda3dab

fix: enrollment and incident date display in iso

217dc25

fix: runtime error when selecting a date in age field in ethiopian ca…

d05011a

…lendar

Merge remote-tracking branch 'origin/master' into DHIS2-18310-enable-…

78a2af8

…non-gregorian-calendars-in-views-and-lists

simonadomnisoru reviewed Jan 20, 2025

View reviewed changes

alaa-yahia added 9 commits January 22, 2025 15:22

fix: use localDate in chip component

fbdfe20

fix: revert to iso date calculations when calendar isn't supported

4ceacde

fix: age calculations

79102e2

fix: age and dateTimeRange searchterms

3493da4

fix: invalidDate in event notes

79f3368

fix: dateTime search query

8aee1e6

fix: dateRange validator

ea0aca4

chore: remove convertStringToDateFormat function

47ebd75

fix: dateTimeRange validator to recieve internalError

76af22d

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: [DHIS2-18310] enable non-Gregorian calendars in views & lists & forms #3900

feat: [DHIS2-18310] enable non-Gregorian calendars in views & lists & forms #3900

alaa-yahia commented Dec 5, 2024 •

edited by jira bot

Loading

simonadomnisoru commented Dec 12, 2024

JoakimSM left a comment

JoakimSM left a comment

JoakimSM Jan 8, 2025

simonadomnisoru left a comment

simonadomnisoru Jan 14, 2025

simonadomnisoru Jan 20, 2025

alaa-yahia Jan 22, 2025 •

edited

Loading

alaa-yahia commented Jan 16, 2025

simonadomnisoru Jan 20, 2025

sonarqubecloud bot commented Jan 31, 2025

feat: [DHIS2-18310] enable non-Gregorian calendars in views & lists & forms #3900

Are you sure you want to change the base?

feat: [DHIS2-18310] enable non-Gregorian calendars in views & lists & forms #3900

Conversation

alaa-yahia commented Dec 5, 2024 • edited by jira bot Loading

simonadomnisoru commented Dec 12, 2024

JoakimSM left a comment

Choose a reason for hiding this comment

JoakimSM left a comment

Choose a reason for hiding this comment

JoakimSM Jan 8, 2025

Choose a reason for hiding this comment

simonadomnisoru left a comment

Choose a reason for hiding this comment

simonadomnisoru Jan 14, 2025

Choose a reason for hiding this comment

simonadomnisoru Jan 20, 2025

Choose a reason for hiding this comment

alaa-yahia Jan 22, 2025 • edited Loading

Choose a reason for hiding this comment

alaa-yahia commented Jan 16, 2025

simonadomnisoru Jan 20, 2025

Choose a reason for hiding this comment

sonarqubecloud bot commented Jan 31, 2025

Quality Gate failed

alaa-yahia commented Dec 5, 2024 •

edited by jira bot

Loading

alaa-yahia Jan 22, 2025 •

edited

Loading