-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
1. renamed existing docs to dev 2. renamed docs import to docs 3. moved dev into the docs folder
- Loading branch information
Showing
33 changed files
with
1,173 additions
and
1,173 deletions.
There are no files selected for viewing
File renamed without changes.
42 changes: 21 additions & 21 deletions
42
...and_validation/data_used_by_validation.md → ...and_validation/data_used_by_validation.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,21 +1,21 @@ | ||
# Data | ||
|
||
Data stored in EMAP that we use to validate against data store within the Trust systems. | ||
|
||
## Patient Data | ||
|
||
- MRN | ||
- NHS Number | ||
- Demographics | ||
- Date of birth | ||
- Infections banner information | ||
|
||
## Encounter Data | ||
|
||
- Arrival | ||
- Discharge | ||
- Location | ||
- Subset of Flowsheets | ||
- Subset of Lab results | ||
- Infections banner information | ||
|
||
# Data | ||
|
||
Data stored in EMAP that we use to validate against data store within the Trust systems. | ||
|
||
## Patient Data | ||
|
||
- MRN | ||
- NHS Number | ||
- Demographics | ||
- Date of birth | ||
- Infections banner information | ||
|
||
## Encounter Data | ||
|
||
- Arrival | ||
- Discharge | ||
- Location | ||
- Subset of Flowsheets | ||
- Subset of Lab results | ||
- Infections banner information | ||
|
File renamed without changes.
110 changes: 55 additions & 55 deletions
110
.../Data_and_validation/validation_issues.md → .../Data_and_validation/validation_issues.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,55 +1,55 @@ | ||
# Validation Issues | ||
|
||
These are issues we have encountered where it is not viable to match data exactly or data must be processed before it can be matched. | ||
|
||
## Letter case and whitespace | ||
|
||
At times there is a mismatch in case of text stored in the reference databases. | ||
EMAP processes HL7 messages exactly as it receives them. | ||
Data in the reference databases can be 'corrected' without an HL7 message being triggered, and thus essentially changed without EMAP being aware. | ||
|
||
There may be a mismatch on white space. | ||
For example, Clarity stores results on separate lines, whilst EMAP puts them on one line. | ||
|
||
Thus, to exactly match text it is necessary to adjust case and whitespace in the text messages. | ||
We also string replace text where necessary to get categorical variables to match, for example, sex 'I' in star maps to 'N' in caboodle. | ||
|
||
## Timestamps | ||
|
||
Using Caboodle, it is possible to edit data without the LastUpdatedTime field associated with this data being changed. | ||
This presents an immediate problem, since the actual time the data was last updated is not recorded as the LastUpdatedTime, making matching impossible. | ||
|
||
## Location information | ||
|
||
EMAP has no non-census locations, for example, there is no mortuary information. | ||
The patient appears to be staying where they were previously admitted. | ||
Caboodle leaves a gap between visits when the patient is in the mortuary. | ||
|
||
Other missing non-census locations involve trips to imaging. | ||
|
||
Some EMAP locations don’t match with caboodle ones. These don’t show up in covid_staging.locations. | ||
|
||
Caboodle leaves a gap between bed stays when a patient has a leave of absence, or is tagged as AMUBLATORY or HOTEL. | ||
|
||
Caboodle and EMAP don’t agree on a when a patient is in a chemotherapy discharge room. | ||
|
||
## Delays in HL7 messages | ||
|
||
Some HL7 messages are extremely delayed, and so don’t end up in EMAP at the time we expect. | ||
This can result in EMAP having an old MRN, while caboodle has the new one. The CSNs stay the same. | ||
|
||
--- | ||
|
||
# Validation Exceptions | ||
|
||
1. We allow a time difference of less than one hour to match. | ||
|
||
2. Exclude leave of absence, hotel, home, and ambulatory patients. | ||
|
||
3. Exclude locations which won’t join. | ||
|
||
4. Exclude non-matching vists of dead patients. | ||
|
||
5. Exclude visits which join on CSN, but not MRN (this does not apply to ops). | ||
|
||
6. Exclude just the chemotherapy visits which don’t join. | ||
# Validation Issues | ||
|
||
These are issues we have encountered where it is not viable to match data exactly or data must be processed before it can be matched. | ||
|
||
## Letter case and whitespace | ||
|
||
At times there is a mismatch in case of text stored in the reference databases. | ||
EMAP processes HL7 messages exactly as it receives them. | ||
Data in the reference databases can be 'corrected' without an HL7 message being triggered, and thus essentially changed without EMAP being aware. | ||
|
||
There may be a mismatch on white space. | ||
For example, Clarity stores results on separate lines, whilst EMAP puts them on one line. | ||
|
||
Thus, to exactly match text it is necessary to adjust case and whitespace in the text messages. | ||
We also string replace text where necessary to get categorical variables to match, for example, sex 'I' in star maps to 'N' in caboodle. | ||
|
||
## Timestamps | ||
|
||
Using Caboodle, it is possible to edit data without the LastUpdatedTime field associated with this data being changed. | ||
This presents an immediate problem, since the actual time the data was last updated is not recorded as the LastUpdatedTime, making matching impossible. | ||
|
||
## Location information | ||
|
||
EMAP has no non-census locations, for example, there is no mortuary information. | ||
The patient appears to be staying where they were previously admitted. | ||
Caboodle leaves a gap between visits when the patient is in the mortuary. | ||
|
||
Other missing non-census locations involve trips to imaging. | ||
|
||
Some EMAP locations don’t match with caboodle ones. These don’t show up in covid_staging.locations. | ||
|
||
Caboodle leaves a gap between bed stays when a patient has a leave of absence, or is tagged as AMUBLATORY or HOTEL. | ||
|
||
Caboodle and EMAP don’t agree on a when a patient is in a chemotherapy discharge room. | ||
|
||
## Delays in HL7 messages | ||
|
||
Some HL7 messages are extremely delayed, and so don’t end up in EMAP at the time we expect. | ||
This can result in EMAP having an old MRN, while caboodle has the new one. The CSNs stay the same. | ||
|
||
--- | ||
|
||
# Validation Exceptions | ||
|
||
1. We allow a time difference of less than one hour to match. | ||
|
||
2. Exclude leave of absence, hotel, home, and ambulatory patients. | ||
|
||
3. Exclude locations which won’t join. | ||
|
||
4. Exclude non-matching vists of dead patients. | ||
|
||
5. Exclude visits which join on CSN, but not MRN (this does not apply to ops). | ||
|
||
6. Exclude just the chemotherapy visits which don’t join. |
Oops, something went wrong.