Advanced Duplicate Detection

[luccalb]

User Story

1. As a RTDIP user
2. I want to detect duplicate data points for different kinds of data
3. So that I can achieve a high data quality

Additional context

Acceptance Criteria

• The existing duplicate detection component should be extended
• It should now accept a list of columns in a dataframe that serve as primary key
• The duplicate detection should then make sure that no primary key appears twice in the data

Definition of Done

• Test cases have been created and are running successfully
• Documentation for the new component was added
• Github Actions are running without errors