The way DST and SDS "update" data is very prone to problems for us

[lwjohnst86]

When DST updates data we already have in the server, especially the external from SDS, it doesn't always provide another dataset that is literally an update of the existing. But rather, some times it seems to be completely different and I'm not completely sure how to easily/quickly resolve this issue for all the databases. I could do a join/remove duplicates, and save to the cleaned databases. But that might take some computational time... and some coding time to get right...