Remove duplicates
Hi there,
Just want to check with you smart people what is the best way to remove duplicates from a list. Basically I am having a problem that some data is duplicating when coming to aperture from the Azure Data Lake and while we resolve this issue I wanted to create a function to deal with this duplicates so I can do the duplicate step and run the daily automation normally.
TIA
Mariana
0
Comments
-
This article covers some different dedupe options. In this case it sounds like there are duplicate rows of data that are identical in which case Grouping it will be simplest:
0
