Dedupe rows in a table
Remove duplicate rows from a table based on criteria that you supply. Choose how many duplicates to keep or merge duplicates.
Removing duplicate data is a common data cleaning task, but it can be time consuming if you need to do it many times. Most data sets will have some sort of repetition, and having a quick way to remove it is important. In Excel you could use the UNIQUE function, but there is not much granular control with it.
Using the Dedupe Object, you can automatically remove duplicate rows based on the criteria that you provide. Furthermore, you can choose how many duplicates to keep, and you can choose to merge specific values from the duplicate rows into the cells that are left behind.