How to find the duplicate records ?? | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson

How to find the duplicate records ??

I have input file like csv or ext file. I need to find out & eliminate the duplicate records

27th Mar 2017, 12:37 PM
Akwin Lopez
Akwin Lopez - avatar
1 Answer
+ 9
There can be various approaches to that. You can parse the data and save it to a dictionary, where the possibly duplicated entry is the key (thus avoiding duplication automatically). You can read it into a list and make it a set, disposing of duplicates, too. It depends on the structure of the data to process, mostly.
27th Mar 2017, 2:46 PM
Kuba Siekierzyński
Kuba Siekierzyński - avatar