Removing duplicates from a CSV file ( NOT unique values )

Ask your PowerShell-related questions, including questions on cmdlet development!
Forum rules
Do not post any licensing information in this forum.

Any code longer than three lines should be added as code using the 'Select Code' dropdown menu or attached as a file.
Locked
User avatar
JohnTitor
Posts: 153
Last visit: Wed Jul 31, 2019 7:05 am

Removing duplicates from a CSV file ( NOT unique values )

Post by JohnTitor »

I have a spreadsheet for lockouts. This lists mac addresses and a few other things

On the macaddress columns, it lists the MACs for their PC, phone, tablet, etc...
Sometimes this CSV file list the same mac addresses multiple times because the phone pings our wireless in attempt to reconnect and their PCs have stored managed credentials

What I'm looking for is the powershell way in excel for Remove Duplicates

When I choose -unique, well it gives me just one :D
Top
jvierra
Posts: 14704
Last visit: Sat Feb 27, 2021 5:46 am
Answers: 8
Has voted: 2 times
Been upvoted: 6 times

Re: Removing duplicates from a CSV file ( NOT unique values )

Post by jvierra »

Excel has a deduplicating method built in. Just select what you want to dedupe and click the button.

In a CSV (a csv is not an Excel workbook it can just be viewed as such) you can use "Group-Object" to dedupe a Csv,

help group-object -online
Top
User avatar
JohnTitor
Posts: 153
Last visit: Wed Jul 31, 2019 7:05 am

Re: Removing duplicates from a CSV file ( NOT unique values )

Post by JohnTitor »

Hmm, that didn't really do what I was hoping, but I found a work around.. Thanks so much!
Top
Locked

Return to “PowerShell”