How to Delete Duplicates in an Excel Column (And What to Watch Out For)
Duplicate data is one of the most common problems in spreadsheets. Whether you're cleaning up a customer list, consolidating survey responses, or reconciling inventory records, knowing how to find and remove duplicate values in an Excel column is a core skill. Excel gives you several ways to do this — and which approach works best depends on factors like what you want to keep, whether order matters, and whether you're working with a single column or comparing across multiple ones.
What "Duplicate" Actually Means in Excel
Before removing anything, it helps to be precise. A duplicate in Excel is typically a cell value that appears more than once in a range. But "duplicate" can mean different things depending on context:
- Exact duplicates — same text, same case, same spacing
- Near-duplicates — same value but different capitalization, trailing spaces, or formatting
- Row-level duplicates — an entire row is repeated, not just one cell
Excel's built-in tools generally work on exact matches. If your data has inconsistent spacing or mixed case (e.g., "New York" vs "new york"), you may need to clean the data first using TRIM() and LOWER() before deduplication gives reliable results.
Method 1: Remove Duplicates (Built-In Tool)
The fastest route is Excel's native Remove Duplicates feature.
- Click any cell inside your data range or select the column directly
- Go to the Data tab on the ribbon
- Click Remove Duplicates
- In the dialog box, check which columns to evaluate — for a single column, leave only that column checked
- Click OK
Excel will delete all but the first occurrence of each duplicate value and display a summary of how many values were removed and how many unique values remain.
⚠️ This operation is permanent. It modifies your data in place. Always work on a copy, or use Ctrl+Z immediately if the result isn't what you expected.
Best for: Quick cleanup of a standalone list where row order doesn't matter and you just want unique values.
Method 2: Highlight Duplicates First (Conditional Formatting)
If you want to review duplicates before deleting them, use Conditional Formatting to flag them visually.
- Select the column
- Go to Home → Conditional Formatting → Highlight Cell Rules → Duplicate Values
- Choose a highlight color and click OK
All duplicate values will be color-coded. You can then manually review, sort by color, or filter and delete them on your terms.
Best for: Datasets where you need to decide which duplicate to keep — not just the first one.
Method 3: Use a Formula to Extract Unique Values
If you need to keep your original data intact and output a clean list elsewhere, formulas are the right tool.
In Excel 365 and Excel 2021:
The UNIQUE() function spills a deduplicated list into adjacent cells automatically. It's dynamic — if your source data changes, the output updates too.
In older versions of Excel (pre-365):
You'll need a more complex approach, such as using Advanced Filter (Data → Advanced → Copy to another location → Unique records only). This extracts unique values to a new range without modifying the original.
| Method | Modifies Original Data | Works in Excel 2016/2019 | Dynamic/Auto-Updates |
|---|---|---|---|
| Remove Duplicates | ✅ Yes | ✅ Yes | ❌ No |
| Conditional Formatting | ❌ No | ✅ Yes | ❌ No |
| UNIQUE() Formula | ❌ No | ❌ No (365/2021 only) | ✅ Yes |
| Advanced Filter | ❌ No | ✅ Yes | ❌ No |
Method 4: Power Query for Larger or Recurring Datasets
For bigger files or workflows you run repeatedly, Power Query offers a more robust deduplication process.
- Select your data and go to Data → From Table/Range
- In the Power Query editor, right-click the column header
- Select Remove Duplicates
- Click Close & Load to output the cleaned data
Power Query keeps your source data untouched and lets you refresh the output any time the source changes. It also handles multi-column duplicate logic more flexibly than the basic Remove Duplicates tool.
Best for: 🔄 Recurring data cleaning tasks, large datasets, or situations where you're combining data from multiple sources.
Variables That Affect Which Method You Should Use
The "right" method isn't universal — it shifts depending on your situation:
- Excel version — UNIQUE() is only available in Microsoft 365 and Excel 2021. Older versions require workarounds.
- Whether you need to preserve source data — Remove Duplicates is destructive; formulas and Power Query are not.
- Single column vs. multi-column logic — Removing duplicates based on one column while keeping row data intact is different from deduplicating a standalone list.
- Data consistency — Inconsistent formatting (extra spaces, mixed case) can cause Excel to treat identical values as different. Cleaning data first changes results significantly.
- Volume of data — Formulas can slow down on very large datasets; Power Query scales better.
- How often you run this process — A one-time cleanup favors Remove Duplicates; a monthly process favors Power Query.
A Note on What Gets Deleted
When Excel removes duplicates, it keeps the first occurrence of each value by default. This matters if your rows contain additional data — dates, IDs, amounts — because the wrong row might be retained if you don't sort first.
If keeping the most recent record matters, sort your data by date (descending) before running Remove Duplicates, so the newest entry appears first and is the one preserved.
How much this matters depends entirely on what your data represents and what you're going to do with it afterward — and that's something only you can evaluate for your specific dataset.