w3resource

Pandas - Detecting duplicate rows in a DataFrame using duplicated()

Pandas: Data Cleaning and Preprocessing Exercise-3 with Solution

Write a Pandas program to detect duplicates using duplicated() method.

In this exercise, you will identify duplicate rows in a DataFrame using the duplicated() method.

Sample Solution :

Code :

import pandas as pd

# Create a sample DataFrame with duplicate rows
df = pd.DataFrame({
    'Name': ['David', 'Annabel', 'Charlie', 'David'],
    'Age': [25, 30, 22, 25],
    'Salary': [50000, 60000, 70000, 50000]
})

# Detect duplicates in the DataFrame
duplicates = df.duplicated()

# Output the result
print(duplicates)

Output:

0    False
1    False
2    False
3     True
dtype: bool

Explanation:

  • Created a DataFrame with some duplicate rows.
  • Used duplicated() to detect which rows are duplicates.
  • Outputted a Boolean Series indicating whether each row is a duplicate.

Python-Pandas Code Editor:

Have another way to solve this solution? Contribute your code (and comments) through Disqus.

What is the difficulty level of this exercise?

Test your Programming skills with w3resource's quiz.



Become a Patron!

Follow us on Facebook and Twitter for latest update.

It will be nice if you may share this link in any developer community or anywhere else, from where other developers may find this content. Thanks.

https://w3resource.com/python-exercises/pandas/pandas-detect-duplicate-rows-in-a-dataframe.php