Pandas - Detecting duplicate rows in a DataFrame using duplicated()
Pandas: Data Cleaning and Preprocessing Exercise-3 with Solution
Write a Pandas program to detect duplicates using duplicated() method.
In this exercise, you will identify duplicate rows in a DataFrame using the duplicated() method.
Sample Solution :
Code :
import pandas as pd
# Create a sample DataFrame with duplicate rows
df = pd.DataFrame({
'Name': ['David', 'Annabel', 'Charlie', 'David'],
'Age': [25, 30, 22, 25],
'Salary': [50000, 60000, 70000, 50000]
})
# Detect duplicates in the DataFrame
duplicates = df.duplicated()
# Output the result
print(duplicates)
Output:
0 False 1 False 2 False 3 True dtype: bool
Explanation:
- Created a DataFrame with some duplicate rows.
- Used duplicated() to detect which rows are duplicates.
- Outputted a Boolean Series indicating whether each row is a duplicate.
Python-Pandas Code Editor:
Have another way to solve this solution? Contribute your code (and comments) through Disqus.
What is the difficulty level of this exercise?
Test your Programming skills with w3resource's quiz.
It will be nice if you may share this link in any developer community or anywhere else, from where other developers may find this content. Thanks.
https://w3resource.com/python-exercises/pandas/pandas-detect-duplicate-rows-in-a-dataframe.php
- Weekly Trends and Language Statistics
- Weekly Trends and Language Statistics