Pandas: Remove repetitive characters from the specified column of a given DataFrame

Last update on April 03 2025 12:57:08 (UTC/GMT +8 hours)

32. Remove Repetitive Characters

Write a Pandas program to remove repetitive characters from the specified column of a given DataFrame.

Sample Solution:

Python Code :

import pandas as pd
import re as re
pd.set_option('display.max_columns', 10)
df = pd.DataFrame({
    'text_code': ['t0001.','t0002','t0003', 't0004'],
    'text_lang': ['She livedd a long life.', 'How oold is your father?', 'What is tthe problem?','TThhis desk is used by Tom.']
    })
print("Original DataFrame:")
print(df)
def rep_char(str1):
    tchr = str1.group(0)
    if len(tchr) > 1:
        return tchr[0:1] # can change the value here on repetition
def unique_char(rep, sent_text):
    convert = re.sub(r'(\w)\1+', rep, sent_text) 
    return convert
df['normal_text']=df['text_lang'].apply(lambda x : unique_char(rep_char,x))
print("\nRemove repetitive characters:")
print(df)

Sample Output:

Original DataFrame:
  text_code                    text_lang
0    t0001.      She livedd a long life.
1     t0002     How oold is your father?
2     t0003        What is tthe problem?
3     t0004  TThhis desk is used by Tom.

Remove repetitive characters:
  text_code                    text_lang                normal_text
0    t0001.      She livedd a long life.     She lived a long life.
1     t0002     How oold is your father?    How old is your father?
2     t0003        What is tthe problem?       What is the problem?
3     t0004  TThhis desk is used by Tom.  This desk is used by Tom.

For more Practice: Solve these Related Problems:

• Write a Pandas program to remove consecutive repetitive characters from strings in a DataFrame column using regex.
• Write a Pandas program to clean a text column by compressing sequences of repeating characters into a single instance.
• Write a Pandas program to apply a function that eliminates duplicate consecutive letters in a column and then output the cleaned column.
• Write a Pandas program to transform a string column by replacing any occurrence of three or more repeated characters with a single character.

Python Code Editor:

Have another way to solve this solution? Contribute your code (and comments) through Disqus.

Previous: Write a Pandas program to extract only punctuations from the specified column of a given DataFrame.
Next: Write a Pandas program to extract numbers greater than 940 from the specified column of a given DataFrame.