How to remove rows from a dataframe that are identical to another dataframe?

Question

I have two data frames df1 and df2. For my analysis, I need to remove rows from df1 that have identical column values (Email) in df2?

>>df1
   First  Last  Email
0 Adam   Smith  email@email.com
1 John   Brown  email2@email.com
2 Joe    Max    email3@email.com
3 Will   Bill   email4@email.com
>>df2
  First  Last   Email
0 Adam   Smith  email@email.com
1 John   Brown  email2@email.com

Mohit Motwani · Accepted Answer · 2020-03-05T17:35:33.867

17

You can try this:

cond = df1['Email'].isin(df2['Email'])
df1.drop(df1[cond].index, inplace = True)

>>df1
    First   Last    Email
2   Joe     Max     email3@email.com
3   Will    Bill    email4@email.com

edited Mar 05 '20 at 17:35

answered Aug 21 '18 at 11:06

Mohit Motwani

601
1
7
23

score 9 · Answer 2 · answered Sep 03 '19 at 14:14

9

Simpler to use isin() with dropna()

https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.isin.html

df1[~df1.isin(df2)].dropna()

answered Sep 03 '19 at 14:14

Idodo

191
2
3

How to remove rows from a dataframe that are identical to another dataframe?

2 Answers2