Python 如何删除每行中的重复项

发布于11月19日

我有一个每行都有副本的数据帧.我想用新的列名如Num1到Num5返回非重复项. 例如,

import numpy as np
import pandas as pd
 
df1 = pd.DataFrame([[1,1,2,4,5,6,7,7],
           [2,5,6,7,22,23,34,7],
           [3,3,5,6,7,45,46,7],
           [4,6,7,14,29,32,33,7],
           [5,6,7,13,23,33,35,7],
           [6,1,6,7,8,9,10,7],
           [7,0,2,5,7,10,30,7]], 
           columns = ['Row_Num', 'Num1','Num2','Num3','Num4','Num5','Num6','Num7'])

我希望我的结果是这样的.

result = pd.DataFrame([[1,1,2,4,5,6],
           [2,5,6,22,23,34],
           [3,3,5,6,45,46],
           [4,6,14,29,32,33],
           [5,6,13,23,33,35],
           [6,1,6,8,9,10],
           [7,0,2,5,10,30]], 
           columns = ['Row_Num', 'Num1','Num2','Num3','Num4','Num5'])

推荐答案

另一个可能的 Select 是:

tmp = df1.set_index("Row_Num").T

out = (tmp.apply(lambda s: (t:=s.drop_duplicates(keep=False))
            .set_axis(tmp.index[:len(t)])).T.reset_index())

发帖主题:Re:Kolibrios

print(out.convert_dtypes())

   Row_Num  Num1  Num2  Num3  Num4  Num5
0        1     1     2     4     5     6
1        2     5     6    22    23    34
2        3     3     5     6    45    46
3        4     6    14    29    32    33
4        5     6    13    23    33    35
5        6     1     6     8     9    10
6        7     0     2     5    10    30

[7 rows x 6 columns]