我的.csv文件如下所示:
"col1","col2"
"1","text1"
"2","This a "TEXT". However, I cannot parse it."
即，它在值中包含逗号和引号.
在read_csv()函数中使用sep参数会在每行的开头和结尾加上引号:
import pandas as pd
df = pd.read_csv('test.csv', sep = '","', engine = 'python')
df
"col1 col2"
0 "1 text1"
1 "2 This a "TEXT". However, I cannot parse it."
我可以做些什么来正确读取我的文件？
在你有趣的 idea 的基础上，你还可以添加第一个和最后一个引号作为分隔符，然后删除不需要的列:
data = io.StringIO('''"col1","col2"
"1","text1"
"2","This a "TEXT". However, I cannot parse it."
''')
df = pd.read_csv(data, sep=r'","|^"|"$', engine='python').iloc[:, 1:-1]
输出:
col1 col2
0 1 text1
1 2 This a "TEXT". However, I cannot parse it.
这样做的好处是，您可以直接获得正确的类型(如果需要):
df.dtypes
col1 int64
col2 object
dtype: object