pandas df explode and implode to remove specific dict from the list-CodePudding

I have pandas dataframe with multiple columns. On the the column called request_headers is in a format of list of dictionaries, example:

[{"name": "name1", "value": "value1"}, {"name": "name2", "value": "value2"}]

I would like to remove only those elements from that list which do contains specific name. For example with:

blacklist = "name2"

I should get the same dataframe, with all the columns including request_headers, but it's value (based on the example above) should be:

[{"name": "name1", "value": "value1"}]

How to achieve it ? I've tried first to explode, then filter, but was not able to "implode" correctly.

Thanks,

CodePudding user response：

Exploding is expensive, rather us a list comprehension:

blacklist = "name2"

df['request_headers'] = [[d for d in l if 'name' in d and d['name'] != blacklist]
                         for l in df['request_headers']]

Output:

                          request_headers
0  [{'name': 'name1', 'value': 'value1'}]

CodePudding user response：

can use a .apply function:

blacklist = 'name2'
df['request_headers'] = df['request_headers'].apply(lambda x: [d for d in x if blacklist not in d.values()])