How to split a dictionary of df in half using pandas?-CodePudding

I have a very large dictionary of dataframes. It contains around 250 dataframes, each of which has around 50 columns per df. My goal is to concat the dataframes to create one large df; however, as you can imagine, this process isn't great because it will create a df that is way too large view outside of using python. My goal is to explode the large dictionary of df in half and turn it into two large, but manageable files.

I will try to replicate what it looks like:

d = {df1, df2,........,df500}
df = pd.concat(d) 
# However, Is there a way to split 50%?
df1 = pd.concat(d) # only gets first 250 of the df
df2 =pd.concat(d) # only gets last 250 df

CodePudding user response：

How about something like this?

v = list(d.values())
part1 = v[:len(v)//2]
part2 = v[len(part1):]

df1 = pd.concat(part1)
df2 = pd.concat(part2)

CodePudding user response：

First of all it's not a dictionary , it's a set which can be converted to list. An List can be divided into 2 as you need.

d=list(d)
ln=len(d)
d1=d[0:ln]
d2=d[ln:]
df1 = pd.concat(d1)
df2 = pd.concat(d2)