Home > Software design >  Writing a List of Dictionaries to seperate JSONs
Writing a List of Dictionaries to seperate JSONs

Time:06-13

I do have dictionary, with each value as a list.

I want to write individual items to separate JSON files. For example

data_to_write = {"Names":["name1", "name2", "name3"], "email":["mail1", "mail2", "mail3"]}

Now I want 3 jsons i.e data1.jsob, data2.json, data3.json in the following(approx) format.

data1.json

{
    Name: name1,
    email: mail1
}

data2.json

{
    Name: name2,
    email: mail2
}

and so on.

My current approach is


    for file_no in range(no_of_files):
        for count, (key, info_list) in enumerate(data_to_write.items()):
            for info in info_list:
                with open(
                     os.path.join(self.path_to_output_dir, str(file_no))   ".json",
                     "a",
                ) as resume:
                    json.dump({key: info}, resume)

But this is wrong. Any helps appreciated.

CodePudding user response:

You could use pandas to do the work for you. Read the dictionary into a dataframe, then iterate the rows of the dataframe to produce the json for each row:

import pandas as pd

data_to_write = {"Names":["name1", "name2", "name3"], "email":["mail1", "mail2", "mail3"]}
df = pd.DataFrame(data_to_write).rename(columns={'Names':'Name'})
for i in range(len(df)):
    jstr = df.iloc[i].to_json()
    with open(f"data{i 1}.json", "w") as f:
        f.write(jstr)

Output (each line is in a separate file):

{"Name":"name1","email":"mail1"}
{"Name":"name2","email":"mail2"}
{"Name":"name3","email":"mail3"}

CodePudding user response:

Try:

import json

data_to_write = {
    "Names": ["name1", "name2", "name3"],
    "email": ["mail1", "mail2", "mail3"],
}

for i, val in enumerate(zip(*data_to_write.values()), 1):
    d = dict(zip(data_to_write, val))
    with open(f"data{i}.json", "w") as f_out:
        json.dump(d, f_out, indent=4)

This writes data(1..3).json with content:

# data1.json
{
    "Names": "name1",
    "email": "mail1"
}

# data2.json
{
    "Names": "name2",
    "email": "mail2"
}

...

CodePudding user response:

import json

data_to_write = {
    "Names": ["name1", "name2", "name3"],
    "email": ["mail1", "mail2", "mail3"],
}

for ind, val in enumerate(zip(*data_to_write.values())):
    jsn = dict(zip(data_to_write, val))
    print(jsn)

    with open("data{}.json".format(ind), "w") as f:
        f.write(json.dumps(jsn))
  • Related