I have a folder with hundreds of csv files with 9 values from a temperature sensor in it. The columns are sensor_id, lat, lon (for the coordinates) and some other stuff that i don't need. The columns that i need are just the three [timestamp, temperature and humidity].

1. I already tried to use a module to import just the columns that i want and
2. i tried to delete the columns that i dont want with loops.

slowly i despair, can someone help me pls?

CodePudding user response：

If you are open to use Pandas, you can do it simply by using usecols parameter, while reading the csv file.

df = pd.read_csv('your_file/path/file.csv', usecols=['col1', 'col2']) 
print(df.shape)
df.head()

CodePudding user response：

Here's some code that should do it, just add in your target directory and change the numbers on the last line to the index of the column you want (with the first column being 0):

import os
import csv

targetdir = "" # fill this in
allrows = []

files = os.listdir(targetDir)
for file in files:
    with open('innovators.csv', 'r') as file:
        reader = csv.reader(file)
        for row in reader:
            allrows.append([row[1], row[3], row[5]])