Bash: Output columns from array consisting of two columns-CodePudding

Problem

I am writing a bash script and I have an array, where each value consists of two columns. It looks like this:

for i in "${res[@]}"; do
  echo "$i"
done

#Stream1
0 a1
1 b1
2 c1
4 d1
6 e1
#Stream2
0 a2
1 b2
3 c2
4 d2
9 f2
...

I would like to combine the output from this array into a larger table, and multiplex the indices. Furthermore, I would like to format the top row by inserting comment #Sec. I would like the result to be something like this:

#Sec  Stream1 Stream2
0     a1      a2
1     b1      b2
2     c1
3             c2
4     d1      d2
6     e1
9             f2

The insertion of #Sec and removal of the # behind the Streamkeyword is not necessary but desired if not too difficult.

Tried Solutions

I have tried piping to column and awk, but have not been able to produce the desired results.

EDIT

resis an array in a bash script. It is quite large, so I will only provide a short selection. Running echo "$( typeset -p res)"produces following output:

declare -a res='([1]="#Stream1
0 3072
1 6144
2 5120
3 1024
5 6144
..." [2]="#Stream2
0 3072
1 5120
2 4096
3 3072
53 3072
55 1024
57 2048")'

As for the 'result', my initial intention was to assign the resulting table to a variable and use it in another awk script to calculate the moving averages for specified indices, and plot the results. This will be done for ~20 different files. However I am open to other solutions.

The number of streams may vary from 10 to 50. Each stream having from 100 to 300 rows.

CodePudding user response：

You may use this awk solution:

cat tabulate.awk

NF == 1 {
   h = h OFS substr($1, 2)
     numSec
   next
}
{
   keys[$1]
   map[$1,numSec] = $2
}
END {
   print h
   for (k in keys) {
      printf "%s", k
      for (i=1; i<=numSec;   i)
         printf "\t%s", map[k,i]
      print ""
   }
}

Then use it as:

awk -v OFS='\t' -v h='#Sec' -f tabulate.awk file

#Sec  Stream1  Stream2
0     a1       a2
1     b1       b2
2     c1
3              c2
4     d1       d2
6     e1
9              f2