Bash script using SSH to sum disk usage on NetApp

Question

I have tried to come with below bash script which is at least working for me, i know its not perfect and that why i want some review and suggestion to make it more aligned with bash practices. I'm trying to read bash manuals and seeking help from google and stackoverflow questions and answers.

I'm not able to explain well thus not getting fruitful help.. but that's the way it works :-) .

Below is my working code which basically have a array_list of volumes like array_fxn1 ... which i'm taking from a file file and then building them and further making sure if ldap_volList is not empty at the same time and then doing some for loop over the array_list further doing check and then ssh to the Server to run the command and do some sum of the certain columns.

As you may see, its always relative to array_list or say volume_list, for an example if its array_fxn1= then its dbcl101, if its array_fxn2= then its dbcl201 and so on ..

   array_fxn1 then fxn101
   array_fxn2 then  fxn201
   array_fxn3 then  fxn301
   array_fxn4 then fxn401

but i am not getting that logic build so come to the below one which can work for me being not an expert.

Any suggestion, will be much much appreciated.

my code:

#!/bin/bash
#
read -rp "Please Enter LDAP Project Name: " ldap_proj
ldap_volList=$(cat ldap-project-nismap.csv |grep "$ldap_proj" | tr "," "\t"| awk '{print $NF}'| tr -d '"')
# Build an array list of desired Volumes beforehand to make it more precise
array_fxn1=$(echo "$ldap_volList" | grep ^fxn1)
array_fxn2=$(echo "$ldap_volList" | grep ^fxn2)
array_fxn3=$(echo "$ldap_volList" | grep ^fxn3)
array_fxn4=$(echo "$ldap_volList" | grep ^fxn4)
array_fxn6=$(echo "$ldap_volList" | grep ^fxn6)
array_fxn7=$(echo "$ldap_volList" | grep ^fxn7)
array_fxn8=$(echo "$ldap_volList" | grep ^fxn8)

# Place a check to ensure the Volumelist is not empty and then loop over the volume array's
if [[ ! -z "$ldap_volList" ]]; then
     for i in $array_fxn1;
     do
       volstyle=$(ssh dbcl101 "row 0; vol show $i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl101 "row 0;set -unit MB; \
         vol show-footprint $i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"||awk '/^stv/{s1+=$3; s2+=$4; s3+=$5 } END {print s1, s2, s3}'
       fi
     done
     for i in $array_fxn2;
     do
       volstyle=$(ssh dbcl201 "row 0; vol show $i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl201 "row 0;set -unit MB; \
         vol show-footprint $i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"||awk '/^stv/{s1+=$3; s2+=$4; s3+=$5 } END {print s1, s2, s3}'
       fi
     done
     for i in $array_fxn3;
     do
       volstyle=$(ssh dbcl301 "row 0; vol show \$i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl301 "row 0;set -unit MB; \
         vol show-footprint \$i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
       fi
     done
     for i in $array_fxn4;
     do
       volstyle=$(ssh fxn401 "row 0; vol show \$i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl401 "row 0;set -unit MB; \
         vol show-footprint \$i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
       fi
     done
     for i in $array_fxn6;
     do
       volstyle=$(ssh dbcl601 "row 0; vol show \$i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl601 "row 0;set -unit MB; \
         vol show-footprint \$i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
       fi
     done
     for i in $array_fxn7;
     do
       volstyle=$(ssh dbcl701 "row 0; vol show \$i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl701 "row 0;set -unit MB; \
         vol show-footprint \$i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
       fi
     done
     for i in $array_fxn8;
     do
       volstyle=$(ssh dbcl804 "row 0; vol show \$i -fields volume-style-extended" |awk '/fxn/{print $3}')
       if [[ "$volstyle" == "flexvol" ]];then
         echo -n "$ldap_proj:$i  "
         ssh dbcl804 "row 0;set -unit MB; \
         vol show-footprint \$i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
       fi
     done
fi

Output:

$ bash new_test.sh
Please Enter LDAP Project Name: web3
web3:fxn1002_web3_wiki  14030MB 13292MB 0MB
web3:fxn1002_web3_wvg   690194MB 679021MB 0MB
web3:fxn1002_web3_wso   70MB 38MB 0MB

UPDATE ON THE POST:

CVS DATA Sample:

Location,ProjectName,NisMap,"Total(GB)","Used(GB)","Used_Percentage",Quality,Id,volumeName
"DC_oregon-DC01",dnpc,"dbc2002:/proj/dbc2002_dnpc_eaeagle_pd2/q",1000,"761.87",76,economy,"eaeagle_pd2","dbc2002_dnpc_eaeagle_pd2"
"DC_oregon-DC01",dnpc,"dbc2002:/proj/dbc2002_dnpc_eaeagle2_7/q",4096,"3536.99",86,scratch,"eaeagle2_7","dbc2002_dnpc_eaeagle2_7"
"DC_oregon-DC01",dnpc,"dbc2002:/proj/dbc2002_dnpc_eaeagle2_6/q",4096,"2976.74",73,scratch,"eaeagle2_6","dbc2002_dnpc_eaeagle2_6"
"DC_oregon-DC01",dnpc,"dbc2002:/proj/dbc2002_dnpc_eaeagle2_5/q",4096,"3111.61",76,economy,"eaeagle2_5","dbc2002_dnpc_eaeagle2_5"
"DC_oregon-DC01",dnpc,"dbc2002:/proj/dbc2002_dnpc_eaeagle2_4/q",4096,"3595.16",88,economy,"eaeagle2_4","dbc2002_dnpc_eaeagle2_4"
"DC_oregon-DC01",dnpc,"dbc2002:/proj/dbc2002_dnpc_eaeagle2_3/q",4096,"2296.67",56,economy,"eaeagle2_3","dbc2002_dnpc_eaeagle2_3"

NetAPP command data:

1)

$ ssh dbcl101 "row 0; vol show fxn1002_dbdesk_scratch  -fields volume-style-extended" |awk '/fxn/{print $3}'

flexvol

the above command I am making sure if the output returns flexvol.

$ ssh dbcl101 "row 0; vol show fxn1002_dbdesk_scratch  -fields volume-style-extended"

Last login time: 7/17/2022 21:38:02
  (rows)

vserver volume                     volume-style-extended
------- -------------------------- ---------------------
fxn1002 fxn1002_dbdesk_scratch flexvol

The above one is full command which have volume type like we have in previous command which contains the flexvol and that's what we are getting store via awk to a variable.

2. The below NetApp command returns the size of a volume.

--

$ ssh dbcl101 "row 0; vol show-footprint fxn1002_dbdesk_scratch -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"

Last login time: 7/17/2022 21:39:26
  (rows)

vserver volume                     total-footprint volume-blocks-footprint-bin0 volume-blocks-footprint-bin1
------- -------------------------- --------------- ---------------------------- ----------------------------
fxn1002 fxn1002_dbdesk_scratch 880.4GB         18.91GB                      854.8GB
fxn1002 fxn1002_dbdesk_scratch 880.4GB         18.91GB                      854.8GB

---

$ ssh dbcl101 "row 0; vol show-footprint fxn1002_dbdesk_scratch -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
880.4GB 18.91GB 854.8GB

The above one again the same command which does the print the field 2, 3 & 4.

Answer 1

I have no idea of what you are trying to achieve, but still here we go.

• Less indentation is better than more indentation. Compare

    if condition; then
        do_plenty_of_work
    fi
  

  vs

    if not condition; then
        return
    fi
    do_plenty_of_work
  

  Second version is much more readable. I don't have to scroll down to see that there is no else.

• Don't Repeat Yourself (aka DRY). All your for loops are identical; only the server name, and the array name differ, and they differ in a very regular way. Lift the common code into a function:

    do_stuff() {
        array=$(echo "$ldap_volList" | grep ^fxn${1})
        server = "dbcl"${1}"01"
        for i in $array; do
            volstyle=$(ssh ${server} "row 0; vol show $i -fields volume-style-extended" |awk '/fxn/{print $3}')
            if [[ "$volstyle" == "flexvol" ]];then
                echo -n "$ldap_proj:$i  "
                ssh ${server} "row 0;set -unit MB; \
                vol show-footprint $i -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint"|awk '/fxn/{print $3,$4,$5}'
            fi
         done
  

  and call it in a loop:

    for i in {1..8}: do
        do_stuff ${i}
    done
  

Answer 2

While going through your post and your requirement as I understand where you are looking for below string match, for this to solve better I would use regexp matches =~ and Bash logical (&&) operator where && lets you do something based on whether the previous command completed successfully - that's why you tend to see it chained as do_something &&

   array_fxn1 then fxn101
   array_fxn2 then fxn201
   array_fxn3 then fxn301
   array_fxn4 then fxn401

Below is something I'll try if I would be you, I'm not a Storage expert and NetAPP access hence can not try any more, please give it a try ..

#!/bin/bash
##
read -rp "Please Enter LDAP Project Name: " ldap_proj
ldap_volList=$(grep  "$ldap_proj" ldap-project-nismap.csv | tr "," "\t"| awk '{print $NF}'| tr -d '"')
for vols in $(echo "$ldap_volList");
 do
    [[ $vols =~ ^fsx1 ]] && ssh_server="dbcl101";
    [[ $vols =~ ^fsx2 ]] && ssh_server="dbcl201";
    [[ $vols =~ ^fsx3 ]] && ssh_server="dbcl301";
    [[ $vols =~ ^fsx4 ]] && ssh_server="dbcl401";
    [[ $vols =~ ^fsx5 ]] && ssh_server="dbcl501";
    [[ $vols =~ ^fsx6 ]] && ssh_server="dbcl601";
    [[ $vols =~ ^fsx7 ]] && ssh_server="dbcl701";
    [[ $vols =~ ^fsx8 ]] && ssh_server="dbcl804";
    volstyle=$(ssh "$ssh_server" "row 0; vol show $vols -fields volume-style-extended" |awk '/fsx/{print $3}')
    if [[ "$volstyle" == "flexvol" && ! -z "$ssh_server" ]];then
      echo -n "$ldap_proj:$vols "
      ssh $ssh_server "row 0;set -unit MB; \
      vol show-footprint $vols -fields volume-blocks-footprint-bin0,volume-blocks-footprint-bin1,total-footprint" \
      |awk '/fsx/{print $3,$4,$5}'
    fi
  done

Now, you don't need to run for loop multiple times.