Ygtjki

Hi all i have a question that i have two files

1. Which contains the data where each column is | separated . This is a csv file




2. the other file has data which has three rows and the third row contains the count of rows in the first file .
   the data looks like below

date -some date mentioned 
time - sometime mentioned 
COUNT 00007654( random row count).

Now i have to validate the row count of the csv file EXCLUDING the header which is first row in the csv file and the COUNT row in the second file .'

If the row count of the csv file matches( i am thinking of using cat file.csv|wc -l) and the count value mentioned in the second file
then i proceed further or else i move the csv file to bad a defined bad location.

Explanation:

file1.cvs is the file that has the count, put all the file in the same directory and then use the below script.

Script:

#!/bin/bash

count1=$(cat $1|wc -l)

for i in ./*
do
count2=$(cat $i|wc -l)
if [ $count1 == $count2 ]
 then
 echo "file $i matched" ## your output
 else
 echo "file $i is Bad file" ## your command
fi
done

Usage:

./script.sh file1.csv 

Instead of piping the file into wc it's more efficient to use wc directly. I don't cat the file into tail, but just use tail directly.

Here's a script which does the comparison I believe you want.

Regarding the the loop and the filenames, you need to update your question and explain how to find the file and the count file. Or just ask a new question.

~/tmp$ cat f1
Head1,head2,head3
data1,data2,data3
data1,data2,data3
data1,data2,data3
~/tmp$ cat f1summary
date -some date mentioned
time - sometime mentioned
COUNT 00007654( random row count).
~/tmp$ cat checkIncommingFiles
#!/bin/bash

filename=$1 # set filename
filesummary=$2 # set filesummary

wcout=$( wc -l $filename) # gets line count followed by filename
filelines=$wcout%$filename # removes filename
filelines=$(( $filelines -1 )) # subtract 1 for header

# extracts summaryCount using modified version your recipe
# file2.csv| tail -1| cut -c -8

typeset -i summaryCount # Declared as Integer to remove leading zeros
summaryCount=$(tail -1 $filesummary | cut -d"(" -f1 |cut -d" " -f2 )

# change the values
if [[ $filelines != $summaryCount ]] ; then
 echo mismatch $filename has $filelines lines $filesummary has $summaryCount
else
 echo goodmatch $filename has $filelines lines $filesummary has $summaryCount
fi


~/tmp$ bash ./checkIncommingFiles f1 f1summary 
mismatch f1 has 3 lines f1summary has 7654
~/tmp$