Ygtjki

I have lines in a file like below

AB: 20190131 13 J-1|19:30:00.000000000 18:06:00.000000000 123466 50 @TEST . "" 1234 - I . ".." "" "" "TEST TEXT 1" "TEXT 2: SAMPLE TEXT I must explain to you how all this mistaken idea of denouncing pleasure and praising pain was born and I will give you a complete account of the system, and expound the actual teachings of the great explorer of the truth, the master-builder of human happiness. No one rejects, dislikes, or avoids pleasure itself, because it is pleasure, but because those who do not know how to pursue pleasure rationally encounter consequences that are extremely painful. Nor again is there anyone who loves or pursues or desires to obtain pain of itself, because it is pain, but because occasionally circumstances occur in which toil and pain can procure him some great pleasure. To take a trivial example, which of us ever undertakes laborious physical exercise, except to obtain some advantage from it? But who has any right to find f.==Required file.csv.gz FIELD*SERVER-TIME*05:29:51.981378000" "" NoTime

I want to extract third field seperated by space that is 13 and Required file.csv.gz which is the first field for field separator ==

Required output is

13,Required file.csv.gz

I am able to extract file name with below command

awk -F "==" '/.csv.gz/print $2' | awk 'print $1'

But unable to get the file ID 13. Unable to use space as delimitter as text after TEXT2: don't have fixed words.

Filenames in file can be "Required file.csv.gz", "Required_file.csv.gz" or "This is a required file.csv.gz".

You can use match() with RSTART, RLENGTH and substr():

awk 'match($0,/==.*?.csv.gz/)print $3","substr($0, RSTART+2, RLENGTH-2)' file 

Where

we use match() function to find the sub-string matching the pattern /==.*?.csv.gz/. For any matched lines, we will get RSTART and RLENGTH to identify the location and length of the matched text, then use substr($0, RSTART+2, RLENGTH-2) to retrieve the text (+2 and -2 to remove the leading '==' from the matched text).

Try this,

Option 1:

awk 'gsub(/f.==/, ""); print $3","$(NF-4)" "$(NF-3)' file

13,Required file.csv.gz

• 
  gsub will substitute "f.==" with null.


• print 3rd fields from start and 4th and 3rd filed from the end of the line

Option 2:

echo "`awk ' print $3' file && awk -F '==' 'print $2' file| awk 'print $1" "$2'`" | tr 'n' ','

• print the 3rd column with space as delimiter.


• parse 2nd column with "==" as delimiter and from that print 1st and 2nd column with space as delimiter.


• the transpose newline with comma

Note: option2 is only for one line input.

With one awk :

awk '
 printf "%s,", $3
 match($0, /Required [a-z]+.csv.gz/, a)
 print a[0]
 ' /tmp/file

With 2 commands :

awk 'printf "%s,", $3' /tmp/file
grep -oP 'f.==KRequired w+.csv.gz' /tmp/file

Output

13,Required file.csv.gz