Grepping string, but include all non-blank lines following each grep match2019 Community Moderator ElectionHow can I grep a directory based on the contents of two successive lines?grep: Find all lines that contain Japanese kanjisBlank lines when executing “grep | xargs” in a “find -exec”How to use grep/awk/unix to match all lines from one file in another file, even if they are duplicatesRemove all the lines before the first line that contains a match?grep match all occurrences of multiple regular expressionsCompare two files and retrieve corresponding resultsregex and grep: match all letters in a listHow to search for a match, then a non-match on that line, but include context lines for matched line?How to `grep -v` and also exclude 'n' lines after the match?

What would sports be like in a dystopia?

Which Article Helped Get Rid of Technobabble in RPGs?

Why is so much work done on numerical verification of the Riemann Hypothesis?

Is there a nicer/politer/more positive alternative for "negates"?

What is Cash Advance APR?

Does grappling negate Mirror Image?

Has the laser at Magurele, Romania reached a tenth of the Sun's power?

What (the heck) is a Super Worm Equinox Moon?

"It doesn't matter" or "it won't matter"?

Why do ¬, ∀ and ∃ have the same precedence?

Review your own paper in Mathematics

Is there a RAID 0 Equivalent for RAM?

Doesn't the system of the Supreme Court oppose justice?

Why does Carol not get rid of the Kree symbol on her suit when she changes its colours?

How to make money from a browser who sees 5 seconds into the future of any web page?

15% tax on $7.5k earnings. Is that right?

Why is the Sun approximated as a black body at ~ 5800 K?

Delete multiple columns using awk or sed

What are some good ways to treat frozen vegetables such that they behave like fresh vegetables when stir frying them?

The Digit Triangles

What does Apple's new App Store requirement mean

How could a planet have erratic days?

A variation to the phrase "hanging over my shoulders"

Has any country ever had 2 former presidents in jail simultaneously?



Grepping string, but include all non-blank lines following each grep match



2019 Community Moderator ElectionHow can I grep a directory based on the contents of two successive lines?grep: Find all lines that contain Japanese kanjisBlank lines when executing “grep | xargs” in a “find -exec”How to use grep/awk/unix to match all lines from one file in another file, even if they are duplicatesRemove all the lines before the first line that contains a match?grep match all occurrences of multiple regular expressionsCompare two files and retrieve corresponding resultsregex and grep: match all letters in a listHow to search for a match, then a non-match on that line, but include context lines for matched line?How to `grep -v` and also exclude 'n' lines after the match?










7















Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.










share|improve this question



















  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday















7















Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.










share|improve this question



















  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday













7












7








7








Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.










share|improve this question
















Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.







text-processing grep






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited yesterday







Faheem Mitha

















asked yesterday









Faheem MithaFaheem Mitha

23.2k1884137




23.2k1884137







  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday












  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday







2




2





do you want all the Matches in one output or you want them to be ran separately ?

– Vivek Kanadiya
yesterday





do you want all the Matches in one output or you want them to be ran separately ?

– Vivek Kanadiya
yesterday













I guess one output is fine, as long as they are clearly separated, say by a blank line.

– Faheem Mitha
yesterday





I guess one output is fine, as long as they are clearly separated, say by a blank line.

– Faheem Mitha
yesterday













might not possible in one output but I can try to see in each separate output!

– Vivek Kanadiya
yesterday





might not possible in one output but I can try to see in each separate output!

– Vivek Kanadiya
yesterday













For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

– Jeff Schaller
yesterday





For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

– Jeff Schaller
yesterday













@JeffSchaller Yes, please separate different FOO matches.

– Faheem Mitha
yesterday





@JeffSchaller Yes, please separate different FOO matches.

– Faheem Mitha
yesterday










7 Answers
7






active

oldest

votes


















9














Using awk rather than grep:



awk '/FOO/ if (matching) printf("n"); matching = 1 
/^$/ if (matching) printf("n"); matching = 0
matching' file


A version that enumerates the matches:



awk 'function flush_print_maybe() 
if (matching) printf("Match %dn%snn", ++n, buf)
buf = ""

/FOO/ flush_print_maybe(); matching = 1
/^$/ flush_print_maybe(); matching = 0
matching buf = (buf == "" ? $0 : buf ORS $0)
END flush_print_maybe() ' file


Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



The first program prints any line when in the matching state.



The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



Output of this last program on the sample data:



Match 1
this line contains FOO
this line is not blank

Match 2
This line also contains FOO

Match 3
This line contains FOO too
Not blank
Also not blank

Match 4
FOO!
Yet more random text

Match 5
FOO!





share|improve this answer

























  • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

    – Stephen Kitt
    yesterday











  • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

    – Kusalananda
    yesterday












  • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

    – Stephen Kitt
    yesterday











  • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

    – Kusalananda
    yesterday


















6














sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



This



  1. suppresses output (-n); then

  2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

  3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

  4. prints those lines (p).


this line contains FOO
this line is not blank


This line also contains FOO


This line contains FOO too
Not blank
Also not blank


FOO!
Yet more random text

FOO!





share|improve this answer
































    5














    I don’t think this is doable with grep, but it is with AWK:



    #! /usr/bin/awk -f

    /FOO/
    matched = 1
    if (notfirst) print ""
    notfirst = 1


    /^$/
    matched = 0


    matched


    With a count of matches:



    #! /usr/bin/awk -f

    /FOO/
    matched = 1
    if (matches) print ""
    printf "Match %dn", ++matches


    /^$/
    matched = 0


    matched


    In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






    share|improve this answer
































      2














      I've included a pcregrep solution and a python solution.



      Multiline Grep Solution



      If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



      pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


      The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



      Python Solution



      Here is a Python script that should do what you want:



      #!/usr/bin/env python3
      # -*- encoding: utf8 -*-
      """grep_follow.py

      Search a text file for a pattern,
      and output that pattern and the
      non-empty lines which immediately follow it.
      """

      import re
      import sys

      # Get the search pattern and the input file as command-line arguments
      pattern = sys.argv[1]
      input_file = sys.argv[2]

      # Set a flag to determine whether or not to output the current line
      print_flag = False

      with open(input_file, "r") as _input_file:

      # Iterate over the lines of the input file
      for line in _input_file:

      # Remove trailing whitespace
      line = line.rstrip()

      # If the line is empty, stop producing output
      if not line.strip():
      print_flag = False

      # If the line matches the search pattern, start producing output
      elif re.search(pattern, line):
      print_flag = True

      # If the print flag is set then output the line
      if print_flag:
      print(line)


      You would run it like this:



      $ python grep_follow.py FOO test.txt


      this line contains FOO
      this line is not blank
      This line also contains FOO
      This line contains FOO too
      Not blank
      Also not blank
      FOO!
      Yet more random text
      FOO!





      share|improve this answer




















      • 1





        a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

        – iruvar
        20 hours ago


















      1














      awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

      ===match 1===
      this line contains FOO
      this line is not blank

      ===match 2===
      This line also contains FOO

      ===match 3===
      This line contains FOO too
      Not blank
      Also not blank

      ===match 4===
      FOO!
      Yet more random text
      ===match 5===
      FOO!


      A similar variant where FOO could be easily changed to something else:



      awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


      Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






      share|improve this answer






























        0














        One way can be using Perl's range operator ...:



        $ perl -lne '
        print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
        ' input.txt

        MATCH#1
        this line contains FOO
        this line is not blank


        MATCH#2
        This line also contains FOO


        MATCH#3
        This line contains FOO too
        Not blank
        Also not blank


        MATCH#4
        FOO!
        Yet more random text

        MATCH#5
        FOO!


        In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



        Note :



        $/ = RS = "n"



        $, = OFS = ""



        $ perl -lne '
        print
        s^(?=.*FOO)

        ($,,$/)[$r>1] .
        "MATCH#" . ++$count . $/
        rex
        if $r = /FOO/ ... /^$/;
        ' input.txt


        Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



        Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



        $ perl -aln -F'n' -00 -e '
        next unless /FOO/;
        shift @F until $F[0] =~ /FOO/;
        push @F, $, if ! eof;
        print "MATCH#", ++$k, $, shift @F;
        print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
        ' input.txt





        share|improve this answer
































          0














          Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



          gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


          First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



          This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



          gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





          share|improve this answer






















            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "106"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f507517%2fgrepping-string-but-include-all-non-blank-lines-following-each-grep-match%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            7 Answers
            7






            active

            oldest

            votes








            7 Answers
            7






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            9














            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!





            share|improve this answer

























            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday















            9














            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!





            share|improve this answer

























            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday













            9












            9








            9







            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!





            share|improve this answer















            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!






            share|improve this answer














            share|improve this answer



            share|improve this answer








            edited yesterday

























            answered yesterday









            KusalanandaKusalananda

            137k17258426




            137k17258426












            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday

















            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday
















            Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

            – Stephen Kitt
            yesterday





            Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

            – Stephen Kitt
            yesterday













            @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

            – Kusalananda
            yesterday






            @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

            – Kusalananda
            yesterday














            Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

            – Stephen Kitt
            yesterday





            Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

            – Stephen Kitt
            yesterday













            @StephenKitt It's almost midnight here, I'll get back to it later. :-)

            – Kusalananda
            yesterday





            @StephenKitt It's almost midnight here, I'll get back to it later. :-)

            – Kusalananda
            yesterday













            6














            sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


            Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



            This



            1. suppresses output (-n); then

            2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

            3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

            4. prints those lines (p).


            this line contains FOO
            this line is not blank


            This line also contains FOO


            This line contains FOO too
            Not blank
            Also not blank


            FOO!
            Yet more random text

            FOO!





            share|improve this answer





























              6














              sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


              Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



              This



              1. suppresses output (-n); then

              2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

              3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

              4. prints those lines (p).


              this line contains FOO
              this line is not blank


              This line also contains FOO


              This line contains FOO too
              Not blank
              Also not blank


              FOO!
              Yet more random text

              FOO!





              share|improve this answer



























                6












                6








                6







                sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


                Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



                This



                1. suppresses output (-n); then

                2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

                3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

                4. prints those lines (p).


                this line contains FOO
                this line is not blank


                This line also contains FOO


                This line contains FOO too
                Not blank
                Also not blank


                FOO!
                Yet more random text

                FOO!





                share|improve this answer















                sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


                Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



                This



                1. suppresses output (-n); then

                2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

                3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

                4. prints those lines (p).


                this line contains FOO
                this line is not blank


                This line also contains FOO


                This line contains FOO too
                Not blank
                Also not blank


                FOO!
                Yet more random text

                FOO!






                share|improve this answer














                share|improve this answer



                share|improve this answer








                edited yesterday

























                answered yesterday









                Michael HomerMichael Homer

                50k8137175




                50k8137175





















                    5














                    I don’t think this is doable with grep, but it is with AWK:



                    #! /usr/bin/awk -f

                    /FOO/
                    matched = 1
                    if (notfirst) print ""
                    notfirst = 1


                    /^$/
                    matched = 0


                    matched


                    With a count of matches:



                    #! /usr/bin/awk -f

                    /FOO/
                    matched = 1
                    if (matches) print ""
                    printf "Match %dn", ++matches


                    /^$/
                    matched = 0


                    matched


                    In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






                    share|improve this answer





























                      5














                      I don’t think this is doable with grep, but it is with AWK:



                      #! /usr/bin/awk -f

                      /FOO/
                      matched = 1
                      if (notfirst) print ""
                      notfirst = 1


                      /^$/
                      matched = 0


                      matched


                      With a count of matches:



                      #! /usr/bin/awk -f

                      /FOO/
                      matched = 1
                      if (matches) print ""
                      printf "Match %dn", ++matches


                      /^$/
                      matched = 0


                      matched


                      In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






                      share|improve this answer



























                        5












                        5








                        5







                        I don’t think this is doable with grep, but it is with AWK:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (notfirst) print ""
                        notfirst = 1


                        /^$/
                        matched = 0


                        matched


                        With a count of matches:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (matches) print ""
                        printf "Match %dn", ++matches


                        /^$/
                        matched = 0


                        matched


                        In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






                        share|improve this answer















                        I don’t think this is doable with grep, but it is with AWK:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (notfirst) print ""
                        notfirst = 1


                        /^$/
                        matched = 0


                        matched


                        With a count of matches:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (matches) print ""
                        printf "Match %dn", ++matches


                        /^$/
                        matched = 0


                        matched


                        In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.







                        share|improve this answer














                        share|improve this answer



                        share|improve this answer








                        edited 16 hours ago

























                        answered yesterday









                        Stephen KittStephen Kitt

                        177k24402480




                        177k24402480





















                            2














                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!





                            share|improve this answer




















                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              20 hours ago















                            2














                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!





                            share|improve this answer




















                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              20 hours ago













                            2












                            2








                            2







                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!





                            share|improve this answer















                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!






                            share|improve this answer














                            share|improve this answer



                            share|improve this answer








                            edited yesterday

























                            answered yesterday









                            igaligal

                            5,9611536




                            5,9611536







                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              20 hours ago












                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              20 hours ago







                            1




                            1





                            a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                            – iruvar
                            20 hours ago





                            a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                            – iruvar
                            20 hours ago











                            1














                            awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                            ===match 1===
                            this line contains FOO
                            this line is not blank

                            ===match 2===
                            This line also contains FOO

                            ===match 3===
                            This line contains FOO too
                            Not blank
                            Also not blank

                            ===match 4===
                            FOO!
                            Yet more random text
                            ===match 5===
                            FOO!


                            A similar variant where FOO could be easily changed to something else:



                            awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                            Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






                            share|improve this answer



























                              1














                              awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                              ===match 1===
                              this line contains FOO
                              this line is not blank

                              ===match 2===
                              This line also contains FOO

                              ===match 3===
                              This line contains FOO too
                              Not blank
                              Also not blank

                              ===match 4===
                              FOO!
                              Yet more random text
                              ===match 5===
                              FOO!


                              A similar variant where FOO could be easily changed to something else:



                              awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                              Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






                              share|improve this answer

























                                1












                                1








                                1







                                awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                                ===match 1===
                                this line contains FOO
                                this line is not blank

                                ===match 2===
                                This line also contains FOO

                                ===match 3===
                                This line contains FOO too
                                Not blank
                                Also not blank

                                ===match 4===
                                FOO!
                                Yet more random text
                                ===match 5===
                                FOO!


                                A similar variant where FOO could be easily changed to something else:



                                awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                                Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






                                share|improve this answer













                                awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                                ===match 1===
                                this line contains FOO
                                this line is not blank

                                ===match 2===
                                This line also contains FOO

                                ===match 3===
                                This line contains FOO too
                                Not blank
                                Also not blank

                                ===match 4===
                                FOO!
                                Yet more random text
                                ===match 5===
                                FOO!


                                A similar variant where FOO could be easily changed to something else:



                                awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                                Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)







                                share|improve this answer












                                share|improve this answer



                                share|improve this answer










                                answered yesterday









                                mosvymosvy

                                8,3521732




                                8,3521732





















                                    0














                                    One way can be using Perl's range operator ...:



                                    $ perl -lne '
                                    print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                    ' input.txt

                                    MATCH#1
                                    this line contains FOO
                                    this line is not blank


                                    MATCH#2
                                    This line also contains FOO


                                    MATCH#3
                                    This line contains FOO too
                                    Not blank
                                    Also not blank


                                    MATCH#4
                                    FOO!
                                    Yet more random text

                                    MATCH#5
                                    FOO!


                                    In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                    Note :



                                    $/ = RS = "n"



                                    $, = OFS = ""



                                    $ perl -lne '
                                    print
                                    s^(?=.*FOO)

                                    ($,,$/)[$r>1] .
                                    "MATCH#" . ++$count . $/
                                    rex
                                    if $r = /FOO/ ... /^$/;
                                    ' input.txt


                                    Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                    Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                    $ perl -aln -F'n' -00 -e '
                                    next unless /FOO/;
                                    shift @F until $F[0] =~ /FOO/;
                                    push @F, $, if ! eof;
                                    print "MATCH#", ++$k, $, shift @F;
                                    print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                    ' input.txt





                                    share|improve this answer





























                                      0














                                      One way can be using Perl's range operator ...:



                                      $ perl -lne '
                                      print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                      ' input.txt

                                      MATCH#1
                                      this line contains FOO
                                      this line is not blank


                                      MATCH#2
                                      This line also contains FOO


                                      MATCH#3
                                      This line contains FOO too
                                      Not blank
                                      Also not blank


                                      MATCH#4
                                      FOO!
                                      Yet more random text

                                      MATCH#5
                                      FOO!


                                      In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                      Note :



                                      $/ = RS = "n"



                                      $, = OFS = ""



                                      $ perl -lne '
                                      print
                                      s^(?=.*FOO)

                                      ($,,$/)[$r>1] .
                                      "MATCH#" . ++$count . $/
                                      rex
                                      if $r = /FOO/ ... /^$/;
                                      ' input.txt


                                      Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                      Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                      $ perl -aln -F'n' -00 -e '
                                      next unless /FOO/;
                                      shift @F until $F[0] =~ /FOO/;
                                      push @F, $, if ! eof;
                                      print "MATCH#", ++$k, $, shift @F;
                                      print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                      ' input.txt





                                      share|improve this answer



























                                        0












                                        0








                                        0







                                        One way can be using Perl's range operator ...:



                                        $ perl -lne '
                                        print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                        ' input.txt

                                        MATCH#1
                                        this line contains FOO
                                        this line is not blank


                                        MATCH#2
                                        This line also contains FOO


                                        MATCH#3
                                        This line contains FOO too
                                        Not blank
                                        Also not blank


                                        MATCH#4
                                        FOO!
                                        Yet more random text

                                        MATCH#5
                                        FOO!


                                        In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                        Note :



                                        $/ = RS = "n"



                                        $, = OFS = ""



                                        $ perl -lne '
                                        print
                                        s^(?=.*FOO)

                                        ($,,$/)[$r>1] .
                                        "MATCH#" . ++$count . $/
                                        rex
                                        if $r = /FOO/ ... /^$/;
                                        ' input.txt


                                        Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                        Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                        $ perl -aln -F'n' -00 -e '
                                        next unless /FOO/;
                                        shift @F until $F[0] =~ /FOO/;
                                        push @F, $, if ! eof;
                                        print "MATCH#", ++$k, $, shift @F;
                                        print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                        ' input.txt





                                        share|improve this answer















                                        One way can be using Perl's range operator ...:



                                        $ perl -lne '
                                        print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                        ' input.txt

                                        MATCH#1
                                        this line contains FOO
                                        this line is not blank


                                        MATCH#2
                                        This line also contains FOO


                                        MATCH#3
                                        This line contains FOO too
                                        Not blank
                                        Also not blank


                                        MATCH#4
                                        FOO!
                                        Yet more random text

                                        MATCH#5
                                        FOO!


                                        In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                        Note :



                                        $/ = RS = "n"



                                        $, = OFS = ""



                                        $ perl -lne '
                                        print
                                        s^(?=.*FOO)

                                        ($,,$/)[$r>1] .
                                        "MATCH#" . ++$count . $/
                                        rex
                                        if $r = /FOO/ ... /^$/;
                                        ' input.txt


                                        Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                        Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                        $ perl -aln -F'n' -00 -e '
                                        next unless /FOO/;
                                        shift @F until $F[0] =~ /FOO/;
                                        push @F, $, if ! eof;
                                        print "MATCH#", ++$k, $, shift @F;
                                        print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                        ' input.txt






                                        share|improve this answer














                                        share|improve this answer



                                        share|improve this answer








                                        edited 21 hours ago

























                                        answered yesterday









                                        Rakesh SharmaRakesh Sharma

                                        342115




                                        342115





















                                            0














                                            Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                            gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                            First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                            This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                            gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





                                            share|improve this answer



























                                              0














                                              Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                              gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                              First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                              This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                              gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





                                              share|improve this answer

























                                                0












                                                0








                                                0







                                                Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                                gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                                First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                                This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                                gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





                                                share|improve this answer













                                                Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                                gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                                First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                                This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                                gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt






                                                share|improve this answer












                                                share|improve this answer



                                                share|improve this answer










                                                answered 9 hours ago









                                                nigel222nigel222

                                                1514




                                                1514



























                                                    draft saved

                                                    draft discarded
















































                                                    Thanks for contributing an answer to Unix & Linux Stack Exchange!


                                                    • Please be sure to answer the question. Provide details and share your research!

                                                    But avoid


                                                    • Asking for help, clarification, or responding to other answers.

                                                    • Making statements based on opinion; back them up with references or personal experience.

                                                    To learn more, see our tips on writing great answers.




                                                    draft saved


                                                    draft discarded














                                                    StackExchange.ready(
                                                    function ()
                                                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f507517%2fgrepping-string-but-include-all-non-blank-lines-following-each-grep-match%23new-answer', 'question_page');

                                                    );

                                                    Post as a guest















                                                    Required, but never shown





















































                                                    Required, but never shown














                                                    Required, but never shown












                                                    Required, but never shown







                                                    Required, but never shown

































                                                    Required, but never shown














                                                    Required, but never shown












                                                    Required, but never shown







                                                    Required, but never shown







                                                    Popular posts from this blog

                                                    Àrd-bhaile Cathair chruinne/Baile mòr cruinne | Artagailean ceangailte | Clàr-taice na seòladaireachd

                                                    대한민국 목차 국명 지리 역사 정치 국방 경제 사회 문화 국제 순위 관련 항목 각주 외부 링크 둘러보기 메뉴북위 37° 34′ 08″ 동경 126° 58′ 36″ / 북위 37.568889° 동경 126.976667°  / 37.568889; 126.976667ehThe Korean Repository문단을 편집문단을 편집추가해Clarkson PLC 사Report for Selected Countries and Subjects-Korea“Human Development Index and its components: P.198”“http://www.law.go.kr/%EB%B2%95%EB%A0%B9/%EB%8C%80%ED%95%9C%EB%AF%BC%EA%B5%AD%EA%B5%AD%EA%B8%B0%EB%B2%95”"한국은 국제법상 한반도 유일 합법정부 아니다" - 오마이뉴스 모바일Report for Selected Countries and Subjects: South Korea격동의 역사와 함께한 조선일보 90년 : 조선일보 인수해 혁신시킨 신석우, 임시정부 때는 '대한민국' 국호(國號) 정해《우리가 몰랐던 우리 역사: 나라 이름의 비밀을 찾아가는 역사 여행》“남북 공식호칭 ‘남한’‘북한’으로 쓴다”“Corea 대 Korea, 누가 이긴 거야?”국내기후자료 - 한국[김대중 前 대통령 서거] 과감한 구조개혁 'DJ노믹스'로 최단기간 환란극복 :: 네이버 뉴스“이라크 "韓-쿠르드 유전개발 MOU 승인 안해"(종합)”“해외 우리국민 추방사례 43%가 일본”차기전차 K2'흑표'의 세계 최고 전력 분석, 쿠키뉴스 엄기영, 2007-03-02두산인프라, 헬기잡는 장갑차 'K21'...내년부터 공급, 고뉴스 이대준, 2008-10-30과거 내용 찾기mk 뉴스 - 구매력 기준으로 보면 한국 1인당 소득 3만弗과거 내용 찾기"The N-11: More Than an Acronym"Archived조선일보 최우석, 2008-11-01Global 500 2008: Countries - South Korea“몇년째 '시한폭탄'... 가계부채, 올해는 터질까”가구당 부채 5000만원 처음 넘어서“‘빚’으로 내몰리는 사회.. 위기의 가계대출”“[경제365] 공공부문 부채 급증…800조 육박”“"소득 양극화 다소 완화...불평등은 여전"”“공정사회·공생발전 한참 멀었네”iSuppli,08年2QのDRAMシェア・ランキングを発表(08/8/11)South Korea dominates shipbuilding industry | Stock Market News & Stocks to Watch from StraightStocks한국 자동차 생산, 3년 연속 세계 5위자동차수출 '현대-삼성 웃고 기아-대우-쌍용은 울고' 과거 내용 찾기동반성장위 창립 1주년 맞아Archived"중기적합 3개업종 합의 무시한 채 선정"李대통령, 사업 무분별 확장 소상공인 생계 위협 질타삼성-LG, 서민업종인 빵·분식사업 잇따라 철수상생은 뒷전…SSM ‘몸집 불리기’ 혈안Archived“경부고속도에 '아시안하이웨이' 표지판”'철의 실크로드' 앞서 '말(言)의 실크로드'부터, 프레시안 정창현, 2008-10-01“'서울 지하철은 안전한가?'”“서울시 “올해 안에 모든 지하철역 스크린도어 설치””“부산지하철 1,2호선 승강장 안전펜스 설치 완료”“전교조, 정부 노조 통계서 처음 빠져”“[Weekly BIZ] 도요타 '제로 이사회'가 리콜 사태 불러들였다”“S Korea slams high tuition costs”““정치가 여론 양극화 부채질… 합리주의 절실””“〈"`촛불집회'는 민주주의의 질적 변화 상징"〉”““촛불집회가 민주주의 왜곡 초래””“국민 65%, "한국 노사관계 대립적"”“한국 국가경쟁력 27위‥노사관계 '꼴찌'”“제대로 형성되지 않은 대한민국 이념지형”“[신년기획-갈등의 시대] 갈등지수 OECD 4위…사회적 손실 GDP 27% 무려 300조”“2012 총선-대선의 키워드는 '국민과 소통'”“한국 삶의 질 27위, 2000년과 2008년 연속 하위권 머물러”“[해피 코리아] 행복점수 68점…해외 평가선 '낙제점'”“한국 어린이·청소년 행복지수 3년 연속 OECD ‘꼴찌’”“한국 이혼율 OECD중 8위”“[통계청] 한국 이혼율 OECD 4위”“오피니언 [이렇게 생각한다] `부부의 날` 에 돌아본 이혼율 1위 한국”“Suicide Rates by Country, Global Health Observatory Data Repository.”“1. 또 다른 차별”“오피니언 [편집자에게] '왕따'와 '패거리 정치' 심리는 닮은꼴”“[미래한국리포트] 무한경쟁에 빠진 대한민국”“대학생 98% "외모가 경쟁력이라는 말 동의"”“특급호텔 웨딩·200만원대 유모차… "남보다 더…" 호화病, 고질병 됐다”“[스트레스 공화국] ① 경쟁사회, 스트레스 쌓인다”““매일 30여명 자살 한국, 의사보다 무속인에…””“"자살 부르는 '우울증', 환자 중 85% 치료 안 받아"”“정신병원을 가다”“대한민국도 ‘묻지마 범죄’,안전지대 아니다”“유엔 "학생 '성적 지향'에 따른 차별 금지하라"”“유엔아동권리위원회 보고서 및 번역본 원문”“고졸 성공스토리 담은 '제빵왕 김탁구' 드라마 나온다”“‘빛 좋은 개살구’ 고졸 취업…실습 대신 착취”원본 문서“정신건강, 사회적 편견부터 고쳐드립니다”‘소통’과 ‘행복’에 목 마른 사회가 잠들어 있던 ‘심리학’ 깨웠다“[포토] 사유리-곽금주 교수의 유쾌한 심리상담”“"올해 한국인 평균 영화관람횟수 세계 1위"(종합)”“[게임연중기획] 게임은 문화다-여가활동 1순위 게임”“영화속 ‘영어 지상주의’ …“왠지 씁쓸한데””“2월 `신문 부수 인증기관` 지정..방송법 후속작업”“무료신문 성장동력 ‘차별성’과 ‘갈등해소’”대한민국 국회 법률지식정보시스템"Pew Research Center's Religion & Public Life Project: South Korea"“amp;vwcd=MT_ZTITLE&path=인구·가구%20>%20인구총조사%20>%20인구부문%20>%20 총조사인구(2005)%20>%20전수부문&oper_YN=Y&item=&keyword=종교별%20인구& amp;lang_mode=kor&list_id= 2005년 통계청 인구 총조사”원본 문서“한국인이 좋아하는 취미와 운동 (2004-2009)”“한국인이 좋아하는 취미와 운동 (2004-2014)”Archived“한국, `부분적 언론자유국' 강등〈프리덤하우스〉”“국경없는기자회 "한국, 인터넷감시 대상국"”“한국, 조선산업 1위 유지(S. Korea Stays Top Shipbuilding Nation) RZD-Partner Portal”원본 문서“한국, 4년 만에 ‘선박건조 1위’”“옛 마산시,인터넷속도 세계 1위”“"한국 초고속 인터넷망 세계1위"”“인터넷·휴대폰 요금, 외국보다 훨씬 비싸”“한국 관세행정 6년 연속 세계 '1위'”“한국 교통사고 사망자 수 OECD 회원국 중 2위”“결핵 후진국' 한국, 환자가 급증한 이유는”“수술은 신중해야… 자칫하면 생명 위협”대한민국분류대한민국의 지도대한민국 정부대표 다국어포털대한민국 전자정부대한민국 국회한국방송공사about korea and information korea브리태니커 백과사전(한국편)론리플래닛의 정보(한국편)CIA의 세계 정보(한국편)마리암 부디아 (Mariam Budia),『한국: 하늘이 내린 한 폭의 그림』, 서울: 트랜스라틴 19호 (2012년 3월)대한민국ehehehehehehehehehehehehehehWorldCat132441370n791268020000 0001 2308 81034078029-6026373548cb11863345f(데이터)00573706ge128495

                                                    Cannot Extend partition with GParted The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Community Moderator Election ResultsCan't increase partition size with GParted?GParted doesn't recognize the unallocated space after my current partitionWhat is the best way to add unallocated space located before to Ubuntu 12.04 partition with GParted live?I can't figure out how to extend my Arch home partition into free spaceGparted Linux Mint 18.1 issueTrying to extend but swap partition is showing as Unknown in Gparted, shows proper from fdiskRearrange partitions in gparted to extend a partitionUnable to extend partition even though unallocated space is next to it using GPartedAllocate free space to root partitiongparted: how to merge unallocated space with a partition