Replace anything between parentheses even if spanning multiple lines2019 Community Moderator ElectionHow do I delete the first n lines of an ascii file using shell commands?How to replace text between two markers in a file with a section of text from another file?Delete multiple lines in a fileUsing sed to replace spaces in text files with _ only when between “ ” after specific stringHow to match text between a string and a spaceAppend multiple lines, specified as verbatim bash variable, after a matched line in file?Replace matching parentheses with enclosing contentText Processing - Get 2 lines with exact text between themDeleting parentheses in shell scriptStrings replace in bash using multiple lines pattern
Taxes on Dividends in a Roth IRA
Shouldn’t conservatives embrace universal basic income?
A Trivial Diagnosis
Why does this expression simplify as such?
How could a planet have erratic days?
Pre-mixing cryogenic fuels and using only one fuel tank
Mimic lecturing on blackboard, facing audience
Change the color of a single dot in `ddot` symbol
Can you use Vicious Mockery to win an argument or gain favours?
Quoting Keynes in a lecture
What is the English pronunciation of "pain au chocolat"?
How to draw a matrix with arrows in limited space
Which Article Helped Get Rid of Technobabble in RPGs?
I found an audio circuit and I built it just fine, but I find it a bit too quiet. How do I amplify the output so that it is a bit louder?
Do we have to expect a queue for the shuttle from Watford Junction to Harry Potter Studio?
Will number of steps recorded on FitBit/any fitness tracker add up distance in PokemonGo?
What features enable the Su-25 Frogfoot to operate with such a wide variety of fuels?
How do you make your own symbol when Detexify fails?
What to do when eye contact makes your coworker uncomfortable?
What are some good ways to treat frozen vegetables such that they behave like fresh vegetables when stir frying them?
Why is so much work done on numerical verification of the Riemann Hypothesis?
Non-trope happy ending?
What is the difference between lands and mana?
Why does Carol not get rid of the Kree symbol on her suit when she changes its colours?
Replace anything between parentheses even if spanning multiple lines
2019 Community Moderator ElectionHow do I delete the first n lines of an ascii file using shell commands?How to replace text between two markers in a file with a section of text from another file?Delete multiple lines in a fileUsing sed to replace spaces in text files with _ only when between “ ” after specific stringHow to match text between a string and a spaceAppend multiple lines, specified as verbatim bash variable, after a matched line in file?Replace matching parentheses with enclosing contentText Processing - Get 2 lines with exact text between themDeleting parentheses in shell scriptStrings replace in bash using multiple lines pattern
I would like to use bash or shell script and replace anything between the two parentheses with an empty space. The text between the two parentheses could be in multiple lines, such as:
myFunction (line0
line1
line2
line3
line4)
that I would like to convert to:
myFunction ( )
I appreciate any help. My hope is to use sed
for this purpose.
shell-script text-processing regular-expression
add a comment |
I would like to use bash or shell script and replace anything between the two parentheses with an empty space. The text between the two parentheses could be in multiple lines, such as:
myFunction (line0
line1
line2
line3
line4)
that I would like to convert to:
myFunction ( )
I appreciate any help. My hope is to use sed
for this purpose.
shell-script text-processing regular-expression
2
Did you want to replaceline
withnewline
or prepend/prefix all non-empty lines inside the parentheses withnew
?
– phk
Jan 29 '17 at 12:35
No, indeed I want to replace some text which is sitting between two parentheses in multiple lines with some new text that I am going to read from a second file.
– Armin
Jan 29 '17 at 18:32
You want to convert tomyFunction ( )
or to replace the text with new text that comes from a second file as per your comment above? You talk about two different things.
– George Vasiliou
Jan 29 '17 at 21:58
Eventually I would like to replace the text within the two parentheses with a new text. However, the final replacement is easy. That's why I simplified my question.
– Armin
Jan 29 '17 at 22:06
This has turned into an meta.stackexchange.com/questions/66377/what-is-the-xy-problem/… - tell us what you actually want to do. By all means tell us what you can do yourself.
– icarus
Jan 30 '17 at 3:19
add a comment |
I would like to use bash or shell script and replace anything between the two parentheses with an empty space. The text between the two parentheses could be in multiple lines, such as:
myFunction (line0
line1
line2
line3
line4)
that I would like to convert to:
myFunction ( )
I appreciate any help. My hope is to use sed
for this purpose.
shell-script text-processing regular-expression
I would like to use bash or shell script and replace anything between the two parentheses with an empty space. The text between the two parentheses could be in multiple lines, such as:
myFunction (line0
line1
line2
line3
line4)
that I would like to convert to:
myFunction ( )
I appreciate any help. My hope is to use sed
for this purpose.
shell-script text-processing regular-expression
shell-script text-processing regular-expression
edited Jan 29 '17 at 21:49
Armin
asked Jan 28 '17 at 23:15
ArminArmin
336
336
2
Did you want to replaceline
withnewline
or prepend/prefix all non-empty lines inside the parentheses withnew
?
– phk
Jan 29 '17 at 12:35
No, indeed I want to replace some text which is sitting between two parentheses in multiple lines with some new text that I am going to read from a second file.
– Armin
Jan 29 '17 at 18:32
You want to convert tomyFunction ( )
or to replace the text with new text that comes from a second file as per your comment above? You talk about two different things.
– George Vasiliou
Jan 29 '17 at 21:58
Eventually I would like to replace the text within the two parentheses with a new text. However, the final replacement is easy. That's why I simplified my question.
– Armin
Jan 29 '17 at 22:06
This has turned into an meta.stackexchange.com/questions/66377/what-is-the-xy-problem/… - tell us what you actually want to do. By all means tell us what you can do yourself.
– icarus
Jan 30 '17 at 3:19
add a comment |
2
Did you want to replaceline
withnewline
or prepend/prefix all non-empty lines inside the parentheses withnew
?
– phk
Jan 29 '17 at 12:35
No, indeed I want to replace some text which is sitting between two parentheses in multiple lines with some new text that I am going to read from a second file.
– Armin
Jan 29 '17 at 18:32
You want to convert tomyFunction ( )
or to replace the text with new text that comes from a second file as per your comment above? You talk about two different things.
– George Vasiliou
Jan 29 '17 at 21:58
Eventually I would like to replace the text within the two parentheses with a new text. However, the final replacement is easy. That's why I simplified my question.
– Armin
Jan 29 '17 at 22:06
This has turned into an meta.stackexchange.com/questions/66377/what-is-the-xy-problem/… - tell us what you actually want to do. By all means tell us what you can do yourself.
– icarus
Jan 30 '17 at 3:19
2
2
Did you want to replace
line
with newline
or prepend/prefix all non-empty lines inside the parentheses with new
?– phk
Jan 29 '17 at 12:35
Did you want to replace
line
with newline
or prepend/prefix all non-empty lines inside the parentheses with new
?– phk
Jan 29 '17 at 12:35
No, indeed I want to replace some text which is sitting between two parentheses in multiple lines with some new text that I am going to read from a second file.
– Armin
Jan 29 '17 at 18:32
No, indeed I want to replace some text which is sitting between two parentheses in multiple lines with some new text that I am going to read from a second file.
– Armin
Jan 29 '17 at 18:32
You want to convert to
myFunction ( )
or to replace the text with new text that comes from a second file as per your comment above? You talk about two different things.– George Vasiliou
Jan 29 '17 at 21:58
You want to convert to
myFunction ( )
or to replace the text with new text that comes from a second file as per your comment above? You talk about two different things.– George Vasiliou
Jan 29 '17 at 21:58
Eventually I would like to replace the text within the two parentheses with a new text. However, the final replacement is easy. That's why I simplified my question.
– Armin
Jan 29 '17 at 22:06
Eventually I would like to replace the text within the two parentheses with a new text. However, the final replacement is easy. That's why I simplified my question.
– Armin
Jan 29 '17 at 22:06
This has turned into an meta.stackexchange.com/questions/66377/what-is-the-xy-problem/… - tell us what you actually want to do. By all means tell us what you can do yourself.
– icarus
Jan 30 '17 at 3:19
This has turned into an meta.stackexchange.com/questions/66377/what-is-the-xy-problem/… - tell us what you actually want to do. By all means tell us what you can do yourself.
– icarus
Jan 30 '17 at 3:19
add a comment |
8 Answers
8
active
oldest
votes
AWK
AWK allows executing code-block on range of conditions. In this case, we want to execute
gsub()
on every line in range from the one that contains (
to the one that contains )
.
$ awk '$0~/[(]/,$0~/[)]/gsub(/line/,"newline");1' input.txt
another line
something else
myFunction (newline0
newline1
whatever
newline2
newline3
newline4)
some other line
Python (original answer)
Here's a quick python script that does the job:
#!/usr/bin/env python3
from __future__ import print_function
import sys
with open(sys.argv[1]) as fp:
flag = None
for line in fp:
clean_line = line.strip()
if "(" in clean_line: flag = True
if flag:
clean_line = clean_line.replace("line","newline")
print(clean_line)
if ")" in clean_line: flag = False
Test run:
$ cat input.txt
another line
something else
myFunction (line0
line1
lilne2
line3
line4)
some other line
$ ./edit_function_args.py input.txt
another line
something else
myFunction (newline0
newline1
newline2
newline3
line4)
some other line
BASH version
The same script, except rewritten in bash
with sed
#!/bin/bash
flag=false
while IFS= read -r line
do
if grep -q '(' <<< "$line"
then
flag=true
fi
if $flag
then
line=$(sed 's/line/newline/' <<< "$line")
fi
printf "%sn" "$line"
if grep -q ')' <<< "$line"
then
flag=false
fi
done < "$1"
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
add a comment |
Taking the bash
answer of @Serg and converting it to use bash builtins, rather than 2 or 3 processes per line. Processes are cheap but not free!
#!/bin/bash
# Use shell builtins, read, true, false, printf
flag=false
while IFS= read -r line
do
case "$line" in
(*"("*) flag=true ;;
esac
if $flag
then
line=$line//line/newline
fi
printf "%sn" "$line"
case "$line" in
(*")"*) flag=false ;;
esac
done < "$1"
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
1
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
add a comment |
If perl
solution is okay and file is small enough to be processed as a whole:
$ perl -0777 -pe 's/([^)]+)/$&=~s|line|newline|gr/ge' ip.txt
myFunction (newline0
newline1
newline2
newline3
newline4)
-0777
slurp entire input file([^)]+)
pattern to match -(
followed by non)
characters and ending with)
$&=~s|line|newline|gr
the matched pattern is referenced here using$&
and the desired replacement (line to newline) is done. Note ther
flag to return the result as the replacement stringe
flag allows to use expression instead of string- use
perl -i -0777 -pe
for inplace editing
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
@Armin not sure of your question, something like this?perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
add a comment |
For the question and data as originally presented, a sed 1-liner works
sed '/(/,/)/s/line/newline/g'
which says for each region that starts with a line containing an (
and ends with a line containing a ')', substitute globally line
for newline
. Remove the g
if you only want to change the first line
on an input line.
For the modified question,
sed -e '/(/' -e ':loop;s/(.*)/()/;t;N;b loop' -e ''
works. It loops over the input,printing it until it finds a (
. At this point it tries to change everything inside a (
)
pair including the delimiters to just ()
. If this succeeds it breaks out of the loop, prints the result and continues. If it didn't manage to do so, usually because it hasn't yet seen the )
, it appends the next input line and continues the loop. If you don't want it on one line then writing it as
sed -e '/(/
:loop
s/(.*)/()/
t
N
b loop
'
makes it easier to follow.
Pretty good. Gave me idea for a similarawk
solution.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
1
As data are presented, even ased 's/line/newline/g'
would do the job....
– George Vasiliou
Jan 29 '17 at 1:29
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are noline
before an(
or after a)
that need to be left unchanged.
– icarus
Jan 29 '17 at 1:49
1
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there areline
words that OP might not want to edit or they are outside of parenthesis
– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
1
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognizemyfunction ( line0 , etc)
instead of just(line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
|
show 3 more comments
Using
awk
:awk '
function mysub(str)
if (str) gsub(/line/, "newline", str); return str
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,mysub($2); OFS=FS=")"
else
print mysub($1),$2; OFS=FS="("
next
print FS=="(" ? $0 : mysub($0)
' /path/to/input
The custom function mysub
is where you do the replacements you want to do between the parentheses. The assumption is that parentheses aren't nested.
How it works:
There are two states, inside and outside the parentheses.
- Outside (the starting state), the input and output separator is set to the opening parenthesis (
OFS=FS="("
). - Once it comes across a line with more than one field separated by the input separator (
NF>1
) and…- …you are currently in the outside mode (
FS=="("
), everything before and after the field separator is outputted (with the output separator in-between) but with latter going through the replacement function (mysub($2)
) and then the the mode is flipped by changing the input and output separators (OFS=FS=")"
), - …otherwise (
else
), you are in inside mode, and everything before and after the field separator is outputted but this time with former going through the replacement function (mysub($1)
) and the mode flips here as well.
- …you are currently in the outside mode (
- On all other lines, the whole line is outputted unchanged if outside (
FS=="("
) or otherwise goes as a whole through the replacement function (mysub($0)
).
Compressed into a single line:
awk 'function m(s)gsub(/line/,"newline",s);return sBEGINOFS=FS="("NF>1if(FS=="(")print $1,m($2);OFS=FS=")"elseprint m($1),$2;OFS=FS="("nextprint FS=="("?$0:m($0)' /path/to/input
My trickier test data (which some the one-liner solutions here will fail with):
line96
line97 myFunction (line0
line1
line2
line3
line4) line98
line99
Output for it:
line96
line97 myFunction (newline0
newline1
newline2
newline3
newline4) line98
line99
Variation where everything between the parentheses is deleted instead (except for the first and last line breaks):
awk '
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,""; OFS=FS=")"
else
print "",$2; OFS=FS="("
next
FS=="("' /path/to/input
Output for this one:
line96
line97 myFunction (
) line98
line99
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
add a comment |
Combining all the clarifications, comments and revised data, my offer would be like bellow.
First of all lets consider a source file d.txt
containing your advised myFunction (...)
plus one more function to be more realistic.
To be on the hard side lets suppose that those two functions in this d.txt file have almost identical contents, like this:
$ cat d.txt
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
myFunction (xx as boolean
yy as integer
dd as string
ee as whatever)
Lets suppose now that in another file d2.txt
we have a different function.
$ cat d2.txt
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Forgetting the sample names of line, newline , etc , and considering your comments it seems that what you really want is to replace in your initial source code file d.txt
the existing myFunction (..)
with the BrandNewFunction (...)
present in file d2.txt
.
This can be done easily using pure bash:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)" #isolates myFunction from the source file d.txt
$ b="$(cat d2.txt)" #get contents of file d2.txt (BrandNewFunction)
$ c="$(cat d.txt)" #get the whole source file d.txt
$ echo "$c/$a/$b" #in source file d.txt ($c) replace $a with $b (d2.txt)
#Output:
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Or even as one-liner:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)";b="$(cat d2.txt)";c="$(cat d.txt)";echo "$c/$a/$b"
Above command just prints on your screen the replacement results (echo). To save the results just send echo to >d.txt
for overwritting the existing file or even a new file if you like.
Sed seems not to be quite good to replace multiple lines separated by newlines, since it is focused on line operations.
AWK should be good for the job, but i'm not good in AWK.
Bash is the easiest solution, which can successfully replace multilines.
PS1: If file d2.txt
contains more functions and you want to isolate the BrandNewFunction (..)
, similarly to source file d.txt
you just need to modify the $b variable definition like this:
$ b="$(sed -n '/BrandNewFunction (/,/)/p' d2.txt)"
PS2: If you just want to replace myFunction (...) of source file d.txt with a blank function of the same name, you can just hardcode variable b like this (you know already which function from source file d.txt you want to delete, right?)
$ b="myFunction ( )"
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
|
show 3 more comments
If you also want to process nested parenthesis correctly, use a tool for a context-free language instead of a regular language, for example sgrep:
sgrep -o '%r ' '(start .. end) extracting ("("__")")' < input_file
This way, for example, the following
myFunction (line0
line1
(line2)
line3
line4)
anotherFun (x y)
becomes
myFunction ( )
anotherFun ( )
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
add a comment |
A new version of GNU sed supports the -z option.
Normally, sed reads a line by reading a string of characters up to the end-of-line character (new line or carriage return).
The GNU version of sed added a feature in version 4.2.2 to use the "NULL" character instead. This can be useful if you have files that use the NULL as a record separator. Some GNU utilities can genertae output that uses a NULL instead a new line, such as "find . -print0" or "grep -lZ".
You can use this option when you want sed to work over different lines.
sed -z 's/([^)]*)/( )/g' inputfile
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f340883%2freplace-anything-between-parentheses-even-if-spanning-multiple-lines%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
8 Answers
8
active
oldest
votes
8 Answers
8
active
oldest
votes
active
oldest
votes
active
oldest
votes
AWK
AWK allows executing code-block on range of conditions. In this case, we want to execute
gsub()
on every line in range from the one that contains (
to the one that contains )
.
$ awk '$0~/[(]/,$0~/[)]/gsub(/line/,"newline");1' input.txt
another line
something else
myFunction (newline0
newline1
whatever
newline2
newline3
newline4)
some other line
Python (original answer)
Here's a quick python script that does the job:
#!/usr/bin/env python3
from __future__ import print_function
import sys
with open(sys.argv[1]) as fp:
flag = None
for line in fp:
clean_line = line.strip()
if "(" in clean_line: flag = True
if flag:
clean_line = clean_line.replace("line","newline")
print(clean_line)
if ")" in clean_line: flag = False
Test run:
$ cat input.txt
another line
something else
myFunction (line0
line1
lilne2
line3
line4)
some other line
$ ./edit_function_args.py input.txt
another line
something else
myFunction (newline0
newline1
newline2
newline3
line4)
some other line
BASH version
The same script, except rewritten in bash
with sed
#!/bin/bash
flag=false
while IFS= read -r line
do
if grep -q '(' <<< "$line"
then
flag=true
fi
if $flag
then
line=$(sed 's/line/newline/' <<< "$line")
fi
printf "%sn" "$line"
if grep -q ')' <<< "$line"
then
flag=false
fi
done < "$1"
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
add a comment |
AWK
AWK allows executing code-block on range of conditions. In this case, we want to execute
gsub()
on every line in range from the one that contains (
to the one that contains )
.
$ awk '$0~/[(]/,$0~/[)]/gsub(/line/,"newline");1' input.txt
another line
something else
myFunction (newline0
newline1
whatever
newline2
newline3
newline4)
some other line
Python (original answer)
Here's a quick python script that does the job:
#!/usr/bin/env python3
from __future__ import print_function
import sys
with open(sys.argv[1]) as fp:
flag = None
for line in fp:
clean_line = line.strip()
if "(" in clean_line: flag = True
if flag:
clean_line = clean_line.replace("line","newline")
print(clean_line)
if ")" in clean_line: flag = False
Test run:
$ cat input.txt
another line
something else
myFunction (line0
line1
lilne2
line3
line4)
some other line
$ ./edit_function_args.py input.txt
another line
something else
myFunction (newline0
newline1
newline2
newline3
line4)
some other line
BASH version
The same script, except rewritten in bash
with sed
#!/bin/bash
flag=false
while IFS= read -r line
do
if grep -q '(' <<< "$line"
then
flag=true
fi
if $flag
then
line=$(sed 's/line/newline/' <<< "$line")
fi
printf "%sn" "$line"
if grep -q ')' <<< "$line"
then
flag=false
fi
done < "$1"
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
add a comment |
AWK
AWK allows executing code-block on range of conditions. In this case, we want to execute
gsub()
on every line in range from the one that contains (
to the one that contains )
.
$ awk '$0~/[(]/,$0~/[)]/gsub(/line/,"newline");1' input.txt
another line
something else
myFunction (newline0
newline1
whatever
newline2
newline3
newline4)
some other line
Python (original answer)
Here's a quick python script that does the job:
#!/usr/bin/env python3
from __future__ import print_function
import sys
with open(sys.argv[1]) as fp:
flag = None
for line in fp:
clean_line = line.strip()
if "(" in clean_line: flag = True
if flag:
clean_line = clean_line.replace("line","newline")
print(clean_line)
if ")" in clean_line: flag = False
Test run:
$ cat input.txt
another line
something else
myFunction (line0
line1
lilne2
line3
line4)
some other line
$ ./edit_function_args.py input.txt
another line
something else
myFunction (newline0
newline1
newline2
newline3
line4)
some other line
BASH version
The same script, except rewritten in bash
with sed
#!/bin/bash
flag=false
while IFS= read -r line
do
if grep -q '(' <<< "$line"
then
flag=true
fi
if $flag
then
line=$(sed 's/line/newline/' <<< "$line")
fi
printf "%sn" "$line"
if grep -q ')' <<< "$line"
then
flag=false
fi
done < "$1"
AWK
AWK allows executing code-block on range of conditions. In this case, we want to execute
gsub()
on every line in range from the one that contains (
to the one that contains )
.
$ awk '$0~/[(]/,$0~/[)]/gsub(/line/,"newline");1' input.txt
another line
something else
myFunction (newline0
newline1
whatever
newline2
newline3
newline4)
some other line
Python (original answer)
Here's a quick python script that does the job:
#!/usr/bin/env python3
from __future__ import print_function
import sys
with open(sys.argv[1]) as fp:
flag = None
for line in fp:
clean_line = line.strip()
if "(" in clean_line: flag = True
if flag:
clean_line = clean_line.replace("line","newline")
print(clean_line)
if ")" in clean_line: flag = False
Test run:
$ cat input.txt
another line
something else
myFunction (line0
line1
lilne2
line3
line4)
some other line
$ ./edit_function_args.py input.txt
another line
something else
myFunction (newline0
newline1
newline2
newline3
line4)
some other line
BASH version
The same script, except rewritten in bash
with sed
#!/bin/bash
flag=false
while IFS= read -r line
do
if grep -q '(' <<< "$line"
then
flag=true
fi
if $flag
then
line=$(sed 's/line/newline/' <<< "$line")
fi
printf "%sn" "$line"
if grep -q ')' <<< "$line"
then
flag=false
fi
done < "$1"
edited Jan 29 '17 at 1:15
answered Jan 28 '17 at 23:27
Sergiy KolodyazhnyySergiy Kolodyazhnyy
10.6k42763
10.6k42763
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
add a comment |
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
Thanks! I am going to check it. In the meantime, do you know by chance any way to do the same thing in shell ? This is mainly because the rest of my script is in bash.
– Armin
Jan 28 '17 at 23:35
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin Sure, can be done. I can rewrite my python script in bash+sed or even awk, but I'm kind of running out of time here - have to leave my work in 20 minutes. I'll edit it and post once i get home. OK ?
– Sergiy Kolodyazhnyy
Jan 28 '17 at 23:37
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
@Armin I also threw in an awk version, which is fairly short an simple. Hope that helps
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:15
add a comment |
Taking the bash
answer of @Serg and converting it to use bash builtins, rather than 2 or 3 processes per line. Processes are cheap but not free!
#!/bin/bash
# Use shell builtins, read, true, false, printf
flag=false
while IFS= read -r line
do
case "$line" in
(*"("*) flag=true ;;
esac
if $flag
then
line=$line//line/newline
fi
printf "%sn" "$line"
case "$line" in
(*")"*) flag=false ;;
esac
done < "$1"
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
1
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
add a comment |
Taking the bash
answer of @Serg and converting it to use bash builtins, rather than 2 or 3 processes per line. Processes are cheap but not free!
#!/bin/bash
# Use shell builtins, read, true, false, printf
flag=false
while IFS= read -r line
do
case "$line" in
(*"("*) flag=true ;;
esac
if $flag
then
line=$line//line/newline
fi
printf "%sn" "$line"
case "$line" in
(*")"*) flag=false ;;
esac
done < "$1"
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
1
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
add a comment |
Taking the bash
answer of @Serg and converting it to use bash builtins, rather than 2 or 3 processes per line. Processes are cheap but not free!
#!/bin/bash
# Use shell builtins, read, true, false, printf
flag=false
while IFS= read -r line
do
case "$line" in
(*"("*) flag=true ;;
esac
if $flag
then
line=$line//line/newline
fi
printf "%sn" "$line"
case "$line" in
(*")"*) flag=false ;;
esac
done < "$1"
Taking the bash
answer of @Serg and converting it to use bash builtins, rather than 2 or 3 processes per line. Processes are cheap but not free!
#!/bin/bash
# Use shell builtins, read, true, false, printf
flag=false
while IFS= read -r line
do
case "$line" in
(*"("*) flag=true ;;
esac
if $flag
then
line=$line//line/newline
fi
printf "%sn" "$line"
case "$line" in
(*")"*) flag=false ;;
esac
done < "$1"
answered Jan 29 '17 at 0:49
icarusicarus
6,12111231
6,12111231
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
1
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
add a comment |
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
1
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
Heh, OK, pretty good. I'd want to say that on modern systems with plenty of RAM and multi-core processes multiple processes wouldn't be an issue, but it might be useful on legacy systems.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:10
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
*multi-core processors , small typo there
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:20
1
1
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@Serg, Time it! Multi-core processors don't help as this is all sequential. On a system where each core reports about 5000 bogomips, it takes me about 6 milliseconds to start a sed, read a line, and exit, and 7 milliseconds to start a grep. This assumes that sed and grep are in the system cache. So this means assuming that all other overheads can be ignored you are limited to about 70 lines a second. Because I am ignoring all other overheads I can process at an infinite number of lines a second :-) using shell builtins.
– icarus
Jan 29 '17 at 1:47
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus, how would you change line=$line//line/newline to replace anything in this line with empty space ? Many thanks in advance.
– Armin
Jan 29 '17 at 21:16
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
@icarus Eh . . . I somehow doubt shells , even with built-ins, perform noticeably better. If we want speed and performance, then it's job for C or other compiled language, heck maybe even for Python.
– Sergiy Kolodyazhnyy
Jan 30 '17 at 0:03
add a comment |
If perl
solution is okay and file is small enough to be processed as a whole:
$ perl -0777 -pe 's/([^)]+)/$&=~s|line|newline|gr/ge' ip.txt
myFunction (newline0
newline1
newline2
newline3
newline4)
-0777
slurp entire input file([^)]+)
pattern to match -(
followed by non)
characters and ending with)
$&=~s|line|newline|gr
the matched pattern is referenced here using$&
and the desired replacement (line to newline) is done. Note ther
flag to return the result as the replacement stringe
flag allows to use expression instead of string- use
perl -i -0777 -pe
for inplace editing
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
@Armin not sure of your question, something like this?perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
add a comment |
If perl
solution is okay and file is small enough to be processed as a whole:
$ perl -0777 -pe 's/([^)]+)/$&=~s|line|newline|gr/ge' ip.txt
myFunction (newline0
newline1
newline2
newline3
newline4)
-0777
slurp entire input file([^)]+)
pattern to match -(
followed by non)
characters and ending with)
$&=~s|line|newline|gr
the matched pattern is referenced here using$&
and the desired replacement (line to newline) is done. Note ther
flag to return the result as the replacement stringe
flag allows to use expression instead of string- use
perl -i -0777 -pe
for inplace editing
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
@Armin not sure of your question, something like this?perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
add a comment |
If perl
solution is okay and file is small enough to be processed as a whole:
$ perl -0777 -pe 's/([^)]+)/$&=~s|line|newline|gr/ge' ip.txt
myFunction (newline0
newline1
newline2
newline3
newline4)
-0777
slurp entire input file([^)]+)
pattern to match -(
followed by non)
characters and ending with)
$&=~s|line|newline|gr
the matched pattern is referenced here using$&
and the desired replacement (line to newline) is done. Note ther
flag to return the result as the replacement stringe
flag allows to use expression instead of string- use
perl -i -0777 -pe
for inplace editing
If perl
solution is okay and file is small enough to be processed as a whole:
$ perl -0777 -pe 's/([^)]+)/$&=~s|line|newline|gr/ge' ip.txt
myFunction (newline0
newline1
newline2
newline3
newline4)
-0777
slurp entire input file([^)]+)
pattern to match -(
followed by non)
characters and ending with)
$&=~s|line|newline|gr
the matched pattern is referenced here using$&
and the desired replacement (line to newline) is done. Note ther
flag to return the result as the replacement stringe
flag allows to use expression instead of string- use
perl -i -0777 -pe
for inplace editing
answered Jan 29 '17 at 5:07
SundeepSundeep
7,5161927
7,5161927
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
@Armin not sure of your question, something like this?perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
add a comment |
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
@Armin not sure of your question, something like this?perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
Thanks @Sundeep. Before trying this, please note that I don't know what is the exact value for variable line. How can I say whatever between to parentheses to be replaced by let's say an empty space?
– Armin
Jan 29 '17 at 20:22
@Armin not sure of your question, something like this?
perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
@Armin not sure of your question, something like this?
perl -0777 -pe 's/([^)]+)/( )/g' ip.txt
– Sundeep
Jan 30 '17 at 1:51
add a comment |
For the question and data as originally presented, a sed 1-liner works
sed '/(/,/)/s/line/newline/g'
which says for each region that starts with a line containing an (
and ends with a line containing a ')', substitute globally line
for newline
. Remove the g
if you only want to change the first line
on an input line.
For the modified question,
sed -e '/(/' -e ':loop;s/(.*)/()/;t;N;b loop' -e ''
works. It loops over the input,printing it until it finds a (
. At this point it tries to change everything inside a (
)
pair including the delimiters to just ()
. If this succeeds it breaks out of the loop, prints the result and continues. If it didn't manage to do so, usually because it hasn't yet seen the )
, it appends the next input line and continues the loop. If you don't want it on one line then writing it as
sed -e '/(/
:loop
s/(.*)/()/
t
N
b loop
'
makes it easier to follow.
Pretty good. Gave me idea for a similarawk
solution.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
1
As data are presented, even ased 's/line/newline/g'
would do the job....
– George Vasiliou
Jan 29 '17 at 1:29
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are noline
before an(
or after a)
that need to be left unchanged.
– icarus
Jan 29 '17 at 1:49
1
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there areline
words that OP might not want to edit or they are outside of parenthesis
– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
1
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognizemyfunction ( line0 , etc)
instead of just(line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
|
show 3 more comments
For the question and data as originally presented, a sed 1-liner works
sed '/(/,/)/s/line/newline/g'
which says for each region that starts with a line containing an (
and ends with a line containing a ')', substitute globally line
for newline
. Remove the g
if you only want to change the first line
on an input line.
For the modified question,
sed -e '/(/' -e ':loop;s/(.*)/()/;t;N;b loop' -e ''
works. It loops over the input,printing it until it finds a (
. At this point it tries to change everything inside a (
)
pair including the delimiters to just ()
. If this succeeds it breaks out of the loop, prints the result and continues. If it didn't manage to do so, usually because it hasn't yet seen the )
, it appends the next input line and continues the loop. If you don't want it on one line then writing it as
sed -e '/(/
:loop
s/(.*)/()/
t
N
b loop
'
makes it easier to follow.
Pretty good. Gave me idea for a similarawk
solution.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
1
As data are presented, even ased 's/line/newline/g'
would do the job....
– George Vasiliou
Jan 29 '17 at 1:29
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are noline
before an(
or after a)
that need to be left unchanged.
– icarus
Jan 29 '17 at 1:49
1
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there areline
words that OP might not want to edit or they are outside of parenthesis
– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
1
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognizemyfunction ( line0 , etc)
instead of just(line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
|
show 3 more comments
For the question and data as originally presented, a sed 1-liner works
sed '/(/,/)/s/line/newline/g'
which says for each region that starts with a line containing an (
and ends with a line containing a ')', substitute globally line
for newline
. Remove the g
if you only want to change the first line
on an input line.
For the modified question,
sed -e '/(/' -e ':loop;s/(.*)/()/;t;N;b loop' -e ''
works. It loops over the input,printing it until it finds a (
. At this point it tries to change everything inside a (
)
pair including the delimiters to just ()
. If this succeeds it breaks out of the loop, prints the result and continues. If it didn't manage to do so, usually because it hasn't yet seen the )
, it appends the next input line and continues the loop. If you don't want it on one line then writing it as
sed -e '/(/
:loop
s/(.*)/()/
t
N
b loop
'
makes it easier to follow.
For the question and data as originally presented, a sed 1-liner works
sed '/(/,/)/s/line/newline/g'
which says for each region that starts with a line containing an (
and ends with a line containing a ')', substitute globally line
for newline
. Remove the g
if you only want to change the first line
on an input line.
For the modified question,
sed -e '/(/' -e ':loop;s/(.*)/()/;t;N;b loop' -e ''
works. It loops over the input,printing it until it finds a (
. At this point it tries to change everything inside a (
)
pair including the delimiters to just ()
. If this succeeds it breaks out of the loop, prints the result and continues. If it didn't manage to do so, usually because it hasn't yet seen the )
, it appends the next input line and continues the loop. If you don't want it on one line then writing it as
sed -e '/(/
:loop
s/(.*)/()/
t
N
b loop
'
makes it easier to follow.
edited Jan 30 '17 at 0:21
answered Jan 29 '17 at 0:55
icarusicarus
6,12111231
6,12111231
Pretty good. Gave me idea for a similarawk
solution.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
1
As data are presented, even ased 's/line/newline/g'
would do the job....
– George Vasiliou
Jan 29 '17 at 1:29
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are noline
before an(
or after a)
that need to be left unchanged.
– icarus
Jan 29 '17 at 1:49
1
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there areline
words that OP might not want to edit or they are outside of parenthesis
– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
1
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognizemyfunction ( line0 , etc)
instead of just(line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
|
show 3 more comments
Pretty good. Gave me idea for a similarawk
solution.
– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
1
As data are presented, even ased 's/line/newline/g'
would do the job....
– George Vasiliou
Jan 29 '17 at 1:29
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are noline
before an(
or after a)
that need to be left unchanged.
– icarus
Jan 29 '17 at 1:49
1
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there areline
words that OP might not want to edit or they are outside of parenthesis
– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
1
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognizemyfunction ( line0 , etc)
instead of just(line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
Pretty good. Gave me idea for a similar
awk
solution.– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
Pretty good. Gave me idea for a similar
awk
solution.– Sergiy Kolodyazhnyy
Jan 29 '17 at 1:16
1
1
As data are presented, even a
sed 's/line/newline/g'
would do the job....– George Vasiliou
Jan 29 '17 at 1:29
As data are presented, even a
sed 's/line/newline/g'
would do the job....– George Vasiliou
Jan 29 '17 at 1:29
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are no
line
before an (
or after a )
that need to be left unchanged.– icarus
Jan 29 '17 at 1:49
OK, using the data as presented and the problem description, you need the range limiting. The point of the "data as presented" comment is that it allows us to ignore nesting of parenthesis, and that there are no
line
before an (
or after a )
that need to be left unchanged.– icarus
Jan 29 '17 at 1:49
1
1
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there are
line
words that OP might not want to edit or they are outside of parenthesis– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
@GeorgeVasiliou as presented - yes. But you gotta think one step ahead. OP likely has file with more than just one function. You have to anticipate that there are
line
words that OP might not want to edit or they are outside of parenthesis– Sergiy Kolodyazhnyy
Jan 29 '17 at 2:01
1
1
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognize
myfunction ( line0 , etc)
instead of just (line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
@Serg Yes, sure. I just believe that OP should enrich the question. Even thinking that this is a source code file with lot of functions, the correct question & answer i think should recognize
myfunction ( line0 , etc)
instead of just (line0,etc )
– George Vasiliou
Jan 29 '17 at 8:51
|
show 3 more comments
Using
awk
:awk '
function mysub(str)
if (str) gsub(/line/, "newline", str); return str
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,mysub($2); OFS=FS=")"
else
print mysub($1),$2; OFS=FS="("
next
print FS=="(" ? $0 : mysub($0)
' /path/to/input
The custom function mysub
is where you do the replacements you want to do between the parentheses. The assumption is that parentheses aren't nested.
How it works:
There are two states, inside and outside the parentheses.
- Outside (the starting state), the input and output separator is set to the opening parenthesis (
OFS=FS="("
). - Once it comes across a line with more than one field separated by the input separator (
NF>1
) and…- …you are currently in the outside mode (
FS=="("
), everything before and after the field separator is outputted (with the output separator in-between) but with latter going through the replacement function (mysub($2)
) and then the the mode is flipped by changing the input and output separators (OFS=FS=")"
), - …otherwise (
else
), you are in inside mode, and everything before and after the field separator is outputted but this time with former going through the replacement function (mysub($1)
) and the mode flips here as well.
- …you are currently in the outside mode (
- On all other lines, the whole line is outputted unchanged if outside (
FS=="("
) or otherwise goes as a whole through the replacement function (mysub($0)
).
Compressed into a single line:
awk 'function m(s)gsub(/line/,"newline",s);return sBEGINOFS=FS="("NF>1if(FS=="(")print $1,m($2);OFS=FS=")"elseprint m($1),$2;OFS=FS="("nextprint FS=="("?$0:m($0)' /path/to/input
My trickier test data (which some the one-liner solutions here will fail with):
line96
line97 myFunction (line0
line1
line2
line3
line4) line98
line99
Output for it:
line96
line97 myFunction (newline0
newline1
newline2
newline3
newline4) line98
line99
Variation where everything between the parentheses is deleted instead (except for the first and last line breaks):
awk '
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,""; OFS=FS=")"
else
print "",$2; OFS=FS="("
next
FS=="("' /path/to/input
Output for this one:
line96
line97 myFunction (
) line98
line99
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
add a comment |
Using
awk
:awk '
function mysub(str)
if (str) gsub(/line/, "newline", str); return str
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,mysub($2); OFS=FS=")"
else
print mysub($1),$2; OFS=FS="("
next
print FS=="(" ? $0 : mysub($0)
' /path/to/input
The custom function mysub
is where you do the replacements you want to do between the parentheses. The assumption is that parentheses aren't nested.
How it works:
There are two states, inside and outside the parentheses.
- Outside (the starting state), the input and output separator is set to the opening parenthesis (
OFS=FS="("
). - Once it comes across a line with more than one field separated by the input separator (
NF>1
) and…- …you are currently in the outside mode (
FS=="("
), everything before and after the field separator is outputted (with the output separator in-between) but with latter going through the replacement function (mysub($2)
) and then the the mode is flipped by changing the input and output separators (OFS=FS=")"
), - …otherwise (
else
), you are in inside mode, and everything before and after the field separator is outputted but this time with former going through the replacement function (mysub($1)
) and the mode flips here as well.
- …you are currently in the outside mode (
- On all other lines, the whole line is outputted unchanged if outside (
FS=="("
) or otherwise goes as a whole through the replacement function (mysub($0)
).
Compressed into a single line:
awk 'function m(s)gsub(/line/,"newline",s);return sBEGINOFS=FS="("NF>1if(FS=="(")print $1,m($2);OFS=FS=")"elseprint m($1),$2;OFS=FS="("nextprint FS=="("?$0:m($0)' /path/to/input
My trickier test data (which some the one-liner solutions here will fail with):
line96
line97 myFunction (line0
line1
line2
line3
line4) line98
line99
Output for it:
line96
line97 myFunction (newline0
newline1
newline2
newline3
newline4) line98
line99
Variation where everything between the parentheses is deleted instead (except for the first and last line breaks):
awk '
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,""; OFS=FS=")"
else
print "",$2; OFS=FS="("
next
FS=="("' /path/to/input
Output for this one:
line96
line97 myFunction (
) line98
line99
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
add a comment |
Using
awk
:awk '
function mysub(str)
if (str) gsub(/line/, "newline", str); return str
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,mysub($2); OFS=FS=")"
else
print mysub($1),$2; OFS=FS="("
next
print FS=="(" ? $0 : mysub($0)
' /path/to/input
The custom function mysub
is where you do the replacements you want to do between the parentheses. The assumption is that parentheses aren't nested.
How it works:
There are two states, inside and outside the parentheses.
- Outside (the starting state), the input and output separator is set to the opening parenthesis (
OFS=FS="("
). - Once it comes across a line with more than one field separated by the input separator (
NF>1
) and…- …you are currently in the outside mode (
FS=="("
), everything before and after the field separator is outputted (with the output separator in-between) but with latter going through the replacement function (mysub($2)
) and then the the mode is flipped by changing the input and output separators (OFS=FS=")"
), - …otherwise (
else
), you are in inside mode, and everything before and after the field separator is outputted but this time with former going through the replacement function (mysub($1)
) and the mode flips here as well.
- …you are currently in the outside mode (
- On all other lines, the whole line is outputted unchanged if outside (
FS=="("
) or otherwise goes as a whole through the replacement function (mysub($0)
).
Compressed into a single line:
awk 'function m(s)gsub(/line/,"newline",s);return sBEGINOFS=FS="("NF>1if(FS=="(")print $1,m($2);OFS=FS=")"elseprint m($1),$2;OFS=FS="("nextprint FS=="("?$0:m($0)' /path/to/input
My trickier test data (which some the one-liner solutions here will fail with):
line96
line97 myFunction (line0
line1
line2
line3
line4) line98
line99
Output for it:
line96
line97 myFunction (newline0
newline1
newline2
newline3
newline4) line98
line99
Variation where everything between the parentheses is deleted instead (except for the first and last line breaks):
awk '
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,""; OFS=FS=")"
else
print "",$2; OFS=FS="("
next
FS=="("' /path/to/input
Output for this one:
line96
line97 myFunction (
) line98
line99
Using
awk
:awk '
function mysub(str)
if (str) gsub(/line/, "newline", str); return str
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,mysub($2); OFS=FS=")"
else
print mysub($1),$2; OFS=FS="("
next
print FS=="(" ? $0 : mysub($0)
' /path/to/input
The custom function mysub
is where you do the replacements you want to do between the parentheses. The assumption is that parentheses aren't nested.
How it works:
There are two states, inside and outside the parentheses.
- Outside (the starting state), the input and output separator is set to the opening parenthesis (
OFS=FS="("
). - Once it comes across a line with more than one field separated by the input separator (
NF>1
) and…- …you are currently in the outside mode (
FS=="("
), everything before and after the field separator is outputted (with the output separator in-between) but with latter going through the replacement function (mysub($2)
) and then the the mode is flipped by changing the input and output separators (OFS=FS=")"
), - …otherwise (
else
), you are in inside mode, and everything before and after the field separator is outputted but this time with former going through the replacement function (mysub($1)
) and the mode flips here as well.
- …you are currently in the outside mode (
- On all other lines, the whole line is outputted unchanged if outside (
FS=="("
) or otherwise goes as a whole through the replacement function (mysub($0)
).
Compressed into a single line:
awk 'function m(s)gsub(/line/,"newline",s);return sBEGINOFS=FS="("NF>1if(FS=="(")print $1,m($2);OFS=FS=")"elseprint m($1),$2;OFS=FS="("nextprint FS=="("?$0:m($0)' /path/to/input
My trickier test data (which some the one-liner solutions here will fail with):
line96
line97 myFunction (line0
line1
line2
line3
line4) line98
line99
Output for it:
line96
line97 myFunction (newline0
newline1
newline2
newline3
newline4) line98
line99
Variation where everything between the parentheses is deleted instead (except for the first and last line breaks):
awk '
BEGIN
OFS=FS="("
NF>1
if (FS=="(")
print $1,""; OFS=FS=")"
else
print "",$2; OFS=FS="("
next
FS=="("' /path/to/input
Output for this one:
line96
line97 myFunction (
) line98
line99
edited Jan 30 '17 at 16:22
answered Jan 28 '17 at 23:46
phkphk
4,04852255
4,04852255
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
add a comment |
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
@Armin If this answer solves your problem, would be kind except thanking phk also to accept this answer as a solution.
– George Vasiliou
Jan 29 '17 at 0:49
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
Thanks @phk. Would you lease let me know how in this script could I replace "any thing" (not a specific string), with let's say an empty space. Still I am struggling with replacing anyThingMultiLine with empty space between parentheses. I appreciate your help.
– Armin
Jan 29 '17 at 21:05
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
@Armin See my latest edit of my answer.
– phk
Jan 29 '17 at 21:19
add a comment |
Combining all the clarifications, comments and revised data, my offer would be like bellow.
First of all lets consider a source file d.txt
containing your advised myFunction (...)
plus one more function to be more realistic.
To be on the hard side lets suppose that those two functions in this d.txt file have almost identical contents, like this:
$ cat d.txt
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
myFunction (xx as boolean
yy as integer
dd as string
ee as whatever)
Lets suppose now that in another file d2.txt
we have a different function.
$ cat d2.txt
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Forgetting the sample names of line, newline , etc , and considering your comments it seems that what you really want is to replace in your initial source code file d.txt
the existing myFunction (..)
with the BrandNewFunction (...)
present in file d2.txt
.
This can be done easily using pure bash:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)" #isolates myFunction from the source file d.txt
$ b="$(cat d2.txt)" #get contents of file d2.txt (BrandNewFunction)
$ c="$(cat d.txt)" #get the whole source file d.txt
$ echo "$c/$a/$b" #in source file d.txt ($c) replace $a with $b (d2.txt)
#Output:
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Or even as one-liner:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)";b="$(cat d2.txt)";c="$(cat d.txt)";echo "$c/$a/$b"
Above command just prints on your screen the replacement results (echo). To save the results just send echo to >d.txt
for overwritting the existing file or even a new file if you like.
Sed seems not to be quite good to replace multiple lines separated by newlines, since it is focused on line operations.
AWK should be good for the job, but i'm not good in AWK.
Bash is the easiest solution, which can successfully replace multilines.
PS1: If file d2.txt
contains more functions and you want to isolate the BrandNewFunction (..)
, similarly to source file d.txt
you just need to modify the $b variable definition like this:
$ b="$(sed -n '/BrandNewFunction (/,/)/p' d2.txt)"
PS2: If you just want to replace myFunction (...) of source file d.txt with a blank function of the same name, you can just hardcode variable b like this (you know already which function from source file d.txt you want to delete, right?)
$ b="myFunction ( )"
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
|
show 3 more comments
Combining all the clarifications, comments and revised data, my offer would be like bellow.
First of all lets consider a source file d.txt
containing your advised myFunction (...)
plus one more function to be more realistic.
To be on the hard side lets suppose that those two functions in this d.txt file have almost identical contents, like this:
$ cat d.txt
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
myFunction (xx as boolean
yy as integer
dd as string
ee as whatever)
Lets suppose now that in another file d2.txt
we have a different function.
$ cat d2.txt
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Forgetting the sample names of line, newline , etc , and considering your comments it seems that what you really want is to replace in your initial source code file d.txt
the existing myFunction (..)
with the BrandNewFunction (...)
present in file d2.txt
.
This can be done easily using pure bash:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)" #isolates myFunction from the source file d.txt
$ b="$(cat d2.txt)" #get contents of file d2.txt (BrandNewFunction)
$ c="$(cat d.txt)" #get the whole source file d.txt
$ echo "$c/$a/$b" #in source file d.txt ($c) replace $a with $b (d2.txt)
#Output:
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Or even as one-liner:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)";b="$(cat d2.txt)";c="$(cat d.txt)";echo "$c/$a/$b"
Above command just prints on your screen the replacement results (echo). To save the results just send echo to >d.txt
for overwritting the existing file or even a new file if you like.
Sed seems not to be quite good to replace multiple lines separated by newlines, since it is focused on line operations.
AWK should be good for the job, but i'm not good in AWK.
Bash is the easiest solution, which can successfully replace multilines.
PS1: If file d2.txt
contains more functions and you want to isolate the BrandNewFunction (..)
, similarly to source file d.txt
you just need to modify the $b variable definition like this:
$ b="$(sed -n '/BrandNewFunction (/,/)/p' d2.txt)"
PS2: If you just want to replace myFunction (...) of source file d.txt with a blank function of the same name, you can just hardcode variable b like this (you know already which function from source file d.txt you want to delete, right?)
$ b="myFunction ( )"
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
|
show 3 more comments
Combining all the clarifications, comments and revised data, my offer would be like bellow.
First of all lets consider a source file d.txt
containing your advised myFunction (...)
plus one more function to be more realistic.
To be on the hard side lets suppose that those two functions in this d.txt file have almost identical contents, like this:
$ cat d.txt
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
myFunction (xx as boolean
yy as integer
dd as string
ee as whatever)
Lets suppose now that in another file d2.txt
we have a different function.
$ cat d2.txt
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Forgetting the sample names of line, newline , etc , and considering your comments it seems that what you really want is to replace in your initial source code file d.txt
the existing myFunction (..)
with the BrandNewFunction (...)
present in file d2.txt
.
This can be done easily using pure bash:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)" #isolates myFunction from the source file d.txt
$ b="$(cat d2.txt)" #get contents of file d2.txt (BrandNewFunction)
$ c="$(cat d.txt)" #get the whole source file d.txt
$ echo "$c/$a/$b" #in source file d.txt ($c) replace $a with $b (d2.txt)
#Output:
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Or even as one-liner:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)";b="$(cat d2.txt)";c="$(cat d.txt)";echo "$c/$a/$b"
Above command just prints on your screen the replacement results (echo). To save the results just send echo to >d.txt
for overwritting the existing file or even a new file if you like.
Sed seems not to be quite good to replace multiple lines separated by newlines, since it is focused on line operations.
AWK should be good for the job, but i'm not good in AWK.
Bash is the easiest solution, which can successfully replace multilines.
PS1: If file d2.txt
contains more functions and you want to isolate the BrandNewFunction (..)
, similarly to source file d.txt
you just need to modify the $b variable definition like this:
$ b="$(sed -n '/BrandNewFunction (/,/)/p' d2.txt)"
PS2: If you just want to replace myFunction (...) of source file d.txt with a blank function of the same name, you can just hardcode variable b like this (you know already which function from source file d.txt you want to delete, right?)
$ b="myFunction ( )"
Combining all the clarifications, comments and revised data, my offer would be like bellow.
First of all lets consider a source file d.txt
containing your advised myFunction (...)
plus one more function to be more realistic.
To be on the hard side lets suppose that those two functions in this d.txt file have almost identical contents, like this:
$ cat d.txt
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
myFunction (xx as boolean
yy as integer
dd as string
ee as whatever)
Lets suppose now that in another file d2.txt
we have a different function.
$ cat d2.txt
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Forgetting the sample names of line, newline , etc , and considering your comments it seems that what you really want is to replace in your initial source code file d.txt
the existing myFunction (..)
with the BrandNewFunction (...)
present in file d2.txt
.
This can be done easily using pure bash:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)" #isolates myFunction from the source file d.txt
$ b="$(cat d2.txt)" #get contents of file d2.txt (BrandNewFunction)
$ c="$(cat d.txt)" #get the whole source file d.txt
$ echo "$c/$a/$b" #in source file d.txt ($c) replace $a with $b (d2.txt)
#Output:
myOtherFunction (x as boolean
y as integer
d as string
e as whatever)
BrandNewFunction (xxx as integer
yyy as boolean
ddd as integer
eee as whatever)
Or even as one-liner:
$ a="$(sed -n '/myFunction (/,/)/p' d.txt)";b="$(cat d2.txt)";c="$(cat d.txt)";echo "$c/$a/$b"
Above command just prints on your screen the replacement results (echo). To save the results just send echo to >d.txt
for overwritting the existing file or even a new file if you like.
Sed seems not to be quite good to replace multiple lines separated by newlines, since it is focused on line operations.
AWK should be good for the job, but i'm not good in AWK.
Bash is the easiest solution, which can successfully replace multilines.
PS1: If file d2.txt
contains more functions and you want to isolate the BrandNewFunction (..)
, similarly to source file d.txt
you just need to modify the $b variable definition like this:
$ b="$(sed -n '/BrandNewFunction (/,/)/p' d2.txt)"
PS2: If you just want to replace myFunction (...) of source file d.txt with a blank function of the same name, you can just hardcode variable b like this (you know already which function from source file d.txt you want to delete, right?)
$ b="myFunction ( )"
edited Jan 29 '17 at 23:52
answered Jan 29 '17 at 23:45
George VasiliouGeorge Vasiliou
5,71531030
5,71531030
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
|
show 3 more comments
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin This solution should cover you entirely.
– George Vasiliou
Jan 29 '17 at 23:54
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Armin It would be kind to leave a comment just to advise what made you unaccept this answer. It would help me to improve future answers on similar posts.
– George Vasiliou
Jan 31 '17 at 18:30
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Georges, indeed I used parts of your code to complete mine. Specially sed -n idea was very good. I didn't do a copy-past of the entire thing that you proposed, by I certainly used part of it. Please accept my apologies if I miss something as I am really new in this community. Thanks anyways for all your very useful advices.
– Armin
Jan 31 '17 at 22:24
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin Ok. I just got happy yesterday to see that you accepted my answer as a solution (maybe by mistake) and got unhappy today to see that my answer was unaccepted. Anyway, is your right to accept the best answer for you.
– George Vasiliou
Jan 31 '17 at 22:32
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
@Armin I think that you also changed the accepted answer again. Yesterday you accept my answer, this afternoon you unaccept my answer and you accept the perl solution of Sundeep and now i can see that you also unaccept Sundeep solution and you accepted dirkt solution. You can upvote all solutions if you like them but you can accept only one solution. Do not hop around :-)
– George Vasiliou
Jan 31 '17 at 22:37
|
show 3 more comments
If you also want to process nested parenthesis correctly, use a tool for a context-free language instead of a regular language, for example sgrep:
sgrep -o '%r ' '(start .. end) extracting ("("__")")' < input_file
This way, for example, the following
myFunction (line0
line1
(line2)
line3
line4)
anotherFun (x y)
becomes
myFunction ( )
anotherFun ( )
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
add a comment |
If you also want to process nested parenthesis correctly, use a tool for a context-free language instead of a regular language, for example sgrep:
sgrep -o '%r ' '(start .. end) extracting ("("__")")' < input_file
This way, for example, the following
myFunction (line0
line1
(line2)
line3
line4)
anotherFun (x y)
becomes
myFunction ( )
anotherFun ( )
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
add a comment |
If you also want to process nested parenthesis correctly, use a tool for a context-free language instead of a regular language, for example sgrep:
sgrep -o '%r ' '(start .. end) extracting ("("__")")' < input_file
This way, for example, the following
myFunction (line0
line1
(line2)
line3
line4)
anotherFun (x y)
becomes
myFunction ( )
anotherFun ( )
If you also want to process nested parenthesis correctly, use a tool for a context-free language instead of a regular language, for example sgrep:
sgrep -o '%r ' '(start .. end) extracting ("("__")")' < input_file
This way, for example, the following
myFunction (line0
line1
(line2)
line3
line4)
anotherFun (x y)
becomes
myFunction ( )
anotherFun ( )
answered Jan 30 '17 at 18:59
dirktdirkt
17.3k31338
17.3k31338
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
add a comment |
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @dirkt. Unfortunately still I don't have sgrep on my machine properly installed.
– Armin
Jan 30 '17 at 22:37
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
Thanks @everyone. Eventually I had to use a combination of the solutions and tricks that you had proposed. Here is the algorithm that I implemented successfully in bash: (a) read line by line the file to detect myFunction and its contents, (b) commented myFunction using sed, (c) inserted new myFunction in the right place using a combination of sed and print.
– Armin
Jan 31 '17 at 21:22
add a comment |
A new version of GNU sed supports the -z option.
Normally, sed reads a line by reading a string of characters up to the end-of-line character (new line or carriage return).
The GNU version of sed added a feature in version 4.2.2 to use the "NULL" character instead. This can be useful if you have files that use the NULL as a record separator. Some GNU utilities can genertae output that uses a NULL instead a new line, such as "find . -print0" or "grep -lZ".
You can use this option when you want sed to work over different lines.
sed -z 's/([^)]*)/( )/g' inputfile
add a comment |
A new version of GNU sed supports the -z option.
Normally, sed reads a line by reading a string of characters up to the end-of-line character (new line or carriage return).
The GNU version of sed added a feature in version 4.2.2 to use the "NULL" character instead. This can be useful if you have files that use the NULL as a record separator. Some GNU utilities can genertae output that uses a NULL instead a new line, such as "find . -print0" or "grep -lZ".
You can use this option when you want sed to work over different lines.
sed -z 's/([^)]*)/( )/g' inputfile
add a comment |
A new version of GNU sed supports the -z option.
Normally, sed reads a line by reading a string of characters up to the end-of-line character (new line or carriage return).
The GNU version of sed added a feature in version 4.2.2 to use the "NULL" character instead. This can be useful if you have files that use the NULL as a record separator. Some GNU utilities can genertae output that uses a NULL instead a new line, such as "find . -print0" or "grep -lZ".
You can use this option when you want sed to work over different lines.
sed -z 's/([^)]*)/( )/g' inputfile
A new version of GNU sed supports the -z option.
Normally, sed reads a line by reading a string of characters up to the end-of-line character (new line or carriage return).
The GNU version of sed added a feature in version 4.2.2 to use the "NULL" character instead. This can be useful if you have files that use the NULL as a record separator. Some GNU utilities can genertae output that uses a NULL instead a new line, such as "find . -print0" or "grep -lZ".
You can use this option when you want sed to work over different lines.
sed -z 's/([^)]*)/( )/g' inputfile
answered yesterday
Walter AWalter A
514210
514210
add a comment |
add a comment |
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f340883%2freplace-anything-between-parentheses-even-if-spanning-multiple-lines%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
Did you want to replace
line
withnewline
or prepend/prefix all non-empty lines inside the parentheses withnew
?– phk
Jan 29 '17 at 12:35
No, indeed I want to replace some text which is sitting between two parentheses in multiple lines with some new text that I am going to read from a second file.
– Armin
Jan 29 '17 at 18:32
You want to convert to
myFunction ( )
or to replace the text with new text that comes from a second file as per your comment above? You talk about two different things.– George Vasiliou
Jan 29 '17 at 21:58
Eventually I would like to replace the text within the two parentheses with a new text. However, the final replacement is easy. That's why I simplified my question.
– Armin
Jan 29 '17 at 22:06
This has turned into an meta.stackexchange.com/questions/66377/what-is-the-xy-problem/… - tell us what you actually want to do. By all means tell us what you can do yourself.
– icarus
Jan 30 '17 at 3:19