Difference between revisions of "Sed"

From Blue-IT.org Wiki
(→‎Cut a certain passage out of a file)
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== Save search and replace ==
 
== Save search and replace ==
 +
The following snippet does a save - in term of special characters - search and replace with sed.
  
−
  search="$(printf "%s\n" "src=\"${SUBDIR}" | sed 's/[][\.*^$/]/\\&/g')"
+
  search="$(printf "%s\n" "SEARCHSTRING" | sed 's/[][\.*^$/]/\\&/g')"
−
  replace="$(printf "%s\n" "src=\"${ANOTHER_DIR}/${SUBDIR}" | sed 's/[][\.*^$/]/\\&/g')"
+
  replace="$(printf "%s\n" "REPLACESTRING" | sed 's/[][\.*^$/]/\\&/g')"
 
  sed "s/${search}/${replace}/g" "${DOC}"
 
  sed "s/${search}/${replace}/g" "${DOC}"
 +
 +
Or, if you prefere to use a function:
 +
 +
# Search and replace text in a document
 +
# param1: search string
 +
# param2: replace string
 +
# param3: the document URL
 +
search_replace(){
 +
 +
    search="$(printf "%s\n" "${1}" | sed 's/[][\.*^$/]/\\&/g')"
 +
    replace="$(printf "%s\n" "${2}" | sed 's/[][\.*^$/]/\\&/g')"
 +
    sed -i "s/${search}/${replace}/g" "${3}"
 +
 +
}
 +
 +
[...]
 +
 +
search_replace "SEARCHSTRING" "REPLACESTRING" "DOCUMENT_URL"
  
 
== Cut a certain passage out of a file ==
 
== Cut a certain passage out of a file ==
Line 13: Line 32:
 
</h1>
 
</h1>
 
<div id=content>
 
<div id=content>
−
  <div id=abstract>
+
  <div id=abstract>
 
   Lorem ipsum dolor sit amet, consetetur sadipscing elitr,
 
   Lorem ipsum dolor sit amet, consetetur sadipscing elitr,
−
   sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat,  
+
   sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat,
−
   sed diam voluptua.  
+
   sed diam voluptua.'''
−
  </div>
+
  </div>
 
  At vero eos et accusam et justo duo dolores et ea rebum.  
 
  At vero eos et accusam et justo duo dolores et ea rebum.  
 
  Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.  
 
  Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.  
Line 28: Line 47:
 
</nowiki></pre>
 
</nowiki></pre>
  
−
We like to cut out the ''abstract'' and get:
+
We like to '''cut out the <abstract>''' and get:
  
 
<pre><nowiki>
 
<pre><nowiki>
Line 45: Line 64:
 
</nowiki></pre>
 
</nowiki></pre>
  
−
The next snippet searches for the first (!) - and only the first - occurence of the Expression "FIRST_TEXT_FRAGMENT" and then, from that line on to the first occurence of "LAST_TEXT_FRAGMENT". It then cuts the out with ''sed''.
+
The next snippet searches for the first (!) - and only the first - occurence of the Expression "FIRST_TEXT_FRAGMENT" and then, from that line on to the first occurence of "LAST_TEXT_FRAGMENT". It then cuts the lines between these two - including the found lines (!) - out with ''sed''.
  
 
<pre><nowiki>
 
<pre><nowiki>
 
ARTICLE="${1}"
 
ARTICLE="${1}"
−
 
−
cat "${ARTICLE}" > tmp1
 
−
LENGTH=$(wc "${ARTICLE}" | awk '{print $1}')
 
−
LENGTH=$(expr ${LENGTH} - 1)
 
−
echo "Length: ${LENGTH}"
 
  
 
FIRST_TEXT_FRAGMENT="<div id=abstract>"
 
FIRST_TEXT_FRAGMENT="<div id=abstract>"
 
LAST_TEXT_FRAGMENT="</div>"
 
LAST_TEXT_FRAGMENT="</div>"
−
+
 
 +
cat "${ARTICLE}" > tmp1
 
BEGIN_CUT=$(cat tmp1 | fgrep -n --max-count=1 "${FIRST_TEXT_FRAGMENT}" | cut -d':' -f1)
 
BEGIN_CUT=$(cat tmp1 | fgrep -n --max-count=1 "${FIRST_TEXT_FRAGMENT}" | cut -d':' -f1)
 
BEGIN_CUT=$(expr ${BEGIN_CUT})
 
BEGIN_CUT=$(expr ${BEGIN_CUT})
−
echo ${BEGIN_CUT}
 
  
−
END_CUT=$(cat tmp1 | sed -e "${BEGIN_CUT},${LENGTH}d" | fgrep -n --max-count=1 "${LAST_TEXT_FRAGMENT}" | cut -d':' -f1)
+
END_CUT=$(cat tmp1 | sed -e "1,${BEGIN_CUT}d" | fgrep -n --max-count=1 "${LAST_TEXT_FRAGMENT}" | cut -d':' -f1)
−
END_CUT=$(expr ${END_CUT} - 1 + ${BEGIN_CUT})
+
END_CUT=$(expr ${END_CUT} + ${BEGIN_CUT})
−
echo ${END_CUT}
 
  
 
cat tmp1 | sed -e "${BEGIN_CUT},${END_CUT}d" > tmp2
 
cat tmp1 | sed -e "${BEGIN_CUT},${END_CUT}d" > tmp2
−
rm tmp1
 
 
</nowiki></pre>
 
</nowiki></pre>
 +
 +
 +
=== Search for a string and replace the beginning of a line ===
 +
 +
sed -n '/SEARCH_STRING/{s|^|//|};p' myfile.php
 +
 +
sed '/SEARCH_STRING/s|^|//|' file

Latest revision as of 12:56, 8 June 2016

Save search and replace

The following snippet does a save - in term of special characters - search and replace with sed. 

search="$(printf "%s\n" "SEARCHSTRING" | sed 's/[][\.*^$/]/\\&/g')"
replace="$(printf "%s\n" "REPLACESTRING" | sed 's/[][\.*^$/]/\\&/g')"
sed "s/${search}/${replace}/g" "${DOC}"

Or, if you prefere to use a function: 

# Search and replace text in a document
# param1: search string
# param2: replace string
# param3: the document URL
search_replace(){

   search="$(printf "%s\n" "${1}" | sed 's/[][\.*^$/]/\\&/g')"
   replace="$(printf "%s\n" "${2}" | sed 's/[][\.*^$/]/\\&/g')"
   sed -i "s/${search}/${replace}/g" "${3}"

}

[...]

search_replace "SEARCHSTRING" "REPLACESTRING" "DOCUMENT_URL"

Cut a certain passage out of a file

Let's assume we have the following sample text: 

<h1 class = title>
 Lorem ipsum
</h1>
<div id=content>
   <div id=abstract>
   Lorem ipsum dolor sit amet, consetetur sadipscing elitr,
   sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat,
   sed diam voluptua.''' 
   </div>
 At vero eos et accusam et justo duo dolores et ea rebum. 
 Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet. 
 Lorem ipsum dolor sit amet, consetetur sadipscing elitr, 
 sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat,
 sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. 
 Stet clita kasd gubergren, 
 no sea takimata sanctus est Lorem ipsum dolor sit amet.
</div>

We like to cut out the <abstract> and get: 

<h1 class = title>
 Lorem ipsum
</h1> 
<div id=content>
 At vero eos et accusam et justo duo dolores et ea rebum. 
 Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet. 
 Lorem ipsum dolor sit amet, consetetur sadipscing elitr, 
 sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat,
 sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. 
 Stet clita kasd gubergren, 
 no sea takimata sanctus est Lorem ipsum dolor sit amet.
</div>

The next snippet searches for the first (!) - and only the first - occurence of the Expression "FIRST_TEXT_FRAGMENT" and then, from that line on to the first occurence of "LAST_TEXT_FRAGMENT". It then cuts the lines between these two - including the found lines (!) - out with sed. 

ARTICLE="${1}"

FIRST_TEXT_FRAGMENT="<div id=abstract>"
LAST_TEXT_FRAGMENT="</div>"

cat "${ARTICLE}" > tmp1
BEGIN_CUT=$(cat tmp1 | fgrep -n --max-count=1 "${FIRST_TEXT_FRAGMENT}" | cut -d':' -f1)
BEGIN_CUT=$(expr ${BEGIN_CUT})

END_CUT=$(cat tmp1 | sed -e "1,${BEGIN_CUT}d" | fgrep -n --max-count=1 "${LAST_TEXT_FRAGMENT}" | cut -d':' -f1)
END_CUT=$(expr ${END_CUT} + ${BEGIN_CUT})

cat tmp1 | sed -e "${BEGIN_CUT},${END_CUT}d" > tmp2


Search for a string and replace the beginning of a line

sed -n '/SEARCH_STRING/{s|^|//|};p' myfile.php

sed '/SEARCH_STRING/s|^|//|' file
Retrieved from "https://wiki.blue-it.org/index.php?title=Sed&oldid=6156"