Newlines in BSD sed vs gsed The 2019 Stack Overflow Developer Survey Results Are InInsert after a second pattern in sedHow can I instruct BSD sed to interpret escape sequences like n and t?sed on OSX insert at a certain lineadd newlines in .cshrc command outputAre there standard versions of `sed` on which `-E` is unsupported?Using sed command arguments to be compatible with both GNU & BSD Unix (in-place editing)Using BSD jot for generating file with random contentHow to add some text before another with sed in FreeBSD?Does Apple modify the GNU and BSD tools that comes with macOS?Are there multiple flavors of the GNU tools?

Does coating your armor in silver add any effects?

Falsification in Math vs Science

Landlord wants to switch my lease to a "Land contract" to "get back at the city"

Geography at the pixel level

Can you compress metal and what would be the consequences?

What do hard-Brexiteers want with respect to the Irish border?

Is "plugging out" electronic devices an American expression?

Are there any other methods to apply to solving simultaneous equations?

Output the Arecibo Message

Return to UK after having been refused entry years ago

Identify boardgame from Big movie

Shouldn't "much" here be used instead of "more"?

Deal with toxic manager when you can't quit

Aging parents with no investments

Time travel alters history but people keep saying nothing's changed

How technical should a Scrum Master be to effectively remove impediments?

Why is the Constellation's nose gear so long?

Does the shape of a die affect the probability of a number being rolled?

Can a flute soloist sit?

If I score a critical hit on an 18 or higher, what are my chances of getting a critical hit if I roll 3d20?

Is there a symbol for a right arrow with a square in the middle?

Ubuntu Server install with full GUI

What could be the right powersource for 15 seconds lifespan disposable giant chainsaw?

What does ひと匙 mean in this manga and has it been used colloquially?



Newlines in BSD sed vs gsed



The 2019 Stack Overflow Developer Survey Results Are InInsert after a second pattern in sedHow can I instruct BSD sed to interpret escape sequences like n and t?sed on OSX insert at a certain lineadd newlines in .cshrc command outputAre there standard versions of `sed` on which `-E` is unsupported?Using sed command arguments to be compatible with both GNU & BSD Unix (in-place editing)Using BSD jot for generating file with random contentHow to add some text before another with sed in FreeBSD?Does Apple modify the GNU and BSD tools that comes with macOS?Are there multiple flavors of the GNU tools?



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








7















The sed, which comes with FreeBSD 11.2 p7, gives:



 $ seq 10 | sed 'N; l; D; p'
1$
2$
2$
3$
3$
4$
4$
5$
5$
6$
6$
7$
7$
8$
8$
9$
9$
10$


While gsed (GNU sed 4.7) gives for the same script:



$ seq 10 | gsed 'N; l; D; p'
1n2$
2n3$
3n4$
4n5$
5n6$
6n7$
7n8$
8n9$
9n10$
10


How can we explain this difference in behavior?










share|improve this question






























    7















    The sed, which comes with FreeBSD 11.2 p7, gives:



     $ seq 10 | sed 'N; l; D; p'
    1$
    2$
    2$
    3$
    3$
    4$
    4$
    5$
    5$
    6$
    6$
    7$
    7$
    8$
    8$
    9$
    9$
    10$


    While gsed (GNU sed 4.7) gives for the same script:



    $ seq 10 | gsed 'N; l; D; p'
    1n2$
    2n3$
    3n4$
    4n5$
    5n6$
    6n7$
    7n8$
    8n9$
    9n10$
    10


    How can we explain this difference in behavior?










    share|improve this question


























      7












      7








      7








      The sed, which comes with FreeBSD 11.2 p7, gives:



       $ seq 10 | sed 'N; l; D; p'
      1$
      2$
      2$
      3$
      3$
      4$
      4$
      5$
      5$
      6$
      6$
      7$
      7$
      8$
      8$
      9$
      9$
      10$


      While gsed (GNU sed 4.7) gives for the same script:



      $ seq 10 | gsed 'N; l; D; p'
      1n2$
      2n3$
      3n4$
      4n5$
      5n6$
      6n7$
      7n8$
      8n9$
      9n10$
      10


      How can we explain this difference in behavior?










      share|improve this question
















      The sed, which comes with FreeBSD 11.2 p7, gives:



       $ seq 10 | sed 'N; l; D; p'
      1$
      2$
      2$
      3$
      3$
      4$
      4$
      5$
      5$
      6$
      6$
      7$
      7$
      8$
      8$
      9$
      9$
      10$


      While gsed (GNU sed 4.7) gives for the same script:



      $ seq 10 | gsed 'N; l; D; p'
      1n2$
      2n3$
      3n4$
      4n5$
      5n6$
      6n7$
      7n8$
      8n9$
      9n10$
      10


      How can we explain this difference in behavior?







      sed gnu newlines bsd






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Mar 30 at 17:18









      Jeff Schaller

      44.9k1164147




      44.9k1164147










      asked Mar 30 at 17:02









      wolf-revo-catswolf-revo-cats

      8851035




      8851035




















          1 Answer
          1






          active

          oldest

          votes


















          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer




















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "106"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f509606%2fnewlines-in-bsd-sed-vs-gsed%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer




















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34
















          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer




















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34














          8












          8








          8







          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer















          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.







          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited Mar 30 at 17:43

























          answered Mar 30 at 17:15









          KusalanandaKusalananda

          141k17262438




          141k17262438







          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34













          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34








          2




          2





          Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

          – Stéphane Chazelas
          Mar 30 at 17:29






          Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

          – Stéphane Chazelas
          Mar 30 at 17:29














          @StéphaneChazelas Thanks. I did not notice that difference at first.

          – Kusalananda
          Mar 30 at 17:31





          @StéphaneChazelas Thanks. I did not notice that difference at first.

          – Kusalananda
          Mar 30 at 17:31













          Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

          – Stéphane Chazelas
          Mar 30 at 17:34






          Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

          – Stéphane Chazelas
          Mar 30 at 17:34


















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Unix & Linux Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f509606%2fnewlines-in-bsd-sed-vs-gsed%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Triangular numbers and gcdProving sum of a set is $0 pmod n$ if $n$ is odd, or $fracn2 pmod n$ if $n$ is even?Is greatest common divisor of two numbers really their smallest linear combination?GCD, LCM RelationshipProve a set of nonnegative integers with greatest common divisor 1 and closed under addition has all but finite many nonnegative integers.all pairs of a and b in an equation containing gcdTriangular Numbers Modulo $k$ - Hit All Values?Understanding the Existence and Uniqueness of the GCDGCD and LCM with logical symbolsThe greatest common divisor of two positive integers less than 100 is equal to 3. Their least common multiple is twelve times one of the integers.Suppose that for all integers $x$, $x|a$ and $x|b$ if and only if $x|c$. Then $c = gcd(a,b)$Which is the gcd of 2 numbers which are multiplied and the result is 600000?

          Ingelân Ynhâld Etymology | Geografy | Skiednis | Polityk en bestjoer | Ekonomy | Demografy | Kultuer | Klimaat | Sjoch ek | Keppelings om utens | Boarnen, noaten en referinsjes Navigaasjemenuwww.gov.ukOffisjele webside fan it regear fan it Feriene KeninkrykOffisjele webside fan it Britske FerkearsburoNederlânsktalige ynformaasje fan it Britske FerkearsburoOffisjele webside fan English Heritage, de organisaasje dy't him ynset foar it behâld fan it Ingelske kultuergoedYnwennertallen fan alle Britske stêden út 'e folkstelling fan 2011Notes en References, op dizze sideEngland

          Boston (Lincolnshire) Stedsbyld | Berne yn Boston | NavigaasjemenuBoston Borough CouncilBoston, Lincolnshire