bug-bash
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: bash-4.3: casemod word expansions broken with UTF-8


From: Ulrich Mueller
Subject: Re: bash-4.3: casemod word expansions broken with UTF-8
Date: Sun, 15 Nov 2015 17:56:59 +0100

>>>>> On Sun, 15 Nov 2015, Ulrich Mueller wrote:

> Description:
>       In an UTF-8 locale like en_US.UTF-8, the case-modifying
>       parameter expansions sometimes return invalid UTF-8 encodings.

>       This seems to happen when the UTF-8 byte sequences that are
>       encoding upper and lower case have different lengths.

Even more interesting effects happen if the string contains a
character whose UTF-8 encoding gets *longer* after case conversion,
because then the terminating null byte will be overwritten.

For example, U+0250 "LATIN SMALL LETTER TURNED A" is represented by a
two byte sequence in UTF-8, while its uppercase equivalent U+2C6F
needs three bytes:

        $ LC_ALL=en_US.UTF-8
        $ x=$'aaaaa\xc9\x90'
        $ y=${x^^}
        $ echo -n "$y" | od -t x1
        0000000 41 41 41 41 41 e2 90 af 6f 6d 65 2f 75 6c 6d
        0000017

y contains some trailing garbage (could be a part of $HOME or $PWD).



reply via email to

[Prev in Thread] Current Thread [Next in Thread]