Languages that accept characters beyond ASCII (Was RE: Veering)

[Joel Rees <rees@server.mediafusion.co.jp>]

Steve Rowe clarified:

> John Cowan wrote:
> > Perl 5.6 AFAIK is still ASCII-only.
>
> Perl understands UTF-8, though full Unicode support is not yet
> implemented.
>
> From the Perl 5.6.0 perlunicode manpage:
>
> - Identifiers within the Perl script may contain Unicode alphanumeric
> characters, including ideographs.
>
> - Character classes in regular expressions match characters instead of
> bytes, and match against the character properties specified in the
> Unicode properties database. So \w can be used to match an ideograph,
> for instance.
>
> Steve

Just a reminder, but the meaning for \w, \s, etc., (ergo, the concept of a
delimiter) for plain text is drastically different for human languages which
use ideographs.

When discussing the use of ideographs as tag names and other
programmatically parsed identifiers, we must be careful to make the
distinction between the human languages on the one hand, and the artificial
languages which are borrowing characters from the human languages on the
other.

(I understand that many early attempts to use Japanese in programming
languages tried to use natural Japanese parsing, and thus earned Japanese
characters a reputation for seriously slowing compilers down.)

Joel Rees
programmer -- rees@mediafusion.co.jp
----------------------------------------------------
To be a tree supporting all information,
  giving root to the chaos
    and branches to the trivia,
      information breathing anew --
        This is the aim of Yggdrasill.
============================XML as Best Solution===
Media Fusion Co. ,Ltd.  株式会社メディアフュージョン
Amagasaki  TEL 81-6-6415-2560    FAX 81-6-6415-2556
    Tokyo　TEL 81-3-3516-2566  　FAX 81-3-3516-2567
                       http://www.mediafusion.co.jp
===================================================