Provide UTF-8 variants for all existing locales. The data is derived
from the Unicode Common Locale Data Repository.

Convert non-UTF-8 versions from the UTF-8 version using iconv and some
ad-hoc transliterations using sed.

Use EUR as currency_symbol in ISO8859-1.

Invert the Norwegian handling. no_NO is an alias for nb_NO as the latter
is used e.g. in CLDR.

Provide the Serbian locales in both Cyrilic and Latin script versions.
The alias is choosen based on the character set for the non-UTF-8 case
and Cyrillic is the default for UTF-8.

branches: 1.29.6; 1.29.12;
Add support for fr_*.UTF-8 locale. Setting LANG to fr_*.UTF-8 won't get
the message catalog right (they're encoded in iso-8859-1), but other locale
functions should work right.
Proposed on tech-userlevel on 20 May 2009.

Fixes PR lib/39662, shortcomings in LC_{MONETARY,NUMERIC,TIME,MESSAGES} db format.
ok'ed by core and releng.
(thanks for agc@, snj@ and i'm sorry for long time patience).

[libc]
- localeio.[ch] and lc*.[ch] in src/lib/libc/locale was replaced by
new locale-db implementation using citrus_db backend,
see src/lib/libc/citrus/citrus_lc_*.[ch].
- add citrus_bcs_strtou?l.c. don't use strtou?l locale implementation
internally, because they're locale-aware function.
- add some stubs for multi-locale issue, see {current,global}_locale.c.
- remove some obsolete file, setrunelocale.c, ___runetype_mb.c.
- remove __savectype() from ctypeio.[ch].

[tools]
- mklocale(1): add new option ``-t'' that generates new style
LC_{MONETARY,NUMERIC,TIME,MESSAGES} locale-db format.
- chrtbl(1): added ctypeio.[ch] for __savectype().

[locale-db]
- added en_US.US-ASCII locale.
- removed some shareable locale definition file:
en_US.US-ASCII -> en_US.ISO8859-1, en_US.UTF-8
zh_CN.eucCN -> zh_CN.GB18030
and more...see src/share/locale/*/Makefile.
- remove obsoleted locale sr_YU, added new locale sr_ME, sr_RS.
- change locale name ja_JP.ISO2022-JP* -> ja_JP.ISO-2022-JP*
for X11's locale.alias file alignments.
- fix regression test, wrong wcs?width(3), NAN/INF usage.

i tested release-build following arch:
i386, amd64, hpc{mips,arm,sh}, sparc64, vax.

citrus_lc_*.[ch] also can read old-plain-text style locale-db.
so that backward compatibility is keeped, but lc*.[ch] can't read
new citrus_db'ed locale-db and localeio.c never check sanity,
so forward compatibility is broken ;-<

old mklocale(1) doesn't know -t option, so you have to rebuild toolchain.

branches: 1.27.2;
Use ${TOOL_SED} instead if plain sed in Makefiles.

add tr_TR.ISO8859-9 locale.

add nn_NO(Nynorsk) and nb_NO(Bokmal) locale.

add zh_HK.Big5-HKSCS locale, derrived from FreeBSD.

add kk_KZ.PT154 locale and iconv support for PTCP154.

add following locales:
af_AZ.ISO8859-1/15
be_BY.ISO8859-5
en_NZ.ISO8859-1/15
et_EE.ISO8859-15
eu_ES.ISO8859-1/15
pt_BR.ISO8859-1
ro_RO.ISO8859-2
sr_YU.ISO8859-2/5
ukUA.CP1251/ISO8859-5

added be_BY.CP1251, ru_BY.CP1251, ru_RU.CP1251 locale.
requested by cheusov AT tut DOT by, thanks.

remove ko_KR.UTF-8.
this locale is alias for en_US.UTF-8 by locale.alias now.

Remove support for ALIASES in share/locale/ctype/Makefile, which
created symlinks in the filesystem. Put the one existing alias
(zh_TW.BIG5) into the newer locale.alias file.

Rework how MAKEVERBOSE operates:

* Don't bother prefixing commands with a line of ${_MKCMD}\
and instead rely upon "make -s". This is less intrusive on
all the Makefiles than the former. Idea from David Laight.

* Rename the variables use to print messages. The scheme now is:
_MKMSG_FOO Run _MKMSG 'foo'
_MKTARGET_FOO Run _MKMSG_FOO ${.TARGET}
From discussion with Alistair Crooks.

implement MAKEVERBOSE

Sort unsorted entries in last commit.

Sort entries by name.

Add UTF-8 ctype locale support for Korean.

From Min Sik Kim <minskim bawi org>. tshiozak@ ok.

add new locales - bg_BG.CP1251 el_GR.ISO8859-7 hy_AM.ARMSCII-8 lt_LT.ISO8859-13
These are obtained from FreeBSD. Thanks!

Rename a large chunk of the make(1) variables which refer to a
program/tool from "FOO" to "TOOL_FOO". The new variables are:
TOOL_ASN1_COMPILE TOOL_CAP_MKDB TOOL_CAT TOOL_CKSUM TOOL_COMPILE_ET
TOOL_CONFIG TOOL_CRUNCHGEN TOOL_CTAGS TOOL_DB TOOL_EQN TOOL_FGEN
TOOL_GENCAT TOOL_GROFF TOOL_HEXDUMP TOOL_INDXBIB TOOL_INSTALLBOOT
TOOL_INSTALL_INFO TOOL_M4 TOOL_MAKEFS TOOL_MAKEINFO TOOL_MAKEWHATIS
TOOL_MDSETIMAGE TOOL_MENUC TOOL_MKCSMAPPER TOOL_MKESDB
TOOL_MKLOCALE TOOL_MKMAGIC TOOL_MKTEMP TOOL_MSGC TOOL_MTREE
TOOL_PAX TOOL_PIC TOOL_PREPMKBOOTIMAGE TOOL_PWD_MKDB TOOL_REFER
TOOL_ROFF_ASCII TOOL_ROFF_DVI TOOL_ROFF_HTML TOOL_ROFF_PS
TOOL_ROFF_RAW TOOL_RPCGEN TOOL_SOELIM TOOL_SUNLABEL TOOL_TBL
TOOL_UUDECODE TOOL_VGRIND TOOL_ZIC

For each, provide default in <bsd.sys.mk> of the form:
TOOL_FOO?= foo
and for the ${USETOOLS}=="yes" case in <bsd.own.mk>, provide override:
TOOL_FOO= ${TOOLDIR}/bin/${_TOOL_PREFIX}foo

Document all of these in bsd.README.

This cleans up a chunk of potential (and actual) namespace collision
within our build infrastructure, as well as improves consistency in
the share/mk documentation and provision of appropriate defaults for
each of these variables.

Finally add complete support for Catalan (ca_ES, ca) LC_CTYPE and libc
catalog messages.
Thanks to salo for letting me know what was missing.

add support for zh_CN.GB18030 locale.
(lib/20835 by sigsegv at s25 dot xrea dot com)
XXX: charclass for GBK compatible area is not supported.

use NETBSDSRCDIR as appropriate

Use ${CPP}, not cpp.

add LC_CTYPE for sk_SK.ISO8859-2, by Lubomir Sedlacik.

branches: 1.6.2;
Set NOxxx= before <bsd.own.mk> is pulled in (even indirectly).
Otherwise the appropriate MKxxx=no won't be defined .

MKfoo=no -> NOfoo

Remove UTF-2. UTF-2 is superceded by UTF-8.
see also:
http://mail-index.netbsd.org/tech-userlevel/2001/03/30/0000.html
http://mail-index.netbsd.org/tech-userlevel/2001/03/30/0001.html
http://mail-index.netbsd.org/tech-userlevel/2001/03/30/0002.html

support nl_langinfo(CODESET).

integrate Makefile.inc and Makefile. use bsd.files.mk to avoid installation
with cmp(1).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

integrate Makefile.inc and Makefile. use bsd.files.mk to avoid installation
with cmp(1).

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

supply ru_RU.* LC_CTYPE locales.
From: Patrick Welche <prlw1@newn.cam.ac.uk>

move src/share/mklocale into src/share/locale/ctype. PR 11838.

for platforms that has problem with c++ comment, switch to good old /* */

branches: 1.2.2;
change comment style: # -> //

add new locales - bg_BG.CP1251 el_GR.ISO8859-7 hy_AM.ARMSCII-8 lt_LT.ISO8859-13
These are obtained from FreeBSD. Thanks!

branches: 1.1.2;
add new locales - bg_BG.CP1251 el_GR.ISO8859-7 hy_AM.ARMSCII-8 lt_LT.ISO8859-13
These are obtained from FreeBSD. Thanks!

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.3.2;
Add character 0xbe (uppercase Y diaeresis) to UPPER chars.
Fixes misc/15363 by Joachim Kuebart.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

fix XDIGIT problem on several locales,
pointed by Joerg Sonnenberger on tech-userlevel@.

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

fix XDIGIT problem on several locales,
pointed by Joerg Sonnenberger on tech-userlevel@.

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

Remove UTF-2. UTF-2 is superceded by UTF-8.
see also:
http://mail-index.netbsd.org/tech-userlevel/2001/03/30/0000.html
http://mail-index.netbsd.org/tech-userlevel/2001/03/30/0001.html
http://mail-index.netbsd.org/tech-userlevel/2001/03/30/0002.html

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

Update to Unicode 16.0

Based on perl 5.42.0.

branches: 1.10.2;
Update Unicode tables to 15.0.0.

This is based on the tables provided by perl 5.37.7.

Update Unicode tables.

These tables are for Unicode 14.0.0 using the data provided with
perl 5.36.0.

Update unicode tables.

This version of the file, and the generator script, come from
OpenBSD. The script was written by Andrew Fresh.

The file covers the encodings from Unicode 13.0.0, based on the files
distributed with perl 5.32.1.

branches: 1.7.2;
Add "Emoji & Pictographs" character definitions from Unicode 15.0.0
(previously 10.0.0):

http://www.unicode.org/charts/

They are classified as PUNCT, which has been used for characters other
than blank, alphabetic, or digit ones.

Glyph widths are taken from "East Asian Width":

https://www.unicode.org/Public/15.0.0/ucd/EastAsianWidth.txt

Characters of "F" or "W" are classified to SWIDTH2, and others are to
SWIDTH1, as usual. See also:

https://www.unicode.org/reports/tr11/

XXX
It would be really nice if someone could check and update characters in
categories other than Emoji...

Add characters in "Emoji & Pictographs" from Unicode 10.0.0:
http://www.unicode.org/charts/

They are classified as PUNCT, which is historically used for characters other
than blank, alphabetic, or digit ones.

Glyph widths are taken from "East Asian Width":
https://www.unicode.org/Public/10.0.0/ucd/EastAsianWidth.txt
Characters of "F" or "W" are classified to SWIDTH2, and others are classified
to SWIDTH1, as implicitly done in the previous revisions.

Should address problems like PR bin/53323.

Discussed with soda@. We thank Takuya SHIOZAKI (tshiozak@) for useful comments.

branches: 1.5.30;
fix PR lib/46772 wcwidth of combining characters.
patch probyted by yamt@, thanks.

branches: 1.4.48;
merge resent FreeBSD UTF-8 locale.
now support outside BMP area.

Replace with a much better one which covers the whole Unicode range,
from U+0000 to U+FFFF.

Contributed by Hye-Shik Chang <perky@freebsd.org>. Thanks, perky!

branches: 1.2.2;
support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

sync with OpenBSD: whitespace change only

branches: 1.2.2; 1.2.4;
Add NetBSD RCS Id header instead of OpenBSD one.

Update unicode tables.

This version of the file, and the generator script, come from
OpenBSD. The script was written by Andrew Fresh.

The file covers the encodings from Unicode 13.0.0, based on the files
distributed with perl 5.32.1.

for platforms that has problem with c++ comment, switch to good old /* */

branches: 1.3.2;
use the correct comment style...

change comment style: # -> //

add new locales - bg_BG.CP1251 el_GR.ISO8859-7 hy_AM.ARMSCII-8 lt_LT.ISO8859-13
These are obtained from FreeBSD. Thanks!

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

1. make fullwidth space as printble(also blank).
suggested by yamt-san.
2. JISX0201 2/1 - 2/5 is not phonogram, change it as punct.

fix XDIGIT problem on several locales,
pointed by Joerg Sonnenberger on tech-userlevel@.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

1. make fullwidth space as printble(also blank).
suggested by yamt-san.
2. JISX0201 2/1 - 2/5 is not phonogram, change it as punct.

To prevent ctype predicate functions (e.g. isalpha()) to misjudge,
change the charset mask for G2 (JIS X 0201 kana), from 0x80 to 0x800080.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add kk_KZ.PT154 locale and iconv support for PTCP154.

catch up KS X 1001:2002: added U+327E - CIRCLED HANGUL IEUNG U.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

for platforms that has problem with c++ comment, switch to good old /* */

branches: 1.2.2;
change comment style: # -> //

add new locales - bg_BG.CP1251 el_GR.ISO8859-7 hy_AM.ARMSCII-8 lt_LT.ISO8859-13
These are obtained from FreeBSD. Thanks!

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

move src/share/mklocale into src/share/locale/ctype. PR 11838.

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

move src/share/mklocale into src/share/locale/ctype. PR 11838.

ru_SU locales are deprecated, ru_RU is now correct one.
rename LC_CTYPE locale declarations and vi message catalog.

From: Oleg Polyanski <luke@jetinf.com>

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tr_TR.ISO8859-9 locale.

for platforms that has problem with c++ comment, switch to good old /* */

If we're preprocessing with cpp, it's not a very good idea to use
"#" as a comment character; use "//" in those places, instead.

branches: 1.2.2;
support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

- support for the additional code area of zh_CN.GB18030 locale,
- make sure that __nbrune_t is unsigned 32bit clean and
- fix wrong copyright notice in the last commit.
this patch is contributed by Takehiko NOZAKI <sigsegv at s25 dot xrea dot com>.

add support for zh_CN.GB18030 locale.
(lib/20835 by sigsegv at s25 dot xrea dot com)
XXX: charclass for GBK compatible area is not supported.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add zh_HK.Big5-HKSCS locale, derrived from FreeBSD.

fix invalid range.

fix invalid range.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

corrrect invalid charset mask.

1. added CNS11643 plane 3 <-> UCS iconv data.
2. zh_TW.eucTW locale now supports CNS11643 plane 3 ~ 7

fix invalid charset-bit.

add csmapper:CNS11643-1,2 and esdb:ISO-2022-CN,
integrate esdb:EUC-TW, locale:zh_TW.eucTW.

support nl_langinfo(CODESET).

move src/share/mklocale into src/share/locale/ctype. PR 11838.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

1. make fullwidth space as printble(also blank).
suggested by yamt-san.
2. JISX0201 2/1 - 2/5 is not phonogram, change it as punct.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

1. make fullwidth space as printble(also blank).
suggested by yamt-san.
2. JISX0201 2/1 - 2/5 is not phonogram, change it as punct.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

1. make fullwidth space as printble(also blank).
suggested by yamt-san.
2. JISX0201 2/1 - 2/5 is not phonogram, change it as punct.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

catch up KS X 1001:2002: added U+327E - CIRCLED HANGUL IEUNG U.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.

add tab and several characters to BLANK and SPACE classes on the Latin
charsets to make up for shortages.
pointed out by Joerg Sonnenberger.

move src/share/mklocale into src/share/locale/ctype. PR 11838.