Revert the duplication of compat set lists; do it another way.

1. Restore the compatdir and compatfile tags in base and debug.

=> compatdir marks directories that should have per-ABI compat
subdirectories, like /usr/lib having /usr/lib/o32 and
/usr/lib/64 on mips64.

=> compatfile marks files that have per-ABI versions in the
nearest compatdir, like /usr/lib/o32/libc.so.12.221.

This is the mechanism we use to avoid duplicating every library
that has a compat version in multiple set lists.

2. Teach sets.subr to split the compatdir and compatfile entries out
into separate sets for base and debug.

The mechanism is to internally use:

- a new tag `omitcompat' when processing base and debug, so we
don't generate the per-ABI compat directories or per-ABI compat
files under them;

- a new tag `takecompat=${ABI}' when processing base32/64 and
debug32/64, so we _do_ generate the per-ABI compat directories
for ${ABI}.

=> On, e.g., mips64, base32 uses `takecompat=o32' and base64
uses `takecompat=64'.

=> On, e.g., aarch64, base32 uses
`takecompat=eabi,takecompat=eabihf', and there is no base64.

3. Record in sets.subr the list of `32' and `64' architectures for
each port.

This is maybe not the right place to put it, but it's also not
clear that we want to keep exactly this division -- maybe it would
be more sensible to just have per-ABI , e.g.:

(aarch64) base-eabi, base-eabihf
(amd64) base-i386
(mips64) base-o32, base-64
(mipsn64) base-o32, base-n32

But I'll leave cleaning that up for another day.

4. Adjust some sets. Mostly this commit shouldn't change what file
go in what sets, but, e.g., on mips64, the following move from
base32 to base64 as part of this change, which I think is
appropriate:

- /lib/64
- /libexec/ld.elf_so-64
- /usr/lib/64
- /usr/libdata/debug/lib/64
- /usr/libdata/debug/usr/lib/64
- /usr/libexec/ld.elf_so-64

TBD: Remove ./lib and ./usr/lib from debug/mi; they're already in
base/mi. Maybe move ./usr/libdata/debug to from base/mi to debug/mi.

This reverts most of the set list changes in:

https://mail-index.netbsd.org/source-changes/2024/04/09/msg150763.html

PR misc/58365

branches: 1.94.2;
Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

lists: Remove more bogus shlib obsolete entries.

Too much trouble to have to remember about libuv.so, libgmp.so, &c.
Just apply the rule uniformly.

All that's left is test libraries and loadable modules.

Searched with:

git grep 'lib.*\.so\.[0-9][0-9]*.*obsolete' distrib/sets/lists \
| grep -v '/modules/' \
| grep -v '/locale/lib/' \
| grep -v '/lib/npf/' \
| grep -v '/lib/librump' \
| grep -v '/lib/netbsd/libclang_rt' \
| grep -v '/runemodule/'

more updates for sets and GCC 12

- renable sanitizer, add new shlib versions, enable tsan for arm64,
including moving some stuff into the per-cpu/arch dir from 'mi'.
- fix mips64, 68k, and ia64
- mark many any-gcc-version things just as "gcc" and remove dups
- mark many gcc=9 only things as obsolete
- mark many gcc=10 only things as obsolete with gcc=12 (more could
be done here.)

various updates for GCC 12

- bump some shlibs
- add new header files
- add compiler-version header files
- disable sanitizer libraries for gcc12 for now

openssl: Nix capi.so engine -- it's for the Windows crypto API.

Not likely to work in NetBSD base!

openssl: Fix typo in mips set list.

openssl: padlock.so engine for VIA CPUs makes sense only on x86.

openssl: Wire up dynamic engine build goo.

This restores the devcrypto engine, which was converted from static
to dynamic since the previous OpenSSL update.

XXX Pretty sure I got some of the set list package names wrong, but
it's not clear what the right ones are or what consequences any of
this has.

XXX Needs testing.

Revert "openssl: Nix build goo for dynamically loaded engines."

Turns out there is a regression lurking here: the devcrypto engine
was made dynamic-only (https://github.com/openssl/openssl/pull/7859),
so to maintain that functionality, we need to build dynamic engines.
Will fix the aarch64 build issue and wire things up separately.

openssl: Nix build goo for dynamically loaded engines.

- Engines are deprecated in openssl 3.

- We never actually had the .so engines wired up to be built in
openssl 1.1, and judging by the lack of obsolete entries in the set
lists, I don't think we ever had them wired up to be built at all.

fix mips OpenSSL-3.x compat

branches: 1.83.6;
Choose the right compat sets for the platform:
mipsn64 -> o32 n32
mips64 -> o32 64

various updates for GCC 10 support. remove dead gcc7/8 support
and properly mark obsolete files in gcc9/gcc10.

testing on amd64 and shark for GCC 9, and many platforms for GCC 10,
(though not arm yet.)

fix mips and powerpc GCC 9 builds.

gcc 8 set lists updates. i don't appear to have broken gcc 7 builds
but i only tested a couple of them.

- add new entries of gcc=7 and libgomp, libasan, liblsan, libstdc++, libubsan
- add missing header files fpr gcc=7
- add some missing gcc=5 obsolete entries
- create ./usr/include/dev/bluetooth in mtree not make, and move it into the
base set where all other directories are.

- mark gcc=5 files obsolete
- make includes always available, not only when gcccmds
- mark files obsolete consistently

branches: 1.77.2; 1.77.4;
obsolete some GCC 4.8 files.

updates for GCC 6.4: add gcc-6 specific headers, combine some
all-gcc files, bump the shlib versions on new libs.

convert HAVE_GCC handling to modern GCC release numbering:
- HAVE_GCC=5 is now the default (vs. HAVE_GCC=53 we've been using for
GCC 5.4 and GCC 5.5.)
- remove some more GCC 4.8 code. we don't support GCC 4 here.
- adjust set lists to gcc=5 from gcc=53.

add some basic HAVE_GCC=6 handling (totally unused so far.)

Sort the unsorted sets lists (they should all be correctly sorted now.)

we build libc_fp for mips64* only, adjust sets accordingly.

build and install libc_fp on mips
use with LD_PRELOAD=/lib/libc_fp.so for FPU use via softfloat

branches: 1.71.2;
fix sets for mips64 builds (libgomp is not built for N64)
and also for GCC 5.

Update some of the set lists to use the compatdir/compatfile
compattestsdir/compattestsfile as well the kmod auto-entry creation.
Remove entries that are now instantiated by the above.

bump libintl

Fix sets for mips64

bump liblzma

bump libssh

bump libpcap.

stuff added by blacklist

bump libamu.

bump libc for strtoi and strtou

Update of OpenSSL to 1.0.1k part 3:
- bump the shared library versions
- adjust set lists
- regenerate man pages
- note the import in doc/3RDPARTY and doc/CHANGES

there were no changes in asm parts

bump libmagic

remove obsolete entries for libisccfg which are not.

bump for bind update

Consistently tag libasan with gcc=48

Add libasan

bump libssh

bump libc and add man pages for open_{,w}memstream

bump libstdc++ minor due to new complex etc functions enabled.

bump libm for long double complex functions

add execvpe,execlpe bump.

add strnstr from FreeBSD

sort

branches: 1.48.2;
merge openssl 1.0.1i

Update set lists for libc bump and new man pages.

introduce a new pci_drvname(3) to libpci. implement it in the backend
via PCI_IOC_DRVNAME.

update manual and set lists (and remove a couple of doubled entries.)o

this will be used in libpciaccess() to implement the has_kernel_driver()
method.

fixed removal of Lua 5.1 entries from distrib/sets/lists

lua: updated from 5.1 to 5.3 work3

* lua(1):
- changed lua_Integer to intmax_t
- updated distrib/sets/lists and etc/mtree
- updated bsd.lua.mk
- fixed bozohttpd (lua-bozo.c)
- compatibilized bindings: gpio, sqlite
* lua(4):
- removed floating-point and libc dependencies using '#ifndef _KERNEL'
- fixed division by zero and exponentiation
- libkern: added isalnum(), iscntrl(), isgraph(), isprint() and ispunct()
- acpica: removed isprint() from acnetbsd.h
- libc: moved strcspn.c, strpbrk.c and strspn.c to common
- removed stub headers
- compatibilized bindings: luapmf, luasystm
* reorganized luaconf.h
* updated doc/CHANGES and doc/RESPONSIBLE

infrastructure for bind-9.10.0-P2:
adding the tools delv and dnssec-importkey
adding libirs to support delv

bump libc.

Add asysctl(3) and asysctlbyname(3) wrappers for the common idiom of
fetching dynamically sized data via sysctl.

Update for OpenLDAP 2.4.39.

libossaudio minor version bump to signify new ioctls.

sort

branches: 1.37.2;
bump libssl

Fix compat libelf version numbers

Fix typo in library version.

bump libelf and libdwarf

Replace all the libbind9.so.7 with libbind9.so.8.
Hmm... why isn't the list of 32bit compat libs based on the normal list?

bump bind libraries

bump sqlite3

Update file lists for atf 0.19.

This has been tested with both MKKYUA=no (the default) and MKKYUA=yes, as
well as with a non-clean tree and a clean build. Hopefully I got the
details right... but they were tricky!

bump libc for ___lwp_park60

Finish updating set lists for libc minor bump.

bump openssl libraries

bump libc for ptsname_r

bump libisc for new bind

fix mips64 sets for GCC 4.8.

Add the syslog(3) Lua binding to the build.

bump libssh

more sets fixes (libgomp, libobjc)

add support for GCC 4.8 sets.

sort

bump libc

Add liblutok.so.2.

Also mark liblutok.so.1 as obsolete. While this should not be done in the
general case, I think it's fine here because MKKYUA still defaults to NO
and therefore lutok is not built by default.

bump for binutils

Update set lists after libc minor bump.

Sort entries in strcmp order.

More libbind9 set listupdates, for mips64

Update sets lists for new bind9 and friends.

lists for new bind 9.9.3-P2

Collapse all the ad.mips* set lists into a single ad.mips which works for
all variations of mips{,64}e{b,l}

branches: 1.9.8; 1.9.10; 1.9.14; 1.9.16; 1.9.22;
Remove LKMs and switch to the module framework, pass 1.

Proposed on tech-kern@.

branches: 1.8.36; 1.8.48;
reformat whitespace

Install the kernel linker script in /usr/lkm/ldscript so that modload(8)
works without needing to resort to -A abuse. LKMs work cleanly on MIPS
now.

Now that LKMs work all over, bring the VFS LKMs and if_ipl LKM to mi list from
arch ones. Also make all VFS LKMs 'base-vfs-lkm'.

MIPS has LKM's now.

ld.so is only for 1.3 binary compatibility, and will become part of the
soon to be created compat13 pkg.

move crtn.o to comp set

Remove /sbin/ldconfig - not used on mips ports anymore

Do datbase normalization on sets/lists/*/* containing shared-library
related files. Partition into three categories:
* shl.mi -- MI sharedlib files present on all ports with shared libs
* shl.aout -- MI sharedlib files present on all ELF ports
* shl.elf -- MI sharedlib files present on all a.out ports

Add rudimentary shl* support to makeflist.
Remove files left empty after shlib normalization.
Add ad.mips where appropriate.
Make libc, libedit numbers consistent (libc.so.12.29, libedit.2.1).