openssh: Install libssh.so in /usr/lib/private.

This way it doesn't get exposed to applications accidentally, and we
don't need to worry about breaking ABI when updating openssh in base.

PR lib/58648: private shared libraries should go in /usr/lib/private,
not /usr/lib

smb is no more.

Redo the sshsk_sign() stuff properly, but putting the helper in libssh.so

Unfortunately libssh has an undefined symbol sshsk_sign(), which is provided
by different implementations depending if we are a server or a client. While
the clients we compile in, provide that symbol, it is getting hidden by
crunchhide, so we provide it again. It would have been a lot simpler to
use a function pointer instead in the library...

1. Remove all the special handling of variables (-d -p -P -s -S) that
were dealing with DBG (-d) LDSTATIC/NOPIE (-p), and the rest with
disabling/enabling sanitizers.
2. Use emalloc/estrdup for all the allocators instead of only some cases.
3. Add -V varspec which passes variables on the command line (as DBG
and LDSTATIC used to be passed before) instead of appending them
to the on-the-fly Makefile using -v varspec.
4. Change the distrib and rescue Makefiles to use -V instead of the removed
flags.

The motivation of this is to make variable handling consistent, less magical,
and remove the need for changing crunchgen each time we want to add disabling
an option by default.

(as proposed in tech-toolchain)

Remove ldconfig from /rescue, and mark it MI obsolete.

- ldconfig in netbsd refers to a.out binaries only. We've been ELF-only
since NetBSD 2.0 or so, and having it in /rescue served little purpose
even before that, as /rescue is standalone.
- Using MI obsolete to avoid the need for MD set lists where ldconfig
is the sole entry

branches: 1.37.2;
fix duplicated chunk from merge

Merge the [pgoyette-compat] branch

Specify NOLIBCSANITIZER for rescue

The rescue image could be sanitized with a sanitizer in libc, but it's left
for future as a possible research.

branches: 1.34.2;
Set NOSANITIZER in rescue/Makefile

This is required to stop sanitizing rcmd.o and liboverride.o. These object
files will be linked into statically linked rescue.

branches: 1.33.2;
Extra flags for static PIE

Remove MKCRYPTO option.

Originally, MKCRYPTO was introduced because the United States
classified cryptography as a munition and restricted its export. The
export controls were substantially relaxed fifteen years ago, and are
essentially irrelevant for software with published source code.

In the intervening time, nobody bothered to remove the option after
its motivation -- the US export restriction -- was eliminated. I'm
not aware of any other operating system that has a similar option; I
expect it is mainly out of apathy for churn that we still have it.
Today, cryptography is an essential part of modern computing -- you
can't use the internet responsibly without cryptography.

The position of the TNF board of directors is that TNF makes no
representation that MKCRYPTO=no satisfies any country's cryptography
regulations.

My personal position is that the availability of cryptography is a
basic human right; that any local laws restricting it to a privileged
few are fundamentally immoral; and that it is wrong for developers to
spend effort crippling cryptography to work around such laws.

As proposed on tech-crypto, tech-security, and tech-userlevel to no
objections:

https://mail-index.netbsd.org/tech-crypto/2017/05/06/msg000719.html
https://mail-index.netbsd.org/tech-security/2017/05/06/msg000928.html
https://mail-index.netbsd.org/tech-userlevel/2017/05/06/msg010547.html

P.S. Reviewing all the uses of MKCRYPTO in src revealed a lot of
*bad* crypto that was conditional on it, e.g. DES in telnet... That
should probably be removed too, but on the grounds that it is bad,
not on the grounds that it is (nominally) crypto.

Append -Os to DBG, not overwrite in case DBG has more than just -Ox from
sys.mk

mount_smbfs has moved.

descend to bin for pdisk

pdisk has moved to external/bsd - try to deal.

branches: 1.27.6; 1.27.12; 1.27.18;
Relegate edlabel to use in extremely memory constrained install
ramdisks and prefer disklabel elsewhere.
Based on discussion on affected port lists (port-sparc port-sparc64
port-sun3 port-sun2 port-atari port-mvme68k).
All listed ports plus amd64 test built after change

Don't install terminfo.db in rescue.

Move the emergancy terminfo database from /root to /rescue.

kill ldd_aout. it didn't work anyway...not since i don't know when.

Add a new list.ldd.noaout, which is a copy of list.ldd but without
the a.out support.
Tweak Makefile so that the a.out support is not built for mips.

- rework this a bunch to make it work inside /rescue/ldd.
- fix alpha build.

branches: 1.21.10;
make all sun2 use -O0 and move most of the hacks out into just 3 files.

Remove support for NetBSD/pc532.

branches: 1.19.10;
Make fdisk(8) available on all platforms, since MS-DOS partitioning
is the de-facto standard for many removable media types.

improve MAKEVERBOSE support

Restore the "liboverride" functionality because it's needed to correctly
implement rmcd(3) in the rescue tools.

Add to /rescue: scp ssh slogin
(all without Kerberos support at this time)

MAKEVERBOSE support

Provide /rescue/cgdconfig if ${MKCRYPTO} != "no"

Repeat after me: "test both cases before commit"

Only compile in IPv6 support if ${USE_INET6} != "no"

MKINET6 is for providing IPv6 infrastructure.
USE_INET6 is for compiling IPv6 support into the programs (needs MKINET6).

Complete removal of "liboverride" to fix build problems.

Remove special handling for rcmd.o; not needed.

Remove file "rescue.unstripped" in "cleandir" target.

* Add ftp to /rescue.
* Implement liboverride.o to provide overrides of various libc functions.
For now, compile a special version of rcmd(3) (et al) which uses
/rescue/rcmd and /rescue/sh instead of the /bin variants.
Other overrides may appear in the future.

Should fix [bin/21670] from Geoff Wing.

Enable MIPS now that crunchgen works again for this arch.

set SMALLPROG=0 (it was implicit)

* Move the rescue bits into their own file.
* In makeflist, skip rescue bits in arch's that don't yet support it
(MIPS, currently, due to an objcopy-crunch bug).

Compare MACHINE_CPU and "mips" rather than MACHINE_ARCH and "mipseb" or
"mipsel".

Don't build this on mipseb or mipsel, as crunchgen(1) doesn't work correctly
on those, no fix has been forthcoming, and users are getting antsy.

This allows "make build" to complete; "make release" will still fail in the
sets generation. Maybe *that* will inspire a MIPS/toolchain guru to fix
crunchgen(1)...

set CRUNCHENV= RESCUE=/rescue (still don't want SMALLPROG)

Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

smb is no more.

Redo the sshsk_sign() stuff properly, but putting the helper in libssh.so

Unfortunately libssh has an undefined symbol sshsk_sign(), which is provided
by different implementations depending if we are a server or a client. While
the clients we compile in, provide that symbol, it is getting hidden by
crunchhide, so we provide it again. It would have been a lot simpler to
use a function pointer instead in the library...

1. Remove all the special handling of variables (-d -p -P -s -S) that
were dealing with DBG (-d) LDSTATIC/NOPIE (-p), and the rest with
disabling/enabling sanitizers.
2. Use emalloc/estrdup for all the allocators instead of only some cases.
3. Add -V varspec which passes variables on the command line (as DBG
and LDSTATIC used to be passed before) instead of appending them
to the on-the-fly Makefile using -v varspec.
4. Change the distrib and rescue Makefiles to use -V instead of the removed
flags.

The motivation of this is to make variable handling consistent, less magical,
and remove the need for changing crunchgen each time we want to add disabling
an option by default.

(as proposed in tech-toolchain)

Remove ldconfig from /rescue, and mark it MI obsolete.

- ldconfig in netbsd refers to a.out binaries only. We've been ELF-only
since NetBSD 2.0 or so, and having it in /rescue served little purpose
even before that, as /rescue is standalone.
- Using MI obsolete to avoid the need for MD set lists where ldconfig
is the sole entry

branches: 1.37.2;
fix duplicated chunk from merge

Merge the [pgoyette-compat] branch

Specify NOLIBCSANITIZER for rescue

The rescue image could be sanitized with a sanitizer in libc, but it's left
for future as a possible research.

branches: 1.34.2;
Set NOSANITIZER in rescue/Makefile

This is required to stop sanitizing rcmd.o and liboverride.o. These object
files will be linked into statically linked rescue.

branches: 1.33.2;
Extra flags for static PIE

Remove MKCRYPTO option.

Originally, MKCRYPTO was introduced because the United States
classified cryptography as a munition and restricted its export. The
export controls were substantially relaxed fifteen years ago, and are
essentially irrelevant for software with published source code.

In the intervening time, nobody bothered to remove the option after
its motivation -- the US export restriction -- was eliminated. I'm
not aware of any other operating system that has a similar option; I
expect it is mainly out of apathy for churn that we still have it.
Today, cryptography is an essential part of modern computing -- you
can't use the internet responsibly without cryptography.

The position of the TNF board of directors is that TNF makes no
representation that MKCRYPTO=no satisfies any country's cryptography
regulations.

My personal position is that the availability of cryptography is a
basic human right; that any local laws restricting it to a privileged
few are fundamentally immoral; and that it is wrong for developers to
spend effort crippling cryptography to work around such laws.

As proposed on tech-crypto, tech-security, and tech-userlevel to no
objections:

https://mail-index.netbsd.org/tech-crypto/2017/05/06/msg000719.html
https://mail-index.netbsd.org/tech-security/2017/05/06/msg000928.html
https://mail-index.netbsd.org/tech-userlevel/2017/05/06/msg010547.html

P.S. Reviewing all the uses of MKCRYPTO in src revealed a lot of
*bad* crypto that was conditional on it, e.g. DES in telnet... That
should probably be removed too, but on the grounds that it is bad,
not on the grounds that it is (nominally) crypto.

Append -Os to DBG, not overwrite in case DBG has more than just -Ox from
sys.mk

mount_smbfs has moved.

descend to bin for pdisk

pdisk has moved to external/bsd - try to deal.

branches: 1.27.6; 1.27.12; 1.27.18;
Relegate edlabel to use in extremely memory constrained install
ramdisks and prefer disklabel elsewhere.
Based on discussion on affected port lists (port-sparc port-sparc64
port-sun3 port-sun2 port-atari port-mvme68k).
All listed ports plus amd64 test built after change

Don't install terminfo.db in rescue.

Move the emergancy terminfo database from /root to /rescue.

kill ldd_aout. it didn't work anyway...not since i don't know when.

Add a new list.ldd.noaout, which is a copy of list.ldd but without
the a.out support.
Tweak Makefile so that the a.out support is not built for mips.

- rework this a bunch to make it work inside /rescue/ldd.
- fix alpha build.

branches: 1.21.10;
make all sun2 use -O0 and move most of the hacks out into just 3 files.

Remove support for NetBSD/pc532.

branches: 1.19.10;
Make fdisk(8) available on all platforms, since MS-DOS partitioning
is the de-facto standard for many removable media types.

improve MAKEVERBOSE support

Restore the "liboverride" functionality because it's needed to correctly
implement rmcd(3) in the rescue tools.

Add to /rescue: scp ssh slogin
(all without Kerberos support at this time)

MAKEVERBOSE support

Provide /rescue/cgdconfig if ${MKCRYPTO} != "no"

Repeat after me: "test both cases before commit"

Only compile in IPv6 support if ${USE_INET6} != "no"

MKINET6 is for providing IPv6 infrastructure.
USE_INET6 is for compiling IPv6 support into the programs (needs MKINET6).

Complete removal of "liboverride" to fix build problems.

Remove special handling for rcmd.o; not needed.

Remove file "rescue.unstripped" in "cleandir" target.

* Add ftp to /rescue.
* Implement liboverride.o to provide overrides of various libc functions.
For now, compile a special version of rcmd(3) (et al) which uses
/rescue/rcmd and /rescue/sh instead of the /bin variants.
Other overrides may appear in the future.

Should fix [bin/21670] from Geoff Wing.

Enable MIPS now that crunchgen works again for this arch.

set SMALLPROG=0 (it was implicit)

* Move the rescue bits into their own file.
* In makeflist, skip rescue bits in arch's that don't yet support it
(MIPS, currently, due to an objcopy-crunch bug).

Compare MACHINE_CPU and "mips" rather than MACHINE_ARCH and "mipseb" or
"mipsel".

Don't build this on mipseb or mipsel, as crunchgen(1) doesn't work correctly
on those, no fix has been forthcoming, and users are getting antsy.

This allows "make build" to complete; "make release" will still fail in the
sets generation. Maybe *that* will inspire a MIPS/toolchain guru to fix
crunchgen(1)...

set CRUNCHENV= RESCUE=/rescue (still don't want SMALLPROG)

Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.