openssh: Install libssh.so in /usr/lib/private.

This way it doesn't get exposed to applications accidentally, and we
don't need to worry about breaking ABI when updating openssh in base.

PR lib/58648: private shared libraries should go in /usr/lib/private,
not /usr/lib

smb is no more.

Redo the sshsk_sign() stuff properly, but putting the helper in libssh.so

Unfortunately libssh has an undefined symbol sshsk_sign(), which is provided
by different implementations depending if we are a server or a client. While
the clients we compile in, provide that symbol, it is getting hidden by
crunchhide, so we provide it again. It would have been a lot simpler to
use a function pointer instead in the library...

1. Remove all the special handling of variables (-d -p -P -s -S) that
were dealing with DBG (-d) LDSTATIC/NOPIE (-p), and the rest with
disabling/enabling sanitizers.
2. Use emalloc/estrdup for all the allocators instead of only some cases.
3. Add -V varspec which passes variables on the command line (as DBG
and LDSTATIC used to be passed before) instead of appending them
to the on-the-fly Makefile using -v varspec.
4. Change the distrib and rescue Makefiles to use -V instead of the removed
flags.

The motivation of this is to make variable handling consistent, less magical,
and remove the need for changing crunchgen each time we want to add disabling
an option by default.

(as proposed in tech-toolchain)

Remove ldconfig from /rescue, and mark it MI obsolete.

- ldconfig in netbsd refers to a.out binaries only. We've been ELF-only
since NetBSD 2.0 or so, and having it in /rescue served little purpose
even before that, as /rescue is standalone.
- Using MI obsolete to avoid the need for MD set lists where ldconfig
is the sole entry

branches: 1.37.2;
fix duplicated chunk from merge

Merge the [pgoyette-compat] branch

Specify NOLIBCSANITIZER for rescue

The rescue image could be sanitized with a sanitizer in libc, but it's left
for future as a possible research.

branches: 1.34.2;
Set NOSANITIZER in rescue/Makefile

This is required to stop sanitizing rcmd.o and liboverride.o. These object
files will be linked into statically linked rescue.

branches: 1.33.2;
Extra flags for static PIE

Remove MKCRYPTO option.

Originally, MKCRYPTO was introduced because the United States
classified cryptography as a munition and restricted its export. The
export controls were substantially relaxed fifteen years ago, and are
essentially irrelevant for software with published source code.

In the intervening time, nobody bothered to remove the option after
its motivation -- the US export restriction -- was eliminated. I'm
not aware of any other operating system that has a similar option; I
expect it is mainly out of apathy for churn that we still have it.
Today, cryptography is an essential part of modern computing -- you
can't use the internet responsibly without cryptography.

The position of the TNF board of directors is that TNF makes no
representation that MKCRYPTO=no satisfies any country's cryptography
regulations.

My personal position is that the availability of cryptography is a
basic human right; that any local laws restricting it to a privileged
few are fundamentally immoral; and that it is wrong for developers to
spend effort crippling cryptography to work around such laws.

As proposed on tech-crypto, tech-security, and tech-userlevel to no
objections:

https://mail-index.netbsd.org/tech-crypto/2017/05/06/msg000719.html
https://mail-index.netbsd.org/tech-security/2017/05/06/msg000928.html
https://mail-index.netbsd.org/tech-userlevel/2017/05/06/msg010547.html

P.S. Reviewing all the uses of MKCRYPTO in src revealed a lot of
*bad* crypto that was conditional on it, e.g. DES in telnet... That
should probably be removed too, but on the grounds that it is bad,
not on the grounds that it is (nominally) crypto.

Append -Os to DBG, not overwrite in case DBG has more than just -Ox from
sys.mk

mount_smbfs has moved.

descend to bin for pdisk

pdisk has moved to external/bsd - try to deal.

branches: 1.27.6; 1.27.12; 1.27.18;
Relegate edlabel to use in extremely memory constrained install
ramdisks and prefer disklabel elsewhere.
Based on discussion on affected port lists (port-sparc port-sparc64
port-sun3 port-sun2 port-atari port-mvme68k).
All listed ports plus amd64 test built after change

Don't install terminfo.db in rescue.

Move the emergancy terminfo database from /root to /rescue.

kill ldd_aout. it didn't work anyway...not since i don't know when.

Add a new list.ldd.noaout, which is a copy of list.ldd but without
the a.out support.
Tweak Makefile so that the a.out support is not built for mips.

- rework this a bunch to make it work inside /rescue/ldd.
- fix alpha build.

branches: 1.21.10;
make all sun2 use -O0 and move most of the hacks out into just 3 files.

Remove support for NetBSD/pc532.

branches: 1.19.10;
Make fdisk(8) available on all platforms, since MS-DOS partitioning
is the de-facto standard for many removable media types.

improve MAKEVERBOSE support

Restore the "liboverride" functionality because it's needed to correctly
implement rmcd(3) in the rescue tools.

Add to /rescue: scp ssh slogin
(all without Kerberos support at this time)

MAKEVERBOSE support

Provide /rescue/cgdconfig if ${MKCRYPTO} != "no"

Repeat after me: "test both cases before commit"

Only compile in IPv6 support if ${USE_INET6} != "no"

MKINET6 is for providing IPv6 infrastructure.
USE_INET6 is for compiling IPv6 support into the programs (needs MKINET6).

Complete removal of "liboverride" to fix build problems.

Remove special handling for rcmd.o; not needed.

Remove file "rescue.unstripped" in "cleandir" target.

* Add ftp to /rescue.
* Implement liboverride.o to provide overrides of various libc functions.
For now, compile a special version of rcmd(3) (et al) which uses
/rescue/rcmd and /rescue/sh instead of the /bin variants.
Other overrides may appear in the future.

Should fix [bin/21670] from Geoff Wing.

Enable MIPS now that crunchgen works again for this arch.

set SMALLPROG=0 (it was implicit)

* Move the rescue bits into their own file.
* In makeflist, skip rescue bits in arch's that don't yet support it
(MIPS, currently, due to an objcopy-crunch bug).

Compare MACHINE_CPU and "mips" rather than MACHINE_ARCH and "mipseb" or
"mipsel".

Don't build this on mipseb or mipsel, as crunchgen(1) doesn't work correctly
on those, no fix has been forthcoming, and users are getting antsy.

This allows "make build" to complete; "make release" will still fail in the
sets generation. Maybe *that* will inspire a MIPS/toolchain guru to fix
crunchgen(1)...

set CRUNCHENV= RESCUE=/rescue (still don't want SMALLPROG)

Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

rescue/list: Touch for CRUNCHGEN_FLAGS change for libssh.

PR lib/58648: private shared libraries should go in /usr/lib/private,
not /usr/lib

remove threads; size constraints and behavioral change

Add -lpthread for the benefit or argon2 in cgdconfig

remove SMBFS and nsmb/netsmb - userland part

Retire lmcconfig here too.

Remove the userland part of ISDN. The kernel part is untouched for now.
ipppctl was actually an exact copy of pppoectl; there is no functional
change in pppoectl in this commit.

Add a port of the umb(4) driver from OpenBSD

The umb(4) driver provides support for USB MBIM (Mobile Broadband
Interface Model) devices.

MBIM devices establish connections via cellular networks such as GPRS,
UMTS, and LTE. They appear as a regular point-to-point network interface, transporting raw IP frames.

Required configuration parameters like PIN and APN have to be set with
umbctl(8), a new tool specific to this driver. The IP address is configured
automatically; the default route and DNS server information have to be set
separately.

The driver is not fully functional yet, it is therefore still marked as
experimental and disabled by default. Any help welcome to complete it!

Tested on NetBSD/amd64, with a Sierra Wireless EM7345 LTE modem on a Lenovo
ThinkPad T440s. No functional change expected otherwise.

branches: 1.49.2;
Add progress(1) into /rescue.

No objection when proposed on tech-userlevel@.

branches: 1.48.12;
vnconfig(8) was renamed to vndconfig(8) some time ago, and most places
keep both names around.

One place that got missed is /rescue so let's update it for consistency
with all the other places.

(Pointed out in private Email by kre@)

branches: 1.47.2;
cgdconfig is not crypto

Add rescue/ekermit.

mount_smbfs has moved.

nvi has moved

branches: 1.43.2;
PR/46393 - Nat Sloss -- add gpt(8) to /rescue

branches: 1.42.2; 1.42.4;
Update location of "less" directory.

add the lzma library now that is used by gzip

branches: 1.40.4;
Adjust for the new chown location.

Don't install terminfo.db.

Move the emergancy terminfo database from /root to /rescue.

Userland now builds and uses terminfo instead of termcap.

OK: core@, jdc@

Remove the portalfs kernel file system driver. Replace mount_portal(8)
with a version based on puffs. User functionality remains the same.

- rework this a bunch to make it work inside /rescue/ldd.
- fix alpha build.

Remove LKMs and switch to the module framework, pass 1.

Proposed on tech-kern@.

branches: 1.33.2;
use nvi instead. thanks to Andreas Wrede

Remove systrace. Ok core@.

branches: 1.31.4;
Add read-only support for SGI's Extent File System.

Reviewed by pooka@.

Add dumpfs & dumplfs to /rescue, as they may be useful during system
recovery.

Add: lfs_cleanerd
Suggested by Blair Sadewitz

Add: grep egrep fgrep zgrep zegrep zfgrep
Suggested by George Michaelson

add libprop to LIBS, as veriexecctl now needs it.

Revert the recent addition of /rescue/gkermit. There's some concern
that linking GPL code into /rescue is not a good idea.

Add /rescue/gkermit. Discussed in tech-userlevel.

Add mount_tmpfs(8) to /rescue. Ok with christos.

Add ex(1) to /rescue. This won't add more than a few bytes to the crunchgen
binary since "ex" is just "vi -e" and vi(1) is already there.

Ok with hubertf and salo.

branches: 1.23.2;
lmcctl has been replaced by lmcconfig.

put back tetris; by popular demand.

PR/31370: Andreas Wiese: Remove tetris from rescue

Add vnconfig(8). ok christos

add scan_ffs and veriexecctl to /rescue

Make fdisk(8) available on all platforms, since MS-DOS partitioning
is the de-facto standard for many removable media types.

Add /rescue/tetris.
When your system is fubared, this will help you relax.

branches: 1.16.2;
cosmetic tweak

Restore the "liboverride" functionality because it's needed to correctly
implement rmcd(3) in the rescue tools.

Add: less (more), vi, chroot
Requested by Matthew Mondor in PR 26147

Only compile in IPv6 support if ${USE_INET6} != "no"

MKINET6 is for providing IPv6 infrastructure.
USE_INET6 is for compiling IPv6 support into the programs (needs MKINET6).

Complete removal of "liboverride" to fix build problems.

no need to list gnu/usr.bin any more.

add mount_smbfs

systrace needs libevent now.

Add installboot. Suggested by Curt Sampson.

* Add ftp to /rescue.
* Implement liboverride.o to provide overrides of various libc functions.
For now, compile a special version of rcmd(3) (et al) which uses
/rescue/rcmd and /rescue/sh instead of the /bin variants.
Other overrides may appear in the future.

Should fix [bin/21670] from Geoff Wing.

Build mount_* individually, since mount and most of mount_* no longer
shares binary image. Fixes PR#20553.

Add chown and chgrp. Suggested by Geoff Wing in [bin/18393]

oops; typo. (thanks enami!)

don't install -sh as a link to sh. use ARGVLN to support -sh, -csh, and -ksh

support -sh as a synonym for sh

Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

Remove support for NetBSD/pc532.

branches: 1.1.22;
Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

new openssl needs pthreads

branches: 1.10.28;
cgdconfig is not crypto

PR/47276: ftp has ssl support now.

branches: 1.8.6; 1.8.8; 1.8.12;
use the new ssh

we cannot use pthreads here because we are statically linked.

ssh now needs pthread.

branches: 1.5.12;
libssp is no more

Add new Makefile knob, USE_FORT, which extends USE_SSP by turning on the
FORTIFY_SOURCE feature of libssp, thus checking the size of arguments to
various string and memory copy and set functions (as well as a few system
calls and other miscellany) where known at function entry. RedHat has
evidently built all "core system packages" with this option for some time.

This option should be used at the top of Makefiles (or Makefile.inc where
this is used for subdirectories) but after any setting of LIB.

This is only useful for userland code, and cannot be used in libc or in
any code which includes the libc internals, because it overrides certain
libc functions with macros. Some effort has been made to make USE_FORT=yes
work correctly for a full-system build by having the bsd.sys.mk logic
disable the feature where it should not be used (libc, libssp iteself,
the kernel) but no attempt has been made to build the entire system with
USE_FORT and doing so will doubtless expose numerous bugs and misfeatures.

Adjust the system build so that all programs and libraries that are setuid,
directly handle network data (including serial comm data), perform
authentication, or appear likely to have (or have a history of having)
data-driven bugs (e.g. file(1)) are built with USE_FORT=yes by default,
with the exception of libc, which cannot use USE_FORT and thus uses
only USE_SSP by default. Tested on i386 with no ill results; USE_FORT=no
per-directory or in a system build will disable if desired.

Special-case the srcdirs for scp & ssh.

Add to /rescue: scp ssh slogin
(all without Kerberos support at this time)

Provide /rescue/cgdconfig if ${MKCRYPTO} != "no"

Relegate edlabel to use in extremely memory constrained install
ramdisks and prefer disklabel elsewhere.
Based on discussion on affected port lists (port-sparc port-sparc64
port-sun3 port-sun2 port-atari port-mvme68k).
All listed ports plus amd64 test built after change

Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

Make fdisk(8) available on all platforms, since MS-DOS partitioning
is the de-facto standard for many removable media types.

Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

Remove rtsol(8) and rtsold(8) as their functionality is in dhcpcd(8).
Remove rtsol(8) from rc.d/network.
Add -w seconds command to ifconfig to wait for N seconds for until DAD
has finished on all addresses.
Use ifconfig -w in rc.d/network instead of a forced sleep.

As discussed on tech-net@

Only compile in IPv6 support if ${USE_INET6} != "no"

MKINET6 is for providing IPv6 infrastructure.
USE_INET6 is for compiling IPv6 support into the programs (needs MKINET6).

Remove ldconfig from /rescue, and mark it MI obsolete.

- ldconfig in netbsd refers to a.out binaries only. We've been ELF-only
since NetBSD 2.0 or so, and having it in /rescue served little purpose
even before that, as /rescue is standalone.
- Using MI obsolete to avoid the need for MD set lists where ldconfig
is the sole entry

branches: 1.1.96; 1.1.98;
Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

move the build of ldd binary to a subdir in order to allow
explict ordering. This makes "make all" work the same as
"make dependall"

Add basic locking to ld.elf_so.

Add TLS support infrastructure. For dynamic binaries, ld.elf_so exports
_rtld_tls_allocate and _rtld_tls_free. libpthread uses this functions to
setup the thread private area of all new threads. ld.elf_so is
responsible for setting up the private area for the initial thread.
Similar functions are called from _libc_init for static binaries, using
dl_iterate_phdr to access the ELF Program Header.

Add test cases to exercise the different TLS storage models. Test cases
are compiled and installed on all platforms, but are skipped on
platforms not marked for TLS support.

This material is based upon work partially supported by
The NetBSD Foundation under a contract with Joerg Sonnenberger.

It is inspired by the TLS support in FreeBSD by Doug Rabson and the
clean ups of the DragonFly port of the original FreeBSD modifications.

Implement dl_iterate_phdr.

Somewhat taken from FreeBSD. Manual page from OpenBSD.

Sync against new ld.elf_so

kill ldd_aout. it didn't work anyway...not since i don't know when.

branches: 1.1.2;
- rework this a bunch to make it work inside /rescue/ldd.
- fix alpha build.

kill ldd_aout. it didn't work anyway...not since i don't know when.

Add a new list.ldd.noaout, which is a copy of list.ldd but without
the a.out support.
Tweak Makefile so that the a.out support is not built for mips.

point pdisk to the right place

branches: 1.1.54; 1.1.60; 1.1.68;
Migrate rescue tools from distrib/rescue -> rescue. Purpose of tools:

Infrastructure to build a set of "rescue" tools; a crunched-up
version of all the statically linked binaries in /bin, /sbin
and the few in /usr/bin.

Don't install terminfo.db in rescue.

Move the emergancy terminfo database from /root to /rescue.

Remove special handling for rcmd.o; not needed.

* Add ftp to /rescue.
* Implement liboverride.o to provide overrides of various libc functions.
For now, compile a special version of rcmd(3) (et al) which uses
/rescue/rcmd and /rescue/sh instead of the /bin variants.
Other overrides may appear in the future.

Should fix [bin/21670] from Geoff Wing.

Don't install terminfo.db in rescue.

Move the emergancy terminfo database from /root to /rescue.