More conservative umask

Set the file creation mask consistently because the files these scripts
create can become part of an iso image.

Deprecate extsrc/, EXTSRCSRCDIR, MKEXTSRC

Remove support for building extsrc/:
1. Makefile: remove do-extsrc target.
2. build.sh: remove options -y and -Y extsrcdir.
3. distrib/sets: remove support for extsrc in various tools
including the options -L ext and -y, and the extsrc sets.
4. doc/BUILDING.mdoc: remove docs for extsrc/, EXTSRCSRCDIR, MKEXTSRC (etc)
5. bsd.own.mk and various Makefiles: remove support for extsrc/,
EXTSRCSRCDIR, MKEXTSRC.

As proposed on tech-kern and tech-userlevel on 2022-01-07
and followed up on 2022-08-21.

PR 56389: do not include top level .git or .hg directories
in source sets.

branches: 1.42.2;
Prepare for .tar.xz sets

branches: 1.41.4; 1.41.10; 1.41.12;
more gnu directory removal.

branches: 1.40.2; 1.40.4;
GPL code isn't just in src/gnu these days (i.e., the last 6 years).
move stuff from src/external/gpl[23] out of the src tarball and into
gnusrc.

branches: 1.39.4;
PR/46182: Andreas Gustafsson: Make all files ending in [.-]sh executable.
The perfect is the enemy of the good.

branches: 1.38.6; 1.38.8; 1.38.12; 1.38.14; 1.38.22;
Support "extsrc", externally added programs and libraries. Users can write
their own reach-overs, cross-build, install, and get set files just like base
and X11 / X.org. (These sets are not included as TNF releases.)

Only generate SHA512 and MD5 checksums for releases.

In various places that manipulate mtree specs, use "mtree -CS" to sort.
Remove some now-redundant standalone sort commands.

Consistently use gzip with the -n flag so dates are not embedded.

Not tested on all platforms.

branches: 1.34.6; 1.34.8; 1.34.10; 1.34.12;
Add '-q' to maketars and makesrctars, to quieten them.
Improve MAKEVERBOSE support.

branches: 1.33.4; 1.33.10; 1.33.12;
move common from src.tgz to syssrc.tgz as discussed on tech-install

branches: 1.32.2;
Make sure that all "move-if-change" scripts in "src/gnu/dist" are
executable in the source ".tgz" files. This is necessary while
bootstrapping the toolchain which isn't done using NetBSD makefiles.

This should fix PR toolchain/34489 by Kirk Russell.

branches: 1.31.2;
in src.tgz, set build.sh permissions +x

Ensure that (almost) all shell variables in distrib/sets/* scripts are
used with curly braces and quotes, as in "${var}".

Also ensure that command substitution is quoted, as in "$(command)", and
convert `command` to $(command).

Reviewed by agc

Add shell variables defined in sets.subr for almost all commands used
by scripts in distrib/sets/*. This is intended to be useful when cross
building. Only trivial commands like echo, cat, and rm are excluded
from this treatment.

While I am here, make ${MTREE} and ${DB} follow the pattern used by most
other such variables.

Reviewed by agc.

Move default values for several shell variables into sets.subr.

Reviewed by agc

Whitespace/usage cleanup and a proper exit when done

Remove unneeded set of PASSWD

Insert some missing backslashes

Set default vars so blank and unset both end up w. a reasonable default

Fix path for mtree

Restructure how makesrctars works so it spits out source balls that look like
they would from a release (files owned by root:wsrc, perms set, etc)

Include SHA512 now also

Adapt to recent source tree changes:
- usr.sbin/config -> usr.bin/config
- contrib/sys -> sys/contrib

Use "find |sort" instead of "find -s" -- the latter isn't POSIX.

branches: 1.18.2;
Prune obj|obj.* directories/symlinks correctly. Fix from Hubert Feyrer.

makesrctars:
* Support '-x xsrcdir' to tar up xsrcdir as xsrc.tgz, with the
contents of the tarfile being relative to xsrcdir and
prefixed with 'usr/xsrc'
* Convert to getopts a la the other scripts in this directory

Makefile
* if ${MKX11} != no, call makesrctars with '-x ${X11SRCDIR}'

Move ./contrib/sys from src.tgz to syssrc.tgz.
Fixes [misc/25251] from Darren Reed.

branches: 1.15.2;
- change so that the source directory and sets directory are now
command-line arguments, rather than ${SRCDIR} and ${DESTDIR}/sets
- when building syssrc.tgz, only skip subdirs of sys/arch/*/compile
which are not named "CVS"
- improve method that sets are built
- don't bother chmodding results as it makes it difficult to re-run this

branches: 1.14.2;
use gzip -9 instead of --best

use ${CKSUM} instead of cksum/md5

Address misc/14958:
Don't error out if DESTDIR exists.
Use "find -s" instead of "find | sort"
While here: Drop syssrc/usr.sbin/dbsym from syssrc.tgz, since it has been
replaced by gnusrc/gnu/usr.sbin/dbsym.
XXX: Add gnusrc/gnu/usr.sbin/dbsym (and libbfd)?

We don't have seperate secr source sets anymore, so don't try to create
them.

branches: 1.10.10;
Fix construction of the 'sys' tarball so that compile directories
really will not be included, but compile/CVS and compile/.keep_me will
still be (if present).

Include CVS directories in the tar files. Explicitly omit obj.* links and
directories. Fix some lossage with / being chowned when unpacking src.tgz.

Fix not to include contents of kernel compile directories
(from Havard.Eidnes@runit.sintef.no)

Make all the sum files.

make makesrctars make the "correct" flavor of source sets

branches: 1.5.2;
Don't hardcode in the current release information; generate it
automatically on the fly, by using
`sh ${BSDSRCDIR}/sys/conf/osrelease.sh -s`

eliminate dangling references to config.old;
from Klaus Klein in PR misc/3295.

RCSID police

merge in 1.2 branch

branches: 1.1.4;
Add script I used to make the 1.1 source distribution