add nglereg.h

Mark old gcc=9 conditional entries as obsolete or just remove them.

XXX pullup netbsd-11

various updates for GCC 14. maybe not complete for all ports.

x86 should be complete, arm64 might be.


tested with i386 and evbarm64 builds and HAVE_GCC=12, hopefully
won't break existing builds.

paravirt_membar_sync(9): New memory barrier.

For use in paravirtualized drivers which require store-before-load
ordering -- irrespective of whether the kernel is built for a single
processor, or whether the (virtual) machine is booted with a single
processor.

This is even required on architectures that don't even have a
store-before-load ordering barrier, like m68k; adding, e.g., a virtio
bus is _as if_ the architecture has been extended with relaxed memory
ordering when talking with that new bus. Such architectures need
some way to request the hypervisor enforce that ordering -- on m68k,
that's done by issuing a CASL instruction, which qemu maps to an
atomic r/m/w with sequential consistency ordering in the host.

PR kern/59618: occasional virtio block device lock ups/hangs

add thread.h

branches: 1.2497.2;
Add lua.pc so pkg-config can pick it up.

I considered using lua-5.4 as most distros seem to install their .pc file
as that, but equally there is some support for just lua which seems to
reflect the system provided library which is what NetBSD ships.

Fixes for openssl-3.5.1

more openssl=35 additions.

Add heartbeat(9) to installed man pages

Add support for serializing to, and de-serializing from, JSON, as
specified in RFC 8259. Format is automatically detected for input,
and can be specified explicitly for output. The default format remains
XML.

As part of this change, generic prop_object_{internalize,externalize}()
functions are provided, and the "_with_format" flavor allows the output
format to be specified. Previous array- and dictionary-specific routines
remain for backwards compatibility.

Add entries for timespec_getres(3) - which should be needed regardless
of whether that remains a separate man page, or becomes a link to another.

add new str{f,p}time man page variants; sort

Update sets for sanitizer lib[alt]san_preinit.o files.

A driver and userland utility for a couple of families of the
Microchip Technology / SMSC fan controller chips.

The driver and utility supports the:

o EMC2101 and EMC2101-R
o EMC2103-1, EMC2102-2 and EMC2103-4
o EMC2104
o EMC2106
o EMC2301
o EMC2302
o EMC2303
o EMC2305

The EMC210X family supports 1 or 2 fans with tachometer. Depending on
the chip, it may support 2 additional fans without tach and might
support a high side attachment (i.e. a fan, usually 5v, driven
directly from the chip and not PWM or DAC). All versions of EMC210X
support internal temperature measurements, and depending on the chip,
may support up to 5 additional temperature zones. The tachometers and
temperature measurements are provided to the system via the envsys(4)
framework. Some chip types support GPIO pins and support is provided
via the gpio(4) framework.

The EMC230X family supports 1, 2, 3 or 5 fans with the same number of
tachometers. No temperature zone or GPIO support. The tachometers
are provided to the system via the envsys(4) framework. The fan
support can be provided by PWM signaling or DAC.

The two chip families mostly do PWM signaling for the fan speed, but a
number of them support DAC output, a 0 to 3v or so voltage. When the
chip supports external temperature zones, this is done usually by a
bipolar NPN or PNP transister configured as a diode, but some of the
chip varients support thermistors.

The emcfan(4) kernel driver provides a simple read / write / seek
device in /dev/ to the register set in the chip. The heavy lifting is
done in the userland utility emcfanctl(8) which provides the ability
to read and write to any valid register and provides some basic higher
level commands to control fan behavior. The output is simple text
lines, or JSON.

The kernel driver does not reset or other mess with the chip, aside
from reading registers. It is entirely possible that something else
in any particular system is the major manager of the fan controller
and it would not do for the kernel driver to mess too much with the
attached device. All interactions are intentional via the userland
utility.

It is known that a EMC2301 is present on the Raspberry PI 4 Compute IO
module (not to be confused with the Raspberry PI 4 Compute module
itself) and there is a breakout board from Adafruit with a EMC2101 on
it. The chips themselves are pretty inexpensive from Mouser or
Digi-key and can be soldered using the simpler SMD soldering
techniques. A number of the variants are QFN packages, but the pads
are exposed to the side of the chip. No other external components are
required to use these fan controllers.

put back extattr.3

add extattrctl man page, sort.

libc: New _r variants of heapsort, mergesort, qsort.

Also kheapsort_r for kernel/standalone use.

These variants allow the caller to pass a cookie through to the
comparison function, e.g. if you want to sort an array of indices
into a buffer.

qsort_r is new in POSIX.1-2024; the others are obvious analogues of
our nonstandard extensions for heapsort and mergesort.

PR lib/58931: qsort_r() missing

sets changes for new bind-9.

A driver for the MCP-2221 / 2221A multi-io chip. This is a USB to
UART / GPIO / I2C multi-io chip probably based upon a programmed PIC.
The end result is that simple gpio and i2c can exist on any system
that provides a USB port. This is everything from a RPI to a
Virtualbox VM.


o The UART presents itself as a umodem(4) device and pretty much works
as one would expect.

o There are 4 simple GPIO pins with multiple functions that attach to
gpio(4). Support for basic GPIO input and output exists with gpioctl,
the ADC, DAC and clock pulse functions exist as ALT functions. For
the ADC and DAC /dev/ devices are provided such that simple reads and
writes interact with the ADC and DAC. The IRQ function on pin GP1 and
bit banging the GPIO with gpiopps(4) and gpioow(4) are not really
supported. The short answer is that a spin lock is held while trying
to do USB transfers and that isn't allowed.

o There is a simple I2C engine that attaches to iic(4). This mostly
works as expected, except that a READ without STOP is not supported by
the engine which causes problems for some drivers. Most drivers do
not seem to use READ without STOP and seem to work as expected.
Support for changing the I2C speed is not supported, but nothing much
really does that.

o A userland utility called umcpmioctl(8) is provided that allows the
query of the status of the chip and allows for the query of the flash
memory and the setting of some of the flash memory parameters mostly
related to gpio. This utility interacts with a control device in
/dev/. The flash memory contents is copied to the sram on boot up of
the chip and can be used to adjust how the chip sets up the gpio pins,
among other things. Support for setting or entering the chip password
is not provided.

o A number of sysctls are provided to mess with various settings.
These are detailed in the man page.


While not perfect, the chip is reasonable, cheap, and has at least one
vendor making a breakout board. It is also one of the only ones in
this space that has enough documentation to write a driver.

Support for a related chip, the MCP-2210, which provides SPI and GPIO
may exist some day as the programming interface is very simular.

PR lib/58850: add man page link for snprintf_ss

install summitreg.h - we will need it for Xorg

make zstd a private library (for now)

memset_explicit(3): Add C23 alias for explicit_memset.

PR standards/58607: C23: <string.h> memset_explicit

ffs(3): Fix visibility in strings.h and add MLINKS for ffsl/ffsll.

ffs(3) was added in POSIX 2001 with XSI option (_XOPEN_SOURCE>=600),
not in POSIX 2008 with XSI option (_XOPEN_SOURCE>=700).

Noticed while updating the STANDARDS section of the man page.

PR lib/58802: missing ffsl(), ffsll() functions from POSIX 2024

Hook zstd to the build and enable it for libarchive and file.

Add c17(1) wrapper script for gcc with the ISO 2017 C standard.

Not much reason to use this over c11(1), but it's expected to be
required by upcoming POSIX revisions.

add container_of man page.

PR/58729: Taylor R Campbell: container_of is not documented or available
in userland

new semtimedop(2) GSoC 2024 (Shivraj Jamgade)

mbsnrtowcs(3), wcsnrtombs(3): Add man pages for these mouthfuls.

Based on patch drafted by abhinav@, with a little additional tidying
by me.

PR standards/52343: wcsnrtombs missing man-page

PR/58640: Riastradh: Provide sys/stdalign.h

sets/lists: Add gdbinit(5)

libc: New functions c8rtomb(3) and mbrtoc8(3).

New in C23, for converting from UTF-8 to locale-dependent multibyte
sequences (c8rtomb) or vice versa (mbrtoc8), along with the new type
char8_t.

Conditional on either:
- _NETBSD_SOURCE
- _ISOC23_SOURCE
- __STDC_VERSION__ >= 202311L

(Riding the libc minor bump from this morning for the UTF-16/UTF-32
versions from C11.)

PR standards/58601: uchar.h C23 compliance: char8_t, mbrtoc8, c8rtomb

libc: New C11 functions mbrtoc16, mbrtoc32, c16rtomb, c32rtomb.

The mbrtoc16/32 functions read mulitbyte strings according to the
current locale into UTF-16/32 code unit sequences; the c16/32rtomb
functions write UTF-16/32 code unit sequences into multibyte strings
according to the current locale. The `r' means restartable: they
work incrementally and pick up where they left off.

NOTE: This bumps the libc minor version, since it adds new symbols.

PR lib/52374: <uchar.h> missing

uchar.h: New header file for C11 (and C++11) compliance.

Implementation of the new functions mbrtoc16, c16rtomb, mbrtoc32, and
c32rtomb to come later. Updates for C23 to come later.

PR lib/52374: <uchar.h> missing

man page for acct_process

Improve the man for strtoi() (and consequently strtou())

PR lib/58461 PR lib/58453

Improve the wording so it is clearer exactly what strtoi() is
intended to do in various cases.

While here, add, in the most minimalist way possible, the
strtoi_l(), and so also strtou_l(), functions, which seem to
have been previously undocumented.

Do some linguistic gymnastics so that the conversion of the
page from strtoi(3) -> strtou(3) will not generate "an unitmax_t"
which is incorrect, we need "a unitmax_t" - one of those was
easy to fix in the Makefile sed script, the others would have
been more difficult, so reword instead.

crashme(9): Install man page

Suggested by ozaki-r@

updates for OpenSSL man pages

sets/lists: Add all combinations of {,u}{i,l}{max,min}(9)

XXX XXX
This should definitely be auto-generated!!

PR/58391: Noriyuki Soda: re-adding syslog_ss() to syslog.h and syslog.3

GCC sanitizers: only build the sanitizers if $MKGCCCMDS != "no".

there's a minor use-case for the configuration of "building sanitizers
for distribution, but not the compiler", but it's pretty uncommon, and
the latest sanitizers don't build at all on m68000 so enhance the
option to not build /usr/bin/gcc (which simply can't modern GCC on a
sun2) to not build the sanitizers either.

(if we were to split these, MKGCCSANITIZER would be good variable.)

update set lists for far too many files, including fixing MKDEBUG for
a couple of builds.

Properly mark an entry as obsolete for gcc=12.

branches: 1.2459.2;
distrib/lists/sets/comp: Add gcc=12 obsolete entries for gcc-10/*.h.

uvm_obj_wirepages(9): New man page.

Add _dlauxinfo.3

install stireg.h

new sqlite

changes for new bind.
XXX: removing lint libraries where lint does not work anymore is temporary.

Add the long double math functions recently added from FreeBSD to their related man pages

Install securelevel.9 as an alias of secmodel_securelevel.9

According to submitter, this should be sufficient to address misc/57824.

Add a vmem_xalloc_addr() function, which allocates a specific address
from an arena. This is just a convenience wrapper around vmem_xalloc(),
that's just a bit more obvious how to use and performs some additional
sanity checks.

sys/wchan.h: Need to install this for sanitizers.

sqlite3 changes

off-by-one

sets for libfido2-1.13.0

at suggestion from phone@ (via irc/icb) make this file depend on
any version of gdb, not just gdb=1100

XXX I really don't know what I'm doing here, so if anyone has a
XXX better idea, go for it.

comp/mi: /usr/include/g++/bit is gcc-only, not for clang (or pcc)

more updates for sets and GCC 12

- renable sanitizer, add new shlib versions, enable tsan for arm64,
including moving some stuff into the per-cpu/arch dir from 'mi'.
- fix mips64, 68k, and ia64
- mark many any-gcc-version things just as "gcc" and remove dups
- mark many gcc=9 only things as obsolete
- mark many gcc=10 only things as obsolete with gcc=12 (more could
be done here.)

Fix lists for HAVE_GCC=12.

Revert addition of epoll to libc until discussion concludes

Add companion mempcpy to wmempcpy, bump.

various updates for GCC 12

- bump some shlibs
- add new header files
- add compiler-version header files
- disable sanitizer libraries for gcc12 for now

new gdb needs wmempcpy, give it to it.

Add epoll(2) from Theodore Preduta as part of GSoC 2023

Add memfd_create(2) from GSoC 2023 by Theodore Preduta

fix typo

Document how system call versioning is done. From this summer's compat-linux
GSoC, by Theodore Preduta.

libbsdmalloc: New man page.

XXX pullup-10

install pkg-config file for libedit

version number matches portable libedit
--cflags output matches portable libedit, since users probably want the
readline interface

add missing 'obsolete' keyword

mark some openssl 1.1 files as obsolete with openssl 3

Alignment nit.

obsolete mkstr(1) and xstr(1)

These were only used on PDP-11 for two programs we don't ship,
and have been obsolete since the VAX days.

xstr never worked in the build.sh cross-build environment (22 years), or
parallel make environment (nearly 28 years), didn't work in the orignal 386bsd
import, and has never been needed in NetBSD as we don't have the older BSD
programs (pascal, pre-nvi ex) that needed mkstr/xstr on PDP-11.

PR toolchain/35964

distrib/sets/lists: Nix trailing whitespace.

No functional change intended.

update the sets for OpenSSL-3.x

portfeatures(9): the man page for the __HAVE macros

The man page itself is a skeleton/template for now. Please add short
descriptions and xrefs. If the target man page doesn't yet document
relevant __HAVE macros (hi, mutex(9)), please add something there,
possibly in a .Sh IMPLEMENTATION NOTES section.

branches: 1.2425.2;
Remove in_pcb_hdr.h

tcp: separate syn cache stuffs into tcp_syncache.[ch] files

No functional change.

distrib/sets: remove duplicate lines in comp package

distrib/sets: remove extra keywords for obsolete files

They were ignored when building the distribution, but fmt-list
complained about them.

Document the pktqueue interface.

Sort.

Garbage-collect the remaining vestiges of netisr.

Add sincos{,f,l} from FreeBSD

Build and install pkgconfig files for liblzma and libarchive

build system: Revert all the recent additions of MK[...] knobs that
allow conditionally disabling the building of certain user space
programs in the 'base' set.

There is not enough consensus that this is the right way and a few
people had strong objections, see source-changes-d@.

libc: Reintroduce getentropy.

This was introduced two years ago when the getrandom/getentropy API
question was still open, and removed because the discussion was
ongoing. Now getentropy is more widely adopted and soon to be in
POSIX. So reintroduce the symbol into libc since we'll be keeping it
anyway. Discussion of details of the semantics, as interpreted by
NetBSD, is ongoing, but the symbol needs to get in before the
netbsd-10 branch. The draft POSIX text is
(https://www.opengroup.org/austin/docs/austin_1110.pdf):

SYNOPSIS
#include <unistd.h>

int getentropy(void *buffer, size_t length);

DESCRIPTION
The getentropy() function shall write length bytes of data
starting at the location pointed to by buffer. The output
shall be unpredictable high quality random data, generated by
a cryptographically secure pseudo-random number
generator. The maximum permitted value for the length
argument is given by the {GETENTROPY_MAX} symbolic constant
defined in <limits.h>.

RETURN VALUES
Upon successful completion, getentropy() shall return 0;
otherwise, -1 shall be retunred and errno set to indicate the
error.

ERRORS
The getentropy() function shall fail if:

[EINVAL] The value of length is greater than
{GETENTROPY_MAX}.

The getentropy() function may fail if:

[ENOSYS] The system does not provide the necessary
source of entropy.

RATIONALE
The getentropy() function is not a cancellation point.

Minor changes from the previous introduction of getentropy into libc:

- Return EINVAL, not EIO, on buflen > 256.
- Define GETENTROPY_MAX in limits.h.

The declaration of getentropy in unistd.h and definition of
GETENTROPY_MAX in limits.h are currently conditional on
_NETBSD_SOURCE. When the next revision of POSIX is finalized, we can
expose them also under _POSIX_C_SOURCE > 20yymmL as usual -- and this
can be done as a pullup without breaking existing compiled programs.

mk: Add a MKLFS flag for excluding the log-structured filesystem userspace
tools from the build.

Introduce membar_acquire/release. Deprecate membar_enter/exit.

The names membar_enter/exit were unclear, and the documentation of
membar_enter has disagreed with the implementations on sparc,
powerpc, and even x86(!) for the entire time it has been in NetBSD.

The terms `acquire' and `release' are ubiquitous in the literature
today, and have been adopted in the C and C++ standards to mean
load-before-load/store and load/store-before-store, respectively,
which are exactly the orderings required by acquiring and releasing a
mutex, as well as other useful applications like decrementing a
reference count and then freeing the underlying object if it went to
zero.

Originally I proposed changing one word in the documentation for
membar_enter to make it load-before-load/store instead of
store-before-load/store, i.e., to make it an acquire barrier. I
proposed this on the grounds that

(a) all implementations guarantee load-before-load/store,
(b) some implementations fail to guarantee store-before-load/store,
and
(c) all uses in-tree assume load-before-load/store.

I verified parts (a) and (b) (except, for (a), powerpc didn't even
guarantee load-before-load/store -- isync isn't necessarily enough;
need lwsync in general -- but it _almost_ did, and it certainly didn't
guarantee store-before-load/store).

Part (c) might not be correct, however: under the mistaken assumption
that atomic-r/m/w then membar-w/rw is equivalent to atomic-r/m/w then
membar-r/rw, I only audited the cases of membar_enter that _aren't_
immediately after an atomic-r/m/w. All of those cases assume
load-before-load/store. But my assumption was wrong -- there are
cases of atomic-r/m/w then membar-w/rw that would be broken by
changing to atomic-r/m/w then membar-r/rw:

https://mail-index.netbsd.org/tech-kern/2022/03/29/msg028044.html

Furthermore, the name membar_enter has been adopted in other places
like OpenBSD where it actually does follow the documentation and
guarantee store-before-load/store, even if that order is not useful.
So the name membar_enter currently lives in a bad place where it
means either of two things -- r/rw or w/rw.

With this change, we deprecate membar_enter/exit, introduce
membar_acquire/release as better names for the useful pair (r/rw and
rw/w), and make sure the implementation of membar_enter guarantees
both what was documented _and_ what was implemented, making it an
alias for membar_sync.

While here, rework all of the membar_* definitions and aliases. The
new logic follows a rule to make it easier to audit:

membar_X is defined as an alias for membar_Y iff membar_X is
guaranteed by membar_Y.

The `no stronger than' relation is (the transitive closure of):

- membar_consumer (r/r) is guaranteed by membar_acquire (r/rw)
- membar_producer (w/w) is guaranteed by membar_release (rw/w)
- membar_acquire (r/rw) is guaranteed by membar_sync (rw/rw)
- membar_release (rw/w) is guaranteed by membar_sync (rw/rw)

And, for the deprecated membars:

- membar_enter (whether r/rw, w/rw, or rw/rw) is guaranteed by
membar_sync (rw/rw)
- membar_exit (rw/w) is guaranteed by membar_release (rw/w)

(membar_exit is identical to membar_release, but the name is
deprecated.)

Finally, while here, annotate some of the instructions with their
semantics. For powerpc, leave an essay with citations on the
unfortunate but -- as far as I can tell -- necessary decision to use
lwsync, not isync, for membar_acquire and membar_consumer.

Also add membar(3) and atomic(3) man page links.

KERNEL_LOCK(9): New man page for old not-dead-yet hack.

I'm not documenting this to encourage anyone to use it. I'm only
documenting this to remind myself what the semantics is, because it's
kind of confusing and not at all like mutex(9).

__cpu_simple_lock(9): New man page.

This doesn't mean you should use it! Mostly it's to document the
semantics to help understand existing uses, which should not
proliferate, and audit definitions.

Add __MASK(3)

__MASK(n): first n bits all set, where __MASK(4) == 0b1111.

lib/librefuse: Implement all sorts of compat tweaks to appease various file systems

ReFUSE now supports all the FUSE API variants from FUSE 1.1 to FUSE
3.10. Sorry for the freaking giant patch. I could not break it down
any further.

lib/librefuse: Add support for legacy types and functions

lib/librefuse: Add stub functions for FUSE polling API

lib/librefuse: Implement data buffer API appeared on FUSE 2.9

lib/librefuse: Implement FUSE session API and its signal handling functionality

lib/librefuse: Implement logging API appeared on FUSE 3.7

new vnode op ACL pages

section 9 acl related changes

Document PR_PSERIALIZE. Remove documentation for pool_cache_setpredestruct().

Add pool_cache_setpredestruct(), which allows a pool cache to specify
a function to be called before the destructor for a batch of one or more
objects is called. This can be used as a synchronization point by
subsystems that rely on the type-stable nature of pool cache objects or
subsystems that use other forms of passive serialization.

A driver and user land utility for the Sparkfun Serial Controlled Motor
Driver module as illustrated here:

https://www.sparkfun.com/products/13911

A SCMD module is a ARM SOC simular to a Arduino in front of a motor
driver chip. The single SCMD module can control two motors and up to
16 additional modules can be chained together using an internal I2C
bus. One can interface with the SCMD using tty uart commands, SPI or
I2C. The driver in this commit adds a kernel driver for the I2C and
SPI interfaces. The command line utility provides a set of
convenience commands that support most of the functions of the SCMD
and is able to use the tty uart mode, SPI user land or the included
kernel driver in a uniform manor.

The use of the SCMD module is mostly for small robots and the like,
but it can control anything that is controllable by voltage.

Add man pages for posix_spawn_file_actions_add{f,}chdir from piyush

add mgxreg.h

efi: Add /dev/efi character device

Introduce a /dev/efi character device that provides a means for accessing
UEFI RT variable services from userland. Compatible with the FreeBSD ioctl
interface for ease of porting their libefivar and associated tools.

The ioctl interface is defined in sys/efiio.h.

To enable support for this on an arch, the kernel needs `pseudo-device efi`
and the MD EFI implementation needs to register its backend by calling
efi_ops_register(). This commit includes an implementation for Arm.

Added tests for the linear hook APIs

Introduce a generic linear hook list

Add native implementations of eventfd(2) and timerfd(2), compatible with
the Linux interfaces of the same name.

Move the sanitizer libraries from 9.0.0 -> 13.0.0 to match our current clang
version.

install experimental/* and ext/opt_random.h. they're expected to
be there (and the latter was removed by accident.)

regen for everyone (also picks up missing tgmath.h for many ports.)

fixes build of pkgsrc/databases/mongodb for me.

Rump-ify ALTQ (librumpnet_altq.so)

new libfido2

Update LLVM build system for 249b40b558955afe5ac2b549edcf2d7f859c8cc9

This enables the use of modules for a significant build performance gain
when building with clang as host compiler or when using HAVE_LLVM=yes.
Switch libc++ to using the copy from the mono-repo.

Add a new link-aggregation pseudo interface named lagg(4)

- FreeBSD's lagg(4) based implementation
- MP-safe and MP-scalable

branches: 1.2386.2;
Add links for the other functions documented in arc4random(3).

config_found_ia.9 and config_found_sm_loc.9 have been obsoleted.
Should fix build.

Update autoconf(9) for recent autoconfiguration changes.

build cc1objplus. don't forget debug set this time.

build new GCC 10 lto-dump(1) tool.

sort.

- Remove obsolete cltom(9) and mtocl(9).
- Add missing manual page's link of m_adj.

various updates for GCC 10 support. remove dead gcc7/8 support
and properly mark obsolete files in gcc9/gcc10.

testing on amd64 and shark for GCC 9, and many platforms for GCC 10,
(though not arm yet.)

Add usr/include/elfdefinitions.h and usr/include/sys/elfdefinitions.h

Add manpage links for asysctl(3) and asysctlbyname(3), already described
in sysctl(3).

Add printf_nostamp(9), kernel printf() without prepending a timestamp.

Add utmp man pages

new locale pages, sort

Add kmem_tmpbuf_alloc(), a utility function for allocating memory for
temporary use where allocation on the stack is desirable, but only up to
a certain size. If the requested size fits within the specified stack
buffer, the stack buffer is returned. Otherwise, memory is allocated with
kmem_alloc(). Add a corresponding kmem_tmpbuf_free() function that frees
the memory using kmem_free() if it is not the tempory stack buffer location.

Add a manual page for strlist(9).

lint: install custom stdbool.h, used for strict bool mode

lint: remove custom stdbool.h for strict bool mode again

Adding it broke the official builds.

lint: in strict bool mode, integer constants do not have type bool

Previously, lint1 allowed integer constants such as 0 and 1 to be used
as bool constants. This was only half-baked since after fixing all
error messages from that strict mode, there may still be integer
literals in the code that should be replaced with true or false. This
would stop a migration from int to bool in the middle, leaving
inconsistent code around.

To find the remaining type inconsistencies, treat integers and bool as
completely incompatible, even for compile time constants.

Rename man-util-* to comp-c-*

branches: 1.2367.2;
new libfido2

Reintroduce the support of MKCATPAGES

Requested by <mrg>

Remove catman pages support

No longer relevant after the MKCATPAGES removal.

Move the html9/psref* files from comp-sys-catman to comp-sys-htmlman

Install ddb(9). Xref it from ddb(4).

Install the NetBSD XML syscall definitions

add set_rpc_maxgrouplist

rumpify vether(4)

Add HAVE_NVMM and use it to control the build of NVMM related components.
Defined to "yes" on amd64, "no" everywhere else.

As indicated at the top of the file, don't simply remove entries. Instead
we need to mark them "obsolete" so they will get removed if already in the
$DESTDIR

remove getentropy

actually, disable tsan on everything but amd64.

it fails to build on mips64 and arm64 for me as well as others..

mark tsan files as !machine=sparc64.

Revert previous to make iscsi kernel headers optional again, as
required by kamil.

Now, sanitizer in GCC9 has been fixed differently for MKISCSI=no.

Currently restrict GCC TSan files to gcc=9

Build and install GCC TSan for 64-bit CPUs

Include nd.h in sets

Unconditionally install kernel headers for iSCSI as required by
sanitizer shipped with GCC9.

Fix build release with HAVE_GCC=9 for sun2, where MKISCSI=no by default.

Register getrandom.0

Fixes MKCATPAGES=yes build.

install new libstdc++ pstl headers. remove some dead makefile
code and consolidate some of the header installation.

mostly support GCC 9 builds. some what tested with GCC 9 but
tested to not break GCC 8 builds for x86, arm*, vax, and sparc*.

clean up file lists

- remove trailing whitespace
- remove empty line
- remove typo "htm\tl", that line is repeated

Clarify wg(4)'s relation to WireGuard, pending further discussion.

Still planning to replace wgconfig(8) and wg-keygen(8) by one wg(8)
tool compatible with wireguard-tools; update wg(4) for the minor
changes from the 2018-06-30 spec to the 2020-06-01 spec; &c. This just
clarifies the current state of affairs as it exists in the development
tree for now.

Mark the man page EXPERIMENTAL for extra clarity.

[ozaki-r] Add wg files

New system call getrandom() compatible with Linux and others.

Three ways to call:

getrandom(p, n, 0) Blocks at boot until full entropy.
Returns up to n bytes at p; guarantees
up to 256 bytes even if interrupted
after blocking. getrandom(0,0,0)
serves as an entropy barrier: return
only after system has full entropy.

getrandom(p, n, GRND_INSECURE) Never blocks. Guarantees up to 256
bytes even if interrupted. Equivalent
to /dev/urandom. Safe only after
successful getrandom(...,0),
getrandom(...,GRND_RANDOM), or read
from /dev/random.

getrandom(p, n, GRND_RANDOM) May block at any time. Returns up to n
bytes at p, but no guarantees about how
many -- may return as short as 1 byte.
Equivalent to /dev/random. Legacy.
Provided only for source compatibility
with Linux.

Can also use flags|GRND_NONBLOCK to fail with EWOULDBLOCK/EAGAIN
without producing any output instead of blocking.

- The combination GRND_INSECURE|GRND_NONBLOCK is the same as
GRND_INSECURE, since GRND_INSECURE never blocks anyway.

- The combinations GRND_INSECURE|GRND_RANDOM and
GRND_INSECURE|GRND_RANDOM|GRND_NONBLOCK are nonsensical and fail
with EINVAL.

As proposed on tech-userlevel, tech-crypto, tech-security, and
tech-kern, and subsequently adopted by core (minus the getentropy part
of the proposal, because other operating systems and participants in
the discussion couldn't come to an agreement about getentropy and
blocking semantics):

https://mail-index.netbsd.org/tech-userlevel/2020/05/02/msg012333.html

new openldap.h

extattr.3 is obsolete

Add ppoll() a compatibility wrapper around pollts(2)

Submitted by Apurva Nandan.

Update pci_configure_bus(9) to reflect the new reality -- no more manual
fiddling with extent maps, use pciconf_resource_{init,add,fini}() instead.

Add vmem_xfreeall(), which frees all allocated regions in the specified arena.
All outstanding allocations MUST have been performed with vmem_xalloc() or
else the behavior is undefined. (This also implies that the arena must also
not have a quantum cache; note this in the documentation.)

Add compatfile to libblacklist

Rename blacklist -> blocklist

Build and install llvm-symbolizer for MKLLVM=yes

llvm-symbolizer is an alternative for GNU addr2line(1), heavily used by the
LLVM sanitizers.

Do not install it as tools as it is not necessary as of today in that
stage.

install fault.h

One more libprop-related cat pages fixup.

Improvements to the problib(3) API:

==> Provide a much more complete set of setters and getters for different
value types in the prop_array_util(3) and prop_dictionary_util(3)
functions.

==> Overhaul the prop_data(3), prop_number(3), and prop_string(3) APIs
to be easier to use and less awkwardly named, Deprecate the old
awkward names, and produce link-time warnings when they are referenced.

==> Deprecate mutable prop_data(3) and prop_string(3) objects. The old
APIs that support them still exist, but will now produce link-time
warnings when used.

==> When the new prop_string(3) API is used, strings are internally
de-duplicated as a memory footprint optimization.

==> Provide a rich set of bounds-checked gettter functions in and a
corresponding set of convenience setters in the prop_number(3) API.

==> Add a new prop_bool_value(3) function that is equivalent to
prop_bool_true(3), but aligned with the new "value" routines in
prop_data(3), prop_string(3), and prop_number(3).

Make libuv private, requested by joerg@

new bind+libuv

put back extattr.3

move the fido man pages from man to comp where they belong. I wonder about
the other section 3 man pages? Should they also move from man to comp?

Add ACL support for FFS. From FreeBSD.

PR/55102: Kamil Rytarowski: Duplicate fifo_vnodeop_entries,
fifo_vnodeop_opv_desc symbols.

Many filesystems ffs, lfs, ulfs, chfs, ext2fs etc. use fifofs
internally for their fifo vnops. NFS does too, but it also needs
networking anyway. Unfortunately fifofs brings in a lot of the
networking code so that the rumpkernel is not well partition. In
addition the fifo code is rarely used.

The existing hack depended on duplicating the above symbols and
adding minimal functionality for the majority of the the tests
(except the ffs and the puffs one). In these two cases both symbols
were loaded and the symbol sizes clashed which broke the sanitizers.
While this can be fixed with weak symbols and other kinds of
indirection, it is more straight forward to select between the
minimal and the full fifofs implementation by introducing a new
shared library librumpvfs_nofifofs.

Add getentropy() to libc - a simple wrapper to access the kernel CSPRNG.

Posted to tech-userlevel@ a week ago and reviewed by riastradh@.

GETENTROPY(3) Library Functions Manual GETENTROPY(3)

NAME
getentropy - fill a buffer with high quality random data

LIBRARY
Standard C Library (libc, -lc)

SYNOPSIS
#include <unistd.h>

int
getentropy(void *buf, size_t buflen);

DESCRIPTION
The getentropy() function fills a buffer with high quality random data,
suitable for seeding cryptographically secure psuedorandom number
generators.

getentropy() is only intended for seeding random number generators and is
not intended for use by regular code which simply needs secure random
data. For this purpose, please use arc4random(3).

The maximum value for buflen is 256 bytes.

IMPLEMENTATION NOTES
getentropy() reads from the sysctl(7) variable kern.arandom.

RETURN VALUES
The getentropy() function returns 0 on success, and -1 if an error
occurred.

ERRORS
getentropy() will succeed unless:

[EFAULT] The buf argument points to an invalid memory address.

[EIO] Too many bytes were requested.

SEE ALSO
arc4random(3), rnd(4)

STANDARDS
The getentropy() function is non-standard.

HISTORY
The getentropy() function first appeared in OpenBSD 5.6, then in
FreeBSD 12.0, and NetBSD 10.

link also m_apply(9) to mbuf(9)

Rewrite entropy subsystem.

Primary goals:

1. Use cryptography primitives designed and vetted by cryptographers.
2. Be honest about entropy estimation.
3. Propagate full entropy as soon as possible.
4. Simplify the APIs.
5. Reduce overhead of rnd_add_data and cprng_strong.
6. Reduce side channels of HWRNG data and human input sources.
7. Improve visibility of operation with sysctl and event counters.

Caveat: rngtest is no longer used generically for RND_TYPE_RNG
rndsources. Hardware RNG devices should have hardware-specific
health tests. For example, checking for two repeated 256-bit outputs
works to detect AMD's 2019 RDRAND bug. Not all hardware RNGs are
necessarily designed to produce exactly uniform output.

ENTROPY POOL

- A Keccak sponge, with test vectors, replaces the old LFSR/SHA-1
kludge as the cryptographic primitive.

- `Entropy depletion' is available for testing purposes with a sysctl
knob kern.entropy.depletion; otherwise it is disabled, and once the
system reaches full entropy it is assumed to stay there as far as
modern cryptography is concerned.

- No `entropy estimation' based on sample values. Such `entropy
estimation' is a contradiction in terms, dishonest to users, and a
potential source of side channels. It is the responsibility of the
driver author to study the entropy of the process that generates
the samples.

- Per-CPU gathering pools avoid contention on a global queue.

- Entropy is occasionally consolidated into global pool -- as soon as
it's ready, if we've never reached full entropy, and with a rate
limit afterward. Operators can force consolidation now by running
sysctl -w kern.entropy.consolidate=1.

- rndsink(9) API has been replaced by an epoch counter which changes
whenever entropy is consolidated into the global pool.
. Usage: Cache entropy_epoch() when you seed. If entropy_epoch()
has changed when you're about to use whatever you seeded, reseed.
. Epoch is never zero, so initialize cache to 0 if you want to reseed
on first use.
. Epoch is -1 iff we have never reached full entropy -- in other
words, the old rnd_initial_entropy is (entropy_epoch() != -1) --
but it is better if you check for changes rather than for -1, so
that if the system estimated its own entropy incorrectly, entropy
consolidation has the opportunity to prevent future compromise.

- Sysctls and event counters provide operator visibility into what's
happening:
. kern.entropy.needed - bits of entropy short of full entropy
. kern.entropy.pending - bits known to be pending in per-CPU pools,
can be consolidated with sysctl -w kern.entropy.consolidate=1
. kern.entropy.epoch - number of times consolidation has happened,
never 0, and -1 iff we have never reached full entropy

CPRNG_STRONG

- A cprng_strong instance is now a collection of per-CPU NIST
Hash_DRBGs. There are only two in the system: user_cprng for
/dev/urandom and sysctl kern.?random, and kern_cprng for kernel
users which may need to operate in interrupt context up to IPL_VM.

(Calling cprng_strong in interrupt context does not strike me as a
particularly good idea, so I added an event counter to see whether
anything actually does.)

- Event counters provide operator visibility into when reseeding
happens.

INTEL RDRAND/RDSEED, VIA C3 RNG (CPU_RNG)

- Unwired for now; will be rewired in a subsequent commit.

Add a NetBSD native futex implementation, mostly written by riastradh@.
Map the COMPAT_LINUX futex calls to the native ones.

fix netsmb, libgnuctf

gnuctf is only binutils=234

fix sets for new binutils

remove SMBFS and nsmb/netsmb - userland part

Put the ioctl definitions in a header, and install it.

Document strerror_l()

While here also document (but comment it out since it isn't
available - yet) strerror_lr(). To include that, simply
uncomment the relevant lines, and (twice I think) s/returns/return/
on lines just after currently commented out lines (that is, it
currently says, "A returns" after the comments are returned, we
need it to be "A and B return" - the "and B" appears when the comment
markers are removed, removing the 's' from returns must be done manually.

In addition to adding strerror_l() some additional enhancements were
made to the general strerror() doc.

add pw_gensalt

curses: Add stubs for mouse functions

No mouse support actually included.
But that doesn't matter because most terms don't actually support a mouse.

We should look into hooking these into wsmouse(4) and xterm mouse
in the future.

Compatable with nCurses mouse API version 2.

Wrap vnode_impl.h in defined(_KERNEL) || defined(_KMEMUSER), and install
it for kmem grovellers.

add libfido2, libcbor, pam-u2f, sort

Add rw_lock_op(): return either RW_READER or RW_WRITER for a lock that is
known to be held by the caller. Panic if the lock is not held.

Install LLVM sanitizers to /usr/lib/clang/9.0.0

This is the proper location where clang 9.0.0 looks for them.

Add percpu_foreach_xcall(9).

New function percpu_create.

Associates a constructor and destructor with the percpu. Currently
the constructor runs immediately, but in principle we could use the
same API for future CPU hotplug support.

This lets you sleep for allocation or draining users before
deallocation when setting up or tearing down a percpu -- currently we
have many abuses of percpu_foreach in tree for that purpose.

Proposed on tech-kern:
https://mail-index.NetBSD.org/tech-kern/2020/01/30/msg026036.html

remove urio(4), a driver for the Rio500 MP3 player.

At this point it is highly unlikely this 1999 device still has users,
but it still comes up in the context of maxv's USB-fuzzing (and any device
could pretend to be a urio(4)), so it's best to get rid of it.

Renamed all major entries to obsolete, as was done in previous removals.

This still requires an update to sanitizers, but they're located in
"external", perhaps it should be first committed upstream?

Proposed on tech-kern a month ago.

Add <net/if_stats.h>.

Remove FDDI support.

Remove filemon(4).

Discussed on tech-kern:
https://mail-index.NetBSD.org/tech-kern/2020/01/13/msg025938.html

This was never (intentionally) enabled by default, and the design has
some shortcomings. You can get mostly the same results with ktrace,
as in usr.bin/make/filemon/filemon_ktrace.c which is now used instead
of filemon for make's meta mode.

If applications require higher performance than ktrace, or nesting
that ktrace doesn't support, we might consider adding something back
into the vfs system calls themselves, without hijacking the syscall
table. (Might want a more reliable output format too, e.g. one that
can handle newlines in file names.)

Remove Token Ring support.

Fix set lists after HIPPI removal

Remove HIPPI support and the esh(4) driver that uses it. There have not
been any users of HIPPI for some time, and it is unlikely to be resurrected.

Document dlinfo(3)

Man-page taken from FreeBSD.

Revert the removal of filemon.

Retire filemon, discussed on tech-kern@.

Include radixtree in the kernel.

Add missing MLINK for membar_datadep_consumer(3).

Detected by the indefatigable wizd.

Missed another spot.

Marked mb.9 obsolete but forgot to mark mb_memory.9 &c. too.

New atomic load/store operations for the kernel.

Guarantee no fusing and no tearing, and can optionally impose
ordering relative to other memory operations.

Unordered:
- atomic_load_relaxed
- atomic_store_relaxed

Ordered:
- atomic_load_acquire
- atomic_load_consume
- atomic_store_release

These are intended to match C11 semantics, and can be defined in
terms of the C11 atomic API when ready.

Nix obsolete mb(9) man page.

Update LLVM to 10.0.0git (01f3a59fb3e2542fce74c768718f594d0debd0da)

Add __FPTRCAST

Add manpage links for frexpf and frexpl.

Manpage links were missing for frexpf and frexpl even thogh they were
mentioned in the manpage for frexp.

gcc 8 set lists updates. i don't appear to have broken gcc 7 builds
but i only tested a couple of them.

Describe roundup2(9) in roundup(9).
Bump date.

Install it also as roundup2(9).

new libpcap

fexecve(2) related additions.

curses(3): add curses_version()

Returns NetBSD-Curses %s
Where %s is the NetBSD version taken from sys/param.h

Discussed on tech-net@, only for ncurses compat.

Install thmap(9) man page.

fix MKCXX=no:
- don't build GDB
- don't build sanitizers
- don't build GCC commands
- fix some set lists

Ship with sanitizer/lsan_interface.h for LLVM 7

Leak Sanitizer header is already needed in the distribution for built with
Address Sanitizer (MKSANITIZER):

- dist/llvm/utils/TableGen/TableGen.cpp
- dist/clang/utils/TableGen/TableGen.cpp

Next version of LLVM (9.0) will ship with LSan.

Ship with sanitizer/lsan_interface.h for GCC 7

Leak Sanitizer is there.

Add LLVM sanitizers in the MKLLVM=yes build

Enable in all the supported variations for NetBSD/amd64:

- Address Sanitizer
- Thread Sanitizer
- Memory Sanitizer
- Undefined Behavior Sanitizer
- SafeStack
- libFuzzer
- XRay

This change enables the features on amd64 for start.

usbnet may be stable now. document it.

branches: 1.2278.2;
Update build glue and configuration for libarchive 3.4.0.

it's html not himl. should fix build.

new openssl man page

Fix CATPAGES entries in distrib files

Register CMSG_DATA.0, getcchar.0, acorn32/boot.0.

These files were marked as obsolete which is no longer true.

Add experimental userland interface to IPMI driver. Currently, transactions
(like sensor readout) are locked, so that a userland program may interfere with
envsys operation.

To use this you need a program like ipmitool built with OpenIPMI support.

Update manpages respond to isaki-audio2 branch.

Add a C99 symbol to libm: nexttowardl

It's an alias for an already existing symbol nextafterl.

Patch obtained from <mgorny>

Detected by the LLVM buildbot breakage in tests.

document cosl with MLINKS and in the man page

Add a complete C11 threads(3) implementation

C11 Thread support library is a portable threading C API between OSs,
similar to std::threads in the C++ world.

The library is implemented as a thin shim over POSIX interfaces.

NetBSD implements the API as a part of the POSIX threading library
(libpthread(3)).

C11 threads(3) are in the process of making them an integral part
of the POSIX standard. The interface has been implemented in major
OSs and used with stopgap libraries for older versions of them.

C11 threading library is already used (with a stopgap implementation)
in the NetBSD distribution in MESA.

Original implementation by myself from 2016.

ATF tests are new and cover almost all interfaces.

Proposed on tech-userlevel@.

Don't install YP headers when MKYP=no

Correct ustore(9) entry for MKCATPAGES=yes

Revert llvm -> llvmcmds unintended changes in distrib files

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

Revert MKLLVMCMDS changes.

split MKLLVM into MKLLVM and MKLLVMCMDS, like MKGCC and MKGCCCMDS:

- only build clang or clang-tblgen if MKLLVMCMDS != "no"
- move HAVE_MESA_VER earlier so we can detect mesa 18 and enable
MKLLVM on platforms that need it
- move the clang commands and headers into llvmcmds group
- only build the clang specific LLVM libraries if MKLLVMCMDS != "no"

much of this work came from maya@'s github commit
f90685c11d4460d3098fa35f48b58d1893e974e0, reworked for HAVE_MESA_VER
and llvmcmds vs MKCLANG.


build tested on several platforms and on amd64 and i386 with several
different build options (clang build, gcc build, gcc build with llvm
libs).

lint library for jemalloc

Add libjemalloc.so

Register missing CAT page spi.0 in distribution files

Add userland driver to spi framework.

Previously spi would configure the controller to use the lowest speed of
all connected devices since the kernel started and to fail attempted mode
changes. This is now improved to keep individual modes and speeds for each
slave and to reconfigure the controller as necessary for each transfer.

Added man page for spi(9).

Add KCOV - kernel code coverage tracing device

The KCOV driver implements collection of code coverage inside the kernel.
It can be enabled on a per process basis from userland, allowing the kernel
program counter to be collected during syscalls triggered by the same
process.

The device is oriented towards kernel fuzzers, in particular syzkaller.

Currently the only supported coverage type is -fsanitize-coverage=trace-pc.

The KCOV driver was initially developed in Linux. A driver based on the
same concept was then implemented in FreeBSD and OpenBSD.

Documentation is borrowed from OpenBSD and ATF tests from FreeBSD.

This patch has been prepared by Siddharth Muralee, improved by <maxv>
and polished by myself before importing into the mainline tree.

All ATF tests pass.

openssl/store.h is installed by openssl 1.1, don't obsolete it every build.

run this through sort -u. removes a few duplicates and fixes order.

lto1 and lto-wrapper are part of gcccmds set.

put g++/debug/{assertions,helper_functions,stl_iterator}.h back in the
normal gcc set, since we have it for gcc6 and gcc7.

should fix builds. reported by moof, but i also see 47 builds failed
on HEAD on the latest build report so far.

- add new entries of gcc=7 and libgomp, libasan, liblsan, libstdc++, libubsan
- add missing header files fpr gcc=7
- add some missing gcc=5 obsolete entries
- create ./usr/include/dev/bluetooth in mtree not make, and move it into the
base set where all other directories are.

Remove the satlink driver. It was disabled everywhere, had no man page and
no use either. Spotted by thorpej in PR/21345, ok christos.

adjust libstdc++ headers for gcc7.

add basic gcc-7 support in sets lists and filesystem. mips gained
a header. assumes it's otherwise mostly the same as gcc-7.

- mark gcc=5 files obsolete
- make includes always available, not only when gcccmds
- mark files obsolete consistently

If we are building gcc, we always install the include files, otherwise
we can't build things even when cross-compiling because of missing header
files (like stdatomic.h). Really all the md/ad header files now will be
installed when mkgcccmds=no, but I've only fixed m68k.

Revert installing llvm headers.

Move llvm header directories to base/mi.
They are created unconditionally by mtree.

Should help with set lists on non-llvm-for-now builds :-)

Install most of the llvm headers.

This is missing some generated files, llvm/include/IR/*.inc

Add threadpool(9), an abstraction that provides shared pools of kernel
threads running at specific priorities, with support for unbound pools
and per-cpu pools.

Written by riastradh@, and based on the May 2014 draft, with a few changes
by me:
- Working on the assumption that a relative few priorities will actually
be used, reduce the memory footprint by using linked lists, rather than
2 large (and mostly empty) tables. The performance impact is essentially
nil, since these lists are consulted only when pools are created (and
destroyed, for DIAGNOSTIC checks), and the lists will have at most 225
entries.
- Make threadpool job object, which the caller must allocate storage for,
really opaque.
- Use typedefs for the threadpool types, to reduce the verbosity of the
API somewhat.
- Fix a bunch of pool / worker thread / job object lifecycle bugs.

Also include an ATF unit test, written by me, that exercises the basics
of the API by loading a kernel module that exposes several sysctls that
allow the ATF test script to create and destroy threadpools, schedule a
basic job, and verify that it ran.

And thus NetBSD 8.99.29 has arrived.

Update the man page, we don't want M_COPY_PKTHDR, M_MOVE_PKTHDR, MH_ALIGN
and M_ALIGN.

add new sqlite3 man pages.

Correct libproc_p.a in distribution sets

There was a stale entry under MKPROFILE=no option.

Retire the LMC driver, and its associated lmcconfig tool. LMC has been
mentioned repeatedly as a non-MP-safe driver that is hard to maintain,
and no one is taking care of it.

LMC was removed from OpenBSD three years ago, and from FreeBSD a few
months ago.

Correct the documentation of cdbr_open_mem(3)

Fix function prototype in the man-page.
Add link cdbr_open_mem(3) -> cdbr(3).

Provide basic documentation on getcchar(3) and setcchar(3).

Looks like we don't have any of wide curses stuff documented, so this
seems to be a good place to start. Needs more exposition on wide
attr_t and how it's related to non-wide chtype, etc, etc.

Simplify the mtag API:

- Remove m_tag_init(), m_tag_first(), m_tag_next() and
m_tag_delete_nonpersistent().

- Remove the 't' argument from m_tag_delete_chain().

Repair after 1.2234 - restore obsoleted cat pages, I must have been
very confused about how we do it now.

Register missing files in distrib sets

Add curses_insch.0, mvinsch.0 and mvwinsch.0.

Mark html3/curses_insertch.html as obsolete too.

Rename curses_insertch.3 to curses_insch.3 to match the function names
documented in that manpage. With the letter salad used in curses
function names naming consistency is very important and this page was
the only one that didn't match.

Add mvinsch and mvwinsch links. Update xrefs in other man pages.

Bring back three state file system suspension:

NORMAL -> SUSPENDING -> SUSPENDED

and add operation fstrans_start_lazy() that only blocks while SUSPENDED.

Change vndthread() support operation handle_with_rdwr() to bracket
its file system operations by fstrans_start_lazy() and fstrans_done().

PR kern/53624 (dom0 freeze on domU exit)

Revive netipsec/keysock.h, accidentally marked obsolete in r1.2230.

Reported by Robert Swindells on current-users.

merge openssl-1.1.1

Remove ISDN from the kernel. It has remained unmaintained for a long time,
is of poor quality, and is now an obstacle to MP-ification. It was removed
ten years ago from FreeBSD for the same reason.

This retires a big user of the mbuf API, and will ease maintenance of the
kernel.

Add rumpkern_nv (in-kernel RUMP libnv).

Remove netkey/.

Remove netinet6/ipsec.h.

Remove the network ATM code.

Yet another pcap include.

more includes for pcap

Update for removal of pcap/export-defs.h

Add missing lint library, sort

There is no possible reason that <sys/asan.h> can be useful to
userland, all it contains is a few prototypes for kernel functions.
So, don't install asan.h in /usr/include/sys (if it ever gains
anything which would be useful, then this can be changed).

Note: I have simply removed /usr/includ/esys/asan.hit from the sets
list, rather than marking it obsolete - it has not been there for
very long, If you get build problems (sets list errors) from an
update build because you managed to install it during the last few
hours, just remove asan.h from /usr/include/sys

Add the new sys/kasan.h to the distrib sets lists

Retire EtherIP, we have L2TP instead.

- although I like the ",obsolete" better, the convention is to obliterate
the info
- fix lint

fix the libns and liblwres entries for new bind.

Fix distribution lists with MKCATPAGES=yes

Add SCTP documentation.

Add userland support for SCTP and manpages.

Add a port of the umb(4) driver from OpenBSD

The umb(4) driver provides support for USB MBIM (Mobile Broadband
Interface Model) devices.

MBIM devices establish connections via cellular networks such as GPRS,
UMTS, and LTE. They appear as a regular point-to-point network interface, transporting raw IP frames.

Required configuration parameters like PIN and APN have to be set with
umbctl(8), a new tool specific to this driver. The IP address is configured
automatically; the default route and DNS server information have to be set
separately.

The driver is not fully functional yet, it is therefore still marked as
experimental and disabled by default. Any help welcome to complete it!

Tested on NetBSD/amd64, with a Sierra Wireless EM7345 LTE modem on a Lenovo
ThinkPad T440s. No functional change expected otherwise.

Userland changes for getsockopt2().

Update LLVM/Clang build system to r337282.

Retire ipkdb entirely. The option was removed from the config files
yesterday.

ok kamil christos

Remove the kernel PMC code. Sent yesterday on tech-kern@.

This change:

* Removes "options PERFCTRS", the associated includes, and the associated
ifdefs. In doing so, it removes several XXXSMPs in the MI code, which is
good.

* Removes the PMC code of ARM XSCALE.

* Removes all the pmc.h files. They were all empty, except for ARM XSCALE.

* Reorders the x86 PMC code not to rely on the legacy pmc.h file. The
definitions are put in sysarch.h.

* Removes the kern/sys_pmc.c file, and along with it, the sys_pmc_control
and sys_pmc_get_info syscalls. They are marked as OBSOL in kern,
netbsd32 and rump.

* Removes the pmc_evid_t and pmc_ctr_t types.

* Removes all the associated man pages. The sets are marked as obsolete.

...and obsolete the html of pmc.3 too... We will obsolete all the pmc*
references anyway.

Obsolete pmc.3, it was part of libpmc.

Fix build. pf_ioctl.c needs netinet/in_offload.h (after previous change).
Because this is in a module, apparently, that means that netinet_in_offload.h
needs to get installed in /usr/include, so do that as well.

Feel free to fix this in a better way...

branches: 1.2206.2;
put back lsan

Comment out liblsan entries to fix the build

Add the lsan libraries

Fix names of module_{,un}register_callbacks pages

Add the module specificdata entries to the sets lists. While here, sort
the entries for module(9) and specificdata(9) and use the correct setname
selectors for the latter.

Update sets lists for new MLINKS for module(9)

Add new module(9) links to the sets lists

merge a new version of the CDDL dtrace and ZFS code.
this changes the upstream vendor from OpenSolaris to FreeBSD,
and this version is based on FreeBSD svn r315983.

in addition to the 10 years of improvements from upstream,
this version also has these NetBSD-specific enhancements:
- dtrace FBT probes can now be placed in kernel modules.
- ZFS now supports mmap().

Move the audio specification to section 9 under audio_system.

Ok wiz@

Don't mention sprintf and vsprintf, they don't exist in the kernel.
Drop MLINKS, too.

obsolete DES_random_key

fix build

obsolete HMAC from cat3 as it was renamed to openssl_HMAC

rename {HMAC,MD5} to openssl_{HMAC,MD5}; add openssl_MD{2,4}

remove ubc_alloc(9) and ubc_release(9) from ubc(9) from the documentation, they
are internal (static) functions

pointed out by Matthew Green in private email

fix proflib for bozo

files with _p.a suffix should be tagged profile, files with _pic.a suffix belong
in the shl.mi list. learnt through broken sun2 build.

fix bozo issues:
- sort
- add lintlib

Hello libbozohttpd(3)
Enabling as it is a dependency for bozohttpd(3lua).

Make sys/pmf.h available to userland (again).

The recently exposed device.h internals to _KMEMUSER also require
exposing details about pmf.

The current build works without this as the only user is crash(8)
which partially uses kernel sources and is compiled with the
additional kernel include path.

Remove m_getclr. It is unused, confusing (vs m_clget), and is a weak
implementation (eg you can't request a zeroed pkthdr mbuf).

Document opendisk1() - it has been around long enough.
(pity about the name...)

XXX pullup-8

branches: 1.2185.2;
Correct OpenSSL 1.1 entries in plist

Fix references to:
./usr/share/man/cat3/BIO_get_data.0
./usr/share/man/cat3/SSL_CONF_cmd.0

This is obserbable with the MKCATPAGES=yes build option.

Try to correct generation of the sun2 distribution

Mark the headers for GCC sanitizers as gcccmds.

Currently, it is not necessary to install rss_config.h. Pointed out by msaitoh@n.o.

Fix build failure, sorry.

obsolete some GCC 4.8 files.

Add obsolete lines for the gcc-5 and openssl-1.0 lines for systems that have
installed gcc-6 and openssl-1.1. Requested by wiz@

fix openssl-1.1

try to make this match what I believe is current reality

add openssl to the list of selectable variables for sets and fix the sets.

build and install gcov-dump.

more updates for GCC 6. with other uncommited changes, i386 seems
to work well enough for hello.c, hello.cc and hello.m.

updates for GCC 6.4: add gcc-6 specific headers, combine some
all-gcc files, bump the shlib versions on new libs.

convert HAVE_GCC handling to modern GCC release numbering:
- HAVE_GCC=5 is now the default (vs. HAVE_GCC=53 we've been using for
GCC 5.4 and GCC 5.5.)
- remove some more GCC 4.8 code. we don't support GCC 4 here.
- adjust set lists to gcc=5 from gcc=53.

add some basic HAVE_GCC=6 handling (totally unused so far.)

Install GCC (gcc.old/) headers for Sanitizers

Install:
- allocator_interface.h
- asan_interface.h
- common_interface_defs.h
- tsan_interface_atomic.h

Into:
- /usr/include/gcc-5/sanitizer

Note headers in a comment headers for introduction in future:
- dfsan_interface.h
- lsan_interface.h
- msan_interface.h

Skip a file that will never be relevant on NetBSD:
- linux_syscall_hooks.h

PR 52265 by Kamil Rytarowski

Proposed and accepted on tech-toolchain@.

Sponsored by <The NetBSD Foundation>

When second keyword is 'obsolete', first one should be foo-obsolete as well.

document pfil_{add,remove}_ihook, pfil_run_{addr,if}hooks

from ryo shimizu in PR bin/51941

changes by myself: fix mdoc -Tlint, add missing set lists, adjust date
to today, reword history addition.

ipsec(4) interface supports rump now.

add ipsec(4) interface, which is used for route-based VPN.

man and ATF are added later, please see man for details.

reviewed by christos@n.o, joerg@n.o and ozaki-r@n.o, thanks.
https://mail-index.netbsd.org/tech-net/2017/12/18/msg006557.html

Merge autofs support from: Tomohiro Kusumi
XXX: Does not work yet

add missing dtrace tag for librtld_db.0

add strfmon_l man page links

Try to correct removal of <sys/vadvise.h>

Drop <sys/vadvise.h>

The (o)vadvise syscall is dummy since the beginning of NetBSD.

Sponsored by <The NetBSD Foundation>

Fix fallout from hid factorisation:
- need to install sys/dev/hid/hid.h for userland
- include it where needed - most of the time in place if usb/usbhid.h

Add the new sha3.h file

Add driver for QEMU Firmware Configuration device.

This interface allows the host to pass various data items and files to
the guest OS.

remove both timestamp and static pie

not ready for static pie either.

remove tstamp.h, this is for a different time.

kmem_str{dupsize,free} man pages.

Also mark ppi.html as obsolete

remove ppi(9) manpage, the actual subsystem got never implemented

PR kern/52665 by Kamil Rytarowski

Implement tcgetwinsize() and tcsetwinsize() in libc, with access
via <termios.h> (and document them.) Bump libc minor number for them.

Arrange for "struct winsize" to become visible in <termios.h>

Fix stty(1) so that "cols" is reported as the arg to set number of columns,
and "columns" is the alias, rather than the other way around, as "cols" is
what has been added to POSIX.

This is to conform with updates to be included in 1003.1 issue 8
(whenever that gets published) currently available at:
http://austingroupbugs.net/view.php?id=1053 (see note 3863)
http://austingroupbugs.net/view.php?id=1151 (see note 3856)

Add endian.h header. Simply includes sys/endian.h

<endian.h> has been accepted by the austin group.

Add librumpres

Missed a "C"

Don't install stdatomic.h if we don't have gcccmds. This is prolly the wrong
fix but only sun2 is affected. Perhaps it is better to descend into
usr.bin/include and install there because that also installs tgmath.h and
unfortunately math-68881.h...

add stdatomic.h

Add man page link for hypotl.3

Install new man-page devname_r(3).

This is a link to devname(3).

All things considered, remove the i386_pmc API. I deprecated it some
months ago, and clearly no one should be using it.

(reminder: our new PMCs use the same sysarch, but the arguments are
opaque and not compatible with the previous versions)

Remove the i386_vm86 API (instead of just deprecating it). This API is not
available anymore, and any binary using it won't function correctly.

Update lists for btuart h5 protocol includes.

Update LLVM build glue for 5.0RC1.

Remove <sys/user.h>

Proposed on the the tech-userlevel mailing list without strong objections.

This file no longer serves any purpose in any supported release branch.

There will be fallout in pkgsrc, please restrict inclusion <sys/user.h> to
FreeBSD and DragonflyBSD.

I tried to iterate over packages in pkgsrc and there was little fallout,
however I don't have the full sources to scan every source code. I already
upstreamed to several projects removal of inclusion on NetBSD of
<sys/user.h> (like Qt5).

Update for wsbell(4) manual pages.

Add dtc

branches: 1.2138.2;
merge the bouyer-socketcan branch to HEAD.

CAN stands for Controller Area Network, a broadcast network used
in automation and automotive fields. For example, the NMEA2000 standard
developped for marine devices uses a CAN network as the link layer.

This is an implementation of the linux socketcan API:
https://www.kernel.org/doc/Documentation/networking/can.txt
you can also see can(4).

This adds a new socket family (AF_CAN) and protocol (PF_CAN),
as well as the canconfig(8) utility, used to set timing parameter of
CAN hardware. Also inclued is a driver for the CAN controller
found in the allwinner A20 SoC (I tested it with an Olimex lime2 board,
connected with PIC18-based CAN devices).

There is also the canloop(4) pseudo-device, which allows to use
the socketcan API without CAN hardware.

At this time the CANFD part of the linux socketcan API is not implemented.
Error frames are not implemented either. But I could get the cansend and
canreceive utilities from the canutils package to build and run with minimal
changes. tcpudmp(8) can also be used to record frames, which can be
decoded with etherreal.

Fix MKCATPAGES=yes build

Fix typo in the cat1/openssl_ocsp.0 entry: "cat" -> ".cat".

Add MLINKS for the functions described in bufq(9)

Remove MKCRYPTO option.

Originally, MKCRYPTO was introduced because the United States
classified cryptography as a munition and restricted its export. The
export controls were substantially relaxed fifteen years ago, and are
essentially irrelevant for software with published source code.

In the intervening time, nobody bothered to remove the option after
its motivation -- the US export restriction -- was eliminated. I'm
not aware of any other operating system that has a similar option; I
expect it is mainly out of apathy for churn that we still have it.
Today, cryptography is an essential part of modern computing -- you
can't use the internet responsibly without cryptography.

The position of the TNF board of directors is that TNF makes no
representation that MKCRYPTO=no satisfies any country's cryptography
regulations.

My personal position is that the availability of cryptography is a
basic human right; that any local laws restricting it to a privileged
few are fundamentally immoral; and that it is wrong for developers to
spend effort crippling cryptography to work around such laws.

As proposed on tech-crypto, tech-security, and tech-userlevel to no
objections:

https://mail-index.netbsd.org/tech-crypto/2017/05/06/msg000719.html
https://mail-index.netbsd.org/tech-security/2017/05/06/msg000928.html
https://mail-index.netbsd.org/tech-userlevel/2017/05/06/msg010547.html

P.S. Reviewing all the uses of MKCRYPTO in src revealed a lot of
*bad* crypto that was conditional on it, e.g. DES in telnet... That
should probably be removed too, but on the grounds that it is bad,
not on the grounds that it is (nominally) crypto.

Remove MKCRYPTO_RC5. Unconditionally include RC5 in libcrypto.so.

This option existed only because RC5 is covered by patents that, twenty
years ago, we had reason to suspect the patent holder, RSA, Inc., might
litigate. The two US patents in question are 5,724,428 and 5,835,600.

According to the USPTO Patent Term Calculator web site at
<https://www.uspto.gov/patent/laws-and-regulations/patent-term-calculator#heading-5>
(retrieved 2017-05-21), patents filed after 1995-06-07 expire twenty
years after the filing date.

number filing date
5,724,428 1995-11-01
5,835,600 1997-04-21

Thus, these patents appear to be expired.

As proposed on tech-crypto and tech-security:

https://mail-index.netbsd.org/tech-crypto/2017/05/05/msg000718.html
https://mail-index.netbsd.org/tech-security/2017/05/05/msg000927.html

Introduce new localcount(9) reference-count primitives.

Fix distribution build for MKCATPAGES=yes

Add: cat3/signalname.0, cat3/signalnext.0, cat3/signalnumber.0

Add the new signalname/signalnext/signalnumber interface to libc.

This as discussed on current-users in the thread
entitled:
Proposal: new libc/libutil functions to map SIGXXXX <-> "XXXX"
that can be found (starting at):
http://mail-index.netbsd.org/current-users/2017/04/28/msg031600.html

These functions provide the mechanism to enable applications
to divorce themselves from internal details of the signal
implementation.

Libc minor bumped, prototypes in <signal.h>, sets lists updated (and sorted).

One and all: feel free to improve the sources & man page (etc), but
please do not change the function signatures without discussion.

Remove yet another entry for localcount - we're not ready yet

Too early for including localcount here, too

Sets list for new mutex_ownable(9) entry

Add new primary entry for devsw(9) man page

Remove a couple of over eager obsolete markers.

branches: 1.2125.2;
Update build system for libarchive-3.3.2pre.

New rndsource driver for Araneus Alea II TRNG USB devices.

Disabled by default in x86/GENERIC and usbdevices.config pending
review and testing without rump ugenhc in the way, but enabled in
x86/ALL for compile-testing.

(Hi gson! Finally found a round tuit in my pocket, next to a certain
rectangular one.)

Add new documentation locking(9)

It's a document from June 2015.

DESCRIPTION
The NetBSD kernel provides several synchronization and interrupt control
primitives. This manpage aims at giving an overview of these interfaces
and their proper application. This document includes also basic kernel
thread control primitives and rough overview of the NetBSD kernel design.

Part of interfaces are missing, like new mechanisms for networking SMP,
as this documentation page predates them.

Initial review back in 2015 by Thomas Klausner <wiz>

Add new documentation for klua_mod_register(9) and klua_lock(9)

Lua kernel bindings.

cvslatest is unconditional, not conditional on cvs.

Rumpify netipsec

Note that we should modularize netipsec and reduce reverse symbol references
(referencing symbols of netipsec from net, netinet and netinet6) though,
the task needs lots of code changes. Prior to doing so, rumpifying it and
having ATF tests should be useful.

Add MLINKS for extent_alloc1(9) and extent_alloc_subregion1(9).

Sort (NFC)

Fix typo: s/ubc_range/ubc_zerorange/

Add entries for ubc_purge(9) and ubc_zerorange(9)

Add man page links for:
EV_SET to kqueue(2)
getmntoptstr, getmntoptnum, freemntopts to getmntopts(3)

Reviewed by wiz@

new sqlite man pages

PR misc/52058: proc_trampoline became lwp_trampoline.
Sort.

add accept4

Add links for kmem_intr_alloc.9, kmem_intr_free.9 and kmem_intr_zalloc.9.

l2tp(4) support rump.

add l2tp(4) L2TPv3 interface.

originally implemented by IIJ SEIL team.

libpthread_dbg(3) deletion from the base distribution

libpthread_dbg(3) is a remnant library from the M:N thread model
(pre-NetBSD-5.0) API to introspect threads within a process and for use
of debuggers.

Currently in the 1:1 model it's not used in GDB neither in LLDB and it's
not either planned to be used. It's current function to read pthread_t
structures is realizable within a regular debugger capable to
instrospect objects within a tracee (GDB, LLDB...).

Remaining users of this API can still use this library from
pkgsrc/devel/libpthread_dbg.

Sponsored by <The NetBSD Foundation>

Add evbuffer.h.3

one more include file

add more man pages

Add another pcap header.

Implement POSIX Curses Soft Label Key functions.

branches: 1.2102.2;
Update LLVM build glue for pre-4.0.0 r291444.

Implement POSIX curses function ripoffline(3).

Add entries of pmap(9) functions

Fix MKCATPAGES=yes build - fix typo in cat3/krb5_checksum_is_keyed.0

Implement ncurses is_pad(3).
Correct documentation about is_keypad(3).

Implement is_term_resized and resize_term(3) ncurses extensions.
resizeterm(3) is now a wrapper for resize_term(3).

Add the set_escdelay(3) and set_tabsize(3) ncurses extensions.

Tag cleanup: if the last column contains 'obsolete', the one before should too.

Add more curses functions (Hi Roy!)

Fix typo in distribution synckok.0 -> syncok.0

Fix tag.

We don't need sys/uvm/uvm_physseg.h installed, since userland has no
use for it.

Obsolete it in the set list.

Rename vget() to vcache_vget() and vcache_tryvget() respectively and
move the definitions to sys/vnode_impl.h.

No functional change intended.

Welcome to 7.99.54

Implement POSIX Curses functions immedok(3) and syncok(3).

Implement ncurses extension has_key.

Implement POSIX Curses typeahead function.

Implement POSIX curses use_env function.

Implement ncurses extensions is_leaveok and is_keypad.

The former allows the ncurses (and pdcurses) macros getsyx and setsyx
to be implemented, which is needed by a surprising number of applications.

The latter is needed for Python curses support so it doesn't have to dive
into ncurses window structure.

Add the POSIX filter() function to libcurses.

add new header (uvm_physseg.h) to set list.

fix release build after the addition of uvm_hotplug man9 page
by adding it to the set lists.

add sys/psref.h

Sort the unsorted sets lists (they should all be correctly sorted now.)

put back the isa/spkrio.h for compat

spkrio.h is not isa only anymore.

cvslatest(1) is unconditional, doesn't use cvs(1).