merge DB 1.85 changes

add unintrusive Ids

branches: 1.3.2;
clean up import

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

branches: 1.8.6;
Convert db from UCB types to POSIX types. Prefer uint8_t for u_char as
it is mostly about the wire format.

Patched libc.so is bit-identical.

OK matt@

branches: 1.7.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

merge DB 1.85 changes

add unintrusive Ids

branches: 1.3.2;
clean up import

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

branches: 1.15.6;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

branches: 1.13.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

Fix signed/unsigned comparison warnings.

branches: 1.10.12;
Add some braces to make egcs happy.

If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.7.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.5.2; 1.5.4;
clean up import

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

branches: 1.17.6;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

Convert db from UCB types to POSIX types. Prefer uint8_t for u_char as
it is mostly about the wire format.

Patched libc.so is bit-identical.

OK matt@

branches: 1.14.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

fix WARNS=2 (-Wshadow) warnings

branches: 1.11.12;
delint

If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.8.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.6.2;
clean up import

Remove potential spoilsport.

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

fix bug in previous change (sz should be the size of the newly allocated
buffer).

It's been many years since realloc(NULL, size) == malloc(size). Also don't
destroy pointers on allocation errors so someone can free them later.

branches: 1.16.2; 1.16.6; 1.16.26;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

Convert db from UCB types to POSIX types. Prefer uint8_t for u_char as
it is mostly about the wire format.

Patched libc.so is bit-identical.

OK matt@

branches: 1.13.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

indx_t can be a 16 bit type, and is thus not suited to hold a difference
between two pointers in the general case. Replace it by ptrdiff_t.

-> recno databases can now handle records of more than 64KB
-> nvi can now handle files with lines bigger than 64KB

Problem and fix suggested by FreeBSD PR#9350

branches: 1.10.12; 1.10.14;
If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.8.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.6.2;
clean up import

repeat after me: realloc, THEN assign pointer...

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

remove mpool_getf

Merge the recursive tree traversal changes from the mit kerberos tree. This
Also make the tracefile customizable. Unfortunately we can't merge any of
the hash changes because they have a different on-disk format. That does not
matter really because we've fixed most of the problems...

branches: 1.20.8;
- centralize opening of regular and temp files to avoid code duplication
- don't cast malloc
- use malloc sizeof(*var) instead of sizeof(type)

branches: 1.19.2; 1.19.8;
put back some compat code for systems that don't have O_CLOEXEC.

use O_CLOEXEC

branches: 1.17.6;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

branches: 1.15.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Ensure dbp is initialized to NULL before trying to use it in an error codepath.
Detected with gcc -Wuninitialized.
(The bug was introduced in rev 1.13. Hi Mycroft! :)

branches: 1.13.2;
hash already uses FD_CLOEXEC -- pay attention to the return value and make it
a hard failure.

Also make btree and recno uses FD_CLOEXEC.

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

Change the file mode argument to dbopen() and the db backends from int to
mode_t.

Fill in missing (default) mmap(2) flags.

If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.7.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.5.2; 1.5.4;
clean up import

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

It's been many years since realloc(NULL, size) == malloc(size). Also don't
destroy pointers on allocation errors so someone can free them later.

- centralize opening of regular and temp files to avoid code duplication
- don't cast malloc
- use malloc sizeof(*var) instead of sizeof(type)

branches: 1.19.2; 1.19.8;
- Fix bug copying only 1 byte instead of the whole page number. Broke nvi
joining lines that needed R_BIGDATA.
- Fix from FreeBSD for nrec IAFTER.
XXX: Should be pulled up to 5.x

various build fixes for gcc 4.5. from chuq. XXX i'm not sure all of
these work properly wtf pointer aliasing, but there are no casts at
least...

the lib/libpuffs/puffs_priv.h is definately a real bug fix.

from chuq.

branches: 1.17.6; 1.17.20;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

Convert db from UCB types to POSIX types. Prefer uint8_t for u_char as
it is mostly about the wire format.

Patched libc.so is bit-identical.

OK matt@

branches: 1.14.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

Fix signed/unsigned comparison warnings.

branches: 1.11.12;
delint

If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.8.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.6.2;
clean up import

DTRT when recno db's are extended beyond current end of db

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

remove mpool_getf

Merge the recursive tree traversal changes from the mit kerberos tree. This
Also make the tracefile customizable. Unfortunately we can't merge any of
the hash changes because they have a different on-disk format. That does not
matter really because we've fixed most of the problems...

branches: 1.14.6; 1.14.44;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

branches: 1.12.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

Fix -Wshadow warnings (gcc 3.1).

branches: 1.9.14;
If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.7.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.5.2;
clean up import

version 1.71 of new db code

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

branches: 1.14.6;
Consistently include "nbtool_config.h" when cross-compiling.

In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

branches: 1.12.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

check LIBC_SCCS

If port provides __weak_alias(), provide an Standard C and POSIX pure
identifier namespace by renaming non standard functions and variables
such that they have a leading underscore. The library will use those
names internally. Weak aliases are used to provide the original names
to the API.

This is only the first part of this change. It is most of the functions
which are implemented in C for all NetBSD ports. Subsequent changes are
to add the same support to the remaining C files, to assembly files, and
to the automagically generated assembly source used for system calls.
When all of the above is done, ports with weak alias support should add
a definition for __weak_alias to <sys/cdefs.h>.

Fix RCSID's
Fix gcc warnings.

branches: 1.7.2;
merge DB 1.85 changes

add unintrusive Ids

branches: 1.5.2;
clean up import

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

fix recently committed typos by msaitoh in few more places, as well as few more.
mainly s/contigous/contiguous/ and s/miliseconds/milliseconds/ in comments.

It's been many years since realloc(NULL, size) == malloc(size). Also don't
destroy pointers on allocation errors so someone can free them later.

- centralize opening of regular and temp files to avoid code duplication
- don't cast malloc
- use malloc sizeof(*var) instead of sizeof(type)

branches: 1.12.2; 1.12.6; 1.12.26;
In preparation for providing a db fallback in libnbcompat, remove
sccsid and conditionals around __RCSID. lint understands __RCSID enough
to ignore it, undefining LIBC_SCCS is superseded by MKSTRIPIDENT.
No functional changes.

branches: 1.11.12;
cleanup:
- remove __P
- remove unneeded casts
- add _DIAGASSERT
- add more diagnostics for integer overflow
- fix size_t/int confusion
- make debugging and statistics code compile

Completely rework how tools/compat is done. Purge all uses/references to
_NETBSD_SOURCE as this makes cross building from older/newer versions of
NetBSD harder, not easier (and also makes the resulting tools 'different')

Wrap all required code with the inclusion of nbtool_config.h, attempt to
only use POSIX code in all places (or when reasonable test w. configure and
provide definitions: ala u_int, etc).

Reviewed by lukem. Tested on FreeBSD 4.9, Redhat Linux ES3, NetBSD 1.6.2 x86
NetBSD current (x86 and amd64) and Solaris 9.

Fixes PR's: PR#17762 PR#25944

branches: 1.9.2;
Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

Fix RCSID's
Fix gcc warnings.

merge DB 1.85 changes

add unintrusive Ids

branches: 1.5.2;
clean up import

upgrade new DB code to version 1.7

Declare rcsid strings so they are stored in text segment.

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22280, verified by myself.

merge DB 1.85 changes

add unintrusive Ids

branches: 1.3.2;
clean up import

Add RCS identifiers.

branches: 1.1.1;
update db code to v1.6 from vangogh, and put it in "db" rather than "DB"