UPDATING revision 1.291
1$NetBSD: UPDATING,v 1.291 2018/02/13 04:36:00 mrg Exp $ 2 3This file (UPDATING) is intended to be a brief reference to recent 4changes that might cause problems in the build process, and a guide for 5what to do if something doesn't work. 6 7For a more detailed description of the recommended way to build NetBSD 8using build.sh, see the BUILDING file. 9 10Note that much of the advice in this UPDATING file was written before 11build.sh existed. Nevertheless, the advice here may be useful for 12working around specific problems with build.sh. 13 14Sections are marked with "^^^^^". After the section on "Recent changes" 15are several sections containing more general information. 16 17See also: BUILDING, build.sh, Makefile. 18 19Recent changes: 20^^^^^^^^^^^^^^^ 21 2220180212: 23 between OpenSSL and GCC updates, many things may fail to build. 24 any failure that looks like GCC or openssl is best handled by 25 a clean destdir and objdir. Full cleandir and destdir deletion 26 is recommended if build failures occur. 27 2820171225: 29 removal of the vadvise syscall requires manual removal of all 30 associated files from the libc build object directory (including 31 the .depend files) - a command like: 32 cd $OBJ && find . -type d -name libc | xargs rm -rf 33 For architectures that support multiple "compat" binary targets, 34 you'll need to cleanup both the regular libc directory and the 35 compat ones (the above command will do that). 36 3720171010: 38 a change to the build structure of external/bsd/acpica/bin/iasl 39 means that its objdir (or *.d and .depend at least) might need 40 to be manually removed - or a build done once without -u. 41 4220170822: 43 a new version of GMP has been imported and probably 44 will break parts of builds related to themselves or GCC, both 45 in the tools and the native section. Remove all GCC, GMP, MPFR 46 and MPC objdirs or build once without -u. 47 4820170816: 49 a new version of MPFR and MPC have been imported and probably 50 will break parts of builds related to themselves or GCC, both 51 in the tools and the native section. Remove all GCC, GMP, MPFR 52 and MPC objdirs or build once without -u. 53 5420170402: 55 a new version of dhcpcd has been imported, which does not support 56 update builds from the previous version. Remove your 57 external/bsd/dhcpcd object dir or build once without -u. 58 5920170211: 60 a new terminfo database has been imported. 61 The structure of it has changed slightly from prior versions and 62 an updated tic tool is required. 63 If you build.sh, don't use -u 64 6520170207: 66 various arch dependent libc/exect.S files were removed 67 Either remove the obj directories (lib/libc and compat/amd64/i386/lib 68 if it exists) or do a clean build. 69 (This is a bug in the make system, it should be corrected without 70 human intervention, but isn't.) 71 7220170104: 73 xinput build options have changed. 74 Remove the obj directory (external/mit/xorg/bin/xinput) 75 if you build.sh -u 76 7720170103: 78 a new version of flex has been imported. 79 Remove the file from obj (external/bsd/flex) 80 if you build.sh -u 81 8220161014: 83 a new version of OpenSSL has been imported. 84 Remove the files from obj (crypto/external/bsd/openssl) 85 if you build.sh -u 86 8720161009: 88 a new version of dhcpcd has been imported with slightly changed 89 build infrastructure. When doing a build.sh -u this requires 90 pruning the external/bsd/dhcpcd objdir. 91 9220160914: 93 i386, amd64, shark, ofppc and macppc have joined shark and x68k 94 ports in using xorg-server 1.18. This requires a clean destdir 95 and a clean objdir. 96 9720160527: 98 i386 needs a full cleandir or objdir deletion because PIE has 99 been enabled. (see the amd64 entry two down for further info) 100 10120160418: 102 libedit needs manual removal of all autogenerated files since 103 some of them are not autogenerated anymore. Remember that there 104 might be two copies of libedit if your platform builds "compat". 105 10620160410: 107 amd64 needs full "make cleandir" or deletion of objdir now that 108 PIE has been enabled for amd64. PIE, or position-independent 109 executables, means all code, including executables and not just 110 shared libraries, is position-independent and hence able to be 111 relocated by ASLR, address space layout randomization. 112 113 The change was made in Makefile variables for compiler and 114 linker flags, for which make(1) does not record dependencies, 115 hence it is unable to detect that all .o files need rebuilding. 116 117 Partial rebuilds with some modified source files will likely 118 fail when linking executables, since the linker refuses to mix 119 position-independent code with position-dependent code in 120 position-independent executables: 121 122 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC 123 12420160401: 125 Ports switching to GCC 5.3 will need a full "make cleandir". 126 Some people have found that cleandir is not sufficient, so if 127 in doubt delete the entire object directory tree for gcc. 128 12920160306: 130 NetBSD's regexp implementation is now part of libnbcompat. 131 Nblex, nbm4, nbpax, nbsed use it and they may crash on 132 non-NetBSD hosts if linked with stale object files produced 133 while they included a non-NetBSD regex.h. 134 In any case, you should "make cleandir" at least these tools 135 before updating your toolchain. 136 13720160125: 138 Dtrace has been enabled by default on some architectures. 139 When doing an update build, make sure to clean the etc/mtree 140 object directory before starting the build - otherwise the 141 needed directories in destdir will not be created. 142 An easy way to do this is: 143 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir 144 14520150818: 146 New acpica requires "make cleandir" in src/external/bsd/acpica 147 again. 148 14920150413: 150 New acpica requires "make cleandir" and reinstalling yacc 151 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and 152 also "make cleandir" in /usr/src/external/bsd/acpica. 153 15420150404: 155 Lint changes require a full rebuild of the tool, so make 156 sure to build without -u option to build.sh, or manually 157 do a make cleandir in src/tools/lint1 and 158 src/usr.bin/xlint. 159 16020150310: 161 Improvements to openssl for arm mean that update builds of 162 the openssl libraries will fail. A make cleandir in 163 external/bsd/openssl/lib is needed 164 16520141026: 166 A mishap during the import of pppd may cause your corruption 167 in your cvs directory if you happened to do a cvs update 168 during a short period of time. To fix, just remove the 169 directory src/external/bsd/ppp/dist/pppd completely 170 and let cvs restore it on next update. 171 17220140721: 173 The src/external/mit/lua/src directory was accidentally created 174 and then deleted in the CVS repository. If you get errors like 175 176 cvs [update aborted]: cannot open directory 177 /cvsroot/src/external/mit/lua/src: No such file or directory 178 179 then delete your local copy of that directory tree and try again. 180 18120140530: 182 ARM eABI switched to DWARF based exception handling. This requires 183 rebuilding all C++ code. It is strongly advised to do a clean build. 184 18520140131: 186 The new compiler_rt/libc integration moved a few things. It is strongly 187 advised to do a clean build. At least lib/libc, the compat version(s) 188 of libc, libkern, rump and the kernels need to be cleaned. 189 19020131227: 191 1. The new ntpd runs in a restricted mode to prevent amplification 192 attacks. If you need ntpdc to work you need to explicitly enable 193 mode7 in your config file. Make sure you put the necessary restrict 194 statements to avoid being exposed. 195 2. strncat has moved from lib/libc to common/lib/libc; you might need 196 to make clean in libc 197 19820131129: 199 The GMP sources were updated, and builds will likely fail without 200 cleaning their build trees for both tools and in-tree, like below. 201 20220131128: 203 The MPC and MPFR sources were updated, and builds may require their 204 tools and in-tree directories cleaned for successful updates. 205 20620130605: 207 The kernel option FAST_IPSEC no longer exists, it's been renamed 208 to IPSEC (and the older IPSEC version removed). 209 21020130605: 211 Previous freetype installations eroneously installed private 212 header files. If you are building against a non-empty $DESTDIR, 213 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/. 214 21520130531: 216 The xdm update may cause build failure due to xdm.man being 217 in the obj tree. Make sure to ensure any like this: 218 nbmake: nbmake: don't know how to make xdm.man. Stop 219 is fixed by deleting the xdm.man in the obj tree. 220 22120130530: 222 Updates of many xsrc packages will leave old .pc files around. 223 Best to clean out the xsrc objdir entirely before rebuilds. 224 22520130301: 226 The removal of netiso requires manual removal of /usr/include/netiso 227 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump} 228 22920120726: 230 The update of OpenSSL requires cleaning both the OpenSSL build 231 directory and DESTDIR. *Even non-update builds require cleaning 232 DESTDIR.* Builds done without taking these steps may fail, or in 233 some cases may succeed and install broken OpenSSL libraries that 234 cause third-party software to link incorrectly and/or crash. 235 23620120507: 237 The database schema for makemandb was changed. You will 238 need to update the database using 'makemandb -f' or wait 239 for the next weekly run to fix it. 240 24120120319: 242 sys/conf/Makefile.kern.inc has been modified to adjust the 243 size of db_symtab automatically. You need to update dbsym in 244 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If 245 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your 246 mk.conf. 247 24820120216: 249 Default for MKCATPAGES changed to NO. Update builds will fail 250 unless DESTDIR is cleaned manually. If you built between 20120207 251 and 20120216, daily and weekly could have created an unreadable 252 /var/db/man.db index for apropos. Running makemandb -f or 253 the next run of weekly will fix it. 254 25520111227: 256 If you built between 20111225 and 20111227 you need to remove 257 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the 258 bump has been reverted. 259 26020111125: 261 The "rnd" pseudodevice has been added to sys/conf/std, which 262 means it should no longer be explicitly listed in kernel 263 configuration files. The line "pseudo-device rnd" should be 264 removed from any custom kernel config files users may have. 265 26620111119: 267 A problem with the datastructures used by the rndctl(8) 268 utility (pointers in datastructures in an array, making 32->64 269 bit compatibility very painful) has been fixed in a 270 non-backwards-compatible way. If you replace your kernel, 271 replace your rndctl executable too. 272 27320111001: 274 the prop_*_send_syscall() functions from proplib(3) have been 275 changed and their new version is not backward compatible with the old 276 one. So ensure that all consumers of these functions (currently: 277 quota2 code and its tests) are updated together with the new lib. 278 27920110817: 280 sparc has been changed to use GCC 4.5.3, so any objdir or 281 DESTDIR for them should be deleted before updating. 282 28320110806: 284 i386 and amd64 have been changed to use GCC 4.5.3, so any 285 objdir or DESTDIR for them should be deleted before updating. 286 28720110805: 288 The update to GCC 4.5.3 requires a non-trivial portion of 289 the tree to be cleaned. Best to delete both objdir and 290 DESTDIR before running this update. So far, only the 291 sparc64, mips and powerpc platforms have changed. 292 29320110803: 294 The layout of external/public-domain/xz has changed. To do an 295 update build you will have to remove the contents of the OBJDIR 296 for external/public-domain/xz/bin by hand as the xz entry there 297 is now a directory. 298 29920110410: 300 The configuration of src/tools/gcc has changed. To do an 301 update build you have to clean both tools/binutils and 302 tools/gcc by hand. 303 30420110328: 305 Building the Xorg binary was moved into a subdirectory to fix 306 ordering issues with "make all". It may be necessary to remove 307 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86 308 if your update build fails, as the "Xorg" entry there is now a 309 directory. 310 31120110121: 312 Assembler files no longer use -traditional-cpp. This can break 313 the build of individual parts of the tree. This is handled 314 correctly by build.sh. Manual builds have to update /usr/share/mk 315 and re-run config(1) for any kernel configurations as needed. 316 31720101217: 318 The tcpdump(8) program was changed to drop privileges and chroot(2) 319 by default. It may be necessary to manually update passwd(5) and 320 group(5) in order to make the program work with existing setups. 321 32220101125: 323 The latest changes to setenv(3) dissallow setting environment 324 variables with names that contain '='. Revision 1.18 of env.c 325 assumed that this was allowed. Installing a new libc with an 326 old copy of /usr/bin/env causes env x=1 printenv | grep x= to 327 break which affects the autoconf tests for dependency finding, 328 so building gcc will end up printing: 329 checking dependency style of gcc... none 330 configure: error: no usable dependency style found 331 Fix it by rebuilding and re-installing env. 332 33320101119: 334 Recent Xorg updates in xsrc/external/mit/ may cause various build 335 or run-time problems. Delete your entire DESTDIR and OBJDIR if you 336 have any build problems with xsrc, or problems with mismatched 337 versions between xorg-server and drivers. 338 33920100604: 340 The update of ATF to 0.9 causes old tests written in shell to fail 341 unless they are rebuilt. If you are building with MKUPDATE=yes, 342 you need to clean the src/external/bsd/atf/tests/ and the src/tests/ 343 trees by hand. 344 34520100522: 346 Recent Xorg updates in xsrc/external/mit/ will cause various build 347 problems. Delete your entire DESTDIR and OBJDIR if you have any 348 build problems with xsrc. 349 35020100522: 351 private section of <ctype.h> was splitted, and now mklocale(1) 352 include ctype_local.h, so you have to make cleandir in tools/mklocale. 353 35420100520: 355 The location of the xkb compiled descriptions has changed. Please 356 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR. 357 35820100222: 359 The shared objects file extension has been changed from .so to 360 .pico, in order to avoid conflicts with shared libraries names 361 libXX.so. All now stale regular .so files can be removed from 362 your object directories. 363 36420100204: 365 The termcap database has been removed from the sources, 366 but has not been marked obsolete so it is not removed 367 from the system when upgrading. 368 As such, you will need to remove them from your object 369 and destination directories. 370 37120091101: 372 After updating, it may be necessary to make the 'cleandir' 373 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a 374 'build.sh -u tools' or 'build.sh -u distribution'. Ditto 375 src/tools/lex/ and src/usr.bin/lex/. 376 37720091001: 378 On amd64 you must rebuild tools (to get the new binutils) 379 before building a kernel, or the build fails on cpufunc.S. 380 38120091001: 382 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb 383 symlink, failing the build. Delete the link, and the subdir 384 it is in, and retry your build. 385 38620090718: 387 libc build changed so that strchr() provides the extra entry 388 point for index(). Update build of libc.a (and libc_pic.a) 389 may fail because the archive contains the unwanted index.o. 390 (Similarly for strrchr() and rindex().) 391 39220090709: 393 Native Xorg was upgraded again. Builds will probably fail again 394 without a clean objdir, at least for src/external/mit/xorg. 395 39620090616: 397 Native Xorg was upgraded. Builds will need a clean objdir for 398 src/external/mit/xorg. Upgrading a system from sets will not 399 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc 400 subdirectory has been changed into a file, and this needs to 401 be manually "rm -r"'ed before installing xbase.tgz. 402 40320090501: 404 Several new functions were added to string.h/libc, and this 405 can cause autoconf problems during the tool build for people 406 who fail to clean out their tools objects properly. If you 407 note messages about stpcpy, stpncpy or strnlen accompanying a 408 failure during the tool build, clean out all your tools 409 objects and start again. 410 41120090325: 412 The i386 port was switched to i486 default toolchain. This requires 413 cleaning your src/tools directory and $TOOLDIR and rebuilding them. 414 41520090126: 416 The __posix_fadvise50 system call changed assembly stub type. You 417 need to 'rm -f __posix_fadvise50.*' in the libc build directory 418 to avoid using the old assembly stub. 419 42020090202: 421 pkg_install now depends on the pkgdb cache for automatic conflict 422 detection. It is recommented to rebuild the cache with 423 ``pkg_admin rebuild''. 424 42520090110: 426 time_t and dev_t have been bumped to 64 bit quantities. To upgrade: 427 1. Make sure your kernel has COMPAT_50 in it. Build and install. 428 This is needed even in the MODULAR kernel because there is 429 conditionally compiled code in rtsock.c. 430 2. make sure build.sh completes and the binaries in a chroot work 431 before installing. 432 3. If you don't use build.sh and you build directly to root, and 433 your build breaks in the middle, don't despair. Make sure headers 434 are installed properly, and start building libraries first libc 435 and libutil, install them and then continue building all the 436 libraries in src/lib and src/gnu/lib and install them. Once 437 the new libraries are installed, you can restart the build. 438 4. If you compile packages and you notice link time warnings, 439 rebuild the required packages to update their shared libraries. 440 Any package you rebuild will require rebuilding all the packages 441 that depend on it. 442 5. Next time you run pwd_mkdb with the new binary, the file 443 will be upgraded and it will not be backwards compatible. 444 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see 445 lastlogx(5)) have been versioned, and there is a heuristic 446 for utmp. You are better off removing the old files after 447 upgrading. The automated clearing of /var/run during 448 boot, and the automated rotating of files in /var/log by 449 newsyslog(8), may mean that you do not have to remove the 450 files manually. 451 7. The optional accounting file (/var/account/acct, see 452 accton(8)) has not been versioned, and will need to be 453 removed. The automatic rotation of the accounting file by 454 /etc/daily limits the bad consequences of failure to remove 455 the file. 456 8. Application software that writes time_t to binary files on 457 disk will break or need attention. Most notably: if you are 458 using PostgreSQL < 8.4, you need to dump your databases, 459 rebuild PostgreSQL with the new time_t, then restore. 460 46120081219: 462 config(1) has been updated, and one of the files it creates - 463 swapnetbsd.o - has changed format. You need to rebuild config 464 (done automatically by build.sh) and then you need to rerun 465 config on all kernel configuration files before rebuilding those 466 kernels. 467 46820081205: 469 If you build with MKX11=no, you should remove /etc/rc.d/xdm and 470 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc 471 set and will appear as extra files for MKX11=no update builds. 472 47320081122: 474 On i386, various kernel options(4) in GENERIC including 475 file systems have been disabled and moved into kernel modules. 476 Before trying a new GENERIC kernel, you have to prepare the 477 following files as well as a new GENERIC kernel: 478 479 - build and install kernel modules from src/sys/modules 480 481 - install the latest bootloader, which will load a module 482 for the file system from which the kernel is loaded automatically 483 484 If you have to load your kernel from a file system which is not of 485 the same type as the root file system, you have to load the necessary 486 file system module manually on the boot prompt or in the boot.cfg file. 487 48820080827: 489 If you built and installed a libc from sources between 490 2008/08/20 and 2008/08/26 you got a broken strtouq(3) 491 which results in false errors reported by lint(1). 492 Since this breaks the libc build itself, manual help is 493 needed -- lint must be disabled temporarily, e.g.: 494 $ (cd lib/libc && make MKLINT=no dependall install) 495 49620080813: 497 MKDEBUG build was broken because the .depend files did not know 498 about .go files. You need to remove all .depend files and rebuild. 499 50020080802: 501 A regression in binary compatibility for pthread_mutex_t has 502 been fixed. Unfortunately, the price is breaking compatibility 503 for -current. 504 505 Threaded programs (using libpthread) and C++ programs (using 506 libstdc++) compiled after 20070907 and before 20080802 need to 507 be recompiled. 508 509 One way to find affected pkgsrc packages: 510 511 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO 512 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO 513 51420080731: 515 WAPBL (metadata journaling support) has been added, but at this 516 time isn't backwards compatible with pre-WAPBL aware kernels 517 and userland (fsck_ffs in particular). Please make sure you 518 don't use a journaled filesystem with an older kernel/userland, 519 especially an uncleanly mounted journaled filesystem. WAPBL 520 also requires the super block to be in the UFS2 format. You 521 can use fsck_ffs -c 4 to update the superblock format. 522 52320080721: 524 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR 525 isn't defined. 526 52720080531: 528 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 529 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8) 530 utility needs to be rebuilt and reinstalled as older binaries 531 won't work correctly. The following sequence of commands: 532 533 $ (cd sys/sys/ && nbmake-$arch includes) 534 $ (cd sbin/drvctl/ && nbmake-$arch clean) 535 $ (cd sbin/drvctl/ && nbmake-$arch all) 536 537 leaves new drvctl utility in sbin/drvctl build directory. 538 53920080503: 540 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE. 541 54220080521: 543 For a while, unprivileged UPDATE builds would fail to 544 succeed at the checkflist stage, complaining that 545 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this 546 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9. 547 If you already hit this problem, update the .mk file, 548 remove ${DESTDIR}/stand/<arch>, and re-run the build. 549 55020080303: 551 Linker warnings are now fatal if $WARNS>0. 552 55320080126: 554 The posix_fadvise system call has been changed from an assembly 555 stub, to a c file that calls an assembly stub. You need to 556 'rm -f posix_fadvise.* .depend' in the libc build directory to 557 avoid using the old assembly stub. 558 55920071209: 560 The acpiec(4) driver has been split into two attachments. If you 561 get ACPI errors before the attachment, please update your kernel 562 configuration file appropriately or see GENERIC for more details. 563 56420071115: 565 The it(4) driver has been renamed to itesio(4) and the old port 566 argument specified in the kernel configuration file is not valid 567 anymore. The itesio(4) driver now uses the Super I/O address port 568 rather than the EC address port. Please update your kernel 569 configuration file appropriately or see GENERIC for more details. 570 57120071028: 572 The pccons(4) driver has been removed from the NetBSD/shark port. 573 You need to update any custom kernel configuration file you have 574 to remove any references to pccons (which includes removing the 575 now useless XSERVER option) and replace them with the correct 576 entries for the wscons driver. See the GENERIC configuration file 577 for more details. 578 57920070913: 580 A latent bug in dhclient/dhcpd that caused it to be unable to 581 enumerate interfaces was fixed. The bug began to cause 582 problems after 20070911 when the kernel's SIOCGIFCONF 583 implementation was repaired. From 20070529 to 20070911 racoon 584 could not enumerate interfaces. (These are noted because 585 normal kernel/userspace version matching hygiene is not 586 sufficient to avoid this problem.) Ensure that both kernel 587 and userland are from after 20070913. 588 58920070703: 590 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It 591 calls the target-specific strip program, and the logic to pass 592 down STRIP from make has been removed. This requires a 593 re-installation of tools. 594 59520070422: 596 The way OS emulations lookup filenames inside the emulation root 597 has been changed. Rather than modify the pathname (and copy back 598 to userspace) namei() and lookup() directly check the emulation 599 root. One side effect is that absolute symlinks inside the emulated 600 root file system will be relative to that file system - unless they 601 start /../ this is useful when the emulated root is a real install 602 that has such links. 603 This might affect symlinks that have been added to reference outside 604 the emulated root. 605 60620070412: 607 The pckbc driver on sgimips IP32 has been removed. Use macekbc 608 instead. See the GENERIC32_IP3x kernel configuration for an 609 example. 610 61120070319: 612 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so 613 on many platforms due to incorrect flags settings. If you 614 updated and built after about 20070315, do "nbmake-$arch 615 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a 616 rebuild of object files that might have been built 617 incorrectly, and ensure that you have at least 618 src/lib/libc/Makefile 1.130. 619 62020070210: 621 src/sys/sys/{sa.h,savar.h} were removed. 622 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \ 623 | xargs egrep -l '/sa.h|/savar.h' | xargs rm 624 will allow dependencies on those files to get get rebuilt 625 62620070209: 627 The threading model was changed when the newlock2 branch 628 was merged to NetBSD-current. If you boot with a new 629 kernel (version 4.99.10), then you also need a new pthread 630 library (/usr/lib/libpthread.so.0.7). If you boot with 631 an old kernel, then you need the old pthread library 632 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and 633 the pthread library in sync, old threaded applications should 634 continue to work with an old or new kernel. Note that named(8) 635 is the only threaded application in the base system. 636 63720061214: 638 Following the move of string_to_flags() and flags_to_string() 639 from the bin/ls/ sources to libutil, users doing UPDATE builds 640 will need to do a "make cleandir" in 641 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/, 642 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/, 643 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well 644 as the installation images in distrib/ 645 in order to excise stale references to the old stat_flags.h header 646 file in the ls sources -- stat_flags.h has been removed. 647 64820061108: 649 The configure script used in the src/tools/gcc compiler has been 650 changed to indicate that our libc has ssp support built-in and 651 does not depend on -lssp and -lssp-nonshared. You'll need to 652 make clean in src/tools/gcc first to rebuild the compiler. 653 65420061009: 655 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer 656 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead. 657 65820060814: 659 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been 660 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC 661 kernel configuration for an example. X servers from the last 662 few years should cope. 663 66420060703: 665 MPACPI is no more. We always configure PCI interrupts using ACPI 666 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed 667 to ACPI_SCANPCI. Thanks to work from fvdl. 668 66920060627: 670 socket(2) has changed, and its system call has been versioned. 671 For userlands with the old version of socket(2), make sure that 672 your kernel has 'options COMPAT_30' set, or else 'bad system call' 673 errors will result. 674 675Hints for a more successful build: 676^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 677 Use build.sh, but do not use its "expert mode": 678 This will automatically build the tools in the 679 correct order, and it will keep the tools and the 680 new build products from interfering with the running 681 system. This will allow you to ignore most of the 682 other advice in this file. 683 Build a new kernel first: 684 This makes sure that any new system calls or features 685 expected by the new userland will be present. This 686 helps to avoid critical errors when upgrading. 687 Use object directories: 688 This helps to keep stale object 689 files from polluting the build if a Makefile "forgets" 690 about one. It also makes it easier to clean up after 691 a build. It's also necessary if you want to use the 692 same source tree for multiple machines. 693 To use object directories with build.sh: 694 a) invoke build.sh with the "-M" or "-O" options. 695 To use object directories without using build.sh: 696 a) cd /usr/src ; make cleandir 697 b) Add "OBJMACHINE=yes" to /etc/mk.conf 698 c) Add "MKOBJDIRS=yes" to /etc/mk.conf 699 d) cd /usr/src ; make build 700 Note that running "make obj" in a directory will create 701 in obj.$MACHINE directory. 702 Build to a DESTDIR: 703 This helps to keep old installed files (especially libraries) 704 from interfering with the new build. 705 To build to a DESTDIR with build.sh, use the "-D" option. 706 To build to a DESTDIR without using build.sh, set the DESTDIR 707 environment variable before running make build. It should be 708 set to the pathname of an initially empty directory. 709 Problems: if you do not use build.sh, you might need to 710 update critical utilities without using DESTDIR since 711 nothing is executed from what is installed in DESTDIR. 712 (See critical utils, below.) 713 Build often: 714 This keeps critical utilities current enough to not choke 715 on any other part of the source tree that depends on up to 716 date functionality. If you use build.sh, you should not have 717 this problem. 718 719What to do if things don't work: 720^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 721When things don't work there are usually a few things that commonly 722should be done. 723 1) make includes 724 This should be done automatically by make build. 725 2) cd share/mk && make install 726 Again, automatically done by make build. 727 728Failsafe rebuild of a small part of the tree: 729^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 730To make sure you rebuild something correctly you want to do 731something like the following: 732 1) Make sure the includes and .mk files are up to date. 733 2) Make sure any program used to build the particular 734 utility is up to date. (yacc, lex, etc...) 735 3) cd ...path/to/util... 736 make cleandir 737 rm ...all obj directories... 738 make cleandir # yes, again 739 make obj 740 make depend && make 741 742Failsafe rebuild of the entire tree: 743^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 744If you really want to make sure the source tree is clean and 745ready for a build try the following. Note that sourcing /etc/mk.conf 746(a make(1) Makefile) in this manner is not right, and will not work 747for anyone who uses any make(1) features in /etc/mk.conf. 748 749---cut here--- 750#!/bin/sh 751. /etc/mk.conf 752 753if [ -z $NETBSDSRCDIR ] ; then 754 NETBSDSRCDIR=/usr/src 755fi 756if [ \! -d $NETBSDSRCDIR ] ; then 757 echo Unable to find sources 758 exit 1 759fi 760find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 761 762if [ -z $BSDOBJDIR ] ; then 763 BSDOBJDIR=/usr/obj 764fi 765if [ -d $BSDOBJDIR ] ; then 766 rm -rf $BSDOBJDIR 767fi 768 769cd $NETBSDSRCDIR && make cleandir 770 771---cut here--- 772 773Critical utilities: 774^^^^^^^^^^^^^^^^^^^ 775 usr.bin/compile_et 776 usr.bin/make 777 usr.bin/yacc 778 usr.bin/lex 779 usr.bin/xlint 780 usr.bin/config 781 782Other problems and possible solutions: 783^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 784Symptom:Complaints involving a Makefile. 785Fix: Rebuild usr.bin/make: 786 cd usr.bin/make && make && make install 787 Or, a failsafe method if that doesn't work: 788 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 789 790Fix: Make sure .mk files are up to date. 791 cd share/mk && make install 792 793Symptom:Kernel `config' fails to configure any kernel, including GENERIC. 794Fix: Rebuild usr.bin/config 795 796Symptom: 797Fix: Rebuild usr.bin/yacc 798 799Symptom: 800Fix: Rebuild usr.bin/lex 801 802Symptom: 803Fix: rm /usr/lib/libbfd.a 804 805Symptom:Obsolete intermediate files are used during compilation 806Fix: Try the following sequence of commands in the directory in question. 807 make cleandir; rm `make print-objdir`; make cleandir; make obj 808 (If you built the tree without "make obj" in the past, obsolete files 809 may remain. The command tries to clean everything up) 810 811Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible 812 pointer type 813Fix: Rebuild and install usr.bin/menuc 814 815Symptom:mklocale not found during build in share/locale/ctype 816Fix: Build and install usr.bin/mklocale 817 818Symptom:undefined reference to `__assert13' or `__unsetenv13' 819Fix: Rebuild and install lib/libc 820 821Symptom:usr.bin/config fails to build. 822Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 823 824Symptom:undefined reference to `getprogname' or `setprogname' 825Fix: Rebuild and install lib/libc 826 827Symptom:lint does not understand the '-X' option 828Fix: May need to build & install libs with NOLINT=1 before rebuilding lint 829 830Symptom:Update build fails in src/tools/gcc complaining that a variable 831 (e.g. CPPFLAGS) has changed since the previous run. 832Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build. 833 834Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...: 835 No such file or directory. 836Cause: If a directory is created by mistake, then it is sometimes 837 deleted from the CVS repository using administrative commands 838 that bypass the normal cvs access controls. If your cvs working tree 839 contains references to a directory that has been deleted on the 840 server in this way, then "cvs update" reports this error. 841Fix: Recursively delete the affected directory from your working tree 842 and try the update again. 843