UPDATING revision 1.290
1$NetBSD: UPDATING,v 1.290 2017/12/27 08:29:02 martin Exp $ 2 3This file (UPDATING) is intended to be a brief reference to recent 4changes that might cause problems in the build process, and a guide for 5what to do if something doesn't work. 6 7For a more detailed description of the recommended way to build NetBSD 8using build.sh, see the BUILDING file. 9 10Note that much of the advice in this UPDATING file was written before 11build.sh existed. Nevertheless, the advice here may be useful for 12working around specific problems with build.sh. 13 14Sections are marked with "^^^^^". After the section on "Recent changes" 15are several sections containing more general information. 16 17See also: BUILDING, build.sh, Makefile. 18 19Recent changes: 20^^^^^^^^^^^^^^^ 21 2220171225: 23 removal of the vadvise syscall requires manual removal of all 24 associated files from the libc build object directory (including 25 the .depend files) - a command like: 26 cd $OBJ && find . -type d -name libc | xargs rm -rf 27 For architectures that support multiple "compat" binary targets, 28 you'll need to cleanup both the regular libc directory and the 29 compat ones (the above command will do that). 30 3120171010: 32 a change to the build structure of external/bsd/acpica/bin/iasl 33 means that its objdir (or *.d and .depend at least) might need 34 to be manually removed - or a build done once without -u. 35 3620170822: 37 a new version of GMP has been imported and probably 38 will break parts of builds related to themselves or GCC, both 39 in the tools and the native section. Remove all GCC, GMP, MPFR 40 and MPC objdirs or build once without -u. 41 4220170816: 43 a new version of MPFR and MPC have been imported and probably 44 will break parts of builds related to themselves or GCC, both 45 in the tools and the native section. Remove all GCC, GMP, MPFR 46 and MPC objdirs or build once without -u. 47 4820170402: 49 a new version of dhcpcd has been imported, which does not support 50 update builds from the previous version. Remove your 51 external/bsd/dhcpcd object dir or build once without -u. 52 5320170211: 54 a new terminfo database has been imported. 55 The structure of it has changed slightly from prior versions and 56 an updated tic tool is required. 57 If you build.sh, don't use -u 58 5920170207: 60 various arch dependent libc/exect.S files were removed 61 Either remove the obj directories (lib/libc and compat/amd64/i386/lib 62 if it exists) or do a clean build. 63 (This is a bug in the make system, it should be corrected without 64 human intervention, but isn't.) 65 6620170104: 67 xinput build options have changed. 68 Remove the obj directory (external/mit/xorg/bin/xinput) 69 if you build.sh -u 70 7120170103: 72 a new version of flex has been imported. 73 Remove the file from obj (external/bsd/flex) 74 if you build.sh -u 75 7620161014: 77 a new version of OpenSSL has been imported. 78 Remove the files from obj (crypto/external/bsd/openssl) 79 if you build.sh -u 80 8120161009: 82 a new version of dhcpcd has been imported with slightly changed 83 build infrastructure. When doing a build.sh -u this requires 84 pruning the external/bsd/dhcpcd objdir. 85 8620160914: 87 i386, amd64, shark, ofppc and macppc have joined shark and x68k 88 ports in using xorg-server 1.18. This requires a clean destdir 89 and a clean objdir. 90 9120160527: 92 i386 needs a full cleandir or objdir deletion because PIE has 93 been enabled. (see the amd64 entry two down for further info) 94 9520160418: 96 libedit needs manual removal of all autogenerated files since 97 some of them are not autogenerated anymore. Remember that there 98 might be two copies of libedit if your platform builds "compat". 99 10020160410: 101 amd64 needs full "make cleandir" or deletion of objdir now that 102 PIE has been enabled for amd64. PIE, or position-independent 103 executables, means all code, including executables and not just 104 shared libraries, is position-independent and hence able to be 105 relocated by ASLR, address space layout randomization. 106 107 The change was made in Makefile variables for compiler and 108 linker flags, for which make(1) does not record dependencies, 109 hence it is unable to detect that all .o files need rebuilding. 110 111 Partial rebuilds with some modified source files will likely 112 fail when linking executables, since the linker refuses to mix 113 position-independent code with position-dependent code in 114 position-independent executables: 115 116 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC 117 11820160401: 119 Ports switching to GCC 5.3 will need a full "make cleandir". 120 Some people have found that cleandir is not sufficient, so if 121 in doubt delete the entire object directory tree for gcc. 122 12320160306: 124 NetBSD's regexp implementation is now part of libnbcompat. 125 Nblex, nbm4, nbpax, nbsed use it and they may crash on 126 non-NetBSD hosts if linked with stale object files produced 127 while they included a non-NetBSD regex.h. 128 In any case, you should "make cleandir" at least these tools 129 before updating your toolchain. 130 13120160125: 132 Dtrace has been enabled by default on some architectures. 133 When doing an update build, make sure to clean the etc/mtree 134 object directory before starting the build - otherwise the 135 needed directories in destdir will not be created. 136 An easy way to do this is: 137 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir 138 13920150818: 140 New acpica requires "make cleandir" in src/external/bsd/acpica 141 again. 142 14320150413: 144 New acpica requires "make cleandir" and reinstalling yacc 145 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and 146 also "make cleandir" in /usr/src/external/bsd/acpica. 147 14820150404: 149 Lint changes require a full rebuild of the tool, so make 150 sure to build without -u option to build.sh, or manually 151 do a make cleandir in src/tools/lint1 and 152 src/usr.bin/xlint. 153 15420150310: 155 Improvements to openssl for arm mean that update builds of 156 the openssl libraries will fail. A make cleandir in 157 external/bsd/openssl/lib is needed 158 15920141026: 160 A mishap during the import of pppd may cause your corruption 161 in your cvs directory if you happened to do a cvs update 162 during a short period of time. To fix, just remove the 163 directory src/external/bsd/ppp/dist/pppd completely 164 and let cvs restore it on next update. 165 16620140721: 167 The src/external/mit/lua/src directory was accidentally created 168 and then deleted in the CVS repository. If you get errors like 169 170 cvs [update aborted]: cannot open directory 171 /cvsroot/src/external/mit/lua/src: No such file or directory 172 173 then delete your local copy of that directory tree and try again. 174 17520140530: 176 ARM eABI switched to DWARF based exception handling. This requires 177 rebuilding all C++ code. It is strongly advised to do a clean build. 178 17920140131: 180 The new compiler_rt/libc integration moved a few things. It is strongly 181 advised to do a clean build. At least lib/libc, the compat version(s) 182 of libc, libkern, rump and the kernels need to be cleaned. 183 18420131227: 185 1. The new ntpd runs in a restricted mode to prevent amplification 186 attacks. If you need ntpdc to work you need to explicitly enable 187 mode7 in your config file. Make sure you put the necessary restrict 188 statements to avoid being exposed. 189 2. strncat has moved from lib/libc to common/lib/libc; you might need 190 to make clean in libc 191 19220131129: 193 The GMP sources were updated, and builds will likely fail without 194 cleaning their build trees for both tools and in-tree, like below. 195 19620131128: 197 The MPC and MPFR sources were updated, and builds may require their 198 tools and in-tree directories cleaned for successful updates. 199 20020130605: 201 The kernel option FAST_IPSEC no longer exists, it's been renamed 202 to IPSEC (and the older IPSEC version removed). 203 20420130605: 205 Previous freetype installations eroneously installed private 206 header files. If you are building against a non-empty $DESTDIR, 207 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/. 208 20920130531: 210 The xdm update may cause build failure due to xdm.man being 211 in the obj tree. Make sure to ensure any like this: 212 nbmake: nbmake: don't know how to make xdm.man. Stop 213 is fixed by deleting the xdm.man in the obj tree. 214 21520130530: 216 Updates of many xsrc packages will leave old .pc files around. 217 Best to clean out the xsrc objdir entirely before rebuilds. 218 21920130301: 220 The removal of netiso requires manual removal of /usr/include/netiso 221 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump} 222 22320120726: 224 The update of OpenSSL requires cleaning both the OpenSSL build 225 directory and DESTDIR. *Even non-update builds require cleaning 226 DESTDIR.* Builds done without taking these steps may fail, or in 227 some cases may succeed and install broken OpenSSL libraries that 228 cause third-party software to link incorrectly and/or crash. 229 23020120507: 231 The database schema for makemandb was changed. You will 232 need to update the database using 'makemandb -f' or wait 233 for the next weekly run to fix it. 234 23520120319: 236 sys/conf/Makefile.kern.inc has been modified to adjust the 237 size of db_symtab automatically. You need to update dbsym in 238 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If 239 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your 240 mk.conf. 241 24220120216: 243 Default for MKCATPAGES changed to NO. Update builds will fail 244 unless DESTDIR is cleaned manually. If you built between 20120207 245 and 20120216, daily and weekly could have created an unreadable 246 /var/db/man.db index for apropos. Running makemandb -f or 247 the next run of weekly will fix it. 248 24920111227: 250 If you built between 20111225 and 20111227 you need to remove 251 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the 252 bump has been reverted. 253 25420111125: 255 The "rnd" pseudodevice has been added to sys/conf/std, which 256 means it should no longer be explicitly listed in kernel 257 configuration files. The line "pseudo-device rnd" should be 258 removed from any custom kernel config files users may have. 259 26020111119: 261 A problem with the datastructures used by the rndctl(8) 262 utility (pointers in datastructures in an array, making 32->64 263 bit compatibility very painful) has been fixed in a 264 non-backwards-compatible way. If you replace your kernel, 265 replace your rndctl executable too. 266 26720111001: 268 the prop_*_send_syscall() functions from proplib(3) have been 269 changed and their new version is not backward compatible with the old 270 one. So ensure that all consumers of these functions (currently: 271 quota2 code and its tests) are updated together with the new lib. 272 27320110817: 274 sparc has been changed to use GCC 4.5.3, so any objdir or 275 DESTDIR for them should be deleted before updating. 276 27720110806: 278 i386 and amd64 have been changed to use GCC 4.5.3, so any 279 objdir or DESTDIR for them should be deleted before updating. 280 28120110805: 282 The update to GCC 4.5.3 requires a non-trivial portion of 283 the tree to be cleaned. Best to delete both objdir and 284 DESTDIR before running this update. So far, only the 285 sparc64, mips and powerpc platforms have changed. 286 28720110803: 288 The layout of external/public-domain/xz has changed. To do an 289 update build you will have to remove the contents of the OBJDIR 290 for external/public-domain/xz/bin by hand as the xz entry there 291 is now a directory. 292 29320110410: 294 The configuration of src/tools/gcc has changed. To do an 295 update build you have to clean both tools/binutils and 296 tools/gcc by hand. 297 29820110328: 299 Building the Xorg binary was moved into a subdirectory to fix 300 ordering issues with "make all". It may be necessary to remove 301 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86 302 if your update build fails, as the "Xorg" entry there is now a 303 directory. 304 30520110121: 306 Assembler files no longer use -traditional-cpp. This can break 307 the build of individual parts of the tree. This is handled 308 correctly by build.sh. Manual builds have to update /usr/share/mk 309 and re-run config(1) for any kernel configurations as needed. 310 31120101217: 312 The tcpdump(8) program was changed to drop privileges and chroot(2) 313 by default. It may be necessary to manually update passwd(5) and 314 group(5) in order to make the program work with existing setups. 315 31620101125: 317 The latest changes to setenv(3) dissallow setting environment 318 variables with names that contain '='. Revision 1.18 of env.c 319 assumed that this was allowed. Installing a new libc with an 320 old copy of /usr/bin/env causes env x=1 printenv | grep x= to 321 break which affects the autoconf tests for dependency finding, 322 so building gcc will end up printing: 323 checking dependency style of gcc... none 324 configure: error: no usable dependency style found 325 Fix it by rebuilding and re-installing env. 326 32720101119: 328 Recent Xorg updates in xsrc/external/mit/ may cause various build 329 or run-time problems. Delete your entire DESTDIR and OBJDIR if you 330 have any build problems with xsrc, or problems with mismatched 331 versions between xorg-server and drivers. 332 33320100604: 334 The update of ATF to 0.9 causes old tests written in shell to fail 335 unless they are rebuilt. If you are building with MKUPDATE=yes, 336 you need to clean the src/external/bsd/atf/tests/ and the src/tests/ 337 trees by hand. 338 33920100522: 340 Recent Xorg updates in xsrc/external/mit/ will cause various build 341 problems. Delete your entire DESTDIR and OBJDIR if you have any 342 build problems with xsrc. 343 34420100522: 345 private section of <ctype.h> was splitted, and now mklocale(1) 346 include ctype_local.h, so you have to make cleandir in tools/mklocale. 347 34820100520: 349 The location of the xkb compiled descriptions has changed. Please 350 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR. 351 35220100222: 353 The shared objects file extension has been changed from .so to 354 .pico, in order to avoid conflicts with shared libraries names 355 libXX.so. All now stale regular .so files can be removed from 356 your object directories. 357 35820100204: 359 The termcap database has been removed from the sources, 360 but has not been marked obsolete so it is not removed 361 from the system when upgrading. 362 As such, you will need to remove them from your object 363 and destination directories. 364 36520091101: 366 After updating, it may be necessary to make the 'cleandir' 367 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a 368 'build.sh -u tools' or 'build.sh -u distribution'. Ditto 369 src/tools/lex/ and src/usr.bin/lex/. 370 37120091001: 372 On amd64 you must rebuild tools (to get the new binutils) 373 before building a kernel, or the build fails on cpufunc.S. 374 37520091001: 376 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb 377 symlink, failing the build. Delete the link, and the subdir 378 it is in, and retry your build. 379 38020090718: 381 libc build changed so that strchr() provides the extra entry 382 point for index(). Update build of libc.a (and libc_pic.a) 383 may fail because the archive contains the unwanted index.o. 384 (Similarly for strrchr() and rindex().) 385 38620090709: 387 Native Xorg was upgraded again. Builds will probably fail again 388 without a clean objdir, at least for src/external/mit/xorg. 389 39020090616: 391 Native Xorg was upgraded. Builds will need a clean objdir for 392 src/external/mit/xorg. Upgrading a system from sets will not 393 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc 394 subdirectory has been changed into a file, and this needs to 395 be manually "rm -r"'ed before installing xbase.tgz. 396 39720090501: 398 Several new functions were added to string.h/libc, and this 399 can cause autoconf problems during the tool build for people 400 who fail to clean out their tools objects properly. If you 401 note messages about stpcpy, stpncpy or strnlen accompanying a 402 failure during the tool build, clean out all your tools 403 objects and start again. 404 40520090325: 406 The i386 port was switched to i486 default toolchain. This requires 407 cleaning your src/tools directory and $TOOLDIR and rebuilding them. 408 40920090126: 410 The __posix_fadvise50 system call changed assembly stub type. You 411 need to 'rm -f __posix_fadvise50.*' in the libc build directory 412 to avoid using the old assembly stub. 413 41420090202: 415 pkg_install now depends on the pkgdb cache for automatic conflict 416 detection. It is recommented to rebuild the cache with 417 ``pkg_admin rebuild''. 418 41920090110: 420 time_t and dev_t have been bumped to 64 bit quantities. To upgrade: 421 1. Make sure your kernel has COMPAT_50 in it. Build and install. 422 This is needed even in the MODULAR kernel because there is 423 conditionally compiled code in rtsock.c. 424 2. make sure build.sh completes and the binaries in a chroot work 425 before installing. 426 3. If you don't use build.sh and you build directly to root, and 427 your build breaks in the middle, don't despair. Make sure headers 428 are installed properly, and start building libraries first libc 429 and libutil, install them and then continue building all the 430 libraries in src/lib and src/gnu/lib and install them. Once 431 the new libraries are installed, you can restart the build. 432 4. If you compile packages and you notice link time warnings, 433 rebuild the required packages to update their shared libraries. 434 Any package you rebuild will require rebuilding all the packages 435 that depend on it. 436 5. Next time you run pwd_mkdb with the new binary, the file 437 will be upgraded and it will not be backwards compatible. 438 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see 439 lastlogx(5)) have been versioned, and there is a heuristic 440 for utmp. You are better off removing the old files after 441 upgrading. The automated clearing of /var/run during 442 boot, and the automated rotating of files in /var/log by 443 newsyslog(8), may mean that you do not have to remove the 444 files manually. 445 7. The optional accounting file (/var/account/acct, see 446 accton(8)) has not been versioned, and will need to be 447 removed. The automatic rotation of the accounting file by 448 /etc/daily limits the bad consequences of failure to remove 449 the file. 450 8. Application software that writes time_t to binary files on 451 disk will break or need attention. Most notably: if you are 452 using PostgreSQL < 8.4, you need to dump your databases, 453 rebuild PostgreSQL with the new time_t, then restore. 454 45520081219: 456 config(1) has been updated, and one of the files it creates - 457 swapnetbsd.o - has changed format. You need to rebuild config 458 (done automatically by build.sh) and then you need to rerun 459 config on all kernel configuration files before rebuilding those 460 kernels. 461 46220081205: 463 If you build with MKX11=no, you should remove /etc/rc.d/xdm and 464 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc 465 set and will appear as extra files for MKX11=no update builds. 466 46720081122: 468 On i386, various kernel options(4) in GENERIC including 469 file systems have been disabled and moved into kernel modules. 470 Before trying a new GENERIC kernel, you have to prepare the 471 following files as well as a new GENERIC kernel: 472 473 - build and install kernel modules from src/sys/modules 474 475 - install the latest bootloader, which will load a module 476 for the file system from which the kernel is loaded automatically 477 478 If you have to load your kernel from a file system which is not of 479 the same type as the root file system, you have to load the necessary 480 file system module manually on the boot prompt or in the boot.cfg file. 481 48220080827: 483 If you built and installed a libc from sources between 484 2008/08/20 and 2008/08/26 you got a broken strtouq(3) 485 which results in false errors reported by lint(1). 486 Since this breaks the libc build itself, manual help is 487 needed -- lint must be disabled temporarily, e.g.: 488 $ (cd lib/libc && make MKLINT=no dependall install) 489 49020080813: 491 MKDEBUG build was broken because the .depend files did not know 492 about .go files. You need to remove all .depend files and rebuild. 493 49420080802: 495 A regression in binary compatibility for pthread_mutex_t has 496 been fixed. Unfortunately, the price is breaking compatibility 497 for -current. 498 499 Threaded programs (using libpthread) and C++ programs (using 500 libstdc++) compiled after 20070907 and before 20080802 need to 501 be recompiled. 502 503 One way to find affected pkgsrc packages: 504 505 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO 506 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO 507 50820080731: 509 WAPBL (metadata journaling support) has been added, but at this 510 time isn't backwards compatible with pre-WAPBL aware kernels 511 and userland (fsck_ffs in particular). Please make sure you 512 don't use a journaled filesystem with an older kernel/userland, 513 especially an uncleanly mounted journaled filesystem. WAPBL 514 also requires the super block to be in the UFS2 format. You 515 can use fsck_ffs -c 4 to update the superblock format. 516 51720080721: 518 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR 519 isn't defined. 520 52120080531: 522 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 523 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8) 524 utility needs to be rebuilt and reinstalled as older binaries 525 won't work correctly. The following sequence of commands: 526 527 $ (cd sys/sys/ && nbmake-$arch includes) 528 $ (cd sbin/drvctl/ && nbmake-$arch clean) 529 $ (cd sbin/drvctl/ && nbmake-$arch all) 530 531 leaves new drvctl utility in sbin/drvctl build directory. 532 53320080503: 534 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE. 535 53620080521: 537 For a while, unprivileged UPDATE builds would fail to 538 succeed at the checkflist stage, complaining that 539 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this 540 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9. 541 If you already hit this problem, update the .mk file, 542 remove ${DESTDIR}/stand/<arch>, and re-run the build. 543 54420080303: 545 Linker warnings are now fatal if $WARNS>0. 546 54720080126: 548 The posix_fadvise system call has been changed from an assembly 549 stub, to a c file that calls an assembly stub. You need to 550 'rm -f posix_fadvise.* .depend' in the libc build directory to 551 avoid using the old assembly stub. 552 55320071209: 554 The acpiec(4) driver has been split into two attachments. If you 555 get ACPI errors before the attachment, please update your kernel 556 configuration file appropriately or see GENERIC for more details. 557 55820071115: 559 The it(4) driver has been renamed to itesio(4) and the old port 560 argument specified in the kernel configuration file is not valid 561 anymore. The itesio(4) driver now uses the Super I/O address port 562 rather than the EC address port. Please update your kernel 563 configuration file appropriately or see GENERIC for more details. 564 56520071028: 566 The pccons(4) driver has been removed from the NetBSD/shark port. 567 You need to update any custom kernel configuration file you have 568 to remove any references to pccons (which includes removing the 569 now useless XSERVER option) and replace them with the correct 570 entries for the wscons driver. See the GENERIC configuration file 571 for more details. 572 57320070913: 574 A latent bug in dhclient/dhcpd that caused it to be unable to 575 enumerate interfaces was fixed. The bug began to cause 576 problems after 20070911 when the kernel's SIOCGIFCONF 577 implementation was repaired. From 20070529 to 20070911 racoon 578 could not enumerate interfaces. (These are noted because 579 normal kernel/userspace version matching hygiene is not 580 sufficient to avoid this problem.) Ensure that both kernel 581 and userland are from after 20070913. 582 58320070703: 584 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It 585 calls the target-specific strip program, and the logic to pass 586 down STRIP from make has been removed. This requires a 587 re-installation of tools. 588 58920070422: 590 The way OS emulations lookup filenames inside the emulation root 591 has been changed. Rather than modify the pathname (and copy back 592 to userspace) namei() and lookup() directly check the emulation 593 root. One side effect is that absolute symlinks inside the emulated 594 root file system will be relative to that file system - unless they 595 start /../ this is useful when the emulated root is a real install 596 that has such links. 597 This might affect symlinks that have been added to reference outside 598 the emulated root. 599 60020070412: 601 The pckbc driver on sgimips IP32 has been removed. Use macekbc 602 instead. See the GENERIC32_IP3x kernel configuration for an 603 example. 604 60520070319: 606 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so 607 on many platforms due to incorrect flags settings. If you 608 updated and built after about 20070315, do "nbmake-$arch 609 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a 610 rebuild of object files that might have been built 611 incorrectly, and ensure that you have at least 612 src/lib/libc/Makefile 1.130. 613 61420070210: 615 src/sys/sys/{sa.h,savar.h} were removed. 616 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \ 617 | xargs egrep -l '/sa.h|/savar.h' | xargs rm 618 will allow dependencies on those files to get get rebuilt 619 62020070209: 621 The threading model was changed when the newlock2 branch 622 was merged to NetBSD-current. If you boot with a new 623 kernel (version 4.99.10), then you also need a new pthread 624 library (/usr/lib/libpthread.so.0.7). If you boot with 625 an old kernel, then you need the old pthread library 626 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and 627 the pthread library in sync, old threaded applications should 628 continue to work with an old or new kernel. Note that named(8) 629 is the only threaded application in the base system. 630 63120061214: 632 Following the move of string_to_flags() and flags_to_string() 633 from the bin/ls/ sources to libutil, users doing UPDATE builds 634 will need to do a "make cleandir" in 635 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/, 636 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/, 637 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well 638 as the installation images in distrib/ 639 in order to excise stale references to the old stat_flags.h header 640 file in the ls sources -- stat_flags.h has been removed. 641 64220061108: 643 The configure script used in the src/tools/gcc compiler has been 644 changed to indicate that our libc has ssp support built-in and 645 does not depend on -lssp and -lssp-nonshared. You'll need to 646 make clean in src/tools/gcc first to rebuild the compiler. 647 64820061009: 649 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer 650 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead. 651 65220060814: 653 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been 654 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC 655 kernel configuration for an example. X servers from the last 656 few years should cope. 657 65820060703: 659 MPACPI is no more. We always configure PCI interrupts using ACPI 660 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed 661 to ACPI_SCANPCI. Thanks to work from fvdl. 662 66320060627: 664 socket(2) has changed, and its system call has been versioned. 665 For userlands with the old version of socket(2), make sure that 666 your kernel has 'options COMPAT_30' set, or else 'bad system call' 667 errors will result. 668 669Hints for a more successful build: 670^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 671 Use build.sh, but do not use its "expert mode": 672 This will automatically build the tools in the 673 correct order, and it will keep the tools and the 674 new build products from interfering with the running 675 system. This will allow you to ignore most of the 676 other advice in this file. 677 Build a new kernel first: 678 This makes sure that any new system calls or features 679 expected by the new userland will be present. This 680 helps to avoid critical errors when upgrading. 681 Use object directories: 682 This helps to keep stale object 683 files from polluting the build if a Makefile "forgets" 684 about one. It also makes it easier to clean up after 685 a build. It's also necessary if you want to use the 686 same source tree for multiple machines. 687 To use object directories with build.sh: 688 a) invoke build.sh with the "-M" or "-O" options. 689 To use object directories without using build.sh: 690 a) cd /usr/src ; make cleandir 691 b) Add "OBJMACHINE=yes" to /etc/mk.conf 692 c) Add "MKOBJDIRS=yes" to /etc/mk.conf 693 d) cd /usr/src ; make build 694 Note that running "make obj" in a directory will create 695 in obj.$MACHINE directory. 696 Build to a DESTDIR: 697 This helps to keep old installed files (especially libraries) 698 from interfering with the new build. 699 To build to a DESTDIR with build.sh, use the "-D" option. 700 To build to a DESTDIR without using build.sh, set the DESTDIR 701 environment variable before running make build. It should be 702 set to the pathname of an initially empty directory. 703 Problems: if you do not use build.sh, you might need to 704 update critical utilities without using DESTDIR since 705 nothing is executed from what is installed in DESTDIR. 706 (See critical utils, below.) 707 Build often: 708 This keeps critical utilities current enough to not choke 709 on any other part of the source tree that depends on up to 710 date functionality. If you use build.sh, you should not have 711 this problem. 712 713What to do if things don't work: 714^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 715When things don't work there are usually a few things that commonly 716should be done. 717 1) make includes 718 This should be done automatically by make build. 719 2) cd share/mk && make install 720 Again, automatically done by make build. 721 722Failsafe rebuild of a small part of the tree: 723^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 724To make sure you rebuild something correctly you want to do 725something like the following: 726 1) Make sure the includes and .mk files are up to date. 727 2) Make sure any program used to build the particular 728 utility is up to date. (yacc, lex, etc...) 729 3) cd ...path/to/util... 730 make cleandir 731 rm ...all obj directories... 732 make cleandir # yes, again 733 make obj 734 make depend && make 735 736Failsafe rebuild of the entire tree: 737^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 738If you really want to make sure the source tree is clean and 739ready for a build try the following. Note that sourcing /etc/mk.conf 740(a make(1) Makefile) in this manner is not right, and will not work 741for anyone who uses any make(1) features in /etc/mk.conf. 742 743---cut here--- 744#!/bin/sh 745. /etc/mk.conf 746 747if [ -z $NETBSDSRCDIR ] ; then 748 NETBSDSRCDIR=/usr/src 749fi 750if [ \! -d $NETBSDSRCDIR ] ; then 751 echo Unable to find sources 752 exit 1 753fi 754find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 755 756if [ -z $BSDOBJDIR ] ; then 757 BSDOBJDIR=/usr/obj 758fi 759if [ -d $BSDOBJDIR ] ; then 760 rm -rf $BSDOBJDIR 761fi 762 763cd $NETBSDSRCDIR && make cleandir 764 765---cut here--- 766 767Critical utilities: 768^^^^^^^^^^^^^^^^^^^ 769 usr.bin/compile_et 770 usr.bin/make 771 usr.bin/yacc 772 usr.bin/lex 773 usr.bin/xlint 774 usr.bin/config 775 776Other problems and possible solutions: 777^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 778Symptom:Complaints involving a Makefile. 779Fix: Rebuild usr.bin/make: 780 cd usr.bin/make && make && make install 781 Or, a failsafe method if that doesn't work: 782 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 783 784Fix: Make sure .mk files are up to date. 785 cd share/mk && make install 786 787Symptom:Kernel `config' fails to configure any kernel, including GENERIC. 788Fix: Rebuild usr.bin/config 789 790Symptom: 791Fix: Rebuild usr.bin/yacc 792 793Symptom: 794Fix: Rebuild usr.bin/lex 795 796Symptom: 797Fix: rm /usr/lib/libbfd.a 798 799Symptom:Obsolete intermediate files are used during compilation 800Fix: Try the following sequence of commands in the directory in question. 801 make cleandir; rm `make print-objdir`; make cleandir; make obj 802 (If you built the tree without "make obj" in the past, obsolete files 803 may remain. The command tries to clean everything up) 804 805Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible 806 pointer type 807Fix: Rebuild and install usr.bin/menuc 808 809Symptom:mklocale not found during build in share/locale/ctype 810Fix: Build and install usr.bin/mklocale 811 812Symptom:undefined reference to `__assert13' or `__unsetenv13' 813Fix: Rebuild and install lib/libc 814 815Symptom:usr.bin/config fails to build. 816Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 817 818Symptom:undefined reference to `getprogname' or `setprogname' 819Fix: Rebuild and install lib/libc 820 821Symptom:lint does not understand the '-X' option 822Fix: May need to build & install libs with NOLINT=1 before rebuilding lint 823 824Symptom:Update build fails in src/tools/gcc complaining that a variable 825 (e.g. CPPFLAGS) has changed since the previous run. 826Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build. 827 828Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...: 829 No such file or directory. 830Cause: If a directory is created by mistake, then it is sometimes 831 deleted from the CVS repository using administrative commands 832 that bypass the normal cvs access controls. If your cvs working tree 833 contains references to a directory that has been deleted on the 834 server in this way, then "cvs update" reports this error. 835Fix: Recursively delete the affected directory from your working tree 836 and try the update again. 837