UPDATING revision 1.292
1$NetBSD: UPDATING,v 1.292 2018/03/11 11:18:06 mrg Exp $ 2 3This file (UPDATING) is intended to be a brief reference to recent 4changes that might cause problems in the build process, and a guide for 5what to do if something doesn't work. 6 7For a more detailed description of the recommended way to build NetBSD 8using build.sh, see the BUILDING file. 9 10Note that much of the advice in this UPDATING file was written before 11build.sh existed. Nevertheless, the advice here may be useful for 12working around specific problems with build.sh. 13 14Sections are marked with "^^^^^". After the section on "Recent changes" 15are several sections containing more general information. 16 17See also: BUILDING, build.sh, Makefile. 18 19Recent changes: 20^^^^^^^^^^^^^^^ 21 2220180311: 23 bdftopcf was updated and may need cleaning in the 24 src/external/mit/xorg/tools/bdftopcf subdirectory if there are 25 link errors. 26 2720180212: 28 between OpenSSL and GCC updates, many things may fail to build. 29 any failure that looks like GCC or openssl is best handled by 30 a clean destdir and objdir. Full cleandir and destdir deletion 31 is recommended if build failures occur. 32 3320171225: 34 removal of the vadvise syscall requires manual removal of all 35 associated files from the libc build object directory (including 36 the .depend files) - a command like: 37 cd $OBJ && find . -type d -name libc | xargs rm -rf 38 For architectures that support multiple "compat" binary targets, 39 you'll need to cleanup both the regular libc directory and the 40 compat ones (the above command will do that). 41 4220171010: 43 a change to the build structure of external/bsd/acpica/bin/iasl 44 means that its objdir (or *.d and .depend at least) might need 45 to be manually removed - or a build done once without -u. 46 4720170822: 48 a new version of GMP has been imported and probably 49 will break parts of builds related to themselves or GCC, both 50 in the tools and the native section. Remove all GCC, GMP, MPFR 51 and MPC objdirs or build once without -u. 52 5320170816: 54 a new version of MPFR and MPC have been imported and probably 55 will break parts of builds related to themselves or GCC, both 56 in the tools and the native section. Remove all GCC, GMP, MPFR 57 and MPC objdirs or build once without -u. 58 5920170402: 60 a new version of dhcpcd has been imported, which does not support 61 update builds from the previous version. Remove your 62 external/bsd/dhcpcd object dir or build once without -u. 63 6420170211: 65 a new terminfo database has been imported. 66 The structure of it has changed slightly from prior versions and 67 an updated tic tool is required. 68 If you build.sh, don't use -u 69 7020170207: 71 various arch dependent libc/exect.S files were removed 72 Either remove the obj directories (lib/libc and compat/amd64/i386/lib 73 if it exists) or do a clean build. 74 (This is a bug in the make system, it should be corrected without 75 human intervention, but isn't.) 76 7720170104: 78 xinput build options have changed. 79 Remove the obj directory (external/mit/xorg/bin/xinput) 80 if you build.sh -u 81 8220170103: 83 a new version of flex has been imported. 84 Remove the file from obj (external/bsd/flex) 85 if you build.sh -u 86 8720161014: 88 a new version of OpenSSL has been imported. 89 Remove the files from obj (crypto/external/bsd/openssl) 90 if you build.sh -u 91 9220161009: 93 a new version of dhcpcd has been imported with slightly changed 94 build infrastructure. When doing a build.sh -u this requires 95 pruning the external/bsd/dhcpcd objdir. 96 9720160914: 98 i386, amd64, shark, ofppc and macppc have joined shark and x68k 99 ports in using xorg-server 1.18. This requires a clean destdir 100 and a clean objdir. 101 10220160527: 103 i386 needs a full cleandir or objdir deletion because PIE has 104 been enabled. (see the amd64 entry two down for further info) 105 10620160418: 107 libedit needs manual removal of all autogenerated files since 108 some of them are not autogenerated anymore. Remember that there 109 might be two copies of libedit if your platform builds "compat". 110 11120160410: 112 amd64 needs full "make cleandir" or deletion of objdir now that 113 PIE has been enabled for amd64. PIE, or position-independent 114 executables, means all code, including executables and not just 115 shared libraries, is position-independent and hence able to be 116 relocated by ASLR, address space layout randomization. 117 118 The change was made in Makefile variables for compiler and 119 linker flags, for which make(1) does not record dependencies, 120 hence it is unable to detect that all .o files need rebuilding. 121 122 Partial rebuilds with some modified source files will likely 123 fail when linking executables, since the linker refuses to mix 124 position-independent code with position-dependent code in 125 position-independent executables: 126 127 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC 128 12920160401: 130 Ports switching to GCC 5.3 will need a full "make cleandir". 131 Some people have found that cleandir is not sufficient, so if 132 in doubt delete the entire object directory tree for gcc. 133 13420160306: 135 NetBSD's regexp implementation is now part of libnbcompat. 136 Nblex, nbm4, nbpax, nbsed use it and they may crash on 137 non-NetBSD hosts if linked with stale object files produced 138 while they included a non-NetBSD regex.h. 139 In any case, you should "make cleandir" at least these tools 140 before updating your toolchain. 141 14220160125: 143 Dtrace has been enabled by default on some architectures. 144 When doing an update build, make sure to clean the etc/mtree 145 object directory before starting the build - otherwise the 146 needed directories in destdir will not be created. 147 An easy way to do this is: 148 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir 149 15020150818: 151 New acpica requires "make cleandir" in src/external/bsd/acpica 152 again. 153 15420150413: 155 New acpica requires "make cleandir" and reinstalling yacc 156 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and 157 also "make cleandir" in /usr/src/external/bsd/acpica. 158 15920150404: 160 Lint changes require a full rebuild of the tool, so make 161 sure to build without -u option to build.sh, or manually 162 do a make cleandir in src/tools/lint1 and 163 src/usr.bin/xlint. 164 16520150310: 166 Improvements to openssl for arm mean that update builds of 167 the openssl libraries will fail. A make cleandir in 168 external/bsd/openssl/lib is needed 169 17020141026: 171 A mishap during the import of pppd may cause your corruption 172 in your cvs directory if you happened to do a cvs update 173 during a short period of time. To fix, just remove the 174 directory src/external/bsd/ppp/dist/pppd completely 175 and let cvs restore it on next update. 176 17720140721: 178 The src/external/mit/lua/src directory was accidentally created 179 and then deleted in the CVS repository. If you get errors like 180 181 cvs [update aborted]: cannot open directory 182 /cvsroot/src/external/mit/lua/src: No such file or directory 183 184 then delete your local copy of that directory tree and try again. 185 18620140530: 187 ARM eABI switched to DWARF based exception handling. This requires 188 rebuilding all C++ code. It is strongly advised to do a clean build. 189 19020140131: 191 The new compiler_rt/libc integration moved a few things. It is strongly 192 advised to do a clean build. At least lib/libc, the compat version(s) 193 of libc, libkern, rump and the kernels need to be cleaned. 194 19520131227: 196 1. The new ntpd runs in a restricted mode to prevent amplification 197 attacks. If you need ntpdc to work you need to explicitly enable 198 mode7 in your config file. Make sure you put the necessary restrict 199 statements to avoid being exposed. 200 2. strncat has moved from lib/libc to common/lib/libc; you might need 201 to make clean in libc 202 20320131129: 204 The GMP sources were updated, and builds will likely fail without 205 cleaning their build trees for both tools and in-tree, like below. 206 20720131128: 208 The MPC and MPFR sources were updated, and builds may require their 209 tools and in-tree directories cleaned for successful updates. 210 21120130605: 212 The kernel option FAST_IPSEC no longer exists, it's been renamed 213 to IPSEC (and the older IPSEC version removed). 214 21520130605: 216 Previous freetype installations eroneously installed private 217 header files. If you are building against a non-empty $DESTDIR, 218 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/. 219 22020130531: 221 The xdm update may cause build failure due to xdm.man being 222 in the obj tree. Make sure to ensure any like this: 223 nbmake: nbmake: don't know how to make xdm.man. Stop 224 is fixed by deleting the xdm.man in the obj tree. 225 22620130530: 227 Updates of many xsrc packages will leave old .pc files around. 228 Best to clean out the xsrc objdir entirely before rebuilds. 229 23020130301: 231 The removal of netiso requires manual removal of /usr/include/netiso 232 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump} 233 23420120726: 235 The update of OpenSSL requires cleaning both the OpenSSL build 236 directory and DESTDIR. *Even non-update builds require cleaning 237 DESTDIR.* Builds done without taking these steps may fail, or in 238 some cases may succeed and install broken OpenSSL libraries that 239 cause third-party software to link incorrectly and/or crash. 240 24120120507: 242 The database schema for makemandb was changed. You will 243 need to update the database using 'makemandb -f' or wait 244 for the next weekly run to fix it. 245 24620120319: 247 sys/conf/Makefile.kern.inc has been modified to adjust the 248 size of db_symtab automatically. You need to update dbsym in 249 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If 250 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your 251 mk.conf. 252 25320120216: 254 Default for MKCATPAGES changed to NO. Update builds will fail 255 unless DESTDIR is cleaned manually. If you built between 20120207 256 and 20120216, daily and weekly could have created an unreadable 257 /var/db/man.db index for apropos. Running makemandb -f or 258 the next run of weekly will fix it. 259 26020111227: 261 If you built between 20111225 and 20111227 you need to remove 262 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the 263 bump has been reverted. 264 26520111125: 266 The "rnd" pseudodevice has been added to sys/conf/std, which 267 means it should no longer be explicitly listed in kernel 268 configuration files. The line "pseudo-device rnd" should be 269 removed from any custom kernel config files users may have. 270 27120111119: 272 A problem with the datastructures used by the rndctl(8) 273 utility (pointers in datastructures in an array, making 32->64 274 bit compatibility very painful) has been fixed in a 275 non-backwards-compatible way. If you replace your kernel, 276 replace your rndctl executable too. 277 27820111001: 279 the prop_*_send_syscall() functions from proplib(3) have been 280 changed and their new version is not backward compatible with the old 281 one. So ensure that all consumers of these functions (currently: 282 quota2 code and its tests) are updated together with the new lib. 283 28420110817: 285 sparc has been changed to use GCC 4.5.3, so any objdir or 286 DESTDIR for them should be deleted before updating. 287 28820110806: 289 i386 and amd64 have been changed to use GCC 4.5.3, so any 290 objdir or DESTDIR for them should be deleted before updating. 291 29220110805: 293 The update to GCC 4.5.3 requires a non-trivial portion of 294 the tree to be cleaned. Best to delete both objdir and 295 DESTDIR before running this update. So far, only the 296 sparc64, mips and powerpc platforms have changed. 297 29820110803: 299 The layout of external/public-domain/xz has changed. To do an 300 update build you will have to remove the contents of the OBJDIR 301 for external/public-domain/xz/bin by hand as the xz entry there 302 is now a directory. 303 30420110410: 305 The configuration of src/tools/gcc has changed. To do an 306 update build you have to clean both tools/binutils and 307 tools/gcc by hand. 308 30920110328: 310 Building the Xorg binary was moved into a subdirectory to fix 311 ordering issues with "make all". It may be necessary to remove 312 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86 313 if your update build fails, as the "Xorg" entry there is now a 314 directory. 315 31620110121: 317 Assembler files no longer use -traditional-cpp. This can break 318 the build of individual parts of the tree. This is handled 319 correctly by build.sh. Manual builds have to update /usr/share/mk 320 and re-run config(1) for any kernel configurations as needed. 321 32220101217: 323 The tcpdump(8) program was changed to drop privileges and chroot(2) 324 by default. It may be necessary to manually update passwd(5) and 325 group(5) in order to make the program work with existing setups. 326 32720101125: 328 The latest changes to setenv(3) dissallow setting environment 329 variables with names that contain '='. Revision 1.18 of env.c 330 assumed that this was allowed. Installing a new libc with an 331 old copy of /usr/bin/env causes env x=1 printenv | grep x= to 332 break which affects the autoconf tests for dependency finding, 333 so building gcc will end up printing: 334 checking dependency style of gcc... none 335 configure: error: no usable dependency style found 336 Fix it by rebuilding and re-installing env. 337 33820101119: 339 Recent Xorg updates in xsrc/external/mit/ may cause various build 340 or run-time problems. Delete your entire DESTDIR and OBJDIR if you 341 have any build problems with xsrc, or problems with mismatched 342 versions between xorg-server and drivers. 343 34420100604: 345 The update of ATF to 0.9 causes old tests written in shell to fail 346 unless they are rebuilt. If you are building with MKUPDATE=yes, 347 you need to clean the src/external/bsd/atf/tests/ and the src/tests/ 348 trees by hand. 349 35020100522: 351 Recent Xorg updates in xsrc/external/mit/ will cause various build 352 problems. Delete your entire DESTDIR and OBJDIR if you have any 353 build problems with xsrc. 354 35520100522: 356 private section of <ctype.h> was splitted, and now mklocale(1) 357 include ctype_local.h, so you have to make cleandir in tools/mklocale. 358 35920100520: 360 The location of the xkb compiled descriptions has changed. Please 361 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR. 362 36320100222: 364 The shared objects file extension has been changed from .so to 365 .pico, in order to avoid conflicts with shared libraries names 366 libXX.so. All now stale regular .so files can be removed from 367 your object directories. 368 36920100204: 370 The termcap database has been removed from the sources, 371 but has not been marked obsolete so it is not removed 372 from the system when upgrading. 373 As such, you will need to remove them from your object 374 and destination directories. 375 37620091101: 377 After updating, it may be necessary to make the 'cleandir' 378 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a 379 'build.sh -u tools' or 'build.sh -u distribution'. Ditto 380 src/tools/lex/ and src/usr.bin/lex/. 381 38220091001: 383 On amd64 you must rebuild tools (to get the new binutils) 384 before building a kernel, or the build fails on cpufunc.S. 385 38620091001: 387 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb 388 symlink, failing the build. Delete the link, and the subdir 389 it is in, and retry your build. 390 39120090718: 392 libc build changed so that strchr() provides the extra entry 393 point for index(). Update build of libc.a (and libc_pic.a) 394 may fail because the archive contains the unwanted index.o. 395 (Similarly for strrchr() and rindex().) 396 39720090709: 398 Native Xorg was upgraded again. Builds will probably fail again 399 without a clean objdir, at least for src/external/mit/xorg. 400 40120090616: 402 Native Xorg was upgraded. Builds will need a clean objdir for 403 src/external/mit/xorg. Upgrading a system from sets will not 404 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc 405 subdirectory has been changed into a file, and this needs to 406 be manually "rm -r"'ed before installing xbase.tgz. 407 40820090501: 409 Several new functions were added to string.h/libc, and this 410 can cause autoconf problems during the tool build for people 411 who fail to clean out their tools objects properly. If you 412 note messages about stpcpy, stpncpy or strnlen accompanying a 413 failure during the tool build, clean out all your tools 414 objects and start again. 415 41620090325: 417 The i386 port was switched to i486 default toolchain. This requires 418 cleaning your src/tools directory and $TOOLDIR and rebuilding them. 419 42020090126: 421 The __posix_fadvise50 system call changed assembly stub type. You 422 need to 'rm -f __posix_fadvise50.*' in the libc build directory 423 to avoid using the old assembly stub. 424 42520090202: 426 pkg_install now depends on the pkgdb cache for automatic conflict 427 detection. It is recommented to rebuild the cache with 428 ``pkg_admin rebuild''. 429 43020090110: 431 time_t and dev_t have been bumped to 64 bit quantities. To upgrade: 432 1. Make sure your kernel has COMPAT_50 in it. Build and install. 433 This is needed even in the MODULAR kernel because there is 434 conditionally compiled code in rtsock.c. 435 2. make sure build.sh completes and the binaries in a chroot work 436 before installing. 437 3. If you don't use build.sh and you build directly to root, and 438 your build breaks in the middle, don't despair. Make sure headers 439 are installed properly, and start building libraries first libc 440 and libutil, install them and then continue building all the 441 libraries in src/lib and src/gnu/lib and install them. Once 442 the new libraries are installed, you can restart the build. 443 4. If you compile packages and you notice link time warnings, 444 rebuild the required packages to update their shared libraries. 445 Any package you rebuild will require rebuilding all the packages 446 that depend on it. 447 5. Next time you run pwd_mkdb with the new binary, the file 448 will be upgraded and it will not be backwards compatible. 449 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see 450 lastlogx(5)) have been versioned, and there is a heuristic 451 for utmp. You are better off removing the old files after 452 upgrading. The automated clearing of /var/run during 453 boot, and the automated rotating of files in /var/log by 454 newsyslog(8), may mean that you do not have to remove the 455 files manually. 456 7. The optional accounting file (/var/account/acct, see 457 accton(8)) has not been versioned, and will need to be 458 removed. The automatic rotation of the accounting file by 459 /etc/daily limits the bad consequences of failure to remove 460 the file. 461 8. Application software that writes time_t to binary files on 462 disk will break or need attention. Most notably: if you are 463 using PostgreSQL < 8.4, you need to dump your databases, 464 rebuild PostgreSQL with the new time_t, then restore. 465 46620081219: 467 config(1) has been updated, and one of the files it creates - 468 swapnetbsd.o - has changed format. You need to rebuild config 469 (done automatically by build.sh) and then you need to rerun 470 config on all kernel configuration files before rebuilding those 471 kernels. 472 47320081205: 474 If you build with MKX11=no, you should remove /etc/rc.d/xdm and 475 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc 476 set and will appear as extra files for MKX11=no update builds. 477 47820081122: 479 On i386, various kernel options(4) in GENERIC including 480 file systems have been disabled and moved into kernel modules. 481 Before trying a new GENERIC kernel, you have to prepare the 482 following files as well as a new GENERIC kernel: 483 484 - build and install kernel modules from src/sys/modules 485 486 - install the latest bootloader, which will load a module 487 for the file system from which the kernel is loaded automatically 488 489 If you have to load your kernel from a file system which is not of 490 the same type as the root file system, you have to load the necessary 491 file system module manually on the boot prompt or in the boot.cfg file. 492 49320080827: 494 If you built and installed a libc from sources between 495 2008/08/20 and 2008/08/26 you got a broken strtouq(3) 496 which results in false errors reported by lint(1). 497 Since this breaks the libc build itself, manual help is 498 needed -- lint must be disabled temporarily, e.g.: 499 $ (cd lib/libc && make MKLINT=no dependall install) 500 50120080813: 502 MKDEBUG build was broken because the .depend files did not know 503 about .go files. You need to remove all .depend files and rebuild. 504 50520080802: 506 A regression in binary compatibility for pthread_mutex_t has 507 been fixed. Unfortunately, the price is breaking compatibility 508 for -current. 509 510 Threaded programs (using libpthread) and C++ programs (using 511 libstdc++) compiled after 20070907 and before 20080802 need to 512 be recompiled. 513 514 One way to find affected pkgsrc packages: 515 516 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO 517 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO 518 51920080731: 520 WAPBL (metadata journaling support) has been added, but at this 521 time isn't backwards compatible with pre-WAPBL aware kernels 522 and userland (fsck_ffs in particular). Please make sure you 523 don't use a journaled filesystem with an older kernel/userland, 524 especially an uncleanly mounted journaled filesystem. WAPBL 525 also requires the super block to be in the UFS2 format. You 526 can use fsck_ffs -c 4 to update the superblock format. 527 52820080721: 529 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR 530 isn't defined. 531 53220080531: 533 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 534 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8) 535 utility needs to be rebuilt and reinstalled as older binaries 536 won't work correctly. The following sequence of commands: 537 538 $ (cd sys/sys/ && nbmake-$arch includes) 539 $ (cd sbin/drvctl/ && nbmake-$arch clean) 540 $ (cd sbin/drvctl/ && nbmake-$arch all) 541 542 leaves new drvctl utility in sbin/drvctl build directory. 543 54420080503: 545 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE. 546 54720080521: 548 For a while, unprivileged UPDATE builds would fail to 549 succeed at the checkflist stage, complaining that 550 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this 551 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9. 552 If you already hit this problem, update the .mk file, 553 remove ${DESTDIR}/stand/<arch>, and re-run the build. 554 55520080303: 556 Linker warnings are now fatal if $WARNS>0. 557 55820080126: 559 The posix_fadvise system call has been changed from an assembly 560 stub, to a c file that calls an assembly stub. You need to 561 'rm -f posix_fadvise.* .depend' in the libc build directory to 562 avoid using the old assembly stub. 563 56420071209: 565 The acpiec(4) driver has been split into two attachments. If you 566 get ACPI errors before the attachment, please update your kernel 567 configuration file appropriately or see GENERIC for more details. 568 56920071115: 570 The it(4) driver has been renamed to itesio(4) and the old port 571 argument specified in the kernel configuration file is not valid 572 anymore. The itesio(4) driver now uses the Super I/O address port 573 rather than the EC address port. Please update your kernel 574 configuration file appropriately or see GENERIC for more details. 575 57620071028: 577 The pccons(4) driver has been removed from the NetBSD/shark port. 578 You need to update any custom kernel configuration file you have 579 to remove any references to pccons (which includes removing the 580 now useless XSERVER option) and replace them with the correct 581 entries for the wscons driver. See the GENERIC configuration file 582 for more details. 583 58420070913: 585 A latent bug in dhclient/dhcpd that caused it to be unable to 586 enumerate interfaces was fixed. The bug began to cause 587 problems after 20070911 when the kernel's SIOCGIFCONF 588 implementation was repaired. From 20070529 to 20070911 racoon 589 could not enumerate interfaces. (These are noted because 590 normal kernel/userspace version matching hygiene is not 591 sufficient to avoid this problem.) Ensure that both kernel 592 and userland are from after 20070913. 593 59420070703: 595 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It 596 calls the target-specific strip program, and the logic to pass 597 down STRIP from make has been removed. This requires a 598 re-installation of tools. 599 60020070422: 601 The way OS emulations lookup filenames inside the emulation root 602 has been changed. Rather than modify the pathname (and copy back 603 to userspace) namei() and lookup() directly check the emulation 604 root. One side effect is that absolute symlinks inside the emulated 605 root file system will be relative to that file system - unless they 606 start /../ this is useful when the emulated root is a real install 607 that has such links. 608 This might affect symlinks that have been added to reference outside 609 the emulated root. 610 61120070412: 612 The pckbc driver on sgimips IP32 has been removed. Use macekbc 613 instead. See the GENERIC32_IP3x kernel configuration for an 614 example. 615 61620070319: 617 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so 618 on many platforms due to incorrect flags settings. If you 619 updated and built after about 20070315, do "nbmake-$arch 620 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a 621 rebuild of object files that might have been built 622 incorrectly, and ensure that you have at least 623 src/lib/libc/Makefile 1.130. 624 62520070210: 626 src/sys/sys/{sa.h,savar.h} were removed. 627 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \ 628 | xargs egrep -l '/sa.h|/savar.h' | xargs rm 629 will allow dependencies on those files to get get rebuilt 630 63120070209: 632 The threading model was changed when the newlock2 branch 633 was merged to NetBSD-current. If you boot with a new 634 kernel (version 4.99.10), then you also need a new pthread 635 library (/usr/lib/libpthread.so.0.7). If you boot with 636 an old kernel, then you need the old pthread library 637 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and 638 the pthread library in sync, old threaded applications should 639 continue to work with an old or new kernel. Note that named(8) 640 is the only threaded application in the base system. 641 64220061214: 643 Following the move of string_to_flags() and flags_to_string() 644 from the bin/ls/ sources to libutil, users doing UPDATE builds 645 will need to do a "make cleandir" in 646 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/, 647 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/, 648 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well 649 as the installation images in distrib/ 650 in order to excise stale references to the old stat_flags.h header 651 file in the ls sources -- stat_flags.h has been removed. 652 65320061108: 654 The configure script used in the src/tools/gcc compiler has been 655 changed to indicate that our libc has ssp support built-in and 656 does not depend on -lssp and -lssp-nonshared. You'll need to 657 make clean in src/tools/gcc first to rebuild the compiler. 658 65920061009: 660 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer 661 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead. 662 66320060814: 664 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been 665 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC 666 kernel configuration for an example. X servers from the last 667 few years should cope. 668 66920060703: 670 MPACPI is no more. We always configure PCI interrupts using ACPI 671 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed 672 to ACPI_SCANPCI. Thanks to work from fvdl. 673 67420060627: 675 socket(2) has changed, and its system call has been versioned. 676 For userlands with the old version of socket(2), make sure that 677 your kernel has 'options COMPAT_30' set, or else 'bad system call' 678 errors will result. 679 680Hints for a more successful build: 681^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 682 Use build.sh, but do not use its "expert mode": 683 This will automatically build the tools in the 684 correct order, and it will keep the tools and the 685 new build products from interfering with the running 686 system. This will allow you to ignore most of the 687 other advice in this file. 688 Build a new kernel first: 689 This makes sure that any new system calls or features 690 expected by the new userland will be present. This 691 helps to avoid critical errors when upgrading. 692 Use object directories: 693 This helps to keep stale object 694 files from polluting the build if a Makefile "forgets" 695 about one. It also makes it easier to clean up after 696 a build. It's also necessary if you want to use the 697 same source tree for multiple machines. 698 To use object directories with build.sh: 699 a) invoke build.sh with the "-M" or "-O" options. 700 To use object directories without using build.sh: 701 a) cd /usr/src ; make cleandir 702 b) Add "OBJMACHINE=yes" to /etc/mk.conf 703 c) Add "MKOBJDIRS=yes" to /etc/mk.conf 704 d) cd /usr/src ; make build 705 Note that running "make obj" in a directory will create 706 in obj.$MACHINE directory. 707 Build to a DESTDIR: 708 This helps to keep old installed files (especially libraries) 709 from interfering with the new build. 710 To build to a DESTDIR with build.sh, use the "-D" option. 711 To build to a DESTDIR without using build.sh, set the DESTDIR 712 environment variable before running make build. It should be 713 set to the pathname of an initially empty directory. 714 Problems: if you do not use build.sh, you might need to 715 update critical utilities without using DESTDIR since 716 nothing is executed from what is installed in DESTDIR. 717 (See critical utils, below.) 718 Build often: 719 This keeps critical utilities current enough to not choke 720 on any other part of the source tree that depends on up to 721 date functionality. If you use build.sh, you should not have 722 this problem. 723 724What to do if things don't work: 725^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 726When things don't work there are usually a few things that commonly 727should be done. 728 1) make includes 729 This should be done automatically by make build. 730 2) cd share/mk && make install 731 Again, automatically done by make build. 732 733Failsafe rebuild of a small part of the tree: 734^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 735To make sure you rebuild something correctly you want to do 736something like the following: 737 1) Make sure the includes and .mk files are up to date. 738 2) Make sure any program used to build the particular 739 utility is up to date. (yacc, lex, etc...) 740 3) cd ...path/to/util... 741 make cleandir 742 rm ...all obj directories... 743 make cleandir # yes, again 744 make obj 745 make depend && make 746 747Failsafe rebuild of the entire tree: 748^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 749If you really want to make sure the source tree is clean and 750ready for a build try the following. Note that sourcing /etc/mk.conf 751(a make(1) Makefile) in this manner is not right, and will not work 752for anyone who uses any make(1) features in /etc/mk.conf. 753 754---cut here--- 755#!/bin/sh 756. /etc/mk.conf 757 758if [ -z $NETBSDSRCDIR ] ; then 759 NETBSDSRCDIR=/usr/src 760fi 761if [ \! -d $NETBSDSRCDIR ] ; then 762 echo Unable to find sources 763 exit 1 764fi 765find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 766 767if [ -z $BSDOBJDIR ] ; then 768 BSDOBJDIR=/usr/obj 769fi 770if [ -d $BSDOBJDIR ] ; then 771 rm -rf $BSDOBJDIR 772fi 773 774cd $NETBSDSRCDIR && make cleandir 775 776---cut here--- 777 778Critical utilities: 779^^^^^^^^^^^^^^^^^^^ 780 usr.bin/compile_et 781 usr.bin/make 782 usr.bin/yacc 783 usr.bin/lex 784 usr.bin/xlint 785 usr.bin/config 786 787Other problems and possible solutions: 788^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 789Symptom:Complaints involving a Makefile. 790Fix: Rebuild usr.bin/make: 791 cd usr.bin/make && make && make install 792 Or, a failsafe method if that doesn't work: 793 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 794 795Fix: Make sure .mk files are up to date. 796 cd share/mk && make install 797 798Symptom:Kernel `config' fails to configure any kernel, including GENERIC. 799Fix: Rebuild usr.bin/config 800 801Symptom: 802Fix: Rebuild usr.bin/yacc 803 804Symptom: 805Fix: Rebuild usr.bin/lex 806 807Symptom: 808Fix: rm /usr/lib/libbfd.a 809 810Symptom:Obsolete intermediate files are used during compilation 811Fix: Try the following sequence of commands in the directory in question. 812 make cleandir; rm `make print-objdir`; make cleandir; make obj 813 (If you built the tree without "make obj" in the past, obsolete files 814 may remain. The command tries to clean everything up) 815 816Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible 817 pointer type 818Fix: Rebuild and install usr.bin/menuc 819 820Symptom:mklocale not found during build in share/locale/ctype 821Fix: Build and install usr.bin/mklocale 822 823Symptom:undefined reference to `__assert13' or `__unsetenv13' 824Fix: Rebuild and install lib/libc 825 826Symptom:usr.bin/config fails to build. 827Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 828 829Symptom:undefined reference to `getprogname' or `setprogname' 830Fix: Rebuild and install lib/libc 831 832Symptom:lint does not understand the '-X' option 833Fix: May need to build & install libs with NOLINT=1 before rebuilding lint 834 835Symptom:Update build fails in src/tools/gcc complaining that a variable 836 (e.g. CPPFLAGS) has changed since the previous run. 837Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build. 838 839Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...: 840 No such file or directory. 841Cause: If a directory is created by mistake, then it is sometimes 842 deleted from the CVS repository using administrative commands 843 that bypass the normal cvs access controls. If your cvs working tree 844 contains references to a directory that has been deleted on the 845 server in this way, then "cvs update" reports this error. 846Fix: Recursively delete the affected directory from your working tree 847 and try the update again. 848