UPDATING revision 1.339
1 $NetBSD: UPDATING,v 1.339 2023/06/04 16:14:59 martin Exp $ 2 3 This file (UPDATING) is intended to be a brief reference to recent 4 changes that might cause problems in the build process, and a guide for 5 what to do if something doesn't work. 6 7 For a more detailed description of the recommended way to build NetBSD 8 using build.sh, see the BUILDING file. 9 10 Note that much of the advice in this UPDATING file was written before 11 build.sh existed. Nevertheless, the advice here may be useful for 12 working around specific problems with build.sh. 13 14 Sections are marked with "^^^^^". After the section on "Recent changes" 15 are several sections containing more general information. 16 17 See also: BUILDING, build.sh, Makefile. 18 19 Recent changes: 20 ^^^^^^^^^^^^^^^ 21 22 20230604: 23 Building native kernels with the installed make(1) instead of 24 the $TOOLDIR/bin/nbmake-${arch} wrapper will fail if userland 25 has not been updated. Note that this is an unsupported build 26 configuration (but usually works if userland is -current enough). 27 28 20230523: 29 ctfmerge was fixed as macOS host tool. This may require a clean tools 30 rebuild to detect the update to tools/compat/configure. 31 32 20230322: 33 Fixes for moved /lib/libisns* mean that builds will complain about 34 ./usr/lib/libisns* being missing until src/lib/libisns is forced 35 to (re)install the files, including the symlinks. The simplest 36 way is to clean this subdir before building. 37 38 20230112: 39 New binutils require an updated ld.elf_so. If you are doing 40 (unsupported) in-place self builds (with the -E flag to build.sh), 41 make sure to have installed latest ld.elf_so before you rebuild 42 userland. 43 44 20221116: 45 The addition to NetBSD's version of UFS2 of support for extended 46 attributes broke backward compatibility with previous releases 47 of NetBSD, so UFS2 has been restored to being compatible with 48 previous NetBSD releases by disabling extended attributes. 49 (Note that ACLs are implemented as extended attributes, so 50 this changes disables ACLs as well.) 51 52 Support for UFS2 with extended attributes is now available in a new 53 UFS variant called UFS2ea. If you have created extended attributes 54 in an original UFS2 file system then "fsck -p" will now fail due to 55 the unexpected presence of extended attributes and "fsck -y" will 56 remove all extended attributes. If you wish to preserve extended 57 attributes rather than delete them, there is a utility to convert 58 a UFS2 file system to UFS2ea and leave extended attributes in place, 59 but this should be used with caution since it will preserve any 60 extended attributes that have been corrupted by the backward 61 incompatibility too. 62 63 If you wish to use a UFS2ea file system as your root file system, 64 then you will need to update your boot loader to a version that 65 supports UFS2ea. 66 67 For more information, see: 68 https://wiki.netbsd.org/features/UFS2ea 69 70 20221111: 71 The new libdrm import worsened the conflict issues for the 72 kdump/ktruss ioctl, and i915 now conflicts with base, and has 73 been turned off. This will cause update build issues like: 74 75 kdump-ioctl.c:12175:143: error: 'DRM_IOCTL_I915_DESTROY_HEAP' 76 undeclared here (not in a function); 77 did you mean 'DRM_IOCTL_MODE_DESTROY_DUMB'? 78 79 You'll need to clean usr.bin/ktruss, usr.bin/kdump, and rescue. 80 81 20220921: 82 Since the kernel version was bumped to 9.99.100, the bootloader 83 must be updated on x86 or EFI boot platforms in order to load 84 modules from boot.cfg(5) or interactively at the bootloader 85 prompt. 86 87 The kernel can still load modules at runtime, with modload(8) 88 or modules.conf(5), with no bootloader update. This will not 89 affect release branches because it only applies to patch 90 numbers >=100. 91 92 On x86 (i386 or amd64) with BIOS boot, this requires copying a 93 new /usr/mdec/boot to /boot. You can build this in the destdir 94 by running `$TOOLDIR/bin/nbmake-$ARCH dependall install' in 95 sys/arch/i386/stand. 96 97 On platforms with EFI boot (including x86 with EFI boot), this 98 requires copying a new /usr/mdec/boot*.efi to the EFI/BOOT/ 99 directory on the EFI system partition. The boot*.efi file is: 100 101 aarch64 bootaa64.efi 102 amd64 bootx64.efi 103 arm bootarm.efi (32-bit arm) 104 i386 bootx32.efi 105 106 You can build this in the destdir by running 107 `$TOOLDIR/bin/nbmake-$ARCH dependall install' in 108 sys/stand/efiboot/boot*. 109 110 20220821: 111 Support for building extsrc/ has been deprecated. 112 EXTSRCSRCDIR and MKEXTSRC have been deprecated. 113 114 20220714: 115 Updates to xorg-server and associated drivers may cause builds to 116 fail. Cleaning both DESTDIR and the xorg build tree may be needed. 117 118 20220628: 119 Changes in the build of src/games/robots require a clean build 120 of that program. 121 122 20211116: 123 Changes in the xorg build require clean obj dirs for external/mit/xorg 124 (or a full clean/non-update build). 125 126 20211112: 127 Device tree sources were updated for evbarm. Some device nodes 128 (in particular, ld(4) devices on the ROCKPro64) will be renumbered. 129 130 20211014: 131 MKPIE default for aarch64 has changed, a clean build is required. 132 133 20210917: 134 Changed MNT_ACLS to default to POSIX1e ACLs instead of NFSv4 135 ACLs, to be compatible with FreeBSD. If you are using NFSv4 ACLs 136 and have "acls" in /etc/fstab you'll need to change it to "nfs4acls". 137 138 20210711: 139 Updated GMP sources may require cleaning in tools/gmp and/or in 140 external/lgpl3/gmp/lib, particularly if GCC itself does not build. 141 142 20210417: 143 GCC 10 was enabled for several platforms. If builds fail in either 144 tools/gcc or external/gpl/gcc, first try cleaning those objects and 145 removing the $DESTDIR/usr/include/g++ subdirectory. 146 147 20201230: 148 lint1/ops.c is no longer autogenerated. If this makes the build 149 fail, clean $OBJDIR/tools/*lint* and $OBJDIR/usr.bin/*xlint*. 150 151 20201016: 152 MIPS kernel modules have been disabled until they work. This will 153 turn up in extra files in the DESTDIR, which should be cleaned. 154 155 20200925: 156 GNU MPC and MPFR have been updated. At least MPFR needs cleaning 157 in both the tools and external dirs. 158 159 20200912: 160 GCC 9 has arrived for Arm and x86 platforms, and will be coming 161 for several more, as will binutils 2.34. Clean as required. 162 163 20200907: 164 GCC 9 is coming, and binutils has been updated for MIPS. This 165 probably requires cleaning the tools/binutils. 166 167 20200811: 168 GCC updates may require cleaning the objdir. This may occur 169 due to GCC 7.5 update, GCC 8.4 move to gcc.old, or the upcoming 170 GCC 9 upgrade. 171 172 20200614: 173 blacklist* has been renamed to blocklist*. postinstall(8) 174 should handle the migration. 175 176 20200601: 177 Due to a mistake in LIBISPRIVATE handling, .so libraries were 178 created in the build directories and need cleaning. 179 180 20200311: 181 GCC 8 ports will need cleaning in src/tools/gcc and 182 src/external/gpl3/gcc due to GCC 8.4 update. 183 184 20191118: 185 More architectures were switched to gcc8: 186 i386, ia64 powerpc64, sparc, sparc64, arm 187 The same comments as in 20191022 apply. 188 189 20191112: 190 The LLVM update requires a clean rebuild for all architectures using 191 LLVM during the tools build phase (i386, amd64, aarch64). 192 193 20191022: 194 Ports amd64 and aarch64 switched to GCC 8.3 by default. 195 In-place ("expert mode", build.sh -E) builds are not supported 196 when going from a GCC 7 userland to GCC 8. Do a regular 197 build to a different DESTDIR (or preferably: build.sh -U) at least 198 once and install sets, or download comp.{tar.xz,tgz} from the 199 daily builds and install that before doing the next in-place build. 200 201 20191001: 202 GCC 8.3 was imported. Builds of src/tools/gcc may fail if 203 old builds with GCC 7 output now uses GCC 8. Clean this 204 directory, and also clean src/external/gpl3/gcc. 205 206 20190903: 207 Files with names that coincide with existing files' names on 208 case-insensitive file systems were inadvertently committed, for 209 radeon GPU firmware. We cannot mark these as obsolete for 210 postinstall to fix, so if you updated src since 2019-08-26, and 211 ran build.sh distribution or ran build.sh release, you must 212 manually delete the following files in your DESTDIR (which is 213 usually $OBJDIR/destir.$ARCH), or from / if you have installed 214 them: 215 216 /libdata/firmware/radeon/bonaire_ce.bin 217 /libdata/firmware/radeon/bonaire_mc.bin 218 /libdata/firmware/radeon/bonaire_me.bin 219 /libdata/firmware/radeon/bonaire_mec.bin 220 /libdata/firmware/radeon/bonaire_pfp.bin 221 /libdata/firmware/radeon/bonaire_rlc.bin 222 /libdata/firmware/radeon/bonaire_sdma.bin 223 /libdata/firmware/radeon/bonaire_smc.bin 224 /libdata/firmware/radeon/bonaire_uvd.bin 225 /libdata/firmware/radeon/hainan_ce.bin 226 /libdata/firmware/radeon/hainan_mc.bin 227 /libdata/firmware/radeon/hainan_me.bin 228 /libdata/firmware/radeon/hainan_pfp.bin 229 /libdata/firmware/radeon/hainan_rlc.bin 230 /libdata/firmware/radeon/hainan_smc.bin 231 /libdata/firmware/radeon/hawaii_ce.bin 232 /libdata/firmware/radeon/hawaii_mc.bin 233 /libdata/firmware/radeon/hawaii_me.bin 234 /libdata/firmware/radeon/hawaii_mec.bin 235 /libdata/firmware/radeon/hawaii_pfp.bin 236 /libdata/firmware/radeon/hawaii_rlc.bin 237 /libdata/firmware/radeon/hawaii_sdma.bin 238 /libdata/firmware/radeon/hawaii_smc.bin 239 /libdata/firmware/radeon/kabini_ce.bin 240 /libdata/firmware/radeon/kabini_me.bin 241 /libdata/firmware/radeon/kabini_mec.bin 242 /libdata/firmware/radeon/kabini_pfp.bin 243 /libdata/firmware/radeon/kabini_rlc.bin 244 /libdata/firmware/radeon/kabini_sdma.bin 245 /libdata/firmware/radeon/kaveri_ce.bin 246 /libdata/firmware/radeon/kaveri_me.bin 247 /libdata/firmware/radeon/kaveri_mec.bin 248 /libdata/firmware/radeon/kaveri_mec2.bin 249 /libdata/firmware/radeon/kaveri_pfp.bin 250 /libdata/firmware/radeon/kaveri_rlc.bin 251 /libdata/firmware/radeon/kaveri_sdma.bin 252 /libdata/firmware/radeon/mullins_ce.bin 253 /libdata/firmware/radeon/mullins_me.bin 254 /libdata/firmware/radeon/mullins_mec.bin 255 /libdata/firmware/radeon/mullins_pfp.bin 256 /libdata/firmware/radeon/mullins_rlc.bin 257 /libdata/firmware/radeon/mullins_sdma.bin 258 /libdata/firmware/radeon/oland_ce.bin 259 /libdata/firmware/radeon/oland_mc.bin 260 /libdata/firmware/radeon/oland_me.bin 261 /libdata/firmware/radeon/oland_pfp.bin 262 /libdata/firmware/radeon/oland_rlc.bin 263 /libdata/firmware/radeon/oland_smc.bin 264 /libdata/firmware/radeon/pitcairn_ce.bin 265 /libdata/firmware/radeon/pitcairn_mc.bin 266 /libdata/firmware/radeon/pitcairn_me.bin 267 /libdata/firmware/radeon/pitcairn_pfp.bin 268 /libdata/firmware/radeon/pitcairn_rlc.bin 269 /libdata/firmware/radeon/pitcairn_smc.bin 270 /libdata/firmware/radeon/tahiti_ce.bin 271 /libdata/firmware/radeon/tahiti_mc.bin 272 /libdata/firmware/radeon/tahiti_me.bin 273 /libdata/firmware/radeon/tahiti_pfp.bin 274 /libdata/firmware/radeon/tahiti_rlc.bin 275 /libdata/firmware/radeon/tahiti_smc.bin 276 /libdata/firmware/radeon/verde_ce.bin 277 /libdata/firmware/radeon/verde_mc.bin 278 /libdata/firmware/radeon/verde_me.bin 279 /libdata/firmware/radeon/verde_pfp.bin 280 /libdata/firmware/radeon/verde_rlc.bin 281 /libdata/firmware/radeon/verde_smc.bin 282 283 We will re-import these radeon firmware images another way 284 later. 285 286 20190727: 287 The uefi bootloader has gained tftp support and needs a clean 288 build. If you do update builds, manually clean its object 289 directory by something like: 290 cd sys/arch/i386/stand/efiboot && make clean 291 292 20190723: 293 The jemalloc allocator in libc is now build without extended 294 debugging (for performance reasons). In update builds make sure 295 to rebuild it completely, by removing all affected object files, 296 including compat builds, something like: 297 cd /usr/obj && find . -type d -name jemalloc|xargs rm -rf 298 299 20190207: 300 GCC 7 switched for many ports. Update builds are likely to fail. 301 302 20180924: 303 A newer OpenSSL version has been imported. If you are doing 304 update builds, make sure to remove all old obj dirs, like: 305 cd /usr/obj && find . -type d -name openssl | xargs rm -rf 306 307 20180717: 308 On aarch64 int64_t and related types have changed from long long 309 to long. This requires recompiling all C++ binaries. 310 311 20180713: 312 On amd64 and i386 static binaries are now build position 313 independend. This requires recompilation of all object 314 files used to create the crunched /rescue binary. 315 Clean the rescue directory in your obj directory before 316 doing an update build, otherwise linking will fail. 317 318 20180414: 319 Existing binutils was migrated to binutils.old. Manual 320 removal of tools/binutils objects directory may be required 321 to fix tools build failure. 322 323 20180311: 324 bdftopcf was updated and may need cleaning in the 325 src/external/mit/xorg/tools/bdftopcf subdirectory if there are 326 link errors. 327 328 20180212: 329 between OpenSSL and GCC updates, many things may fail to build. 330 any failure that looks like GCC or openssl is best handled by 331 a clean destdir and objdir. Full cleandir and destdir deletion 332 is recommended if build failures occur. 333 334 20171225: 335 removal of the vadvise syscall requires manual removal of all 336 associated files from the libc build object directory (including 337 the .depend files) - a command like: 338 cd $OBJ && find . -type d -name libc | xargs rm -rf 339 For architectures that support multiple "compat" binary targets, 340 you'll need to cleanup both the regular libc directory and the 341 compat ones (the above command will do that). 342 343 20171010: 344 a change to the build structure of external/bsd/acpica/bin/iasl 345 means that its objdir (or *.d and .depend at least) might need 346 to be manually removed - or a build done once without -u. 347 348 20170822: 349 a new version of GMP has been imported and probably 350 will break parts of builds related to themselves or GCC, both 351 in the tools and the native section. Remove all GCC, GMP, MPFR 352 and MPC objdirs or build once without -u. 353 354 20170816: 355 a new version of MPFR and MPC have been imported and probably 356 will break parts of builds related to themselves or GCC, both 357 in the tools and the native section. Remove all GCC, GMP, MPFR 358 and MPC objdirs or build once without -u. 359 360 20170402: 361 a new version of dhcpcd has been imported, which does not support 362 update builds from the previous version. Remove your 363 external/bsd/dhcpcd object dir or build once without -u. 364 365 20170211: 366 a new terminfo database has been imported. 367 The structure of it has changed slightly from prior versions and 368 an updated tic tool is required. 369 If you build.sh, don't use -u 370 371 20170207: 372 various arch dependent libc/exect.S files were removed 373 Either remove the obj directories (lib/libc and compat/amd64/i386/lib 374 if it exists) or do a clean build. 375 (This is a bug in the make system, it should be corrected without 376 human intervention, but isn't.) 377 378 20170104: 379 xinput build options have changed. 380 Remove the obj directory (external/mit/xorg/bin/xinput) 381 if you build.sh -u 382 383 20170103: 384 a new version of flex has been imported. 385 Remove the file from obj (external/bsd/flex) 386 if you build.sh -u 387 388 20161014: 389 a new version of OpenSSL has been imported. 390 Remove the files from obj (crypto/external/bsd/openssl) 391 if you build.sh -u 392 393 20161009: 394 a new version of dhcpcd has been imported with slightly changed 395 build infrastructure. When doing a build.sh -u this requires 396 pruning the external/bsd/dhcpcd objdir. 397 398 20160914: 399 i386, amd64, shark, ofppc and macppc have joined shark and x68k 400 ports in using xorg-server 1.18. This requires a clean destdir 401 and a clean objdir. 402 403 20160527: 404 i386 needs a full cleandir or objdir deletion because PIE has 405 been enabled. (see the amd64 entry two down for further info) 406 407 20160418: 408 libedit needs manual removal of all autogenerated files since 409 some of them are not autogenerated anymore. Remember that there 410 might be two copies of libedit if your platform builds "compat". 411 412 20160410: 413 amd64 needs full "make cleandir" or deletion of objdir now that 414 PIE has been enabled for amd64. PIE, or position-independent 415 executables, means all code, including executables and not just 416 shared libraries, is position-independent and hence able to be 417 relocated by ASLR, address space layout randomization. 418 419 The change was made in Makefile variables for compiler and 420 linker flags, for which make(1) does not record dependencies, 421 hence it is unable to detect that all .o files need rebuilding. 422 423 Partial rebuilds with some modified source files will likely 424 fail when linking executables, since the linker refuses to mix 425 position-independent code with position-dependent code in 426 position-independent executables: 427 428 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC 429 430 20160401: 431 Ports switching to GCC 5.3 will need a full "make cleandir". 432 Some people have found that cleandir is not sufficient, so if 433 in doubt delete the entire object directory tree for gcc. 434 435 20160306: 436 NetBSD's regexp implementation is now part of libnbcompat. 437 Nblex, nbm4, nbpax, nbsed use it and they may crash on 438 non-NetBSD hosts if linked with stale object files produced 439 while they included a non-NetBSD regex.h. 440 In any case, you should "make cleandir" at least these tools 441 before updating your toolchain. 442 443 20160125: 444 Dtrace has been enabled by default on some architectures. 445 When doing an update build, make sure to clean the etc/mtree 446 object directory before starting the build - otherwise the 447 needed directories in destdir will not be created. 448 An easy way to do this is: 449 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir 450 451 20150818: 452 New acpica requires "make cleandir" in src/external/bsd/acpica 453 again. 454 455 20150413: 456 New acpica requires "make cleandir" and reinstalling yacc 457 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and 458 also "make cleandir" in /usr/src/external/bsd/acpica. 459 460 20150404: 461 Lint changes require a full rebuild of the tool, so make 462 sure to build without -u option to build.sh, or manually 463 do a make cleandir in src/tools/lint1 and 464 src/usr.bin/xlint. 465 466 20150310: 467 Improvements to openssl for arm mean that update builds of 468 the openssl libraries will fail. A make cleandir in 469 external/bsd/openssl/lib is needed 470 471 20141026: 472 A mishap during the import of pppd may cause your corruption 473 in your cvs directory if you happened to do a cvs update 474 during a short period of time. To fix, just remove the 475 directory src/external/bsd/ppp/dist/pppd completely 476 and let cvs restore it on next update. 477 478 20140721: 479 The src/external/mit/lua/src directory was accidentally created 480 and then deleted in the CVS repository. If you get errors like 481 482 cvs [update aborted]: cannot open directory 483 /cvsroot/src/external/mit/lua/src: No such file or directory 484 485 then delete your local copy of that directory tree and try again. 486 487 20140530: 488 ARM eABI switched to DWARF based exception handling. This requires 489 rebuilding all C++ code. It is strongly advised to do a clean build. 490 491 20140131: 492 The new compiler_rt/libc integration moved a few things. It is strongly 493 advised to do a clean build. At least lib/libc, the compat version(s) 494 of libc, libkern, rump and the kernels need to be cleaned. 495 496 20131227: 497 1. The new ntpd runs in a restricted mode to prevent amplification 498 attacks. If you need ntpdc to work you need to explicitly enable 499 mode7 in your config file. Make sure you put the necessary restrict 500 statements to avoid being exposed. 501 2. strncat has moved from lib/libc to common/lib/libc; you might need 502 to make clean in libc 503 504 20131129: 505 The GMP sources were updated, and builds will likely fail without 506 cleaning their build trees for both tools and in-tree, like below. 507 508 20131128: 509 The MPC and MPFR sources were updated, and builds may require their 510 tools and in-tree directories cleaned for successful updates. 511 512 20130605: 513 The kernel option FAST_IPSEC no longer exists, it's been renamed 514 to IPSEC (and the older IPSEC version removed). 515 516 20130605: 517 Previous freetype installations erroneously installed private 518 header files. If you are building against a non-empty $DESTDIR, 519 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/. 520 521 20130531: 522 The xdm update may cause build failure due to xdm.man being 523 in the obj tree. Make sure to ensure any like this: 524 nbmake: nbmake: don't know how to make xdm.man. Stop 525 is fixed by deleting the xdm.man in the obj tree. 526 527 20130530: 528 Updates of many xsrc packages will leave old .pc files around. 529 Best to clean out the xsrc objdir entirely before rebuilds. 530 531 20130301: 532 The removal of netiso requires manual removal of /usr/include/netiso 533 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump} 534 535 20120726: 536 The update of OpenSSL requires cleaning both the OpenSSL build 537 directory and DESTDIR. *Even non-update builds require cleaning 538 DESTDIR.* Builds done without taking these steps may fail, or in 539 some cases may succeed and install broken OpenSSL libraries that 540 cause third-party software to link incorrectly and/or crash. 541 542 20120507: 543 The database schema for makemandb was changed. You will 544 need to update the database using 'makemandb -f' or wait 545 for the next weekly run to fix it. 546 547 20120319: 548 sys/conf/Makefile.kern.inc has been modified to adjust the 549 size of db_symtab automatically. You need to update dbsym in 550 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If 551 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your 552 mk.conf. 553 554 20120216: 555 Default for MKCATPAGES changed to NO. Update builds will fail 556 unless DESTDIR is cleaned manually. If you built between 20120207 557 and 20120216, daily and weekly could have created an unreadable 558 /var/db/man.db index for apropos. Running makemandb -f or 559 the next run of weekly will fix it. 560 561 20111227: 562 If you built between 20111225 and 20111227 you need to remove 563 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the 564 bump has been reverted. 565 566 20111125: 567 The "rnd" pseudodevice has been added to sys/conf/std, which 568 means it should no longer be explicitly listed in kernel 569 configuration files. The line "pseudo-device rnd" should be 570 removed from any custom kernel config files users may have. 571 572 20111119: 573 A problem with the datastructures used by the rndctl(8) 574 utility (pointers in datastructures in an array, making 32->64 575 bit compatibility very painful) has been fixed in a 576 non-backwards-compatible way. If you replace your kernel, 577 replace your rndctl executable too. 578 579 20111001: 580 the prop_*_send_syscall() functions from proplib(3) have been 581 changed and their new version is not backward compatible with the old 582 one. So ensure that all consumers of these functions (currently: 583 quota2 code and its tests) are updated together with the new lib. 584 585 20110817: 586 sparc has been changed to use GCC 4.5.3, so any objdir or 587 DESTDIR for them should be deleted before updating. 588 589 20110806: 590 i386 and amd64 have been changed to use GCC 4.5.3, so any 591 objdir or DESTDIR for them should be deleted before updating. 592 593 20110805: 594 The update to GCC 4.5.3 requires a non-trivial portion of 595 the tree to be cleaned. Best to delete both objdir and 596 DESTDIR before running this update. So far, only the 597 sparc64, mips and powerpc platforms have changed. 598 599 20110803: 600 The layout of external/public-domain/xz has changed. To do an 601 update build you will have to remove the contents of the OBJDIR 602 for external/public-domain/xz/bin by hand as the xz entry there 603 is now a directory. 604 605 20110410: 606 The configuration of src/tools/gcc has changed. To do an 607 update build you have to clean both tools/binutils and 608 tools/gcc by hand. 609 610 20110328: 611 Building the Xorg binary was moved into a subdirectory to fix 612 ordering issues with "make all". It may be necessary to remove 613 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86 614 if your update build fails, as the "Xorg" entry there is now a 615 directory. 616 617 20110121: 618 Assembler files no longer use -traditional-cpp. This can break 619 the build of individual parts of the tree. This is handled 620 correctly by build.sh. Manual builds have to update /usr/share/mk 621 and re-run config(1) for any kernel configurations as needed. 622 623 20101217: 624 The tcpdump(8) program was changed to drop privileges and chroot(2) 625 by default. It may be necessary to manually update passwd(5) and 626 group(5) in order to make the program work with existing setups. 627 628 20101125: 629 The latest changes to setenv(3) disallow setting environment 630 variables with names that contain '='. Revision 1.18 of env.c 631 assumed that this was allowed. Installing a new libc with an 632 old copy of /usr/bin/env causes env x=1 printenv | grep x= to 633 break which affects the autoconf tests for dependency finding, 634 so building gcc will end up printing: 635 checking dependency style of gcc... none 636 configure: error: no usable dependency style found 637 Fix it by rebuilding and re-installing env. 638 639 20101119: 640 Recent Xorg updates in xsrc/external/mit/ may cause various build 641 or run-time problems. Delete your entire DESTDIR and OBJDIR if you 642 have any build problems with xsrc, or problems with mismatched 643 versions between xorg-server and drivers. 644 645 20100604: 646 The update of ATF to 0.9 causes old tests written in shell to fail 647 unless they are rebuilt. If you are building with MKUPDATE=yes, 648 you need to clean the src/external/bsd/atf/tests/ and the src/tests/ 649 trees by hand. 650 651 20100522: 652 Recent Xorg updates in xsrc/external/mit/ will cause various build 653 problems. Delete your entire DESTDIR and OBJDIR if you have any 654 build problems with xsrc. 655 656 20100522: 657 private section of <ctype.h> was split, and now mklocale(1) 658 include ctype_local.h, so you have to make cleandir in tools/mklocale. 659 660 20100520: 661 The location of the xkb compiled descriptions has changed. Please 662 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR. 663 664 20100222: 665 The shared objects file extension has been changed from .so to 666 .pico, in order to avoid conflicts with shared libraries names 667 libXX.so. All now stale regular .so files can be removed from 668 your object directories. 669 670 20100204: 671 The termcap database has been removed from the sources, 672 but has not been marked obsolete so it is not removed 673 from the system when upgrading. 674 As such, you will need to remove them from your object 675 and destination directories. 676 677 20091101: 678 After updating, it may be necessary to make the 'cleandir' 679 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a 680 'build.sh -u tools' or 'build.sh -u distribution'. Ditto 681 src/tools/lex/ and src/usr.bin/lex/. 682 683 20091001: 684 On amd64 you must rebuild tools (to get the new binutils) 685 before building a kernel, or the build fails on cpufunc.S. 686 687 20091001: 688 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb 689 symlink, failing the build. Delete the link, and the subdir 690 it is in, and retry your build. 691 692 20090718: 693 libc build changed so that strchr() provides the extra entry 694 point for index(). Update build of libc.a (and libc_pic.a) 695 may fail because the archive contains the unwanted index.o. 696 (Similarly for strrchr() and rindex().) 697 698 20090709: 699 Native Xorg was upgraded again. Builds will probably fail again 700 without a clean objdir, at least for src/external/mit/xorg. 701 702 20090616: 703 Native Xorg was upgraded. Builds will need a clean objdir for 704 src/external/mit/xorg. Upgrading a system from sets will not 705 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc 706 subdirectory has been changed into a file, and this needs to 707 be manually "rm -r"'ed before installing xbase.tgz. 708 709 20090501: 710 Several new functions were added to string.h/libc, and this 711 can cause autoconf problems during the tool build for people 712 who fail to clean out their tools objects properly. If you 713 note messages about stpcpy, stpncpy or strnlen accompanying a 714 failure during the tool build, clean out all your tools 715 objects and start again. 716 717 20090325: 718 The i386 port was switched to i486 default toolchain. This requires 719 cleaning your src/tools directory and $TOOLDIR and rebuilding them. 720 721 20090126: 722 The __posix_fadvise50 system call changed assembly stub type. You 723 need to 'rm -f __posix_fadvise50.*' in the libc build directory 724 to avoid using the old assembly stub. 725 726 20090202: 727 pkg_install now depends on the pkgdb cache for automatic conflict 728 detection. It is recommended to rebuild the cache with 729 ``pkg_admin rebuild''. 730 731 20090110: 732 time_t and dev_t have been bumped to 64 bit quantities. To upgrade: 733 1. Make sure your kernel has COMPAT_50 in it. Build and install. 734 This is needed even in the MODULAR kernel because there is 735 conditionally compiled code in rtsock.c. 736 2. make sure build.sh completes and the binaries in a chroot work 737 before installing. 738 3. If you don't use build.sh and you build directly to root, and 739 your build breaks in the middle, don't despair. Make sure headers 740 are installed properly, and start building libraries first libc 741 and libutil, install them and then continue building all the 742 libraries in src/lib and src/gnu/lib and install them. Once 743 the new libraries are installed, you can restart the build. 744 4. If you compile packages and you notice link time warnings, 745 rebuild the required packages to update their shared libraries. 746 Any package you rebuild will require rebuilding all the packages 747 that depend on it. 748 5. Next time you run pwd_mkdb with the new binary, the file 749 will be upgraded and it will not be backwards compatible. 750 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see 751 lastlogx(5)) have been versioned, and there is a heuristic 752 for utmp. You are better off removing the old files after 753 upgrading. The automated clearing of /var/run during 754 boot, and the automated rotating of files in /var/log by 755 newsyslog(8), may mean that you do not have to remove the 756 files manually. 757 7. The optional accounting file (/var/account/acct, see 758 accton(8)) has not been versioned, and will need to be 759 removed. The automatic rotation of the accounting file by 760 /etc/daily limits the bad consequences of failure to remove 761 the file. 762 8. Application software that writes time_t to binary files on 763 disk will break or need attention. Most notably: if you are 764 using PostgreSQL < 8.4, you need to dump your databases, 765 rebuild PostgreSQL with the new time_t, then restore. 766 767 20081219: 768 config(1) has been updated, and one of the files it creates - 769 swapnetbsd.o - has changed format. You need to rebuild config 770 (done automatically by build.sh) and then you need to rerun 771 config on all kernel configuration files before rebuilding those 772 kernels. 773 774 20081205: 775 If you build with MKX11=no, you should remove /etc/rc.d/xdm and 776 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc 777 set and will appear as extra files for MKX11=no update builds. 778 779 20081122: 780 On i386, various kernel options(4) in GENERIC including 781 file systems have been disabled and moved into kernel modules. 782 Before trying a new GENERIC kernel, you have to prepare the 783 following files as well as a new GENERIC kernel: 784 785 - build and install kernel modules from src/sys/modules 786 787 - install the latest bootloader, which will load a module 788 for the file system from which the kernel is loaded automatically 789 790 If you have to load your kernel from a file system which is not of 791 the same type as the root file system, you have to load the necessary 792 file system module manually on the boot prompt or in the boot.cfg file. 793 794 20080827: 795 If you built and installed a libc from sources between 796 2008/08/20 and 2008/08/26 you got a broken strtouq(3) 797 which results in false errors reported by lint(1). 798 Since this breaks the libc build itself, manual help is 799 needed -- lint must be disabled temporarily, e.g.: 800 $ (cd lib/libc && make MKLINT=no dependall install) 801 802 20080813: 803 MKDEBUG build was broken because the .depend files did not know 804 about .go files. You need to remove all .depend files and rebuild. 805 806 20080802: 807 A regression in binary compatibility for pthread_mutex_t has 808 been fixed. Unfortunately, the price is breaking compatibility 809 for -current. 810 811 Threaded programs (using libpthread) and C++ programs (using 812 libstdc++) compiled after 20070907 and before 20080802 need to 813 be recompiled. 814 815 One way to find affected pkgsrc packages: 816 817 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO 818 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO 819 820 20080731: 821 WAPBL (metadata journaling support) has been added, but at this 822 time isn't backwards compatible with pre-WAPBL aware kernels 823 and userland (fsck_ffs in particular). Please make sure you 824 don't use a journaled filesystem with an older kernel/userland, 825 especially an uncleanly mounted journaled filesystem. WAPBL 826 also requires the super block to be in the UFS2 format. You 827 can use fsck_ffs -c 4 to update the superblock format. 828 829 20080721: 830 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR 831 isn't defined. 832 833 20080531: 834 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 835 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8) 836 utility needs to be rebuilt and reinstalled as older binaries 837 won't work correctly. The following sequence of commands: 838 839 $ (cd sys/sys/ && nbmake-$arch includes) 840 $ (cd sbin/drvctl/ && nbmake-$arch clean) 841 $ (cd sbin/drvctl/ && nbmake-$arch all) 842 843 leaves new drvctl utility in sbin/drvctl build directory. 844 845 20080503: 846 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE. 847 848 20080521: 849 For a while, unprivileged UPDATE builds would fail to 850 succeed at the checkflist stage, complaining that 851 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this 852 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9. 853 If you already hit this problem, update the .mk file, 854 remove ${DESTDIR}/stand/<arch>, and re-run the build. 855 856 20080303: 857 Linker warnings are now fatal if $WARNS>0. 858 859 20080126: 860 The posix_fadvise system call has been changed from an assembly 861 stub, to a c file that calls an assembly stub. You need to 862 'rm -f posix_fadvise.* .depend' in the libc build directory to 863 avoid using the old assembly stub. 864 865 20071209: 866 The acpiec(4) driver has been split into two attachments. If you 867 get ACPI errors before the attachment, please update your kernel 868 configuration file appropriately or see GENERIC for more details. 869 870 20071115: 871 The it(4) driver has been renamed to itesio(4) and the old port 872 argument specified in the kernel configuration file is not valid 873 anymore. The itesio(4) driver now uses the Super I/O address port 874 rather than the EC address port. Please update your kernel 875 configuration file appropriately or see GENERIC for more details. 876 877 20071028: 878 The pccons(4) driver has been removed from the NetBSD/shark port. 879 You need to update any custom kernel configuration file you have 880 to remove any references to pccons (which includes removing the 881 now useless XSERVER option) and replace them with the correct 882 entries for the wscons driver. See the GENERIC configuration file 883 for more details. 884 885 20070913: 886 A latent bug in dhclient/dhcpd that caused it to be unable to 887 enumerate interfaces was fixed. The bug began to cause 888 problems after 20070911 when the kernel's SIOCGIFCONF 889 implementation was repaired. From 20070529 to 20070911 racoon 890 could not enumerate interfaces. (These are noted because 891 normal kernel/userspace version matching hygiene is not 892 sufficient to avoid this problem.) Ensure that both kernel 893 and userland are from after 20070913. 894 895 20070703: 896 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It 897 calls the target-specific strip program, and the logic to pass 898 down STRIP from make has been removed. This requires a 899 re-installation of tools. 900 901 20070422: 902 The way OS emulations lookup filenames inside the emulation root 903 has been changed. Rather than modify the pathname (and copy back 904 to userspace) namei() and lookup() directly check the emulation 905 root. One side effect is that absolute symlinks inside the emulated 906 root file system will be relative to that file system - unless they 907 start /../ this is useful when the emulated root is a real install 908 that has such links. 909 This might affect symlinks that have been added to reference outside 910 the emulated root. 911 912 20070412: 913 The pckbc driver on sgimips IP32 has been removed. Use macekbc 914 instead. See the GENERIC32_IP3x kernel configuration for an 915 example. 916 917 20070319: 918 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so 919 on many platforms due to incorrect flags settings. If you 920 updated and built after about 20070315, do "nbmake-$arch 921 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a 922 rebuild of object files that might have been built 923 incorrectly, and ensure that you have at least 924 src/lib/libc/Makefile 1.130. 925 926 20070210: 927 src/sys/sys/{sa.h,savar.h} were removed. 928 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \ 929 | xargs egrep -l '/sa.h|/savar.h' | xargs rm 930 will allow dependencies on those files to get get rebuilt 931 932 20070209: 933 The threading model was changed when the newlock2 branch 934 was merged to NetBSD-current. If you boot with a new 935 kernel (version 4.99.10), then you also need a new pthread 936 library (/usr/lib/libpthread.so.0.7). If you boot with 937 an old kernel, then you need the old pthread library 938 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and 939 the pthread library in sync, old threaded applications should 940 continue to work with an old or new kernel. Note that named(8) 941 is the only threaded application in the base system. 942 943 20061214: 944 Following the move of string_to_flags() and flags_to_string() 945 from the bin/ls/ sources to libutil, users doing UPDATE builds 946 will need to do a "make cleandir" in 947 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/, 948 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/, 949 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well 950 as the installation images in distrib/ 951 in order to excise stale references to the old stat_flags.h header 952 file in the ls sources -- stat_flags.h has been removed. 953 954 20061108: 955 The configure script used in the src/tools/gcc compiler has been 956 changed to indicate that our libc has ssp support built-in and 957 does not depend on -lssp and -lssp-nonshared. You'll need to 958 make clean in src/tools/gcc first to rebuild the compiler. 959 960 20061009: 961 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer 962 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead. 963 964 20060814: 965 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been 966 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC 967 kernel configuration for an example. X servers from the last 968 few years should cope. 969 970 20060703: 971 MPACPI is no more. We always configure PCI interrupts using ACPI 972 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed 973 to ACPI_SCANPCI. Thanks to work from fvdl. 974 975 20060627: 976 socket(2) has changed, and its system call has been versioned. 977 For userlands with the old version of socket(2), make sure that 978 your kernel has 'options COMPAT_30' set, or else 'bad system call' 979 errors will result. 980 981 Hints for a more successful build: 982 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 983 Use build.sh, but do not use its "expert mode": 984 This will automatically build the tools in the 985 correct order, and it will keep the tools and the 986 new build products from interfering with the running 987 system. This will allow you to ignore most of the 988 other advice in this file. 989 Build a new kernel first: 990 This makes sure that any new system calls or features 991 expected by the new userland will be present. This 992 helps to avoid critical errors when upgrading. 993 Use object directories: 994 This helps to keep stale object 995 files from polluting the build if a Makefile "forgets" 996 about one. It also makes it easier to clean up after 997 a build. It's also necessary if you want to use the 998 same source tree for multiple machines. 999 To use object directories with build.sh: 1000 a) invoke build.sh with the "-M" or "-O" options. 1001 To use object directories without using build.sh: 1002 a) cd /usr/src ; make cleandir 1003 b) Add "OBJMACHINE=yes" to /etc/mk.conf 1004 c) Add "MKOBJDIRS=yes" to /etc/mk.conf 1005 d) cd /usr/src ; make build 1006 Note that running "make obj" in a directory will create 1007 in obj.$MACHINE directory. 1008 Build to a DESTDIR: 1009 This helps to keep old installed files (especially libraries) 1010 from interfering with the new build. 1011 To build to a DESTDIR with build.sh, use the "-D" option. 1012 To build to a DESTDIR without using build.sh, set the DESTDIR 1013 environment variable before running make build. It should be 1014 set to the pathname of an initially empty directory. 1015 Problems: if you do not use build.sh, you might need to 1016 update critical utilities without using DESTDIR since 1017 nothing is executed from what is installed in DESTDIR. 1018 (See critical utils, below.) 1019 Build often: 1020 This keeps critical utilities current enough to not choke 1021 on any other part of the source tree that depends on up to 1022 date functionality. If you use build.sh, you should not have 1023 this problem. 1024 1025 What to do if things don't work: 1026 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 1027 When things don't work there are usually a few things that commonly 1028 should be done. 1029 1) make includes 1030 This should be done automatically by make build. 1031 2) cd share/mk && make install 1032 Again, automatically done by make build. 1033 1034 Failsafe rebuild of a small part of the tree: 1035 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 1036 To make sure you rebuild something correctly you want to do 1037 something like the following: 1038 1) Make sure the includes and .mk files are up to date. 1039 2) Make sure any program used to build the particular 1040 utility is up to date. (yacc, lex, etc...) 1041 3) cd ...path/to/util... 1042 make cleandir 1043 rm ...all obj directories... 1044 make cleandir # yes, again 1045 make obj 1046 make depend && make 1047 1048 Failsafe rebuild of the entire tree: 1049 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 1050 If you really want to make sure the source tree is clean and 1051 ready for a build try the following. Note that sourcing /etc/mk.conf 1052 (a make(1) Makefile) in this manner is not right, and will not work 1053 for anyone who uses any make(1) features in /etc/mk.conf. 1054 1055 ---cut here--- 1056 #!/bin/sh 1057 . /etc/mk.conf 1058 1059 if [ -z $NETBSDSRCDIR ] ; then 1060 NETBSDSRCDIR=/usr/src 1061 fi 1062 if [ \! -d $NETBSDSRCDIR ] ; then 1063 echo Unable to find sources 1064 exit 1 1065 fi 1066 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 1067 1068 if [ -z $BSDOBJDIR ] ; then 1069 BSDOBJDIR=/usr/obj 1070 fi 1071 if [ -d $BSDOBJDIR ] ; then 1072 rm -rf $BSDOBJDIR 1073 fi 1074 1075 cd $NETBSDSRCDIR && make cleandir 1076 1077 ---cut here--- 1078 1079 Critical utilities: 1080 ^^^^^^^^^^^^^^^^^^^ 1081 usr.bin/compile_et 1082 usr.bin/make 1083 usr.bin/yacc 1084 usr.bin/lex 1085 usr.bin/xlint 1086 usr.bin/config 1087 1088 Other problems and possible solutions: 1089 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 1090 Symptom:Complaints involving a Makefile. 1091 Fix: Rebuild usr.bin/make: 1092 cd usr.bin/make && make && make install 1093 Or, a failsafe method if that doesn't work: 1094 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 1095 1096 Fix: Make sure .mk files are up to date. 1097 cd share/mk && make install 1098 1099 Symptom:Kernel `config' fails to configure any kernel, including GENERIC. 1100 Fix: Rebuild usr.bin/config 1101 1102 Symptom: 1103 Fix: Rebuild usr.bin/yacc 1104 1105 Symptom: 1106 Fix: Rebuild usr.bin/lex 1107 1108 Symptom: 1109 Fix: rm /usr/lib/libbfd.a 1110 1111 Symptom:Obsolete intermediate files are used during compilation 1112 Fix: Try the following sequence of commands in the directory in question. 1113 make cleandir; rm `make print-objdir`; make cleandir; make obj 1114 (If you built the tree without "make obj" in the past, obsolete files 1115 may remain. The command tries to clean everything up) 1116 1117 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible 1118 pointer type 1119 Fix: Rebuild and install usr.bin/menuc 1120 1121 Symptom:mklocale not found during build in share/locale/ctype 1122 Fix: Build and install usr.bin/mklocale 1123 1124 Symptom:undefined reference to `__assert13' or `__unsetenv13' 1125 Fix: Rebuild and install lib/libc 1126 1127 Symptom:usr.bin/config fails to build. 1128 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 1129 1130 Symptom:undefined reference to `getprogname' or `setprogname' 1131 Fix: Rebuild and install lib/libc 1132 1133 Symptom:lint does not understand the '-X' option 1134 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint 1135 1136 Symptom:Update build fails in src/tools/gcc complaining that a variable 1137 (e.g. CPPFLAGS) has changed since the previous run. 1138 Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build. 1139 1140 Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...: 1141 No such file or directory. 1142 Cause: If a directory is created by mistake, then it is sometimes 1143 deleted from the CVS repository using administrative commands 1144 that bypass the normal cvs access controls. If your cvs working tree 1145 contains references to a directory that has been deleted on the 1146 server in this way, then "cvs update" reports this error. 1147 Fix: Recursively delete the affected directory from your working tree 1148 and try the update again. 1149
Indexes created Sun Oct 12 09:09:55 GMT 2025