UPDATING revision 1.156
1$NetBSD: UPDATING,v 1.156 2006/12/15 14:18:38 he Exp $ 2 3This file (UPDATING) is intended to be a brief reference to recent 4changes that might cause problems in the build process, and a guide for 5what to do if something doesn't work. 6 7For a more detailed description of the recommended way to build NetBSD 8using build.sh, see the BUILDING file. 9 10Note that much of the advice in this UPDATING file was written before 11build.sh existed. Nevertheless, the advice here may be useful for 12working around specific problems with build.sh. 13 14See also: BUILDING, build.sh, Makefile. 15 16Recent changes: 17^^^^^^^^^^^^^^^ 18 1920061214: 20 Following the move of string_to_flags() and flags_to_string() 21 from the bin/ls/ sources to libutil, users doing UPDATE builds 22 will need to do a "make cleandir" in 23 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/, 24 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/, 25 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well 26 as the installation images in distrib/ 27 in order to excise stale references to the old stat_flags.h header 28 file in the ls sources -- stat_flags.h has been removed. 29 3020061108: 31 The configure script used in the src/tools/gcc compiler has been 32 changed to indicate that our libc has ssp support built-in and 33 does not depend on -lssp and -lssp-nonshared. You'll need to 34 make clean in src/tools/gcc first to rebuild the compiler. 35 3620061009: 37 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer 38 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead. 39 4020060814: 41 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been 42 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC 43 kernel configuration for an example. X servers from the last 44 few years should cope. 45 4620060703: 47 MPACPI is no more. We always configure PCI interrupts using ACPI 48 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed 49 to ACPI_SCANPCI. Thanks to work from fvdl. 50 5120060627: 52 socket(2) has changed, and its system call has been versioned. 53 For userlands with the old version of socket(2), make sure that 54 your kernel has 'options COMPAT_30' set, or else 'bad system call' 55 errors will result. 56 5720060526: 58 The kernel linker scripts for i386 and xen 59 (sys/arch/i386/conf/kern.ldscript*) were changed to set the 60 load address correctly, for the benefit of MULTIBOOT boot loaders 61 (like Grub). If you use a linker (ld) older than from 2006/04/17, it 62 will be unable to link the kernel because of a bug and ld will fail 63 with an error like: 64 ../../../../arch/i386/conf/kern.ldscript:45 \ 65 non constant expression for load base 66 You need to update at least src/gnu/dist/binutils/ld and recompile 67 and install the linker. If using the build.sh script, the easiest 68 way is with a "build.sh tools" command, with any other options 69 that you use normally. When using build.sh, the linker binary is 70 installed as ${TOOLDIR}/bin/i386--netbsdelf-ld. 71 7220060131: 73 the protocol between the sparc64 bootloader (ofwboot) and 74 the kernel was changed. Before installing a new kernel, 75 you need to update ofwboot. After a full build, just copy 76 /usr/mdec/ofwboot to /, or do a rebuild of 77 src/sys/arch/sparc/stand/ofwboot and install the result to /. 78 7920050917: 80 arch/*/conf/std.* was changed to include conf/std, which 81 contains MI options previously enabled by default. 82 If you have kernel config files which doesn't include 83 arch/*/conf/std.*, you need to edit them to include conf/std 84 to get the previous configuration. 85 8620050830: 87 named.conf was moved from /etc/namedb to /etc. 88 postinstall(8) migrates this during interactive use. 89 Users of MKUPDATE=yes will need to manually rectify 90 this in their DESTDIR. 91 9220050825: 93 Some data structures in sys/device.h, related to interface 94 attributes and locator names, were changed. config(1) was 95 modified to emit the new data structures. 96 Thus usr.bin/config must be updated (and run on the kernel 97 configuration file) before a new kernel can be built. 98 9920050531: 100 genassym.sh(8) was moved to genassym(1). You need to either build 101 tools first or install the version of genassym from /usr/bin before 102 you can build a kernel again. 103 10420050520: 105 Because a kernfs bug which xentools relies on was fixed, 106 xentools up to xentools20-2.0.3nb4 won't work with new kernel. 107 10820050417: 109 postinstall(8) was moved from /etc to /usr/sbin and made part 110 of the "base" set, to make it easier to invoke after an 111 upgrade. 112 11320050325: 114 pcppi(4) was separated in two devices, adding attimer(4). Be sure 115 to add a config line for an attimer(4) device in your kernel 116 configuration, or you won't be able to set the pitch of the beep 117 with wsconsctl. Depending on the default value for the pitch, you 118 might even not hear any more beep. Also, it is advised to attach both 119 devices the same way (i.e., both on isa or both on acpi) or the 120 pcppi(4) device may fail to find the attimer(4) one. 121 12220050211: 123 Fixes to tools/Makefile.gnuhost may cause UPDATE=1 builds in 124 some of the cross tools to fail if they use configure. Some configure's 125 cache the environment passed in and notice the new environment is 126 different and abort. Doing a clean in tools/ should be enough to 127 make a build continue. 128 12920050109: 130 Since su is using pam by default now, make sure that you have 131 /etc/pam.d populated (postinstall will do that automatically 132 for you). Otherwise su will fail open (i.e. will not require 133 a password). 134 13520041229: 136 Make had a path resolution bug that manifested itself as not 137 being able to install openpam.3. This bug has been fixed, but 138 you might need to rebuild make manually first to get through 139 the build. 140 14120041201: 142 Userland programs have been changed to use /dev/bpf instead of 143 /dev/bpfX. You need to create that device by installing a new 144 MAKEDEV and running it, or mv /dev/bpf0 /dev/bpf && rm /dev/bpf[0-9]* 145 14620041006: 147 148 A bug was introduced into /bin/sh (var.c rev 1.35) which causes 149 variables to not export correctly to subshells in all cases. This 150 will cause builds to break if that version of /bin/sh is installed 151 on the system. The proper version of /bin/sh can be verified with: 152 153 ident /bin/sh | grep var 154 155 Any /bin/sh w. version 1.35 will not work and needs to be updated 156 before attempting a build. 157 15820041001: 159 The ipfilter kernel sources moved from sys/netinet to 160 dist/sys/ipf/netinet. Due to the move some Makefile 161 dependencies are now dangling requiring a make cleandir 162 before they work again (kdump, ktruss, rescue, ipf, and 163 ftp-proxy are the victims). 164 16520040715: 166 The rc.d/sendmail script now uses a heuristic to determine 167 if sendmail should be started at boot time. It checks the 168 contents of /etc/mailer.conf, /etc/mail/submit.cf, and the 169 owner and mode of the sendmail binary to see if any changes 170 to the mail infrastructure have been made. If no changes 171 are detected, it will start an SMTP listener. 172 173 Setting sendmail=NO in /etc/rc.conf will override this. 174 175 If you are only using sendmail by default and only for 176 local delivery, it is important that you also update your 177 sendmail.cf so that the SMTP listener only listens on the 178 loopback interface. 179 18020040715: 181 The method by which athhal-elf.o gets pulled into i386 182 kernel builds has been changed again. The latest version 183 of bsd.files.mk is no longer required. 184 18520040621: 186 Due to the recent rototill of tools/compat it's crucial one starts 187 from a clean objdir under tools/*. 188 189 This is mostly due to generated files (yacc and lex sources) needing 190 to be generated with new rules from bsd.hostprog.mk. 191 192 The safest course is to rm -rf all objects under tools before building. 193 19420040516: 195 The end-user modifiable X11 configuration has been moved 196 from /usr/X11R6/lib/X11/<dir> to /etc/X11/<dir>. 197 Ensure that src and xsrc is up to date, and run 198 "make cleandir" in src/x11 before your next build. 199 200 postinstall currently doesn't migrate the files from 201 /usr/X11R6/lib/X11/* to /etc/X11/* although it does 202 detect that this needs to occur, so you'll have to 203 manually move these files yourself. 204 20520040426: 206 Support for the original dynamic sysctl node structure has 207 been removed in favor of the newer layout. This affects 208 consumers of the create and delete interface, as well as 209 the dynamic discovery mechanism. This is believed only to 210 be the sysctl(8) binary itself, at this point in time, so 211 the only effect of this should be that a sysctl binary 212 built from sources dated between 2003/12/04 and 2004/03/24 213 will not work on a kernel built from sources dated after 214 2004/04/25. If you need a new sysctl binary but build.sh 215 does not work, make sure that your revision of 216 src/sys/sys/sysctl.h is 1.112 (or later), and then the 217 do the following: 218 219 cd /usr/src (or wherever your source tree is) 220 make USETOOLS=no includes 221 cd lib/libc 222 make USETOOLS=no dependall install 223 cd ../../sbin/sysctl 224 make USETOOLS=no dependall install 225 226 If you are using older sysctl binary, GNU autoconf would fail to 227 identify your machine architecture, and tries to build binary for 228 "unknown-unknown-netbsd20F" or something like that. if that happens, 229 make sure to follow the above steps. 230 23120040425: 232 The ffs superblock issues listed below under 20040109 and 20030402 233 are now automatically addressed by the /etc/rc.d/fixsb script or by 234 sysinst when it checks a a filesystem. The manual fsck_ffs -b16 -c4 235 invocation mentioned below will continue to work and is now 236 automated by those scripts. Note that under certain circumstances, 237 affected filesystems upgraded to a -current kernel first before 238 upgrading their userland with the fixsb and fsck_ffs fixes may 239 encounter a 'freeing free inode' panic when writing to the affected 240 filesystem, so it is a good idea to repair the filesystem as soon as 241 possible. For more details on the fixsb script, see pr install/25138. 242 24320040418: 244 statfs(2) and friends have been replaced with statvfs(2). Before 245 installing a newly build userland make sure that you are running 246 a newly built kernel with COMPAT_20 set. In addition your libc 247 build might not work (undefined SYS_statfs symbol) because make 248 clean does not know how to remove files it does not know about 249 anymore. Manually remove all generated .S sources and objects 250 from the libc build directory. 251 25220040326: 253 The method by which athhal-elf.o gets pulled into i386 kernel builds 254 has been changed. The file is now stored as a uuencoded file in CVS 255 and the generated Makefile will use the new .uue rules from bsd.file.mk 256 to build it. 257 258 This means you must have the latest bsd.files.mk installed when 259 building a kernel without USETOOLS=yes. 260 26120040318: 262 A bug in the cgd(4) blowfish code was corrected, without 263 provision of backwards compatibility, after several public 264 notices over several months. Users of cgd with blowfish cipher 265 ONLY must dump their data before updating their kernels, and 266 recreate cgd's and restore data using the new kernel. See 267 (recent message to current-users, URL when mail-index has updated) 268 26920040313: 270 On acorn32, the opms and qms drivers have been withdrawn, and 271 the old wsqms driver is now called qms. Kernel config files 272 will need updating. See the ones in sys/arch/acorn32/conf 273 for examples. 274 27520040125: 276 On acorn32, the beep and sysbeep devices are no longer 277 needed, and will need to be deleted from kernel configuration 278 files. 279 28020040109: 281 Compatibility for old ffs superblock layouts has been 282 added, and the restrictive fsck checks have been reenabled 283 when using those layouts. If you have been using -current 284 since 20030402, you may find that fsck again signals fatal 285 superblock mismatches. To repair, make sure you have 286 an updated fsck_ffs and then you can use fsck_ffs -b 16 -c 4 287 to complete the filesystem upgrade. A message has 288 been added to the kernel which should detect this problem. 289 See the following discussion for more information: 290 http://mail-index.NetBSD.org/current-users/2004/01/11/0022.html 291 29220031203: 293 New binutils builds may fail due to old dependencies. 294 It's necessary to "make cleandir" to ensure that 295 the dependencies will be rebuilt correctly. 296 29720031111: 298 A newer mkdep is needed. Error noting that is 299 cc: Ambiguous abbreviation -- 300 30120031008: 302 /usr/include/sys/disklabel_mbr.h was removed. 303 It's necessary to "make cleandir" to ensure that 304 the dependencies will be rebuilt correctly. 305 30620031007: 307 A sign extension bug was fixed which set all the high bits 308 of our newly expanded ffs fs_flags. This should only 309 affect users who installed or upgraded in September of 2003. 310 A small utility program was posted to tech-kern which 311 should fix this problem, and a warning message was added 312 to the kernel which should discover and warn about it. See 313 http://mail-index.NetBSD.org/tech-kern/2003/10/07/0005.html 314 31520030906: 316 With the addition of siginfo support the old signal trampoline 317 code has been deprecated to COMPAT_16. Make sure that your running 318 kernel has COMPAT_16 enabled before building userland. 319 32020030801: 321 With the new openssl, there is some header and library shuffling. 322 rm -f /usr/include/des.h /usr/include/kerberosIV/* /lib/libdes* \ 323 /usr/lib/libdes* before building. 324 32520030703: 326 Texinfo was updated to 4.6. To avoid failures when trying to 327 build the included texinfo files, do: 328 329 cd src/gnu/usr.bin/texinfo 330 make MKINFO=no dependall install 331 33220030630: 333 Groff was updated to 1.19; it's probably necessary to do 334 cd share/mk && make install 335 cd src/gnu/usr.bin/groff 336 make MKMAN=no dependall install 337 (untested). 338 33920030516: 340 Due to bugs in the export handling code, invalid export lines 341 were accepted before and caused the kernel to panic when 342 mountd got restarted because it freed memory that had already 343 been freed. This has been fixed and the kernel checks 344 export addresses very strictly. If you upgrade your kernel, 345 make sure you also upgrade mountd, because if your export 346 file contains lines with an old inet4 address syntax (i.e. 347 a.b.c or a.b or a), they will get rejected by the new kernel. 348 34920030402: 350 The superblock layout for FFS was changed. If you have 1.6 351 fsck binaries, they will signal a fatal superblock mismatch 352 with the first alternate, because they compare too many 353 fields (even ones that aren't useful). If possible, upgrade 354 your fsck_ffs binary before using a new kernel. 355 None of this signals actual filesystem damage. 356 35720030324: 358 sendmail version 8.12.8 was imported. Since sendmail is 359 now setgid to the smmsp group, and runs in "collection" 360 mode for most common activities, there is a new config 361 file called submit.cf that needs to live in /etc/mail. 362 The generic submit.cf sample in /usr/share/sendmail/cf 363 is named netbsd-msp.cf. Upgrading your regular sendmail 364 configuration file is also strongly advised. 365 366 See the section named "MESSAGE SUBMISSION PROGRAM" in 367 the updated /usr/share/sendmail/README file for more 368 information. 369 37020030117: 371 Texinfo was updated to 4.3. To avoid failures when trying to 372 build the included texinfo files, do: 373 374 cd src/gnu/usr.bin/texinfo 375 make MKINFO=no dependall install 376 37720021223: 378 The METALOG format changed slightly, to remove the leading 379 "${DESTDIR}" from path names. 380 This only affects people building with UNPRIVED. 381 For complete safety, remove the DESTDIR entirely and 382 update tools/mtree, before running make build. 383 38420021219: 385 CVS repository layout was changed. See the following for details 386 if you are using (anonymous) cvs to update your tree. 387 388 http://mail-index.NetBSD.org/netbsd-announce/2002/12/19/0000.html 389 39020021219: 391 install(1) had a '-N dbdir' option added, to specify an 392 alternate location to look up users & groups (instead 393 of the host system passwd(5) and group(5) databases). 394 395 The build system was modified to take advantage of 396 this option (using ${NETBSDSRCDIR}/etc), so if you 397 use USETOOLS==no, you may have to rebuild and 398 reinstall usr.bin/xinstall first. 399 40020021130: 401 fparseln(3) moved from libutil to libc. 402 If building to DESTDIR=/, reinstall the includes 403 and rebuild libc: 404 make includes 405 make do-lib-libc 406 If using build.sh, "cd tools/compat && make clean" 407 before rebuilding the tools. 408 40920021126: 410 The mk.conf(5) variable SYS_INCLUDE has been deprecated, 411 including the optional "SYS_INCLUDE=symlinks" support. 412 All header files, including <sys/*.h> are copied into 413 /usr/include. 414 41520021121: 416 The C run-time support files crtbegin.o and crtend.o 417 (and their companions crtbeginS.o and crtendS.o) were 418 split up, with new crti.o and crtn.o files resulting. 419 This means that libtool needs to be rebuilt once the 420 new libraries are installed. The process of rebuilding 421 libtool will cause it to automatically notice the new 422 required files, but it *must* be rebuilt in order to 423 do this. 424 425 An out-of-date libtool will result in shared libraries 426 which lack _init() and _fini() routines, which means that 427 their global constructors/destructors will not be invoked. 428 42920021121: 430 A bug related to how ARM ELF objects were tagged has been 431 corrected. 432 433 NetBSD ARM ELF uses the soft-VFP floating point model by 434 default. However, the assembler lacked support for marking 435 objects as using the VFP floating point format, and the 436 compiler was not properly passing the flag indicating "soft-VFP" 437 to the assembler. 438 439 Unfortunately, this means that the linker will now consider 440 old (i.e. not marked "softvfp") NetBSD ARM ELF objects to be 441 incompatible with new (properly marked) objects. 442 443 The problem will only manifest itself if you attempt to compile 444 a new program using the fixed toolchain, and link that program 445 against old libraries which do not have the proper "softvfp" 446 markings. ALL OF YOUR EXISTING BINARIES AND SHARED LIBRARIES 447 WILL CONTINUE TO WORK PROPERLY. 448 449 The only work-around for the problem is to recompile all of 450 the libraries on the system. The easiest way to do this for 451 system libraries is to install a binary snapshot; they are 452 generally available on releng.NetBSD.org. Any packages you 453 have installed which supply libraries will have to be recompiled 454 if you wish to link new programs against those libraries. 455 456 If you have questions about this matter, please contact 457 port-arm@NetBSD.org. 458 45920021011: 460 Systrace has been improved to support privilege elevation. 461 Updating the kernel requires the userland part of systrace 462 to be rebuilt. 463 46420021010: 465 The config(8) grammar was changed to allow options to register 466 dependencies on attributes, as well as other options. Users 467 must update and reinstall usr.sbin/config before building a new 468 kernel. 469 47020021009: 471 A new attribute dependency syntax was introduced to config(8), 472 which is now used by the SCSI configuration description. Users 473 must update and reinstall usr.sbin/config before building a new 474 kernel. 475 47620021003: 477 Several changes have been made to the autoconfiguration 478 framework. Users must update and reinstall usr.sbin/config 479 before building a new kernel. 480 48120021001: 482 The i386mp branch has been merged. To compile a kernel, users 483 will need to add the option 'cpu* at mainbus?' to their configuration 484 file. Multiprocessor kernels will need 485 ioapic* at mainbus? apid ? 486 options MULTIPROCESSOR 487 options COM_MPLOCK 488 48920020922: 490 MKDYNAMICROOT=yes enabled by default, which means that 491 certain shared libraries are installed into /lib, the shared 492 linker is installed into /libexec, and all programs in /bin 493 and /sbin are dynamically linked. 494 If you do not use "make build", you should ensure that 495 you have the libraries and shared linker in the new locations, 496 with: 497 make do-lib-csu do-lib-libc do-lib do-gnu-lib do-ld.elf_so 498 49920020917: 500 USE_NEW_TOOLCHAIN has been replaced with: 501 - TOOLCHAIN_MISSING -- set to "yes" on platforms for which 502 there is no working in-tree toolchain (hppa, ns32k, sh5, 503 x86_64). 504 - EXTERNAL_TOOLCHAIN -- if defined by the user, points to the 505 root of an external toolchain (e.g. /usr/local/gnu). This 506 enables the cross-build framework even for TOOLCHAIN_MISSING 507 platforms. 508 50920020906: 510 gehenna-devsw has been merged into the trunk. Need to update and 511 reinstall usr.sbin/config before building the kernel. 512 51320020822: 514 Crunched rescue tools (contents of /bin and /sbin, plus others) 515 are now provided in /rescue. 516 517 To ensure that these are built statically linked (no matter 518 what the setting of LDSTATIC is), use a crunchgen(1) built 519 from sources newer than 20020820 (see the next entry). 520 52120020820: 522 crunchgen(1) changed to ensure that the generated program 523 is statically linked. 524 525 Solution: update and reinstall usr.bin/crunch 526 52720020605: 528 smmsp user/group has been added for sendmail. 529 530 Add the following into /etc/group: 531 532 smmsp:*:17: 533 534 and the following to /etc/master.passwd (via vipw): 535 536 smmsp:*:17:17::0:0:Sendmail Message Submission Program:/nonexistent:/sbin/nologin 537 53820020515: 539 sshd user/group has been added. Need to hand add this in, or sshd 540 will not let you log in (with default, or UsePrivilegeSeparation=yes) 541 542 Add the following into /etc/group: 543 544 sshd:*:16: 545 546 and the following to /etc/master.passwd (via vipw): 547 548 sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin 549 550 Also /var/chroot/sshd directory needs to be present (digged as part of 551 the build process). 552 55320020426: 554 NBUILDJOBS obsoleted in favor of just using -j. 555 55620020426: 557 etc/postinstall added, which performs various checks for 558 configuration file updates and changes, and can fix most of 559 the problems identified. 560 This should make it much easier to upgrade a system's 561 configuration from earlier systems (as far back as NetBSD 1.5). 562 56320020320: 564 <bsd.lib.mk> needs a new install(1) for its "-a cmd" support. 565 Build and install at usr.bin/xinstall before the build. 566 56720020319: 568 Raw IPv6 socket now makes strict checking for sa_family and sa_len 569 on send(2) operation. Be sure to have sbin/rtsol and usr.sbin/rtsold 570 newer than November 2001 when you upgrade the kernel. 571 57220020311: 573 ssh configuration files were moved from /etc to /etc/ssh. Beware 574 if you restart your machine from remote. Note that sshd.conf needs 575 to be changed (due to the use of "/etc" inside). 576 57720020223: 578 Users of the VAX port will need to rebuild and install gas 579 so it deal with the now present register prefix used in all 580 the VAX assembly files. 581 58220020118: 583 ntpd user/group has been added. Need to hand add this in or builds 584 will break as mtree aborts early. 585 586 Add the following into /etc/group: 587 588 ntpd:*:15: 589 590 and the following to /etc/master.passwd (via vipw): 591 592 ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin 593 59420011207: 595 If you're attempting to build a snapshot on sparc64 and are getting 596 reloc errors from the toolchain groff binary this means your native 597 toolchain has some broken C++ bits. 598 599 To fix: 600 601 Build a new toolchain (i.e. build.sh -t) 602 Use the new toolchain to build and install natively (i.e. /usr/lib) 603 604 gnu/lib/libgcc 605 gnu/lib/libstdc++ 606 607 After this a snapshot will be able to be built. 608 60920011201: 610 In order for a sparc64 build to work you must have a working awk. If 611 you've built and installed a system with the new toolchain up to this 612 point you do not have a working awk as its ability to do floating 613 point is broken. 614 615 To build: 616 617 remake and install gnu/lib/libgcc 618 remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links 619 against the new libgcc.a) 620 62120011128: 622 Kernel config information was changed to use defflag in 623 the various "files" files. Bug fixes to config(8) are 624 required in order for this to work properly. Make sure 625 to build and install in usr.sbin/config before attempting 626 to build a new kernel. 627 62820011030: 629 libc/locale/wcstod.c now needs new lint(1). Update lint(1) 630 before building libc. 631 63220011029: 633 The new document BUILDING.mdoc (view with nroff | more, or 634 see pre-generated .txt and .html versions) describes the build 635 procedure in great detail. BUILDING, and the USE_NEW_TOOLCHAIN 636 build process, are intended in the long run to replace this 637 manual update log. 638 639 Users building a USE_NEW_TOOLCHAIN system should read the 640 BUILDING document for caveats. Generally, BUILDING supersedes 641 UPDATING for these systems, as tool updating is taken care of 642 by the new build system. 643 64420011028: 645 src/etc/Makefile now needs install to be able to handle 646 symlinks that point to nowhere. A bug in install that 647 prevented this was corrected. 648 649 Solution: update and reinstall usr.bin/xinstall 650 Better Solution: Use the new toolchain and it will just work 651 for you. 652 65320011006: 654 /etc/mtree/NetBSD.dist has been updated to take advantage of 655 absolute path support added to mtree(8). Older mtree(8)s don't 656 understand the format. 657 658 Solution: update and reinstall usr.sbin/mtree 659 66020011004: 661 Crunchgen has been updated to work via reach-over makefiles. Updating 662 is suggested before running a snapshot build 663 66420010915: 665 The new "ubcperf" code committed by Chuck Silvers removed 666 a header file, uvm/uvm_vnode.h. There may be stale .depend 667 files that still reference this file. 668 669 Solution: "make cleandir && make dependall" in affected 670 directories. 671 67220010803: 673 grep.info is now built from grep.texi using makeinfo. Since it 674 requires makeinfo v4.0, you need to install new texinfo before 675 building gnu/usr.bin/grep. To install new texinfo, please follow 676 the instruction described in 20010726 entry. 677 67820010803: 679 (i386 only): i386 kernel now uses new instructions like 680 `fxsave' which old gas doesn't understand. To build the 681 kernel successfully, you need to build and install a new toolchain, 682 (i.e., build.sh -t) or (temporarily) comment out "options I686_CPU" 683 from your kernel configuration until you rebuild your userland. 684 See 20011029 above and BUILDING file in this directory for more information. 685 [updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled] 686 68720010731: 688 Bootloader update on ELF platforms. DDB in kernels from before 689 this will be unable to read symbol tables provided by newer 690 bootloaders. 691 69220010726: 693 Texinfo was updated to 4.0. To avoid failures when trying to 694 build the included texinfo files, do: 695 696 cd src/gnu/usr.bin/texinfo 697 make MKINFO=no dependall install 698 69920010718: 700 Enabled correct .init/.fini processing in crt0. The way this 701 was done was to change a -I directive to cc(1), which means 702 make(1) will have a stale dependency (it will be checking the 703 timestamp on the wrong "dot_init.h"). 704 705 The symptom you will see is that new programs die with SIGSEGV 706 if you have a stale dependency. 707 708 Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so 709 before starting your build. 710 71120010628: 712 A construct was added to uvm_page.h that uncovered a bug 713 in lint(1). If you get a warning/error about a non-portable 714 bitfield, update your lint(1) before proceeding. 715 71620010226: 717 Added named user/group to system. Need to hand add this in or builds 718 will break as mtree aborts early. 719 720 To work around add by hand: 721 722 named:*:14: 723 724 to /etc/group and add: 725 726 named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin 727 728 to master.passwd (use vipw for instance if doing by hand). 729 730 Now a make build should progress. 731 73220010219: 733 get/setprogname() added. Any hostprogs that may use this will need 734 to be bootstrapped manually until the host system is current. 735 736 Known problems: sys/arch/macppc/stand/fixcoff 737 usr.sbin/config (adding -DMAKE_BOOTSTRAP to 738 CFLAGS and rebuilding should work) 739 usr.sbin/mdsetimage - Build a static copy if 740 building a snapshot before fully bootstrapped. 741 74220010204: 743 prepare the code to compile with stricter gcc flags. in 744 particular start eliminating redundant declarations. Yacc 745 needs to be installed before make build. 746 74720010114: 748 introduce .if commands(target) in make(1). You need to 749 bring everything up-to-date first, then without installing 750 anything make and install in usr.bin/make, then proceed 751 with make build. 752 75320010101: 754 bsd.subdir.mk committed 20001230 had a bug which caused 755 afterinstall targets to run too soon; update again. 756 75720001230: 758 New share/mk files needed to support .WAIT in SUBDIR variables. 759 If you get make errors, 760 (cd share/mk; make install) 761 Also, PRINTOBJDIR has changed and is now used more heavily. 762 76320001019: 764 The `ca' device driver has been replaced by `ld'; although the 765 major and minor numbers haven't changed, you should update your /dev 766 directory. 767 76820000929: 769 The following make directives are obsoleted. 770 MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA 771 By default, RSA is built into libcrypto. IDEA and RC5 will not be 772 built into libcrypto. By using MKCRYPTO_{RC5,IDEA}, you can build 773 additional library libcrypto_{idea,rc5}. 774 775 776Hints for a more successful build: 777^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 778 Use build.sh, but do not use its "expert mode": 779 This will automatically build the tools in the 780 correct order, and it will keep the tools and the 781 new build products from interfering with the running 782 system. This will allow you to ignore most of the 783 other advice in this file. 784 Build a new kernel first: 785 This makes sure that any new system calls or features 786 expected by the new userland will be present. This 787 helps to avoid critical errors when upgrading. 788 Use object directories: 789 This helps to keep stale object 790 files from polluting the build if a Makefile "forgets" 791 about one. It also makes it easier to clean up after 792 a build. It's also necessary if you want to use the 793 same source tree for multiple machines. 794 To use object directories with build.sh: 795 a) invoke build.sh with the "-M" or "-O" options. 796 To use object directories without using build.sh: 797 a) cd /usr/src ; make cleandir 798 b) Add "OBJMACHINE=yes" to /etc/mk.conf 799 c) Add "MKOBJDIRS=yes" to /etc/mk.conf 800 d) cd /usr/src ; make build 801 Note that running "make obj" in a directory will create 802 in obj.$MACHINE directory. 803 Build to a DESTDIR: 804 This helps to keep old installed files (especially libraries) 805 from interfering with the new build. 806 To build to a DESTDIR with build.sh, use the "-D" option. 807 To build to a DESTDIR without using build.sh, set the DESTDIR 808 environment variable before running make build. It should be 809 set to the pathname of an initially empty directory. 810 Problems: if you do not use build.sh, you might need to 811 update critical utilities without using DESTDIR since 812 nothing is executed from what is installed in DESTDIR. 813 (See critical utils, below.) 814 Build often: 815 This keeps critical utilities current enough to not choke 816 on any other part of the source tree that depends on up to 817 date functionality. If you use build.sh, you should not have 818 this problem. 819 820What to do if things don't work: 821^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 822When things don't work there is usually a few things that commonly 823should be done. 824 1) make includes 825 This should be done automatically by make build. 826 2) cd share/mk && make install 827 Again, automatically done by make build. 828 829Failsafe rebuild of a small part of the tree: 830^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 831To make sure you rebuild something correctly you want to do 832something like the following: 833 1) Make sure the includes and .mk files are up to date. 834 2) Make sure any program used to build the particular 835 utility is up to date. (yacc, lex, etc...) 836 3) cd ...path/to/util... 837 make cleandir 838 rm ...all obj directories... 839 make cleandir # yes, again 840 make obj 841 make depend && make 842 843Failsafe rebuild of the entire tree: 844^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 845If you really want to make sure the source tree is clean and 846ready for a build try the following. Note that sourcing /etc/mk.conf 847(a make(1) Makefile) in this manner is not right, and will not work 848for anyone who uses any make(1) features in /etc/mk.conf. 849 850---cut here--- 851#!/bin/sh 852. /etc/mk.conf 853 854if [ -z $NETBSDSRCDIR ] ; then 855 NETBSDSRCDIR=/usr/src 856fi 857if [ \! -d $NETBSDSRCDIR ] ; then 858 echo Unable to find sources 859 exit 1 860fi 861find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 862 863if [ -z $BSDOBJDIR ] ; then 864 BSDOBJDIR=/usr/obj 865fi 866if [ -d $BSDOBJDIR ] ; then 867 rm -rf $BSDOBJDIR 868fi 869 870cd $NETBSDSRCDIR && make cleandir 871 872---cut here--- 873 874Critical utilities: 875^^^^^^^^^^^^^^^^^^^ 876 usr.bin/compile_et 877 usr.bin/make 878 usr.bin/yacc 879 usr.bin/lex 880 usr.bin/xlint 881 usr.bin/config 882 883Other problems and possible solutions: 884^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 885Symptom:Complaints involving a Makefile. 886Fix: Rebuild usr.bin/make: 887 cd usr.bin/make && make && make install 888 Or, a failsafe method if that doesn't work: 889 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 890 891Fix: Make sure .mk files are up to date. 892 cd share/mk && make install 893 894Symptom:Kernel `config' fails to configure any kernel, including GENERIC. 895Fix: Rebuild usr.bin/config 896 897Symptom: 898Fix: Rebuild usr.bin/yacc 899 900Symptom: 901Fix: Rebuild usr.bin/lex 902 903Symptom: 904Fix: rm /usr/lib/libbfd.a 905 906Symptom:Obsolete intermediate files are used during compilation 907Fix: Try the following sequence of commands in the directory in question. 908 make cleandir; rm `make print-objdir`; make cleandir; make obj 909 (If you built the tree without "make obj" in the past, obsolete files 910 may remain. The command tries to clean everything up) 911 912Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type 913Fix: Rebuild and install usr.bin/menuc 914 915Symptom:mklocale not found during build in share/locale/ctype 916Fix: Build and install usr.bin/mklocale 917 918Symptom:undefined reference to `__assert13' or `__unsetenv13' 919Fix: Rebuild and install lib/libc 920 921Symptom:usr.bin/config fails to build. 922Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 923 924Symptom:undefined reference to `getprogname' or `setprogname' 925Fix: Rebuild and install lib/libc 926 927Symptom:lint does not understand the '-X' option 928Fix: May need to build & install libs with NOLINT=1 before rebuilding lint 929