UPDATING revision 1.124
11.124Sjmc$NetBSD: UPDATING,v 1.124 2004/06/22 01:29:51 jmc Exp $ 21.1Sabs 31.123SjmcThis file (UPDATING) is intended to be a brief reference to recent 41.123Sjmcchanges that might cause problems in the build process, and a guide for 51.123Sjmcwhat to do if something doesn't work. 61.1Sabs 71.123SjmcFor a more detailed description of the recommended way to build NetBSD 81.123Sjmcusing build.sh, see the BUILDING file. 91.123Sjmc 101.123SjmcNote that much of the advice in this UPDATING file was written before 111.123Sjmcbuild.sh existed. Nevertheless, the advice here may be useful for 121.123Sjmcworking around specific problems with build.sh. 131.123Sjmc 141.123SjmcSee also: BUILDING, build.sh, Makefile. 151.1Sabs 161.1SabsRecent changes: 171.1Sabs^^^^^^^^^^^^^^^ 181.99Smrg 191.124Sjmc20040621: 201.124Sjmc 211.124Sjmc Due to the recent rototill of tools/compat it's crucial one starts 221.124Sjmc from a clean objdir under tools/*. 231.124Sjmc 241.124Sjmc This is mostly due to generated files (yacc and lex sources) needing 251.124Sjmc to be generated w. new rules from bsd.hostprog.mk. 261.124Sjmc 271.124Sjmc The safest course is to rm -rf all objects under tools before building. 281.124Sjmc 291.121Slukem20040516: 301.121Slukem The end-user modifiable X11 configuration has been moved 311.121Slukem from /usr/X11R6/lib/X11/<dir> to /etc/X11/<dir>. 321.121Slukem Ensure that src and xsrc is up to date, and run 331.121Slukem "make cleandir" in src/x11 before your next build. 341.121Slukem 351.119Satatat20040426: 361.119Satatat Support for the original dynamic sysctl node structure has 371.119Satatat been removed in favor of the newer layout. This affects 381.119Satatat consumers of the create and delete interface, as well as 391.119Satatat the dynamic discovery mechanism. This is believed only to 401.119Satatat be the sysctl(8) binary itself, at this point in time, so 411.119Satatat the only effect of this should be that a sysctl binary 421.119Satatat built from sources dated between 2003/12/04 and 2004/03/24 431.119Satatat will not work on a kernel built from sources dated after 441.119Satatat 2004/04/25. If you need a new sysctl binary but build.sh 451.119Satatat does not work, make sure that your revision of 461.120Satatat src/sys/sys/sysctl.h is 1.112 (or later), and then the 471.120Satatat do the following: 481.119Satatat 491.120Satatat cd /usr/src (or wherever your source tree is) 501.120Satatat make USETOOLS=no includes 511.120Satatat cd lib/libc 521.120Satatat make USETOOLS=no dependall install 531.120Satatat cd ../../sbin/sysctl 541.119Satatat make USETOOLS=no dependall install 551.119Satatat 561.122Sitojun If you are using older sysctl binary, GNU autoconf would fail to 571.122Sitojun identify your machine architecture, and tries to build binary for 581.122Sitojun "unknown-unknown-netbsd20F" or something like that. if that happens, 591.122Sitojun make sure to follow the above steps. 601.122Sitojun 611.118Sdbj20040425: 621.118Sdbj The ffs superblock issues listed below under 20040109 and 20030402 631.118Sdbj are now automatically addressed by the /etc/rc.d/fixsb script or by 641.118Sdbj sysinst when it checks a a filesystem. The manual fsck_ffs -b16 -c4 651.118Sdbj invocation mentioned below will continue to work and is now 661.118Sdbj automated by those scripts. Note that under certain circumstances, 671.118Sdbj affected filesystems upgraded to a -current kernel first before 681.118Sdbj upgrading their userland with the fixsb and fsck_ffs fixes may 691.118Sdbj encounter a 'freeing free inode' panic when writing to the affected 701.118Sdbj filesystem, so it is a good idea to repair the filesystem as soon as 711.118Sdbj possible. For more details on the fixsb script, see pr install/25138. 721.118Sdbj 731.115Schristos20040418: 741.121Slukem statfs(2) and friends have been replaced with statvfs(2). Before 751.115Schristos installing a newly build userland make sure that you are running 761.115Schristos a newly built kernel with COMPAT_20 set. In addition your libc 771.115Schristos build might not work (undefined SYS_statfs symbol) because make 781.115Schristos clean does not know how to remove files it does not know about 791.116Schristos anymore. Manually remove all generated .S sources and objects 801.116Schristos from the libc build directory. 811.115Schristos 821.114Sjmc20040326: 831.114Sjmc The method by which athhal-elf.o gets pulled into i386 kernel builds 841.117Sjmc has been changed. The file is now stored as a uuencoded file in CVS 851.114Sjmc and the generated Makefile will use the new .uue rules from bsd.file.mk 861.114Sjmc to build it. 871.114Sjmc 881.114Sjmc This means you must have the latest bsd.files.mk installed when 891.114Sjmc building a kernel without USETOOLS=yes. 901.114Sjmc 911.113Sdan20040318: 921.113Sdan A bug in the cgd(4) blowfish code was corrected, without 931.113Sdan provision of backwards compatibility, after several public 941.113Sdan notices over several months. Users of cgd with blowfish cipher 951.113Sdan ONLY must dump their data before updating their kernels, and 961.113Sdan recreate cgd's and restore data using the new kernel. See 971.113Sdan (recent message to current-users, URL when mail-index has updated) 981.113Sdan 991.108Sbjh2120040313: 1001.108Sbjh21 On acorn32, the opms and qms drivers have been withdrawn, and 1011.108Sbjh21 the old wsqms driver is now called qms. Kernel config files 1021.108Sbjh21 will need updating. See the ones in sys/arch/acorn32/conf 1031.108Sbjh21 for examples. 1041.108Sbjh21 1051.106Sbjh2120040125: 1061.106Sbjh21 On acorn32, the beep and sysbeep devices are no longer 1071.106Sbjh21 needed, and will need to be deleted from kernel configuration 1081.106Sbjh21 files. 1091.105Sbjh21 1101.102Sdbj20040109: 1111.102Sdbj Compatibility for old ffs superblock layouts has been 1121.102Sdbj added, and the restrictive fsck checks have been reenabled 1131.102Sdbj when using those layouts. If you have been using -current 1141.102Sdbj since 20030402, you may find that fsck again signals fatal 1151.110Sdbj superblock mismatches. To repair, make sure you have 1161.111Ssimonb an updated fsck_ffs and then you can use fsck_ffs -b 16 -c 4 1171.109Sdbj to complete the filesystem upgrade. A message has 1181.111Ssimonb been added to the kernel which should detect this problem. 1191.111Ssimonb See the following discussion for more information: 1201.112Skeihan http://mail-index.NetBSD.org/current-users/2004/01/11/0022.html 1211.102Sdbj 1221.99Smrg20031203: 1231.100Skeihan New binutils builds may fail due to old dependencies. 1241.99Smrg It's necessary to "make cleandir" to ensure that 1251.99Smrg the dependencies will be rebuilt correctly. 1261.98Swiz 1271.98Swiz20031111: 1281.98Swiz A newer mkdep is needed. Error noting that is 1291.98Swiz cc: Ambiguous abbreviation -- 1301.97Slukem 1311.97Slukem20031008: 1321.97Slukem /usr/include/sys/disklabel_mbr.h was removed. 1331.97Slukem It's necessary to "make cleandir" to ensure that 1341.97Slukem the dependencies will be rebuilt correctly. 1351.96Schristos 1361.109Sdbj20031007: 1371.111Ssimonb A sign exension bug was fixed which set all the high bits 1381.111Ssimonb of our newly expanded ffs fs_flags. This should only 1391.111Ssimonb affect users who installed or upgraded in September of 2003. 1401.109Sdbj A small utility program was posted to tech-kern which 1411.111Ssimonb should fix this problem, and a warning message was added 1421.111Ssimonb to the kernel which should discover and warn about it. See 1431.111Ssimonb http://mail-index.NetBSD.org/tech-kern/2003/10/07/0005.html 1441.109Sdbj 1451.96Schristos20030906: 1461.96Schristos With the addition of siginfo support the old signal trampoline 1471.96Schristos code has been deprecated to COMPAT_16. Make sure that your running 1481.96Schristos kernel has COMPAT_16 enabled before building userland. 1491.94Schristos 1501.94Schristos20030801: 1511.95Swiz With the new openssl, there is some header and library shuffling. 1521.94Schristos rm -f /usr/include/des.h /usr/include/kerberosIV/* /lib/libdes* \ 1531.95Swiz /usr/lib/libdes* before building. 1541.92Swiz 1551.92Swiz20030703: 1561.92Swiz Texinfo was updated to 4.6. To avoid failures when trying to 1571.92Swiz build the included texinfo files, do: 1581.92Swiz 1591.92Swiz cd src/gnu/usr.bin/texinfo 1601.92Swiz make MKINFO=no dependall install 1611.90Swiz 1621.90Swiz20030630: 1631.101Sjunyoung Groff was updated to 1.19; it's probably necessary to do 1641.91Swiz cd share/mk && make install 1651.90Swiz cd src/gnu/usr.bin/groff 1661.90Swiz make MKMAN=no dependall install 1671.90Swiz (untested). 1681.89Schristos 1691.89Schristos20030516: 1701.89Schristos Due to bugs in the export handling code, invalid export lines 1711.89Schristos were accepted before and caused the kernel to panic when 1721.89Schristos mountd got restarted because it freed memory that had already 1731.89Schristos been freed. This has been fixed and the kernel checks 1741.89Schristos export addresses very strictly. If you upgrade your kernel, 1751.89Schristos make sure you also upgrade mountd, because if your export 1761.89Schristos file contains lines with an old inet4 address syntax (i.e. 1771.89Schristos a.b.c or a.b or a), they will get rejected by the new kernel. 1781.87Sbjh21 1791.87Sbjh2120030402: 1801.87Sbjh21 The superblock layout for FFS was changed. If you have 1.6 1811.87Sbjh21 fsck binaries, they will signal a fatal superblock mismatch 1821.87Sbjh21 with the first alternate, because they compare too many 1831.87Sbjh21 fields (even ones that aren't useful). If possible, upgrade 1841.87Sbjh21 your fsck_ffs binary before using a new kernel. 1851.87Sbjh21 None of this signals actual filesystem damage. 1861.85Satatat 1871.85Satatat20030324: 1881.85Satatat sendmail version 8.12.8 was imported. Since sendmail is 1891.85Satatat now setgid to the smmsp group, and runs in "collection" 1901.85Satatat mode for most common activities, there is a new config 1911.85Satatat file called submit.cf that needs to live in /etc/mail. 1921.85Satatat The generic submit.cf sample in /usr/share/sendmail/cf 1931.85Satatat is named netbsd-msp.cf. Upgrading your regular sendmail 1941.85Satatat configuration file is also strongly advised. 1951.85Satatat 1961.85Satatat See the section named "MESSAGE SUBMISSION PROGRAM" in 1971.85Satatat the updated /usr/share/sendmail/README file for more 1981.85Satatat information. 1991.82Swiz 2001.82Swiz20030117: 2011.82Swiz Texinfo was updated to 4.3. To avoid failures when trying to 2021.82Swiz build the included texinfo files, do: 2031.82Swiz 2041.82Swiz cd src/gnu/usr.bin/texinfo 2051.82Swiz make MKINFO=no dependall install 2061.81Slukem 2071.81Slukem20021223: 2081.81Slukem The METALOG format changed slightly, to remove the leading 2091.81Slukem "${DESTDIR}" from path names. 2101.81Slukem This only affects people building with UNPRIVED. 2111.81Slukem For complete safety, remove the DESTDIR entirely and 2121.81Slukem update tools/mtree, before running make build. 2131.88Sitojun 2141.88Sitojun20021219: 2151.88Sitojun CVS repository layout was changed. See the following for details 2161.88Sitojun if you are using (anonymous) cvs to update your tree. 2171.88Sitojun 2181.93Ssalo http://mail-index.NetBSD.org/netbsd-announce/2002/12/19/0000.html 2191.80Slukem 2201.80Slukem20021219: 2211.80Slukem install(1) had a '-N dbdir' option added, to specify an 2221.80Slukem alternate location to look up users & groups (instead 2231.80Slukem of the host system passwd(5) and group(5) databases). 2241.80Slukem 2251.80Slukem The build system was modified to take advantage of 2261.80Slukem this option (using ${NETBSDSRCDIR}/etc), so if you 2271.83Skei use USETOOLS==no, you may have to rebuild and 2281.80Slukem reinstall usr.bin/xinstall first. 2291.78Slukem 2301.78Slukem20021130: 2311.78Slukem fparseln(3) moved from libutil to libc. 2321.78Slukem If building to DESTDIR=/, reinstall the includes 2331.78Slukem and rebuild libc: 2341.78Slukem make includes 2351.78Slukem make do-lib-libc 2361.78Slukem If using build.sh, "cd tools/compat && make clean" 2371.78Slukem before rebuilding the tools. 2381.77Slukem 2391.77Slukem20021126: 2401.77Slukem The mk.conf(5) variable SYS_INCLUDE has been deprecated, 2411.77Slukem including the optional "SYS_INCLUDE=symlinks" support. 2421.77Slukem All header files, including <sys/*.h> are copied into 2431.77Slukem /usr/include. 2441.76Sthorpej 2451.76Sthorpej20021121: 2461.76Sthorpej The C run-time support files crtbegin.o and crtend.o 2471.76Sthorpej (and their companions crtbeginS.o and crtendS.o) were 2481.76Sthorpej split up, with new crti.o and crtn.o files resulting. 2491.76Sthorpej This means that libtool needs to be rebuilt once the 2501.76Sthorpej new libraries are installed. The process of rebuilding 2511.76Sthorpej libtool will cause it to automatically notice the new 2521.76Sthorpej required files, but it *must* be rebuilt in order to 2531.76Sthorpej do this. 2541.76Sthorpej 2551.76Sthorpej An out-of-date libtool will result in shared libraries 2561.76Sthorpej which lack _init() and _fini() routines, which means that 2571.76Sthorpej their global contructors/destructors will not be invoked. 2581.75Sthorpej 2591.75Sthorpej20021121: 2601.75Sthorpej A bug related to how ARM ELF objects were tagged has been 2611.75Sthorpej corrected. 2621.75Sthorpej 2631.75Sthorpej NetBSD ARM ELF uses the soft-VFP floating point model by 2641.75Sthorpej default. However, the assembler lacked support for marking 2651.75Sthorpej objects as using the VFP floating point format, and the 2661.79Swiz compiler was not properly passing the flag indicating "soft-VFP" 2671.75Sthorpej to the assembler. 2681.75Sthorpej 2691.75Sthorpej Unfortunately, this means that the linker will now consider 2701.75Sthorpej old (i.e. not marked "softvfp") NetBSD ARM ELF objects to be 2711.75Sthorpej incompatible with new (properly marked) objects. 2721.75Sthorpej 2731.75Sthorpej The problem will only manifest itself if you attempt to compile 2741.75Sthorpej a new program using the fixed toolchain, and link that program 2751.75Sthorpej against old libraries which do not have the proper "softvfp" 2761.75Sthorpej markings. ALL OF YOUR EXISTING BINARIES AND SHARED LIBRARIES 2771.75Sthorpej WILL CONTINUE TO WORK PROPERLY. 2781.75Sthorpej 2791.75Sthorpej The only work-around for the problem is to recompile all of 2801.75Sthorpej the libraries on the system. The easiest way to do this for 2811.79Swiz system libraries is to install a binary snapshot; they are 2821.93Ssalo generally available on releng.NetBSD.org. Any packages you 2831.75Sthorpej have installed which supply libraries will have to be recompiled 2841.75Sthorpej if you wish to link new programs against those libraries. 2851.75Sthorpej 2861.75Sthorpej If you have questions about this matter, please contact 2871.93Ssalo port-arm@NetBSD.org. 2881.73Sprovos 2891.73Sprovos20021011: 2901.73Sprovos Systrace has been improved to support privilege elevation. 2911.73Sprovos Updating the kernel requires the userland part of systrace 2921.79Swiz to be rebuilt. 2931.72Sthorpej 2941.72Sthorpej20021010: 2951.72Sthorpej The config(8) grammar was changed to allow options to register 2961.72Sthorpej dependencies on attributes, as well as other options. Users 2971.72Sthorpej must update and reinstall usr.sbin/config before building a new 2981.72Sthorpej kernel. 2991.70Sthorpej 3001.70Sthorpej20021009: 3011.70Sthorpej A new attribute dependency syntax was introduced to config(8), 3021.70Sthorpej which is now used by the SCSI configuration description. Users 3031.71Swiz must update and reinstall usr.sbin/config before building a new 3041.70Sthorpej kernel. 3051.69Sthorpej 3061.69Sthorpej20021003: 3071.69Sthorpej Several changes have been made to the autoconfiguration 3081.69Sthorpej framework. Users must update and reinstall usr.sbin/config 3091.69Sthorpej before building a new kernel. 3101.74Sjschauma 3111.74Sjschauma20021001: 3121.74Sjschauma The i386mp branch has been merged. To compile a kernel, users 3131.74Sjschauma will need to add the option 'cpu* at mainbus?' to their configuration 3141.74Sjschauma file. Multiprocessor kernels will need 3151.74Sjschauma ioapic* at mainbus? apid ? 3161.74Sjschauma options MULTIPROCESSOR 3171.74Sjschauma options COM_MPLOCK 3181.68Slukem 3191.68Slukem20020922: 3201.68Slukem MKDYNAMICROOT=yes enabled by default, which means that 3211.68Slukem certain shared libraries are installed into /lib, the shared 3221.68Slukem linker is installed into /libexec, and all programs in /bin 3231.68Slukem and /sbin are dynamically linked. 3241.68Slukem If you do not use "make build", you should ensure that 3251.68Slukem you have the libraries and shared linker in the new locations, 3261.68Slukem with: 3271.68Slukem make do-lib-csu do-lib-libc do-lib do-gnu-lib do-ld.elf_so 3281.67Slukem 3291.67Slukem20020917: 3301.67Slukem USE_NEW_TOOLCHAIN has been replaced with: 3311.67Slukem - TOOLCHAIN_MISSING -- set to "yes" on platforms for which 3321.67Slukem there is no working in-tree toolchain (hppa, ns32k, sh5, 3331.67Slukem x86_64). 3341.67Slukem - EXTERNAL_TOOLCHAIN -- if defined by the user, points to the 3351.79Swiz root of an external toolchain (e.g. /usr/local/gnu). This 3361.67Slukem enables the cross-build framework even for TOOLCHAIN_MISSING 3371.67Slukem platforms. 3381.66Sgehenna 3391.66Sgehenna20020906: 3401.66Sgehenna gehenna-devsw has been merged into the trunk. Need to update and 3411.79Swiz reinstall usr.sbin/config before building the kernel. 3421.65Slukem 3431.65Slukem20020822: 3441.65Slukem Crunched rescue tools (contents of /bin and /sbin, plus others) 3451.65Slukem are now provided in /rescue. 3461.65Slukem 3471.65Slukem To ensure that these are built statically linked (no matter 3481.65Slukem what the setting of LDSTATIC is), use a crunchgen(1) built 3491.65Slukem from sources newer than 20020820 (see the next entry). 3501.65Slukem 3511.65Slukem20020820: 3521.65Slukem crunchgen(1) changed to ensure that the generated program 3531.65Slukem is statically linked. 3541.65Slukem 3551.65Slukem Solution: update and reinstall usr.bin/crunch 3561.84Sgrant 3571.84Sgrant20020605: 3581.84Sgrant smmsp user/group has been added for sendmail. 3591.84Sgrant 3601.84Sgrant Add the following into /etc/group: 3611.84Sgrant 3621.84Sgrant smmsp:*:17: 3631.84Sgrant 3641.84Sgrant and the following to /etc/master.passwd (via vipw): 3651.84Sgrant 3661.84Sgrant smmsp:*:17:17::0:0:Sendmail Message Submission Program:/nonexistent:/sbin/nologin 3671.61Sitojun 3681.61Sitojun20020515: 3691.61Sitojun sshd user/group has been added. Need to hand add this in, or sshd 3701.61Sitojun will not let you log in (with default, or UsePrivlegeSeparation=yes) 3711.61Sitojun 3721.61Sitojun Add the following into /etc/group: 3731.61Sitojun 3741.61Sitojun sshd:*:16: 3751.61Sitojun 3761.61Sitojun and the following to /etc/master.passwd (via vipw): 3771.61Sitojun 3781.63Senami sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin 3791.61Sitojun 3801.79Swiz Also /var/chroot/sshd directory needs to be present (digged as part of 3811.79Swiz the build process). 3821.60Ssommerfe 3831.60Ssommerfe20020426: 3841.60Ssommerfe NBUILDJOBS obsoleted in favor of just using -j. 3851.59Slukem 3861.59Slukem20020426: 3871.59Slukem etc/postinstall added, which performs various checks for 3881.59Slukem configuration file updates and changes, and can fix most of 3891.59Slukem the problems identified. 3901.59Slukem This should make it much easier to upgrade a system's 3911.59Slukem configuration from earlier systems (as far back as NetBSD 1.5). 3921.56Slukem 3931.56Slukem20020320: 3941.79Swiz <bsd.lib.mk> needs a new install(1) for its "-a cmd" support. 3951.79Swiz Build and install at usr.bin/xinstall before the build. 3961.56Slukem 3971.55Sitojun20020319: 3981.79Swiz Raw IPv6 socket now makes strict checking for sa_family and sa_len 3991.79Swiz on send(2) operation. Be sure to have sbin/rtsol and usr.sbin/rtsold 4001.55Sitojun newer than November 2001 when you upgrade the kernel. 4011.55Sitojun 4021.54Sitojun20020311: 4031.54Sitojun ssh configuration files were moved from /etc to /etc/ssh. Beware 4041.54Sitojun if you restart your machine from remote. Note that sshd.conf needs 4051.54Sitojun to be changed (due to the use of "/etc" inside). 4061.54Sitojun 4071.54Sitojun20020223: 4081.53Smatt Users of the VAX port will need to rebuild and install gas 4091.53Smatt so it deal with the now present register prefix used in all 4101.53Smatt the VAX assembly files. 4111.53Smatt 4121.50Sitojun20020118: 4131.50Sitojun ntpd user/group has been added. Need to hand add this in or builds 4141.50Sitojun will break as mtree aborts early. 4151.50Sitojun 4161.50Sitojun Add the following into /etc/group: 4171.50Sitojun 4181.50Sitojun ntpd:*:15: 4191.50Sitojun 4201.50Sitojun and the following to /etc/master.passwd (via vipw): 4211.50Sitojun 4221.50Sitojun ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin 4231.50Sitojun 4241.49Sjmc20011207: 4251.49Sjmc If you're attempting to build a snapshot on sparc64 and are getting 4261.49Sjmc reloc errors from the toolchain groff binary this means your native 4271.49Sjmc toolchain has some broken C++ bits. 4281.49Sjmc 4291.49Sjmc To fix: 4301.49Sjmc 4311.49Sjmc Build a new toolchain (i.e. build.sh -t) 4321.49Sjmc Use the new toolchain to build and install natively (i.e. /usr/lib) 4331.49Sjmc 4341.49Sjmc gnu/lib/libgcc 4351.51Spooka gnu/lib/libstdc++ 4361.49Sjmc 4371.49Sjmc After this a snapshot will be able to be built. 4381.49Sjmc 4391.47Sjmc20011201: 4401.47Sjmc In order for a sparc64 build to work you must have a working awk. If 4411.47Sjmc you've built and installed a system with the new toolchain up to this 4421.52Swiz point you do not have a working awk as its ability to do floating 4431.47Sjmc point is broken. 4441.47Sjmc 4451.47Sjmc To build: 4461.47Sjmc 4471.47Sjmc remake and install gnu/lib/libgcc 4481.47Sjmc remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links 4491.48Sjmc against the new libgcc.a) 4501.47Sjmc 4511.46Sthorpej20011128: 4521.46Sthorpej Kernel config information was changed to use defflag in 4531.46Sthorpej the various "files" files. Bug fixes to config(8) are 4541.46Sthorpej required in order for this to work properly. Make sure 4551.46Sthorpej to build and install in usr.sbin/config before attempting 4561.46Sthorpej to build a new kernel. 4571.46Sthorpej 4581.45Syamt20011030: 4591.45Syamt libc/locale/wcstod.c now needs new lint(1). Update lint(1) 4601.45Syamt before building libc. 4611.43Smason 4621.44Stv20011029: 4631.44Stv The new document BUILDING.mdoc (view with nroff | more, or 4641.44Stv see pre-generated .txt and .html versions) describes the build 4651.44Stv procedure in great detail. BUILDING, and the USE_NEW_TOOLCHAIN 4661.44Stv build process, are intended in the long run to replace this 4671.44Stv manual update log. 4681.44Stv 4691.44Stv Users building a USE_NEW_TOOLCHAIN system should read the 4701.44Stv BUILDING document for caveats. Generally, BUILDING supersedes 4711.44Stv UPDATING for these systems, as tool updating is taken care of 4721.44Stv by the new build system. 4731.42Sperry 4741.42Sperry20011028: 4751.42Sperry src/etc/Makefile now needs install to be able to handle 4761.42Sperry symlinks that point to nowhere. A bug in install that 4771.42Sperry prevented this was corrected. 4781.42Sperry 4791.42Sperry Solution: update and reinstall usr.bin/xinstall 4801.42Sperry Better Solution: Use the new toolchain and it will just work 4811.42Sperry for you. 4821.40Slukem 4831.40Slukem20011006: 4841.40Slukem /etc/mtree/NetBSD.dist has been updated to take advantage of 4851.40Slukem absolute path support added to mtree(8). Older mtree(8)s don't 4861.40Slukem understand the format. 4871.40Slukem 4881.40Slukem Solution: update and reinstall usr.sbin/mtree 4891.39Sjmc 4901.39Sjmc20011004: 4911.39Sjmc Crunchgen has been updated to work via reach-over makefiles. Updating 4921.39Sjmc is suggested before running a snapshot build 4931.36Stv 4941.35Sthorpej20010915: 4951.35Sthorpej The new "ubcperf" code committed by Chuck Silvers removed 4961.35Sthorpej a header file, uvm/uvm_vnode.h. There may be stale .depend 4971.35Sthorpej files that still reference this file. 4981.35Sthorpej 4991.35Sthorpej Solution: "make cleandir && make dependall" in affected 5001.35Sthorpej directories. 5011.31Senami 5021.31Senami20010803: 5031.31Senami grep.info is now built from grep.texi using makeinfo. Since it 5041.31Senami requires makeinfo v4.0, you need to install new texinfo before 5051.31Senami building gnu/usr.bin/grep. To install new texinfo, please follow 5061.31Senami the instruction described in 20010726 entry. 5071.30Senami 5081.64Ssommerfe20010803: 5091.41Swiz (i386 only): i386 kernel now uses new instructions like 5101.111Ssimonb `fxsave' which old gas doesn't understand. To build the 5111.64Ssommerfe kernel successfully, you need to build and install a new toolchain, 5121.64Ssommerfe (i.e., build.sh -t) or (temporarily) comment out "options I686_CPU" 5131.64Ssommerfe from your kernel configuration until you rebuild your userland. 5141.64Ssommerfe See 20011029 above and BUILDING file in this directory for more information. 5151.64Ssommerfe [updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled] 5161.29Sbjh21 5171.29Sbjh2120010731: 5181.29Sbjh21 Bootloader update on ELF platforms. DDB in kernels from before 5191.29Sbjh21 this will be unable to read symbol tables provided by newer 5201.29Sbjh21 bootloaders. 5211.27Sassar 5221.27Sassar20010726: 5231.27Sassar Texinfo was updated to 4.0. To avoid failures when trying to 5241.28Sassar build the included texinfo files, do: 5251.28Sassar 5261.28Sassar cd src/gnu/usr.bin/texinfo 5271.28Sassar make MKINFO=no dependall install 5281.25Sthorpej 5291.25Sthorpej20010718: 5301.25Sthorpej Enabled correct .init/.fini processing in crt0. The way this 5311.25Sthorpej was done was to change a -I directive to cc(1), which means 5321.25Sthorpej make(1) will have a stale dependency (it will be checking the 5331.25Sthorpej timestamp on the wrong "dot_init.h"). 5341.25Sthorpej 5351.25Sthorpej The symptom you will see is that new programs die with SIGSEGV 5361.25Sthorpej if you have a stale dependency. 5371.25Sthorpej 5381.25Sthorpej Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so 5391.25Sthorpej before starting your build. 5401.26Sthorpej 5411.26Sthorpej20010628: 5421.26Sthorpej A construct was added to uvm_page.h that uncovered a bug 5431.26Sthorpej in lint(1). If you get a warning/error about a non-portable 5441.26Sthorpej bitfield, update your lint(1) before proceeding. 5451.21Sjmc 5461.21Sjmc20010226: 5471.22Sjmc Added named user/group to system. Need to hand add this in or builds 5481.21Sjmc will break as mtree aborts early. 5491.21Sjmc 5501.21Sjmc To work around add by hand: 5511.21Sjmc 5521.21Sjmc named:*:14: 5531.21Sjmc 5541.22Sjmc to /etc/group and add: 5551.22Sjmc 5561.22Sjmc named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin 5571.22Sjmc 5581.22Sjmc to master.passwd (use vipw for instance if doing by hand). 5591.22Sjmc 5601.22Sjmc Now a make build should progress. 5611.18Sjmc 5621.18Sjmc20010219: 5631.52Swiz get/setprogname() added. Any hostprogs that may use this will need 5641.111Ssimonb to be bootstrapped manually until the host system is current. 5651.18Sjmc 5661.111Ssimonb Known problems: sys/arch/macppc/stand/fixcoff 5671.19Scgd usr.sbin/config (adding -DMAKE_BOOTSTRAP to 5681.19Scgd CFLAGS and rebuilding should work) 5691.20Sjmc usr.sbin/mdsetimage - Build a static copy if 5701.111Ssimonb building a snapshot before fully bootstrapped. 5711.15Schristos 5721.15Schristos20010204: 5731.15Schristos prepare the code to compile with stricter gcc flags. in 5741.15Schristos particular start eliminating redundant declarations. Yacc 5751.15Schristos needs to be installed before make build. 5761.10Schristos 5771.10Schristos20010114: 5781.10Schristos introduce .if commands(target) in make(1). You need to 5791.10Schristos bring everything up-to-date first, then without installing 5801.23Stron anything make and install in usr.bin/make, then proceed 5811.10Schristos with make build. 5821.9Ssommerfe 5831.9Ssommerfe20010101: 5841.9Ssommerfe bsd.subdir.mk committed 20001230 had a bug which caused 5851.9Ssommerfe afterinstall targets to run too soon; update again. 5861.8Ssommerfe 5871.8Ssommerfe20001230: 5881.8Ssommerfe New share/mk files needed to support .WAIT in SUBDIR variables. 5891.8Ssommerfe If you get make errors, 5901.8Ssommerfe (cd share/mk; make install) 5911.8Ssommerfe Also, PRINTOBJDIR has changed and is now used more heavily. 5921.6Sad 5931.6Sad20001019: 5941.7Sad The `ca' device driver has been replaced by `ld'; although the 5951.6Sad major and minor numbers haven't changed, you should update your /dev 5961.6Sad directory. 5971.1Sabs 5981.4Sitojun20000929: 5991.4Sitojun The following make directives are obsoleted. 6001.4Sitojun MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA 6011.4Sitojun By default, RSA is built into libcrypto. IDEA and RC5 will not be 6021.16Swiz built into libcrypto. By using MKCRYPTO_{RC5,IDEA}, you can build 6031.4Sitojun additional library libcrypto_{idea,rc5}. 6041.1Sabs 6051.1Sabs 6061.1SabsHints for a more successful build: 6071.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 6081.123Sjmc Use build.sh, but do not use its "expert mode": 6091.123Sjmc This will will automatically build the tools in the 6101.123Sjmc correct order, and it will keep the tools and the 6111.123Sjmc new build products from interfering with the running 6121.123Sjmc system. This will allow you to ignore most of the 6131.123Sjmc other advice in this file. 6141.2Smrg Build a new kernel first: 6151.2Smrg This makes sure that any new system calls or features 6161.2Smrg expected by the new userland will be present. This 6171.2Smrg helps to avoid critical errors when upgrading. 6181.1Sabs Use object directories: 6191.1Sabs This helps to keep stale object 6201.1Sabs files from polluting the build if a Makefile "forgets" 6211.1Sabs about one. It also makes it easier to clean up after 6221.1Sabs a build. It's also necessary if you want to use the 6231.1Sabs same source tree for multiple machines. 6241.123Sjmc To use object directories with build.sh: 6251.123Sjmc a) invoke build.sh with the "-M" or "-O" options. 6261.123Sjmc To use object directories without using build.sh: 6271.1Sabs a) cd /usr/src ; make cleandir 6281.2Smrg b) Add "OBJMACHINE=yes" to /etc/mk.conf 6291.2Smrg c) Add "MKOBJDIRS=yes" to /etc/mk.conf 6301.1Sabs d) cd /usr/src ; make build 6311.2Smrg Note that running "make obj" in a directory will create 6321.2Smrg in obj.$MACHINE directory. 6331.1Sabs Build to a DESTDIR: 6341.123Sjmc This helps to keep old installed files (especially libraries) 6351.123Sjmc from interfering with the new build. 6361.123Sjmc To build to a DESTDIR with build.sh, use the "-D" option. 6371.123Sjmc To build to a DESTDIR without using build.sh, set the DESTDIR 6381.123Sjmc environment variable before running make build. It should be 6391.123Sjmc set to the pathname of an initially empty directory. 6401.123Sjmc Problems: if you do not use build.sh, you might need to 6411.123Sjmc update critical utilities without using DESTDIR since 6421.123Sjmc nothing is executed from what is installed in DESTDIR. 6431.123Sjmc (See critical utils, below.) 6441.1Sabs Build often: 6451.1Sabs This keeps critical utilities current enough to not choke 6461.1Sabs on any other part of the source tree that depends on up to 6471.123Sjmc date functionality. If you use build.sh, you should not have 6481.123Sjmc this problem. 6491.1Sabs 6501.1SabsWhat to do if things don't work: 6511.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 6521.1SabsWhen things don't work there is usually a few things that commonly 6531.1Sabsshould be done. 6541.1Sabs 1) make includes 6551.1Sabs This should be done automatically by make build. 6561.1Sabs 2) cd share/mk && make install 6571.1Sabs Again, automatically done by make build. 6581.1Sabs 6591.1SabsFailsafe rebuild of a small part of the tree: 6601.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 6611.1SabsTo make sure you rebuild something correctly you want to do 6621.1Sabssomething like the following: 6631.1Sabs 1) Make sure the includes and .mk files are up to date. 6641.1Sabs 2) Make sure any program used to build the particular 6651.1Sabs utility is up to date. (yacc, lex, etc...) 6661.1Sabs 3) cd ...path/to/util... 6671.1Sabs make cleandir 6681.1Sabs rm ...all obj directories... 6691.1Sabs make cleandir # yes, again 6701.1Sabs make obj 6711.1Sabs make depend && make 6721.1Sabs 6731.1SabsFailsafe rebuild of the entire tree: 6741.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 6751.1SabsIf you really want to make sure the source tree is clean and 6761.2Smrgready for a build try the following. Note that sourcing /etc/mk.conf 6771.2Smrg(a make(1) Makefile) in this manner is not right, and will not work 6781.2Smrgfor anyone who uses any make(1) features in /etc/mk.conf. 6791.1Sabs 6801.1Sabs---cut here--- 6811.1Sabs#!/bin/sh 6821.1Sabs. /etc/mk.conf 6831.1Sabs 6841.58Slukemif [ -z $NETBSDSRCDIR ] ; then 6851.58Slukem NETBSDSRCDIR=/usr/src 6861.1Sabsfi 6871.58Slukemif [ \! -d $NETBSDSRCDIR ] ; then 6881.1Sabs echo Unable to find sources 6891.1Sabs exit 1 6901.1Sabsfi 6911.58Slukemfind $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \; 6921.1Sabs 6931.1Sabsif [ -z $BSDOBJDIR ] ; then 6941.1Sabs BSDOBJDIR=/usr/obj 6951.1Sabsfi 6961.1Sabsif [ -d $BSDOBJDIR ] ; then 6971.1Sabs rm -rf $BSDOBJDIR 6981.1Sabsfi 6991.1Sabs 7001.58Slukemcd $NETBSDSRCDIR && make cleandir 7011.1Sabs 7021.1Sabs---cut here--- 7031.1Sabs 7041.1SabsCritical utilities: 7051.1Sabs^^^^^^^^^^^^^^^^^^^ 7061.1Sabs gnu/usr.bin/egcs 7071.3Sitojun usr.bin/compile_et 7081.1Sabs usr.bin/make 7091.1Sabs usr.bin/yacc 7101.1Sabs usr.bin/lex 7111.11Slukem usr.bin/xlint 7121.2Smrg usr.sbin/config 7131.1Sabs 7141.34SsimonbOther problems and possible solutions: 7151.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7161.1SabsSymptom:Unreasonable compiler errors. 7171.1SabsFix: Rebuild gnu/usr.bin/egcs 7181.1Sabs 7191.1SabsSymptom:Complaints involving a Makefile. 7201.17SerhFix: Rebuild usr.bin/make: 7211.17Serh cd usr.bin/make && make && make install 7221.111Ssimonb Or, a failsafe method if that doesn't work: 7231.17Serh cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin 7241.17Serh 7251.1SabsFix: Make sure .mk files are up to date. 7261.1Sabs cd share/mk && make install 7271.2Smrg 7281.2SmrgSymptom:Kernel `config' fails to configure any kernel, including GENERIC. 7291.2SmrgFix: Rebuild usr.sbin/config 7301.1Sabs 7311.1SabsSymptom: 7321.1SabsFix: Rebuild usr.bin/yacc 7331.1Sabs 7341.1SabsSymptom: 7351.1SabsFix: Rebuild usr.bin/lex 7361.1Sabs 7371.1SabsSymptom: 7381.1SabsFix: rm /usr/lib/libbfd.a 7391.4Sitojun 7401.4SitojunSymptom:Obsolete intermediate files are used during compilation 7411.4SitojunFix: Try the following sequence of commands in the directory in question. 7421.4Sitojun make cleandir; rm `make print-objdir`; make cleandir; make obj 7431.4Sitojun (If you built the tree without "make obj" in the past, obsolete files 7441.4Sitojun may remain. The command tries to clean everything up) 7451.5Swiz 7461.5SwizSymptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type 7471.5SwizFix: Rebuild and install usr.bin/menuc 7481.12Sitojun 7491.12SitojunSymptom:mklocale not found during build in share/locale/ctype 7501.12SitojunFix: Build and install usr.bin/mklocale 7511.13Sdogcow 7521.86SkleinkSymptom:undefined reference to `__assert13' or `__unsetenv13' 7531.13SdogcowFix: Rebuild and install lib/libc 7541.13Sdogcow 7551.19ScgdSymptom:usr.sbin/config fails to build. 7561.19ScgdFix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile. 7571.13Sdogcow 7581.19ScgdSymptom:undefined reference to `getprogname' or `setprogname' 7591.19ScgdFix: Rebuild and install lib/libc 7601.24Sabs 7611.24SabsSymptom:lint does not understand the '-X' option 7621.24SabsFix: May need to build & install libs with NOLINT=1 before rebuilding lint 763