UPDATING revision 1.292
11.292Smrg$NetBSD: UPDATING,v 1.292 2018/03/11 11:18:06 mrg Exp $
21.1Sabs
31.123SjmcThis file (UPDATING) is intended to be a brief reference to recent
41.123Sjmcchanges that might cause problems in the build process, and a guide for
51.123Sjmcwhat to do if something doesn't work.
61.1Sabs
71.123SjmcFor a more detailed description of the recommended way to build NetBSD
81.123Sjmcusing build.sh, see the BUILDING file.
91.123Sjmc
101.123SjmcNote that much of the advice in this UPDATING file was written before
111.123Sjmcbuild.sh existed.  Nevertheless, the advice here may be useful for
121.123Sjmcworking around specific problems with build.sh.
131.123Sjmc
141.257SapbSections are marked with "^^^^^".  After the section on "Recent changes"
151.257Sapbare several sections containing more general information.
161.257Sapb
171.123SjmcSee also: BUILDING, build.sh, Makefile.
181.1Sabs
191.1SabsRecent changes:
201.1Sabs^^^^^^^^^^^^^^^
211.230Stls
221.292Smrg20180311:
231.292Smrg	bdftopcf was updated and may need cleaning in the
241.292Smrg	src/external/mit/xorg/tools/bdftopcf subdirectory if there are
251.292Smrg	link errors.
261.292Smrg
271.291Smrg20180212:
281.291Smrg	between OpenSSL and GCC updates, many things may fail to build.
291.291Smrg	any failure that looks like GCC or openssl is best handled by
301.291Smrg	a clean destdir and objdir.  Full cleandir and destdir deletion
311.291Smrg	is recommended if build failures occur.
321.291Smrg
331.288Smartin20171225:
341.288Smartin	removal of the vadvise syscall requires manual removal of all
351.288Smartin	associated files from the libc build object directory (including
361.289Schristos	the .depend files) - a command like:
371.288Smartin		cd $OBJ && find . -type d -name libc | xargs rm -rf
381.289Schristos	For architectures that support multiple "compat" binary targets,
391.289Schristos	you'll need to cleanup both the regular libc directory and the
401.290Smartin	compat ones (the above command will do that).
411.288Smartin
421.287Skre20171010:
431.287Skre	a change to the build structure of external/bsd/acpica/bin/iasl
441.287Skre	means that its objdir (or *.d and .depend at least) might need
451.287Skre	to be manually removed - or a build done once without -u.
461.287Skre
471.286Smrg20170822:
481.286Smrg	a new version of GMP has been imported and probably
491.286Smrg	will break parts of builds related to themselves or GCC, both
501.286Smrg	in the tools and the native section.  Remove all GCC, GMP, MPFR
511.286Smrg	and MPC objdirs or build once without -u.
521.286Smrg
531.285Smrg20170816:
541.285Smrg	a new version of MPFR and MPC have been imported and probably
551.285Smrg	will break parts of builds related to themselves or GCC, both
561.285Smrg	in the tools and the native section.  Remove all GCC, GMP, MPFR
571.285Smrg	and MPC objdirs or build once without -u.
581.285Smrg
591.284Smartin20170402:
601.284Smartin	a new version of dhcpcd has been imported, which does not support
611.284Smartin	update builds from the previous version. Remove your
621.284Smartin	external/bsd/dhcpcd object dir or build once without -u.
631.284Smartin
641.281Sroy20170211:
651.281Sroy	a new terminfo database has been imported.
661.281Sroy	The structure of it has changed slightly from prior versions and
671.281Sroy	an updated tic tool is required.
681.281Sroy	If you build.sh, don't use -u
691.281Sroy
701.280Skre20170207:
711.278Skre	various arch dependent libc/exect.S files were removed
721.279Skre	Either remove the obj directories (lib/libc and compat/amd64/i386/lib
731.279Skre	if it exists) or do a clean build.
741.279Skre	(This is a bug in the make system, it should be corrected without
751.279Skre	human intervention, but isn't.)
761.278Skre
771.277Smartin20170104:
781.277Smartin	xinput build options have changed.
791.277Smartin	Remove the obj directory (external/mit/xorg/bin/xinput)
801.277Smartin	if you build.sh -u
811.277Smartin
821.276Smartin20170103:
831.276Smartin	a new version of flex has been imported.
841.276Smartin	Remove the file from obj (external/bsd/flex)
851.276Smartin	if you build.sh -u
861.276Smartin
871.275Sspz20161014:
881.275Sspz	a new version of OpenSSL has been imported.
891.275Sspz	Remove the files from obj (crypto/external/bsd/openssl) 
901.275Sspz	if you build.sh -u
911.275Sspz
921.274Smartin20161009:
931.274Smartin	a new version of dhcpcd has been imported with slightly changed
941.274Smartin	build infrastructure. When doing a build.sh -u this requires
951.274Smartin	pruning the external/bsd/dhcpcd objdir.
961.274Smartin
971.273Smrg20160914:
981.273Smrg	i386, amd64, shark, ofppc and macppc have joined shark and x68k
991.273Smrg	ports in using xorg-server 1.18. This requires a clean destdir
1001.273Smrg	and a clean objdir.
1011.273Smrg
1021.272Sdholland20160527:
1031.272Sdholland	i386 needs a full cleandir or objdir deletion because PIE has
1041.272Sdholland	been enabled. (see the amd64 entry two down for further info)
1051.272Sdholland
1061.270Schristos20160418:
1071.270Schristos	libedit needs manual removal of all autogenerated files since
1081.271Schristos	some of them are not autogenerated anymore. Remember that there
1091.271Schristos	might be two copies of libedit if your platform builds "compat".
1101.270Schristos
1111.268Sriastrad20160410:
1121.268Sriastrad	amd64 needs full "make cleandir" or deletion of objdir now that
1131.268Sriastrad	PIE has been enabled for amd64.  PIE, or position-independent
1141.268Sriastrad	executables, means all code, including executables and not just
1151.268Sriastrad	shared libraries, is position-independent and hence able to be
1161.268Sriastrad	relocated by ASLR, address space layout randomization.
1171.268Sriastrad
1181.268Sriastrad	The change was made in Makefile variables for compiler and
1191.268Sriastrad	linker flags, for which make(1) does not record dependencies,
1201.268Sriastrad	hence it is unable to detect that all .o files need rebuilding.
1211.268Sriastrad
1221.268Sriastrad	Partial rebuilds with some modified source files will likely
1231.268Sriastrad	fail when linking executables, since the linker refuses to mix
1241.268Sriastrad	position-independent code with position-dependent code in
1251.268Sriastrad	position-independent executables:
1261.268Sriastrad
1271.268Sriastrad		.../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC
1281.268Sriastrad
1291.267Smrg20160401:
1301.267Smrg	Ports switching to GCC 5.3 will need a full "make cleandir".
1311.269Sdholland	Some people have found that cleandir is not sufficient, so if
1321.269Sdholland	in doubt delete the entire object directory tree for gcc.
1331.267Smrg
1341.266Saymeric20160306:
1351.265Saymeric	NetBSD's regexp implementation is now part of libnbcompat.
1361.265Saymeric	Nblex, nbm4, nbpax, nbsed use it and they may crash on
1371.265Saymeric	non-NetBSD hosts if linked with stale object files produced
1381.265Saymeric	while they included a non-NetBSD regex.h.
1391.265Saymeric	In any case, you should "make cleandir" at least these tools
1401.265Saymeric	before updating your toolchain.
1411.265Saymeric
1421.264Smartin20160125:
1431.264Smartin	Dtrace has been enabled by default on some architectures.
1441.264Smartin	When doing an update build, make sure to clean the etc/mtree
1451.264Smartin	object directory before starting the build - otherwise the
1461.264Smartin	needed directories in destdir will not be created.
1471.264Smartin	An easy way to do this is:
1481.264Smartin	   cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir
1491.264Smartin
1501.263Sdholland20150818:
1511.263Sdholland	New acpica requires "make cleandir" in src/external/bsd/acpica
1521.263Sdholland	again.
1531.263Sdholland
1541.262Schristos20150413:
1551.262Schristos	New acpica requires "make cleandir" and reinstalling yacc
1561.262Schristos	in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and
1571.262Schristos	also "make cleandir" in /usr/src/external/bsd/acpica.
1581.262Schristos
1591.261Smartin20150404:
1601.261Smartin	Lint changes require a full rebuild of the tool, so make
1611.261Smartin	sure to build without -u option to build.sh, or manually
1621.261Smartin	do a make cleandir in src/tools/lint1 and
1631.261Smartin	src/usr.bin/xlint.
1641.261Smartin
1651.260Sskrll20150310:
1661.260Sskrll	Improvements to openssl for arm mean that update builds of
1671.260Sskrll	the openssl libraries will fail. A make cleandir in
1681.260Sskrll	external/bsd/openssl/lib is needed
1691.260Sskrll
1701.258Smartin20141026:
1711.259Smsaitoh	A mishap during the import of pppd may cause your corruption
1721.258Smartin	in your cvs directory if you happened to do a cvs update
1731.258Smartin	during a short period of time. To fix, just remove the
1741.258Smartin	directory src/external/bsd/ppp/dist/pppd completely
1751.258Smartin	and let cvs restore it on next update.
1761.258Smartin
1771.256Sapb20140721:
1781.256Sapb	The src/external/mit/lua/src directory was accidentally created
1791.256Sapb	and then deleted in the CVS repository.  If you get errors like
1801.256Sapb
1811.256Sapb	cvs [update aborted]: cannot open directory
1821.256Sapb	/cvsroot/src/external/mit/lua/src: No such file or directory
1831.256Sapb
1841.256Sapb	then delete your local copy of that directory tree and try again.
1851.256Sapb
1861.255Sjoerg20140530:
1871.255Sjoerg	ARM eABI switched to DWARF based exception handling. This requires
1881.255Sjoerg	rebuilding all C++ code. It is strongly advised to do a clean build.
1891.255Sjoerg
1901.251Smartin20140131:
1911.253Sjoerg	The new compiler_rt/libc integration moved a few things. It is strongly
1921.254Sskrll	advised to do a clean build. At least lib/libc, the compat version(s)
1931.253Sjoerg	of libc, libkern, rump and the kernels need to be cleaned.
1941.251Smartin
1951.250Schristos20131227:
1961.250Schristos	1. The new ntpd runs in a restricted mode to prevent amplification
1971.250Schristos	   attacks. If you need ntpdc to work you need to explicitly enable
1981.250Schristos	   mode7 in your config file. Make sure you put the necessary restrict
1991.250Schristos	   statements to avoid being exposed.
2001.250Schristos	2. strncat has moved from lib/libc to common/lib/libc; you might need
2011.250Schristos	   to make clean in libc
2021.250Schristos
2031.249Smrg20131129:
2041.249Smrg	The GMP sources were updated, and builds will likely fail without
2051.249Smrg	cleaning their build trees for both tools and in-tree, like below.
2061.249Smrg
2071.248Smrg20131128:
2081.248Smrg	The MPC and MPFR sources were updated, and builds may require their
2091.248Smrg	tools and in-tree directories cleaned for successful updates.
2101.248Smrg
2111.246Smartin20130605:
2121.247Sspz	The kernel option FAST_IPSEC no longer exists, it's been renamed
2131.247Sspz	to IPSEC (and the older IPSEC version removed).
2141.247Sspz
2151.247Sspz20130605:
2161.246Smartin	Previous freetype installations eroneously installed private
2171.246Smartin	header files. If you are building against a non-empty $DESTDIR,
2181.246Smartin	please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/.
2191.246Smartin
2201.245Smrg20130531:
2211.245Smrg	The xdm update may cause build failure due to xdm.man being
2221.245Smrg	in the obj tree.  Make sure to ensure any like this:
2231.245Smrg		nbmake: nbmake: don't know how to make xdm.man. Stop
2241.245Smrg	is fixed by deleting the xdm.man in the obj tree.
2251.245Smrg
2261.244Smrg20130530:
2271.244Smrg	Updates of many xsrc packages will leave old .pc files around.
2281.244Smrg	Best to clean out the xsrc objdir entirely before rebuilds.
2291.244Smrg
2301.242Schristos20130301:
2311.242Schristos	The removal of netiso requires manual removal of /usr/include/netiso
2321.243Schristos	prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump}
2331.242Schristos
2341.238Sdholland20120726:
2351.241Swiz	The update of OpenSSL requires cleaning both the OpenSSL build
2361.241Swiz	directory and DESTDIR.  *Even non-update builds require cleaning
2371.240Sdholland	DESTDIR.* Builds done without taking these steps may fail, or in
2381.241Swiz	some cases may succeed and install broken OpenSSL libraries that
2391.240Sdholland	cause third-party software to link incorrectly and/or crash.
2401.238Sdholland
2411.237Swiz20120507:
2421.241Swiz	The database schema for makemandb was changed.  You will
2431.237Swiz	need to update the database using 'makemandb -f' or wait
2441.237Swiz	for the next weekly run to fix it.
2451.237Swiz
2461.236Sbsh20120319:
2471.236Sbsh	sys/conf/Makefile.kern.inc has been modified to adjust the
2481.236Sbsh	size of db_symtab automatically.  You need to update dbsym in
2491.236Sbsh	your $TOOLDIR to build kernels with options SYMTAB_SPACE.  If
2501.236Sbsh	you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your
2511.236Sbsh	mk.conf.
2521.236Sbsh
2531.235Sjoerg20120216:
2541.241Swiz	Default for MKCATPAGES changed to NO.  Update builds will fail
2551.241Swiz	unless DESTDIR is cleaned manually.  If you built between 20120207
2561.239Sdholland	and 20120216, daily and weekly could have created an unreadable
2571.241Swiz	/var/db/man.db index for apropos.  Running makemandb -f or
2581.235Sjoerg	the next run of weekly will fix it.
2591.233Sjoerg
2601.232Schristos20111227:
2611.232Schristos	If you built between 20111225 and 20111227 you need to remove
2621.232Schristos	/usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the
2631.232Schristos	bump has been reverted.
2641.232Schristos
2651.231Stls20111125:
2661.231Stls	The "rnd" pseudodevice has been added to sys/conf/std, which
2671.231Stls	means it should no longer be explicitly listed in kernel
2681.231Stls	configuration files.  The line "pseudo-device rnd" should be
2691.231Stls	removed from any custom kernel config files users may have.
2701.231Stls
2711.230Stls20111119:
2721.230Stls	A problem with the datastructures used by the rndctl(8)
2731.230Stls	utility (pointers in datastructures in an array, making 32->64
2741.230Stls	bit compatibility very painful) has been fixed in a
2751.230Stls	non-backwards-compatible way.  If you replace your kernel,
2761.230Stls	replace your rndctl executable too.
2771.241Swiz
2781.229Sjym20111001:
2791.229Sjym	the prop_*_send_syscall() functions from proplib(3) have been
2801.229Sjym	changed and their new version is not backward compatible with the old
2811.241Swiz	one.  So ensure that all consumers of these functions (currently:
2821.229Sjym	quota2 code and its tests) are updated together with the new lib.
2831.229Sjym
2841.228Smrg20110817:
2851.228Smrg	sparc has been changed to use GCC 4.5.3, so any objdir or
2861.228Smrg	DESTDIR for them should be deleted before updating.
2871.228Smrg
2881.227Sriastrad20110806:
2891.227Sriastrad	i386 and amd64 have been changed to use GCC 4.5.3, so any
2901.227Sriastrad	objdir or DESTDIR for them should be deleted before updating.
2911.227Sriastrad
2921.226Smrg20110805:
2931.226Smrg	The update to GCC 4.5.3 requires a non-trivial portion of
2941.226Smrg	the tree to be cleaned.  Best to delete both objdir and
2951.226Smrg	DESTDIR before running this update.  So far, only the
2961.226Smrg	sparc64, mips and powerpc platforms have changed.
2971.226Smrg
2981.225Smatt20110803:
2991.241Swiz	The layout of external/public-domain/xz has changed.  To do an
3001.225Smatt	update build you will have to remove the contents of the OBJDIR
3011.225Smatt	for external/public-domain/xz/bin by hand as the xz entry there
3021.225Smatt	is now a directory.
3031.225Smatt
3041.223Sjoerg20110410:
3051.241Swiz	The configuration of src/tools/gcc has changed.  To do an
3061.224Sdholland	update build you have to clean both tools/binutils and
3071.224Sdholland	tools/gcc by hand.
3081.223Sjoerg
3091.222Splunky20110328:
3101.222Splunky	Building the Xorg binary was moved into a subdirectory to fix
3111.241Swiz	ordering issues with "make all".  It may be necessary to remove
3121.222Splunky	the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86
3131.222Splunky	if your update build fails, as the "Xorg" entry there is now a
3141.222Splunky	directory.
3151.222Splunky
3161.220Sjoerg20110121:
3171.221Slukem	Assembler files no longer use -traditional-cpp.  This can break
3181.220Sjoerg	the build of individual parts of the tree.  This is handled
3191.220Sjoerg	correctly by build.sh.  Manual builds have to update /usr/share/mk
3201.220Sjoerg	and re-run config(1) for any kernel configurations as needed.
3211.218Sjoerg
3221.217Sjruoho20101217:
3231.217Sjruoho	The tcpdump(8) program was changed to drop privileges and chroot(2)
3241.241Swiz	by default.  It may be necessary to manually update passwd(5) and
3251.217Sjruoho	group(5) in order to make the program work with existing setups.
3261.217Sjruoho
3271.216Schristos20101125:
3281.216Schristos	The latest changes to setenv(3) dissallow setting environment
3291.241Swiz	variables with names that contain '='.  Revision 1.18 of env.c
3301.241Swiz	assumed that this was allowed.  Installing a new libc with an
3311.216Schristos	old copy of /usr/bin/env causes env x=1 printenv | grep x= to
3321.216Schristos	break which affects the autoconf tests for dependency finding,
3331.216Schristos	so building gcc will end up printing:
3341.216Schristos	    checking dependency style of gcc... none
3351.216Schristos	    configure: error: no usable dependency style found
3361.216Schristos	Fix it by rebuilding and re-installing env.
3371.138Slukem
3381.215Smrg20101119:
3391.215Smrg	Recent Xorg updates in xsrc/external/mit/ may cause various build
3401.215Smrg	or run-time problems.  Delete your entire DESTDIR and OBJDIR if you
3411.215Smrg	have any build problems with xsrc, or problems with mismatched
3421.215Smrg	versions between xorg-server and drivers.
3431.215Smrg
3441.213Sjmmv20100604:
3451.213Sjmmv	The update of ATF to 0.9 causes old tests written in shell to fail
3461.213Sjmmv	unless they are rebuilt.  If you are building with MKUPDATE=yes,
3471.213Sjmmv	you need to clean the src/external/bsd/atf/tests/ and the src/tests/
3481.213Sjmmv	trees by hand.
3491.213Sjmmv
3501.211Stnozaki20100522:
3511.212Smrg	Recent Xorg updates in xsrc/external/mit/ will cause various build
3521.212Smrg	problems.  Delete your entire DESTDIR and OBJDIR if you have any
3531.212Smrg	build problems with xsrc.
3541.212Smrg
3551.212Smrg20100522:
3561.211Stnozaki	private section of <ctype.h> was splitted, and now mklocale(1)
3571.214Sdholland	include ctype_local.h, so you have to make cleandir in tools/mklocale.
3581.211Stnozaki
3591.210Schristos20100520:
3601.241Swiz	The location of the xkb compiled descriptions has changed.  Please
3611.210Schristos	remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR.
3621.210Schristos
3631.209Snjoly20100222:
3641.209Snjoly	The shared objects file extension has been changed from .so to
3651.209Snjoly	.pico, in order to avoid conflicts with shared libraries names
3661.209Snjoly	libXX.so.  All now stale regular .so files can be removed from
3671.209Snjoly	your object directories.
3681.209Snjoly
3691.208Sroy20100204:
3701.208Sroy	The termcap database has been removed from the sources,
3711.208Sroy	but has not been marked obsolete so it is not removed
3721.208Sroy	from the system when upgrading.
3731.208Sroy	As such, you will need to remove them from your object
3741.208Sroy	and destination directories.
3751.208Sroy
3761.203Sdyoung20091101:
3771.205Sdholland        After updating, it may be necessary to make the 'cleandir'
3781.205Sdholland        target in src/tools/yacc/ and in src/usr.bin/yacc/ before a
3791.205Sdholland        'build.sh -u tools' or 'build.sh -u distribution'.  Ditto
3801.205Sdholland        src/tools/lex/ and src/usr.bin/lex/.
3811.203Sdyoung
3821.202Smrg20091001:
3831.206Sdholland	On amd64 you must rebuild tools (to get the new binutils)
3841.206Sdholland	before building a kernel, or the build fails on cpufunc.S.
3851.206Sdholland
3861.206Sdholland20091001:
3871.202Smrg	An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb
3881.202Smrg	symlink, failing the build.  Delete the link, and the subdir
3891.202Smrg	it is in, and retry your build.
3901.202Smrg
3911.201Sdsl20090718:
3921.201Sdsl	libc build changed so that strchr() provides the extra entry
3931.241Swiz	point for index().  Update build of libc.a (and libc_pic.a)
3941.201Sdsl	may fail because the archive contains the unwanted index.o.
3951.201Sdsl	(Similarly for strrchr() and rindex().)
3961.201Sdsl
3971.198Smrg20090709:
3981.198Smrg	Native Xorg was upgraded again.  Builds will probably fail again
3991.198Smrg	without a clean objdir, at least for src/external/mit/xorg.
4001.198Smrg
4011.197Smrg20090616:
4021.197Smrg	Native Xorg was upgraded.  Builds will need a clean objdir for
4031.197Smrg	src/external/mit/xorg.  Upgrading a system from sets will not
4041.197Smrg	work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
4051.197Smrg	subdirectory has been changed into a file, and this needs to
4061.197Smrg	be manually "rm -r"'ed before installing xbase.tgz.
4071.197Smrg
4081.195Sperry20090501:
4091.195Sperry	Several new functions were added to string.h/libc, and this
4101.195Sperry	can cause autoconf problems during the tool build for people
4111.241Swiz	who fail to clean out their tools objects properly.  If you
4121.195Sperry	note messages about stpcpy, stpncpy or strnlen accompanying a
4131.195Sperry	failure during the tool build, clean out all your tools
4141.195Sperry	objects and start again.
4151.195Sperry
4161.194Smrg20090325:
4171.194Smrg	The i386 port was switched to i486 default toolchain.  This requires
4181.194Smrg	cleaning your src/tools directory and $TOOLDIR and rebuilding them.
4191.194Smrg
4201.192Sskrll20090126:
4211.241Swiz	The __posix_fadvise50 system call changed assembly stub type.  You
4221.207Smbalmer	need to 'rm -f __posix_fadvise50.*' in the libc build directory
4231.207Smbalmer	to avoid using the old assembly stub.
4241.192Sskrll
4251.191Sjoerg20090202:
4261.191Sjoerg	pkg_install now depends on the pkgdb cache for automatic conflict
4271.191Sjoerg	detection.  It is recommented to rebuild the cache with
4281.191Sjoerg	``pkg_admin rebuild''.
4291.191Sjoerg
4301.184Schristos20090110:
4311.241Swiz	time_t and dev_t have been bumped to 64 bit quantities.  To upgrade:
4321.241Swiz	1. Make sure your kernel has COMPAT_50 in it.  Build and install.
4331.188Schristos	   This is needed even in the MODULAR kernel because there is
4341.188Schristos	   conditionally compiled code in rtsock.c.
4351.184Schristos	2. make sure build.sh completes and the binaries in a chroot work
4361.184Schristos	   before installing.
4371.184Schristos	3. If you don't use build.sh and you build directly to root, and
4381.241Swiz	   your build breaks in the middle, don't despair.  Make sure headers
4391.184Schristos	   are installed properly, and start building libraries first libc
4401.184Schristos	   and libutil, install them and then continue building all the
4411.241Swiz	   libraries in src/lib and src/gnu/lib and install them.  Once
4421.184Schristos	   the new libraries are installed, you can restart the build.
4431.184Schristos	4. If you compile packages and you notice link time warnings,
4441.189Shubertf	   rebuild the required packages to update their shared libraries.
4451.189Shubertf	   Any package you rebuild will require rebuilding all the packages
4461.189Shubertf	   that depend on it.
4471.186Schristos	5. Next time you run pwd_mkdb with the new binary, the file
4481.186Schristos	   will be upgraded and it will not be backwards compatible.
4491.190Sapb	6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see
4501.190Sapb	   lastlogx(5)) have been versioned, and there is a heuristic
4511.241Swiz	   for utmp.  You are better off removing the old files after
4521.190Sapb	   upgrading.  The automated clearing of /var/run during
4531.190Sapb	   boot, and the automated rotating of files in /var/log by
4541.190Sapb	   newsyslog(8), may mean that you do not have to remove the
4551.190Sapb	   files manually.
4561.190Sapb	7. The optional accounting file (/var/account/acct, see
4571.190Sapb	   accton(8)) has not been versioned, and will need to be
4581.190Sapb	   removed.  The automatic rotation of the accounting file by
4591.190Sapb	   /etc/daily limits the bad consequences of failure to remove
4601.190Sapb	   the file.
4611.196Sdholland	8. Application software that writes time_t to binary files on
4621.241Swiz	   disk will break or need attention.  Most notably: if you are
4631.196Sdholland	   using PostgreSQL < 8.4, you need to dump your databases,
4641.196Sdholland	   rebuild PostgreSQL with the new time_t, then restore.
4651.185Sjmcneill
4661.183Spgoyette20081219:
4671.183Spgoyette	config(1) has been updated, and one of the files it creates -
4681.183Spgoyette	swapnetbsd.o - has changed format.  You need to rebuild config
4691.183Spgoyette	(done automatically by build.sh) and then you need to rerun
4701.183Spgoyette	config on all kernel configuration files before rebuilding those
4711.183Spgoyette	kernels.
4721.183Spgoyette
4731.181Scube20081205:
4741.181Scube	If you build with MKX11=no, you should remove /etc/rc.d/xdm and
4751.181Scube	/etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
4761.181Scube	set and will appear as extra files for MKX11=no update builds.
4771.178Slukem
4781.179Stsutsui20081122:
4791.182Stsutsui	On i386, various kernel options(4) in GENERIC including
4801.180Swiz	file systems have been disabled and moved into kernel modules.
4811.180Swiz	Before trying a new GENERIC kernel, you have to prepare the
4821.179Stsutsui	following files as well as a new GENERIC kernel:
4831.179Stsutsui
4841.179Stsutsui	- build and install kernel modules from src/sys/modules
4851.179Stsutsui
4861.179Stsutsui	- install the latest bootloader, which will load a module
4871.180Swiz	  for the file system from which the kernel is loaded automatically
4881.179Stsutsui
4891.180Swiz	If you have to load your kernel from a file system which is not of
4901.180Swiz	the same type as the root file system, you have to load the necessary
4911.180Swiz	file system module manually on the boot prompt or in the boot.cfg file.
4921.179Stsutsui
4931.178Slukem20080827:
4941.178Slukem	If you built and installed a libc from sources between
4951.178Slukem	2008/08/20 and 2008/08/26 you got a broken strtouq(3)
4961.178Slukem	which results in false errors reported by lint(1).
4971.178Slukem	Since this breaks the libc build itself, manual help is
4981.180Swiz	needed -- lint must be disabled temporarily, e.g.:
4991.178Slukem	  $ (cd lib/libc && make MKLINT=no dependall install)
5001.178Slukem
5011.177Schristos20080813:
5021.177Schristos	MKDEBUG build was broken because the .depend files did not know
5031.241Swiz	about .go files.  You need to remove all .depend files and rebuild.
5041.177Schristos
5051.200Sdholland20080802:
5061.200Sdholland	A regression in binary compatibility for pthread_mutex_t has
5071.241Swiz	been fixed.  Unfortunately, the price is breaking compatibility
5081.200Sdholland	for -current.
5091.200Sdholland
5101.200Sdholland	Threaded programs (using libpthread) and C++ programs (using
5111.200Sdholland	libstdc++) compiled after 20070907 and before 20080802 need to
5121.200Sdholland	be recompiled.
5131.200Sdholland
5141.200Sdholland	One way to find affected pkgsrc packages:
5151.200Sdholland
5161.200Sdholland	  $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO
5171.200Sdholland	  $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO
5181.200Sdholland
5191.175Ssimonb20080731:
5201.175Ssimonb	WAPBL (metadata journaling support) has been added, but at this
5211.175Ssimonb	time isn't backwards compatible with pre-WAPBL aware kernels
5221.175Ssimonb	and userland (fsck_ffs in particular).  Please make sure you
5231.175Ssimonb	don't use a journaled filesystem with an older kernel/userland,
5241.176Ssimonb	especially an uncleanly mounted journaled filesystem.  WAPBL
5251.176Ssimonb	also requires the super block to be in the UFS2 format.  You
5261.176Ssimonb	can use fsck_ffs -c 4 to update the superblock format.
5271.175Ssimonb
5281.174Slukem20080721:
5291.174Slukem	Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
5301.174Slukem	isn't defined.
5311.174Slukem
5321.173Sfreza20080531:
5331.241Swiz	The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
5341.241Swiz	from 125 (conflicted with DRVCTLCOMMAND) to 129.  The drvctl(8)
5351.173Sfreza	utility needs to be rebuilt and reinstalled as older binaries
5361.241Swiz	won't work correctly.  The following sequence of commands:
5371.173Sfreza
5381.173Sfreza	  $ (cd sys/sys/ && nbmake-$arch includes)
5391.173Sfreza	  $ (cd sbin/drvctl/ && nbmake-$arch clean)
5401.173Sfreza	  $ (cd sbin/drvctl/ && nbmake-$arch all)
5411.173Sfreza
5421.173Sfreza	leaves new drvctl utility in sbin/drvctl build directory.
5431.173Sfreza
5441.172Slukem20080503:
5451.172Slukem	The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
5461.172Slukem
5471.171She20080521:
5481.171She	For a while, unprivileged UPDATE builds would fail to
5491.171She	succeed at the checkflist stage, complaining that
5501.171She	${DESTDIR}/stand/<arch>/ did not exist.  A fix for this
5511.171She	problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
5521.171She	If you already hit this problem, update the .mk file,
5531.171She	remove ${DESTDIR}/stand/<arch>, and re-run the build.
5541.171She
5551.174Slukem20080303:
5561.174Slukem	Linker warnings are now fatal if $WARNS>0.
5571.174Slukem
5581.170Schristos20080126:
5591.170Schristos	The posix_fadvise system call has been changed from an assembly
5601.241Swiz	stub, to a c file that calls an assembly stub.  You need to
5611.170Schristos	'rm -f posix_fadvise.* .depend' in the libc build directory to
5621.170Schristos	avoid using the old assembly stub.
5631.170Schristos
5641.168Sjoerg20071209:
5651.241Swiz	The acpiec(4) driver has been split into two attachments.  If you
5661.168Sjoerg	get ACPI errors before the attachment, please update your kernel
5671.169Swiz	configuration file appropriately or see GENERIC for more details.
5681.168Sjoerg
5691.166Sxtraeme20071115:
5701.166Sxtraeme	The it(4) driver has been renamed to itesio(4) and the old port
5711.166Sxtraeme	argument specified in the kernel configuration file is not valid
5721.241Swiz	anymore.  The itesio(4) driver now uses the Super I/O address port
5731.241Swiz	rather than the EC address port.  Please update your kernel
5741.167Swiz	configuration file appropriately or see GENERIC for more details.
5751.166Sxtraeme
5761.165Sjmmv20071028:
5771.165Sjmmv	The pccons(4) driver has been removed from the NetBSD/shark port.
5781.165Sjmmv	You need to update any custom kernel configuration file you have
5791.165Sjmmv	to remove any references to pccons (which includes removing the
5801.165Sjmmv	now useless XSERVER option) and replace them with the correct
5811.165Sjmmv	entries for the wscons driver.  See the GENERIC configuration file
5821.165Sjmmv	for more details.
5831.165Sjmmv
5841.164Sgdt20070913:
5851.164Sgdt	A latent bug in dhclient/dhcpd that caused it to be unable to
5861.164Sgdt	enumerate interfaces was fixed.  The bug began to cause
5871.164Sgdt	problems after 20070911 when the kernel's SIOCGIFCONF
5881.164Sgdt	implementation was repaired.  From 20070529 to 20070911 racoon
5891.164Sgdt	could not enumerate interfaces.  (These are noted because
5901.164Sgdt	normal kernel/userspace version matching hygiene is not
5911.164Sgdt	sufficient to avoid this problem.)  Ensure that both kernel
5921.164Sgdt	and userland are from after 20070913.
5931.164Sgdt
5941.163Sjoerg20070703:
5951.241Swiz	nbinstall has been renamed ${MACHINE_GNU_ARCH}-install.  It
5961.199Sdholland	calls the target-specific strip program, and the logic to pass
5971.199Sdholland	down STRIP from make has been removed.  This requires a
5981.199Sdholland	re-installation of tools.
5991.163Sjoerg
6001.161Sdsl20070422:
6011.161Sdsl	The way OS emulations lookup filenames inside the emulation root
6021.161Sdsl	has been changed.  Rather than modify the pathname (and copy back
6031.161Sdsl	to userspace) namei() and lookup() directly check the emulation
6041.241Swiz	root.  One side effect is that absolute symlinks inside the emulated
6051.167Swiz	root file system will be relative to that file system - unless they
6061.161Sdsl	start /../ this is useful when the emulated root is a real install
6071.161Sdsl	that has such links.
6081.161Sdsl	This might affect symlinks that have been added to reference outside
6091.161Sdsl	the emulated root.
6101.161Sdsl
6111.160Sjmcneill20070412:
6121.241Swiz	The pckbc driver on sgimips IP32 has been removed.  Use macekbc
6131.241Swiz	instead.  See the GENERIC32_IP3x kernel configuration for an
6141.160Sjmcneill	example.
6151.160Sjmcneill
6161.159Sgdt20070319:
6171.159Sgdt        src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
6181.159Sgdt        on many platforms due to incorrect flags settings.  If you
6191.159Sgdt        updated and built after about 20070315, do "nbmake-$arch
6201.159Sgdt	cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
6211.159Sgdt	rebuild of object files that might have been built
6221.159Sgdt	incorrectly, and ensure that you have at least
6231.159Sgdt	src/lib/libc/Makefile 1.130.
6241.159Sgdt
6251.241Swiz20070210:
6261.158Sdbj        src/sys/sys/{sa.h,savar.h} were removed.
6271.158Sdbj          find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
6281.158Sdbj              | xargs egrep -l '/sa.h|/savar.h' | xargs rm
6291.158Sdbj        will allow dependencies on those files to get get rebuilt
6301.158Sdbj
6311.157Sapb20070209:
6321.157Sapb        The threading model was changed when the newlock2 branch
6331.157Sapb        was merged to NetBSD-current.  If you boot with a new
6341.157Sapb        kernel (version 4.99.10), then you also need a new pthread
6351.157Sapb        library (/usr/lib/libpthread.so.0.7).  If you boot with
6361.157Sapb        an old kernel, then you need the old pthread library
6371.157Sapb        (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
6381.157Sapb        the pthread library in sync, old threaded applications should
6391.157Sapb        continue to work with an old or new kernel.  Note that named(8)
6401.157Sapb	is the only threaded application in the base system.
6411.157Sapb
6421.154She20061214:
6431.154She	Following the move of string_to_flags() and flags_to_string()
6441.154She	from the bin/ls/ sources to libutil, users doing UPDATE builds
6451.154She	will need to do a "make cleandir" in
6461.154She		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
6471.154She		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
6481.156She		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
6491.156She		as the installation images in distrib/
6501.154She	in order to excise stale references to the old stat_flags.h header
6511.154She	file in the ls sources -- stat_flags.h has been removed.
6521.154She
6531.152Schristos20061108:
6541.152Schristos	The configure script used in the src/tools/gcc compiler has been
6551.152Schristos	changed to indicate that our libc has ssp support built-in and
6561.241Swiz	does not depend on -lssp and -lssp-nonshared.  You'll need to
6571.152Schristos	make clean in src/tools/gcc first to rebuild the compiler.
6581.152Schristos
6591.151Srpaulo20061009:
6601.151Srpaulo	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
6611.241Swiz	available.  Use net.inet{,6}.tcp{,6}.congctl.selected instead.
6621.151Srpaulo
6631.150Sbjh2120060814:
6641.150Sbjh21	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
6651.150Sbjh21	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
6661.150Sbjh21	kernel configuration for an example.  X servers from the last
6671.150Sbjh21	few years should cope.
6681.150Sbjh21
6691.149Schristos20060703:
6701.241Swiz	MPACPI is no more.  We always configure PCI interrupts using ACPI
6711.241Swiz	if we have an ACPI kernel.  The option MPACPI_SCANPCI has been renamed
6721.241Swiz	to ACPI_SCANPCI.  Thanks to work from fvdl.
6731.149Schristos
6741.148Sdogcow20060627:
6751.148Sdogcow	socket(2) has changed, and its system call has been versioned.
6761.148Sdogcow	For userlands with the old version of socket(2), make sure that
6771.148Sdogcow	your kernel has 'options COMPAT_30' set, or else 'bad system call'
6781.148Sdogcow	errors will result.
6791.148Sdogcow
6801.1SabsHints for a more successful build:
6811.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
6821.123Sjmc    Use build.sh, but do not use its "expert mode":
6831.132Sjmmv	This will automatically build the tools in the
6841.123Sjmc	   correct order, and it will keep the tools and the
6851.123Sjmc	   new build products from interfering with the running
6861.123Sjmc	   system.  This will allow you to ignore most of the
6871.123Sjmc	   other advice in this file.
6881.2Smrg    Build a new kernel first:
6891.2Smrg	This makes sure that any new system calls or features
6901.2Smrg	   expected by the new userland will be present.  This
6911.2Smrg	   helps to avoid critical errors when upgrading.
6921.1Sabs    Use object directories:
6931.1Sabs	This helps to keep stale object
6941.1Sabs	   files from polluting the build if a Makefile "forgets"
6951.1Sabs	   about one.  It also makes it easier to clean up after
6961.1Sabs	   a build.  It's also necessary if you want to use the
6971.1Sabs	   same source tree for multiple machines.
6981.123Sjmc	   To use object directories with build.sh:
6991.123Sjmc	    a) invoke build.sh with the "-M" or "-O" options.
7001.123Sjmc	   To use object directories without using build.sh:
7011.1Sabs	    a) cd /usr/src ; make cleandir
7021.2Smrg	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
7031.2Smrg	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
7041.1Sabs	    d) cd /usr/src ; make build
7051.2Smrg	   Note that running "make obj" in a directory will create
7061.2Smrg	   in obj.$MACHINE directory.
7071.1Sabs    Build to a DESTDIR:
7081.123Sjmc	This helps to keep old installed files (especially libraries)
7091.123Sjmc	   from interfering with the new build.
7101.123Sjmc	   To build to a DESTDIR with build.sh, use the "-D" option.
7111.123Sjmc	   To build to a DESTDIR without using build.sh, set the DESTDIR
7121.123Sjmc	   environment variable before running make build.  It should be
7131.123Sjmc	   set to the pathname of an initially empty directory.
7141.123Sjmc	   Problems: if you do not use build.sh, you might need to
7151.123Sjmc		update critical utilities without using DESTDIR since
7161.123Sjmc		nothing is executed from what is installed in DESTDIR.
7171.123Sjmc		(See critical utils, below.)
7181.1Sabs    Build often:
7191.1Sabs	This keeps critical utilities current enough to not choke
7201.1Sabs	on any other part of the source tree that depends on up to
7211.123Sjmc	date functionality.  If you use build.sh, you should not have
7221.123Sjmc	this problem.
7231.241Swiz
7241.1SabsWhat to do if things don't work:
7251.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
7261.230StlsWhen things don't work there are usually a few things that commonly
7271.1Sabsshould be done.
7281.1Sabs    1)	make includes
7291.1Sabs	This should be done automatically by make build.
7301.1Sabs    2)  cd share/mk && make install
7311.1Sabs	Again, automatically done by make build.
7321.1Sabs
7331.1SabsFailsafe rebuild of a small part of the tree:
7341.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
7351.1SabsTo make sure you rebuild something correctly you want to do
7361.1Sabssomething like the following:
7371.1Sabs    1)  Make sure the includes and .mk files are up to date.
7381.1Sabs    2)  Make sure any program used to build the particular
7391.1Sabs	utility is up to date.  (yacc, lex, etc...)
7401.1Sabs    3)  cd ...path/to/util...
7411.1Sabs	make cleandir
7421.1Sabs	rm ...all obj directories...
7431.1Sabs	make cleandir			# yes, again
7441.1Sabs	make obj
7451.1Sabs	make depend && make
7461.1Sabs
7471.1SabsFailsafe rebuild of the entire tree:
7481.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
7491.1SabsIf you really want to make sure the source tree is clean and
7501.2Smrgready for a build try the following.  Note that sourcing /etc/mk.conf
7511.2Smrg(a make(1) Makefile) in this manner is not right, and will not work
7521.2Smrgfor anyone who uses any make(1) features in /etc/mk.conf.
7531.1Sabs
7541.1Sabs---cut here---
7551.1Sabs#!/bin/sh
7561.1Sabs. /etc/mk.conf
7571.1Sabs
7581.58Slukemif [ -z $NETBSDSRCDIR ] ; then
7591.58Slukem    NETBSDSRCDIR=/usr/src
7601.1Sabsfi
7611.58Slukemif [ \! -d $NETBSDSRCDIR ] ; then
7621.1Sabs    echo Unable to find sources
7631.1Sabs    exit 1
7641.1Sabsfi
7651.58Slukemfind $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
7661.1Sabs
7671.1Sabsif [ -z $BSDOBJDIR ] ; then
7681.1Sabs    BSDOBJDIR=/usr/obj
7691.1Sabsfi
7701.1Sabsif [ -d $BSDOBJDIR ] ; then
7711.1Sabs    rm -rf $BSDOBJDIR
7721.1Sabsfi
7731.1Sabs
7741.58Slukemcd $NETBSDSRCDIR && make cleandir
7751.1Sabs
7761.1Sabs---cut here---
7771.1Sabs
7781.1SabsCritical utilities:
7791.1Sabs^^^^^^^^^^^^^^^^^^^
7801.3Sitojun	usr.bin/compile_et
7811.1Sabs	usr.bin/make
7821.1Sabs	usr.bin/yacc
7831.1Sabs	usr.bin/lex
7841.11Slukem	usr.bin/xlint
7851.142Sdrochner	usr.bin/config
7861.1Sabs
7871.34SsimonbOther problems and possible solutions:
7881.1Sabs^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
7891.1SabsSymptom:Complaints involving a Makefile.
7901.17SerhFix:	Rebuild usr.bin/make:
7911.17Serh	cd usr.bin/make && make && make install
7921.111Ssimonb	Or, a failsafe method if that doesn't work:
7931.17Serh	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
7941.17Serh
7951.1SabsFix:	Make sure .mk files are up to date.
7961.1Sabs	cd share/mk && make install
7971.2Smrg
7981.2SmrgSymptom:Kernel `config' fails to configure any kernel, including GENERIC.
7991.142SdrochnerFix:	Rebuild usr.bin/config
8001.1Sabs
8011.1SabsSymptom:
8021.1SabsFix:	Rebuild usr.bin/yacc
8031.1Sabs
8041.1SabsSymptom:
8051.1SabsFix:	Rebuild usr.bin/lex
8061.1Sabs
8071.1SabsSymptom:
8081.1SabsFix:	rm /usr/lib/libbfd.a
8091.4Sitojun
8101.4SitojunSymptom:Obsolete intermediate files are used during compilation
8111.4SitojunFix:	Try the following sequence of commands in the directory in question.
8121.4Sitojun	make cleandir; rm `make print-objdir`; make cleandir; make obj
8131.4Sitojun	(If you built the tree without "make obj" in the past, obsolete files
8141.4Sitojun	may remain.  The command tries to clean everything up)
8151.5Swiz
8161.207SmbalmerSymptom:.../sysinst/run.c:xx: warning: initialization from incompatible
8171.207Smbalmer	pointer type
8181.5SwizFix:	Rebuild and install usr.bin/menuc
8191.12Sitojun
8201.12SitojunSymptom:mklocale not found during build in share/locale/ctype
8211.12SitojunFix:	Build and install usr.bin/mklocale
8221.13Sdogcow
8231.86SkleinkSymptom:undefined reference to `__assert13' or `__unsetenv13'
8241.13SdogcowFix:    Rebuild and install lib/libc
8251.13Sdogcow
8261.142SdrochnerSymptom:usr.bin/config fails to build.
8271.19ScgdFix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
8281.13Sdogcow
8291.19ScgdSymptom:undefined reference to `getprogname' or `setprogname'
8301.19ScgdFix:    Rebuild and install lib/libc
8311.24Sabs
8321.24SabsSymptom:lint does not understand the '-X' option
8331.24SabsFix:    May need to build & install libs with NOLINT=1 before rebuilding lint
8341.223Sjoerg
8351.223SjoergSymptom:Update build fails in src/tools/gcc complaining that a variable
8361.223Sjoerg	(e.g. CPPFLAGS) has changed since the previous run.
8371.223SjoergFix:    Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build.
8381.257Sapb
8391.257SapbSymptom:cvs [update aborted]: cannot open directory /cvsroot/src/...:
8401.257Sapb	No such file or directory.
8411.257SapbCause:	If a directory is created by mistake, then it is sometimes
8421.257Sapb	deleted from the CVS repository using administrative commands
8431.257Sapb	that bypass the normal cvs access controls.  If your cvs working tree
8441.257Sapb	contains references to a directory that has been deleted on the
8451.257Sapb	server in this way, then "cvs update" reports this error.
8461.257SapbFix:	Recursively delete the affected directory from your working tree
8471.257Sapb	and try the update again.
848