UPDATING revision 1.278
11.8Ssalo$NetBSD: UPDATING,v 1.278 2017/02/08 10:56:12 kre Exp $
21.1Schopps
31.1SchoppsThis file (UPDATING) is intended to be a brief reference to recent
41.1Schoppschanges that might cause problems in the build process, and a guide for
51.1Schoppswhat to do if something doesn't work.
61.1Schopps
71.1SchoppsFor a more detailed description of the recommended way to build NetBSD
81.1Schoppsusing build.sh, see the BUILDING file.
91.1Schopps
101.1SchoppsNote that much of the advice in this UPDATING file was written before
111.1Schoppsbuild.sh existed.  Nevertheless, the advice here may be useful for
121.1Schoppsworking around specific problems with build.sh.
131.1Schopps
141.1SchoppsSections are marked with "^^^^^".  After the section on "Recent changes"
151.1Schoppsare several sections containing more general information.
161.7Scgd
171.8SsaloSee also: BUILDING, build.sh, Makefile.
181.7Scgd
191.1SchoppsRecent changes:
201.7Scgd^^^^^^^^^^^^^^^
211.7Scgd
221.1Schopps20170107:
231.1Schopps	various arch dependent libc/exect.S files were removed
241.1Schopps	Either remove the obj directory (lib/libc) or do a
251.1Schopps	clean build.   (This is a bug in the make system, it should
261.1Schopps	be corrected without human intervention, but isn't.)
271.1Schopps
281.1Schopps20170104:
291.1Schopps	xinput build options have changed.
301.1Schopps	Remove the obj directory (external/mit/xorg/bin/xinput)
311.1Schopps	if you build.sh -u
321.7Scgd
331.7Scgd20170103:
341.1Schopps	a new version of flex has been imported.
351.1Schopps	Remove the file from obj (external/bsd/flex)
361.1Schopps	if you build.sh -u
371.1Schopps
381.1Schopps20161014:
391.3Sperry	a new version of OpenSSL has been imported.
401.3Sperry	Remove the files from obj (crypto/external/bsd/openssl) 
411.1Schopps	if you build.sh -u
421.1Schopps
431.1Schopps20161009:
441.1Schopps	a new version of dhcpcd has been imported with slightly changed
451.1Schopps	build infrastructure. When doing a build.sh -u this requires
461.4Scgd	pruning the external/bsd/dhcpcd objdir.
471.1Schopps
481.1Schopps20160914:
491.1Schopps	i386, amd64, shark, ofppc and macppc have joined shark and x68k
501.1Schopps	ports in using xorg-server 1.18. This requires a clean destdir
511.1Schopps	and a clean objdir.
521.1Schopps
531.1Schopps20160527:
541.1Schopps	i386 needs a full cleandir or objdir deletion because PIE has
551.1Schopps	been enabled. (see the amd64 entry two down for further info)
561.1Schopps
571.1Schopps20160418:
581.1Schopps	libedit needs manual removal of all autogenerated files since
591.1Schopps	some of them are not autogenerated anymore. Remember that there
60	might be two copies of libedit if your platform builds "compat".
61
6220160410:
63	amd64 needs full "make cleandir" or deletion of objdir now that
64	PIE has been enabled for amd64.  PIE, or position-independent
65	executables, means all code, including executables and not just
66	shared libraries, is position-independent and hence able to be
67	relocated by ASLR, address space layout randomization.
68
69	The change was made in Makefile variables for compiler and
70	linker flags, for which make(1) does not record dependencies,
71	hence it is unable to detect that all .o files need rebuilding.
72
73	Partial rebuilds with some modified source files will likely
74	fail when linking executables, since the linker refuses to mix
75	position-independent code with position-dependent code in
76	position-independent executables:
77
78		.../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC
79
8020160401:
81	Ports switching to GCC 5.3 will need a full "make cleandir".
82	Some people have found that cleandir is not sufficient, so if
83	in doubt delete the entire object directory tree for gcc.
84
8520160306:
86	NetBSD's regexp implementation is now part of libnbcompat.
87	Nblex, nbm4, nbpax, nbsed use it and they may crash on
88	non-NetBSD hosts if linked with stale object files produced
89	while they included a non-NetBSD regex.h.
90	In any case, you should "make cleandir" at least these tools
91	before updating your toolchain.
92
9320160125:
94	Dtrace has been enabled by default on some architectures.
95	When doing an update build, make sure to clean the etc/mtree
96	object directory before starting the build - otherwise the
97	needed directories in destdir will not be created.
98	An easy way to do this is:
99	   cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir
100
10120150818:
102	New acpica requires "make cleandir" in src/external/bsd/acpica
103	again.
104
10520150413:
106	New acpica requires "make cleandir" and reinstalling yacc
107	in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and
108	also "make cleandir" in /usr/src/external/bsd/acpica.
109
11020150404:
111	Lint changes require a full rebuild of the tool, so make
112	sure to build without -u option to build.sh, or manually
113	do a make cleandir in src/tools/lint1 and
114	src/usr.bin/xlint.
115
11620150310:
117	Improvements to openssl for arm mean that update builds of
118	the openssl libraries will fail. A make cleandir in
119	external/bsd/openssl/lib is needed
120
12120141026:
122	A mishap during the import of pppd may cause your corruption
123	in your cvs directory if you happened to do a cvs update
124	during a short period of time. To fix, just remove the
125	directory src/external/bsd/ppp/dist/pppd completely
126	and let cvs restore it on next update.
127
12820140721:
129	The src/external/mit/lua/src directory was accidentally created
130	and then deleted in the CVS repository.  If you get errors like
131
132	cvs [update aborted]: cannot open directory
133	/cvsroot/src/external/mit/lua/src: No such file or directory
134
135	then delete your local copy of that directory tree and try again.
136
13720140530:
138	ARM eABI switched to DWARF based exception handling. This requires
139	rebuilding all C++ code. It is strongly advised to do a clean build.
140
14120140131:
142	The new compiler_rt/libc integration moved a few things. It is strongly
143	advised to do a clean build. At least lib/libc, the compat version(s)
144	of libc, libkern, rump and the kernels need to be cleaned.
145
14620131227:
147	1. The new ntpd runs in a restricted mode to prevent amplification
148	   attacks. If you need ntpdc to work you need to explicitly enable
149	   mode7 in your config file. Make sure you put the necessary restrict
150	   statements to avoid being exposed.
151	2. strncat has moved from lib/libc to common/lib/libc; you might need
152	   to make clean in libc
153
15420131129:
155	The GMP sources were updated, and builds will likely fail without
156	cleaning their build trees for both tools and in-tree, like below.
157
15820131128:
159	The MPC and MPFR sources were updated, and builds may require their
160	tools and in-tree directories cleaned for successful updates.
161
16220130605:
163	The kernel option FAST_IPSEC no longer exists, it's been renamed
164	to IPSEC (and the older IPSEC version removed).
165
16620130605:
167	Previous freetype installations eroneously installed private
168	header files. If you are building against a non-empty $DESTDIR,
169	please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/.
170
17120130531:
172	The xdm update may cause build failure due to xdm.man being
173	in the obj tree.  Make sure to ensure any like this:
174		nbmake: nbmake: don't know how to make xdm.man. Stop
175	is fixed by deleting the xdm.man in the obj tree.
176
17720130530:
178	Updates of many xsrc packages will leave old .pc files around.
179	Best to clean out the xsrc objdir entirely before rebuilds.
180
18120130301:
182	The removal of netiso requires manual removal of /usr/include/netiso
183	prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump}
184
18520120726:
186	The update of OpenSSL requires cleaning both the OpenSSL build
187	directory and DESTDIR.  *Even non-update builds require cleaning
188	DESTDIR.* Builds done without taking these steps may fail, or in
189	some cases may succeed and install broken OpenSSL libraries that
190	cause third-party software to link incorrectly and/or crash.
191
19220120507:
193	The database schema for makemandb was changed.  You will
194	need to update the database using 'makemandb -f' or wait
195	for the next weekly run to fix it.
196
19720120319:
198	sys/conf/Makefile.kern.inc has been modified to adjust the
199	size of db_symtab automatically.  You need to update dbsym in
200	your $TOOLDIR to build kernels with options SYMTAB_SPACE.  If
201	you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your
202	mk.conf.
203
20420120216:
205	Default for MKCATPAGES changed to NO.  Update builds will fail
206	unless DESTDIR is cleaned manually.  If you built between 20120207
207	and 20120216, daily and weekly could have created an unreadable
208	/var/db/man.db index for apropos.  Running makemandb -f or
209	the next run of weekly will fix it.
210
21120111227:
212	If you built between 20111225 and 20111227 you need to remove
213	/usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the
214	bump has been reverted.
215
21620111125:
217	The "rnd" pseudodevice has been added to sys/conf/std, which
218	means it should no longer be explicitly listed in kernel
219	configuration files.  The line "pseudo-device rnd" should be
220	removed from any custom kernel config files users may have.
221
22220111119:
223	A problem with the datastructures used by the rndctl(8)
224	utility (pointers in datastructures in an array, making 32->64
225	bit compatibility very painful) has been fixed in a
226	non-backwards-compatible way.  If you replace your kernel,
227	replace your rndctl executable too.
228
22920111001:
230	the prop_*_send_syscall() functions from proplib(3) have been
231	changed and their new version is not backward compatible with the old
232	one.  So ensure that all consumers of these functions (currently:
233	quota2 code and its tests) are updated together with the new lib.
234
23520110817:
236	sparc has been changed to use GCC 4.5.3, so any objdir or
237	DESTDIR for them should be deleted before updating.
238
23920110806:
240	i386 and amd64 have been changed to use GCC 4.5.3, so any
241	objdir or DESTDIR for them should be deleted before updating.
242
24320110805:
244	The update to GCC 4.5.3 requires a non-trivial portion of
245	the tree to be cleaned.  Best to delete both objdir and
246	DESTDIR before running this update.  So far, only the
247	sparc64, mips and powerpc platforms have changed.
248
24920110803:
250	The layout of external/public-domain/xz has changed.  To do an
251	update build you will have to remove the contents of the OBJDIR
252	for external/public-domain/xz/bin by hand as the xz entry there
253	is now a directory.
254
25520110410:
256	The configuration of src/tools/gcc has changed.  To do an
257	update build you have to clean both tools/binutils and
258	tools/gcc by hand.
259
26020110328:
261	Building the Xorg binary was moved into a subdirectory to fix
262	ordering issues with "make all".  It may be necessary to remove
263	the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86
264	if your update build fails, as the "Xorg" entry there is now a
265	directory.
266
26720110121:
268	Assembler files no longer use -traditional-cpp.  This can break
269	the build of individual parts of the tree.  This is handled
270	correctly by build.sh.  Manual builds have to update /usr/share/mk
271	and re-run config(1) for any kernel configurations as needed.
272
27320101217:
274	The tcpdump(8) program was changed to drop privileges and chroot(2)
275	by default.  It may be necessary to manually update passwd(5) and
276	group(5) in order to make the program work with existing setups.
277
27820101125:
279	The latest changes to setenv(3) dissallow setting environment
280	variables with names that contain '='.  Revision 1.18 of env.c
281	assumed that this was allowed.  Installing a new libc with an
282	old copy of /usr/bin/env causes env x=1 printenv | grep x= to
283	break which affects the autoconf tests for dependency finding,
284	so building gcc will end up printing:
285	    checking dependency style of gcc... none
286	    configure: error: no usable dependency style found
287	Fix it by rebuilding and re-installing env.
288
28920101119:
290	Recent Xorg updates in xsrc/external/mit/ may cause various build
291	or run-time problems.  Delete your entire DESTDIR and OBJDIR if you
292	have any build problems with xsrc, or problems with mismatched
293	versions between xorg-server and drivers.
294
29520100604:
296	The update of ATF to 0.9 causes old tests written in shell to fail
297	unless they are rebuilt.  If you are building with MKUPDATE=yes,
298	you need to clean the src/external/bsd/atf/tests/ and the src/tests/
299	trees by hand.
300
30120100522:
302	Recent Xorg updates in xsrc/external/mit/ will cause various build
303	problems.  Delete your entire DESTDIR and OBJDIR if you have any
304	build problems with xsrc.
305
30620100522:
307	private section of <ctype.h> was splitted, and now mklocale(1)
308	include ctype_local.h, so you have to make cleandir in tools/mklocale.
309
31020100520:
311	The location of the xkb compiled descriptions has changed.  Please
312	remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR.
313
31420100222:
315	The shared objects file extension has been changed from .so to
316	.pico, in order to avoid conflicts with shared libraries names
317	libXX.so.  All now stale regular .so files can be removed from
318	your object directories.
319
32020100204:
321	The termcap database has been removed from the sources,
322	but has not been marked obsolete so it is not removed
323	from the system when upgrading.
324	As such, you will need to remove them from your object
325	and destination directories.
326
32720091101:
328        After updating, it may be necessary to make the 'cleandir'
329        target in src/tools/yacc/ and in src/usr.bin/yacc/ before a
330        'build.sh -u tools' or 'build.sh -u distribution'.  Ditto
331        src/tools/lex/ and src/usr.bin/lex/.
332
33320091001:
334	On amd64 you must rebuild tools (to get the new binutils)
335	before building a kernel, or the build fails on cpufunc.S.
336
33720091001:
338	An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb
339	symlink, failing the build.  Delete the link, and the subdir
340	it is in, and retry your build.
341
34220090718:
343	libc build changed so that strchr() provides the extra entry
344	point for index().  Update build of libc.a (and libc_pic.a)
345	may fail because the archive contains the unwanted index.o.
346	(Similarly for strrchr() and rindex().)
347
34820090709:
349	Native Xorg was upgraded again.  Builds will probably fail again
350	without a clean objdir, at least for src/external/mit/xorg.
351
35220090616:
353	Native Xorg was upgraded.  Builds will need a clean objdir for
354	src/external/mit/xorg.  Upgrading a system from sets will not
355	work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
356	subdirectory has been changed into a file, and this needs to
357	be manually "rm -r"'ed before installing xbase.tgz.
358
35920090501:
360	Several new functions were added to string.h/libc, and this
361	can cause autoconf problems during the tool build for people
362	who fail to clean out their tools objects properly.  If you
363	note messages about stpcpy, stpncpy or strnlen accompanying a
364	failure during the tool build, clean out all your tools
365	objects and start again.
366
36720090325:
368	The i386 port was switched to i486 default toolchain.  This requires
369	cleaning your src/tools directory and $TOOLDIR and rebuilding them.
370
37120090126:
372	The __posix_fadvise50 system call changed assembly stub type.  You
373	need to 'rm -f __posix_fadvise50.*' in the libc build directory
374	to avoid using the old assembly stub.
375
37620090202:
377	pkg_install now depends on the pkgdb cache for automatic conflict
378	detection.  It is recommented to rebuild the cache with
379	``pkg_admin rebuild''.
380
38120090110:
382	time_t and dev_t have been bumped to 64 bit quantities.  To upgrade:
383	1. Make sure your kernel has COMPAT_50 in it.  Build and install.
384	   This is needed even in the MODULAR kernel because there is
385	   conditionally compiled code in rtsock.c.
386	2. make sure build.sh completes and the binaries in a chroot work
387	   before installing.
388	3. If you don't use build.sh and you build directly to root, and
389	   your build breaks in the middle, don't despair.  Make sure headers
390	   are installed properly, and start building libraries first libc
391	   and libutil, install them and then continue building all the
392	   libraries in src/lib and src/gnu/lib and install them.  Once
393	   the new libraries are installed, you can restart the build.
394	4. If you compile packages and you notice link time warnings,
395	   rebuild the required packages to update their shared libraries.
396	   Any package you rebuild will require rebuilding all the packages
397	   that depend on it.
398	5. Next time you run pwd_mkdb with the new binary, the file
399	   will be upgraded and it will not be backwards compatible.
400	6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see
401	   lastlogx(5)) have been versioned, and there is a heuristic
402	   for utmp.  You are better off removing the old files after
403	   upgrading.  The automated clearing of /var/run during
404	   boot, and the automated rotating of files in /var/log by
405	   newsyslog(8), may mean that you do not have to remove the
406	   files manually.
407	7. The optional accounting file (/var/account/acct, see
408	   accton(8)) has not been versioned, and will need to be
409	   removed.  The automatic rotation of the accounting file by
410	   /etc/daily limits the bad consequences of failure to remove
411	   the file.
412	8. Application software that writes time_t to binary files on
413	   disk will break or need attention.  Most notably: if you are
414	   using PostgreSQL < 8.4, you need to dump your databases,
415	   rebuild PostgreSQL with the new time_t, then restore.
416
41720081219:
418	config(1) has been updated, and one of the files it creates -
419	swapnetbsd.o - has changed format.  You need to rebuild config
420	(done automatically by build.sh) and then you need to rerun
421	config on all kernel configuration files before rebuilding those
422	kernels.
423
42420081205:
425	If you build with MKX11=no, you should remove /etc/rc.d/xdm and
426	/etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
427	set and will appear as extra files for MKX11=no update builds.
428
42920081122:
430	On i386, various kernel options(4) in GENERIC including
431	file systems have been disabled and moved into kernel modules.
432	Before trying a new GENERIC kernel, you have to prepare the
433	following files as well as a new GENERIC kernel:
434
435	- build and install kernel modules from src/sys/modules
436
437	- install the latest bootloader, which will load a module
438	  for the file system from which the kernel is loaded automatically
439
440	If you have to load your kernel from a file system which is not of
441	the same type as the root file system, you have to load the necessary
442	file system module manually on the boot prompt or in the boot.cfg file.
443
44420080827:
445	If you built and installed a libc from sources between
446	2008/08/20 and 2008/08/26 you got a broken strtouq(3)
447	which results in false errors reported by lint(1).
448	Since this breaks the libc build itself, manual help is
449	needed -- lint must be disabled temporarily, e.g.:
450	  $ (cd lib/libc && make MKLINT=no dependall install)
451
45220080813:
453	MKDEBUG build was broken because the .depend files did not know
454	about .go files.  You need to remove all .depend files and rebuild.
455
45620080802:
457	A regression in binary compatibility for pthread_mutex_t has
458	been fixed.  Unfortunately, the price is breaking compatibility
459	for -current.
460
461	Threaded programs (using libpthread) and C++ programs (using
462	libstdc++) compiled after 20070907 and before 20080802 need to
463	be recompiled.
464
465	One way to find affected pkgsrc packages:
466
467	  $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO
468	  $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO
469
47020080731:
471	WAPBL (metadata journaling support) has been added, but at this
472	time isn't backwards compatible with pre-WAPBL aware kernels
473	and userland (fsck_ffs in particular).  Please make sure you
474	don't use a journaled filesystem with an older kernel/userland,
475	especially an uncleanly mounted journaled filesystem.  WAPBL
476	also requires the super block to be in the UFS2 format.  You
477	can use fsck_ffs -c 4 to update the superblock format.
478
47920080721:
480	Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
481	isn't defined.
482
48320080531:
484	The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
485	from 125 (conflicted with DRVCTLCOMMAND) to 129.  The drvctl(8)
486	utility needs to be rebuilt and reinstalled as older binaries
487	won't work correctly.  The following sequence of commands:
488
489	  $ (cd sys/sys/ && nbmake-$arch includes)
490	  $ (cd sbin/drvctl/ && nbmake-$arch clean)
491	  $ (cd sbin/drvctl/ && nbmake-$arch all)
492
493	leaves new drvctl utility in sbin/drvctl build directory.
494
49520080503:
496	The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
497
49820080521:
499	For a while, unprivileged UPDATE builds would fail to
500	succeed at the checkflist stage, complaining that
501	${DESTDIR}/stand/<arch>/ did not exist.  A fix for this
502	problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
503	If you already hit this problem, update the .mk file,
504	remove ${DESTDIR}/stand/<arch>, and re-run the build.
505
50620080303:
507	Linker warnings are now fatal if $WARNS>0.
508
50920080126:
510	The posix_fadvise system call has been changed from an assembly
511	stub, to a c file that calls an assembly stub.  You need to
512	'rm -f posix_fadvise.* .depend' in the libc build directory to
513	avoid using the old assembly stub.
514
51520071209:
516	The acpiec(4) driver has been split into two attachments.  If you
517	get ACPI errors before the attachment, please update your kernel
518	configuration file appropriately or see GENERIC for more details.
519
52020071115:
521	The it(4) driver has been renamed to itesio(4) and the old port
522	argument specified in the kernel configuration file is not valid
523	anymore.  The itesio(4) driver now uses the Super I/O address port
524	rather than the EC address port.  Please update your kernel
525	configuration file appropriately or see GENERIC for more details.
526
52720071028:
528	The pccons(4) driver has been removed from the NetBSD/shark port.
529	You need to update any custom kernel configuration file you have
530	to remove any references to pccons (which includes removing the
531	now useless XSERVER option) and replace them with the correct
532	entries for the wscons driver.  See the GENERIC configuration file
533	for more details.
534
53520070913:
536	A latent bug in dhclient/dhcpd that caused it to be unable to
537	enumerate interfaces was fixed.  The bug began to cause
538	problems after 20070911 when the kernel's SIOCGIFCONF
539	implementation was repaired.  From 20070529 to 20070911 racoon
540	could not enumerate interfaces.  (These are noted because
541	normal kernel/userspace version matching hygiene is not
542	sufficient to avoid this problem.)  Ensure that both kernel
543	and userland are from after 20070913.
544
54520070703:
546	nbinstall has been renamed ${MACHINE_GNU_ARCH}-install.  It
547	calls the target-specific strip program, and the logic to pass
548	down STRIP from make has been removed.  This requires a
549	re-installation of tools.
550
55120070422:
552	The way OS emulations lookup filenames inside the emulation root
553	has been changed.  Rather than modify the pathname (and copy back
554	to userspace) namei() and lookup() directly check the emulation
555	root.  One side effect is that absolute symlinks inside the emulated
556	root file system will be relative to that file system - unless they
557	start /../ this is useful when the emulated root is a real install
558	that has such links.
559	This might affect symlinks that have been added to reference outside
560	the emulated root.
561
56220070412:
563	The pckbc driver on sgimips IP32 has been removed.  Use macekbc
564	instead.  See the GENERIC32_IP3x kernel configuration for an
565	example.
566
56720070319:
568        src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
569        on many platforms due to incorrect flags settings.  If you
570        updated and built after about 20070315, do "nbmake-$arch
571	cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
572	rebuild of object files that might have been built
573	incorrectly, and ensure that you have at least
574	src/lib/libc/Makefile 1.130.
575
57620070210:
577        src/sys/sys/{sa.h,savar.h} were removed.
578          find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
579              | xargs egrep -l '/sa.h|/savar.h' | xargs rm
580        will allow dependencies on those files to get get rebuilt
581
58220070209:
583        The threading model was changed when the newlock2 branch
584        was merged to NetBSD-current.  If you boot with a new
585        kernel (version 4.99.10), then you also need a new pthread
586        library (/usr/lib/libpthread.so.0.7).  If you boot with
587        an old kernel, then you need the old pthread library
588        (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
589        the pthread library in sync, old threaded applications should
590        continue to work with an old or new kernel.  Note that named(8)
591	is the only threaded application in the base system.
592
59320061214:
594	Following the move of string_to_flags() and flags_to_string()
595	from the bin/ls/ sources to libutil, users doing UPDATE builds
596	will need to do a "make cleandir" in
597		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
598		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
599		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
600		as the installation images in distrib/
601	in order to excise stale references to the old stat_flags.h header
602	file in the ls sources -- stat_flags.h has been removed.
603
60420061108:
605	The configure script used in the src/tools/gcc compiler has been
606	changed to indicate that our libc has ssp support built-in and
607	does not depend on -lssp and -lssp-nonshared.  You'll need to
608	make clean in src/tools/gcc first to rebuild the compiler.
609
61020061009:
611	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
612	available.  Use net.inet{,6}.tcp{,6}.congctl.selected instead.
613
61420060814:
615	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
616	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
617	kernel configuration for an example.  X servers from the last
618	few years should cope.
619
62020060703:
621	MPACPI is no more.  We always configure PCI interrupts using ACPI
622	if we have an ACPI kernel.  The option MPACPI_SCANPCI has been renamed
623	to ACPI_SCANPCI.  Thanks to work from fvdl.
624
62520060627:
626	socket(2) has changed, and its system call has been versioned.
627	For userlands with the old version of socket(2), make sure that
628	your kernel has 'options COMPAT_30' set, or else 'bad system call'
629	errors will result.
630
631Hints for a more successful build:
632^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
633    Use build.sh, but do not use its "expert mode":
634	This will automatically build the tools in the
635	   correct order, and it will keep the tools and the
636	   new build products from interfering with the running
637	   system.  This will allow you to ignore most of the
638	   other advice in this file.
639    Build a new kernel first:
640	This makes sure that any new system calls or features
641	   expected by the new userland will be present.  This
642	   helps to avoid critical errors when upgrading.
643    Use object directories:
644	This helps to keep stale object
645	   files from polluting the build if a Makefile "forgets"
646	   about one.  It also makes it easier to clean up after
647	   a build.  It's also necessary if you want to use the
648	   same source tree for multiple machines.
649	   To use object directories with build.sh:
650	    a) invoke build.sh with the "-M" or "-O" options.
651	   To use object directories without using build.sh:
652	    a) cd /usr/src ; make cleandir
653	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
654	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
655	    d) cd /usr/src ; make build
656	   Note that running "make obj" in a directory will create
657	   in obj.$MACHINE directory.
658    Build to a DESTDIR:
659	This helps to keep old installed files (especially libraries)
660	   from interfering with the new build.
661	   To build to a DESTDIR with build.sh, use the "-D" option.
662	   To build to a DESTDIR without using build.sh, set the DESTDIR
663	   environment variable before running make build.  It should be
664	   set to the pathname of an initially empty directory.
665	   Problems: if you do not use build.sh, you might need to
666		update critical utilities without using DESTDIR since
667		nothing is executed from what is installed in DESTDIR.
668		(See critical utils, below.)
669    Build often:
670	This keeps critical utilities current enough to not choke
671	on any other part of the source tree that depends on up to
672	date functionality.  If you use build.sh, you should not have
673	this problem.
674
675What to do if things don't work:
676^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
677When things don't work there are usually a few things that commonly
678should be done.
679    1)	make includes
680	This should be done automatically by make build.
681    2)  cd share/mk && make install
682	Again, automatically done by make build.
683
684Failsafe rebuild of a small part of the tree:
685^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
686To make sure you rebuild something correctly you want to do
687something like the following:
688    1)  Make sure the includes and .mk files are up to date.
689    2)  Make sure any program used to build the particular
690	utility is up to date.  (yacc, lex, etc...)
691    3)  cd ...path/to/util...
692	make cleandir
693	rm ...all obj directories...
694	make cleandir			# yes, again
695	make obj
696	make depend && make
697
698Failsafe rebuild of the entire tree:
699^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
700If you really want to make sure the source tree is clean and
701ready for a build try the following.  Note that sourcing /etc/mk.conf
702(a make(1) Makefile) in this manner is not right, and will not work
703for anyone who uses any make(1) features in /etc/mk.conf.
704
705---cut here---
706#!/bin/sh
707. /etc/mk.conf
708
709if [ -z $NETBSDSRCDIR ] ; then
710    NETBSDSRCDIR=/usr/src
711fi
712if [ \! -d $NETBSDSRCDIR ] ; then
713    echo Unable to find sources
714    exit 1
715fi
716find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
717
718if [ -z $BSDOBJDIR ] ; then
719    BSDOBJDIR=/usr/obj
720fi
721if [ -d $BSDOBJDIR ] ; then
722    rm -rf $BSDOBJDIR
723fi
724
725cd $NETBSDSRCDIR && make cleandir
726
727---cut here---
728
729Critical utilities:
730^^^^^^^^^^^^^^^^^^^
731	usr.bin/compile_et
732	usr.bin/make
733	usr.bin/yacc
734	usr.bin/lex
735	usr.bin/xlint
736	usr.bin/config
737
738Other problems and possible solutions:
739^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
740Symptom:Complaints involving a Makefile.
741Fix:	Rebuild usr.bin/make:
742	cd usr.bin/make && make && make install
743	Or, a failsafe method if that doesn't work:
744	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
745
746Fix:	Make sure .mk files are up to date.
747	cd share/mk && make install
748
749Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
750Fix:	Rebuild usr.bin/config
751
752Symptom:
753Fix:	Rebuild usr.bin/yacc
754
755Symptom:
756Fix:	Rebuild usr.bin/lex
757
758Symptom:
759Fix:	rm /usr/lib/libbfd.a
760
761Symptom:Obsolete intermediate files are used during compilation
762Fix:	Try the following sequence of commands in the directory in question.
763	make cleandir; rm `make print-objdir`; make cleandir; make obj
764	(If you built the tree without "make obj" in the past, obsolete files
765	may remain.  The command tries to clean everything up)
766
767Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible
768	pointer type
769Fix:	Rebuild and install usr.bin/menuc
770
771Symptom:mklocale not found during build in share/locale/ctype
772Fix:	Build and install usr.bin/mklocale
773
774Symptom:undefined reference to `__assert13' or `__unsetenv13'
775Fix:    Rebuild and install lib/libc
776
777Symptom:usr.bin/config fails to build.
778Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
779
780Symptom:undefined reference to `getprogname' or `setprogname'
781Fix:    Rebuild and install lib/libc
782
783Symptom:lint does not understand the '-X' option
784Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
785
786Symptom:Update build fails in src/tools/gcc complaining that a variable
787	(e.g. CPPFLAGS) has changed since the previous run.
788Fix:    Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build.
789
790Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...:
791	No such file or directory.
792Cause:	If a directory is created by mistake, then it is sometimes
793	deleted from the CVS repository using administrative commands
794	that bypass the normal cvs access controls.  If your cvs working tree
795	contains references to a directory that has been deleted on the
796	server in this way, then "cvs update" reports this error.
797Fix:	Recursively delete the affected directory from your working tree
798	and try the update again.
799