UPDATING revision 1.158
1$NetBSD: UPDATING,v 1.158 2007/03/10 00:10:15 dbj Exp $
2
3This file (UPDATING) is intended to be a brief reference to recent
4changes that might cause problems in the build process, and a guide for
5what to do if something doesn't work.
6
7For a more detailed description of the recommended way to build NetBSD
8using build.sh, see the BUILDING file.
9
10Note that much of the advice in this UPDATING file was written before
11build.sh existed.  Nevertheless, the advice here may be useful for
12working around specific problems with build.sh.
13
14See also: BUILDING, build.sh, Makefile.
15
16Recent changes:
17^^^^^^^^^^^^^^^
18
1920070210: 
20        src/sys/sys/{sa.h,savar.h} were removed.
21          find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
22              | xargs egrep -l '/sa.h|/savar.h' | xargs rm
23        will allow dependencies on those files to get get rebuilt
24
2520070209:
26        The threading model was changed when the newlock2 branch
27        was merged to NetBSD-current.  If you boot with a new
28        kernel (version 4.99.10), then you also need a new pthread
29        library (/usr/lib/libpthread.so.0.7).  If you boot with
30        an old kernel, then you need the old pthread library
31        (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
32        the pthread library in sync, old threaded applications should
33        continue to work with an old or new kernel.  Note that named(8)
34	is the only threaded application in the base system.
35
3620061214:
37	Following the move of string_to_flags() and flags_to_string()
38	from the bin/ls/ sources to libutil, users doing UPDATE builds
39	will need to do a "make cleandir" in
40		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
41		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
42		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
43		as the installation images in distrib/
44	in order to excise stale references to the old stat_flags.h header
45	file in the ls sources -- stat_flags.h has been removed.
46
4720061108:
48	The configure script used in the src/tools/gcc compiler has been
49	changed to indicate that our libc has ssp support built-in and
50	does not depend on -lssp and -lssp-nonshared. You'll need to
51	make clean in src/tools/gcc first to rebuild the compiler.
52
5320061009:
54	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
55	available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
56
5720060814:
58	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
59	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
60	kernel configuration for an example.  X servers from the last
61	few years should cope.
62
6320060703:
64	MPACPI is no more. We always configure PCI interrupts using ACPI
65	if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
66	to ACPI_SCANPCI. Thanks to work from fvdl.
67
6820060627:
69	socket(2) has changed, and its system call has been versioned.
70	For userlands with the old version of socket(2), make sure that
71	your kernel has 'options COMPAT_30' set, or else 'bad system call'
72	errors will result.
73
7420060526:
75	The kernel linker scripts for i386 and xen 
76	(sys/arch/i386/conf/kern.ldscript*) were changed to set the
77	load address correctly, for the benefit of MULTIBOOT boot loaders
78	(like Grub). If you use a linker (ld) older than from 2006/04/17, it
79	will be unable to link the kernel because of a bug and ld will fail
80	with an error like:
81	    ../../../../arch/i386/conf/kern.ldscript:45 \
82		non constant expression for load base
83	You need to update at least src/gnu/dist/binutils/ld and recompile
84	and install the linker. If using the build.sh script, the easiest
85	way is with a "build.sh tools" command, with any other options
86	that you use normally. When using build.sh, the linker binary is
87	installed as ${TOOLDIR}/bin/i386--netbsdelf-ld.
88
8920060131:
90	the protocol between the sparc64 bootloader (ofwboot) and
91	the kernel was changed. Before installing a new kernel,
92	you need to update ofwboot. After a full build, just copy
93	/usr/mdec/ofwboot to /, or do a rebuild of
94	src/sys/arch/sparc/stand/ofwboot and install the result to /.
95
9620050917:
97	arch/*/conf/std.* was changed to include conf/std, which
98	contains MI options previously enabled by default.
99	If you have kernel config files which doesn't include
100	arch/*/conf/std.*, you need to edit them to include conf/std
101	to get the previous configuration.
102
10320050830:
104	named.conf was moved from /etc/namedb to /etc.
105	postinstall(8) migrates this during interactive use.
106	Users of MKUPDATE=yes will need to manually rectify
107	this in their DESTDIR.
108
10920050825:
110	Some data structures in sys/device.h, related to interface
111	attributes and locator names, were changed. config(1) was
112	modified to emit the new data structures.
113	Thus usr.bin/config must be updated (and run on the kernel
114	configuration file) before a new kernel can be built.
115
11620050531:
117	genassym.sh(8) was moved to genassym(1). You need to either build
118	tools first or install the version of genassym from /usr/bin before
119	you can build a kernel again.
120
12120050520:
122	Because a kernfs bug which xentools relies on was fixed,
123	xentools up to xentools20-2.0.3nb4 won't work with new kernel.
124
12520050417:
126	postinstall(8) was moved from /etc to /usr/sbin and made part
127	of the "base" set, to make it easier to invoke after an
128	upgrade.
129
13020050325:
131	pcppi(4) was separated in two devices, adding attimer(4).  Be sure
132	to add a config line for an attimer(4) device in your kernel
133	configuration, or you won't be able to set the pitch of the beep
134	with wsconsctl.  Depending on the default value for the pitch, you
135	might even not hear any more beep.  Also, it is advised to attach both
136	devices the same way (i.e., both on isa or both on acpi) or the
137	pcppi(4) device may fail to find the attimer(4) one.
138
13920050211:
140	Fixes to tools/Makefile.gnuhost may cause UPDATE=1 builds in
141	some of the cross tools to fail if they use configure. Some configure's
142	cache the environment passed in and notice the new environment is
143	different and abort. Doing a clean in tools/ should be enough to
144	make a build continue.
145
14620050109:
147	Since su is using pam by default now, make sure that you have
148	/etc/pam.d populated (postinstall will do that automatically
149	for you). Otherwise su will fail open (i.e. will not require
150	a password).
151
15220041229:
153	Make had a path resolution bug that manifested itself as not
154	being able to install openpam.3. This bug has been fixed, but
155	you might need to rebuild make manually first to get through
156	the build.
157
15820041201:
159	Userland programs have been changed to use /dev/bpf instead of
160	/dev/bpfX. You need to create that device by installing a new
161	MAKEDEV and running it, or mv /dev/bpf0 /dev/bpf && rm /dev/bpf[0-9]*
162
16320041006:
164
165	A bug was introduced into /bin/sh (var.c rev 1.35) which causes
166	variables to not export correctly to subshells in all cases. This
167	will cause builds to break if that version of /bin/sh is installed
168	on the system. The proper version of /bin/sh can be verified with:
169
170        ident /bin/sh | grep var
171
172	Any /bin/sh w. version 1.35 will not work and needs to be updated
173	before attempting a build.
174	
17520041001:
176	The ipfilter kernel sources moved from sys/netinet to
177	dist/sys/ipf/netinet. Due to the move some Makefile
178	dependencies are now dangling requiring a make cleandir
179	before they work again (kdump, ktruss, rescue, ipf, and
180	ftp-proxy are the victims).
181
18220040715:
183	The rc.d/sendmail script now uses a heuristic to determine
184	if sendmail should be started at boot time.  It checks the
185	contents of /etc/mailer.conf, /etc/mail/submit.cf, and the
186	owner and mode of the sendmail binary to see if any changes
187	to the mail infrastructure have been made.  If no changes
188	are detected, it will start an SMTP listener.
189
190	Setting sendmail=NO in /etc/rc.conf will override this.
191
192	If you are only using sendmail by default and only for
193	local delivery, it is important that you also update your
194	sendmail.cf so that the SMTP listener only listens on the
195	loopback interface.
196
19720040715:
198	The method by which athhal-elf.o gets pulled into i386
199	kernel builds has been changed again.  The latest version
200	of bsd.files.mk is no longer required.
201
20220040621:
203	Due to the recent rototill of tools/compat it's crucial one starts
204	from a clean objdir under tools/*.
205
206	This is mostly due to generated files (yacc and lex sources) needing
207	to be generated with new rules from bsd.hostprog.mk.
208
209	The safest course is to rm -rf all objects under tools before building.
210
21120040516:
212	The end-user modifiable X11 configuration has been moved
213	from /usr/X11R6/lib/X11/<dir> to /etc/X11/<dir>.
214	Ensure that src and xsrc is up to date, and run
215	"make cleandir" in src/x11 before your next build.
216
217	postinstall currently doesn't migrate the files from
218	/usr/X11R6/lib/X11/* to /etc/X11/* although it does
219	detect that this needs to occur, so you'll have to
220	manually move these files yourself.
221
22220040426:
223	Support for the original dynamic sysctl node structure has
224	been removed in favor of the newer layout.  This affects
225	consumers of the create and delete interface, as well as
226	the dynamic discovery mechanism.  This is believed only to
227	be the sysctl(8) binary itself, at this point in time, so
228	the only effect of this should be that a sysctl binary
229	built from sources dated between 2003/12/04 and 2004/03/24
230	will not work on a kernel built from sources dated after
231	2004/04/25.  If you need a new sysctl binary but build.sh
232	does not work, make sure that your revision of
233	src/sys/sys/sysctl.h is 1.112 (or later), and then the
234	do the following:
235
236	cd /usr/src (or wherever your source tree is)
237	make USETOOLS=no includes
238	cd lib/libc
239	make USETOOLS=no dependall install
240	cd ../../sbin/sysctl
241	make USETOOLS=no dependall install
242
243	If you are using older sysctl binary, GNU autoconf would fail to
244	identify your machine architecture, and tries to build binary for
245	"unknown-unknown-netbsd20F" or something like that.  if that happens,
246	make sure to follow the above steps.
247
24820040425:
249	The ffs superblock issues listed below under 20040109 and 20030402
250	are now automatically addressed by the /etc/rc.d/fixsb script or by
251	sysinst when it checks a a filesystem. The manual fsck_ffs -b16 -c4
252	invocation mentioned below will continue to work and is now
253	automated by those scripts.  Note that under certain circumstances,
254	affected filesystems upgraded to a -current kernel first before
255	upgrading their userland with the fixsb and fsck_ffs fixes may
256	encounter a 'freeing free inode' panic when writing to the affected
257	filesystem, so it is a good idea to repair the filesystem as soon as
258	possible.  For more details on the fixsb script, see pr install/25138.
259
26020040418:
261	statfs(2) and friends have been replaced with statvfs(2). Before
262	installing a newly build userland make sure that you are running
263	a newly built kernel with COMPAT_20 set. In addition your libc
264	build might not work (undefined SYS_statfs symbol) because make
265	clean does not know how to remove files it does not know about
266	anymore. Manually remove all generated .S sources and objects
267	from the libc build directory.
268
26920040326:
270	The method by which athhal-elf.o gets pulled into i386 kernel builds
271	has been changed. The file is now stored as a uuencoded file in CVS
272	and the generated Makefile will use the new .uue rules from bsd.file.mk
273	to build it.
274
275	This means you must have the latest bsd.files.mk installed when
276	building a kernel without USETOOLS=yes.
277
27820040318:
279	A bug in the cgd(4) blowfish code was corrected, without
280	provision of backwards compatibility, after several public
281	notices over several months. Users of cgd with blowfish cipher
282	ONLY must dump their data before updating their kernels, and
283	recreate cgd's and restore data using the new kernel. See
284	(recent message to current-users, URL when mail-index has updated)
285
28620040313:
287	On acorn32, the opms and qms drivers have been withdrawn, and
288	the old wsqms driver is now called qms.  Kernel config files
289	will need updating.  See the ones in sys/arch/acorn32/conf
290	for examples.
291
29220040125:
293	On acorn32, the beep and sysbeep devices are no longer
294	needed, and will need to be deleted from kernel configuration
295	files.
296
29720040109:
298	Compatibility for old ffs superblock layouts has been
299	added, and the restrictive fsck checks have been reenabled
300	when using those layouts.  If you have been using -current
301	since 20030402, you may find that fsck again signals fatal
302	superblock mismatches.  To repair, make sure you have
303	an updated fsck_ffs and then you can use fsck_ffs -b 16 -c 4
304	to complete the filesystem upgrade.  A message has
305	been added to the kernel which should detect this problem.
306	See the following discussion for more information:
307	http://mail-index.NetBSD.org/current-users/2004/01/11/0022.html
308
30920031203:
310	New binutils builds may fail due to old dependencies.
311	It's necessary to "make cleandir" to ensure that
312	the dependencies will be rebuilt correctly.
313
31420031111:
315	A newer mkdep is needed.  Error noting that is
316		cc: Ambiguous abbreviation --
317
31820031008:
319	/usr/include/sys/disklabel_mbr.h was removed.
320	It's necessary to "make cleandir" to ensure that
321	the dependencies will be rebuilt correctly.
322
32320031007:
324	A sign extension bug was fixed which set all the high bits
325	of our newly expanded ffs fs_flags.  This should only
326	affect users who installed or upgraded in September of 2003.
327	A small utility program was posted to tech-kern which
328	should fix this problem, and a warning message was added
329	to the kernel which should discover and warn about it.  See
330	http://mail-index.NetBSD.org/tech-kern/2003/10/07/0005.html
331
33220030906:
333	With the addition of siginfo support the old signal trampoline
334	code has been deprecated to COMPAT_16. Make sure that your running
335	kernel has COMPAT_16 enabled before building userland.
336
33720030801:
338	With the new openssl, there is some header and library shuffling.
339	rm -f /usr/include/des.h /usr/include/kerberosIV/* /lib/libdes* \
340	/usr/lib/libdes* before building.
341
34220030703:
343	Texinfo was updated to 4.6.  To avoid failures when trying to
344	build the included texinfo files, do:
345
346	cd src/gnu/usr.bin/texinfo
347	make MKINFO=no dependall install
348
34920030630:
350	Groff was updated to 1.19; it's probably necessary to do
351		cd share/mk && make install
352		cd src/gnu/usr.bin/groff
353		make MKMAN=no dependall install
354	(untested).
355
35620030516:
357	Due to bugs in the export handling code, invalid export lines
358	were accepted before and caused the kernel to panic when
359	mountd got restarted because it freed memory that had already
360	been freed. This has been fixed and the kernel checks
361	export addresses very strictly. If you upgrade your kernel,
362	make sure you also upgrade mountd, because if your export
363	file contains lines with an old inet4 address syntax (i.e.
364	a.b.c or a.b or a), they will get rejected by the new kernel.
365
36620030402:
367	The superblock layout for FFS was changed.  If you have 1.6
368	fsck binaries, they will signal a fatal superblock mismatch
369	with the first alternate, because they compare too many
370	fields (even ones that aren't useful).  If possible, upgrade
371	your fsck_ffs binary before using a new kernel.
372	None of this signals actual filesystem damage.
373
37420030324:
375	sendmail version 8.12.8 was imported.  Since sendmail is
376	now setgid to the smmsp group, and runs in "collection"
377	mode for most common activities, there is a new config
378	file called submit.cf that needs to live in /etc/mail.
379	The generic submit.cf sample in /usr/share/sendmail/cf
380	is named netbsd-msp.cf.  Upgrading your regular sendmail
381	configuration file is also strongly advised.
382
383	See the section named "MESSAGE SUBMISSION PROGRAM" in
384	the updated /usr/share/sendmail/README file for more
385	information.
386
38720030117:
388	Texinfo was updated to 4.3.  To avoid failures when trying to
389	build the included texinfo files, do:
390
391	cd src/gnu/usr.bin/texinfo
392	make MKINFO=no dependall install
393
39420021223:
395	The METALOG format changed slightly, to remove the leading
396	"${DESTDIR}" from path names.
397	This only affects people building with UNPRIVED.
398	For complete safety, remove the DESTDIR entirely and
399	update tools/mtree, before running make build.
400
40120021219:
402	CVS repository layout was changed.  See the following for details
403	if you are using (anonymous) cvs to update your tree.
404
405	http://mail-index.NetBSD.org/netbsd-announce/2002/12/19/0000.html
406
40720021219:
408	install(1) had a '-N dbdir' option added, to specify an
409	alternate location to look up users & groups (instead
410	of the host system passwd(5) and group(5) databases).
411
412	The build system was modified to take advantage of
413	this option (using ${NETBSDSRCDIR}/etc), so if you
414	use USETOOLS==no, you may have to rebuild and
415	reinstall usr.bin/xinstall first.
416
41720021130:
418	fparseln(3) moved from libutil to libc.
419	If building to DESTDIR=/, reinstall the includes
420	and rebuild libc:
421		make includes
422		make do-lib-libc
423	If using build.sh, "cd tools/compat && make clean"
424	before rebuilding the tools.
425
42620021126:
427	The mk.conf(5) variable SYS_INCLUDE has been deprecated,
428	including the optional "SYS_INCLUDE=symlinks" support.
429	All header files, including <sys/*.h> are copied into
430	/usr/include.
431
43220021121:
433	The C run-time support files crtbegin.o and crtend.o
434	(and their companions crtbeginS.o and crtendS.o) were
435	split up, with new crti.o and crtn.o files resulting.
436	This means that libtool needs to be rebuilt once the
437	new libraries are installed.  The process of rebuilding
438	libtool will cause it to automatically notice the new
439	required files, but it *must* be rebuilt in order to
440	do this.
441
442	An out-of-date libtool will result in shared libraries
443	which lack _init() and _fini() routines, which means that
444	their global constructors/destructors will not be invoked.
445
44620021121:
447	A bug related to how ARM ELF objects were tagged has been
448	corrected.
449
450	NetBSD ARM ELF uses the soft-VFP floating point model by
451	default.  However, the assembler lacked support for marking
452	objects as using the VFP floating point format, and the
453	compiler was not properly passing the flag indicating "soft-VFP"
454	to the assembler.
455
456	Unfortunately, this means that the linker will now consider
457	old (i.e. not marked "softvfp") NetBSD ARM ELF objects to be
458	incompatible with new (properly marked) objects.
459
460	The problem will only manifest itself if you attempt to compile
461	a new program using the fixed toolchain, and link that program
462	against old libraries which do not have the proper "softvfp"
463	markings.  ALL OF YOUR EXISTING BINARIES AND SHARED LIBRARIES
464	WILL CONTINUE TO WORK PROPERLY.
465
466	The only work-around for the problem is to recompile all of
467	the libraries on the system.  The easiest way to do this for
468	system libraries is to install a binary snapshot; they are
469	generally available on releng.NetBSD.org.  Any packages you
470	have installed which supply libraries will have to be recompiled
471	if you wish to link new programs against those libraries.
472
473	If you have questions about this matter, please contact
474	port-arm@NetBSD.org.
475
47620021011:
477	Systrace has been improved to support privilege elevation.
478	Updating the kernel requires the userland part of systrace
479	to be rebuilt.
480
48120021010:
482	The config(8) grammar was changed to allow options to register
483	dependencies on attributes, as well as other options.  Users
484	must update and reinstall usr.sbin/config before building a new
485	kernel.
486
48720021009:
488	A new attribute dependency syntax was introduced to config(8),
489	which is now used by the SCSI configuration description.  Users
490	must update and reinstall usr.sbin/config before building a new
491	kernel.
492
49320021003:
494	Several changes have been made to the autoconfiguration
495	framework.  Users must update and reinstall usr.sbin/config
496	before building a new kernel.
497
49820021001:
499	The i386mp branch has been merged.  To compile a kernel, users
500	will need to add the option 'cpu* at mainbus?' to their configuration
501	file.  Multiprocessor kernels will need
502	ioapic*		at mainbus? apid ?
503	options		MULTIPROCESSOR
504	options		COM_MPLOCK
505
50620020922:
507	MKDYNAMICROOT=yes enabled by default, which means that
508	certain shared libraries are installed into /lib, the shared
509	linker is installed into /libexec, and all programs in /bin
510	and /sbin are dynamically linked.
511	If you do not use "make build", you should ensure that
512	you have the libraries and shared linker in the new locations,
513	with:
514		make do-lib-csu do-lib-libc do-lib do-gnu-lib do-ld.elf_so
515
51620020917:
517	USE_NEW_TOOLCHAIN has been replaced with:
518	    -	TOOLCHAIN_MISSING -- set to "yes" on platforms for which
519		there is no working in-tree toolchain (hppa, ns32k, sh5,
520		x86_64).
521	    -	EXTERNAL_TOOLCHAIN -- if defined by the user, points to the
522		root of an external toolchain (e.g. /usr/local/gnu).  This
523		enables the cross-build framework even for TOOLCHAIN_MISSING
524		platforms.
525
52620020906:
527	gehenna-devsw has been merged into the trunk. Need to update and
528	reinstall usr.sbin/config before building the kernel.
529
53020020822:
531	Crunched rescue tools (contents of /bin and /sbin, plus others)
532	are now provided in /rescue.
533
534	To ensure that these are built statically linked (no matter
535	what the setting of LDSTATIC is), use a crunchgen(1) built
536	from sources newer than 20020820 (see the next entry).
537
53820020820:
539	crunchgen(1) changed to ensure that the generated program
540	is statically linked.
541
542	Solution: update and reinstall usr.bin/crunch
543
54420020605:
545	smmsp user/group has been added for sendmail.
546
547	Add the following into /etc/group:
548
549	smmsp:*:17:
550
551	and the following to /etc/master.passwd (via vipw):
552
553	smmsp:*:17:17::0:0:Sendmail Message Submission Program:/nonexistent:/sbin/nologin
554
55520020515:
556	sshd user/group has been added.  Need to hand add this in, or sshd
557	will not let you log in (with default, or UsePrivilegeSeparation=yes)
558
559	Add the following into /etc/group:
560
561	sshd:*:16:
562
563	and the following to /etc/master.passwd (via vipw):
564
565	sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin
566	
567	Also /var/chroot/sshd directory needs to be present (digged as part of
568	the build process).
569
57020020426:
571	NBUILDJOBS obsoleted in favor of just using -j.
572
57320020426:
574	etc/postinstall added, which performs various checks for 
575	configuration file updates and changes, and can fix most of
576	the problems identified.
577	This should make it much easier to upgrade a system's
578	configuration from earlier systems (as far back as NetBSD 1.5).
579
58020020320:
581	<bsd.lib.mk> needs a new install(1) for its "-a cmd" support.
582	Build and install at usr.bin/xinstall before the build.
583
58420020319:
585	Raw IPv6 socket now makes strict checking for sa_family and sa_len
586	on send(2) operation.  Be sure to have sbin/rtsol and usr.sbin/rtsold
587	newer than November 2001 when you upgrade the kernel.
588
58920020311:
590	ssh configuration files were moved from /etc to /etc/ssh.  Beware
591	if you restart your machine from remote.  Note that sshd.conf needs
592	to be changed (due to the use of "/etc" inside).
593
59420020223:
595	Users of the VAX port will need to rebuild and install gas
596	so it deal with the now present register prefix used in all
597	the VAX assembly files.
598
59920020118:
600	ntpd user/group has been added.  Need to hand add this in or builds
601	will break as mtree aborts early.
602
603	Add the following into /etc/group:
604
605	ntpd:*:15:
606
607	and the following to /etc/master.passwd (via vipw):
608
609	ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin
610
61120011207:
612	If you're attempting to build a snapshot on sparc64 and are getting
613	reloc errors from the toolchain groff binary this means your native
614	toolchain has some broken C++ bits.
615
616	To fix:
617
618	Build a new toolchain (i.e. build.sh -t)
619	Use the new toolchain to build and install natively (i.e. /usr/lib)
620
621	gnu/lib/libgcc
622	gnu/lib/libstdc++
623
624	After this a snapshot will be able to be built.
625
62620011201:
627	In order for a sparc64 build to work you must have a working awk. If
628	you've built and installed a system with the new toolchain up to this
629	point you do not have a working awk as its ability to do floating
630	point is broken. 
631
632	To build:
633
634	remake and install gnu/lib/libgcc
635	remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links
636	against the new libgcc.a)
637
63820011128:
639	Kernel config information was changed to use defflag in
640	the various "files" files.  Bug fixes to config(8) are
641	required in order for this to work properly.  Make sure
642	to build and install in usr.sbin/config before attempting
643	to build a new kernel.
644
64520011030:
646	libc/locale/wcstod.c now needs new lint(1). Update lint(1)
647	before building libc.
648
64920011029:
650	The new document BUILDING.mdoc (view with nroff | more, or
651	see pre-generated .txt and .html versions) describes the build
652	procedure in great detail.  BUILDING, and the USE_NEW_TOOLCHAIN
653	build process, are intended in the long run to replace this
654	manual update log.
655
656	Users building a USE_NEW_TOOLCHAIN system should read the
657	BUILDING document for caveats.  Generally, BUILDING supersedes
658	UPDATING for these systems, as tool updating is taken care of
659	by the new build system.
660
66120011028:
662	src/etc/Makefile now needs install to be able to handle
663	symlinks that point to nowhere. A bug in install that
664	prevented this was corrected.
665
666	Solution: update and reinstall usr.bin/xinstall
667	Better Solution: Use the new toolchain and it will just work
668	for you.
669
67020011006:
671	/etc/mtree/NetBSD.dist has been updated to take advantage of
672	absolute path support added to mtree(8). Older mtree(8)s don't
673	understand the format.
674
675	Solution: update and reinstall usr.sbin/mtree
676
67720011004:
678	Crunchgen has been updated to work via reach-over makefiles. Updating
679	is suggested before running a snapshot build
680
68120010915:
682	The new "ubcperf" code committed by Chuck Silvers removed
683	a header file, uvm/uvm_vnode.h.  There may be stale .depend
684	files that still reference this file.
685
686	Solution: "make cleandir && make dependall" in affected
687	directories.
688
68920010803:
690	grep.info is now built from grep.texi using makeinfo.  Since it
691	requires makeinfo v4.0, you need to install new texinfo before
692	building gnu/usr.bin/grep.  To install new texinfo, please follow
693	the instruction described in 20010726 entry.
694
69520010803: 
696	(i386 only): i386 kernel now uses new instructions like
697	`fxsave' which old gas doesn't understand.  To build the
698	kernel successfully, you need to build and install a new toolchain, 
699	(i.e., build.sh -t) or 	(temporarily) comment out "options I686_CPU" 
700	from your kernel configuration until you rebuild your userland.
701	See 20011029 above and BUILDING file in this directory for more information.
702	[updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled]
703
70420010731:
705	Bootloader update on ELF platforms.  DDB in kernels from before
706	this will be unable to read symbol tables provided by newer
707	bootloaders.
708
70920010726:
710	Texinfo was updated to 4.0.  To avoid failures when trying to
711	build the included texinfo files, do:
712
713	cd src/gnu/usr.bin/texinfo
714	make MKINFO=no dependall install
715
71620010718:
717	Enabled correct .init/.fini processing in crt0.  The way this
718	was done was to change a -I directive to cc(1), which means
719	make(1) will have a stale dependency (it will be checking the
720	timestamp on the wrong "dot_init.h").
721
722	The symptom you will see is that new programs die with SIGSEGV
723	if you have a stale dependency.
724
725	Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so
726	before starting your build.
727
72820010628:
729	A construct was added to uvm_page.h that uncovered a bug
730	in lint(1).  If you get a warning/error about a non-portable
731	bitfield, update your lint(1) before proceeding.
732
73320010226:
734	Added named user/group to system. Need to hand add this in or builds
735	will break as mtree aborts early.
736
737	To work around add by hand:
738
739	named:*:14:
740
741	to /etc/group and add:
742
743	named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin
744
745	to master.passwd (use vipw for instance if doing by hand).
746
747	Now a make build should progress.
748
74920010219:
750	get/setprogname() added. Any hostprogs that may use this will need
751	to be bootstrapped manually until the host system is current.
752
753	Known problems: sys/arch/macppc/stand/fixcoff
754			usr.sbin/config (adding -DMAKE_BOOTSTRAP to
755			  CFLAGS and rebuilding should work)
756			usr.sbin/mdsetimage - Build a static copy if
757			  building a snapshot before fully bootstrapped.
758
75920010204:
760	prepare the code to compile with stricter gcc flags. in
761	particular start eliminating redundant declarations. Yacc
762	needs to be installed before make build.
763
76420010114:
765	introduce .if commands(target) in make(1). You need to
766	bring everything up-to-date first, then without installing
767	anything make and install in usr.bin/make, then proceed
768	with make build.
769
77020010101:
771	bsd.subdir.mk committed 20001230 had a bug which caused
772	afterinstall targets to run too soon; update again.
773
77420001230:
775	New share/mk files needed to support .WAIT in SUBDIR variables.
776	If you get make errors, 
777		(cd share/mk; make install)
778	Also, PRINTOBJDIR has changed and is now used more heavily.
779
78020001019:
781	The `ca' device driver has been replaced by `ld'; although the
782	major and minor numbers haven't changed, you should update your /dev
783	directory.
784
78520000929:
786	The following make directives are obsoleted.
787	MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA 
788	By default, RSA is built into libcrypto.  IDEA and RC5 will not be
789	built into libcrypto.  By using MKCRYPTO_{RC5,IDEA}, you can build
790	additional library libcrypto_{idea,rc5}.
791
792
793Hints for a more successful build:
794^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
795    Use build.sh, but do not use its "expert mode":
796	This will automatically build the tools in the
797	   correct order, and it will keep the tools and the
798	   new build products from interfering with the running
799	   system.  This will allow you to ignore most of the
800	   other advice in this file.
801    Build a new kernel first:
802	This makes sure that any new system calls or features
803	   expected by the new userland will be present.  This
804	   helps to avoid critical errors when upgrading.
805    Use object directories:
806	This helps to keep stale object
807	   files from polluting the build if a Makefile "forgets"
808	   about one.  It also makes it easier to clean up after
809	   a build.  It's also necessary if you want to use the
810	   same source tree for multiple machines.
811	   To use object directories with build.sh:
812	    a) invoke build.sh with the "-M" or "-O" options.
813	   To use object directories without using build.sh:
814	    a) cd /usr/src ; make cleandir
815	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
816	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
817	    d) cd /usr/src ; make build
818	   Note that running "make obj" in a directory will create
819	   in obj.$MACHINE directory.
820    Build to a DESTDIR:
821	This helps to keep old installed files (especially libraries)
822	   from interfering with the new build.
823	   To build to a DESTDIR with build.sh, use the "-D" option.
824	   To build to a DESTDIR without using build.sh, set the DESTDIR
825	   environment variable before running make build.  It should be
826	   set to the pathname of an initially empty directory.
827	   Problems: if you do not use build.sh, you might need to
828		update critical utilities without using DESTDIR since
829		nothing is executed from what is installed in DESTDIR.
830		(See critical utils, below.)
831    Build often:
832	This keeps critical utilities current enough to not choke
833	on any other part of the source tree that depends on up to
834	date functionality.  If you use build.sh, you should not have
835	this problem.
836 
837What to do if things don't work:
838^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
839When things don't work there is usually a few things that commonly
840should be done.
841    1)	make includes
842	This should be done automatically by make build.
843    2)  cd share/mk && make install
844	Again, automatically done by make build.
845
846Failsafe rebuild of a small part of the tree:
847^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
848To make sure you rebuild something correctly you want to do
849something like the following:
850    1)  Make sure the includes and .mk files are up to date.
851    2)  Make sure any program used to build the particular
852	utility is up to date.  (yacc, lex, etc...)
853    3)  cd ...path/to/util...
854	make cleandir
855	rm ...all obj directories...
856	make cleandir			# yes, again
857	make obj
858	make depend && make
859
860Failsafe rebuild of the entire tree:
861^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
862If you really want to make sure the source tree is clean and
863ready for a build try the following.  Note that sourcing /etc/mk.conf
864(a make(1) Makefile) in this manner is not right, and will not work
865for anyone who uses any make(1) features in /etc/mk.conf.
866
867---cut here---
868#!/bin/sh
869. /etc/mk.conf
870
871if [ -z $NETBSDSRCDIR ] ; then
872    NETBSDSRCDIR=/usr/src
873fi
874if [ \! -d $NETBSDSRCDIR ] ; then
875    echo Unable to find sources
876    exit 1
877fi
878find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
879
880if [ -z $BSDOBJDIR ] ; then
881    BSDOBJDIR=/usr/obj
882fi
883if [ -d $BSDOBJDIR ] ; then
884    rm -rf $BSDOBJDIR
885fi
886
887cd $NETBSDSRCDIR && make cleandir
888
889---cut here---
890
891Critical utilities:
892^^^^^^^^^^^^^^^^^^^
893	usr.bin/compile_et
894	usr.bin/make
895	usr.bin/yacc
896	usr.bin/lex
897	usr.bin/xlint
898	usr.bin/config
899
900Other problems and possible solutions:
901^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
902Symptom:Complaints involving a Makefile.
903Fix:	Rebuild usr.bin/make:
904	cd usr.bin/make && make && make install
905	Or, a failsafe method if that doesn't work:
906	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
907
908Fix:	Make sure .mk files are up to date.
909	cd share/mk && make install
910
911Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
912Fix:	Rebuild usr.bin/config
913
914Symptom:
915Fix:	Rebuild usr.bin/yacc
916
917Symptom:
918Fix:	Rebuild usr.bin/lex
919
920Symptom:
921Fix:	rm /usr/lib/libbfd.a
922
923Symptom:Obsolete intermediate files are used during compilation
924Fix:	Try the following sequence of commands in the directory in question.
925	make cleandir; rm `make print-objdir`; make cleandir; make obj
926	(If you built the tree without "make obj" in the past, obsolete files
927	may remain.  The command tries to clean everything up)
928
929Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
930Fix:	Rebuild and install usr.bin/menuc
931
932Symptom:mklocale not found during build in share/locale/ctype
933Fix:	Build and install usr.bin/mklocale
934
935Symptom:undefined reference to `__assert13' or `__unsetenv13'
936Fix:    Rebuild and install lib/libc
937
938Symptom:usr.bin/config fails to build.
939Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
940
941Symptom:undefined reference to `getprogname' or `setprogname'
942Fix:    Rebuild and install lib/libc
943
944Symptom:lint does not understand the '-X' option
945Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
946