UPDATING revision 1.156
1$NetBSD: UPDATING,v 1.156 2006/12/15 14:18:38 he Exp $
2
3This file (UPDATING) is intended to be a brief reference to recent
4changes that might cause problems in the build process, and a guide for
5what to do if something doesn't work.
6
7For a more detailed description of the recommended way to build NetBSD
8using build.sh, see the BUILDING file.
9
10Note that much of the advice in this UPDATING file was written before
11build.sh existed.  Nevertheless, the advice here may be useful for
12working around specific problems with build.sh.
13
14See also: BUILDING, build.sh, Makefile.
15
16Recent changes:
17^^^^^^^^^^^^^^^
18
1920061214:
20	Following the move of string_to_flags() and flags_to_string()
21	from the bin/ls/ sources to libutil, users doing UPDATE builds
22	will need to do a "make cleandir" in
23		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
24		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
25		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
26		as the installation images in distrib/
27	in order to excise stale references to the old stat_flags.h header
28	file in the ls sources -- stat_flags.h has been removed.
29
3020061108:
31	The configure script used in the src/tools/gcc compiler has been
32	changed to indicate that our libc has ssp support built-in and
33	does not depend on -lssp and -lssp-nonshared. You'll need to
34	make clean in src/tools/gcc first to rebuild the compiler.
35
3620061009:
37	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
38	available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
39
4020060814:
41	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
42	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
43	kernel configuration for an example.  X servers from the last
44	few years should cope.
45
4620060703:
47	MPACPI is no more. We always configure PCI interrupts using ACPI
48	if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
49	to ACPI_SCANPCI. Thanks to work from fvdl.
50
5120060627:
52	socket(2) has changed, and its system call has been versioned.
53	For userlands with the old version of socket(2), make sure that
54	your kernel has 'options COMPAT_30' set, or else 'bad system call'
55	errors will result.
56
5720060526:
58	The kernel linker scripts for i386 and xen 
59	(sys/arch/i386/conf/kern.ldscript*) were changed to set the
60	load address correctly, for the benefit of MULTIBOOT boot loaders
61	(like Grub). If you use a linker (ld) older than from 2006/04/17, it
62	will be unable to link the kernel because of a bug and ld will fail
63	with an error like:
64	    ../../../../arch/i386/conf/kern.ldscript:45 \
65		non constant expression for load base
66	You need to update at least src/gnu/dist/binutils/ld and recompile
67	and install the linker. If using the build.sh script, the easiest
68	way is with a "build.sh tools" command, with any other options
69	that you use normally. When using build.sh, the linker binary is
70	installed as ${TOOLDIR}/bin/i386--netbsdelf-ld.
71
7220060131:
73	the protocol between the sparc64 bootloader (ofwboot) and
74	the kernel was changed. Before installing a new kernel,
75	you need to update ofwboot. After a full build, just copy
76	/usr/mdec/ofwboot to /, or do a rebuild of
77	src/sys/arch/sparc/stand/ofwboot and install the result to /.
78
7920050917:
80	arch/*/conf/std.* was changed to include conf/std, which
81	contains MI options previously enabled by default.
82	If you have kernel config files which doesn't include
83	arch/*/conf/std.*, you need to edit them to include conf/std
84	to get the previous configuration.
85
8620050830:
87	named.conf was moved from /etc/namedb to /etc.
88	postinstall(8) migrates this during interactive use.
89	Users of MKUPDATE=yes will need to manually rectify
90	this in their DESTDIR.
91
9220050825:
93	Some data structures in sys/device.h, related to interface
94	attributes and locator names, were changed. config(1) was
95	modified to emit the new data structures.
96	Thus usr.bin/config must be updated (and run on the kernel
97	configuration file) before a new kernel can be built.
98
9920050531:
100	genassym.sh(8) was moved to genassym(1). You need to either build
101	tools first or install the version of genassym from /usr/bin before
102	you can build a kernel again.
103
10420050520:
105	Because a kernfs bug which xentools relies on was fixed,
106	xentools up to xentools20-2.0.3nb4 won't work with new kernel.
107
10820050417:
109	postinstall(8) was moved from /etc to /usr/sbin and made part
110	of the "base" set, to make it easier to invoke after an
111	upgrade.
112
11320050325:
114	pcppi(4) was separated in two devices, adding attimer(4).  Be sure
115	to add a config line for an attimer(4) device in your kernel
116	configuration, or you won't be able to set the pitch of the beep
117	with wsconsctl.  Depending on the default value for the pitch, you
118	might even not hear any more beep.  Also, it is advised to attach both
119	devices the same way (i.e., both on isa or both on acpi) or the
120	pcppi(4) device may fail to find the attimer(4) one.
121
12220050211:
123	Fixes to tools/Makefile.gnuhost may cause UPDATE=1 builds in
124	some of the cross tools to fail if they use configure. Some configure's
125	cache the environment passed in and notice the new environment is
126	different and abort. Doing a clean in tools/ should be enough to
127	make a build continue.
128
12920050109:
130	Since su is using pam by default now, make sure that you have
131	/etc/pam.d populated (postinstall will do that automatically
132	for you). Otherwise su will fail open (i.e. will not require
133	a password).
134
13520041229:
136	Make had a path resolution bug that manifested itself as not
137	being able to install openpam.3. This bug has been fixed, but
138	you might need to rebuild make manually first to get through
139	the build.
140
14120041201:
142	Userland programs have been changed to use /dev/bpf instead of
143	/dev/bpfX. You need to create that device by installing a new
144	MAKEDEV and running it, or mv /dev/bpf0 /dev/bpf && rm /dev/bpf[0-9]*
145
14620041006:
147
148	A bug was introduced into /bin/sh (var.c rev 1.35) which causes
149	variables to not export correctly to subshells in all cases. This
150	will cause builds to break if that version of /bin/sh is installed
151	on the system. The proper version of /bin/sh can be verified with:
152
153        ident /bin/sh | grep var
154
155	Any /bin/sh w. version 1.35 will not work and needs to be updated
156	before attempting a build.
157	
15820041001:
159	The ipfilter kernel sources moved from sys/netinet to
160	dist/sys/ipf/netinet. Due to the move some Makefile
161	dependencies are now dangling requiring a make cleandir
162	before they work again (kdump, ktruss, rescue, ipf, and
163	ftp-proxy are the victims).
164
16520040715:
166	The rc.d/sendmail script now uses a heuristic to determine
167	if sendmail should be started at boot time.  It checks the
168	contents of /etc/mailer.conf, /etc/mail/submit.cf, and the
169	owner and mode of the sendmail binary to see if any changes
170	to the mail infrastructure have been made.  If no changes
171	are detected, it will start an SMTP listener.
172
173	Setting sendmail=NO in /etc/rc.conf will override this.
174
175	If you are only using sendmail by default and only for
176	local delivery, it is important that you also update your
177	sendmail.cf so that the SMTP listener only listens on the
178	loopback interface.
179
18020040715:
181	The method by which athhal-elf.o gets pulled into i386
182	kernel builds has been changed again.  The latest version
183	of bsd.files.mk is no longer required.
184
18520040621:
186	Due to the recent rototill of tools/compat it's crucial one starts
187	from a clean objdir under tools/*.
188
189	This is mostly due to generated files (yacc and lex sources) needing
190	to be generated with new rules from bsd.hostprog.mk.
191
192	The safest course is to rm -rf all objects under tools before building.
193
19420040516:
195	The end-user modifiable X11 configuration has been moved
196	from /usr/X11R6/lib/X11/<dir> to /etc/X11/<dir>.
197	Ensure that src and xsrc is up to date, and run
198	"make cleandir" in src/x11 before your next build.
199
200	postinstall currently doesn't migrate the files from
201	/usr/X11R6/lib/X11/* to /etc/X11/* although it does
202	detect that this needs to occur, so you'll have to
203	manually move these files yourself.
204
20520040426:
206	Support for the original dynamic sysctl node structure has
207	been removed in favor of the newer layout.  This affects
208	consumers of the create and delete interface, as well as
209	the dynamic discovery mechanism.  This is believed only to
210	be the sysctl(8) binary itself, at this point in time, so
211	the only effect of this should be that a sysctl binary
212	built from sources dated between 2003/12/04 and 2004/03/24
213	will not work on a kernel built from sources dated after
214	2004/04/25.  If you need a new sysctl binary but build.sh
215	does not work, make sure that your revision of
216	src/sys/sys/sysctl.h is 1.112 (or later), and then the
217	do the following:
218
219	cd /usr/src (or wherever your source tree is)
220	make USETOOLS=no includes
221	cd lib/libc
222	make USETOOLS=no dependall install
223	cd ../../sbin/sysctl
224	make USETOOLS=no dependall install
225
226	If you are using older sysctl binary, GNU autoconf would fail to
227	identify your machine architecture, and tries to build binary for
228	"unknown-unknown-netbsd20F" or something like that.  if that happens,
229	make sure to follow the above steps.
230
23120040425:
232	The ffs superblock issues listed below under 20040109 and 20030402
233	are now automatically addressed by the /etc/rc.d/fixsb script or by
234	sysinst when it checks a a filesystem. The manual fsck_ffs -b16 -c4
235	invocation mentioned below will continue to work and is now
236	automated by those scripts.  Note that under certain circumstances,
237	affected filesystems upgraded to a -current kernel first before
238	upgrading their userland with the fixsb and fsck_ffs fixes may
239	encounter a 'freeing free inode' panic when writing to the affected
240	filesystem, so it is a good idea to repair the filesystem as soon as
241	possible.  For more details on the fixsb script, see pr install/25138.
242
24320040418:
244	statfs(2) and friends have been replaced with statvfs(2). Before
245	installing a newly build userland make sure that you are running
246	a newly built kernel with COMPAT_20 set. In addition your libc
247	build might not work (undefined SYS_statfs symbol) because make
248	clean does not know how to remove files it does not know about
249	anymore. Manually remove all generated .S sources and objects
250	from the libc build directory.
251
25220040326:
253	The method by which athhal-elf.o gets pulled into i386 kernel builds
254	has been changed. The file is now stored as a uuencoded file in CVS
255	and the generated Makefile will use the new .uue rules from bsd.file.mk
256	to build it.
257
258	This means you must have the latest bsd.files.mk installed when
259	building a kernel without USETOOLS=yes.
260
26120040318:
262	A bug in the cgd(4) blowfish code was corrected, without
263	provision of backwards compatibility, after several public
264	notices over several months. Users of cgd with blowfish cipher
265	ONLY must dump their data before updating their kernels, and
266	recreate cgd's and restore data using the new kernel. See
267	(recent message to current-users, URL when mail-index has updated)
268
26920040313:
270	On acorn32, the opms and qms drivers have been withdrawn, and
271	the old wsqms driver is now called qms.  Kernel config files
272	will need updating.  See the ones in sys/arch/acorn32/conf
273	for examples.
274
27520040125:
276	On acorn32, the beep and sysbeep devices are no longer
277	needed, and will need to be deleted from kernel configuration
278	files.
279
28020040109:
281	Compatibility for old ffs superblock layouts has been
282	added, and the restrictive fsck checks have been reenabled
283	when using those layouts.  If you have been using -current
284	since 20030402, you may find that fsck again signals fatal
285	superblock mismatches.  To repair, make sure you have
286	an updated fsck_ffs and then you can use fsck_ffs -b 16 -c 4
287	to complete the filesystem upgrade.  A message has
288	been added to the kernel which should detect this problem.
289	See the following discussion for more information:
290	http://mail-index.NetBSD.org/current-users/2004/01/11/0022.html
291
29220031203:
293	New binutils builds may fail due to old dependencies.
294	It's necessary to "make cleandir" to ensure that
295	the dependencies will be rebuilt correctly.
296
29720031111:
298	A newer mkdep is needed.  Error noting that is
299		cc: Ambiguous abbreviation --
300
30120031008:
302	/usr/include/sys/disklabel_mbr.h was removed.
303	It's necessary to "make cleandir" to ensure that
304	the dependencies will be rebuilt correctly.
305
30620031007:
307	A sign extension bug was fixed which set all the high bits
308	of our newly expanded ffs fs_flags.  This should only
309	affect users who installed or upgraded in September of 2003.
310	A small utility program was posted to tech-kern which
311	should fix this problem, and a warning message was added
312	to the kernel which should discover and warn about it.  See
313	http://mail-index.NetBSD.org/tech-kern/2003/10/07/0005.html
314
31520030906:
316	With the addition of siginfo support the old signal trampoline
317	code has been deprecated to COMPAT_16. Make sure that your running
318	kernel has COMPAT_16 enabled before building userland.
319
32020030801:
321	With the new openssl, there is some header and library shuffling.
322	rm -f /usr/include/des.h /usr/include/kerberosIV/* /lib/libdes* \
323	/usr/lib/libdes* before building.
324
32520030703:
326	Texinfo was updated to 4.6.  To avoid failures when trying to
327	build the included texinfo files, do:
328
329	cd src/gnu/usr.bin/texinfo
330	make MKINFO=no dependall install
331
33220030630:
333	Groff was updated to 1.19; it's probably necessary to do
334		cd share/mk && make install
335		cd src/gnu/usr.bin/groff
336		make MKMAN=no dependall install
337	(untested).
338
33920030516:
340	Due to bugs in the export handling code, invalid export lines
341	were accepted before and caused the kernel to panic when
342	mountd got restarted because it freed memory that had already
343	been freed. This has been fixed and the kernel checks
344	export addresses very strictly. If you upgrade your kernel,
345	make sure you also upgrade mountd, because if your export
346	file contains lines with an old inet4 address syntax (i.e.
347	a.b.c or a.b or a), they will get rejected by the new kernel.
348
34920030402:
350	The superblock layout for FFS was changed.  If you have 1.6
351	fsck binaries, they will signal a fatal superblock mismatch
352	with the first alternate, because they compare too many
353	fields (even ones that aren't useful).  If possible, upgrade
354	your fsck_ffs binary before using a new kernel.
355	None of this signals actual filesystem damage.
356
35720030324:
358	sendmail version 8.12.8 was imported.  Since sendmail is
359	now setgid to the smmsp group, and runs in "collection"
360	mode for most common activities, there is a new config
361	file called submit.cf that needs to live in /etc/mail.
362	The generic submit.cf sample in /usr/share/sendmail/cf
363	is named netbsd-msp.cf.  Upgrading your regular sendmail
364	configuration file is also strongly advised.
365
366	See the section named "MESSAGE SUBMISSION PROGRAM" in
367	the updated /usr/share/sendmail/README file for more
368	information.
369
37020030117:
371	Texinfo was updated to 4.3.  To avoid failures when trying to
372	build the included texinfo files, do:
373
374	cd src/gnu/usr.bin/texinfo
375	make MKINFO=no dependall install
376
37720021223:
378	The METALOG format changed slightly, to remove the leading
379	"${DESTDIR}" from path names.
380	This only affects people building with UNPRIVED.
381	For complete safety, remove the DESTDIR entirely and
382	update tools/mtree, before running make build.
383
38420021219:
385	CVS repository layout was changed.  See the following for details
386	if you are using (anonymous) cvs to update your tree.
387
388	http://mail-index.NetBSD.org/netbsd-announce/2002/12/19/0000.html
389
39020021219:
391	install(1) had a '-N dbdir' option added, to specify an
392	alternate location to look up users & groups (instead
393	of the host system passwd(5) and group(5) databases).
394
395	The build system was modified to take advantage of
396	this option (using ${NETBSDSRCDIR}/etc), so if you
397	use USETOOLS==no, you may have to rebuild and
398	reinstall usr.bin/xinstall first.
399
40020021130:
401	fparseln(3) moved from libutil to libc.
402	If building to DESTDIR=/, reinstall the includes
403	and rebuild libc:
404		make includes
405		make do-lib-libc
406	If using build.sh, "cd tools/compat && make clean"
407	before rebuilding the tools.
408
40920021126:
410	The mk.conf(5) variable SYS_INCLUDE has been deprecated,
411	including the optional "SYS_INCLUDE=symlinks" support.
412	All header files, including <sys/*.h> are copied into
413	/usr/include.
414
41520021121:
416	The C run-time support files crtbegin.o and crtend.o
417	(and their companions crtbeginS.o and crtendS.o) were
418	split up, with new crti.o and crtn.o files resulting.
419	This means that libtool needs to be rebuilt once the
420	new libraries are installed.  The process of rebuilding
421	libtool will cause it to automatically notice the new
422	required files, but it *must* be rebuilt in order to
423	do this.
424
425	An out-of-date libtool will result in shared libraries
426	which lack _init() and _fini() routines, which means that
427	their global constructors/destructors will not be invoked.
428
42920021121:
430	A bug related to how ARM ELF objects were tagged has been
431	corrected.
432
433	NetBSD ARM ELF uses the soft-VFP floating point model by
434	default.  However, the assembler lacked support for marking
435	objects as using the VFP floating point format, and the
436	compiler was not properly passing the flag indicating "soft-VFP"
437	to the assembler.
438
439	Unfortunately, this means that the linker will now consider
440	old (i.e. not marked "softvfp") NetBSD ARM ELF objects to be
441	incompatible with new (properly marked) objects.
442
443	The problem will only manifest itself if you attempt to compile
444	a new program using the fixed toolchain, and link that program
445	against old libraries which do not have the proper "softvfp"
446	markings.  ALL OF YOUR EXISTING BINARIES AND SHARED LIBRARIES
447	WILL CONTINUE TO WORK PROPERLY.
448
449	The only work-around for the problem is to recompile all of
450	the libraries on the system.  The easiest way to do this for
451	system libraries is to install a binary snapshot; they are
452	generally available on releng.NetBSD.org.  Any packages you
453	have installed which supply libraries will have to be recompiled
454	if you wish to link new programs against those libraries.
455
456	If you have questions about this matter, please contact
457	port-arm@NetBSD.org.
458
45920021011:
460	Systrace has been improved to support privilege elevation.
461	Updating the kernel requires the userland part of systrace
462	to be rebuilt.
463
46420021010:
465	The config(8) grammar was changed to allow options to register
466	dependencies on attributes, as well as other options.  Users
467	must update and reinstall usr.sbin/config before building a new
468	kernel.
469
47020021009:
471	A new attribute dependency syntax was introduced to config(8),
472	which is now used by the SCSI configuration description.  Users
473	must update and reinstall usr.sbin/config before building a new
474	kernel.
475
47620021003:
477	Several changes have been made to the autoconfiguration
478	framework.  Users must update and reinstall usr.sbin/config
479	before building a new kernel.
480
48120021001:
482	The i386mp branch has been merged.  To compile a kernel, users
483	will need to add the option 'cpu* at mainbus?' to their configuration
484	file.  Multiprocessor kernels will need
485	ioapic*		at mainbus? apid ?
486	options		MULTIPROCESSOR
487	options		COM_MPLOCK
488
48920020922:
490	MKDYNAMICROOT=yes enabled by default, which means that
491	certain shared libraries are installed into /lib, the shared
492	linker is installed into /libexec, and all programs in /bin
493	and /sbin are dynamically linked.
494	If you do not use "make build", you should ensure that
495	you have the libraries and shared linker in the new locations,
496	with:
497		make do-lib-csu do-lib-libc do-lib do-gnu-lib do-ld.elf_so
498
49920020917:
500	USE_NEW_TOOLCHAIN has been replaced with:
501	    -	TOOLCHAIN_MISSING -- set to "yes" on platforms for which
502		there is no working in-tree toolchain (hppa, ns32k, sh5,
503		x86_64).
504	    -	EXTERNAL_TOOLCHAIN -- if defined by the user, points to the
505		root of an external toolchain (e.g. /usr/local/gnu).  This
506		enables the cross-build framework even for TOOLCHAIN_MISSING
507		platforms.
508
50920020906:
510	gehenna-devsw has been merged into the trunk. Need to update and
511	reinstall usr.sbin/config before building the kernel.
512
51320020822:
514	Crunched rescue tools (contents of /bin and /sbin, plus others)
515	are now provided in /rescue.
516
517	To ensure that these are built statically linked (no matter
518	what the setting of LDSTATIC is), use a crunchgen(1) built
519	from sources newer than 20020820 (see the next entry).
520
52120020820:
522	crunchgen(1) changed to ensure that the generated program
523	is statically linked.
524
525	Solution: update and reinstall usr.bin/crunch
526
52720020605:
528	smmsp user/group has been added for sendmail.
529
530	Add the following into /etc/group:
531
532	smmsp:*:17:
533
534	and the following to /etc/master.passwd (via vipw):
535
536	smmsp:*:17:17::0:0:Sendmail Message Submission Program:/nonexistent:/sbin/nologin
537
53820020515:
539	sshd user/group has been added.  Need to hand add this in, or sshd
540	will not let you log in (with default, or UsePrivilegeSeparation=yes)
541
542	Add the following into /etc/group:
543
544	sshd:*:16:
545
546	and the following to /etc/master.passwd (via vipw):
547
548	sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin
549	
550	Also /var/chroot/sshd directory needs to be present (digged as part of
551	the build process).
552
55320020426:
554	NBUILDJOBS obsoleted in favor of just using -j.
555
55620020426:
557	etc/postinstall added, which performs various checks for 
558	configuration file updates and changes, and can fix most of
559	the problems identified.
560	This should make it much easier to upgrade a system's
561	configuration from earlier systems (as far back as NetBSD 1.5).
562
56320020320:
564	<bsd.lib.mk> needs a new install(1) for its "-a cmd" support.
565	Build and install at usr.bin/xinstall before the build.
566
56720020319:
568	Raw IPv6 socket now makes strict checking for sa_family and sa_len
569	on send(2) operation.  Be sure to have sbin/rtsol and usr.sbin/rtsold
570	newer than November 2001 when you upgrade the kernel.
571
57220020311:
573	ssh configuration files were moved from /etc to /etc/ssh.  Beware
574	if you restart your machine from remote.  Note that sshd.conf needs
575	to be changed (due to the use of "/etc" inside).
576
57720020223:
578	Users of the VAX port will need to rebuild and install gas
579	so it deal with the now present register prefix used in all
580	the VAX assembly files.
581
58220020118:
583	ntpd user/group has been added.  Need to hand add this in or builds
584	will break as mtree aborts early.
585
586	Add the following into /etc/group:
587
588	ntpd:*:15:
589
590	and the following to /etc/master.passwd (via vipw):
591
592	ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin
593
59420011207:
595	If you're attempting to build a snapshot on sparc64 and are getting
596	reloc errors from the toolchain groff binary this means your native
597	toolchain has some broken C++ bits.
598
599	To fix:
600
601	Build a new toolchain (i.e. build.sh -t)
602	Use the new toolchain to build and install natively (i.e. /usr/lib)
603
604	gnu/lib/libgcc
605	gnu/lib/libstdc++
606
607	After this a snapshot will be able to be built.
608
60920011201:
610	In order for a sparc64 build to work you must have a working awk. If
611	you've built and installed a system with the new toolchain up to this
612	point you do not have a working awk as its ability to do floating
613	point is broken. 
614
615	To build:
616
617	remake and install gnu/lib/libgcc
618	remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links
619	against the new libgcc.a)
620
62120011128:
622	Kernel config information was changed to use defflag in
623	the various "files" files.  Bug fixes to config(8) are
624	required in order for this to work properly.  Make sure
625	to build and install in usr.sbin/config before attempting
626	to build a new kernel.
627
62820011030:
629	libc/locale/wcstod.c now needs new lint(1). Update lint(1)
630	before building libc.
631
63220011029:
633	The new document BUILDING.mdoc (view with nroff | more, or
634	see pre-generated .txt and .html versions) describes the build
635	procedure in great detail.  BUILDING, and the USE_NEW_TOOLCHAIN
636	build process, are intended in the long run to replace this
637	manual update log.
638
639	Users building a USE_NEW_TOOLCHAIN system should read the
640	BUILDING document for caveats.  Generally, BUILDING supersedes
641	UPDATING for these systems, as tool updating is taken care of
642	by the new build system.
643
64420011028:
645	src/etc/Makefile now needs install to be able to handle
646	symlinks that point to nowhere. A bug in install that
647	prevented this was corrected.
648
649	Solution: update and reinstall usr.bin/xinstall
650	Better Solution: Use the new toolchain and it will just work
651	for you.
652
65320011006:
654	/etc/mtree/NetBSD.dist has been updated to take advantage of
655	absolute path support added to mtree(8). Older mtree(8)s don't
656	understand the format.
657
658	Solution: update and reinstall usr.sbin/mtree
659
66020011004:
661	Crunchgen has been updated to work via reach-over makefiles. Updating
662	is suggested before running a snapshot build
663
66420010915:
665	The new "ubcperf" code committed by Chuck Silvers removed
666	a header file, uvm/uvm_vnode.h.  There may be stale .depend
667	files that still reference this file.
668
669	Solution: "make cleandir && make dependall" in affected
670	directories.
671
67220010803:
673	grep.info is now built from grep.texi using makeinfo.  Since it
674	requires makeinfo v4.0, you need to install new texinfo before
675	building gnu/usr.bin/grep.  To install new texinfo, please follow
676	the instruction described in 20010726 entry.
677
67820010803: 
679	(i386 only): i386 kernel now uses new instructions like
680	`fxsave' which old gas doesn't understand.  To build the
681	kernel successfully, you need to build and install a new toolchain, 
682	(i.e., build.sh -t) or 	(temporarily) comment out "options I686_CPU" 
683	from your kernel configuration until you rebuild your userland.
684	See 20011029 above and BUILDING file in this directory for more information.
685	[updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled]
686
68720010731:
688	Bootloader update on ELF platforms.  DDB in kernels from before
689	this will be unable to read symbol tables provided by newer
690	bootloaders.
691
69220010726:
693	Texinfo was updated to 4.0.  To avoid failures when trying to
694	build the included texinfo files, do:
695
696	cd src/gnu/usr.bin/texinfo
697	make MKINFO=no dependall install
698
69920010718:
700	Enabled correct .init/.fini processing in crt0.  The way this
701	was done was to change a -I directive to cc(1), which means
702	make(1) will have a stale dependency (it will be checking the
703	timestamp on the wrong "dot_init.h").
704
705	The symptom you will see is that new programs die with SIGSEGV
706	if you have a stale dependency.
707
708	Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so
709	before starting your build.
710
71120010628:
712	A construct was added to uvm_page.h that uncovered a bug
713	in lint(1).  If you get a warning/error about a non-portable
714	bitfield, update your lint(1) before proceeding.
715
71620010226:
717	Added named user/group to system. Need to hand add this in or builds
718	will break as mtree aborts early.
719
720	To work around add by hand:
721
722	named:*:14:
723
724	to /etc/group and add:
725
726	named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin
727
728	to master.passwd (use vipw for instance if doing by hand).
729
730	Now a make build should progress.
731
73220010219:
733	get/setprogname() added. Any hostprogs that may use this will need
734	to be bootstrapped manually until the host system is current.
735
736	Known problems: sys/arch/macppc/stand/fixcoff
737			usr.sbin/config (adding -DMAKE_BOOTSTRAP to
738			  CFLAGS and rebuilding should work)
739			usr.sbin/mdsetimage - Build a static copy if
740			  building a snapshot before fully bootstrapped.
741
74220010204:
743	prepare the code to compile with stricter gcc flags. in
744	particular start eliminating redundant declarations. Yacc
745	needs to be installed before make build.
746
74720010114:
748	introduce .if commands(target) in make(1). You need to
749	bring everything up-to-date first, then without installing
750	anything make and install in usr.bin/make, then proceed
751	with make build.
752
75320010101:
754	bsd.subdir.mk committed 20001230 had a bug which caused
755	afterinstall targets to run too soon; update again.
756
75720001230:
758	New share/mk files needed to support .WAIT in SUBDIR variables.
759	If you get make errors, 
760		(cd share/mk; make install)
761	Also, PRINTOBJDIR has changed and is now used more heavily.
762
76320001019:
764	The `ca' device driver has been replaced by `ld'; although the
765	major and minor numbers haven't changed, you should update your /dev
766	directory.
767
76820000929:
769	The following make directives are obsoleted.
770	MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA 
771	By default, RSA is built into libcrypto.  IDEA and RC5 will not be
772	built into libcrypto.  By using MKCRYPTO_{RC5,IDEA}, you can build
773	additional library libcrypto_{idea,rc5}.
774
775
776Hints for a more successful build:
777^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
778    Use build.sh, but do not use its "expert mode":
779	This will automatically build the tools in the
780	   correct order, and it will keep the tools and the
781	   new build products from interfering with the running
782	   system.  This will allow you to ignore most of the
783	   other advice in this file.
784    Build a new kernel first:
785	This makes sure that any new system calls or features
786	   expected by the new userland will be present.  This
787	   helps to avoid critical errors when upgrading.
788    Use object directories:
789	This helps to keep stale object
790	   files from polluting the build if a Makefile "forgets"
791	   about one.  It also makes it easier to clean up after
792	   a build.  It's also necessary if you want to use the
793	   same source tree for multiple machines.
794	   To use object directories with build.sh:
795	    a) invoke build.sh with the "-M" or "-O" options.
796	   To use object directories without using build.sh:
797	    a) cd /usr/src ; make cleandir
798	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
799	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
800	    d) cd /usr/src ; make build
801	   Note that running "make obj" in a directory will create
802	   in obj.$MACHINE directory.
803    Build to a DESTDIR:
804	This helps to keep old installed files (especially libraries)
805	   from interfering with the new build.
806	   To build to a DESTDIR with build.sh, use the "-D" option.
807	   To build to a DESTDIR without using build.sh, set the DESTDIR
808	   environment variable before running make build.  It should be
809	   set to the pathname of an initially empty directory.
810	   Problems: if you do not use build.sh, you might need to
811		update critical utilities without using DESTDIR since
812		nothing is executed from what is installed in DESTDIR.
813		(See critical utils, below.)
814    Build often:
815	This keeps critical utilities current enough to not choke
816	on any other part of the source tree that depends on up to
817	date functionality.  If you use build.sh, you should not have
818	this problem.
819 
820What to do if things don't work:
821^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
822When things don't work there is usually a few things that commonly
823should be done.
824    1)	make includes
825	This should be done automatically by make build.
826    2)  cd share/mk && make install
827	Again, automatically done by make build.
828
829Failsafe rebuild of a small part of the tree:
830^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
831To make sure you rebuild something correctly you want to do
832something like the following:
833    1)  Make sure the includes and .mk files are up to date.
834    2)  Make sure any program used to build the particular
835	utility is up to date.  (yacc, lex, etc...)
836    3)  cd ...path/to/util...
837	make cleandir
838	rm ...all obj directories...
839	make cleandir			# yes, again
840	make obj
841	make depend && make
842
843Failsafe rebuild of the entire tree:
844^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
845If you really want to make sure the source tree is clean and
846ready for a build try the following.  Note that sourcing /etc/mk.conf
847(a make(1) Makefile) in this manner is not right, and will not work
848for anyone who uses any make(1) features in /etc/mk.conf.
849
850---cut here---
851#!/bin/sh
852. /etc/mk.conf
853
854if [ -z $NETBSDSRCDIR ] ; then
855    NETBSDSRCDIR=/usr/src
856fi
857if [ \! -d $NETBSDSRCDIR ] ; then
858    echo Unable to find sources
859    exit 1
860fi
861find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
862
863if [ -z $BSDOBJDIR ] ; then
864    BSDOBJDIR=/usr/obj
865fi
866if [ -d $BSDOBJDIR ] ; then
867    rm -rf $BSDOBJDIR
868fi
869
870cd $NETBSDSRCDIR && make cleandir
871
872---cut here---
873
874Critical utilities:
875^^^^^^^^^^^^^^^^^^^
876	usr.bin/compile_et
877	usr.bin/make
878	usr.bin/yacc
879	usr.bin/lex
880	usr.bin/xlint
881	usr.bin/config
882
883Other problems and possible solutions:
884^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
885Symptom:Complaints involving a Makefile.
886Fix:	Rebuild usr.bin/make:
887	cd usr.bin/make && make && make install
888	Or, a failsafe method if that doesn't work:
889	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
890
891Fix:	Make sure .mk files are up to date.
892	cd share/mk && make install
893
894Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
895Fix:	Rebuild usr.bin/config
896
897Symptom:
898Fix:	Rebuild usr.bin/yacc
899
900Symptom:
901Fix:	Rebuild usr.bin/lex
902
903Symptom:
904Fix:	rm /usr/lib/libbfd.a
905
906Symptom:Obsolete intermediate files are used during compilation
907Fix:	Try the following sequence of commands in the directory in question.
908	make cleandir; rm `make print-objdir`; make cleandir; make obj
909	(If you built the tree without "make obj" in the past, obsolete files
910	may remain.  The command tries to clean everything up)
911
912Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
913Fix:	Rebuild and install usr.bin/menuc
914
915Symptom:mklocale not found during build in share/locale/ctype
916Fix:	Build and install usr.bin/mklocale
917
918Symptom:undefined reference to `__assert13' or `__unsetenv13'
919Fix:    Rebuild and install lib/libc
920
921Symptom:usr.bin/config fails to build.
922Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
923
924Symptom:undefined reference to `getprogname' or `setprogname'
925Fix:    Rebuild and install lib/libc
926
927Symptom:lint does not understand the '-X' option
928Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
929