UPDATING revision 1.176 1 $NetBSD: UPDATING,v 1.176 2008/08/02 14:30:37 simonb Exp $
2
3 This file (UPDATING) is intended to be a brief reference to recent
4 changes that might cause problems in the build process, and a guide for
5 what to do if something doesn't work.
6
7 For a more detailed description of the recommended way to build NetBSD
8 using build.sh, see the BUILDING file.
9
10 Note that much of the advice in this UPDATING file was written before
11 build.sh existed. Nevertheless, the advice here may be useful for
12 working around specific problems with build.sh.
13
14 See also: BUILDING, build.sh, Makefile.
15
16 Recent changes:
17 ^^^^^^^^^^^^^^^
18
19 20080731:
20 WAPBL (metadata journaling support) has been added, but at this
21 time isn't backwards compatible with pre-WAPBL aware kernels
22 and userland (fsck_ffs in particular). Please make sure you
23 don't use a journaled filesystem with an older kernel/userland,
24 especially an uncleanly mounted journaled filesystem. WAPBL
25 also requires the super block to be in the UFS2 format. You
26 can use fsck_ffs -c 4 to update the superblock format.
27
28 20080721:
29 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
30 isn't defined.
31
32 20080531:
33 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
34 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
35 utility needs to be rebuilt and reinstalled as older binaries
36 won't work correctly. The following sequence of commands:
37
38 $ (cd sys/sys/ && nbmake-$arch includes)
39 $ (cd sbin/drvctl/ && nbmake-$arch clean)
40 $ (cd sbin/drvctl/ && nbmake-$arch all)
41
42 leaves new drvctl utility in sbin/drvctl build directory.
43
44 20080503:
45 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
46
47 20080521:
48 For a while, unprivileged UPDATE builds would fail to
49 succeed at the checkflist stage, complaining that
50 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
51 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
52 If you already hit this problem, update the .mk file,
53 remove ${DESTDIR}/stand/<arch>, and re-run the build.
54
55 20080303:
56 Linker warnings are now fatal if $WARNS>0.
57
58 20080126:
59 The posix_fadvise system call has been changed from an assembly
60 stub, to a c file that calls an assembly stub. You need to
61 'rm -f posix_fadvise.* .depend' in the libc build directory to
62 avoid using the old assembly stub.
63
64 20071209:
65 The acpiec(4) driver has been split into two attachments. If you
66 get ACPI errors before the attachment, please update your kernel
67 configuration file appropriately or see GENERIC for more details.
68
69 20071115:
70 The it(4) driver has been renamed to itesio(4) and the old port
71 argument specified in the kernel configuration file is not valid
72 anymore. The itesio(4) driver now uses the Super I/O address port
73 rather than the EC address port. Please update your kernel
74 configuration file appropriately or see GENERIC for more details.
75
76 20071028:
77 The pccons(4) driver has been removed from the NetBSD/shark port.
78 You need to update any custom kernel configuration file you have
79 to remove any references to pccons (which includes removing the
80 now useless XSERVER option) and replace them with the correct
81 entries for the wscons driver. See the GENERIC configuration file
82 for more details.
83
84 20070913:
85 A latent bug in dhclient/dhcpd that caused it to be unable to
86 enumerate interfaces was fixed. The bug began to cause
87 problems after 20070911 when the kernel's SIOCGIFCONF
88 implementation was repaired. From 20070529 to 20070911 racoon
89 could not enumerate interfaces. (These are noted because
90 normal kernel/userspace version matching hygiene is not
91 sufficient to avoid this problem.) Ensure that both kernel
92 and userland are from after 20070913.
93
94 20070703:
95 nbinstall has been renamed as it calls the target specific and
96 the logic to pass down STRIP from mk been removed. This forces
97 a re-installation of tools.
98
99 20070422:
100 The way OS emulations lookup filenames inside the emulation root
101 has been changed. Rather than modify the pathname (and copy back
102 to userspace) namei() and lookup() directly check the emulation
103 root. One side effect is that absolute symlinks inside the emulated
104 root file system will be relative to that file system - unless they
105 start /../ this is useful when the emulated root is a real install
106 that has such links.
107 This might affect symlinks that have been added to reference outside
108 the emulated root.
109
110 20070412:
111 The pckbc driver on sgimips IP32 has been removed. Use macekbc
112 instead. See the GENERIC32_IP3x kernel configuration for an
113 example.
114
115 20070319:
116 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
117 on many platforms due to incorrect flags settings. If you
118 updated and built after about 20070315, do "nbmake-$arch
119 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
120 rebuild of object files that might have been built
121 incorrectly, and ensure that you have at least
122 src/lib/libc/Makefile 1.130.
123
124 20070210:
125 src/sys/sys/{sa.h,savar.h} were removed.
126 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
127 | xargs egrep -l '/sa.h|/savar.h' | xargs rm
128 will allow dependencies on those files to get get rebuilt
129
130 20070209:
131 The threading model was changed when the newlock2 branch
132 was merged to NetBSD-current. If you boot with a new
133 kernel (version 4.99.10), then you also need a new pthread
134 library (/usr/lib/libpthread.so.0.7). If you boot with
135 an old kernel, then you need the old pthread library
136 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
137 the pthread library in sync, old threaded applications should
138 continue to work with an old or new kernel. Note that named(8)
139 is the only threaded application in the base system.
140
141 20061214:
142 Following the move of string_to_flags() and flags_to_string()
143 from the bin/ls/ sources to libutil, users doing UPDATE builds
144 will need to do a "make cleandir" in
145 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
146 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
147 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
148 as the installation images in distrib/
149 in order to excise stale references to the old stat_flags.h header
150 file in the ls sources -- stat_flags.h has been removed.
151
152 20061108:
153 The configure script used in the src/tools/gcc compiler has been
154 changed to indicate that our libc has ssp support built-in and
155 does not depend on -lssp and -lssp-nonshared. You'll need to
156 make clean in src/tools/gcc first to rebuild the compiler.
157
158 20061009:
159 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
160 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
161
162 20060814:
163 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
164 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
165 kernel configuration for an example. X servers from the last
166 few years should cope.
167
168 20060703:
169 MPACPI is no more. We always configure PCI interrupts using ACPI
170 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
171 to ACPI_SCANPCI. Thanks to work from fvdl.
172
173 20060627:
174 socket(2) has changed, and its system call has been versioned.
175 For userlands with the old version of socket(2), make sure that
176 your kernel has 'options COMPAT_30' set, or else 'bad system call'
177 errors will result.
178
179 Hints for a more successful build:
180 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
181 Use build.sh, but do not use its "expert mode":
182 This will automatically build the tools in the
183 correct order, and it will keep the tools and the
184 new build products from interfering with the running
185 system. This will allow you to ignore most of the
186 other advice in this file.
187 Build a new kernel first:
188 This makes sure that any new system calls or features
189 expected by the new userland will be present. This
190 helps to avoid critical errors when upgrading.
191 Use object directories:
192 This helps to keep stale object
193 files from polluting the build if a Makefile "forgets"
194 about one. It also makes it easier to clean up after
195 a build. It's also necessary if you want to use the
196 same source tree for multiple machines.
197 To use object directories with build.sh:
198 a) invoke build.sh with the "-M" or "-O" options.
199 To use object directories without using build.sh:
200 a) cd /usr/src ; make cleandir
201 b) Add "OBJMACHINE=yes" to /etc/mk.conf
202 c) Add "MKOBJDIRS=yes" to /etc/mk.conf
203 d) cd /usr/src ; make build
204 Note that running "make obj" in a directory will create
205 in obj.$MACHINE directory.
206 Build to a DESTDIR:
207 This helps to keep old installed files (especially libraries)
208 from interfering with the new build.
209 To build to a DESTDIR with build.sh, use the "-D" option.
210 To build to a DESTDIR without using build.sh, set the DESTDIR
211 environment variable before running make build. It should be
212 set to the pathname of an initially empty directory.
213 Problems: if you do not use build.sh, you might need to
214 update critical utilities without using DESTDIR since
215 nothing is executed from what is installed in DESTDIR.
216 (See critical utils, below.)
217 Build often:
218 This keeps critical utilities current enough to not choke
219 on any other part of the source tree that depends on up to
220 date functionality. If you use build.sh, you should not have
221 this problem.
222
223 What to do if things don't work:
224 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
225 When things don't work there is usually a few things that commonly
226 should be done.
227 1) make includes
228 This should be done automatically by make build.
229 2) cd share/mk && make install
230 Again, automatically done by make build.
231
232 Failsafe rebuild of a small part of the tree:
233 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
234 To make sure you rebuild something correctly you want to do
235 something like the following:
236 1) Make sure the includes and .mk files are up to date.
237 2) Make sure any program used to build the particular
238 utility is up to date. (yacc, lex, etc...)
239 3) cd ...path/to/util...
240 make cleandir
241 rm ...all obj directories...
242 make cleandir # yes, again
243 make obj
244 make depend && make
245
246 Failsafe rebuild of the entire tree:
247 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
248 If you really want to make sure the source tree is clean and
249 ready for a build try the following. Note that sourcing /etc/mk.conf
250 (a make(1) Makefile) in this manner is not right, and will not work
251 for anyone who uses any make(1) features in /etc/mk.conf.
252
253 ---cut here---
254 #!/bin/sh
255 . /etc/mk.conf
256
257 if [ -z $NETBSDSRCDIR ] ; then
258 NETBSDSRCDIR=/usr/src
259 fi
260 if [ \! -d $NETBSDSRCDIR ] ; then
261 echo Unable to find sources
262 exit 1
263 fi
264 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
265
266 if [ -z $BSDOBJDIR ] ; then
267 BSDOBJDIR=/usr/obj
268 fi
269 if [ -d $BSDOBJDIR ] ; then
270 rm -rf $BSDOBJDIR
271 fi
272
273 cd $NETBSDSRCDIR && make cleandir
274
275 ---cut here---
276
277 Critical utilities:
278 ^^^^^^^^^^^^^^^^^^^
279 usr.bin/compile_et
280 usr.bin/make
281 usr.bin/yacc
282 usr.bin/lex
283 usr.bin/xlint
284 usr.bin/config
285
286 Other problems and possible solutions:
287 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
288 Symptom:Complaints involving a Makefile.
289 Fix: Rebuild usr.bin/make:
290 cd usr.bin/make && make && make install
291 Or, a failsafe method if that doesn't work:
292 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
293
294 Fix: Make sure .mk files are up to date.
295 cd share/mk && make install
296
297 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
298 Fix: Rebuild usr.bin/config
299
300 Symptom:
301 Fix: Rebuild usr.bin/yacc
302
303 Symptom:
304 Fix: Rebuild usr.bin/lex
305
306 Symptom:
307 Fix: rm /usr/lib/libbfd.a
308
309 Symptom:Obsolete intermediate files are used during compilation
310 Fix: Try the following sequence of commands in the directory in question.
311 make cleandir; rm `make print-objdir`; make cleandir; make obj
312 (If you built the tree without "make obj" in the past, obsolete files
313 may remain. The command tries to clean everything up)
314
315 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
316 Fix: Rebuild and install usr.bin/menuc
317
318 Symptom:mklocale not found during build in share/locale/ctype
319 Fix: Build and install usr.bin/mklocale
320
321 Symptom:undefined reference to `__assert13' or `__unsetenv13'
322 Fix: Rebuild and install lib/libc
323
324 Symptom:usr.bin/config fails to build.
325 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
326
327 Symptom:undefined reference to `getprogname' or `setprogname'
328 Fix: Rebuild and install lib/libc
329
330 Symptom:lint does not understand the '-X' option
331 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
332