UPDATING revision 1.175 1 $NetBSD: UPDATING,v 1.175 2008/08/01 07:34:57 simonb Exp $
2
3 This file (UPDATING) is intended to be a brief reference to recent
4 changes that might cause problems in the build process, and a guide for
5 what to do if something doesn't work.
6
7 For a more detailed description of the recommended way to build NetBSD
8 using build.sh, see the BUILDING file.
9
10 Note that much of the advice in this UPDATING file was written before
11 build.sh existed. Nevertheless, the advice here may be useful for
12 working around specific problems with build.sh.
13
14 See also: BUILDING, build.sh, Makefile.
15
16 Recent changes:
17 ^^^^^^^^^^^^^^^
18
19 20080731:
20 WAPBL (metadata journaling support) has been added, but at this
21 time isn't backwards compatible with pre-WAPBL aware kernels
22 and userland (fsck_ffs in particular). Please make sure you
23 don't use a journaled filesystem with an older kernel/userland,
24 especially an uncleanly mounted journaled filesystem.
25
26 20080721:
27 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
28 isn't defined.
29
30 20080531:
31 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
32 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
33 utility needs to be rebuilt and reinstalled as older binaries
34 won't work correctly. The following sequence of commands:
35
36 $ (cd sys/sys/ && nbmake-$arch includes)
37 $ (cd sbin/drvctl/ && nbmake-$arch clean)
38 $ (cd sbin/drvctl/ && nbmake-$arch all)
39
40 leaves new drvctl utility in sbin/drvctl build directory.
41
42 20080503:
43 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
44
45 20080521:
46 For a while, unprivileged UPDATE builds would fail to
47 succeed at the checkflist stage, complaining that
48 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
49 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
50 If you already hit this problem, update the .mk file,
51 remove ${DESTDIR}/stand/<arch>, and re-run the build.
52
53 20080303:
54 Linker warnings are now fatal if $WARNS>0.
55
56 20080126:
57 The posix_fadvise system call has been changed from an assembly
58 stub, to a c file that calls an assembly stub. You need to
59 'rm -f posix_fadvise.* .depend' in the libc build directory to
60 avoid using the old assembly stub.
61
62 20071209:
63 The acpiec(4) driver has been split into two attachments. If you
64 get ACPI errors before the attachment, please update your kernel
65 configuration file appropriately or see GENERIC for more details.
66
67 20071115:
68 The it(4) driver has been renamed to itesio(4) and the old port
69 argument specified in the kernel configuration file is not valid
70 anymore. The itesio(4) driver now uses the Super I/O address port
71 rather than the EC address port. Please update your kernel
72 configuration file appropriately or see GENERIC for more details.
73
74 20071028:
75 The pccons(4) driver has been removed from the NetBSD/shark port.
76 You need to update any custom kernel configuration file you have
77 to remove any references to pccons (which includes removing the
78 now useless XSERVER option) and replace them with the correct
79 entries for the wscons driver. See the GENERIC configuration file
80 for more details.
81
82 20070913:
83 A latent bug in dhclient/dhcpd that caused it to be unable to
84 enumerate interfaces was fixed. The bug began to cause
85 problems after 20070911 when the kernel's SIOCGIFCONF
86 implementation was repaired. From 20070529 to 20070911 racoon
87 could not enumerate interfaces. (These are noted because
88 normal kernel/userspace version matching hygiene is not
89 sufficient to avoid this problem.) Ensure that both kernel
90 and userland are from after 20070913.
91
92 20070703:
93 nbinstall has been renamed as it calls the target specific and
94 the logic to pass down STRIP from mk been removed. This forces
95 a re-installation of tools.
96
97 20070422:
98 The way OS emulations lookup filenames inside the emulation root
99 has been changed. Rather than modify the pathname (and copy back
100 to userspace) namei() and lookup() directly check the emulation
101 root. One side effect is that absolute symlinks inside the emulated
102 root file system will be relative to that file system - unless they
103 start /../ this is useful when the emulated root is a real install
104 that has such links.
105 This might affect symlinks that have been added to reference outside
106 the emulated root.
107
108 20070412:
109 The pckbc driver on sgimips IP32 has been removed. Use macekbc
110 instead. See the GENERIC32_IP3x kernel configuration for an
111 example.
112
113 20070319:
114 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
115 on many platforms due to incorrect flags settings. If you
116 updated and built after about 20070315, do "nbmake-$arch
117 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
118 rebuild of object files that might have been built
119 incorrectly, and ensure that you have at least
120 src/lib/libc/Makefile 1.130.
121
122 20070210:
123 src/sys/sys/{sa.h,savar.h} were removed.
124 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
125 | xargs egrep -l '/sa.h|/savar.h' | xargs rm
126 will allow dependencies on those files to get get rebuilt
127
128 20070209:
129 The threading model was changed when the newlock2 branch
130 was merged to NetBSD-current. If you boot with a new
131 kernel (version 4.99.10), then you also need a new pthread
132 library (/usr/lib/libpthread.so.0.7). If you boot with
133 an old kernel, then you need the old pthread library
134 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
135 the pthread library in sync, old threaded applications should
136 continue to work with an old or new kernel. Note that named(8)
137 is the only threaded application in the base system.
138
139 20061214:
140 Following the move of string_to_flags() and flags_to_string()
141 from the bin/ls/ sources to libutil, users doing UPDATE builds
142 will need to do a "make cleandir" in
143 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
144 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
145 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
146 as the installation images in distrib/
147 in order to excise stale references to the old stat_flags.h header
148 file in the ls sources -- stat_flags.h has been removed.
149
150 20061108:
151 The configure script used in the src/tools/gcc compiler has been
152 changed to indicate that our libc has ssp support built-in and
153 does not depend on -lssp and -lssp-nonshared. You'll need to
154 make clean in src/tools/gcc first to rebuild the compiler.
155
156 20061009:
157 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
158 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
159
160 20060814:
161 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
162 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
163 kernel configuration for an example. X servers from the last
164 few years should cope.
165
166 20060703:
167 MPACPI is no more. We always configure PCI interrupts using ACPI
168 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
169 to ACPI_SCANPCI. Thanks to work from fvdl.
170
171 20060627:
172 socket(2) has changed, and its system call has been versioned.
173 For userlands with the old version of socket(2), make sure that
174 your kernel has 'options COMPAT_30' set, or else 'bad system call'
175 errors will result.
176
177 Hints for a more successful build:
178 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
179 Use build.sh, but do not use its "expert mode":
180 This will automatically build the tools in the
181 correct order, and it will keep the tools and the
182 new build products from interfering with the running
183 system. This will allow you to ignore most of the
184 other advice in this file.
185 Build a new kernel first:
186 This makes sure that any new system calls or features
187 expected by the new userland will be present. This
188 helps to avoid critical errors when upgrading.
189 Use object directories:
190 This helps to keep stale object
191 files from polluting the build if a Makefile "forgets"
192 about one. It also makes it easier to clean up after
193 a build. It's also necessary if you want to use the
194 same source tree for multiple machines.
195 To use object directories with build.sh:
196 a) invoke build.sh with the "-M" or "-O" options.
197 To use object directories without using build.sh:
198 a) cd /usr/src ; make cleandir
199 b) Add "OBJMACHINE=yes" to /etc/mk.conf
200 c) Add "MKOBJDIRS=yes" to /etc/mk.conf
201 d) cd /usr/src ; make build
202 Note that running "make obj" in a directory will create
203 in obj.$MACHINE directory.
204 Build to a DESTDIR:
205 This helps to keep old installed files (especially libraries)
206 from interfering with the new build.
207 To build to a DESTDIR with build.sh, use the "-D" option.
208 To build to a DESTDIR without using build.sh, set the DESTDIR
209 environment variable before running make build. It should be
210 set to the pathname of an initially empty directory.
211 Problems: if you do not use build.sh, you might need to
212 update critical utilities without using DESTDIR since
213 nothing is executed from what is installed in DESTDIR.
214 (See critical utils, below.)
215 Build often:
216 This keeps critical utilities current enough to not choke
217 on any other part of the source tree that depends on up to
218 date functionality. If you use build.sh, you should not have
219 this problem.
220
221 What to do if things don't work:
222 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
223 When things don't work there is usually a few things that commonly
224 should be done.
225 1) make includes
226 This should be done automatically by make build.
227 2) cd share/mk && make install
228 Again, automatically done by make build.
229
230 Failsafe rebuild of a small part of the tree:
231 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
232 To make sure you rebuild something correctly you want to do
233 something like the following:
234 1) Make sure the includes and .mk files are up to date.
235 2) Make sure any program used to build the particular
236 utility is up to date. (yacc, lex, etc...)
237 3) cd ...path/to/util...
238 make cleandir
239 rm ...all obj directories...
240 make cleandir # yes, again
241 make obj
242 make depend && make
243
244 Failsafe rebuild of the entire tree:
245 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
246 If you really want to make sure the source tree is clean and
247 ready for a build try the following. Note that sourcing /etc/mk.conf
248 (a make(1) Makefile) in this manner is not right, and will not work
249 for anyone who uses any make(1) features in /etc/mk.conf.
250
251 ---cut here---
252 #!/bin/sh
253 . /etc/mk.conf
254
255 if [ -z $NETBSDSRCDIR ] ; then
256 NETBSDSRCDIR=/usr/src
257 fi
258 if [ \! -d $NETBSDSRCDIR ] ; then
259 echo Unable to find sources
260 exit 1
261 fi
262 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
263
264 if [ -z $BSDOBJDIR ] ; then
265 BSDOBJDIR=/usr/obj
266 fi
267 if [ -d $BSDOBJDIR ] ; then
268 rm -rf $BSDOBJDIR
269 fi
270
271 cd $NETBSDSRCDIR && make cleandir
272
273 ---cut here---
274
275 Critical utilities:
276 ^^^^^^^^^^^^^^^^^^^
277 usr.bin/compile_et
278 usr.bin/make
279 usr.bin/yacc
280 usr.bin/lex
281 usr.bin/xlint
282 usr.bin/config
283
284 Other problems and possible solutions:
285 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
286 Symptom:Complaints involving a Makefile.
287 Fix: Rebuild usr.bin/make:
288 cd usr.bin/make && make && make install
289 Or, a failsafe method if that doesn't work:
290 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
291
292 Fix: Make sure .mk files are up to date.
293 cd share/mk && make install
294
295 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
296 Fix: Rebuild usr.bin/config
297
298 Symptom:
299 Fix: Rebuild usr.bin/yacc
300
301 Symptom:
302 Fix: Rebuild usr.bin/lex
303
304 Symptom:
305 Fix: rm /usr/lib/libbfd.a
306
307 Symptom:Obsolete intermediate files are used during compilation
308 Fix: Try the following sequence of commands in the directory in question.
309 make cleandir; rm `make print-objdir`; make cleandir; make obj
310 (If you built the tree without "make obj" in the past, obsolete files
311 may remain. The command tries to clean everything up)
312
313 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
314 Fix: Rebuild and install usr.bin/menuc
315
316 Symptom:mklocale not found during build in share/locale/ctype
317 Fix: Build and install usr.bin/mklocale
318
319 Symptom:undefined reference to `__assert13' or `__unsetenv13'
320 Fix: Rebuild and install lib/libc
321
322 Symptom:usr.bin/config fails to build.
323 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
324
325 Symptom:undefined reference to `getprogname' or `setprogname'
326 Fix: Rebuild and install lib/libc
327
328 Symptom:lint does not understand the '-X' option
329 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
330