UPDATING revision 1.178.2.2 1 $NetBSD: UPDATING,v 1.178.2.2 2009/05/30 16:40:30 snj Exp $
2
3 This file (UPDATING) is intended to be a brief reference to recent
4 changes that might cause problems in the build process, and a guide for
5 what to do if something doesn't work.
6
7 For a more detailed description of the recommended way to build NetBSD
8 using build.sh, see the BUILDING file.
9
10 Note that much of the advice in this UPDATING file was written before
11 build.sh existed. Nevertheless, the advice here may be useful for
12 working around specific problems with build.sh.
13
14 See also: BUILDING, build.sh, Makefile.
15
16 Recent changes:
17 ^^^^^^^^^^^^^^^
18
19 20090530:
20 pkg_install now depends on the pkgdb cache for automatic conflict
21 detection. It is recommented to rebuild the cache with
22 ``pkg_admin rebuild''.
23
24 audit-packages.conf(5) has been superseded by pkg_install.conf(5).
25 The default configuration is the same. Support for pkg_view(1) has
26 been retired. The functionality of audit-packages(1) and
27 download-vulnerability-list(1) has moved into pkg_admin(1), wrapper
28 scripts that handle the common use cases are provided.
29
30 20081205:
31 If you build with MKX11=no, you should remove /etc/rc.d/xdm and
32 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
33 set and will appear as extra files for MKX11=no update builds.
34
35 20080827:
36 If you built and installed a libc from sources between
37 2008/08/20 and 2008/08/26 you got a broken strtouq(3)
38 which results in false errors reported by lint(1).
39 Since this breaks the libc build itself, manual help is
40 needed -- lint must be disabled temporarily, e.g:
41 $ (cd lib/libc && make MKLINT=no dependall install)
42
43 20080813:
44 MKDEBUG build was broken because the .depend files did not know
45 about .go files. You need to remove all .depend files and rebuild.
46
47 20080731:
48 WAPBL (metadata journaling support) has been added, but at this
49 time isn't backwards compatible with pre-WAPBL aware kernels
50 and userland (fsck_ffs in particular). Please make sure you
51 don't use a journaled filesystem with an older kernel/userland,
52 especially an uncleanly mounted journaled filesystem. WAPBL
53 also requires the super block to be in the UFS2 format. You
54 can use fsck_ffs -c 4 to update the superblock format.
55
56 20080721:
57 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
58 isn't defined.
59
60 20080531:
61 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
62 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
63 utility needs to be rebuilt and reinstalled as older binaries
64 won't work correctly. The following sequence of commands:
65
66 $ (cd sys/sys/ && nbmake-$arch includes)
67 $ (cd sbin/drvctl/ && nbmake-$arch clean)
68 $ (cd sbin/drvctl/ && nbmake-$arch all)
69
70 leaves new drvctl utility in sbin/drvctl build directory.
71
72 20080503:
73 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
74
75 20080521:
76 For a while, unprivileged UPDATE builds would fail to
77 succeed at the checkflist stage, complaining that
78 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
79 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
80 If you already hit this problem, update the .mk file,
81 remove ${DESTDIR}/stand/<arch>, and re-run the build.
82
83 20080303:
84 Linker warnings are now fatal if $WARNS>0.
85
86 20080126:
87 The posix_fadvise system call has been changed from an assembly
88 stub, to a c file that calls an assembly stub. You need to
89 'rm -f posix_fadvise.* .depend' in the libc build directory to
90 avoid using the old assembly stub.
91
92 20071209:
93 The acpiec(4) driver has been split into two attachments. If you
94 get ACPI errors before the attachment, please update your kernel
95 configuration file appropriately or see GENERIC for more details.
96
97 20071115:
98 The it(4) driver has been renamed to itesio(4) and the old port
99 argument specified in the kernel configuration file is not valid
100 anymore. The itesio(4) driver now uses the Super I/O address port
101 rather than the EC address port. Please update your kernel
102 configuration file appropriately or see GENERIC for more details.
103
104 20071028:
105 The pccons(4) driver has been removed from the NetBSD/shark port.
106 You need to update any custom kernel configuration file you have
107 to remove any references to pccons (which includes removing the
108 now useless XSERVER option) and replace them with the correct
109 entries for the wscons driver. See the GENERIC configuration file
110 for more details.
111
112 20070913:
113 A latent bug in dhclient/dhcpd that caused it to be unable to
114 enumerate interfaces was fixed. The bug began to cause
115 problems after 20070911 when the kernel's SIOCGIFCONF
116 implementation was repaired. From 20070529 to 20070911 racoon
117 could not enumerate interfaces. (These are noted because
118 normal kernel/userspace version matching hygiene is not
119 sufficient to avoid this problem.) Ensure that both kernel
120 and userland are from after 20070913.
121
122 20070703:
123 nbinstall has been renamed as it calls the target specific and
124 the logic to pass down STRIP from mk been removed. This forces
125 a re-installation of tools.
126
127 20070422:
128 The way OS emulations lookup filenames inside the emulation root
129 has been changed. Rather than modify the pathname (and copy back
130 to userspace) namei() and lookup() directly check the emulation
131 root. One side effect is that absolute symlinks inside the emulated
132 root file system will be relative to that file system - unless they
133 start /../ this is useful when the emulated root is a real install
134 that has such links.
135 This might affect symlinks that have been added to reference outside
136 the emulated root.
137
138 20070412:
139 The pckbc driver on sgimips IP32 has been removed. Use macekbc
140 instead. See the GENERIC32_IP3x kernel configuration for an
141 example.
142
143 20070319:
144 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
145 on many platforms due to incorrect flags settings. If you
146 updated and built after about 20070315, do "nbmake-$arch
147 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
148 rebuild of object files that might have been built
149 incorrectly, and ensure that you have at least
150 src/lib/libc/Makefile 1.130.
151
152 20070210:
153 src/sys/sys/{sa.h,savar.h} were removed.
154 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
155 | xargs egrep -l '/sa.h|/savar.h' | xargs rm
156 will allow dependencies on those files to get get rebuilt
157
158 20070209:
159 The threading model was changed when the newlock2 branch
160 was merged to NetBSD-current. If you boot with a new
161 kernel (version 4.99.10), then you also need a new pthread
162 library (/usr/lib/libpthread.so.0.7). If you boot with
163 an old kernel, then you need the old pthread library
164 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
165 the pthread library in sync, old threaded applications should
166 continue to work with an old or new kernel. Note that named(8)
167 is the only threaded application in the base system.
168
169 20061214:
170 Following the move of string_to_flags() and flags_to_string()
171 from the bin/ls/ sources to libutil, users doing UPDATE builds
172 will need to do a "make cleandir" in
173 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
174 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
175 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
176 as the installation images in distrib/
177 in order to excise stale references to the old stat_flags.h header
178 file in the ls sources -- stat_flags.h has been removed.
179
180 20061108:
181 The configure script used in the src/tools/gcc compiler has been
182 changed to indicate that our libc has ssp support built-in and
183 does not depend on -lssp and -lssp-nonshared. You'll need to
184 make clean in src/tools/gcc first to rebuild the compiler.
185
186 20061009:
187 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
188 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
189
190 20060814:
191 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
192 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
193 kernel configuration for an example. X servers from the last
194 few years should cope.
195
196 20060703:
197 MPACPI is no more. We always configure PCI interrupts using ACPI
198 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
199 to ACPI_SCANPCI. Thanks to work from fvdl.
200
201 20060627:
202 socket(2) has changed, and its system call has been versioned.
203 For userlands with the old version of socket(2), make sure that
204 your kernel has 'options COMPAT_30' set, or else 'bad system call'
205 errors will result.
206
207 Hints for a more successful build:
208 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
209 Use build.sh, but do not use its "expert mode":
210 This will automatically build the tools in the
211 correct order, and it will keep the tools and the
212 new build products from interfering with the running
213 system. This will allow you to ignore most of the
214 other advice in this file.
215 Build a new kernel first:
216 This makes sure that any new system calls or features
217 expected by the new userland will be present. This
218 helps to avoid critical errors when upgrading.
219 Use object directories:
220 This helps to keep stale object
221 files from polluting the build if a Makefile "forgets"
222 about one. It also makes it easier to clean up after
223 a build. It's also necessary if you want to use the
224 same source tree for multiple machines.
225 To use object directories with build.sh:
226 a) invoke build.sh with the "-M" or "-O" options.
227 To use object directories without using build.sh:
228 a) cd /usr/src ; make cleandir
229 b) Add "OBJMACHINE=yes" to /etc/mk.conf
230 c) Add "MKOBJDIRS=yes" to /etc/mk.conf
231 d) cd /usr/src ; make build
232 Note that running "make obj" in a directory will create
233 in obj.$MACHINE directory.
234 Build to a DESTDIR:
235 This helps to keep old installed files (especially libraries)
236 from interfering with the new build.
237 To build to a DESTDIR with build.sh, use the "-D" option.
238 To build to a DESTDIR without using build.sh, set the DESTDIR
239 environment variable before running make build. It should be
240 set to the pathname of an initially empty directory.
241 Problems: if you do not use build.sh, you might need to
242 update critical utilities without using DESTDIR since
243 nothing is executed from what is installed in DESTDIR.
244 (See critical utils, below.)
245 Build often:
246 This keeps critical utilities current enough to not choke
247 on any other part of the source tree that depends on up to
248 date functionality. If you use build.sh, you should not have
249 this problem.
250
251 What to do if things don't work:
252 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
253 When things don't work there is usually a few things that commonly
254 should be done.
255 1) make includes
256 This should be done automatically by make build.
257 2) cd share/mk && make install
258 Again, automatically done by make build.
259
260 Failsafe rebuild of a small part of the tree:
261 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
262 To make sure you rebuild something correctly you want to do
263 something like the following:
264 1) Make sure the includes and .mk files are up to date.
265 2) Make sure any program used to build the particular
266 utility is up to date. (yacc, lex, etc...)
267 3) cd ...path/to/util...
268 make cleandir
269 rm ...all obj directories...
270 make cleandir # yes, again
271 make obj
272 make depend && make
273
274 Failsafe rebuild of the entire tree:
275 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
276 If you really want to make sure the source tree is clean and
277 ready for a build try the following. Note that sourcing /etc/mk.conf
278 (a make(1) Makefile) in this manner is not right, and will not work
279 for anyone who uses any make(1) features in /etc/mk.conf.
280
281 ---cut here---
282 #!/bin/sh
283 . /etc/mk.conf
284
285 if [ -z $NETBSDSRCDIR ] ; then
286 NETBSDSRCDIR=/usr/src
287 fi
288 if [ \! -d $NETBSDSRCDIR ] ; then
289 echo Unable to find sources
290 exit 1
291 fi
292 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
293
294 if [ -z $BSDOBJDIR ] ; then
295 BSDOBJDIR=/usr/obj
296 fi
297 if [ -d $BSDOBJDIR ] ; then
298 rm -rf $BSDOBJDIR
299 fi
300
301 cd $NETBSDSRCDIR && make cleandir
302
303 ---cut here---
304
305 Critical utilities:
306 ^^^^^^^^^^^^^^^^^^^
307 usr.bin/compile_et
308 usr.bin/make
309 usr.bin/yacc
310 usr.bin/lex
311 usr.bin/xlint
312 usr.bin/config
313
314 Other problems and possible solutions:
315 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
316 Symptom:Complaints involving a Makefile.
317 Fix: Rebuild usr.bin/make:
318 cd usr.bin/make && make && make install
319 Or, a failsafe method if that doesn't work:
320 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
321
322 Fix: Make sure .mk files are up to date.
323 cd share/mk && make install
324
325 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
326 Fix: Rebuild usr.bin/config
327
328 Symptom:
329 Fix: Rebuild usr.bin/yacc
330
331 Symptom:
332 Fix: Rebuild usr.bin/lex
333
334 Symptom:
335 Fix: rm /usr/lib/libbfd.a
336
337 Symptom:Obsolete intermediate files are used during compilation
338 Fix: Try the following sequence of commands in the directory in question.
339 make cleandir; rm `make print-objdir`; make cleandir; make obj
340 (If you built the tree without "make obj" in the past, obsolete files
341 may remain. The command tries to clean everything up)
342
343 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
344 Fix: Rebuild and install usr.bin/menuc
345
346 Symptom:mklocale not found during build in share/locale/ctype
347 Fix: Build and install usr.bin/mklocale
348
349 Symptom:undefined reference to `__assert13' or `__unsetenv13'
350 Fix: Rebuild and install lib/libc
351
352 Symptom:usr.bin/config fails to build.
353 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
354
355 Symptom:undefined reference to `getprogname' or `setprogname'
356 Fix: Rebuild and install lib/libc
357
358 Symptom:lint does not understand the '-X' option
359 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
360