UPDATING revision 1.178.2.3 1 1.178.2.3 riz $NetBSD: UPDATING,v 1.178.2.3 2010/06/12 01:55:43 riz Exp $
2 1.1 abs
3 1.123 jmc This file (UPDATING) is intended to be a brief reference to recent
4 1.123 jmc changes that might cause problems in the build process, and a guide for
5 1.123 jmc what to do if something doesn't work.
6 1.1 abs
7 1.123 jmc For a more detailed description of the recommended way to build NetBSD
8 1.123 jmc using build.sh, see the BUILDING file.
9 1.123 jmc
10 1.123 jmc Note that much of the advice in this UPDATING file was written before
11 1.123 jmc build.sh existed. Nevertheless, the advice here may be useful for
12 1.123 jmc working around specific problems with build.sh.
13 1.123 jmc
14 1.123 jmc See also: BUILDING, build.sh, Makefile.
15 1.1 abs
16 1.1 abs Recent changes:
17 1.1 abs ^^^^^^^^^^^^^^^
18 1.138 lukem
19 1.178.2.3 riz 20090616:
20 1.178.2.3 riz Native Xorg was upgraded. Builds will need a clean objdir for
21 1.178.2.3 riz src/external/mit/xorg. Upgrading a system from sets will not
22 1.178.2.3 riz work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
23 1.178.2.3 riz subdirectory has been changed into a file, and this needs to
24 1.178.2.3 riz be manually "rm -r"'ed before installing xbase.tgz.
25 1.178.2.3 riz
26 1.178.2.2 snj 20090530:
27 1.178.2.2 snj pkg_install now depends on the pkgdb cache for automatic conflict
28 1.178.2.2 snj detection. It is recommented to rebuild the cache with
29 1.178.2.2 snj ``pkg_admin rebuild''.
30 1.178.2.2 snj
31 1.178.2.2 snj audit-packages.conf(5) has been superseded by pkg_install.conf(5).
32 1.178.2.2 snj The default configuration is the same. Support for pkg_view(1) has
33 1.178.2.2 snj been retired. The functionality of audit-packages(1) and
34 1.178.2.2 snj download-vulnerability-list(1) has moved into pkg_admin(1), wrapper
35 1.178.2.2 snj scripts that handle the common use cases are provided.
36 1.178.2.2 snj
37 1.178.2.1 snj 20081205:
38 1.178.2.1 snj If you build with MKX11=no, you should remove /etc/rc.d/xdm and
39 1.178.2.1 snj /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
40 1.178.2.1 snj set and will appear as extra files for MKX11=no update builds.
41 1.178 lukem
42 1.178 lukem 20080827:
43 1.178 lukem If you built and installed a libc from sources between
44 1.178 lukem 2008/08/20 and 2008/08/26 you got a broken strtouq(3)
45 1.178 lukem which results in false errors reported by lint(1).
46 1.178 lukem Since this breaks the libc build itself, manual help is
47 1.178 lukem needed -- lint must be disabled temporarily, e.g:
48 1.178 lukem $ (cd lib/libc && make MKLINT=no dependall install)
49 1.178 lukem
50 1.177 christos 20080813:
51 1.177 christos MKDEBUG build was broken because the .depend files did not know
52 1.177 christos about .go files. You need to remove all .depend files and rebuild.
53 1.177 christos
54 1.175 simonb 20080731:
55 1.175 simonb WAPBL (metadata journaling support) has been added, but at this
56 1.175 simonb time isn't backwards compatible with pre-WAPBL aware kernels
57 1.175 simonb and userland (fsck_ffs in particular). Please make sure you
58 1.175 simonb don't use a journaled filesystem with an older kernel/userland,
59 1.176 simonb especially an uncleanly mounted journaled filesystem. WAPBL
60 1.176 simonb also requires the super block to be in the UFS2 format. You
61 1.176 simonb can use fsck_ffs -c 4 to update the superblock format.
62 1.175 simonb
63 1.174 lukem 20080721:
64 1.174 lukem Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
65 1.174 lukem isn't defined.
66 1.174 lukem
67 1.173 freza 20080531:
68 1.173 freza The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
69 1.173 freza from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
70 1.173 freza utility needs to be rebuilt and reinstalled as older binaries
71 1.173 freza won't work correctly. The following sequence of commands:
72 1.173 freza
73 1.173 freza $ (cd sys/sys/ && nbmake-$arch includes)
74 1.173 freza $ (cd sbin/drvctl/ && nbmake-$arch clean)
75 1.173 freza $ (cd sbin/drvctl/ && nbmake-$arch all)
76 1.173 freza
77 1.173 freza leaves new drvctl utility in sbin/drvctl build directory.
78 1.173 freza
79 1.172 lukem 20080503:
80 1.172 lukem The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
81 1.172 lukem
82 1.171 he 20080521:
83 1.171 he For a while, unprivileged UPDATE builds would fail to
84 1.171 he succeed at the checkflist stage, complaining that
85 1.171 he ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
86 1.171 he problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
87 1.171 he If you already hit this problem, update the .mk file,
88 1.171 he remove ${DESTDIR}/stand/<arch>, and re-run the build.
89 1.171 he
90 1.174 lukem 20080303:
91 1.174 lukem Linker warnings are now fatal if $WARNS>0.
92 1.174 lukem
93 1.170 christos 20080126:
94 1.170 christos The posix_fadvise system call has been changed from an assembly
95 1.170 christos stub, to a c file that calls an assembly stub. You need to
96 1.170 christos 'rm -f posix_fadvise.* .depend' in the libc build directory to
97 1.170 christos avoid using the old assembly stub.
98 1.170 christos
99 1.168 joerg 20071209:
100 1.168 joerg The acpiec(4) driver has been split into two attachments. If you
101 1.168 joerg get ACPI errors before the attachment, please update your kernel
102 1.169 wiz configuration file appropriately or see GENERIC for more details.
103 1.168 joerg
104 1.166 xtraeme 20071115:
105 1.166 xtraeme The it(4) driver has been renamed to itesio(4) and the old port
106 1.166 xtraeme argument specified in the kernel configuration file is not valid
107 1.166 xtraeme anymore. The itesio(4) driver now uses the Super I/O address port
108 1.166 xtraeme rather than the EC address port. Please update your kernel
109 1.167 wiz configuration file appropriately or see GENERIC for more details.
110 1.166 xtraeme
111 1.165 jmmv 20071028:
112 1.165 jmmv The pccons(4) driver has been removed from the NetBSD/shark port.
113 1.165 jmmv You need to update any custom kernel configuration file you have
114 1.165 jmmv to remove any references to pccons (which includes removing the
115 1.165 jmmv now useless XSERVER option) and replace them with the correct
116 1.165 jmmv entries for the wscons driver. See the GENERIC configuration file
117 1.165 jmmv for more details.
118 1.165 jmmv
119 1.164 gdt 20070913:
120 1.164 gdt A latent bug in dhclient/dhcpd that caused it to be unable to
121 1.164 gdt enumerate interfaces was fixed. The bug began to cause
122 1.164 gdt problems after 20070911 when the kernel's SIOCGIFCONF
123 1.164 gdt implementation was repaired. From 20070529 to 20070911 racoon
124 1.164 gdt could not enumerate interfaces. (These are noted because
125 1.164 gdt normal kernel/userspace version matching hygiene is not
126 1.164 gdt sufficient to avoid this problem.) Ensure that both kernel
127 1.164 gdt and userland are from after 20070913.
128 1.164 gdt
129 1.163 joerg 20070703:
130 1.163 joerg nbinstall has been renamed as it calls the target specific and
131 1.163 joerg the logic to pass down STRIP from mk been removed. This forces
132 1.163 joerg a re-installation of tools.
133 1.163 joerg
134 1.161 dsl 20070422:
135 1.161 dsl The way OS emulations lookup filenames inside the emulation root
136 1.161 dsl has been changed. Rather than modify the pathname (and copy back
137 1.161 dsl to userspace) namei() and lookup() directly check the emulation
138 1.161 dsl root. One side effect is that absolute symlinks inside the emulated
139 1.167 wiz root file system will be relative to that file system - unless they
140 1.161 dsl start /../ this is useful when the emulated root is a real install
141 1.161 dsl that has such links.
142 1.161 dsl This might affect symlinks that have been added to reference outside
143 1.161 dsl the emulated root.
144 1.161 dsl
145 1.160 jmcneill 20070412:
146 1.160 jmcneill The pckbc driver on sgimips IP32 has been removed. Use macekbc
147 1.160 jmcneill instead. See the GENERIC32_IP3x kernel configuration for an
148 1.160 jmcneill example.
149 1.160 jmcneill
150 1.159 gdt 20070319:
151 1.159 gdt src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
152 1.159 gdt on many platforms due to incorrect flags settings. If you
153 1.159 gdt updated and built after about 20070315, do "nbmake-$arch
154 1.159 gdt cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
155 1.159 gdt rebuild of object files that might have been built
156 1.159 gdt incorrectly, and ensure that you have at least
157 1.159 gdt src/lib/libc/Makefile 1.130.
158 1.159 gdt
159 1.158 dbj 20070210:
160 1.158 dbj src/sys/sys/{sa.h,savar.h} were removed.
161 1.158 dbj find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
162 1.158 dbj | xargs egrep -l '/sa.h|/savar.h' | xargs rm
163 1.158 dbj will allow dependencies on those files to get get rebuilt
164 1.158 dbj
165 1.157 apb 20070209:
166 1.157 apb The threading model was changed when the newlock2 branch
167 1.157 apb was merged to NetBSD-current. If you boot with a new
168 1.157 apb kernel (version 4.99.10), then you also need a new pthread
169 1.157 apb library (/usr/lib/libpthread.so.0.7). If you boot with
170 1.157 apb an old kernel, then you need the old pthread library
171 1.157 apb (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
172 1.157 apb the pthread library in sync, old threaded applications should
173 1.157 apb continue to work with an old or new kernel. Note that named(8)
174 1.157 apb is the only threaded application in the base system.
175 1.157 apb
176 1.154 he 20061214:
177 1.154 he Following the move of string_to_flags() and flags_to_string()
178 1.154 he from the bin/ls/ sources to libutil, users doing UPDATE builds
179 1.154 he will need to do a "make cleandir" in
180 1.154 he tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
181 1.154 he bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
182 1.156 he usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
183 1.156 he as the installation images in distrib/
184 1.154 he in order to excise stale references to the old stat_flags.h header
185 1.154 he file in the ls sources -- stat_flags.h has been removed.
186 1.154 he
187 1.152 christos 20061108:
188 1.152 christos The configure script used in the src/tools/gcc compiler has been
189 1.152 christos changed to indicate that our libc has ssp support built-in and
190 1.152 christos does not depend on -lssp and -lssp-nonshared. You'll need to
191 1.152 christos make clean in src/tools/gcc first to rebuild the compiler.
192 1.152 christos
193 1.151 rpaulo 20061009:
194 1.151 rpaulo The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
195 1.151 rpaulo available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
196 1.151 rpaulo
197 1.150 bjh21 20060814:
198 1.150 bjh21 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
199 1.150 bjh21 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
200 1.150 bjh21 kernel configuration for an example. X servers from the last
201 1.150 bjh21 few years should cope.
202 1.150 bjh21
203 1.149 christos 20060703:
204 1.149 christos MPACPI is no more. We always configure PCI interrupts using ACPI
205 1.149 christos if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
206 1.149 christos to ACPI_SCANPCI. Thanks to work from fvdl.
207 1.149 christos
208 1.148 dogcow 20060627:
209 1.148 dogcow socket(2) has changed, and its system call has been versioned.
210 1.148 dogcow For userlands with the old version of socket(2), make sure that
211 1.148 dogcow your kernel has 'options COMPAT_30' set, or else 'bad system call'
212 1.148 dogcow errors will result.
213 1.148 dogcow
214 1.1 abs Hints for a more successful build:
215 1.1 abs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
216 1.123 jmc Use build.sh, but do not use its "expert mode":
217 1.132 jmmv This will automatically build the tools in the
218 1.123 jmc correct order, and it will keep the tools and the
219 1.123 jmc new build products from interfering with the running
220 1.123 jmc system. This will allow you to ignore most of the
221 1.123 jmc other advice in this file.
222 1.2 mrg Build a new kernel first:
223 1.2 mrg This makes sure that any new system calls or features
224 1.2 mrg expected by the new userland will be present. This
225 1.2 mrg helps to avoid critical errors when upgrading.
226 1.1 abs Use object directories:
227 1.1 abs This helps to keep stale object
228 1.1 abs files from polluting the build if a Makefile "forgets"
229 1.1 abs about one. It also makes it easier to clean up after
230 1.1 abs a build. It's also necessary if you want to use the
231 1.1 abs same source tree for multiple machines.
232 1.123 jmc To use object directories with build.sh:
233 1.123 jmc a) invoke build.sh with the "-M" or "-O" options.
234 1.123 jmc To use object directories without using build.sh:
235 1.1 abs a) cd /usr/src ; make cleandir
236 1.2 mrg b) Add "OBJMACHINE=yes" to /etc/mk.conf
237 1.2 mrg c) Add "MKOBJDIRS=yes" to /etc/mk.conf
238 1.1 abs d) cd /usr/src ; make build
239 1.2 mrg Note that running "make obj" in a directory will create
240 1.2 mrg in obj.$MACHINE directory.
241 1.1 abs Build to a DESTDIR:
242 1.123 jmc This helps to keep old installed files (especially libraries)
243 1.123 jmc from interfering with the new build.
244 1.123 jmc To build to a DESTDIR with build.sh, use the "-D" option.
245 1.123 jmc To build to a DESTDIR without using build.sh, set the DESTDIR
246 1.123 jmc environment variable before running make build. It should be
247 1.123 jmc set to the pathname of an initially empty directory.
248 1.123 jmc Problems: if you do not use build.sh, you might need to
249 1.123 jmc update critical utilities without using DESTDIR since
250 1.123 jmc nothing is executed from what is installed in DESTDIR.
251 1.123 jmc (See critical utils, below.)
252 1.1 abs Build often:
253 1.1 abs This keeps critical utilities current enough to not choke
254 1.1 abs on any other part of the source tree that depends on up to
255 1.123 jmc date functionality. If you use build.sh, you should not have
256 1.123 jmc this problem.
257 1.1 abs
258 1.1 abs What to do if things don't work:
259 1.1 abs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
260 1.1 abs When things don't work there is usually a few things that commonly
261 1.1 abs should be done.
262 1.1 abs 1) make includes
263 1.1 abs This should be done automatically by make build.
264 1.1 abs 2) cd share/mk && make install
265 1.1 abs Again, automatically done by make build.
266 1.1 abs
267 1.1 abs Failsafe rebuild of a small part of the tree:
268 1.1 abs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
269 1.1 abs To make sure you rebuild something correctly you want to do
270 1.1 abs something like the following:
271 1.1 abs 1) Make sure the includes and .mk files are up to date.
272 1.1 abs 2) Make sure any program used to build the particular
273 1.1 abs utility is up to date. (yacc, lex, etc...)
274 1.1 abs 3) cd ...path/to/util...
275 1.1 abs make cleandir
276 1.1 abs rm ...all obj directories...
277 1.1 abs make cleandir # yes, again
278 1.1 abs make obj
279 1.1 abs make depend && make
280 1.1 abs
281 1.1 abs Failsafe rebuild of the entire tree:
282 1.1 abs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
283 1.1 abs If you really want to make sure the source tree is clean and
284 1.2 mrg ready for a build try the following. Note that sourcing /etc/mk.conf
285 1.2 mrg (a make(1) Makefile) in this manner is not right, and will not work
286 1.2 mrg for anyone who uses any make(1) features in /etc/mk.conf.
287 1.1 abs
288 1.1 abs ---cut here---
289 1.1 abs #!/bin/sh
290 1.1 abs . /etc/mk.conf
291 1.1 abs
292 1.58 lukem if [ -z $NETBSDSRCDIR ] ; then
293 1.58 lukem NETBSDSRCDIR=/usr/src
294 1.1 abs fi
295 1.58 lukem if [ \! -d $NETBSDSRCDIR ] ; then
296 1.1 abs echo Unable to find sources
297 1.1 abs exit 1
298 1.1 abs fi
299 1.58 lukem find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
300 1.1 abs
301 1.1 abs if [ -z $BSDOBJDIR ] ; then
302 1.1 abs BSDOBJDIR=/usr/obj
303 1.1 abs fi
304 1.1 abs if [ -d $BSDOBJDIR ] ; then
305 1.1 abs rm -rf $BSDOBJDIR
306 1.1 abs fi
307 1.1 abs
308 1.58 lukem cd $NETBSDSRCDIR && make cleandir
309 1.1 abs
310 1.1 abs ---cut here---
311 1.1 abs
312 1.1 abs Critical utilities:
313 1.1 abs ^^^^^^^^^^^^^^^^^^^
314 1.3 itojun usr.bin/compile_et
315 1.1 abs usr.bin/make
316 1.1 abs usr.bin/yacc
317 1.1 abs usr.bin/lex
318 1.11 lukem usr.bin/xlint
319 1.142 drochner usr.bin/config
320 1.1 abs
321 1.34 simonb Other problems and possible solutions:
322 1.1 abs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
323 1.1 abs Symptom:Complaints involving a Makefile.
324 1.17 erh Fix: Rebuild usr.bin/make:
325 1.17 erh cd usr.bin/make && make && make install
326 1.111 simonb Or, a failsafe method if that doesn't work:
327 1.17 erh cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
328 1.17 erh
329 1.1 abs Fix: Make sure .mk files are up to date.
330 1.1 abs cd share/mk && make install
331 1.2 mrg
332 1.2 mrg Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
333 1.142 drochner Fix: Rebuild usr.bin/config
334 1.1 abs
335 1.1 abs Symptom:
336 1.1 abs Fix: Rebuild usr.bin/yacc
337 1.1 abs
338 1.1 abs Symptom:
339 1.1 abs Fix: Rebuild usr.bin/lex
340 1.1 abs
341 1.1 abs Symptom:
342 1.1 abs Fix: rm /usr/lib/libbfd.a
343 1.4 itojun
344 1.4 itojun Symptom:Obsolete intermediate files are used during compilation
345 1.4 itojun Fix: Try the following sequence of commands in the directory in question.
346 1.4 itojun make cleandir; rm `make print-objdir`; make cleandir; make obj
347 1.4 itojun (If you built the tree without "make obj" in the past, obsolete files
348 1.4 itojun may remain. The command tries to clean everything up)
349 1.5 wiz
350 1.5 wiz Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
351 1.5 wiz Fix: Rebuild and install usr.bin/menuc
352 1.12 itojun
353 1.12 itojun Symptom:mklocale not found during build in share/locale/ctype
354 1.12 itojun Fix: Build and install usr.bin/mklocale
355 1.13 dogcow
356 1.86 kleink Symptom:undefined reference to `__assert13' or `__unsetenv13'
357 1.13 dogcow Fix: Rebuild and install lib/libc
358 1.13 dogcow
359 1.142 drochner Symptom:usr.bin/config fails to build.
360 1.19 cgd Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
361 1.13 dogcow
362 1.19 cgd Symptom:undefined reference to `getprogname' or `setprogname'
363 1.19 cgd Fix: Rebuild and install lib/libc
364 1.24 abs
365 1.24 abs Symptom:lint does not understand the '-X' option
366 1.24 abs Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
367