UPDATING revision 1.291 1 $NetBSD: UPDATING,v 1.291 2018/02/13 04:36:00 mrg Exp $
2
3 This file (UPDATING) is intended to be a brief reference to recent
4 changes that might cause problems in the build process, and a guide for
5 what to do if something doesn't work.
6
7 For a more detailed description of the recommended way to build NetBSD
8 using build.sh, see the BUILDING file.
9
10 Note that much of the advice in this UPDATING file was written before
11 build.sh existed. Nevertheless, the advice here may be useful for
12 working around specific problems with build.sh.
13
14 Sections are marked with "^^^^^". After the section on "Recent changes"
15 are several sections containing more general information.
16
17 See also: BUILDING, build.sh, Makefile.
18
19 Recent changes:
20 ^^^^^^^^^^^^^^^
21
22 20180212:
23 between OpenSSL and GCC updates, many things may fail to build.
24 any failure that looks like GCC or openssl is best handled by
25 a clean destdir and objdir. Full cleandir and destdir deletion
26 is recommended if build failures occur.
27
28 20171225:
29 removal of the vadvise syscall requires manual removal of all
30 associated files from the libc build object directory (including
31 the .depend files) - a command like:
32 cd $OBJ && find . -type d -name libc | xargs rm -rf
33 For architectures that support multiple "compat" binary targets,
34 you'll need to cleanup both the regular libc directory and the
35 compat ones (the above command will do that).
36
37 20171010:
38 a change to the build structure of external/bsd/acpica/bin/iasl
39 means that its objdir (or *.d and .depend at least) might need
40 to be manually removed - or a build done once without -u.
41
42 20170822:
43 a new version of GMP has been imported and probably
44 will break parts of builds related to themselves or GCC, both
45 in the tools and the native section. Remove all GCC, GMP, MPFR
46 and MPC objdirs or build once without -u.
47
48 20170816:
49 a new version of MPFR and MPC have been imported and probably
50 will break parts of builds related to themselves or GCC, both
51 in the tools and the native section. Remove all GCC, GMP, MPFR
52 and MPC objdirs or build once without -u.
53
54 20170402:
55 a new version of dhcpcd has been imported, which does not support
56 update builds from the previous version. Remove your
57 external/bsd/dhcpcd object dir or build once without -u.
58
59 20170211:
60 a new terminfo database has been imported.
61 The structure of it has changed slightly from prior versions and
62 an updated tic tool is required.
63 If you build.sh, don't use -u
64
65 20170207:
66 various arch dependent libc/exect.S files were removed
67 Either remove the obj directories (lib/libc and compat/amd64/i386/lib
68 if it exists) or do a clean build.
69 (This is a bug in the make system, it should be corrected without
70 human intervention, but isn't.)
71
72 20170104:
73 xinput build options have changed.
74 Remove the obj directory (external/mit/xorg/bin/xinput)
75 if you build.sh -u
76
77 20170103:
78 a new version of flex has been imported.
79 Remove the file from obj (external/bsd/flex)
80 if you build.sh -u
81
82 20161014:
83 a new version of OpenSSL has been imported.
84 Remove the files from obj (crypto/external/bsd/openssl)
85 if you build.sh -u
86
87 20161009:
88 a new version of dhcpcd has been imported with slightly changed
89 build infrastructure. When doing a build.sh -u this requires
90 pruning the external/bsd/dhcpcd objdir.
91
92 20160914:
93 i386, amd64, shark, ofppc and macppc have joined shark and x68k
94 ports in using xorg-server 1.18. This requires a clean destdir
95 and a clean objdir.
96
97 20160527:
98 i386 needs a full cleandir or objdir deletion because PIE has
99 been enabled. (see the amd64 entry two down for further info)
100
101 20160418:
102 libedit needs manual removal of all autogenerated files since
103 some of them are not autogenerated anymore. Remember that there
104 might be two copies of libedit if your platform builds "compat".
105
106 20160410:
107 amd64 needs full "make cleandir" or deletion of objdir now that
108 PIE has been enabled for amd64. PIE, or position-independent
109 executables, means all code, including executables and not just
110 shared libraries, is position-independent and hence able to be
111 relocated by ASLR, address space layout randomization.
112
113 The change was made in Makefile variables for compiler and
114 linker flags, for which make(1) does not record dependencies,
115 hence it is unable to detect that all .o files need rebuilding.
116
117 Partial rebuilds with some modified source files will likely
118 fail when linking executables, since the linker refuses to mix
119 position-independent code with position-dependent code in
120 position-independent executables:
121
122 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC
123
124 20160401:
125 Ports switching to GCC 5.3 will need a full "make cleandir".
126 Some people have found that cleandir is not sufficient, so if
127 in doubt delete the entire object directory tree for gcc.
128
129 20160306:
130 NetBSD's regexp implementation is now part of libnbcompat.
131 Nblex, nbm4, nbpax, nbsed use it and they may crash on
132 non-NetBSD hosts if linked with stale object files produced
133 while they included a non-NetBSD regex.h.
134 In any case, you should "make cleandir" at least these tools
135 before updating your toolchain.
136
137 20160125:
138 Dtrace has been enabled by default on some architectures.
139 When doing an update build, make sure to clean the etc/mtree
140 object directory before starting the build - otherwise the
141 needed directories in destdir will not be created.
142 An easy way to do this is:
143 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir
144
145 20150818:
146 New acpica requires "make cleandir" in src/external/bsd/acpica
147 again.
148
149 20150413:
150 New acpica requires "make cleandir" and reinstalling yacc
151 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and
152 also "make cleandir" in /usr/src/external/bsd/acpica.
153
154 20150404:
155 Lint changes require a full rebuild of the tool, so make
156 sure to build without -u option to build.sh, or manually
157 do a make cleandir in src/tools/lint1 and
158 src/usr.bin/xlint.
159
160 20150310:
161 Improvements to openssl for arm mean that update builds of
162 the openssl libraries will fail. A make cleandir in
163 external/bsd/openssl/lib is needed
164
165 20141026:
166 A mishap during the import of pppd may cause your corruption
167 in your cvs directory if you happened to do a cvs update
168 during a short period of time. To fix, just remove the
169 directory src/external/bsd/ppp/dist/pppd completely
170 and let cvs restore it on next update.
171
172 20140721:
173 The src/external/mit/lua/src directory was accidentally created
174 and then deleted in the CVS repository. If you get errors like
175
176 cvs [update aborted]: cannot open directory
177 /cvsroot/src/external/mit/lua/src: No such file or directory
178
179 then delete your local copy of that directory tree and try again.
180
181 20140530:
182 ARM eABI switched to DWARF based exception handling. This requires
183 rebuilding all C++ code. It is strongly advised to do a clean build.
184
185 20140131:
186 The new compiler_rt/libc integration moved a few things. It is strongly
187 advised to do a clean build. At least lib/libc, the compat version(s)
188 of libc, libkern, rump and the kernels need to be cleaned.
189
190 20131227:
191 1. The new ntpd runs in a restricted mode to prevent amplification
192 attacks. If you need ntpdc to work you need to explicitly enable
193 mode7 in your config file. Make sure you put the necessary restrict
194 statements to avoid being exposed.
195 2. strncat has moved from lib/libc to common/lib/libc; you might need
196 to make clean in libc
197
198 20131129:
199 The GMP sources were updated, and builds will likely fail without
200 cleaning their build trees for both tools and in-tree, like below.
201
202 20131128:
203 The MPC and MPFR sources were updated, and builds may require their
204 tools and in-tree directories cleaned for successful updates.
205
206 20130605:
207 The kernel option FAST_IPSEC no longer exists, it's been renamed
208 to IPSEC (and the older IPSEC version removed).
209
210 20130605:
211 Previous freetype installations eroneously installed private
212 header files. If you are building against a non-empty $DESTDIR,
213 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/.
214
215 20130531:
216 The xdm update may cause build failure due to xdm.man being
217 in the obj tree. Make sure to ensure any like this:
218 nbmake: nbmake: don't know how to make xdm.man. Stop
219 is fixed by deleting the xdm.man in the obj tree.
220
221 20130530:
222 Updates of many xsrc packages will leave old .pc files around.
223 Best to clean out the xsrc objdir entirely before rebuilds.
224
225 20130301:
226 The removal of netiso requires manual removal of /usr/include/netiso
227 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump}
228
229 20120726:
230 The update of OpenSSL requires cleaning both the OpenSSL build
231 directory and DESTDIR. *Even non-update builds require cleaning
232 DESTDIR.* Builds done without taking these steps may fail, or in
233 some cases may succeed and install broken OpenSSL libraries that
234 cause third-party software to link incorrectly and/or crash.
235
236 20120507:
237 The database schema for makemandb was changed. You will
238 need to update the database using 'makemandb -f' or wait
239 for the next weekly run to fix it.
240
241 20120319:
242 sys/conf/Makefile.kern.inc has been modified to adjust the
243 size of db_symtab automatically. You need to update dbsym in
244 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If
245 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your
246 mk.conf.
247
248 20120216:
249 Default for MKCATPAGES changed to NO. Update builds will fail
250 unless DESTDIR is cleaned manually. If you built between 20120207
251 and 20120216, daily and weekly could have created an unreadable
252 /var/db/man.db index for apropos. Running makemandb -f or
253 the next run of weekly will fix it.
254
255 20111227:
256 If you built between 20111225 and 20111227 you need to remove
257 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the
258 bump has been reverted.
259
260 20111125:
261 The "rnd" pseudodevice has been added to sys/conf/std, which
262 means it should no longer be explicitly listed in kernel
263 configuration files. The line "pseudo-device rnd" should be
264 removed from any custom kernel config files users may have.
265
266 20111119:
267 A problem with the datastructures used by the rndctl(8)
268 utility (pointers in datastructures in an array, making 32->64
269 bit compatibility very painful) has been fixed in a
270 non-backwards-compatible way. If you replace your kernel,
271 replace your rndctl executable too.
272
273 20111001:
274 the prop_*_send_syscall() functions from proplib(3) have been
275 changed and their new version is not backward compatible with the old
276 one. So ensure that all consumers of these functions (currently:
277 quota2 code and its tests) are updated together with the new lib.
278
279 20110817:
280 sparc has been changed to use GCC 4.5.3, so any objdir or
281 DESTDIR for them should be deleted before updating.
282
283 20110806:
284 i386 and amd64 have been changed to use GCC 4.5.3, so any
285 objdir or DESTDIR for them should be deleted before updating.
286
287 20110805:
288 The update to GCC 4.5.3 requires a non-trivial portion of
289 the tree to be cleaned. Best to delete both objdir and
290 DESTDIR before running this update. So far, only the
291 sparc64, mips and powerpc platforms have changed.
292
293 20110803:
294 The layout of external/public-domain/xz has changed. To do an
295 update build you will have to remove the contents of the OBJDIR
296 for external/public-domain/xz/bin by hand as the xz entry there
297 is now a directory.
298
299 20110410:
300 The configuration of src/tools/gcc has changed. To do an
301 update build you have to clean both tools/binutils and
302 tools/gcc by hand.
303
304 20110328:
305 Building the Xorg binary was moved into a subdirectory to fix
306 ordering issues with "make all". It may be necessary to remove
307 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86
308 if your update build fails, as the "Xorg" entry there is now a
309 directory.
310
311 20110121:
312 Assembler files no longer use -traditional-cpp. This can break
313 the build of individual parts of the tree. This is handled
314 correctly by build.sh. Manual builds have to update /usr/share/mk
315 and re-run config(1) for any kernel configurations as needed.
316
317 20101217:
318 The tcpdump(8) program was changed to drop privileges and chroot(2)
319 by default. It may be necessary to manually update passwd(5) and
320 group(5) in order to make the program work with existing setups.
321
322 20101125:
323 The latest changes to setenv(3) dissallow setting environment
324 variables with names that contain '='. Revision 1.18 of env.c
325 assumed that this was allowed. Installing a new libc with an
326 old copy of /usr/bin/env causes env x=1 printenv | grep x= to
327 break which affects the autoconf tests for dependency finding,
328 so building gcc will end up printing:
329 checking dependency style of gcc... none
330 configure: error: no usable dependency style found
331 Fix it by rebuilding and re-installing env.
332
333 20101119:
334 Recent Xorg updates in xsrc/external/mit/ may cause various build
335 or run-time problems. Delete your entire DESTDIR and OBJDIR if you
336 have any build problems with xsrc, or problems with mismatched
337 versions between xorg-server and drivers.
338
339 20100604:
340 The update of ATF to 0.9 causes old tests written in shell to fail
341 unless they are rebuilt. If you are building with MKUPDATE=yes,
342 you need to clean the src/external/bsd/atf/tests/ and the src/tests/
343 trees by hand.
344
345 20100522:
346 Recent Xorg updates in xsrc/external/mit/ will cause various build
347 problems. Delete your entire DESTDIR and OBJDIR if you have any
348 build problems with xsrc.
349
350 20100522:
351 private section of <ctype.h> was splitted, and now mklocale(1)
352 include ctype_local.h, so you have to make cleandir in tools/mklocale.
353
354 20100520:
355 The location of the xkb compiled descriptions has changed. Please
356 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR.
357
358 20100222:
359 The shared objects file extension has been changed from .so to
360 .pico, in order to avoid conflicts with shared libraries names
361 libXX.so. All now stale regular .so files can be removed from
362 your object directories.
363
364 20100204:
365 The termcap database has been removed from the sources,
366 but has not been marked obsolete so it is not removed
367 from the system when upgrading.
368 As such, you will need to remove them from your object
369 and destination directories.
370
371 20091101:
372 After updating, it may be necessary to make the 'cleandir'
373 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a
374 'build.sh -u tools' or 'build.sh -u distribution'. Ditto
375 src/tools/lex/ and src/usr.bin/lex/.
376
377 20091001:
378 On amd64 you must rebuild tools (to get the new binutils)
379 before building a kernel, or the build fails on cpufunc.S.
380
381 20091001:
382 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb
383 symlink, failing the build. Delete the link, and the subdir
384 it is in, and retry your build.
385
386 20090718:
387 libc build changed so that strchr() provides the extra entry
388 point for index(). Update build of libc.a (and libc_pic.a)
389 may fail because the archive contains the unwanted index.o.
390 (Similarly for strrchr() and rindex().)
391
392 20090709:
393 Native Xorg was upgraded again. Builds will probably fail again
394 without a clean objdir, at least for src/external/mit/xorg.
395
396 20090616:
397 Native Xorg was upgraded. Builds will need a clean objdir for
398 src/external/mit/xorg. Upgrading a system from sets will not
399 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
400 subdirectory has been changed into a file, and this needs to
401 be manually "rm -r"'ed before installing xbase.tgz.
402
403 20090501:
404 Several new functions were added to string.h/libc, and this
405 can cause autoconf problems during the tool build for people
406 who fail to clean out their tools objects properly. If you
407 note messages about stpcpy, stpncpy or strnlen accompanying a
408 failure during the tool build, clean out all your tools
409 objects and start again.
410
411 20090325:
412 The i386 port was switched to i486 default toolchain. This requires
413 cleaning your src/tools directory and $TOOLDIR and rebuilding them.
414
415 20090126:
416 The __posix_fadvise50 system call changed assembly stub type. You
417 need to 'rm -f __posix_fadvise50.*' in the libc build directory
418 to avoid using the old assembly stub.
419
420 20090202:
421 pkg_install now depends on the pkgdb cache for automatic conflict
422 detection. It is recommented to rebuild the cache with
423 ``pkg_admin rebuild''.
424
425 20090110:
426 time_t and dev_t have been bumped to 64 bit quantities. To upgrade:
427 1. Make sure your kernel has COMPAT_50 in it. Build and install.
428 This is needed even in the MODULAR kernel because there is
429 conditionally compiled code in rtsock.c.
430 2. make sure build.sh completes and the binaries in a chroot work
431 before installing.
432 3. If you don't use build.sh and you build directly to root, and
433 your build breaks in the middle, don't despair. Make sure headers
434 are installed properly, and start building libraries first libc
435 and libutil, install them and then continue building all the
436 libraries in src/lib and src/gnu/lib and install them. Once
437 the new libraries are installed, you can restart the build.
438 4. If you compile packages and you notice link time warnings,
439 rebuild the required packages to update their shared libraries.
440 Any package you rebuild will require rebuilding all the packages
441 that depend on it.
442 5. Next time you run pwd_mkdb with the new binary, the file
443 will be upgraded and it will not be backwards compatible.
444 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see
445 lastlogx(5)) have been versioned, and there is a heuristic
446 for utmp. You are better off removing the old files after
447 upgrading. The automated clearing of /var/run during
448 boot, and the automated rotating of files in /var/log by
449 newsyslog(8), may mean that you do not have to remove the
450 files manually.
451 7. The optional accounting file (/var/account/acct, see
452 accton(8)) has not been versioned, and will need to be
453 removed. The automatic rotation of the accounting file by
454 /etc/daily limits the bad consequences of failure to remove
455 the file.
456 8. Application software that writes time_t to binary files on
457 disk will break or need attention. Most notably: if you are
458 using PostgreSQL < 8.4, you need to dump your databases,
459 rebuild PostgreSQL with the new time_t, then restore.
460
461 20081219:
462 config(1) has been updated, and one of the files it creates -
463 swapnetbsd.o - has changed format. You need to rebuild config
464 (done automatically by build.sh) and then you need to rerun
465 config on all kernel configuration files before rebuilding those
466 kernels.
467
468 20081205:
469 If you build with MKX11=no, you should remove /etc/rc.d/xdm and
470 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
471 set and will appear as extra files for MKX11=no update builds.
472
473 20081122:
474 On i386, various kernel options(4) in GENERIC including
475 file systems have been disabled and moved into kernel modules.
476 Before trying a new GENERIC kernel, you have to prepare the
477 following files as well as a new GENERIC kernel:
478
479 - build and install kernel modules from src/sys/modules
480
481 - install the latest bootloader, which will load a module
482 for the file system from which the kernel is loaded automatically
483
484 If you have to load your kernel from a file system which is not of
485 the same type as the root file system, you have to load the necessary
486 file system module manually on the boot prompt or in the boot.cfg file.
487
488 20080827:
489 If you built and installed a libc from sources between
490 2008/08/20 and 2008/08/26 you got a broken strtouq(3)
491 which results in false errors reported by lint(1).
492 Since this breaks the libc build itself, manual help is
493 needed -- lint must be disabled temporarily, e.g.:
494 $ (cd lib/libc && make MKLINT=no dependall install)
495
496 20080813:
497 MKDEBUG build was broken because the .depend files did not know
498 about .go files. You need to remove all .depend files and rebuild.
499
500 20080802:
501 A regression in binary compatibility for pthread_mutex_t has
502 been fixed. Unfortunately, the price is breaking compatibility
503 for -current.
504
505 Threaded programs (using libpthread) and C++ programs (using
506 libstdc++) compiled after 20070907 and before 20080802 need to
507 be recompiled.
508
509 One way to find affected pkgsrc packages:
510
511 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO
512 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO
513
514 20080731:
515 WAPBL (metadata journaling support) has been added, but at this
516 time isn't backwards compatible with pre-WAPBL aware kernels
517 and userland (fsck_ffs in particular). Please make sure you
518 don't use a journaled filesystem with an older kernel/userland,
519 especially an uncleanly mounted journaled filesystem. WAPBL
520 also requires the super block to be in the UFS2 format. You
521 can use fsck_ffs -c 4 to update the superblock format.
522
523 20080721:
524 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
525 isn't defined.
526
527 20080531:
528 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
529 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
530 utility needs to be rebuilt and reinstalled as older binaries
531 won't work correctly. The following sequence of commands:
532
533 $ (cd sys/sys/ && nbmake-$arch includes)
534 $ (cd sbin/drvctl/ && nbmake-$arch clean)
535 $ (cd sbin/drvctl/ && nbmake-$arch all)
536
537 leaves new drvctl utility in sbin/drvctl build directory.
538
539 20080503:
540 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
541
542 20080521:
543 For a while, unprivileged UPDATE builds would fail to
544 succeed at the checkflist stage, complaining that
545 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
546 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
547 If you already hit this problem, update the .mk file,
548 remove ${DESTDIR}/stand/<arch>, and re-run the build.
549
550 20080303:
551 Linker warnings are now fatal if $WARNS>0.
552
553 20080126:
554 The posix_fadvise system call has been changed from an assembly
555 stub, to a c file that calls an assembly stub. You need to
556 'rm -f posix_fadvise.* .depend' in the libc build directory to
557 avoid using the old assembly stub.
558
559 20071209:
560 The acpiec(4) driver has been split into two attachments. If you
561 get ACPI errors before the attachment, please update your kernel
562 configuration file appropriately or see GENERIC for more details.
563
564 20071115:
565 The it(4) driver has been renamed to itesio(4) and the old port
566 argument specified in the kernel configuration file is not valid
567 anymore. The itesio(4) driver now uses the Super I/O address port
568 rather than the EC address port. Please update your kernel
569 configuration file appropriately or see GENERIC for more details.
570
571 20071028:
572 The pccons(4) driver has been removed from the NetBSD/shark port.
573 You need to update any custom kernel configuration file you have
574 to remove any references to pccons (which includes removing the
575 now useless XSERVER option) and replace them with the correct
576 entries for the wscons driver. See the GENERIC configuration file
577 for more details.
578
579 20070913:
580 A latent bug in dhclient/dhcpd that caused it to be unable to
581 enumerate interfaces was fixed. The bug began to cause
582 problems after 20070911 when the kernel's SIOCGIFCONF
583 implementation was repaired. From 20070529 to 20070911 racoon
584 could not enumerate interfaces. (These are noted because
585 normal kernel/userspace version matching hygiene is not
586 sufficient to avoid this problem.) Ensure that both kernel
587 and userland are from after 20070913.
588
589 20070703:
590 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It
591 calls the target-specific strip program, and the logic to pass
592 down STRIP from make has been removed. This requires a
593 re-installation of tools.
594
595 20070422:
596 The way OS emulations lookup filenames inside the emulation root
597 has been changed. Rather than modify the pathname (and copy back
598 to userspace) namei() and lookup() directly check the emulation
599 root. One side effect is that absolute symlinks inside the emulated
600 root file system will be relative to that file system - unless they
601 start /../ this is useful when the emulated root is a real install
602 that has such links.
603 This might affect symlinks that have been added to reference outside
604 the emulated root.
605
606 20070412:
607 The pckbc driver on sgimips IP32 has been removed. Use macekbc
608 instead. See the GENERIC32_IP3x kernel configuration for an
609 example.
610
611 20070319:
612 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
613 on many platforms due to incorrect flags settings. If you
614 updated and built after about 20070315, do "nbmake-$arch
615 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
616 rebuild of object files that might have been built
617 incorrectly, and ensure that you have at least
618 src/lib/libc/Makefile 1.130.
619
620 20070210:
621 src/sys/sys/{sa.h,savar.h} were removed.
622 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
623 | xargs egrep -l '/sa.h|/savar.h' | xargs rm
624 will allow dependencies on those files to get get rebuilt
625
626 20070209:
627 The threading model was changed when the newlock2 branch
628 was merged to NetBSD-current. If you boot with a new
629 kernel (version 4.99.10), then you also need a new pthread
630 library (/usr/lib/libpthread.so.0.7). If you boot with
631 an old kernel, then you need the old pthread library
632 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
633 the pthread library in sync, old threaded applications should
634 continue to work with an old or new kernel. Note that named(8)
635 is the only threaded application in the base system.
636
637 20061214:
638 Following the move of string_to_flags() and flags_to_string()
639 from the bin/ls/ sources to libutil, users doing UPDATE builds
640 will need to do a "make cleandir" in
641 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
642 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
643 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
644 as the installation images in distrib/
645 in order to excise stale references to the old stat_flags.h header
646 file in the ls sources -- stat_flags.h has been removed.
647
648 20061108:
649 The configure script used in the src/tools/gcc compiler has been
650 changed to indicate that our libc has ssp support built-in and
651 does not depend on -lssp and -lssp-nonshared. You'll need to
652 make clean in src/tools/gcc first to rebuild the compiler.
653
654 20061009:
655 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
656 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
657
658 20060814:
659 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
660 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
661 kernel configuration for an example. X servers from the last
662 few years should cope.
663
664 20060703:
665 MPACPI is no more. We always configure PCI interrupts using ACPI
666 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
667 to ACPI_SCANPCI. Thanks to work from fvdl.
668
669 20060627:
670 socket(2) has changed, and its system call has been versioned.
671 For userlands with the old version of socket(2), make sure that
672 your kernel has 'options COMPAT_30' set, or else 'bad system call'
673 errors will result.
674
675 Hints for a more successful build:
676 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
677 Use build.sh, but do not use its "expert mode":
678 This will automatically build the tools in the
679 correct order, and it will keep the tools and the
680 new build products from interfering with the running
681 system. This will allow you to ignore most of the
682 other advice in this file.
683 Build a new kernel first:
684 This makes sure that any new system calls or features
685 expected by the new userland will be present. This
686 helps to avoid critical errors when upgrading.
687 Use object directories:
688 This helps to keep stale object
689 files from polluting the build if a Makefile "forgets"
690 about one. It also makes it easier to clean up after
691 a build. It's also necessary if you want to use the
692 same source tree for multiple machines.
693 To use object directories with build.sh:
694 a) invoke build.sh with the "-M" or "-O" options.
695 To use object directories without using build.sh:
696 a) cd /usr/src ; make cleandir
697 b) Add "OBJMACHINE=yes" to /etc/mk.conf
698 c) Add "MKOBJDIRS=yes" to /etc/mk.conf
699 d) cd /usr/src ; make build
700 Note that running "make obj" in a directory will create
701 in obj.$MACHINE directory.
702 Build to a DESTDIR:
703 This helps to keep old installed files (especially libraries)
704 from interfering with the new build.
705 To build to a DESTDIR with build.sh, use the "-D" option.
706 To build to a DESTDIR without using build.sh, set the DESTDIR
707 environment variable before running make build. It should be
708 set to the pathname of an initially empty directory.
709 Problems: if you do not use build.sh, you might need to
710 update critical utilities without using DESTDIR since
711 nothing is executed from what is installed in DESTDIR.
712 (See critical utils, below.)
713 Build often:
714 This keeps critical utilities current enough to not choke
715 on any other part of the source tree that depends on up to
716 date functionality. If you use build.sh, you should not have
717 this problem.
718
719 What to do if things don't work:
720 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
721 When things don't work there are usually a few things that commonly
722 should be done.
723 1) make includes
724 This should be done automatically by make build.
725 2) cd share/mk && make install
726 Again, automatically done by make build.
727
728 Failsafe rebuild of a small part of the tree:
729 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
730 To make sure you rebuild something correctly you want to do
731 something like the following:
732 1) Make sure the includes and .mk files are up to date.
733 2) Make sure any program used to build the particular
734 utility is up to date. (yacc, lex, etc...)
735 3) cd ...path/to/util...
736 make cleandir
737 rm ...all obj directories...
738 make cleandir # yes, again
739 make obj
740 make depend && make
741
742 Failsafe rebuild of the entire tree:
743 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
744 If you really want to make sure the source tree is clean and
745 ready for a build try the following. Note that sourcing /etc/mk.conf
746 (a make(1) Makefile) in this manner is not right, and will not work
747 for anyone who uses any make(1) features in /etc/mk.conf.
748
749 ---cut here---
750 #!/bin/sh
751 . /etc/mk.conf
752
753 if [ -z $NETBSDSRCDIR ] ; then
754 NETBSDSRCDIR=/usr/src
755 fi
756 if [ \! -d $NETBSDSRCDIR ] ; then
757 echo Unable to find sources
758 exit 1
759 fi
760 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
761
762 if [ -z $BSDOBJDIR ] ; then
763 BSDOBJDIR=/usr/obj
764 fi
765 if [ -d $BSDOBJDIR ] ; then
766 rm -rf $BSDOBJDIR
767 fi
768
769 cd $NETBSDSRCDIR && make cleandir
770
771 ---cut here---
772
773 Critical utilities:
774 ^^^^^^^^^^^^^^^^^^^
775 usr.bin/compile_et
776 usr.bin/make
777 usr.bin/yacc
778 usr.bin/lex
779 usr.bin/xlint
780 usr.bin/config
781
782 Other problems and possible solutions:
783 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
784 Symptom:Complaints involving a Makefile.
785 Fix: Rebuild usr.bin/make:
786 cd usr.bin/make && make && make install
787 Or, a failsafe method if that doesn't work:
788 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
789
790 Fix: Make sure .mk files are up to date.
791 cd share/mk && make install
792
793 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
794 Fix: Rebuild usr.bin/config
795
796 Symptom:
797 Fix: Rebuild usr.bin/yacc
798
799 Symptom:
800 Fix: Rebuild usr.bin/lex
801
802 Symptom:
803 Fix: rm /usr/lib/libbfd.a
804
805 Symptom:Obsolete intermediate files are used during compilation
806 Fix: Try the following sequence of commands in the directory in question.
807 make cleandir; rm `make print-objdir`; make cleandir; make obj
808 (If you built the tree without "make obj" in the past, obsolete files
809 may remain. The command tries to clean everything up)
810
811 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible
812 pointer type
813 Fix: Rebuild and install usr.bin/menuc
814
815 Symptom:mklocale not found during build in share/locale/ctype
816 Fix: Build and install usr.bin/mklocale
817
818 Symptom:undefined reference to `__assert13' or `__unsetenv13'
819 Fix: Rebuild and install lib/libc
820
821 Symptom:usr.bin/config fails to build.
822 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
823
824 Symptom:undefined reference to `getprogname' or `setprogname'
825 Fix: Rebuild and install lib/libc
826
827 Symptom:lint does not understand the '-X' option
828 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
829
830 Symptom:Update build fails in src/tools/gcc complaining that a variable
831 (e.g. CPPFLAGS) has changed since the previous run.
832 Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build.
833
834 Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...:
835 No such file or directory.
836 Cause: If a directory is created by mistake, then it is sometimes
837 deleted from the CVS repository using administrative commands
838 that bypass the normal cvs access controls. If your cvs working tree
839 contains references to a directory that has been deleted on the
840 server in this way, then "cvs update" reports this error.
841 Fix: Recursively delete the affected directory from your working tree
842 and try the update again.
843