UPDATING revision 1.291.2.2 1 $NetBSD: UPDATING,v 1.291.2.2 2018/04/22 07:20:06 pgoyette Exp $
2
3 This file (UPDATING) is intended to be a brief reference to recent
4 changes that might cause problems in the build process, and a guide for
5 what to do if something doesn't work.
6
7 For a more detailed description of the recommended way to build NetBSD
8 using build.sh, see the BUILDING file.
9
10 Note that much of the advice in this UPDATING file was written before
11 build.sh existed. Nevertheless, the advice here may be useful for
12 working around specific problems with build.sh.
13
14 Sections are marked with "^^^^^". After the section on "Recent changes"
15 are several sections containing more general information.
16
17 See also: BUILDING, build.sh, Makefile.
18
19 Recent changes:
20 ^^^^^^^^^^^^^^^
21
22 20180414:
23 Existing binutils was migrated to binutils.old. Manual
24 removal of tools/binutils objects directory may be required
25 to fix tools build failure.
26
27 20180311:
28 bdftopcf was updated and may need cleaning in the
29 src/external/mit/xorg/tools/bdftopcf subdirectory if there are
30 link errors.
31
32 20180212:
33 between OpenSSL and GCC updates, many things may fail to build.
34 any failure that looks like GCC or openssl is best handled by
35 a clean destdir and objdir. Full cleandir and destdir deletion
36 is recommended if build failures occur.
37
38 20171225:
39 removal of the vadvise syscall requires manual removal of all
40 associated files from the libc build object directory (including
41 the .depend files) - a command like:
42 cd $OBJ && find . -type d -name libc | xargs rm -rf
43 For architectures that support multiple "compat" binary targets,
44 you'll need to cleanup both the regular libc directory and the
45 compat ones (the above command will do that).
46
47 20171010:
48 a change to the build structure of external/bsd/acpica/bin/iasl
49 means that its objdir (or *.d and .depend at least) might need
50 to be manually removed - or a build done once without -u.
51
52 20170822:
53 a new version of GMP has been imported and probably
54 will break parts of builds related to themselves or GCC, both
55 in the tools and the native section. Remove all GCC, GMP, MPFR
56 and MPC objdirs or build once without -u.
57
58 20170816:
59 a new version of MPFR and MPC have been imported and probably
60 will break parts of builds related to themselves or GCC, both
61 in the tools and the native section. Remove all GCC, GMP, MPFR
62 and MPC objdirs or build once without -u.
63
64 20170402:
65 a new version of dhcpcd has been imported, which does not support
66 update builds from the previous version. Remove your
67 external/bsd/dhcpcd object dir or build once without -u.
68
69 20170211:
70 a new terminfo database has been imported.
71 The structure of it has changed slightly from prior versions and
72 an updated tic tool is required.
73 If you build.sh, don't use -u
74
75 20170207:
76 various arch dependent libc/exect.S files were removed
77 Either remove the obj directories (lib/libc and compat/amd64/i386/lib
78 if it exists) or do a clean build.
79 (This is a bug in the make system, it should be corrected without
80 human intervention, but isn't.)
81
82 20170104:
83 xinput build options have changed.
84 Remove the obj directory (external/mit/xorg/bin/xinput)
85 if you build.sh -u
86
87 20170103:
88 a new version of flex has been imported.
89 Remove the file from obj (external/bsd/flex)
90 if you build.sh -u
91
92 20161014:
93 a new version of OpenSSL has been imported.
94 Remove the files from obj (crypto/external/bsd/openssl)
95 if you build.sh -u
96
97 20161009:
98 a new version of dhcpcd has been imported with slightly changed
99 build infrastructure. When doing a build.sh -u this requires
100 pruning the external/bsd/dhcpcd objdir.
101
102 20160914:
103 i386, amd64, shark, ofppc and macppc have joined shark and x68k
104 ports in using xorg-server 1.18. This requires a clean destdir
105 and a clean objdir.
106
107 20160527:
108 i386 needs a full cleandir or objdir deletion because PIE has
109 been enabled. (see the amd64 entry two down for further info)
110
111 20160418:
112 libedit needs manual removal of all autogenerated files since
113 some of them are not autogenerated anymore. Remember that there
114 might be two copies of libedit if your platform builds "compat".
115
116 20160410:
117 amd64 needs full "make cleandir" or deletion of objdir now that
118 PIE has been enabled for amd64. PIE, or position-independent
119 executables, means all code, including executables and not just
120 shared libraries, is position-independent and hence able to be
121 relocated by ASLR, address space layout randomization.
122
123 The change was made in Makefile variables for compiler and
124 linker flags, for which make(1) does not record dependencies,
125 hence it is unable to detect that all .o files need rebuilding.
126
127 Partial rebuilds with some modified source files will likely
128 fail when linking executables, since the linker refuses to mix
129 position-independent code with position-dependent code in
130 position-independent executables:
131
132 .../x86_64--netbsd/bin/ld: foo.o: relocation R_X86_64_32 against `...' cannot be used when making a shared object; recompile with -fPIC
133
134 20160401:
135 Ports switching to GCC 5.3 will need a full "make cleandir".
136 Some people have found that cleandir is not sufficient, so if
137 in doubt delete the entire object directory tree for gcc.
138
139 20160306:
140 NetBSD's regexp implementation is now part of libnbcompat.
141 Nblex, nbm4, nbpax, nbsed use it and they may crash on
142 non-NetBSD hosts if linked with stale object files produced
143 while they included a non-NetBSD regex.h.
144 In any case, you should "make cleandir" at least these tools
145 before updating your toolchain.
146
147 20160125:
148 Dtrace has been enabled by default on some architectures.
149 When doing an update build, make sure to clean the etc/mtree
150 object directory before starting the build - otherwise the
151 needed directories in destdir will not be created.
152 An easy way to do this is:
153 cd src/etc/mtree && $TOOLDIR/bin/nbmake-$arch cleandir
154
155 20150818:
156 New acpica requires "make cleandir" in src/external/bsd/acpica
157 again.
158
159 20150413:
160 New acpica requires "make cleandir" and reinstalling yacc
161 in /usr/src/external/bsd/byacc and /usr/src/tools/yacc and
162 also "make cleandir" in /usr/src/external/bsd/acpica.
163
164 20150404:
165 Lint changes require a full rebuild of the tool, so make
166 sure to build without -u option to build.sh, or manually
167 do a make cleandir in src/tools/lint1 and
168 src/usr.bin/xlint.
169
170 20150310:
171 Improvements to openssl for arm mean that update builds of
172 the openssl libraries will fail. A make cleandir in
173 external/bsd/openssl/lib is needed
174
175 20141026:
176 A mishap during the import of pppd may cause your corruption
177 in your cvs directory if you happened to do a cvs update
178 during a short period of time. To fix, just remove the
179 directory src/external/bsd/ppp/dist/pppd completely
180 and let cvs restore it on next update.
181
182 20140721:
183 The src/external/mit/lua/src directory was accidentally created
184 and then deleted in the CVS repository. If you get errors like
185
186 cvs [update aborted]: cannot open directory
187 /cvsroot/src/external/mit/lua/src: No such file or directory
188
189 then delete your local copy of that directory tree and try again.
190
191 20140530:
192 ARM eABI switched to DWARF based exception handling. This requires
193 rebuilding all C++ code. It is strongly advised to do a clean build.
194
195 20140131:
196 The new compiler_rt/libc integration moved a few things. It is strongly
197 advised to do a clean build. At least lib/libc, the compat version(s)
198 of libc, libkern, rump and the kernels need to be cleaned.
199
200 20131227:
201 1. The new ntpd runs in a restricted mode to prevent amplification
202 attacks. If you need ntpdc to work you need to explicitly enable
203 mode7 in your config file. Make sure you put the necessary restrict
204 statements to avoid being exposed.
205 2. strncat has moved from lib/libc to common/lib/libc; you might need
206 to make clean in libc
207
208 20131129:
209 The GMP sources were updated, and builds will likely fail without
210 cleaning their build trees for both tools and in-tree, like below.
211
212 20131128:
213 The MPC and MPFR sources were updated, and builds may require their
214 tools and in-tree directories cleaned for successful updates.
215
216 20130605:
217 The kernel option FAST_IPSEC no longer exists, it's been renamed
218 to IPSEC (and the older IPSEC version removed).
219
220 20130605:
221 Previous freetype installations eroneously installed private
222 header files. If you are building against a non-empty $DESTDIR,
223 please remove ${DESTDIR}//usr/X11R7/include/freetype2/freetype/.
224
225 20130531:
226 The xdm update may cause build failure due to xdm.man being
227 in the obj tree. Make sure to ensure any like this:
228 nbmake: nbmake: don't know how to make xdm.man. Stop
229 is fixed by deleting the xdm.man in the obj tree.
230
231 20130530:
232 Updates of many xsrc packages will leave old .pc files around.
233 Best to clean out the xsrc objdir entirely before rebuilds.
234
235 20130301:
236 The removal of netiso requires manual removal of /usr/include/netiso
237 prior to the build and make cleandir in /usr/src/usr.bin/{ktruss,kdump}
238
239 20120726:
240 The update of OpenSSL requires cleaning both the OpenSSL build
241 directory and DESTDIR. *Even non-update builds require cleaning
242 DESTDIR.* Builds done without taking these steps may fail, or in
243 some cases may succeed and install broken OpenSSL libraries that
244 cause third-party software to link incorrectly and/or crash.
245
246 20120507:
247 The database schema for makemandb was changed. You will
248 need to update the database using 'makemandb -f' or wait
249 for the next weekly run to fix it.
250
251 20120319:
252 sys/conf/Makefile.kern.inc has been modified to adjust the
253 size of db_symtab automatically. You need to update dbsym in
254 your $TOOLDIR to build kernels with options SYMTAB_SPACE. If
255 you don't want this behavior, add AUTO_SYMTAB_SPACE=no to your
256 mk.conf.
257
258 20120216:
259 Default for MKCATPAGES changed to NO. Update builds will fail
260 unless DESTDIR is cleaned manually. If you built between 20120207
261 and 20120216, daily and weekly could have created an unreadable
262 /var/db/man.db index for apropos. Running makemandb -f or
263 the next run of weekly will fix it.
264
265 20111227:
266 If you built between 20111225 and 20111227 you need to remove
267 /usr/lib/libpam.so.4* and /usr/lib/security/*.so.4, since the
268 bump has been reverted.
269
270 20111125:
271 The "rnd" pseudodevice has been added to sys/conf/std, which
272 means it should no longer be explicitly listed in kernel
273 configuration files. The line "pseudo-device rnd" should be
274 removed from any custom kernel config files users may have.
275
276 20111119:
277 A problem with the datastructures used by the rndctl(8)
278 utility (pointers in datastructures in an array, making 32->64
279 bit compatibility very painful) has been fixed in a
280 non-backwards-compatible way. If you replace your kernel,
281 replace your rndctl executable too.
282
283 20111001:
284 the prop_*_send_syscall() functions from proplib(3) have been
285 changed and their new version is not backward compatible with the old
286 one. So ensure that all consumers of these functions (currently:
287 quota2 code and its tests) are updated together with the new lib.
288
289 20110817:
290 sparc has been changed to use GCC 4.5.3, so any objdir or
291 DESTDIR for them should be deleted before updating.
292
293 20110806:
294 i386 and amd64 have been changed to use GCC 4.5.3, so any
295 objdir or DESTDIR for them should be deleted before updating.
296
297 20110805:
298 The update to GCC 4.5.3 requires a non-trivial portion of
299 the tree to be cleaned. Best to delete both objdir and
300 DESTDIR before running this update. So far, only the
301 sparc64, mips and powerpc platforms have changed.
302
303 20110803:
304 The layout of external/public-domain/xz has changed. To do an
305 update build you will have to remove the contents of the OBJDIR
306 for external/public-domain/xz/bin by hand as the xz entry there
307 is now a directory.
308
309 20110410:
310 The configuration of src/tools/gcc has changed. To do an
311 update build you have to clean both tools/binutils and
312 tools/gcc by hand.
313
314 20110328:
315 Building the Xorg binary was moved into a subdirectory to fix
316 ordering issues with "make all". It may be necessary to remove
317 the OBJDIR for external/mit/xorg/server/xorg-server/hw/xfree86
318 if your update build fails, as the "Xorg" entry there is now a
319 directory.
320
321 20110121:
322 Assembler files no longer use -traditional-cpp. This can break
323 the build of individual parts of the tree. This is handled
324 correctly by build.sh. Manual builds have to update /usr/share/mk
325 and re-run config(1) for any kernel configurations as needed.
326
327 20101217:
328 The tcpdump(8) program was changed to drop privileges and chroot(2)
329 by default. It may be necessary to manually update passwd(5) and
330 group(5) in order to make the program work with existing setups.
331
332 20101125:
333 The latest changes to setenv(3) dissallow setting environment
334 variables with names that contain '='. Revision 1.18 of env.c
335 assumed that this was allowed. Installing a new libc with an
336 old copy of /usr/bin/env causes env x=1 printenv | grep x= to
337 break which affects the autoconf tests for dependency finding,
338 so building gcc will end up printing:
339 checking dependency style of gcc... none
340 configure: error: no usable dependency style found
341 Fix it by rebuilding and re-installing env.
342
343 20101119:
344 Recent Xorg updates in xsrc/external/mit/ may cause various build
345 or run-time problems. Delete your entire DESTDIR and OBJDIR if you
346 have any build problems with xsrc, or problems with mismatched
347 versions between xorg-server and drivers.
348
349 20100604:
350 The update of ATF to 0.9 causes old tests written in shell to fail
351 unless they are rebuilt. If you are building with MKUPDATE=yes,
352 you need to clean the src/external/bsd/atf/tests/ and the src/tests/
353 trees by hand.
354
355 20100522:
356 Recent Xorg updates in xsrc/external/mit/ will cause various build
357 problems. Delete your entire DESTDIR and OBJDIR if you have any
358 build problems with xsrc.
359
360 20100522:
361 private section of <ctype.h> was splitted, and now mklocale(1)
362 include ctype_local.h, so you have to make cleandir in tools/mklocale.
363
364 20100520:
365 The location of the xkb compiled descriptions has changed. Please
366 remove usr/X11R7/lib/X11/xkb/compiled from your $DESTDIR.
367
368 20100222:
369 The shared objects file extension has been changed from .so to
370 .pico, in order to avoid conflicts with shared libraries names
371 libXX.so. All now stale regular .so files can be removed from
372 your object directories.
373
374 20100204:
375 The termcap database has been removed from the sources,
376 but has not been marked obsolete so it is not removed
377 from the system when upgrading.
378 As such, you will need to remove them from your object
379 and destination directories.
380
381 20091101:
382 After updating, it may be necessary to make the 'cleandir'
383 target in src/tools/yacc/ and in src/usr.bin/yacc/ before a
384 'build.sh -u tools' or 'build.sh -u distribution'. Ditto
385 src/tools/lex/ and src/usr.bin/lex/.
386
387 20091001:
388 On amd64 you must rebuild tools (to get the new binutils)
389 before building a kernel, or the build fails on cpufunc.S.
390
391 20091001:
392 An error will create a ./usr/X11R7/lib/X11/xkb/compiled/xkb
393 symlink, failing the build. Delete the link, and the subdir
394 it is in, and retry your build.
395
396 20090718:
397 libc build changed so that strchr() provides the extra entry
398 point for index(). Update build of libc.a (and libc_pic.a)
399 may fail because the archive contains the unwanted index.o.
400 (Similarly for strrchr() and rindex().)
401
402 20090709:
403 Native Xorg was upgraded again. Builds will probably fail again
404 without a clean objdir, at least for src/external/mit/xorg.
405
406 20090616:
407 Native Xorg was upgraded. Builds will need a clean objdir for
408 src/external/mit/xorg. Upgrading a system from sets will not
409 work properly yet as the /usr/X11R7/lib/X11/xkb/symbols/pc
410 subdirectory has been changed into a file, and this needs to
411 be manually "rm -r"'ed before installing xbase.tgz.
412
413 20090501:
414 Several new functions were added to string.h/libc, and this
415 can cause autoconf problems during the tool build for people
416 who fail to clean out their tools objects properly. If you
417 note messages about stpcpy, stpncpy or strnlen accompanying a
418 failure during the tool build, clean out all your tools
419 objects and start again.
420
421 20090325:
422 The i386 port was switched to i486 default toolchain. This requires
423 cleaning your src/tools directory and $TOOLDIR and rebuilding them.
424
425 20090126:
426 The __posix_fadvise50 system call changed assembly stub type. You
427 need to 'rm -f __posix_fadvise50.*' in the libc build directory
428 to avoid using the old assembly stub.
429
430 20090202:
431 pkg_install now depends on the pkgdb cache for automatic conflict
432 detection. It is recommented to rebuild the cache with
433 ``pkg_admin rebuild''.
434
435 20090110:
436 time_t and dev_t have been bumped to 64 bit quantities. To upgrade:
437 1. Make sure your kernel has COMPAT_50 in it. Build and install.
438 This is needed even in the MODULAR kernel because there is
439 conditionally compiled code in rtsock.c.
440 2. make sure build.sh completes and the binaries in a chroot work
441 before installing.
442 3. If you don't use build.sh and you build directly to root, and
443 your build breaks in the middle, don't despair. Make sure headers
444 are installed properly, and start building libraries first libc
445 and libutil, install them and then continue building all the
446 libraries in src/lib and src/gnu/lib and install them. Once
447 the new libraries are installed, you can restart the build.
448 4. If you compile packages and you notice link time warnings,
449 rebuild the required packages to update their shared libraries.
450 Any package you rebuild will require rebuilding all the packages
451 that depend on it.
452 5. Next time you run pwd_mkdb with the new binary, the file
453 will be upgraded and it will not be backwards compatible.
454 6. The utmpx/wtmpx files (/var/run/utmpx and /var/log/wtmpx, see
455 lastlogx(5)) have been versioned, and there is a heuristic
456 for utmp. You are better off removing the old files after
457 upgrading. The automated clearing of /var/run during
458 boot, and the automated rotating of files in /var/log by
459 newsyslog(8), may mean that you do not have to remove the
460 files manually.
461 7. The optional accounting file (/var/account/acct, see
462 accton(8)) has not been versioned, and will need to be
463 removed. The automatic rotation of the accounting file by
464 /etc/daily limits the bad consequences of failure to remove
465 the file.
466 8. Application software that writes time_t to binary files on
467 disk will break or need attention. Most notably: if you are
468 using PostgreSQL < 8.4, you need to dump your databases,
469 rebuild PostgreSQL with the new time_t, then restore.
470
471 20081219:
472 config(1) has been updated, and one of the files it creates -
473 swapnetbsd.o - has changed format. You need to rebuild config
474 (done automatically by build.sh) and then you need to rerun
475 config on all kernel configuration files before rebuilding those
476 kernels.
477
478 20081205:
479 If you build with MKX11=no, you should remove /etc/rc.d/xdm and
480 /etc/rc.d/xfs from DESTDIR because those files were moved to the xetc
481 set and will appear as extra files for MKX11=no update builds.
482
483 20081122:
484 On i386, various kernel options(4) in GENERIC including
485 file systems have been disabled and moved into kernel modules.
486 Before trying a new GENERIC kernel, you have to prepare the
487 following files as well as a new GENERIC kernel:
488
489 - build and install kernel modules from src/sys/modules
490
491 - install the latest bootloader, which will load a module
492 for the file system from which the kernel is loaded automatically
493
494 If you have to load your kernel from a file system which is not of
495 the same type as the root file system, you have to load the necessary
496 file system module manually on the boot prompt or in the boot.cfg file.
497
498 20080827:
499 If you built and installed a libc from sources between
500 2008/08/20 and 2008/08/26 you got a broken strtouq(3)
501 which results in false errors reported by lint(1).
502 Since this breaks the libc build itself, manual help is
503 needed -- lint must be disabled temporarily, e.g.:
504 $ (cd lib/libc && make MKLINT=no dependall install)
505
506 20080813:
507 MKDEBUG build was broken because the .depend files did not know
508 about .go files. You need to remove all .depend files and rebuild.
509
510 20080802:
511 A regression in binary compatibility for pthread_mutex_t has
512 been fixed. Unfortunately, the price is breaking compatibility
513 for -current.
514
515 Threaded programs (using libpthread) and C++ programs (using
516 libstdc++) compiled after 20070907 and before 20080802 need to
517 be recompiled.
518
519 One way to find affected pkgsrc packages:
520
521 $ grep REQUIRES=/usr/lib/libpthread /var/db/pkg/*/+BUILD_INFO
522 $ grep REQUIRES=/usr/lib/libstdc++ /var/db/pkg/*/+BUILD_INFO
523
524 20080731:
525 WAPBL (metadata journaling support) has been added, but at this
526 time isn't backwards compatible with pre-WAPBL aware kernels
527 and userland (fsck_ffs in particular). Please make sure you
528 don't use a journaled filesystem with an older kernel/userland,
529 especially an uncleanly mounted journaled filesystem. WAPBL
530 also requires the super block to be in the UFS2 format. You
531 can use fsck_ffs -c 4 to update the superblock format.
532
533 20080721:
534 Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
535 isn't defined.
536
537 20080531:
538 The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
539 from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
540 utility needs to be rebuilt and reinstalled as older binaries
541 won't work correctly. The following sequence of commands:
542
543 $ (cd sys/sys/ && nbmake-$arch includes)
544 $ (cd sbin/drvctl/ && nbmake-$arch clean)
545 $ (cd sbin/drvctl/ && nbmake-$arch all)
546
547 leaves new drvctl utility in sbin/drvctl build directory.
548
549 20080503:
550 The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
551
552 20080521:
553 For a while, unprivileged UPDATE builds would fail to
554 succeed at the checkflist stage, complaining that
555 ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
556 problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
557 If you already hit this problem, update the .mk file,
558 remove ${DESTDIR}/stand/<arch>, and re-run the build.
559
560 20080303:
561 Linker warnings are now fatal if $WARNS>0.
562
563 20080126:
564 The posix_fadvise system call has been changed from an assembly
565 stub, to a c file that calls an assembly stub. You need to
566 'rm -f posix_fadvise.* .depend' in the libc build directory to
567 avoid using the old assembly stub.
568
569 20071209:
570 The acpiec(4) driver has been split into two attachments. If you
571 get ACPI errors before the attachment, please update your kernel
572 configuration file appropriately or see GENERIC for more details.
573
574 20071115:
575 The it(4) driver has been renamed to itesio(4) and the old port
576 argument specified in the kernel configuration file is not valid
577 anymore. The itesio(4) driver now uses the Super I/O address port
578 rather than the EC address port. Please update your kernel
579 configuration file appropriately or see GENERIC for more details.
580
581 20071028:
582 The pccons(4) driver has been removed from the NetBSD/shark port.
583 You need to update any custom kernel configuration file you have
584 to remove any references to pccons (which includes removing the
585 now useless XSERVER option) and replace them with the correct
586 entries for the wscons driver. See the GENERIC configuration file
587 for more details.
588
589 20070913:
590 A latent bug in dhclient/dhcpd that caused it to be unable to
591 enumerate interfaces was fixed. The bug began to cause
592 problems after 20070911 when the kernel's SIOCGIFCONF
593 implementation was repaired. From 20070529 to 20070911 racoon
594 could not enumerate interfaces. (These are noted because
595 normal kernel/userspace version matching hygiene is not
596 sufficient to avoid this problem.) Ensure that both kernel
597 and userland are from after 20070913.
598
599 20070703:
600 nbinstall has been renamed ${MACHINE_GNU_ARCH}-install. It
601 calls the target-specific strip program, and the logic to pass
602 down STRIP from make has been removed. This requires a
603 re-installation of tools.
604
605 20070422:
606 The way OS emulations lookup filenames inside the emulation root
607 has been changed. Rather than modify the pathname (and copy back
608 to userspace) namei() and lookup() directly check the emulation
609 root. One side effect is that absolute symlinks inside the emulated
610 root file system will be relative to that file system - unless they
611 start /../ this is useful when the emulated root is a real install
612 that has such links.
613 This might affect symlinks that have been added to reference outside
614 the emulated root.
615
616 20070412:
617 The pckbc driver on sgimips IP32 has been removed. Use macekbc
618 instead. See the GENERIC32_IP3x kernel configuration for an
619 example.
620
621 20070319:
622 src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
623 on many platforms due to incorrect flags settings. If you
624 updated and built after about 20070315, do "nbmake-$arch
625 cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
626 rebuild of object files that might have been built
627 incorrectly, and ensure that you have at least
628 src/lib/libc/Makefile 1.130.
629
630 20070210:
631 src/sys/sys/{sa.h,savar.h} were removed.
632 find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
633 | xargs egrep -l '/sa.h|/savar.h' | xargs rm
634 will allow dependencies on those files to get get rebuilt
635
636 20070209:
637 The threading model was changed when the newlock2 branch
638 was merged to NetBSD-current. If you boot with a new
639 kernel (version 4.99.10), then you also need a new pthread
640 library (/usr/lib/libpthread.so.0.7). If you boot with
641 an old kernel, then you need the old pthread library
642 (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
643 the pthread library in sync, old threaded applications should
644 continue to work with an old or new kernel. Note that named(8)
645 is the only threaded application in the base system.
646
647 20061214:
648 Following the move of string_to_flags() and flags_to_string()
649 from the bin/ls/ sources to libutil, users doing UPDATE builds
650 will need to do a "make cleandir" in
651 tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
652 bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
653 usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
654 as the installation images in distrib/
655 in order to excise stale references to the old stat_flags.h header
656 file in the ls sources -- stat_flags.h has been removed.
657
658 20061108:
659 The configure script used in the src/tools/gcc compiler has been
660 changed to indicate that our libc has ssp support built-in and
661 does not depend on -lssp and -lssp-nonshared. You'll need to
662 make clean in src/tools/gcc first to rebuild the compiler.
663
664 20061009:
665 The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
666 available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
667
668 20060814:
669 The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
670 withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
671 kernel configuration for an example. X servers from the last
672 few years should cope.
673
674 20060703:
675 MPACPI is no more. We always configure PCI interrupts using ACPI
676 if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
677 to ACPI_SCANPCI. Thanks to work from fvdl.
678
679 20060627:
680 socket(2) has changed, and its system call has been versioned.
681 For userlands with the old version of socket(2), make sure that
682 your kernel has 'options COMPAT_30' set, or else 'bad system call'
683 errors will result.
684
685 Hints for a more successful build:
686 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
687 Use build.sh, but do not use its "expert mode":
688 This will automatically build the tools in the
689 correct order, and it will keep the tools and the
690 new build products from interfering with the running
691 system. This will allow you to ignore most of the
692 other advice in this file.
693 Build a new kernel first:
694 This makes sure that any new system calls or features
695 expected by the new userland will be present. This
696 helps to avoid critical errors when upgrading.
697 Use object directories:
698 This helps to keep stale object
699 files from polluting the build if a Makefile "forgets"
700 about one. It also makes it easier to clean up after
701 a build. It's also necessary if you want to use the
702 same source tree for multiple machines.
703 To use object directories with build.sh:
704 a) invoke build.sh with the "-M" or "-O" options.
705 To use object directories without using build.sh:
706 a) cd /usr/src ; make cleandir
707 b) Add "OBJMACHINE=yes" to /etc/mk.conf
708 c) Add "MKOBJDIRS=yes" to /etc/mk.conf
709 d) cd /usr/src ; make build
710 Note that running "make obj" in a directory will create
711 in obj.$MACHINE directory.
712 Build to a DESTDIR:
713 This helps to keep old installed files (especially libraries)
714 from interfering with the new build.
715 To build to a DESTDIR with build.sh, use the "-D" option.
716 To build to a DESTDIR without using build.sh, set the DESTDIR
717 environment variable before running make build. It should be
718 set to the pathname of an initially empty directory.
719 Problems: if you do not use build.sh, you might need to
720 update critical utilities without using DESTDIR since
721 nothing is executed from what is installed in DESTDIR.
722 (See critical utils, below.)
723 Build often:
724 This keeps critical utilities current enough to not choke
725 on any other part of the source tree that depends on up to
726 date functionality. If you use build.sh, you should not have
727 this problem.
728
729 What to do if things don't work:
730 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
731 When things don't work there are usually a few things that commonly
732 should be done.
733 1) make includes
734 This should be done automatically by make build.
735 2) cd share/mk && make install
736 Again, automatically done by make build.
737
738 Failsafe rebuild of a small part of the tree:
739 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
740 To make sure you rebuild something correctly you want to do
741 something like the following:
742 1) Make sure the includes and .mk files are up to date.
743 2) Make sure any program used to build the particular
744 utility is up to date. (yacc, lex, etc...)
745 3) cd ...path/to/util...
746 make cleandir
747 rm ...all obj directories...
748 make cleandir # yes, again
749 make obj
750 make depend && make
751
752 Failsafe rebuild of the entire tree:
753 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
754 If you really want to make sure the source tree is clean and
755 ready for a build try the following. Note that sourcing /etc/mk.conf
756 (a make(1) Makefile) in this manner is not right, and will not work
757 for anyone who uses any make(1) features in /etc/mk.conf.
758
759 ---cut here---
760 #!/bin/sh
761 . /etc/mk.conf
762
763 if [ -z $NETBSDSRCDIR ] ; then
764 NETBSDSRCDIR=/usr/src
765 fi
766 if [ \! -d $NETBSDSRCDIR ] ; then
767 echo Unable to find sources
768 exit 1
769 fi
770 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
771
772 if [ -z $BSDOBJDIR ] ; then
773 BSDOBJDIR=/usr/obj
774 fi
775 if [ -d $BSDOBJDIR ] ; then
776 rm -rf $BSDOBJDIR
777 fi
778
779 cd $NETBSDSRCDIR && make cleandir
780
781 ---cut here---
782
783 Critical utilities:
784 ^^^^^^^^^^^^^^^^^^^
785 usr.bin/compile_et
786 usr.bin/make
787 usr.bin/yacc
788 usr.bin/lex
789 usr.bin/xlint
790 usr.bin/config
791
792 Other problems and possible solutions:
793 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
794 Symptom:Complaints involving a Makefile.
795 Fix: Rebuild usr.bin/make:
796 cd usr.bin/make && make && make install
797 Or, a failsafe method if that doesn't work:
798 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
799
800 Fix: Make sure .mk files are up to date.
801 cd share/mk && make install
802
803 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
804 Fix: Rebuild usr.bin/config
805
806 Symptom:
807 Fix: Rebuild usr.bin/yacc
808
809 Symptom:
810 Fix: Rebuild usr.bin/lex
811
812 Symptom:
813 Fix: rm /usr/lib/libbfd.a
814
815 Symptom:Obsolete intermediate files are used during compilation
816 Fix: Try the following sequence of commands in the directory in question.
817 make cleandir; rm `make print-objdir`; make cleandir; make obj
818 (If you built the tree without "make obj" in the past, obsolete files
819 may remain. The command tries to clean everything up)
820
821 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible
822 pointer type
823 Fix: Rebuild and install usr.bin/menuc
824
825 Symptom:mklocale not found during build in share/locale/ctype
826 Fix: Build and install usr.bin/mklocale
827
828 Symptom:undefined reference to `__assert13' or `__unsetenv13'
829 Fix: Rebuild and install lib/libc
830
831 Symptom:usr.bin/config fails to build.
832 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
833
834 Symptom:undefined reference to `getprogname' or `setprogname'
835 Fix: Rebuild and install lib/libc
836
837 Symptom:lint does not understand the '-X' option
838 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
839
840 Symptom:Update build fails in src/tools/gcc complaining that a variable
841 (e.g. CPPFLAGS) has changed since the previous run.
842 Fix: Run "nbmake-${ARCH} clean" in src/tools/gcc or do a clean build.
843
844 Symptom:cvs [update aborted]: cannot open directory /cvsroot/src/...:
845 No such file or directory.
846 Cause: If a directory is created by mistake, then it is sometimes
847 deleted from the CVS repository using administrative commands
848 that bypass the normal cvs access controls. If your cvs working tree
849 contains references to a directory that has been deleted on the
850 server in this way, then "cvs update" reports this error.
851 Fix: Recursively delete the affected directory from your working tree
852 and try the update again.
853