Home | History | Annotate | Line # | Download | only in src
UPDATING revision 1.176
      1 $NetBSD: UPDATING,v 1.176 2008/08/02 14:30:37 simonb Exp $
      2 
      3 This file (UPDATING) is intended to be a brief reference to recent
      4 changes that might cause problems in the build process, and a guide for
      5 what to do if something doesn't work.
      6 
      7 For a more detailed description of the recommended way to build NetBSD
      8 using build.sh, see the BUILDING file.
      9 
     10 Note that much of the advice in this UPDATING file was written before
     11 build.sh existed.  Nevertheless, the advice here may be useful for
     12 working around specific problems with build.sh.
     13 
     14 See also: BUILDING, build.sh, Makefile.
     15 
     16 Recent changes:
     17 ^^^^^^^^^^^^^^^
     18 
     19 20080731:
     20 	WAPBL (metadata journaling support) has been added, but at this
     21 	time isn't backwards compatible with pre-WAPBL aware kernels
     22 	and userland (fsck_ffs in particular).  Please make sure you
     23 	don't use a journaled filesystem with an older kernel/userland,
     24 	especially an uncleanly mounted journaled filesystem.  WAPBL
     25 	also requires the super block to be in the UFS2 format.  You
     26 	can use fsck_ffs -c 4 to update the superblock format.
     27 
     28 20080721:
     29 	Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
     30 	isn't defined.
     31 
     32 20080531:
     33 	The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 
     34 	from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
     35 	utility needs to be rebuilt and reinstalled as older binaries
     36 	won't work correctly. The following sequence of commands:
     37 
     38 	  $ (cd sys/sys/ && nbmake-$arch includes)
     39 	  $ (cd sbin/drvctl/ && nbmake-$arch clean)
     40 	  $ (cd sbin/drvctl/ && nbmake-$arch all)
     41 
     42 	leaves new drvctl utility in sbin/drvctl build directory.
     43 
     44 20080503:
     45 	The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
     46 
     47 20080521:
     48 	For a while, unprivileged UPDATE builds would fail to
     49 	succeed at the checkflist stage, complaining that
     50 	${DESTDIR}/stand/<arch>/ did not exist.  A fix for this
     51 	problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
     52 	If you already hit this problem, update the .mk file,
     53 	remove ${DESTDIR}/stand/<arch>, and re-run the build.
     54 
     55 20080303:
     56 	Linker warnings are now fatal if $WARNS>0.
     57 
     58 20080126:
     59 	The posix_fadvise system call has been changed from an assembly
     60 	stub, to a c file that calls an assembly stub. You need to
     61 	'rm -f posix_fadvise.* .depend' in the libc build directory to
     62 	avoid using the old assembly stub.
     63 
     64 20071209:
     65 	The acpiec(4) driver has been split into two attachments. If you
     66 	get ACPI errors before the attachment, please update your kernel
     67 	configuration file appropriately or see GENERIC for more details.
     68 
     69 20071115:
     70 	The it(4) driver has been renamed to itesio(4) and the old port
     71 	argument specified in the kernel configuration file is not valid
     72 	anymore. The itesio(4) driver now uses the Super I/O address port
     73 	rather than the EC address port. Please update your kernel
     74 	configuration file appropriately or see GENERIC for more details.
     75 
     76 20071028:
     77 	The pccons(4) driver has been removed from the NetBSD/shark port.
     78 	You need to update any custom kernel configuration file you have
     79 	to remove any references to pccons (which includes removing the
     80 	now useless XSERVER option) and replace them with the correct
     81 	entries for the wscons driver.  See the GENERIC configuration file
     82 	for more details.
     83 
     84 20070913:
     85 	A latent bug in dhclient/dhcpd that caused it to be unable to
     86 	enumerate interfaces was fixed.  The bug began to cause
     87 	problems after 20070911 when the kernel's SIOCGIFCONF
     88 	implementation was repaired.  From 20070529 to 20070911 racoon
     89 	could not enumerate interfaces.  (These are noted because
     90 	normal kernel/userspace version matching hygiene is not
     91 	sufficient to avoid this problem.)  Ensure that both kernel
     92 	and userland are from after 20070913.
     93 
     94 20070703:
     95 	nbinstall has been renamed as it calls the target specific and
     96 	the logic to pass down STRIP from mk been removed.  This forces
     97 	a re-installation of tools.
     98 
     99 20070422:
    100 	The way OS emulations lookup filenames inside the emulation root
    101 	has been changed.  Rather than modify the pathname (and copy back
    102 	to userspace) namei() and lookup() directly check the emulation
    103 	root. One side effect is that absolute symlinks inside the emulated
    104 	root file system will be relative to that file system - unless they
    105 	start /../ this is useful when the emulated root is a real install
    106 	that has such links.
    107 	This might affect symlinks that have been added to reference outside
    108 	the emulated root.
    109 
    110 20070412:
    111 	The pckbc driver on sgimips IP32 has been removed. Use macekbc
    112 	instead. See the GENERIC32_IP3x kernel configuration for an
    113 	example.
    114 
    115 20070319:
    116         src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
    117         on many platforms due to incorrect flags settings.  If you
    118         updated and built after about 20070315, do "nbmake-$arch
    119 	cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
    120 	rebuild of object files that might have been built
    121 	incorrectly, and ensure that you have at least
    122 	src/lib/libc/Makefile 1.130.
    123 
    124 20070210: 
    125         src/sys/sys/{sa.h,savar.h} were removed.
    126           find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
    127               | xargs egrep -l '/sa.h|/savar.h' | xargs rm
    128         will allow dependencies on those files to get get rebuilt
    129 
    130 20070209:
    131         The threading model was changed when the newlock2 branch
    132         was merged to NetBSD-current.  If you boot with a new
    133         kernel (version 4.99.10), then you also need a new pthread
    134         library (/usr/lib/libpthread.so.0.7).  If you boot with
    135         an old kernel, then you need the old pthread library
    136         (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
    137         the pthread library in sync, old threaded applications should
    138         continue to work with an old or new kernel.  Note that named(8)
    139 	is the only threaded application in the base system.
    140 
    141 20061214:
    142 	Following the move of string_to_flags() and flags_to_string()
    143 	from the bin/ls/ sources to libutil, users doing UPDATE builds
    144 	will need to do a "make cleandir" in
    145 		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
    146 		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
    147 		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
    148 		as the installation images in distrib/
    149 	in order to excise stale references to the old stat_flags.h header
    150 	file in the ls sources -- stat_flags.h has been removed.
    151 
    152 20061108:
    153 	The configure script used in the src/tools/gcc compiler has been
    154 	changed to indicate that our libc has ssp support built-in and
    155 	does not depend on -lssp and -lssp-nonshared. You'll need to
    156 	make clean in src/tools/gcc first to rebuild the compiler.
    157 
    158 20061009:
    159 	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
    160 	available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
    161 
    162 20060814:
    163 	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
    164 	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
    165 	kernel configuration for an example.  X servers from the last
    166 	few years should cope.
    167 
    168 20060703:
    169 	MPACPI is no more. We always configure PCI interrupts using ACPI
    170 	if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
    171 	to ACPI_SCANPCI. Thanks to work from fvdl.
    172 
    173 20060627:
    174 	socket(2) has changed, and its system call has been versioned.
    175 	For userlands with the old version of socket(2), make sure that
    176 	your kernel has 'options COMPAT_30' set, or else 'bad system call'
    177 	errors will result.
    178 
    179 Hints for a more successful build:
    180 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    181     Use build.sh, but do not use its "expert mode":
    182 	This will automatically build the tools in the
    183 	   correct order, and it will keep the tools and the
    184 	   new build products from interfering with the running
    185 	   system.  This will allow you to ignore most of the
    186 	   other advice in this file.
    187     Build a new kernel first:
    188 	This makes sure that any new system calls or features
    189 	   expected by the new userland will be present.  This
    190 	   helps to avoid critical errors when upgrading.
    191     Use object directories:
    192 	This helps to keep stale object
    193 	   files from polluting the build if a Makefile "forgets"
    194 	   about one.  It also makes it easier to clean up after
    195 	   a build.  It's also necessary if you want to use the
    196 	   same source tree for multiple machines.
    197 	   To use object directories with build.sh:
    198 	    a) invoke build.sh with the "-M" or "-O" options.
    199 	   To use object directories without using build.sh:
    200 	    a) cd /usr/src ; make cleandir
    201 	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
    202 	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
    203 	    d) cd /usr/src ; make build
    204 	   Note that running "make obj" in a directory will create
    205 	   in obj.$MACHINE directory.
    206     Build to a DESTDIR:
    207 	This helps to keep old installed files (especially libraries)
    208 	   from interfering with the new build.
    209 	   To build to a DESTDIR with build.sh, use the "-D" option.
    210 	   To build to a DESTDIR without using build.sh, set the DESTDIR
    211 	   environment variable before running make build.  It should be
    212 	   set to the pathname of an initially empty directory.
    213 	   Problems: if you do not use build.sh, you might need to
    214 		update critical utilities without using DESTDIR since
    215 		nothing is executed from what is installed in DESTDIR.
    216 		(See critical utils, below.)
    217     Build often:
    218 	This keeps critical utilities current enough to not choke
    219 	on any other part of the source tree that depends on up to
    220 	date functionality.  If you use build.sh, you should not have
    221 	this problem.
    222  
    223 What to do if things don't work:
    224 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    225 When things don't work there is usually a few things that commonly
    226 should be done.
    227     1)	make includes
    228 	This should be done automatically by make build.
    229     2)  cd share/mk && make install
    230 	Again, automatically done by make build.
    231 
    232 Failsafe rebuild of a small part of the tree:
    233 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    234 To make sure you rebuild something correctly you want to do
    235 something like the following:
    236     1)  Make sure the includes and .mk files are up to date.
    237     2)  Make sure any program used to build the particular
    238 	utility is up to date.  (yacc, lex, etc...)
    239     3)  cd ...path/to/util...
    240 	make cleandir
    241 	rm ...all obj directories...
    242 	make cleandir			# yes, again
    243 	make obj
    244 	make depend && make
    245 
    246 Failsafe rebuild of the entire tree:
    247 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    248 If you really want to make sure the source tree is clean and
    249 ready for a build try the following.  Note that sourcing /etc/mk.conf
    250 (a make(1) Makefile) in this manner is not right, and will not work
    251 for anyone who uses any make(1) features in /etc/mk.conf.
    252 
    253 ---cut here---
    254 #!/bin/sh
    255 . /etc/mk.conf
    256 
    257 if [ -z $NETBSDSRCDIR ] ; then
    258     NETBSDSRCDIR=/usr/src
    259 fi
    260 if [ \! -d $NETBSDSRCDIR ] ; then
    261     echo Unable to find sources
    262     exit 1
    263 fi
    264 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
    265 
    266 if [ -z $BSDOBJDIR ] ; then
    267     BSDOBJDIR=/usr/obj
    268 fi
    269 if [ -d $BSDOBJDIR ] ; then
    270     rm -rf $BSDOBJDIR
    271 fi
    272 
    273 cd $NETBSDSRCDIR && make cleandir
    274 
    275 ---cut here---
    276 
    277 Critical utilities:
    278 ^^^^^^^^^^^^^^^^^^^
    279 	usr.bin/compile_et
    280 	usr.bin/make
    281 	usr.bin/yacc
    282 	usr.bin/lex
    283 	usr.bin/xlint
    284 	usr.bin/config
    285 
    286 Other problems and possible solutions:
    287 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    288 Symptom:Complaints involving a Makefile.
    289 Fix:	Rebuild usr.bin/make:
    290 	cd usr.bin/make && make && make install
    291 	Or, a failsafe method if that doesn't work:
    292 	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
    293 
    294 Fix:	Make sure .mk files are up to date.
    295 	cd share/mk && make install
    296 
    297 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
    298 Fix:	Rebuild usr.bin/config
    299 
    300 Symptom:
    301 Fix:	Rebuild usr.bin/yacc
    302 
    303 Symptom:
    304 Fix:	Rebuild usr.bin/lex
    305 
    306 Symptom:
    307 Fix:	rm /usr/lib/libbfd.a
    308 
    309 Symptom:Obsolete intermediate files are used during compilation
    310 Fix:	Try the following sequence of commands in the directory in question.
    311 	make cleandir; rm `make print-objdir`; make cleandir; make obj
    312 	(If you built the tree without "make obj" in the past, obsolete files
    313 	may remain.  The command tries to clean everything up)
    314 
    315 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
    316 Fix:	Rebuild and install usr.bin/menuc
    317 
    318 Symptom:mklocale not found during build in share/locale/ctype
    319 Fix:	Build and install usr.bin/mklocale
    320 
    321 Symptom:undefined reference to `__assert13' or `__unsetenv13'
    322 Fix:    Rebuild and install lib/libc
    323 
    324 Symptom:usr.bin/config fails to build.
    325 Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
    326 
    327 Symptom:undefined reference to `getprogname' or `setprogname'
    328 Fix:    Rebuild and install lib/libc
    329 
    330 Symptom:lint does not understand the '-X' option
    331 Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
    332