Home | History | Annotate | Line # | Download | only in src
UPDATING revision 1.175
      1 $NetBSD: UPDATING,v 1.175 2008/08/01 07:34:57 simonb Exp $
      2 
      3 This file (UPDATING) is intended to be a brief reference to recent
      4 changes that might cause problems in the build process, and a guide for
      5 what to do if something doesn't work.
      6 
      7 For a more detailed description of the recommended way to build NetBSD
      8 using build.sh, see the BUILDING file.
      9 
     10 Note that much of the advice in this UPDATING file was written before
     11 build.sh existed.  Nevertheless, the advice here may be useful for
     12 working around specific problems with build.sh.
     13 
     14 See also: BUILDING, build.sh, Makefile.
     15 
     16 Recent changes:
     17 ^^^^^^^^^^^^^^^
     18 
     19 20080731:
     20 	WAPBL (metadata journaling support) has been added, but at this
     21 	time isn't backwards compatible with pre-WAPBL aware kernels
     22 	and userland (fsck_ffs in particular).  Please make sure you
     23 	don't use a journaled filesystem with an older kernel/userland,
     24 	especially an uncleanly mounted journaled filesystem.
     25 
     26 20080721:
     27 	Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
     28 	isn't defined.
     29 
     30 20080531:
     31 	The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 
     32 	from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
     33 	utility needs to be rebuilt and reinstalled as older binaries
     34 	won't work correctly. The following sequence of commands:
     35 
     36 	  $ (cd sys/sys/ && nbmake-$arch includes)
     37 	  $ (cd sbin/drvctl/ && nbmake-$arch clean)
     38 	  $ (cd sbin/drvctl/ && nbmake-$arch all)
     39 
     40 	leaves new drvctl utility in sbin/drvctl build directory.
     41 
     42 20080503:
     43 	The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
     44 
     45 20080521:
     46 	For a while, unprivileged UPDATE builds would fail to
     47 	succeed at the checkflist stage, complaining that
     48 	${DESTDIR}/stand/<arch>/ did not exist.  A fix for this
     49 	problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
     50 	If you already hit this problem, update the .mk file,
     51 	remove ${DESTDIR}/stand/<arch>, and re-run the build.
     52 
     53 20080303:
     54 	Linker warnings are now fatal if $WARNS>0.
     55 
     56 20080126:
     57 	The posix_fadvise system call has been changed from an assembly
     58 	stub, to a c file that calls an assembly stub. You need to
     59 	'rm -f posix_fadvise.* .depend' in the libc build directory to
     60 	avoid using the old assembly stub.
     61 
     62 20071209:
     63 	The acpiec(4) driver has been split into two attachments. If you
     64 	get ACPI errors before the attachment, please update your kernel
     65 	configuration file appropriately or see GENERIC for more details.
     66 
     67 20071115:
     68 	The it(4) driver has been renamed to itesio(4) and the old port
     69 	argument specified in the kernel configuration file is not valid
     70 	anymore. The itesio(4) driver now uses the Super I/O address port
     71 	rather than the EC address port. Please update your kernel
     72 	configuration file appropriately or see GENERIC for more details.
     73 
     74 20071028:
     75 	The pccons(4) driver has been removed from the NetBSD/shark port.
     76 	You need to update any custom kernel configuration file you have
     77 	to remove any references to pccons (which includes removing the
     78 	now useless XSERVER option) and replace them with the correct
     79 	entries for the wscons driver.  See the GENERIC configuration file
     80 	for more details.
     81 
     82 20070913:
     83 	A latent bug in dhclient/dhcpd that caused it to be unable to
     84 	enumerate interfaces was fixed.  The bug began to cause
     85 	problems after 20070911 when the kernel's SIOCGIFCONF
     86 	implementation was repaired.  From 20070529 to 20070911 racoon
     87 	could not enumerate interfaces.  (These are noted because
     88 	normal kernel/userspace version matching hygiene is not
     89 	sufficient to avoid this problem.)  Ensure that both kernel
     90 	and userland are from after 20070913.
     91 
     92 20070703:
     93 	nbinstall has been renamed as it calls the target specific and
     94 	the logic to pass down STRIP from mk been removed.  This forces
     95 	a re-installation of tools.
     96 
     97 20070422:
     98 	The way OS emulations lookup filenames inside the emulation root
     99 	has been changed.  Rather than modify the pathname (and copy back
    100 	to userspace) namei() and lookup() directly check the emulation
    101 	root. One side effect is that absolute symlinks inside the emulated
    102 	root file system will be relative to that file system - unless they
    103 	start /../ this is useful when the emulated root is a real install
    104 	that has such links.
    105 	This might affect symlinks that have been added to reference outside
    106 	the emulated root.
    107 
    108 20070412:
    109 	The pckbc driver on sgimips IP32 has been removed. Use macekbc
    110 	instead. See the GENERIC32_IP3x kernel configuration for an
    111 	example.
    112 
    113 20070319:
    114         src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
    115         on many platforms due to incorrect flags settings.  If you
    116         updated and built after about 20070315, do "nbmake-$arch
    117 	cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
    118 	rebuild of object files that might have been built
    119 	incorrectly, and ensure that you have at least
    120 	src/lib/libc/Makefile 1.130.
    121 
    122 20070210: 
    123         src/sys/sys/{sa.h,savar.h} were removed.
    124           find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
    125               | xargs egrep -l '/sa.h|/savar.h' | xargs rm
    126         will allow dependencies on those files to get get rebuilt
    127 
    128 20070209:
    129         The threading model was changed when the newlock2 branch
    130         was merged to NetBSD-current.  If you boot with a new
    131         kernel (version 4.99.10), then you also need a new pthread
    132         library (/usr/lib/libpthread.so.0.7).  If you boot with
    133         an old kernel, then you need the old pthread library
    134         (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
    135         the pthread library in sync, old threaded applications should
    136         continue to work with an old or new kernel.  Note that named(8)
    137 	is the only threaded application in the base system.
    138 
    139 20061214:
    140 	Following the move of string_to_flags() and flags_to_string()
    141 	from the bin/ls/ sources to libutil, users doing UPDATE builds
    142 	will need to do a "make cleandir" in
    143 		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
    144 		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
    145 		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
    146 		as the installation images in distrib/
    147 	in order to excise stale references to the old stat_flags.h header
    148 	file in the ls sources -- stat_flags.h has been removed.
    149 
    150 20061108:
    151 	The configure script used in the src/tools/gcc compiler has been
    152 	changed to indicate that our libc has ssp support built-in and
    153 	does not depend on -lssp and -lssp-nonshared. You'll need to
    154 	make clean in src/tools/gcc first to rebuild the compiler.
    155 
    156 20061009:
    157 	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
    158 	available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
    159 
    160 20060814:
    161 	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
    162 	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
    163 	kernel configuration for an example.  X servers from the last
    164 	few years should cope.
    165 
    166 20060703:
    167 	MPACPI is no more. We always configure PCI interrupts using ACPI
    168 	if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
    169 	to ACPI_SCANPCI. Thanks to work from fvdl.
    170 
    171 20060627:
    172 	socket(2) has changed, and its system call has been versioned.
    173 	For userlands with the old version of socket(2), make sure that
    174 	your kernel has 'options COMPAT_30' set, or else 'bad system call'
    175 	errors will result.
    176 
    177 Hints for a more successful build:
    178 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    179     Use build.sh, but do not use its "expert mode":
    180 	This will automatically build the tools in the
    181 	   correct order, and it will keep the tools and the
    182 	   new build products from interfering with the running
    183 	   system.  This will allow you to ignore most of the
    184 	   other advice in this file.
    185     Build a new kernel first:
    186 	This makes sure that any new system calls or features
    187 	   expected by the new userland will be present.  This
    188 	   helps to avoid critical errors when upgrading.
    189     Use object directories:
    190 	This helps to keep stale object
    191 	   files from polluting the build if a Makefile "forgets"
    192 	   about one.  It also makes it easier to clean up after
    193 	   a build.  It's also necessary if you want to use the
    194 	   same source tree for multiple machines.
    195 	   To use object directories with build.sh:
    196 	    a) invoke build.sh with the "-M" or "-O" options.
    197 	   To use object directories without using build.sh:
    198 	    a) cd /usr/src ; make cleandir
    199 	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
    200 	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
    201 	    d) cd /usr/src ; make build
    202 	   Note that running "make obj" in a directory will create
    203 	   in obj.$MACHINE directory.
    204     Build to a DESTDIR:
    205 	This helps to keep old installed files (especially libraries)
    206 	   from interfering with the new build.
    207 	   To build to a DESTDIR with build.sh, use the "-D" option.
    208 	   To build to a DESTDIR without using build.sh, set the DESTDIR
    209 	   environment variable before running make build.  It should be
    210 	   set to the pathname of an initially empty directory.
    211 	   Problems: if you do not use build.sh, you might need to
    212 		update critical utilities without using DESTDIR since
    213 		nothing is executed from what is installed in DESTDIR.
    214 		(See critical utils, below.)
    215     Build often:
    216 	This keeps critical utilities current enough to not choke
    217 	on any other part of the source tree that depends on up to
    218 	date functionality.  If you use build.sh, you should not have
    219 	this problem.
    220  
    221 What to do if things don't work:
    222 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    223 When things don't work there is usually a few things that commonly
    224 should be done.
    225     1)	make includes
    226 	This should be done automatically by make build.
    227     2)  cd share/mk && make install
    228 	Again, automatically done by make build.
    229 
    230 Failsafe rebuild of a small part of the tree:
    231 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    232 To make sure you rebuild something correctly you want to do
    233 something like the following:
    234     1)  Make sure the includes and .mk files are up to date.
    235     2)  Make sure any program used to build the particular
    236 	utility is up to date.  (yacc, lex, etc...)
    237     3)  cd ...path/to/util...
    238 	make cleandir
    239 	rm ...all obj directories...
    240 	make cleandir			# yes, again
    241 	make obj
    242 	make depend && make
    243 
    244 Failsafe rebuild of the entire tree:
    245 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    246 If you really want to make sure the source tree is clean and
    247 ready for a build try the following.  Note that sourcing /etc/mk.conf
    248 (a make(1) Makefile) in this manner is not right, and will not work
    249 for anyone who uses any make(1) features in /etc/mk.conf.
    250 
    251 ---cut here---
    252 #!/bin/sh
    253 . /etc/mk.conf
    254 
    255 if [ -z $NETBSDSRCDIR ] ; then
    256     NETBSDSRCDIR=/usr/src
    257 fi
    258 if [ \! -d $NETBSDSRCDIR ] ; then
    259     echo Unable to find sources
    260     exit 1
    261 fi
    262 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
    263 
    264 if [ -z $BSDOBJDIR ] ; then
    265     BSDOBJDIR=/usr/obj
    266 fi
    267 if [ -d $BSDOBJDIR ] ; then
    268     rm -rf $BSDOBJDIR
    269 fi
    270 
    271 cd $NETBSDSRCDIR && make cleandir
    272 
    273 ---cut here---
    274 
    275 Critical utilities:
    276 ^^^^^^^^^^^^^^^^^^^
    277 	usr.bin/compile_et
    278 	usr.bin/make
    279 	usr.bin/yacc
    280 	usr.bin/lex
    281 	usr.bin/xlint
    282 	usr.bin/config
    283 
    284 Other problems and possible solutions:
    285 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    286 Symptom:Complaints involving a Makefile.
    287 Fix:	Rebuild usr.bin/make:
    288 	cd usr.bin/make && make && make install
    289 	Or, a failsafe method if that doesn't work:
    290 	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
    291 
    292 Fix:	Make sure .mk files are up to date.
    293 	cd share/mk && make install
    294 
    295 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
    296 Fix:	Rebuild usr.bin/config
    297 
    298 Symptom:
    299 Fix:	Rebuild usr.bin/yacc
    300 
    301 Symptom:
    302 Fix:	Rebuild usr.bin/lex
    303 
    304 Symptom:
    305 Fix:	rm /usr/lib/libbfd.a
    306 
    307 Symptom:Obsolete intermediate files are used during compilation
    308 Fix:	Try the following sequence of commands in the directory in question.
    309 	make cleandir; rm `make print-objdir`; make cleandir; make obj
    310 	(If you built the tree without "make obj" in the past, obsolete files
    311 	may remain.  The command tries to clean everything up)
    312 
    313 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
    314 Fix:	Rebuild and install usr.bin/menuc
    315 
    316 Symptom:mklocale not found during build in share/locale/ctype
    317 Fix:	Build and install usr.bin/mklocale
    318 
    319 Symptom:undefined reference to `__assert13' or `__unsetenv13'
    320 Fix:    Rebuild and install lib/libc
    321 
    322 Symptom:usr.bin/config fails to build.
    323 Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
    324 
    325 Symptom:undefined reference to `getprogname' or `setprogname'
    326 Fix:    Rebuild and install lib/libc
    327 
    328 Symptom:lint does not understand the '-X' option
    329 Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
    330