Home | History | Annotate | Line # | Download | only in src
UPDATING revision 1.177
      1 $NetBSD: UPDATING,v 1.177 2008/08/13 16:37:56 christos Exp $
      2 
      3 This file (UPDATING) is intended to be a brief reference to recent
      4 changes that might cause problems in the build process, and a guide for
      5 what to do if something doesn't work.
      6 
      7 For a more detailed description of the recommended way to build NetBSD
      8 using build.sh, see the BUILDING file.
      9 
     10 Note that much of the advice in this UPDATING file was written before
     11 build.sh existed.  Nevertheless, the advice here may be useful for
     12 working around specific problems with build.sh.
     13 
     14 See also: BUILDING, build.sh, Makefile.
     15 
     16 Recent changes:
     17 ^^^^^^^^^^^^^^^
     18 
     19 20080813:
     20 	MKDEBUG build was broken because the .depend files did not know
     21 	about .go files. You need to remove all .depend files and rebuild.
     22 
     23 20080731:
     24 	WAPBL (metadata journaling support) has been added, but at this
     25 	time isn't backwards compatible with pre-WAPBL aware kernels
     26 	and userland (fsck_ffs in particular).  Please make sure you
     27 	don't use a journaled filesystem with an older kernel/userland,
     28 	especially an uncleanly mounted journaled filesystem.  WAPBL
     29 	also requires the super block to be in the UFS2 format.  You
     30 	can use fsck_ffs -c 4 to update the superblock format.
     31 
     32 20080721:
     33 	Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
     34 	isn't defined.
     35 
     36 20080531:
     37 	The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed 
     38 	from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
     39 	utility needs to be rebuilt and reinstalled as older binaries
     40 	won't work correctly. The following sequence of commands:
     41 
     42 	  $ (cd sys/sys/ && nbmake-$arch includes)
     43 	  $ (cd sbin/drvctl/ && nbmake-$arch clean)
     44 	  $ (cd sbin/drvctl/ && nbmake-$arch all)
     45 
     46 	leaves new drvctl utility in sbin/drvctl build directory.
     47 
     48 20080503:
     49 	The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
     50 
     51 20080521:
     52 	For a while, unprivileged UPDATE builds would fail to
     53 	succeed at the checkflist stage, complaining that
     54 	${DESTDIR}/stand/<arch>/ did not exist.  A fix for this
     55 	problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
     56 	If you already hit this problem, update the .mk file,
     57 	remove ${DESTDIR}/stand/<arch>, and re-run the build.
     58 
     59 20080303:
     60 	Linker warnings are now fatal if $WARNS>0.
     61 
     62 20080126:
     63 	The posix_fadvise system call has been changed from an assembly
     64 	stub, to a c file that calls an assembly stub. You need to
     65 	'rm -f posix_fadvise.* .depend' in the libc build directory to
     66 	avoid using the old assembly stub.
     67 
     68 20071209:
     69 	The acpiec(4) driver has been split into two attachments. If you
     70 	get ACPI errors before the attachment, please update your kernel
     71 	configuration file appropriately or see GENERIC for more details.
     72 
     73 20071115:
     74 	The it(4) driver has been renamed to itesio(4) and the old port
     75 	argument specified in the kernel configuration file is not valid
     76 	anymore. The itesio(4) driver now uses the Super I/O address port
     77 	rather than the EC address port. Please update your kernel
     78 	configuration file appropriately or see GENERIC for more details.
     79 
     80 20071028:
     81 	The pccons(4) driver has been removed from the NetBSD/shark port.
     82 	You need to update any custom kernel configuration file you have
     83 	to remove any references to pccons (which includes removing the
     84 	now useless XSERVER option) and replace them with the correct
     85 	entries for the wscons driver.  See the GENERIC configuration file
     86 	for more details.
     87 
     88 20070913:
     89 	A latent bug in dhclient/dhcpd that caused it to be unable to
     90 	enumerate interfaces was fixed.  The bug began to cause
     91 	problems after 20070911 when the kernel's SIOCGIFCONF
     92 	implementation was repaired.  From 20070529 to 20070911 racoon
     93 	could not enumerate interfaces.  (These are noted because
     94 	normal kernel/userspace version matching hygiene is not
     95 	sufficient to avoid this problem.)  Ensure that both kernel
     96 	and userland are from after 20070913.
     97 
     98 20070703:
     99 	nbinstall has been renamed as it calls the target specific and
    100 	the logic to pass down STRIP from mk been removed.  This forces
    101 	a re-installation of tools.
    102 
    103 20070422:
    104 	The way OS emulations lookup filenames inside the emulation root
    105 	has been changed.  Rather than modify the pathname (and copy back
    106 	to userspace) namei() and lookup() directly check the emulation
    107 	root. One side effect is that absolute symlinks inside the emulated
    108 	root file system will be relative to that file system - unless they
    109 	start /../ this is useful when the emulated root is a real install
    110 	that has such links.
    111 	This might affect symlinks that have been added to reference outside
    112 	the emulated root.
    113 
    114 20070412:
    115 	The pckbc driver on sgimips IP32 has been removed. Use macekbc
    116 	instead. See the GENERIC32_IP3x kernel configuration for an
    117 	example.
    118 
    119 20070319:
    120         src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
    121         on many platforms due to incorrect flags settings.  If you
    122         updated and built after about 20070315, do "nbmake-$arch
    123 	cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
    124 	rebuild of object files that might have been built
    125 	incorrectly, and ensure that you have at least
    126 	src/lib/libc/Makefile 1.130.
    127 
    128 20070210: 
    129         src/sys/sys/{sa.h,savar.h} were removed.
    130           find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
    131               | xargs egrep -l '/sa.h|/savar.h' | xargs rm
    132         will allow dependencies on those files to get get rebuilt
    133 
    134 20070209:
    135         The threading model was changed when the newlock2 branch
    136         was merged to NetBSD-current.  If you boot with a new
    137         kernel (version 4.99.10), then you also need a new pthread
    138         library (/usr/lib/libpthread.so.0.7).  If you boot with
    139         an old kernel, then you need the old pthread library
    140         (/usr/lib/libpthread.so.0.6).  Provided you keep the kernel and
    141         the pthread library in sync, old threaded applications should
    142         continue to work with an old or new kernel.  Note that named(8)
    143 	is the only threaded application in the base system.
    144 
    145 20061214:
    146 	Following the move of string_to_flags() and flags_to_string()
    147 	from the bin/ls/ sources to libutil, users doing UPDATE builds
    148 	will need to do a "make cleandir" in
    149 		tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
    150 		bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
    151 		usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
    152 		as the installation images in distrib/
    153 	in order to excise stale references to the old stat_flags.h header
    154 	file in the ls sources -- stat_flags.h has been removed.
    155 
    156 20061108:
    157 	The configure script used in the src/tools/gcc compiler has been
    158 	changed to indicate that our libc has ssp support built-in and
    159 	does not depend on -lssp and -lssp-nonshared. You'll need to
    160 	make clean in src/tools/gcc first to rebuild the compiler.
    161 
    162 20061009:
    163 	The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
    164 	available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
    165 
    166 20060814:
    167 	The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
    168 	withdrawn.  Use vidcvideo and pckbd instead.  See the GENERIC
    169 	kernel configuration for an example.  X servers from the last
    170 	few years should cope.
    171 
    172 20060703:
    173 	MPACPI is no more. We always configure PCI interrupts using ACPI
    174 	if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
    175 	to ACPI_SCANPCI. Thanks to work from fvdl.
    176 
    177 20060627:
    178 	socket(2) has changed, and its system call has been versioned.
    179 	For userlands with the old version of socket(2), make sure that
    180 	your kernel has 'options COMPAT_30' set, or else 'bad system call'
    181 	errors will result.
    182 
    183 Hints for a more successful build:
    184 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    185     Use build.sh, but do not use its "expert mode":
    186 	This will automatically build the tools in the
    187 	   correct order, and it will keep the tools and the
    188 	   new build products from interfering with the running
    189 	   system.  This will allow you to ignore most of the
    190 	   other advice in this file.
    191     Build a new kernel first:
    192 	This makes sure that any new system calls or features
    193 	   expected by the new userland will be present.  This
    194 	   helps to avoid critical errors when upgrading.
    195     Use object directories:
    196 	This helps to keep stale object
    197 	   files from polluting the build if a Makefile "forgets"
    198 	   about one.  It also makes it easier to clean up after
    199 	   a build.  It's also necessary if you want to use the
    200 	   same source tree for multiple machines.
    201 	   To use object directories with build.sh:
    202 	    a) invoke build.sh with the "-M" or "-O" options.
    203 	   To use object directories without using build.sh:
    204 	    a) cd /usr/src ; make cleandir
    205 	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
    206 	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
    207 	    d) cd /usr/src ; make build
    208 	   Note that running "make obj" in a directory will create
    209 	   in obj.$MACHINE directory.
    210     Build to a DESTDIR:
    211 	This helps to keep old installed files (especially libraries)
    212 	   from interfering with the new build.
    213 	   To build to a DESTDIR with build.sh, use the "-D" option.
    214 	   To build to a DESTDIR without using build.sh, set the DESTDIR
    215 	   environment variable before running make build.  It should be
    216 	   set to the pathname of an initially empty directory.
    217 	   Problems: if you do not use build.sh, you might need to
    218 		update critical utilities without using DESTDIR since
    219 		nothing is executed from what is installed in DESTDIR.
    220 		(See critical utils, below.)
    221     Build often:
    222 	This keeps critical utilities current enough to not choke
    223 	on any other part of the source tree that depends on up to
    224 	date functionality.  If you use build.sh, you should not have
    225 	this problem.
    226  
    227 What to do if things don't work:
    228 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    229 When things don't work there is usually a few things that commonly
    230 should be done.
    231     1)	make includes
    232 	This should be done automatically by make build.
    233     2)  cd share/mk && make install
    234 	Again, automatically done by make build.
    235 
    236 Failsafe rebuild of a small part of the tree:
    237 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    238 To make sure you rebuild something correctly you want to do
    239 something like the following:
    240     1)  Make sure the includes and .mk files are up to date.
    241     2)  Make sure any program used to build the particular
    242 	utility is up to date.  (yacc, lex, etc...)
    243     3)  cd ...path/to/util...
    244 	make cleandir
    245 	rm ...all obj directories...
    246 	make cleandir			# yes, again
    247 	make obj
    248 	make depend && make
    249 
    250 Failsafe rebuild of the entire tree:
    251 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    252 If you really want to make sure the source tree is clean and
    253 ready for a build try the following.  Note that sourcing /etc/mk.conf
    254 (a make(1) Makefile) in this manner is not right, and will not work
    255 for anyone who uses any make(1) features in /etc/mk.conf.
    256 
    257 ---cut here---
    258 #!/bin/sh
    259 . /etc/mk.conf
    260 
    261 if [ -z $NETBSDSRCDIR ] ; then
    262     NETBSDSRCDIR=/usr/src
    263 fi
    264 if [ \! -d $NETBSDSRCDIR ] ; then
    265     echo Unable to find sources
    266     exit 1
    267 fi
    268 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
    269 
    270 if [ -z $BSDOBJDIR ] ; then
    271     BSDOBJDIR=/usr/obj
    272 fi
    273 if [ -d $BSDOBJDIR ] ; then
    274     rm -rf $BSDOBJDIR
    275 fi
    276 
    277 cd $NETBSDSRCDIR && make cleandir
    278 
    279 ---cut here---
    280 
    281 Critical utilities:
    282 ^^^^^^^^^^^^^^^^^^^
    283 	usr.bin/compile_et
    284 	usr.bin/make
    285 	usr.bin/yacc
    286 	usr.bin/lex
    287 	usr.bin/xlint
    288 	usr.bin/config
    289 
    290 Other problems and possible solutions:
    291 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    292 Symptom:Complaints involving a Makefile.
    293 Fix:	Rebuild usr.bin/make:
    294 	cd usr.bin/make && make && make install
    295 	Or, a failsafe method if that doesn't work:
    296 	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
    297 
    298 Fix:	Make sure .mk files are up to date.
    299 	cd share/mk && make install
    300 
    301 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
    302 Fix:	Rebuild usr.bin/config
    303 
    304 Symptom:
    305 Fix:	Rebuild usr.bin/yacc
    306 
    307 Symptom:
    308 Fix:	Rebuild usr.bin/lex
    309 
    310 Symptom:
    311 Fix:	rm /usr/lib/libbfd.a
    312 
    313 Symptom:Obsolete intermediate files are used during compilation
    314 Fix:	Try the following sequence of commands in the directory in question.
    315 	make cleandir; rm `make print-objdir`; make cleandir; make obj
    316 	(If you built the tree without "make obj" in the past, obsolete files
    317 	may remain.  The command tries to clean everything up)
    318 
    319 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
    320 Fix:	Rebuild and install usr.bin/menuc
    321 
    322 Symptom:mklocale not found during build in share/locale/ctype
    323 Fix:	Build and install usr.bin/mklocale
    324 
    325 Symptom:undefined reference to `__assert13' or `__unsetenv13'
    326 Fix:    Rebuild and install lib/libc
    327 
    328 Symptom:usr.bin/config fails to build.
    329 Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
    330 
    331 Symptom:undefined reference to `getprogname' or `setprogname'
    332 Fix:    Rebuild and install lib/libc
    333 
    334 Symptom:lint does not understand the '-X' option
    335 Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
    336