Home | History | Annotate | Line # | Download | only in src
UPDATING revision 1.68
      1 $NetBSD: UPDATING,v 1.68 2002/09/24 14:43:39 lukem Exp $
      2 
      3 This file is intended to be a brief introduction to the build
      4 process and a reference on what to do if something doesn't work.
      5 
      6 For a more detailed description see Makefile.
      7 
      8 Recent changes:
      9 ^^^^^^^^^^^^^^^
     10 
     11 20020922:
     12 	MKDYNAMICROOT=yes enabled by default, which means that
     13 	certain shared libraries are installed into /lib, the shared
     14 	linker is installed into /libexec, and all programs in /bin
     15 	and /sbin are dynamically linked.
     16 	If you do not use "make build", you should ensure that
     17 	you have the libraries and shared linker in the new locations,
     18 	with:
     19 		make do-lib-csu do-lib-libc do-lib do-gnu-lib do-ld.elf_so
     20 
     21 20020917:
     22 	USE_NEW_TOOLCHAIN has been replaced with:
     23 	    -	TOOLCHAIN_MISSING -- set to "yes" on platforms for which
     24 		there is no working in-tree toolchain (hppa, ns32k, sh5,
     25 		x86_64).
     26 	    -	EXTERNAL_TOOLCHAIN -- if defined by the user, points to the
     27 		root ofan external toolchain (e.g. /usr/local/gnu).  This
     28 		enables the cross-build framework even for TOOLCHAIN_MISSING
     29 		platforms.
     30 
     31 20020906:
     32 	gehenna-devsw has been merged into the trunk. Need to update and
     33 	reinstall usr.sbin/config before build the kernel.
     34 
     35 20020822:
     36 	Crunched rescue tools (contents of /bin and /sbin, plus others)
     37 	are now provided in /rescue.
     38 
     39 	To ensure that these are built statically linked (no matter
     40 	what the setting of LDSTATIC is), use a crunchgen(1) built
     41 	from sources newer than 20020820 (see the next entry).
     42 
     43 20020820:
     44 	crunchgen(1) changed to ensure that the generated program
     45 	is statically linked.
     46 
     47 	Solution: update and reinstall usr.bin/crunch
     48 
     49 20020515:
     50 	sshd user/group has been added.  Need to hand add this in, or sshd
     51 	will not let you log in (with default, or UsePrivlegeSeparation=yes)
     52 
     53 	Add the following into /etc/group:
     54 
     55 	sshd:*:16:
     56 
     57 	and the following to /etc/master.passwd (via vipw):
     58 
     59 	sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin
     60 	
     61 	also /var/chroot/sshd directory needs to be present (digged as a part of
     62 	build process).
     63 
     64 20020426:
     65 	NBUILDJOBS obsoleted in favor of just using -j.
     66 
     67 20020426:
     68 	etc/postinstall added, which performs various checks for 
     69 	configuration file updates and changes, and can fix most of
     70 	the problems identified.
     71 	This should make it much easier to upgrade a system's
     72 	configuration from earlier systems (as far back as NetBSD 1.5).
     73 
     74 20020320:
     75 	<bsd.lib.mk> needs a new install(1) for it's "-a cmd" support.
     76 	build and install at usr.bin/xinstall before the build.
     77 
     78 20020319:
     79 	raw IPv6 socket now makes strict checking for sa_family and sa_len
     80 	on send(2) operation.  be sure to have sbin/rtsol and usr.sbin/rtsold
     81 	newer than November 2001 when you upgrade the kernel.
     82 
     83 20020311:
     84 	ssh configuration files were moved from /etc to /etc/ssh.  Beware
     85 	if you restart your machine from remote.  Note that sshd.conf needs
     86 	to be changed (due to the use of "/etc" inside).
     87 
     88 20020223:
     89 	Users of the VAX port will need to rebuild and install gas
     90 	so it deal with the now present register prefix used in all
     91 	the VAX assembly files.
     92 
     93 20020118:
     94 
     95 	ntpd user/group has been added.  Need to hand add this in or builds
     96 	will break as mtree aborts early.
     97 
     98 	Add the following into /etc/group:
     99 
    100 	ntpd:*:15:
    101 
    102 	and the following to /etc/master.passwd (via vipw):
    103 
    104 	ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin
    105 
    106 20011207:
    107 
    108 	If you're attempting to build a snapshot on sparc64 and are getting
    109 	reloc errors from the toolchain groff binary this means your native
    110 	toolchain has some broken C++ bits.
    111 
    112 	To fix:
    113 
    114 	Build a new toolchain (i.e. build.sh -t)
    115 	Use the new toolchain to build and install natively (i.e. /usr/lib)
    116 
    117 	gnu/lib/libgcc
    118 	gnu/lib/libstdc++
    119 
    120 	After this a snapshot will be able to be built.
    121 
    122 20011201:
    123 	In order for a sparc64 build to work you must have a working awk. If
    124 	you've built and installed a system with the new toolchain up to this
    125 	point you do not have a working awk as its ability to do floating
    126 	point is broken. 
    127 
    128 	To build:
    129 
    130 	remake and install gnu/lib/libgcc
    131 	remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links
    132 	against the new libgcc.a)
    133 
    134 20011128:
    135 	Kernel config information was changed to use defflag in
    136 	the various "files" files.  Bug fixes to config(8) are
    137 	required in order for this to work properly.  Make sure
    138 	to build and install in usr.sbin/config before attempting
    139 	to build a new kernel.
    140 
    141 20011030:
    142 	libc/locale/wcstod.c now needs new lint(1). Update lint(1)
    143 	before building libc.
    144 
    145 20011029:
    146 	The new document BUILDING.mdoc (view with nroff | more, or
    147 	see pre-generated .txt and .html versions) describes the build
    148 	procedure in great detail.  BUILDING, and the USE_NEW_TOOLCHAIN
    149 	build process, are intended in the long run to replace this
    150 	manual update log.
    151 
    152 	Users building a USE_NEW_TOOLCHAIN system should read the
    153 	BUILDING document for caveats.  Generally, BUILDING supersedes
    154 	UPDATING for these systems, as tool updating is taken care of
    155 	by the new build system.
    156 
    157 20011028:
    158 	src/etc/Makefile now needs install to be able to handle
    159 	symlinks that point to nowhere. A bug in install that
    160 	prevented this was corrected.
    161 
    162 	Solution: update and reinstall usr.bin/xinstall
    163 	Better Solution: Use the new toolchain and it will just work
    164 	for you.
    165 
    166 20011006:
    167 	/etc/mtree/NetBSD.dist has been updated to take advantage of
    168 	absolute path support added to mtree(8). Older mtree(8)s don't
    169 	understand the format.
    170 
    171 	Solution: update and reinstall usr.sbin/mtree
    172 
    173 20011004:
    174 	Crunchgen has been updated to work via reach-over makefiles. Updating
    175 	is suggested before running a snapshot build
    176 
    177 20010915:
    178 	The new "ubcperf" code committed by Chuck Silvers removed
    179 	a header file, uvm/uvm_vnode.h.  There may be stale .depend
    180 	files that still reference this file.
    181 
    182 	Solution: "make cleandir && make dependall" in affected
    183 	directories.
    184 
    185 20010803:
    186 	grep.info is now built from grep.texi using makeinfo.  Since it
    187 	requires makeinfo v4.0, you need to install new texinfo before
    188 	building gnu/usr.bin/grep.  To install new texinfo, please follow
    189 	the instruction described in 20010726 entry.
    190 
    191 20010803: 
    192 	(i386 only): i386 kernel now uses new instructions like
    193         `fxsave' which old gas doesn't understand.  To build the
    194 	kernel successfully, you need to build and install a new toolchain, 
    195 	(i.e., build.sh -t) or 	(temporarily) comment out "options I686_CPU" 
    196 	from your kernel configuration until you rebuild your userland.
    197 	See 20011029 above and BUILDING file in this directory for more information.
    198 	[updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled]
    199 
    200 20010731:
    201 	Bootloader update on ELF platforms.  DDB in kernels from before
    202 	this will be unable to read symbol tables provided by newer
    203 	bootloaders.
    204 
    205 20010726:
    206 	Texinfo was updated to 4.0.  To avoid failures when trying to
    207 	build the included texinfo files, do:
    208 
    209 	cd src/gnu/usr.bin/texinfo
    210 	make MKINFO=no dependall install
    211 
    212 20010718:
    213 	Enabled correct .init/.fini processing in crt0.  The way this
    214 	was done was to change a -I directive to cc(1), which means
    215 	make(1) will have a stale dependency (it will be checking the
    216 	timestamp on the wrong "dot_init.h").
    217 
    218 	The symptom you will see is that new programs die with SIGSEGV
    219 	if you have a stale dependency.
    220 
    221 	Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so
    222 	before starting your build.
    223 
    224 20010628:
    225 	A construct was added to uvm_page.h that uncovered a bug
    226 	in lint(1).  If you get a warning/error about a non-portable
    227 	bitfield, update your lint(1) before proceeding.
    228 
    229 20010226:
    230 	Added named user/group to system. Need to hand add this in or builds
    231 	will break as mtree aborts early.
    232 
    233 	To work around add by hand:
    234 
    235 	named:*:14:
    236 
    237 	to /etc/group and add:
    238 
    239 	named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin
    240 
    241 	to master.passwd (use vipw for instance if doing by hand).
    242 
    243 	Now a make build should progress.
    244 
    245 20010219:
    246 	get/setprogname() added. Any hostprogs that may use this will need
    247         to be bootstrapped manually until the host system is current.
    248 
    249         Known problems: sys/arch/macppc/stand/fixcoff
    250 			usr.sbin/config (adding -DMAKE_BOOTSTRAP to
    251 			  CFLAGS and rebuilding should work)
    252 			usr.sbin/mdsetimage - Build a static copy if
    253   		          building a snapshot before fully bootstrapped.
    254 
    255 20010204:
    256 	prepare the code to compile with stricter gcc flags. in
    257 	particular start eliminating redundant declarations. Yacc
    258 	needs to be installed before make build.
    259 
    260 20010114:
    261 	introduce .if commands(target) in make(1). You need to
    262 	bring everything up-to-date first, then without installing
    263 	anything make and install in usr.bin/make, then proceed
    264 	with make build.
    265 
    266 20010101:
    267 	bsd.subdir.mk committed 20001230 had a bug which caused
    268 	afterinstall targets to run too soon; update again.
    269 
    270 20001230:
    271 	New share/mk files needed to support .WAIT in SUBDIR variables.
    272 	If you get make errors, 
    273 		(cd share/mk; make install)
    274 	Also, PRINTOBJDIR has changed and is now used more heavily.
    275 
    276 20001019:
    277 	The `ca' device driver has been replaced by `ld'; although the
    278 	major and minor numbers haven't changed, you should update your /dev
    279 	directory.
    280 
    281 20000929:
    282 	The following make directives are obsoleted.
    283 	MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA 
    284 	By default, RSA is built into libcrypto.  IDEA and RC5 will not be
    285 	built into libcrypto.  By using MKCRYPTO_{RC5,IDEA}, you can build
    286 	additional library libcrypto_{idea,rc5}.
    287 
    288 
    289 Hints for a more successful build:
    290 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    291     Build a new kernel first:
    292 	This makes sure that any new system calls or features
    293 	   expected by the new userland will be present.  This
    294 	   helps to avoid critical errors when upgrading.
    295     Use object directories:
    296 	This helps to keep stale object
    297 	   files from polluting the build if a Makefile "forgets"
    298 	   about one.  It also makes it easier to clean up after
    299 	   a build.  It's also necessary if you want to use the
    300 	   same source tree for multiple machines.
    301 	   To use object directories:
    302 	    a) cd /usr/src ; make cleandir
    303 	    b) Add "OBJMACHINE=yes" to /etc/mk.conf
    304 	    c) Add "MKOBJDIRS=yes" to /etc/mk.conf
    305 	    d) cd /usr/src ; make build
    306 	   Note that running "make obj" in a directory will create
    307 	   in obj.$MACHINE directory.
    308     Build to a DESTDIR:
    309 	This helps to keep old
    310 	   installed files (especially libraries) from interfering
    311 	   with the new build.
    312 	   To build to a DESTDIR, set the DESTDIR environment
    313 	   variable before running make build.  It should be set to
    314 	   the pathname of an initially empty directory.
    315 	   Problems: you might need to update critical utilities
    316 		without using DESTDIR since nothing is executed
    317 		from what is installed in DESTDIR.
    318 		(See critical utils, below)
    319     Build often:
    320 	This keeps critical utilities current enough to not choke
    321 	on any other part of the source tree that depends on up to
    322 	date functionality.
    323  
    324 What to do if things don't work:
    325 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    326 When things don't work there is usually a few things that commonly
    327 should be done.
    328     1)	make includes
    329 	This should be done automatically by make build.
    330     2)  cd share/mk && make install
    331 	Again, automatically done by make build.
    332 
    333 Failsafe rebuild of a small part of the tree:
    334 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    335 To make sure you rebuild something correctly you want to do
    336 something like the following:
    337     1)  Make sure the includes and .mk files are up to date.
    338     2)  Make sure any program used to build the particular
    339 	utility is up to date.  (yacc, lex, etc...)
    340     3)  cd ...path/to/util...
    341 	make cleandir
    342 	rm ...all obj directories...
    343 	make cleandir			# yes, again
    344 	make obj
    345 	make depend && make
    346 
    347 Failsafe rebuild of the entire tree:
    348 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    349 If you really want to make sure the source tree is clean and
    350 ready for a build try the following.  Note that sourcing /etc/mk.conf
    351 (a make(1) Makefile) in this manner is not right, and will not work
    352 for anyone who uses any make(1) features in /etc/mk.conf.
    353 
    354 ---cut here---
    355 #!/bin/sh
    356 . /etc/mk.conf
    357 
    358 if [ -z $NETBSDSRCDIR ] ; then
    359     NETBSDSRCDIR=/usr/src
    360 fi
    361 if [ \! -d $NETBSDSRCDIR ] ; then
    362     echo Unable to find sources
    363     exit 1
    364 fi
    365 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
    366 
    367 if [ -z $BSDOBJDIR ] ; then
    368     BSDOBJDIR=/usr/obj
    369 fi
    370 if [ -d $BSDOBJDIR ] ; then
    371     rm -rf $BSDOBJDIR
    372 fi
    373 
    374 cd $NETBSDSRCDIR && make cleandir
    375 
    376 ---cut here---
    377 
    378 Critical utilities:
    379 ^^^^^^^^^^^^^^^^^^^
    380 	gnu/usr.bin/egcs
    381 	usr.bin/compile_et
    382 	usr.bin/make
    383 	usr.bin/yacc
    384 	usr.bin/lex
    385 	usr.bin/xlint
    386 	usr.sbin/config
    387 
    388 Other problems and possible solutions:
    389 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    390 Symptom:Unreasonable compiler errors.
    391 Fix:	Rebuild gnu/usr.bin/egcs
    392 
    393 Symptom:Complaints involving a Makefile.
    394 Fix:	Rebuild usr.bin/make:
    395 	cd usr.bin/make && make && make install
    396         Or, a failsafe method if that doesn't work:
    397 	cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
    398 
    399 Fix:	Make sure .mk files are up to date.
    400 	cd share/mk && make install
    401 
    402 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
    403 Fix:	Rebuild usr.sbin/config
    404 
    405 Symptom:
    406 Fix:	Rebuild usr.bin/yacc
    407 
    408 Symptom:
    409 Fix:	Rebuild usr.bin/lex
    410 
    411 Symptom:
    412 Fix:	rm /usr/lib/libbfd.a
    413 
    414 Symptom:Obsolete intermediate files are used during compilation
    415 Fix:	Try the following sequence of commands in the directory in question.
    416 	make cleandir; rm `make print-objdir`; make cleandir; make obj
    417 	(If you built the tree without "make obj" in the past, obsolete files
    418 	may remain.  The command tries to clean everything up)
    419 
    420 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
    421 Fix:	Rebuild and install usr.bin/menuc
    422 
    423 Symptom:mklocale not found during build in share/locale/ctype
    424 Fix:	Build and install usr.bin/mklocale
    425 
    426 Symptom:undefined reference to `__assert13'
    427 Fix:    Rebuild and install lib/libc
    428 
    429 Symptom:usr.sbin/config fails to build.
    430 Fix:	Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
    431 
    432 Symptom:undefined reference to `getprogname' or `setprogname'
    433 Fix:    Rebuild and install lib/libc
    434 
    435 Symptom:lint does not understand the '-X' option
    436 Fix:    May need to build & install libs with NOLINT=1 before rebuilding lint
    437