UPDATING revision 1.64 1 $NetBSD: UPDATING,v 1.64 2002/07/01 02:12:11 sommerfeld Exp $
2
3 This file is intended to be a brief introduction to the build
4 process and a reference on what to do if something doesn't work.
5
6 For a more detailed description see Makefile.
7
8 Recent changes:
9 ^^^^^^^^^^^^^^^
10
11 20020515:
12 sshd user/group has been added. Need to hand add this in, or sshd
13 will not let you log in (with default, or UsePrivlegeSeparation=yes)
14
15 Add the following into /etc/group:
16
17 sshd:*:16:
18
19 and the following to /etc/master.passwd (via vipw):
20
21 sshd:*:16:16::0:0:& pseudo-user:/var/chroot/sshd:/sbin/nologin
22
23 also /var/chroot/sshd directory needs to be present (digged as a part of
24 build process).
25
26 20020426:
27 NBUILDJOBS obsoleted in favor of just using -j.
28
29 20020426:
30 etc/postinstall added, which performs various checks for
31 configuration file updates and changes, and can fix most of
32 the problems identified.
33 This should make it much easier to upgrade a system's
34 configuration from earlier systems (as far back as NetBSD 1.5).
35
36 20020320:
37 <bsd.lib.mk> needs a new install(1) for it's "-a cmd" support.
38 build and install at usr.bin/xinstall before the build.
39
40 20020319:
41 raw IPv6 socket now makes strict checking for sa_family and sa_len
42 on send(2) operation. be sure to have sbin/rtsol and usr.sbin/rtsold
43 newer than November 2001 when you upgrade the kernel.
44
45 20020311:
46 ssh configuration files were moved from /etc to /etc/ssh. Beware
47 if you restart your machine from remote. Note that sshd.conf needs
48 to be changed (due to the use of "/etc" inside).
49
50 20020223:
51 Users of the VAX port will need to rebuild and install gas
52 so it deal with the now present register prefix used in all
53 the VAX assembly files.
54
55 20020118:
56
57 ntpd user/group has been added. Need to hand add this in or builds
58 will break as mtree aborts early.
59
60 Add the following into /etc/group:
61
62 ntpd:*:15:
63
64 and the following to /etc/master.passwd (via vipw):
65
66 ntpd:*:15:15::0:0:Ntpd pseudo-user:/var/chroot/ntpd:/sbin/nologin
67
68 20011207:
69
70 If you're attempting to build a snapshot on sparc64 and are getting
71 reloc errors from the toolchain groff binary this means your native
72 toolchain has some broken C++ bits.
73
74 To fix:
75
76 Build a new toolchain (i.e. build.sh -t)
77 Use the new toolchain to build and install natively (i.e. /usr/lib)
78
79 gnu/lib/libgcc
80 gnu/lib/libstdc++
81
82 After this a snapshot will be able to be built.
83
84 20011201:
85 In order for a sparc64 build to work you must have a working awk. If
86 you've built and installed a system with the new toolchain up to this
87 point you do not have a working awk as its ability to do floating
88 point is broken.
89
90 To build:
91
92 remake and install gnu/lib/libgcc
93 remake and install gnu/usr.bin/gawk into /usr/bin (make sure it links
94 against the new libgcc.a)
95
96 20011128:
97 Kernel config information was changed to use defflag in
98 the various "files" files. Bug fixes to config(8) are
99 required in order for this to work properly. Make sure
100 to build and install in usr.sbin/config before attempting
101 to build a new kernel.
102
103 20011030:
104 libc/locale/wcstod.c now needs new lint(1). Update lint(1)
105 before building libc.
106
107 20011029:
108 The new document BUILDING.mdoc (view with nroff | more, or
109 see pre-generated .txt and .html versions) describes the build
110 procedure in great detail. BUILDING, and the USE_NEW_TOOLCHAIN
111 build process, are intended in the long run to replace this
112 manual update log.
113
114 Users building a USE_NEW_TOOLCHAIN system should read the
115 BUILDING document for caveats. Generally, BUILDING supersedes
116 UPDATING for these systems, as tool updating is taken care of
117 by the new build system.
118
119 20011028:
120 src/etc/Makefile now needs install to be able to handle
121 symlinks that point to nowhere. A bug in install that
122 prevented this was corrected.
123
124 Solution: update and reinstall usr.bin/xinstall
125 Better Solution: Use the new toolchain and it will just work
126 for you.
127
128 20011006:
129 /etc/mtree/NetBSD.dist has been updated to take advantage of
130 absolute path support added to mtree(8). Older mtree(8)s don't
131 understand the format.
132
133 Solution: update and reinstall usr.sbin/mtree
134
135 20011004:
136 Crunchgen has been updated to work via reach-over makefiles. Updating
137 is suggested before running a snapshot build
138
139 20010915:
140 The new "ubcperf" code committed by Chuck Silvers removed
141 a header file, uvm/uvm_vnode.h. There may be stale .depend
142 files that still reference this file.
143
144 Solution: "make cleandir && make dependall" in affected
145 directories.
146
147 20010803:
148 grep.info is now built from grep.texi using makeinfo. Since it
149 requires makeinfo v4.0, you need to install new texinfo before
150 building gnu/usr.bin/grep. To install new texinfo, please follow
151 the instruction described in 20010726 entry.
152
153 20010803:
154 (i386 only): i386 kernel now uses new instructions like
155 `fxsave' which old gas doesn't understand. To build the
156 kernel successfully, you need to build and install a new toolchain,
157 (i.e., build.sh -t) or (temporarily) comment out "options I686_CPU"
158 from your kernel configuration until you rebuild your userland.
159 See 20011029 above and BUILDING file in this directory for more information.
160 [updated 20020630 since i386 gas moved when USE_NEW_TOOLCHAIN enabled]
161
162 20010731:
163 Bootloader update on ELF platforms. DDB in kernels from before
164 this will be unable to read symbol tables provided by newer
165 bootloaders.
166
167 20010726:
168 Texinfo was updated to 4.0. To avoid failures when trying to
169 build the included texinfo files, do:
170
171 cd src/gnu/usr.bin/texinfo
172 make MKINFO=no dependall install
173
174 20010718:
175 Enabled correct .init/.fini processing in crt0. The way this
176 was done was to change a -I directive to cc(1), which means
177 make(1) will have a stale dependency (it will be checking the
178 timestamp on the wrong "dot_init.h").
179
180 The symptom you will see is that new programs die with SIGSEGV
181 if you have a stale dependency.
182
183 Solution: "make cleandir" in both lib/csu and libexec/ld.elf_so
184 before starting your build.
185
186 20010628:
187 A construct was added to uvm_page.h that uncovered a bug
188 in lint(1). If you get a warning/error about a non-portable
189 bitfield, update your lint(1) before proceeding.
190
191 20010226:
192 Added named user/group to system. Need to hand add this in or builds
193 will break as mtree aborts early.
194
195 To work around add by hand:
196
197 named:*:14:
198
199 to /etc/group and add:
200
201 named:*:14:14::0:0:Named pseudo-user:/var/named:/sbin/nologin
202
203 to master.passwd (use vipw for instance if doing by hand).
204
205 Now a make build should progress.
206
207 20010219:
208 get/setprogname() added. Any hostprogs that may use this will need
209 to be bootstrapped manually until the host system is current.
210
211 Known problems: sys/arch/macppc/stand/fixcoff
212 usr.sbin/config (adding -DMAKE_BOOTSTRAP to
213 CFLAGS and rebuilding should work)
214 usr.sbin/mdsetimage - Build a static copy if
215 building a snapshot before fully bootstrapped.
216
217 20010204:
218 prepare the code to compile with stricter gcc flags. in
219 particular start eliminating redundant declarations. Yacc
220 needs to be installed before make build.
221
222 20010114:
223 introduce .if commands(target) in make(1). You need to
224 bring everything up-to-date first, then without installing
225 anything make and install in usr.bin/make, then proceed
226 with make build.
227
228 20010101:
229 bsd.subdir.mk committed 20001230 had a bug which caused
230 afterinstall targets to run too soon; update again.
231
232 20001230:
233 New share/mk files needed to support .WAIT in SUBDIR variables.
234 If you get make errors,
235 (cd share/mk; make install)
236 Also, PRINTOBJDIR has changed and is now used more heavily.
237
238 20001019:
239 The `ca' device driver has been replaced by `ld'; although the
240 major and minor numbers haven't changed, you should update your /dev
241 directory.
242
243 20000929:
244 The following make directives are obsoleted.
245 MKCRYPTO_RSA NOCRYPTO_RSA NOCRYPTO_RC5 NOCRYPTO_IDEA
246 By default, RSA is built into libcrypto. IDEA and RC5 will not be
247 built into libcrypto. By using MKCRYPTO_{RC5,IDEA}, you can build
248 additional library libcrypto_{idea,rc5}.
249
250
251 Hints for a more successful build:
252 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
253 Build a new kernel first:
254 This makes sure that any new system calls or features
255 expected by the new userland will be present. This
256 helps to avoid critical errors when upgrading.
257 Use object directories:
258 This helps to keep stale object
259 files from polluting the build if a Makefile "forgets"
260 about one. It also makes it easier to clean up after
261 a build. It's also necessary if you want to use the
262 same source tree for multiple machines.
263 To use object directories:
264 a) cd /usr/src ; make cleandir
265 b) Add "OBJMACHINE=yes" to /etc/mk.conf
266 c) Add "MKOBJDIRS=yes" to /etc/mk.conf
267 d) cd /usr/src ; make build
268 Note that running "make obj" in a directory will create
269 in obj.$MACHINE directory.
270 Build to a DESTDIR:
271 This helps to keep old
272 installed files (especially libraries) from interfering
273 with the new build.
274 To build to a DESTDIR, set the DESTDIR environment
275 variable before running make build. It should be set to
276 the pathname of an initially empty directory.
277 Problems: you might need to update critical utilities
278 without using DESTDIR since nothing is executed
279 from what is installed in DESTDIR.
280 (See critical utils, below)
281 Build often:
282 This keeps critical utilities current enough to not choke
283 on any other part of the source tree that depends on up to
284 date functionality.
285
286 What to do if things don't work:
287 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
288 When things don't work there is usually a few things that commonly
289 should be done.
290 1) make includes
291 This should be done automatically by make build.
292 2) cd share/mk && make install
293 Again, automatically done by make build.
294
295 Failsafe rebuild of a small part of the tree:
296 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
297 To make sure you rebuild something correctly you want to do
298 something like the following:
299 1) Make sure the includes and .mk files are up to date.
300 2) Make sure any program used to build the particular
301 utility is up to date. (yacc, lex, etc...)
302 3) cd ...path/to/util...
303 make cleandir
304 rm ...all obj directories...
305 make cleandir # yes, again
306 make obj
307 make depend && make
308
309 Failsafe rebuild of the entire tree:
310 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
311 If you really want to make sure the source tree is clean and
312 ready for a build try the following. Note that sourcing /etc/mk.conf
313 (a make(1) Makefile) in this manner is not right, and will not work
314 for anyone who uses any make(1) features in /etc/mk.conf.
315
316 ---cut here---
317 #!/bin/sh
318 . /etc/mk.conf
319
320 if [ -z $NETBSDSRCDIR ] ; then
321 NETBSDSRCDIR=/usr/src
322 fi
323 if [ \! -d $NETBSDSRCDIR ] ; then
324 echo Unable to find sources
325 exit 1
326 fi
327 find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
328
329 if [ -z $BSDOBJDIR ] ; then
330 BSDOBJDIR=/usr/obj
331 fi
332 if [ -d $BSDOBJDIR ] ; then
333 rm -rf $BSDOBJDIR
334 fi
335
336 cd $NETBSDSRCDIR && make cleandir
337
338 ---cut here---
339
340 Critical utilities:
341 ^^^^^^^^^^^^^^^^^^^
342 gnu/usr.bin/egcs
343 usr.bin/compile_et
344 usr.bin/make
345 usr.bin/yacc
346 usr.bin/lex
347 usr.bin/xlint
348 usr.sbin/config
349
350 Other problems and possible solutions:
351 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
352 Symptom:Unreasonable compiler errors.
353 Fix: Rebuild gnu/usr.bin/egcs
354
355 Symptom:Complaints involving a Makefile.
356 Fix: Rebuild usr.bin/make:
357 cd usr.bin/make && make && make install
358 Or, a failsafe method if that doesn't work:
359 cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
360
361 Fix: Make sure .mk files are up to date.
362 cd share/mk && make install
363
364 Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
365 Fix: Rebuild usr.sbin/config
366
367 Symptom:
368 Fix: Rebuild usr.bin/yacc
369
370 Symptom:
371 Fix: Rebuild usr.bin/lex
372
373 Symptom:
374 Fix: rm /usr/lib/libbfd.a
375
376 Symptom:Obsolete intermediate files are used during compilation
377 Fix: Try the following sequence of commands in the directory in question.
378 make cleandir; rm `make print-objdir`; make cleandir; make obj
379 (If you built the tree without "make obj" in the past, obsolete files
380 may remain. The command tries to clean everything up)
381
382 Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
383 Fix: Rebuild and install usr.bin/menuc
384
385 Symptom:mklocale not found during build in share/locale/ctype
386 Fix: Build and install usr.bin/mklocale
387
388 Symptom:undefined reference to `__assert13'
389 Fix: Rebuild and install lib/libc
390
391 Symptom:usr.sbin/config fails to build.
392 Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
393
394 Symptom:undefined reference to `getprogname' or `setprogname'
395 Fix: Rebuild and install lib/libc
396
397 Symptom:lint does not understand the '-X' option
398 Fix: May need to build & install libs with NOLINT=1 before rebuilding lint
399