BUILDING revision 1.68 1 1.1 tv BUILDING(8) NetBSD System Manager's Manual BUILDING(8)
2 1.1 tv
3 1.1 tv NAME
4 1.52 jmc BUILDING -- Procedure for building NetBSD from source code.
5 1.1 tv
6 1.1 tv REQUIREMENTS
7 1.1 tv NetBSD is designed to be buildable on most POSIX-compliant host systems.
8 1.1 tv The basic build procedure is the same whether compiling natively (on the
9 1.1 tv same NetBSD architecture) or cross compiling (on another architecture or
10 1.1 tv OS).
11 1.1 tv
12 1.1 tv This source tree contains a special subtree, ``tools'', which uses the
13 1.1 tv host system to create a build toolchain for the target architecture. The
14 1.1 tv host system must have at least C and C++ compilers in order to create the
15 1.1 tv toolchain (make is not required); all other tools are created as part of
16 1.53 reed the NetBSD build process. (See the environment variables section below
17 1.53 reed if you need to override or manually select your compilers.)
18 1.1 tv
19 1.1 tv FILES
20 1.1 tv Source tree layout
21 1.17 wiz doc/BUILDING.mdoc
22 1.17 wiz This document (in -mdoc troff format; the original copy).
23 1.1 tv
24 1.2 wiz BUILDING This document (in plaintext).
25 1.1 tv
26 1.48 jmc tools/compat/README
27 1.48 jmc Special notes for cross-hosting a NetBSD build on non-
28 1.48 jmc NetBSD platforms.
29 1.48 jmc
30 1.44 lukem Makefile The main Makefile for NetBSD; should only be run for
31 1.44 lukem native builds with an appropriately up-to-date version of
32 1.1 tv NetBSD make(1). (For building from out-of-date systems or
33 1.1 tv on a non-native host, see the build.sh shell script.)
34 1.1 tv
35 1.1 tv UPDATING Special notes for updating from an earlier revision of
36 1.1 tv NetBSD. It is important to read this file before every
37 1.1 tv build of an updated source tree.
38 1.1 tv
39 1.1 tv build.sh Bourne-compatible shell script used for building the host
40 1.1 tv build tools and the NetBSD system from scratch. Can be
41 1.1 tv used for both native and cross builds, and should be used
42 1.1 tv instead of make(1) for any source tree that is updated and
43 1.1 tv recompiled regularly.
44 1.1 tv
45 1.1 tv crypto/dist/, dist/, gnu/dist/
46 1.1 tv Sources imported verbatim from third parties, without man-
47 1.1 tv gling the existing build structure. Other source trees in
48 1.1 tv bin through usr.sbin use the NetBSD make(1) ``reachover''
49 1.44 lukem Makefile semantics when building these programs for a
50 1.44 lukem native host.
51 1.1 tv
52 1.1 tv distrib/, etc/
53 1.1 tv Sources for items used when making a full release snap-
54 1.27 lukem shot, such as files installed in DESTDIR/etc on the desti-
55 1.27 lukem nation system, boot media, and release notes.
56 1.1 tv
57 1.1 tv regress/ Regression test harness. Can be cross-compiled, but only
58 1.1 tv run natively.
59 1.1 tv
60 1.1 tv sys/ NetBSD kernel sources.
61 1.1 tv
62 1.1 tv tools/ ``Reachover'' build structure for the host build tools.
63 1.1 tv This has a special method of determining out-of-date sta-
64 1.1 tv tus.
65 1.1 tv
66 1.1 tv bin/ ... usr.sbin/
67 1.1 tv Sources to the NetBSD userland (non-kernel) programs. If
68 1.1 tv any of these directories are missing, they will be skipped
69 1.1 tv during the build.
70 1.1 tv
71 1.49 lukem x11/ ``Reachover'' build structure for X11R6; the source is in
72 1.49 lukem X11SRCDIR.
73 1.49 lukem
74 1.1 tv Build tree layout
75 1.1 tv The NetBSD build tree is described in hier(7), and the release layout is
76 1.1 tv described in release(7).
77 1.1 tv
78 1.1 tv CONFIGURATION
79 1.8 lukem Environment variables
80 1.8 lukem Several environment variables control the behaviour of NetBSD builds.
81 1.8 lukem
82 1.58 apb HOST_SH Path name to a POSIX-compliant shell. If this is not
83 1.58 apb set explicitly, then the default is set using heuris-
84 1.58 apb tics dependent on the host platform, or from the shell
85 1.58 apb under which build.sh is executed (if that can be deter-
86 1.58 apb mined), or using the first copy of sh found in PATH.
87 1.58 apb If the host system's /bin/sh is not POSIX-compliant, we
88 1.58 apb suggest that you build using commands like
89 1.58 apb
90 1.58 apb HOST_SH=/path/to/working/shell
91 1.58 apb export HOST_SH
92 1.58 apb ${HOST_SH} build.sh [options]
93 1.58 apb
94 1.53 reed HOST_CC Path name to C compiler used to create the toolchain.
95 1.53 reed
96 1.53 reed HOST_CXX Path name to C++ compiler used to create the toolchain.
97 1.53 reed
98 1.8 lukem MACHINE Machine type.
99 1.8 lukem
100 1.8 lukem MACHINE_ARCH Machine architecture.
101 1.8 lukem
102 1.8 lukem MAKE Path name to invoke make(1) as.
103 1.8 lukem
104 1.8 lukem MAKEFLAGS Flags to invoke make(1) with.
105 1.8 lukem
106 1.8 lukem MAKEOBJDIR Directory to use as the .OBJDIR for the current direc-
107 1.59 apb tory. The value is subjected to variable expansion by
108 1.59 apb make(1). Used only if MAKEOBJDIRPREFIX is not defined.
109 1.36 lukem MAKEOBJDIR can only be provided in the environment or
110 1.41 lukem via the -O flag of build.sh.
111 1.8 lukem
112 1.8 lukem MAKEOBJDIRPREFIX Top level directory of the object directory tree. If
113 1.59 apb specified, must be an absolute path. If this is
114 1.59 apb defined, ${MAKEOBJDIRPREFIX}/${.CURDIR} is used as the
115 1.59 apb .OBJDIR for the current directory. The current direc-
116 1.59 apb tory may be read only. MAKEOBJDIRPREFIX can only be
117 1.59 apb provided in the environment or via the -M flag of
118 1.36 lukem build.sh.
119 1.8 lukem
120 1.1 tv "make" variables
121 1.1 tv Several variables control the behavior of NetBSD builds. Unless other-
122 1.1 tv wise specified, these variables may be set in either the process environ-
123 1.1 tv ment or the make(1) configuration file specified by MAKECONF.
124 1.1 tv
125 1.9 thorpej BUILDID Identifier for the build. The identifier will be appended to
126 1.9 thorpej object directory names, and can be consulted in the make(1)
127 1.9 thorpej configuration file in order to set additional build parame-
128 1.9 thorpej ters, such as compiler flags.
129 1.9 thorpej
130 1.1 tv DESTDIR Directory to contain the built NetBSD system. If set, spe-
131 1.1 tv cial options are passed to the compilation tools to prevent
132 1.1 tv their default use of the host system's /usr/include,
133 1.59 apb /usr/lib, and so forth. This pathname must be an absolute
134 1.59 apb path, and should not end with a slash (/) character. (For
135 1.59 apb installation into the system's root directory, set DESTDIR to
136 1.59 apb an empty string, not to ``/''). The directory must reside on
137 1.59 apb a file system which supports long file names and hard links.
138 1.1 tv
139 1.1 tv Default: Empty string if USETOOLS is ``yes''; unset other-
140 1.1 tv wise.
141 1.1 tv
142 1.30 lukem Note: build.sh will provide a default of destdir.MACHINE (in
143 1.30 lukem the top-level .OBJDIR) unless run in `expert' mode
144 1.30 lukem
145 1.1 tv MAKECONF The name of the make(1) configuration file. Only settable in
146 1.1 tv the process environment.
147 1.1 tv
148 1.1 tv Default: ``/etc/mk.conf''
149 1.1 tv
150 1.45 lukem MAKEVERBOSE
151 1.45 lukem Level of verbosity of status messages. Supported values:
152 1.45 lukem
153 1.45 lukem 0 No descriptive messages are shown.
154 1.45 lukem
155 1.45 lukem 1 Descriptive messages are shown.
156 1.45 lukem
157 1.45 lukem 2 Descriptive messages (prefixed with a `#') and command
158 1.45 lukem output is not suppressed.
159 1.45 lukem
160 1.45 lukem Default: 2
161 1.45 lukem
162 1.1 tv MKCATPAGES Can be set to ``yes'' or ``no''. Indicates whether prefor-
163 1.1 tv matted plaintext manual pages will be created during a build.
164 1.1 tv
165 1.1 tv Default: ``yes''
166 1.1 tv
167 1.1 tv MKCRYPTO Can be set to ``yes'' or ``no''. Indicates whether crypto-
168 1.1 tv graphic code will be included in a build; provided for the
169 1.1 tv benefit of countries that do not allow strong cryptography.
170 1.44 lukem Will not affect use of the standard low-security password
171 1.44 lukem encryption system, crypt(3).
172 1.1 tv
173 1.1 tv Default: ``yes''
174 1.1 tv
175 1.1 tv MKDOC Can be set to ``yes'' or ``no''. Indicates whether system
176 1.44 lukem documentation destined for DESTDIR/usr/share/doc will be
177 1.44 lukem installed during a build.
178 1.1 tv
179 1.1 tv Default: ``yes''
180 1.1 tv
181 1.4 tv MKHOSTOBJ Can be set to ``yes'' or ``no''. If set to ``yes'', then for
182 1.4 tv programs intended to be run on the compile host, the name,
183 1.4 tv release, and architecture of the host operating system will
184 1.4 tv be suffixed to the name of the object directory created by
185 1.4 tv ``make obj''. (This allows multiple host systems to compile
186 1.4 tv NetBSD for a single target.) If set to ``no'', then programs
187 1.4 tv built to be run on the compile host will use the same object
188 1.4 tv directory names as programs built to be run on the target.
189 1.4 tv
190 1.4 tv Default: ``no''
191 1.4 tv
192 1.1 tv MKINFO Can be set to ``yes'' or ``no''. Indicates whether GNU Info
193 1.1 tv files, used for the documentation for most of the compilation
194 1.1 tv tools, will be created and installed during a build.
195 1.1 tv
196 1.1 tv Default: ``yes''
197 1.1 tv
198 1.1 tv MKLINT Can be set to ``yes'' or ``no''. Indicates whether lint(1)
199 1.1 tv will be run against portions of the NetBSD source code during
200 1.1 tv the build, and whether lint libraries will be installed into
201 1.27 lukem DESTDIR/usr/libdata/lint.
202 1.1 tv
203 1.1 tv Default: ``yes''
204 1.1 tv
205 1.1 tv MKMAN Can be set to ``yes'' or ``no''. Indicates whether manual
206 1.1 tv pages will be installed during a build.
207 1.1 tv
208 1.1 tv Default: ``yes''
209 1.1 tv
210 1.1 tv MKNLS Can be set to ``yes'' or ``no''. Indicates whether Native
211 1.44 lukem Language System locale zone files will be compiled and
212 1.44 lukem installed during a build.
213 1.1 tv
214 1.1 tv Default: ``yes''
215 1.1 tv
216 1.1 tv MKOBJ Can be set to ``yes'' or ``no''. Indicates whether object
217 1.1 tv directories will be created when running ``make obj''. If
218 1.1 tv set to ``no'', then all built files will be located inside
219 1.1 tv the regular source tree.
220 1.1 tv
221 1.1 tv Default: ``yes''
222 1.1 tv
223 1.1 tv MKPIC Can be set to ``yes'' or ``no''. Indicates whether shared
224 1.1 tv objects and libraries will be created and installed during a
225 1.1 tv build. If set to ``no'', the entire built system will be
226 1.1 tv statically linked.
227 1.1 tv
228 1.1 tv Default: Platform dependent. As of this writing, all plat-
229 1.1 tv forms except sh3 default to ``yes''.
230 1.1 tv
231 1.1 tv MKPICINSTALL
232 1.1 tv Can be set to ``yes'' or ``no''. Indicates whether the ar(1)
233 1.44 lukem format libraries (lib*_pic.a), used to generate shared
234 1.44 lukem libraries, are installed during a build.
235 1.1 tv
236 1.1 tv Default: ``yes''
237 1.1 tv
238 1.1 tv MKPROFILE Can be set to ``yes'' or ``no''. Indicates whether profiled
239 1.1 tv libraries (lib*_p.a) will be built and installed during a
240 1.1 tv build.
241 1.1 tv
242 1.1 tv Default: ``yes''; however, some platforms turn off MKPROFILE
243 1.1 tv by default at times due to toolchain problems with profiled
244 1.1 tv code.
245 1.1 tv
246 1.1 tv MKSHARE Can be set to ``yes'' or ``no''. Indicates whether files
247 1.44 lukem destined to reside in DESTDIR/usr/share will be built and
248 1.44 lukem installed during a build. If set to ``no'', then all of
249 1.27 lukem MKCATPAGES, MKDOC, MKINFO, MKMAN, and MKNLS will be set to
250 1.27 lukem ``no'' unconditionally.
251 1.1 tv
252 1.1 tv Default: ``yes''
253 1.1 tv
254 1.50 wiz MKTTINTERP Can be set to ``yes'' or ``no''. For X builds, decides if
255 1.50 wiz the TrueType bytecode interpreter is turned on. See
256 1.50 wiz http://www.freetype.org/patents.html for details.
257 1.50 wiz
258 1.50 wiz Default: ``no''
259 1.50 wiz
260 1.44 lukem MKUNPRIVED Can be set to ``yes'' or ``no''. Indicates whether an
261 1.44 lukem unprivileged install will occur. The user, group, permis-
262 1.52 jmc sions, and file flags, will not be set on the installed
263 1.52 jmc items; instead the information will be appended to a file
264 1.52 jmc called METALOG in DESTDIR. The contents of METALOG are used
265 1.52 jmc during the generation of the distribution tar files to ensure
266 1.52 jmc that the appropriate file ownership is stored.
267 1.38 lukem
268 1.38 lukem Default: ``no''
269 1.38 lukem
270 1.44 lukem MKUPDATE Can be set to ``yes'' or ``no''. Indicates whether all
271 1.44 lukem install operations intended to write to DESTDIR will compare
272 1.38 lukem file timestamps before installing, and skip the install phase
273 1.44 lukem if the destination files are up-to-date. This also has
274 1.44 lukem implications on full builds (see next subsection).
275 1.38 lukem
276 1.38 lukem Default: ``no''
277 1.38 lukem
278 1.49 lukem MKX11 Can be set to ``yes'' or ``no''. Indicates whether X11R6 is
279 1.49 lukem built from X11SRCDIR.
280 1.49 lukem
281 1.49 lukem Default: ``no''
282 1.49 lukem
283 1.59 apb TOOLDIR Directory to hold the host tools, once built. If specified,
284 1.59 apb must be an absolute path. This directory should be unique to
285 1.59 apb a given host system and NetBSD source tree. (However, multi-
286 1.59 apb ple targets may share the same TOOLDIR; the target-dependent
287 1.59 apb files have unique names.) If unset, a default based on the
288 1.59 apb uname(1) information of the host platform will be created in
289 1.59 apb the .OBJDIR of src.
290 1.1 tv
291 1.1 tv Default: Unset.
292 1.1 tv
293 1.1 tv USETOOLS Indicates whether the tools specified by TOOLDIR should be
294 1.1 tv used as part of a build in progress. Must be set to ``yes''
295 1.1 tv if cross-compiling.
296 1.1 tv
297 1.1 tv yes Use the tools from TOOLDIR.
298 1.1 tv
299 1.1 tv no Do not use the tools from TOOLDIR, but refuse to build
300 1.1 tv native compilation tool components that are version-
301 1.1 tv specific for that tool.
302 1.1 tv
303 1.1 tv never Do not use the tools from TOOLDIR, even when building
304 1.1 tv native tool components. This is similar to the tradi-
305 1.1 tv tional NetBSD build method, but does not verify that
306 1.1 tv the compilation tools in use are up-to-date enough in
307 1.1 tv order to build the tree successfully. This may cause
308 1.1 tv build or runtime problems when building the whole
309 1.1 tv NetBSD source tree.
310 1.1 tv
311 1.1 tv Default: ``yes'' if building all or part of a whole NetBSD
312 1.1 tv source tree (detected automatically); ``no'' otherwise (to
313 1.44 lukem preserve traditional semantics of the <bsd.*.mk> make(1)
314 1.44 lukem include files).
315 1.1 tv
316 1.59 apb X11SRCDIR Directory containing the X11R6 source. If specified, must be
317 1.59 apb an absolute path. The main X11R6 source is found in
318 1.59 apb X11SRCDIR/xfree/xc.
319 1.49 lukem
320 1.49 lukem Default: ``/usr/xsrc''
321 1.49 lukem
322 1.1 tv "make" variables for full builds
323 1.7 lukem These variables only affect the top level ``Makefile'' and do not affect
324 1.7 lukem manually building subtrees of the NetBSD source code.
325 1.1 tv
326 1.20 lukem INSTALLWORLDDIR Location for the ``make installworld'' target to install
327 1.59 apb to. If specified, must be an absolute path.
328 1.1 tv
329 1.20 lukem Default: ``/''
330 1.1 tv
331 1.44 lukem MKOBJDIRS Can be set to ``yes'' or ``no''. Indicates whether
332 1.44 lukem object directories will be created automatically (via a
333 1.20 lukem ``make obj'' pass) at the start of a build.
334 1.1 tv
335 1.34 lukem Default: ``no''
336 1.1 tv
337 1.38 lukem MKUPDATE Can be set to ``yes'' or ``no''. If set, then in addi-
338 1.38 lukem tion to the effects described for MKUPDATE=yes above,
339 1.38 lukem this implies the effects of NOCLEANDIR (i.e., ``make
340 1.38 lukem cleandir'' is avoided).
341 1.38 lukem
342 1.38 lukem Default: ``no''
343 1.38 lukem
344 1.20 lukem NBUILDJOBS Now obsolete. Use the make(1) option -j, instead (see
345 1.20 lukem below)
346 1.1 tv
347 1.20 lukem Default: Unset.
348 1.1 tv
349 1.20 lukem NOCLEANDIR If set, avoids the ``make cleandir'' phase of a full
350 1.20 lukem build. This has the effect of allowing only changed
351 1.20 lukem files in a source tree to be recompiled. This can speed
352 1.20 lukem up builds when updating only a few files in the tree.
353 1.1 tv
354 1.20 lukem Default: Unset.
355 1.1 tv
356 1.20 lukem NODISTRIBDIRS If set, avoids the ``make distrib-dirs'' phase of a full
357 1.20 lukem build. This skips running mtree(8) on DESTDIR, useful
358 1.20 lukem on systems where building as an unprivileged user, or
359 1.20 lukem where it is known that the system-wide mtree files have
360 1.20 lukem not changed.
361 1.1 tv
362 1.20 lukem Default: Unset.
363 1.1 tv
364 1.20 lukem NOINCLUDES If set, avoids the ``make includes'' phase of a full
365 1.20 lukem build. This has the effect of preventing make(1) from
366 1.44 lukem thinking that some programs are out-of-date simply
367 1.44 lukem because the system include files have changed. However,
368 1.20 lukem this option should not be used when updating the entire
369 1.20 lukem NetBSD source tree arbitrarily; it is suggested to use
370 1.38 lukem MKUPDATE=yes in that case.
371 1.1 tv
372 1.20 lukem Default: Unset.
373 1.1 tv
374 1.20 lukem RELEASEDIR If set, specifies the directory to which a release(7)
375 1.20 lukem layout will be written at the end of a ``make release''.
376 1.59 apb If specified, must be an absolute path.
377 1.20 lukem
378 1.20 lukem Default: Unset.
379 1.20 lukem
380 1.30 lukem Note: build.sh will provide a default of releasedir (in
381 1.30 lukem the top-level .OBJDIR) unless run in `expert' mode
382 1.30 lukem
383 1.1 tv BUILDING
384 1.1 tv "make" command line options
385 1.52 jmc This is not a summary of all the options available to make(1); only the
386 1.52 jmc options used most frequently with NetBSD builds are listed here.
387 1.1 tv
388 1.10 sommerfe -j njob Run up to njob make(1) subjobs in parallel. Makefiles should
389 1.52 jmc use .WAIT or have explicit dependencies as necessary to
390 1.44 lukem enforce build ordering. If you see build failures with -j,
391 1.10 sommerfe please save complete build logs so the failures can be ana-
392 1.10 sommerfe lyzed.
393 1.10 sommerfe
394 1.1 tv -m dir Specify the default directory for searching for system Make-
395 1.1 tv file segments, mainly the <bsd.*.mk> files. When building any
396 1.1 tv full NetBSD source tree, this should be set to the
397 1.1 tv ``share/mk'' directory in the source tree. (This is set auto-
398 1.1 tv matically when building from the top level.)
399 1.1 tv
400 1.1 tv -n Display the commands that would have been executed, but do not
401 1.1 tv actually execute them. This will still cause recursion to
402 1.1 tv take place.
403 1.1 tv
404 1.47 zuntum -V var Print make(1)'s idea of the value of var. Does not build any
405 1.1 tv targets.
406 1.1 tv
407 1.1 tv var=value Set the variable var to value, overriding any setting speci-
408 1.1 tv fied by the process environment, the MAKECONF configuration
409 1.1 tv file, or the system Makefile segments.
410 1.1 tv
411 1.1 tv "make" targets
412 1.1 tv These default targets may be built by running make(1) in any subtree of
413 1.1 tv the NetBSD source code. It is recommended that none of these be used
414 1.1 tv from the top level Makefile; as a specific exception, ``make obj'' and
415 1.1 tv ``make cleandir'' are useful in that context.
416 1.1 tv
417 1.1 tv all Build programs, libraries, and preformatted documentation.
418 1.1 tv
419 1.1 tv clean Remove program and library object code files.
420 1.1 tv
421 1.44 lukem cleandir Same as clean, but also remove preformatted documentation,
422 1.44 lukem dependency files generated by ``make depend'', and any other
423 1.49 lukem files known to be created at build time.
424 1.1 tv
425 1.44 lukem depend Create dependency files (.depend) containing more detailed
426 1.44 lukem information about the dependencies of source code on header
427 1.1 tv files. Allows programs to be recompiled automatically when a
428 1.1 tv dependency changes.
429 1.1 tv
430 1.1 tv dependall Does a ``make depend'' immediately followed by a ``make all''.
431 1.10 sommerfe This improves cache locality of the build since both passes
432 1.10 sommerfe read the source files in their entirety.
433 1.1 tv
434 1.49 lukem distclean Synonym for cleandir.
435 1.49 lukem
436 1.44 lukem includes Build and install system header files. Typically needed
437 1.44 lukem before any system libraries or programs can be built.
438 1.1 tv
439 1.1 tv install Install programs, libraries, and documentation into DESTDIR.
440 1.27 lukem Few files will be installed to DESTDIR/dev, DESTDIR/etc,
441 1.27 lukem DESTDIR/root or DESTDIR/var in order to prevent user supplied
442 1.27 lukem configuration data from being overwritten.
443 1.1 tv
444 1.1 tv lint Run lint(1) against the C source code, where appropriate, and
445 1.1 tv generate system-installed lint libraries.
446 1.1 tv
447 1.1 tv obj Create object directories to be used for built files, instead
448 1.1 tv of building directly in the source tree.
449 1.1 tv
450 1.1 tv tags Create ctags(1) searchable function lists usable by the ex(1)
451 1.1 tv and vi(1) text editors.
452 1.1 tv
453 1.1 tv "make" targets for the top level
454 1.1 tv Additional make(1) targets are usable specifically from the top source
455 1.1 tv level to facilitate building the entire NetBSD source tree.
456 1.1 tv
457 1.68 reed build Build the entire NetBSD system (except the kernel). This
458 1.68 reed orders portions of the source tree such that prerequisites
459 1.68 reed will be built in the proper order.
460 1.20 lukem
461 1.20 lukem distribution Do a ``make build'', and then install a full distribution
462 1.68 reed (which does not include a kernel) into DESTDIR, including
463 1.68 reed files in DESTDIR/dev, DESTDIR/etc, DESTDIR/root and
464 1.68 reed DESTDIR/var.
465 1.20 lukem
466 1.20 lukem buildworld As per ``make distribution'', except that it ensures that
467 1.20 lukem DESTDIR is not the root directory.
468 1.20 lukem
469 1.20 lukem installworld Install the distribution from DESTDIR to INSTALLWORLDDIR
470 1.20 lukem (which defaults to the root directory). Ensures that
471 1.52 jmc INSTALLWORLDDIR is not the root directory if cross compil-
472 1.20 lukem ing.
473 1.20 lukem
474 1.61 apb The INSTALLSETS environment variable may be set to a list
475 1.61 apb of distribution sets to be installed. By default, all sets
476 1.61 apb except ``etc'' and ``xetc'' are installed (so most files in
477 1.61 apb INSTALLWORLDDIR/etc will not be installed or modified).
478 1.61 apb
479 1.61 apb Note: Before performing this operation with
480 1.61 apb INSTALLWORLDDIR=/, it is highly recommended that you
481 1.61 apb upgrade your kernel and reboot. After performing this
482 1.61 apb operation, it is recommended that you use etcupdate(8) to
483 1.61 apb update files in INSTALLWORLDDIR/etc and that you use
484 1.61 apb postinstall(8) to check for inconsistencies (and possibly
485 1.61 apb to fix them).
486 1.20 lukem
487 1.25 lukem sets Create distribution sets from DESTDIR into
488 1.25 lukem RELEASEDIR/MACHINE/binary/sets. Should be run after ``make
489 1.25 lukem distribution'' (as ``make build'' does not install all of
490 1.25 lukem the required files).
491 1.25 lukem
492 1.31 lukem sourcesets Create source sets of the source tree into
493 1.31 lukem RELEASEDIR/source/sets.
494 1.31 lukem
495 1.54 apb syspkgs Create syspkgs from DESTDIR into
496 1.54 apb RELEASEDIR/MACHINE/binary/syspkgs. Should be run after
497 1.54 apb ``make distribution'' (as ``make build'' does not install
498 1.54 apb all of the required files).
499 1.54 apb
500 1.44 lukem release Do a ``make distribution'', build kernels, distribution
501 1.44 lukem media, and install sets (this as per ``make sets''), and
502 1.44 lukem then package the system into a standard release layout as
503 1.44 lukem described by release(7). This requires that RELEASEDIR be
504 1.25 lukem set (see above).
505 1.1 tv
506 1.62 apb iso-image Create a NetBSD installation CD-ROM image in the
507 1.62 apb RELEASEDIR/iso directory. The CD-ROM file system will have
508 1.62 apb a layout as described in release(7).
509 1.62 apb
510 1.62 apb For most machine types, the CD-ROM will be bootable, and
511 1.62 apb will automatically run the sysinst(8) menu-based installa-
512 1.62 apb tion program, which can be used to install or upgrade a
513 1.62 apb NetBSD system. Bootable CD-ROMs also contain tools that
514 1.62 apb may be useful in repairing a damaged NetBSD installation.
515 1.62 apb
516 1.62 apb Before ``make iso-image'' is attempted, RELEASEDIR must be
517 1.62 apb populated by ``make release'' or equivalent.
518 1.62 apb
519 1.62 apb Note that other, smaller, CD-ROM images may be created in
520 1.62 apb the RELEASEDIR/MACHINE/installation/cdrom directory by
521 1.62 apb ``make release''. These smaller images usually contain the
522 1.62 apb same tools as the larger images in RELEASEDIR/iso, but do
523 1.62 apb not contain additional content such as the distribution
524 1.62 apb sets.
525 1.62 apb
526 1.62 apb Note that the mac68k port still uses an older method of
527 1.62 apb creating CD-ROM images. This requires the mkisofs(1) util-
528 1.62 apb ity, which is not part of NetBSD, but which can be
529 1.62 apb installed from pkgsrc/sysutils/cdrtools.
530 1.56 apb
531 1.64 jnemeth iso-image-source
532 1.64 jnemeth Create a NetBSD installation CD-ROM image in the
533 1.64 jnemeth RELEASEDIR/iso directory. The CD-ROM file system will have
534 1.64 jnemeth a layout as described in release(7). It will have top
535 1.64 jnemeth level directories for the machine type and source.
536 1.64 jnemeth
537 1.64 jnemeth For most machine types, the CD-ROM will be bootable, and
538 1.64 jnemeth will automatically run the sysinst(8) menu-based installa-
539 1.64 jnemeth tion program, which can be used to install or upgrade a
540 1.64 jnemeth NetBSD system. Bootable CD-ROMs also contain tools that
541 1.64 jnemeth may be useful in repairing a damaged NetBSD installation.
542 1.64 jnemeth
543 1.64 jnemeth Before ``make iso-image-source'' is attempted, RELEASEDIR
544 1.64 jnemeth must be populated by ``make sourcesets release'' or equiva-
545 1.64 jnemeth lent.
546 1.64 jnemeth
547 1.64 jnemeth Note that other, smaller, CD-ROM images may be created in
548 1.64 jnemeth the RELEASEDIR/MACHINE/installation/cdrom directory by
549 1.64 jnemeth ``make release''. These smaller images usually contain the
550 1.64 jnemeth same tools as the larger images in RELEASEDIR/iso, but do
551 1.64 jnemeth not contain additional content such as the distribution
552 1.64 jnemeth sets.
553 1.64 jnemeth
554 1.64 jnemeth Note that the mac68k port still uses an older method of
555 1.64 jnemeth creating CD-ROM images. This requires the mkisofs(1) util-
556 1.64 jnemeth ity, which is not part of NetBSD, but which can be
557 1.64 jnemeth installed from pkgsrc/sysutils/cdrtools.
558 1.64 jnemeth
559 1.1 tv regression-tests
560 1.20 lukem Can only be run after building the regression tests in the
561 1.20 lukem directory ``regress''. Runs the compiled regression tests
562 1.20 lukem on the local host.
563 1.1 tv
564 1.1 tv The "build.sh" script
565 1.1 tv This script file is a Bourne shell script designed to build the entire
566 1.1 tv NetBSD system on any host with a Bourne shell in /bin/sh, including many
567 1.1 tv that are not POSIX compliant. Note that if a host system's /bin/sh is
568 1.1 tv unusually old and broken, the Korn Shell (/bin/ksh), if available, may be
569 1.1 tv a usable alternative.
570 1.1 tv
571 1.1 tv All cross-compile builds, and most native builds, of the entire system
572 1.1 tv should make use of build.sh rather than just running ``make''. This way,
573 1.1 tv the make(1) program will be bootstrapped properly, in case the host sys-
574 1.1 tv tem has an older or incompatible ``make'' program.
575 1.1 tv
576 1.1 tv When compiling the entire system via build.sh, many make(1) variables are
577 1.1 tv set for you in order to help encapsulate the build process. In the list
578 1.1 tv of options below, variables that are automatically set by build.sh are
579 1.1 tv noted where applicable.
580 1.1 tv
581 1.22 lukem The following operations are supported by build.sh:
582 1.22 lukem
583 1.44 lukem build Build the system as per ``make build''. This option
584 1.44 lukem implies the obj and tools operations.
585 1.22 lukem
586 1.22 lukem distribution Build a full distribution as per ``make distribution''.
587 1.22 lukem This option implies the build operation.
588 1.22 lukem
589 1.22 lukem release Build a full release as per ``make release''. This option
590 1.22 lukem implies the distribution operation.
591 1.22 lukem
592 1.23 lukem makewrapper Create the nbmake-MACHINE wrapper. This operation is auto-
593 1.23 lukem matically performed for any of the other operations.
594 1.23 lukem
595 1.22 lukem obj Perform ``make obj''.
596 1.22 lukem
597 1.22 lukem tools Build and install the host tools from src/tools.
598 1.22 lukem
599 1.35 lukem install=idir Install the contents of DESTDIR to idir, using ``make
600 1.61 apb installworld''. Note that files that are part of the
601 1.61 apb ``etc'' or ``xetc'' sets will not be installed.
602 1.35 lukem
603 1.22 lukem kernel=kconf Build a new kernel. The kconf argument is the name of a
604 1.54 apb configuration file suitable for use by config(1). If kconf
605 1.22 lukem does not contain any `/' characters, the configuration file
606 1.22 lukem is expected to be found in the KERNCONFDIR directory, which
607 1.22 lukem is typically sys/arch/MACHINE/conf. The new kernel will be
608 1.22 lukem built in a subdirectory of KERNOBJDIR, which is typically
609 1.22 lukem sys/arch/MACHINE/compile or an associated object directory.
610 1.22 lukem In order to ensure that the kernel is built using up-to-
611 1.22 lukem date tools, it is strongly recommended that the tools be
612 1.22 lukem rebuilt (using the tools operation).
613 1.22 lukem
614 1.35 lukem releasekernel=kconf
615 1.35 lukem Install a gzip(1)ed copy of the kernel built by
616 1.35 lukem kernel=kconf into RELEASEDIR/MACHINE/binary/kernel, usually
617 1.44 lukem as netbsd-kconf.gz, although the ``netbsd'' prefix is
618 1.44 lukem determined from the ``config'' directives in kconf.
619 1.24 lukem
620 1.24 lukem sets Perform ``make sets''.
621 1.31 lukem
622 1.31 lukem sourcesets Perform ``make sourcesets''.
623 1.22 lukem
624 1.54 apb syspkgs Perform ``make syspkgs''.
625 1.54 apb
626 1.56 apb iso-image Perform ``make iso-image''.
627 1.56 apb
628 1.65 jnemeth iso-image-source
629 1.65 jnemeth Perform ``make iso-image-source''.
630 1.65 jnemeth
631 1.51 wiz The following command line options alter the behaviour of the build.sh
632 1.51 wiz operations described above:
633 1.1 tv
634 1.1 tv -a arch Set the value of MACHINE_ARCH to arch.
635 1.9 thorpej
636 1.9 thorpej -B buildid
637 1.9 thorpej Set the value of BUILDID to buildid. This will also append the
638 1.67 sborrill build identifier to the name of the ``make'' wrapper script so
639 1.37 lukem that the resulting name is of the form
640 1.37 lukem ``nbmake-MACHINE-BUILDID''.
641 1.1 tv
642 1.67 sborrill -C cdextras
643 1.67 sborrill Set the value of CDEXTRA to cdextras which is a space-separated
644 1.67 sborrill list of files or directories which will be added in order to
645 1.67 sborrill the CD-ROM image when used in conjunction with ``iso-image'' or
646 1.67 sborrill ``iso-image-source''. Files will be added to the root of the
647 1.67 sborrill CD-ROM image, whereas directories will be copied recursively.
648 1.67 sborrill If relative paths are specified, they will be converted to
649 1.67 sborrill absolute paths before being used.
650 1.66 jnemeth
651 1.59 apb -D dest Set the value of DESTDIR to dest. If a relative path is speci-
652 1.59 apb fied, it will be converted to an absolute path before being
653 1.59 apb used.
654 1.18 lukem
655 1.23 lukem -E Set `expert' mode. This overrides various sanity checks, and
656 1.23 lukem allows: DESTDIR does not have to be set to a non-root path for
657 1.38 lukem builds, and MKUNPRIVED=yes does not have to be set when build-
658 1.38 lukem ing as a non-root user.
659 1.23 lukem
660 1.23 lukem Note: It is highly recommended that you know what you are doing
661 1.23 lukem when you use this option.
662 1.19 lukem
663 1.51 wiz -h Print a help message.
664 1.51 wiz
665 1.10 sommerfe -j njob Passed through to make(1). Makefiles should use .WAIT or have
666 1.10 sommerfe explicit dependancies as necessary to enforce build ordering.
667 1.10 sommerfe If you see build failures with -j, please save complete build
668 1.10 sommerfe logs so the failures can be analyzed.
669 1.1 tv
670 1.59 apb -M obj Set MAKEOBJDIRPREFIX to obj. If a relative path is specified,
671 1.59 apb it will be converted to an absolute path before being used.
672 1.59 apb Unsets MAKEOBJDIR.
673 1.18 lukem
674 1.60 apb -m mach Set the value of MACHINE to mach, except in some special cases
675 1.60 apb listed below. This will also override any value of
676 1.60 apb MACHINE_ARCH in the process environment with a value deduced
677 1.60 apb from mach, unless -a is specified. All cross builds require
678 1.60 apb -m, but if unset on a NetBSD host, the host's value of MACHINE
679 1.60 apb will be detected and used automatically.
680 1.60 apb
681 1.60 apb Some machines support multiple values for MACHINE_ARCH. The
682 1.60 apb following special cases for the mach argument are defined to
683 1.60 apb set the listed values of MACHINE and MACHINE_ARCH:
684 1.33 lukem
685 1.33 lukem mach MACHINE MACHINE_ARCH
686 1.60 apb evbarm evbarm (not set)
687 1.60 apb evbarm-eb evbarm armeb
688 1.60 apb evbarm-el evbarm arm
689 1.33 lukem evbmips evbmips (not set)
690 1.33 lukem evbmips-eb evbmips mipseb
691 1.33 lukem evbmips-el evbmips mipsel
692 1.33 lukem evbsh3 evbsh3 (not set)
693 1.33 lukem evbsh3-eb evbsh3 sh3eb
694 1.33 lukem evbsh3-el evbsh3 sh3el
695 1.33 lukem sbmips sbmips (not set)
696 1.33 lukem sbmips-eb sbmips mipseb
697 1.33 lukem sbmips-el sbmips mipsel
698 1.1 tv
699 1.45 lukem -N noiselevel
700 1.46 lukem Set the ``noisyness'' level of the build, by setting
701 1.46 lukem MAKEVERBOSE to noiselevel.
702 1.45 lukem
703 1.1 tv -n Show the commands that would be executed by build.sh, but do
704 1.1 tv not make any changes. This is similar in concept to ``make
705 1.1 tv -n''.
706 1.1 tv
707 1.18 lukem -O obj Create an appropriate transform macro for MAKEOBJDIR that will
708 1.59 apb place the built object files under obj. If a relative path is
709 1.59 apb specified, it will be converted to an absolute path before
710 1.59 apb being used. For instance, a setting of /usr/obj will place
711 1.59 apb build-time files under /usr/obj/bin, /usr/obj/lib,
712 1.59 apb /usr/obj/usr.bin, and so forth. Unsets MAKEOBJDIRPREFIX.
713 1.18 lukem
714 1.34 lukem -o Set the value of MKOBJDIRS to ``no''. Otherwise, it will be
715 1.34 lukem automatically set to ``yes'' (which is opposite to the default
716 1.34 lukem behaviour).
717 1.1 tv
718 1.59 apb -R rel Set the value of RELEASEDIR to rel. If a relative path is
719 1.59 apb specified, it will be converted to an absolute path before
720 1.59 apb being used.
721 1.18 lukem
722 1.1 tv -r Remove the contents of DESTDIR and TOOLDIR before building
723 1.1 tv (provides a clean starting point). This will skip deleting
724 1.1 tv DESTDIR if building on a native system to the root directory.
725 1.1 tv
726 1.59 apb -T tools Set the value of TOOLDIR to tools. If a relative path is spec-
727 1.59 apb ified, it will be converted to an absolute path before being
728 1.59 apb used. If set, the bootstrap ``make'' will only be rebuilt as
729 1.59 apb needed (when the source files for make(1) change).
730 1.18 lukem
731 1.38 lukem -U Set MKUNPRIVED=yes.
732 1.18 lukem
733 1.38 lukem -u Set MKUPDATE=yes.
734 1.1 tv
735 1.21 lukem -V var=[value]
736 1.40 lukem Set the environment variable var to an optional value. This is
737 1.40 lukem propagated to the nbmake wrapper.
738 1.21 lukem
739 1.1 tv -w wrapper
740 1.1 tv Create the nbmake wrapper script (see below) in a custom loca-
741 1.1 tv tion, specified by wrapper. This allows, for instance, to
742 1.1 tv place the wrapper in PATH automatically. Note that wrapper is
743 1.59 apb the full name of the file, not just a directory name. If a
744 1.59 apb relative path is specified, it will be converted to an absolute
745 1.59 apb path before being used.
746 1.1 tv
747 1.49 lukem -X x11src
748 1.59 apb Set the value of X11SRCDIR to x11src. If a relative path is
749 1.59 apb specified, it will be converted to an absolute path before
750 1.59 apb being used.
751 1.49 lukem
752 1.49 lukem -x Set MKX11=yes.
753 1.49 lukem
754 1.40 lukem -Z var Unset ("zap") the environment variable var. This is propagated
755 1.40 lukem to the nbmake wrapper.
756 1.40 lukem
757 1.1 tv The "nbmake-MACHINE" wrapper script
758 1.1 tv If using the build.sh script to build NetBSD, a nbmake-MACHINE script
759 1.1 tv will be created in TOOLDIR/bin upon the first build to assist in building
760 1.1 tv subtrees on a cross-compile host.
761 1.1 tv
762 1.1 tv nbmake-MACHINE can be invoked in lieu of make(1), and will instead call
763 1.1 tv the up-to-date version of ``nbmake'' installed into TOOLDIR/bin with sev-
764 1.1 tv eral key variables pre-set, including MACHINE, MACHINE_ARCH, and TOOLDIR.
765 1.40 lukem build.sh will also set variables specified with -V, and unset variables
766 1.40 lukem specified with -Z.
767 1.40 lukem
768 1.1 tv This script can be symlinked into a directory listed in PATH, or called
769 1.1 tv with an absolute path.
770 1.1 tv
771 1.16 lukem EXAMPLES
772 1.44 lukem 1. % ./build.sh tools kernel=GENERIC
773 1.28 lukem
774 1.28 lukem Build a new toolchain, and use the new toolchain to configure and
775 1.28 lukem build a new GENERIC kernel.
776 1.28 lukem
777 1.44 lukem 2. % ./build.sh -U distribution
778 1.28 lukem
779 1.30 lukem Using unprivileged mode, build a complete distribution to a DESTDIR
780 1.30 lukem directory that build.sh selects (and will display).
781 1.28 lukem
782 1.43 martti 3. # ./build.sh -U install=/
783 1.28 lukem
784 1.29 lukem As root, install to / the distribution that was built by example 2.
785 1.29 lukem Even though this is run as root, -U is required so that the permis-
786 1.30 lukem sions stored in DESTDIR/METALOG are correctly applied to the files
787 1.30 lukem as they're copied to /.
788 1.28 lukem
789 1.44 lukem 4. % ./build.sh -U -u release
790 1.28 lukem
791 1.30 lukem Using unprivileged mode, build a complete release to DESTDIR and
792 1.30 lukem RELEASEDIR directories that build.sh selects (and will display).
793 1.38 lukem MKUPDATE=yes (-u) is set to prevent the ``make cleandir'', so that
794 1.38 lukem if this is run after example 2, it doesn't need to redo that portion
795 1.38 lukem of the release build.
796 1.16 lukem
797 1.10 sommerfe OBSOLETE VARIABLES
798 1.15 lukem NBUILDJOBS Use the make(1) option -j, instead.
799 1.15 lukem
800 1.15 lukem USE_NEW_TOOLCHAIN
801 1.15 lukem The new toolchain is now the default. To disable, use
802 1.15 lukem TOOLCHAIN_MISSING=yes.
803 1.10 sommerfe
804 1.1 tv SEE ALSO
805 1.62 apb make(1), hier(7), release(7), etcupdate(8), postinstall(8), sysinst(8),
806 1.61 apb pkgsrc/sysutils/cdrtools
807 1.1 tv
808 1.1 tv HISTORY
809 1.15 lukem The build.sh based build scheme was introduced for NetBSD 1.6 as
810 1.15 lukem USE_NEW_TOOLCHAIN, and re-worked to TOOLCHAIN_MISSING after that.
811 1.1 tv
812 1.1 tv BUGS
813 1.15 lukem A few platforms are not yet using this build system.
814 1.1 tv
815 1.68 reed NetBSD March 8, 2008 NetBSD
816