BUILDING revision 1.82 1 1.1 tv BUILDING(8) NetBSD System Manager's Manual BUILDING(8)
2 1.1 tv
3 1.1 tv NAME
4 1.52 jmc BUILDING -- Procedure for building NetBSD from source code.
5 1.1 tv
6 1.1 tv REQUIREMENTS
7 1.1 tv NetBSD is designed to be buildable on most POSIX-compliant host systems.
8 1.1 tv The basic build procedure is the same whether compiling natively (on the
9 1.1 tv same NetBSD architecture) or cross compiling (on another architecture or
10 1.1 tv OS).
11 1.1 tv
12 1.1 tv This source tree contains a special subtree, ``tools'', which uses the
13 1.1 tv host system to create a build toolchain for the target architecture. The
14 1.1 tv host system must have at least C and C++ compilers in order to create the
15 1.1 tv toolchain (make is not required); all other tools are created as part of
16 1.53 reed the NetBSD build process. (See the environment variables section below
17 1.53 reed if you need to override or manually select your compilers.)
18 1.1 tv
19 1.1 tv FILES
20 1.1 tv Source tree layout
21 1.17 wiz doc/BUILDING.mdoc
22 1.17 wiz This document (in -mdoc troff format; the original copy).
23 1.1 tv
24 1.2 wiz BUILDING This document (in plaintext).
25 1.1 tv
26 1.48 jmc tools/compat/README
27 1.48 jmc Special notes for cross-hosting a NetBSD build on non-
28 1.48 jmc NetBSD platforms.
29 1.48 jmc
30 1.44 lukem Makefile The main Makefile for NetBSD; should only be run for
31 1.44 lukem native builds with an appropriately up-to-date version of
32 1.1 tv NetBSD make(1). (For building from out-of-date systems or
33 1.1 tv on a non-native host, see the build.sh shell script.)
34 1.1 tv
35 1.1 tv UPDATING Special notes for updating from an earlier revision of
36 1.1 tv NetBSD. It is important to read this file before every
37 1.1 tv build of an updated source tree.
38 1.1 tv
39 1.1 tv build.sh Bourne-compatible shell script used for building the host
40 1.1 tv build tools and the NetBSD system from scratch. Can be
41 1.1 tv used for both native and cross builds, and should be used
42 1.1 tv instead of make(1) for any source tree that is updated and
43 1.1 tv recompiled regularly.
44 1.1 tv
45 1.1 tv crypto/dist/, dist/, gnu/dist/
46 1.1 tv Sources imported verbatim from third parties, without man-
47 1.1 tv gling the existing build structure. Other source trees in
48 1.1 tv bin through usr.sbin use the NetBSD make(1) ``reachover''
49 1.44 lukem Makefile semantics when building these programs for a
50 1.44 lukem native host.
51 1.1 tv
52 1.1 tv distrib/, etc/
53 1.1 tv Sources for items used when making a full release snap-
54 1.27 lukem shot, such as files installed in DESTDIR/etc on the desti-
55 1.27 lukem nation system, boot media, and release notes.
56 1.1 tv
57 1.70 dholland tests/, regress/
58 1.70 dholland Regression test harness. Can be cross-compiled, but only
59 1.70 dholland run natively. tests/ uses the atf(7) test framework;
60 1.70 dholland regress/ contains older tests that have not yet been
61 1.70 dholland migrated to atf(7).
62 1.1 tv
63 1.1 tv sys/ NetBSD kernel sources.
64 1.1 tv
65 1.1 tv tools/ ``Reachover'' build structure for the host build tools.
66 1.1 tv This has a special method of determining out-of-date sta-
67 1.1 tv tus.
68 1.1 tv
69 1.1 tv bin/ ... usr.sbin/
70 1.1 tv Sources to the NetBSD userland (non-kernel) programs. If
71 1.1 tv any of these directories are missing, they will be skipped
72 1.1 tv during the build.
73 1.1 tv
74 1.49 lukem x11/ ``Reachover'' build structure for X11R6; the source is in
75 1.49 lukem X11SRCDIR.
76 1.49 lukem
77 1.1 tv Build tree layout
78 1.1 tv The NetBSD build tree is described in hier(7), and the release layout is
79 1.1 tv described in release(7).
80 1.1 tv
81 1.1 tv CONFIGURATION
82 1.8 lukem Environment variables
83 1.8 lukem Several environment variables control the behaviour of NetBSD builds.
84 1.8 lukem
85 1.58 apb HOST_SH Path name to a POSIX-compliant shell. If this is not
86 1.58 apb set explicitly, then the default is set using heuris-
87 1.58 apb tics dependent on the host platform, or from the shell
88 1.58 apb under which build.sh is executed (if that can be deter-
89 1.58 apb mined), or using the first copy of sh found in PATH.
90 1.58 apb If the host system's /bin/sh is not POSIX-compliant, we
91 1.58 apb suggest that you build using commands like
92 1.58 apb
93 1.58 apb HOST_SH=/path/to/working/shell
94 1.58 apb export HOST_SH
95 1.58 apb ${HOST_SH} build.sh [options]
96 1.58 apb
97 1.53 reed HOST_CC Path name to C compiler used to create the toolchain.
98 1.53 reed
99 1.53 reed HOST_CXX Path name to C++ compiler used to create the toolchain.
100 1.53 reed
101 1.70 dholland MACHINE Machine type, e.g., ``macppc''.
102 1.8 lukem
103 1.70 dholland MACHINE_ARCH Machine architecture, e.g., ``powerpc''.
104 1.8 lukem
105 1.8 lukem MAKE Path name to invoke make(1) as.
106 1.8 lukem
107 1.8 lukem MAKEFLAGS Flags to invoke make(1) with.
108 1.8 lukem
109 1.8 lukem MAKEOBJDIR Directory to use as the .OBJDIR for the current direc-
110 1.59 apb tory. The value is subjected to variable expansion by
111 1.73 apb make(1). Typical usage is to set this variable to a
112 1.73 apb value involving the use of `${.CURDIR:S...}' or
113 1.73 apb `${.CURDIR:C...}', to derive the value of .OBJDIR from
114 1.73 apb the value of .CURDIR. Used only if MAKEOBJDIRPREFIX is
115 1.73 apb not defined. MAKEOBJDIR can be provided only in the
116 1.73 apb environment or via the -O flag of build.sh; it cannot
117 1.82 mrg usefully be set inside a Makefile, including mk.conf or
118 1.82 mrg ${MAKECONF}.
119 1.8 lukem
120 1.8 lukem MAKEOBJDIRPREFIX Top level directory of the object directory tree. If
121 1.59 apb specified, must be an absolute path. If this is
122 1.59 apb defined, ${MAKEOBJDIRPREFIX}/${.CURDIR} is used as the
123 1.59 apb .OBJDIR for the current directory. The current direc-
124 1.73 apb tory may be read only. MAKEOBJDIRPREFIX can be pro-
125 1.73 apb vided only in the environment or via the -M flag of
126 1.82 mrg build.sh; it cannot usefully be set inside a Makefile,
127 1.82 mrg including mk.conf or ${MAKECONF}.
128 1.8 lukem
129 1.1 tv "make" variables
130 1.1 tv Several variables control the behavior of NetBSD builds. Unless other-
131 1.1 tv wise specified, these variables may be set in either the process environ-
132 1.1 tv ment or the make(1) configuration file specified by MAKECONF.
133 1.1 tv
134 1.9 thorpej BUILDID Identifier for the build. The identifier will be appended to
135 1.9 thorpej object directory names, and can be consulted in the make(1)
136 1.9 thorpej configuration file in order to set additional build parame-
137 1.9 thorpej ters, such as compiler flags.
138 1.9 thorpej
139 1.72 perry BUILDSEED GCC uses random numbers when compiling C++ code. This vari-
140 1.72 perry able seeds the gcc random number generator using the -fran-
141 1.72 perry dom-seed flag with this value. By default, it is set to
142 1.72 perry NetBSD-(majorversion). Using a fixed value causes C++ bina-
143 1.72 perry ries to be the same when built from the same sources. Addi-
144 1.72 perry tional information is available in the GCC documentation of
145 1.72 perry -frandom-seed.
146 1.72 perry
147 1.1 tv DESTDIR Directory to contain the built NetBSD system. If set, spe-
148 1.1 tv cial options are passed to the compilation tools to prevent
149 1.1 tv their default use of the host system's /usr/include,
150 1.59 apb /usr/lib, and so forth. This pathname must be an absolute
151 1.59 apb path, and should not end with a slash (/) character. (For
152 1.59 apb installation into the system's root directory, set DESTDIR to
153 1.59 apb an empty string, not to ``/''). The directory must reside on
154 1.59 apb a file system which supports long file names and hard links.
155 1.1 tv
156 1.1 tv Default: Empty string if USETOOLS is ``yes''; unset other-
157 1.1 tv wise.
158 1.1 tv
159 1.30 lukem Note: build.sh will provide a default of destdir.MACHINE (in
160 1.70 dholland the top-level .OBJDIR) unless run in `expert' mode.
161 1.30 lukem
162 1.1 tv MAKECONF The name of the make(1) configuration file. Only settable in
163 1.1 tv the process environment.
164 1.1 tv
165 1.1 tv Default: ``/etc/mk.conf''
166 1.1 tv
167 1.45 lukem MAKEVERBOSE
168 1.45 lukem Level of verbosity of status messages. Supported values:
169 1.45 lukem
170 1.80 apb 0 No descriptive messages or commands executed by make(1)
171 1.80 apb are shown.
172 1.45 lukem
173 1.80 apb 1 Brief messages are shown describing what is being done,
174 1.80 apb but the actual commands executed by make(1) are not dis-
175 1.80 apb played.
176 1.80 apb
177 1.80 apb 2 Descriptive messages are shown as above (prefixed with a
178 1.80 apb `#'), and ordinary commands performed by make(1) are
179 1.80 apb displayed.
180 1.80 apb
181 1.80 apb 3 In addition to the above, all commands performed by
182 1.80 apb make(1) are displayed, even if they would ordinarily
183 1.80 apb have been hidden through use of the ``@'' prefix in the
184 1.80 apb relevant makefile.
185 1.45 lukem
186 1.80 apb 4 In addition to the above, commands executed by make(1)
187 1.80 apb are traced through use of the sh(1) ``-x'' flag.
188 1.45 lukem
189 1.45 lukem Default: 2
190 1.45 lukem
191 1.1 tv MKCATPAGES Can be set to ``yes'' or ``no''. Indicates whether prefor-
192 1.1 tv matted plaintext manual pages will be created during a build.
193 1.1 tv
194 1.1 tv Default: ``yes''
195 1.1 tv
196 1.1 tv MKCRYPTO Can be set to ``yes'' or ``no''. Indicates whether crypto-
197 1.1 tv graphic code will be included in a build; provided for the
198 1.1 tv benefit of countries that do not allow strong cryptography.
199 1.44 lukem Will not affect use of the standard low-security password
200 1.44 lukem encryption system, crypt(3).
201 1.1 tv
202 1.1 tv Default: ``yes''
203 1.1 tv
204 1.1 tv MKDOC Can be set to ``yes'' or ``no''. Indicates whether system
205 1.44 lukem documentation destined for DESTDIR/usr/share/doc will be
206 1.44 lukem installed during a build.
207 1.1 tv
208 1.1 tv Default: ``yes''
209 1.1 tv
210 1.77 lukem MKHTML Can be set to ``yes'' or ``no''. Indicates whether prefor-
211 1.77 lukem matted HTML manual pages will be built and installed
212 1.77 lukem
213 1.77 lukem Default: ``yes''
214 1.77 lukem
215 1.4 tv MKHOSTOBJ Can be set to ``yes'' or ``no''. If set to ``yes'', then for
216 1.4 tv programs intended to be run on the compile host, the name,
217 1.4 tv release, and architecture of the host operating system will
218 1.4 tv be suffixed to the name of the object directory created by
219 1.4 tv ``make obj''. (This allows multiple host systems to compile
220 1.4 tv NetBSD for a single target.) If set to ``no'', then programs
221 1.4 tv built to be run on the compile host will use the same object
222 1.4 tv directory names as programs built to be run on the target.
223 1.4 tv
224 1.4 tv Default: ``no''
225 1.4 tv
226 1.1 tv MKINFO Can be set to ``yes'' or ``no''. Indicates whether GNU Info
227 1.1 tv files, used for the documentation for most of the compilation
228 1.1 tv tools, will be created and installed during a build.
229 1.1 tv
230 1.1 tv Default: ``yes''
231 1.1 tv
232 1.1 tv MKLINT Can be set to ``yes'' or ``no''. Indicates whether lint(1)
233 1.1 tv will be run against portions of the NetBSD source code during
234 1.1 tv the build, and whether lint libraries will be installed into
235 1.27 lukem DESTDIR/usr/libdata/lint.
236 1.1 tv
237 1.1 tv Default: ``yes''
238 1.1 tv
239 1.1 tv MKMAN Can be set to ``yes'' or ``no''. Indicates whether manual
240 1.1 tv pages will be installed during a build.
241 1.1 tv
242 1.1 tv Default: ``yes''
243 1.1 tv
244 1.1 tv MKNLS Can be set to ``yes'' or ``no''. Indicates whether Native
245 1.44 lukem Language System locale zone files will be compiled and
246 1.44 lukem installed during a build.
247 1.1 tv
248 1.1 tv Default: ``yes''
249 1.1 tv
250 1.1 tv MKOBJ Can be set to ``yes'' or ``no''. Indicates whether object
251 1.1 tv directories will be created when running ``make obj''. If
252 1.1 tv set to ``no'', then all built files will be located inside
253 1.1 tv the regular source tree.
254 1.1 tv
255 1.1 tv Default: ``yes''
256 1.1 tv
257 1.70 dholland Note that setting MKOBJ to ``no'' is not recommended and may
258 1.70 dholland cause problems when updating the tree with cvs(1).
259 1.70 dholland
260 1.1 tv MKPIC Can be set to ``yes'' or ``no''. Indicates whether shared
261 1.1 tv objects and libraries will be created and installed during a
262 1.1 tv build. If set to ``no'', the entire built system will be
263 1.1 tv statically linked.
264 1.1 tv
265 1.1 tv Default: Platform dependent. As of this writing, all plat-
266 1.1 tv forms except sh3 default to ``yes''.
267 1.1 tv
268 1.1 tv MKPICINSTALL
269 1.1 tv Can be set to ``yes'' or ``no''. Indicates whether the ar(1)
270 1.44 lukem format libraries (lib*_pic.a), used to generate shared
271 1.44 lukem libraries, are installed during a build.
272 1.1 tv
273 1.1 tv Default: ``yes''
274 1.1 tv
275 1.1 tv MKPROFILE Can be set to ``yes'' or ``no''. Indicates whether profiled
276 1.1 tv libraries (lib*_p.a) will be built and installed during a
277 1.1 tv build.
278 1.1 tv
279 1.1 tv Default: ``yes''; however, some platforms turn off MKPROFILE
280 1.1 tv by default at times due to toolchain problems with profiled
281 1.1 tv code.
282 1.1 tv
283 1.1 tv MKSHARE Can be set to ``yes'' or ``no''. Indicates whether files
284 1.44 lukem destined to reside in DESTDIR/usr/share will be built and
285 1.44 lukem installed during a build. If set to ``no'', then all of
286 1.27 lukem MKCATPAGES, MKDOC, MKINFO, MKMAN, and MKNLS will be set to
287 1.27 lukem ``no'' unconditionally.
288 1.1 tv
289 1.1 tv Default: ``yes''
290 1.1 tv
291 1.78 apb MKSTRIPIDENT
292 1.78 apb Can be set to ``yes'' or ``no''. Indicates whether program
293 1.78 apb binaries and shared libraries should be built to include RCS
294 1.78 apb IDs for use with ident(1).
295 1.78 apb
296 1.78 apb Default: ``no''
297 1.78 apb
298 1.50 wiz MKTTINTERP Can be set to ``yes'' or ``no''. For X builds, decides if
299 1.50 wiz the TrueType bytecode interpreter is turned on. See
300 1.50 wiz http://www.freetype.org/patents.html for details.
301 1.50 wiz
302 1.50 wiz Default: ``no''
303 1.50 wiz
304 1.44 lukem MKUNPRIVED Can be set to ``yes'' or ``no''. Indicates whether an
305 1.44 lukem unprivileged install will occur. The user, group, permis-
306 1.52 jmc sions, and file flags, will not be set on the installed
307 1.52 jmc items; instead the information will be appended to a file
308 1.52 jmc called METALOG in DESTDIR. The contents of METALOG are used
309 1.52 jmc during the generation of the distribution tar files to ensure
310 1.52 jmc that the appropriate file ownership is stored.
311 1.38 lukem
312 1.38 lukem Default: ``no''
313 1.38 lukem
314 1.44 lukem MKUPDATE Can be set to ``yes'' or ``no''. Indicates whether all
315 1.44 lukem install operations intended to write to DESTDIR will compare
316 1.38 lukem file timestamps before installing, and skip the install phase
317 1.44 lukem if the destination files are up-to-date. This also has
318 1.44 lukem implications on full builds (see next subsection).
319 1.38 lukem
320 1.38 lukem Default: ``no''
321 1.38 lukem
322 1.79 mrg MKX11 Can be set to ``yes'' or ``no''. Indicates whether X11 is
323 1.49 lukem built from X11SRCDIR.
324 1.49 lukem
325 1.49 lukem Default: ``no''
326 1.49 lukem
327 1.59 apb TOOLDIR Directory to hold the host tools, once built. If specified,
328 1.59 apb must be an absolute path. This directory should be unique to
329 1.59 apb a given host system and NetBSD source tree. (However, multi-
330 1.59 apb ple targets may share the same TOOLDIR; the target-dependent
331 1.59 apb files have unique names.) If unset, a default based on the
332 1.59 apb uname(1) information of the host platform will be created in
333 1.59 apb the .OBJDIR of src.
334 1.1 tv
335 1.1 tv Default: Unset.
336 1.1 tv
337 1.1 tv USETOOLS Indicates whether the tools specified by TOOLDIR should be
338 1.1 tv used as part of a build in progress. Must be set to ``yes''
339 1.1 tv if cross-compiling.
340 1.1 tv
341 1.1 tv yes Use the tools from TOOLDIR.
342 1.1 tv
343 1.1 tv no Do not use the tools from TOOLDIR, but refuse to build
344 1.1 tv native compilation tool components that are version-
345 1.1 tv specific for that tool.
346 1.1 tv
347 1.1 tv never Do not use the tools from TOOLDIR, even when building
348 1.1 tv native tool components. This is similar to the tradi-
349 1.1 tv tional NetBSD build method, but does not verify that
350 1.1 tv the compilation tools in use are up-to-date enough in
351 1.1 tv order to build the tree successfully. This may cause
352 1.1 tv build or runtime problems when building the whole
353 1.1 tv NetBSD source tree.
354 1.1 tv
355 1.71 dholland Default: ``yes'', unless TOOLCHAIN_MISSING is set to ``yes''.
356 1.71 dholland
357 1.71 dholland USETOOLS is also set to ``no'' when using <bsd.*.mk> outside
358 1.71 dholland the NetBSD source tree.
359 1.1 tv
360 1.59 apb X11SRCDIR Directory containing the X11R6 source. If specified, must be
361 1.59 apb an absolute path. The main X11R6 source is found in
362 1.59 apb X11SRCDIR/xfree/xc.
363 1.49 lukem
364 1.49 lukem Default: ``/usr/xsrc''
365 1.49 lukem
366 1.79 mrg X11FLAVOUR The style of X11 cross-built, set to either ``Xorg'' or
367 1.79 mrg ``XFree86''.
368 1.79 mrg
369 1.81 mrg Default: ``Xorg'' on amd64, i386, macppc, shark and sparc64
370 1.81 mrg platforms, ``XFree86'' on everything else.
371 1.79 mrg
372 1.1 tv "make" variables for full builds
373 1.7 lukem These variables only affect the top level ``Makefile'' and do not affect
374 1.7 lukem manually building subtrees of the NetBSD source code.
375 1.1 tv
376 1.20 lukem INSTALLWORLDDIR Location for the ``make installworld'' target to install
377 1.59 apb to. If specified, must be an absolute path.
378 1.1 tv
379 1.20 lukem Default: ``/''
380 1.1 tv
381 1.44 lukem MKOBJDIRS Can be set to ``yes'' or ``no''. Indicates whether
382 1.44 lukem object directories will be created automatically (via a
383 1.20 lukem ``make obj'' pass) at the start of a build.
384 1.1 tv
385 1.34 lukem Default: ``no''
386 1.1 tv
387 1.70 dholland If using build.sh, the default is ``yes''. This may be
388 1.70 dholland set back to ``no'' by giving build.sh the -o option.
389 1.70 dholland
390 1.38 lukem MKUPDATE Can be set to ``yes'' or ``no''. If set, then in addi-
391 1.38 lukem tion to the effects described for MKUPDATE=yes above,
392 1.38 lukem this implies the effects of NOCLEANDIR (i.e., ``make
393 1.38 lukem cleandir'' is avoided).
394 1.38 lukem
395 1.38 lukem Default: ``no''
396 1.38 lukem
397 1.70 dholland If using build.sh, this may be set by giving the -u
398 1.70 dholland option.
399 1.70 dholland
400 1.70 dholland NBUILDJOBS Now obsolete. Use the make(1) option -j, instead. See
401 1.70 dholland below.
402 1.1 tv
403 1.20 lukem Default: Unset.
404 1.1 tv
405 1.20 lukem NOCLEANDIR If set, avoids the ``make cleandir'' phase of a full
406 1.20 lukem build. This has the effect of allowing only changed
407 1.20 lukem files in a source tree to be recompiled. This can speed
408 1.20 lukem up builds when updating only a few files in the tree.
409 1.1 tv
410 1.20 lukem Default: Unset.
411 1.1 tv
412 1.70 dholland See also MKUPDATE.
413 1.70 dholland
414 1.20 lukem NODISTRIBDIRS If set, avoids the ``make distrib-dirs'' phase of a full
415 1.20 lukem build. This skips running mtree(8) on DESTDIR, useful
416 1.20 lukem on systems where building as an unprivileged user, or
417 1.20 lukem where it is known that the system-wide mtree files have
418 1.20 lukem not changed.
419 1.1 tv
420 1.20 lukem Default: Unset.
421 1.1 tv
422 1.20 lukem NOINCLUDES If set, avoids the ``make includes'' phase of a full
423 1.20 lukem build. This has the effect of preventing make(1) from
424 1.44 lukem thinking that some programs are out-of-date simply
425 1.44 lukem because the system include files have changed. However,
426 1.20 lukem this option should not be used when updating the entire
427 1.20 lukem NetBSD source tree arbitrarily; it is suggested to use
428 1.70 dholland MKUPDATE=yes instead in that case.
429 1.1 tv
430 1.20 lukem Default: Unset.
431 1.1 tv
432 1.20 lukem RELEASEDIR If set, specifies the directory to which a release(7)
433 1.20 lukem layout will be written at the end of a ``make release''.
434 1.59 apb If specified, must be an absolute path.
435 1.20 lukem
436 1.20 lukem Default: Unset.
437 1.20 lukem
438 1.30 lukem Note: build.sh will provide a default of releasedir (in
439 1.70 dholland the top-level .OBJDIR) unless run in `expert' mode.
440 1.30 lukem
441 1.1 tv BUILDING
442 1.1 tv "make" command line options
443 1.52 jmc This is not a summary of all the options available to make(1); only the
444 1.52 jmc options used most frequently with NetBSD builds are listed here.
445 1.1 tv
446 1.10 sommerfe -j njob Run up to njob make(1) subjobs in parallel. Makefiles should
447 1.52 jmc use .WAIT or have explicit dependencies as necessary to
448 1.74 apb enforce build ordering.
449 1.10 sommerfe
450 1.1 tv -m dir Specify the default directory for searching for system Make-
451 1.1 tv file segments, mainly the <bsd.*.mk> files. When building any
452 1.1 tv full NetBSD source tree, this should be set to the
453 1.70 dholland ``share/mk'' directory in the source tree. This is set auto-
454 1.70 dholland matically when building from the top level, or when using
455 1.70 dholland build.sh.
456 1.1 tv
457 1.1 tv -n Display the commands that would have been executed, but do not
458 1.1 tv actually execute them. This will still cause recursion to
459 1.1 tv take place.
460 1.1 tv
461 1.47 zuntum -V var Print make(1)'s idea of the value of var. Does not build any
462 1.1 tv targets.
463 1.1 tv
464 1.1 tv var=value Set the variable var to value, overriding any setting speci-
465 1.1 tv fied by the process environment, the MAKECONF configuration
466 1.1 tv file, or the system Makefile segments.
467 1.1 tv
468 1.1 tv "make" targets
469 1.1 tv These default targets may be built by running make(1) in any subtree of
470 1.1 tv the NetBSD source code. It is recommended that none of these be used
471 1.1 tv from the top level Makefile; as a specific exception, ``make obj'' and
472 1.1 tv ``make cleandir'' are useful in that context.
473 1.1 tv
474 1.1 tv all Build programs, libraries, and preformatted documentation.
475 1.1 tv
476 1.1 tv clean Remove program and library object code files.
477 1.1 tv
478 1.44 lukem cleandir Same as clean, but also remove preformatted documentation,
479 1.44 lukem dependency files generated by ``make depend'', and any other
480 1.49 lukem files known to be created at build time.
481 1.1 tv
482 1.44 lukem depend Create dependency files (.depend) containing more detailed
483 1.44 lukem information about the dependencies of source code on header
484 1.1 tv files. Allows programs to be recompiled automatically when a
485 1.1 tv dependency changes.
486 1.1 tv
487 1.1 tv dependall Does a ``make depend'' immediately followed by a ``make all''.
488 1.10 sommerfe This improves cache locality of the build since both passes
489 1.10 sommerfe read the source files in their entirety.
490 1.1 tv
491 1.49 lukem distclean Synonym for cleandir.
492 1.49 lukem
493 1.44 lukem includes Build and install system header files. Typically needed
494 1.44 lukem before any system libraries or programs can be built.
495 1.1 tv
496 1.1 tv install Install programs, libraries, and documentation into DESTDIR.
497 1.27 lukem Few files will be installed to DESTDIR/dev, DESTDIR/etc,
498 1.27 lukem DESTDIR/root or DESTDIR/var in order to prevent user supplied
499 1.27 lukem configuration data from being overwritten.
500 1.1 tv
501 1.1 tv lint Run lint(1) against the C source code, where appropriate, and
502 1.1 tv generate system-installed lint libraries.
503 1.1 tv
504 1.1 tv obj Create object directories to be used for built files, instead
505 1.1 tv of building directly in the source tree.
506 1.1 tv
507 1.1 tv tags Create ctags(1) searchable function lists usable by the ex(1)
508 1.1 tv and vi(1) text editors.
509 1.1 tv
510 1.1 tv "make" targets for the top level
511 1.1 tv Additional make(1) targets are usable specifically from the top source
512 1.1 tv level to facilitate building the entire NetBSD source tree.
513 1.1 tv
514 1.68 reed build Build the entire NetBSD system (except the kernel). This
515 1.68 reed orders portions of the source tree such that prerequisites
516 1.68 reed will be built in the proper order.
517 1.20 lukem
518 1.20 lukem distribution Do a ``make build'', and then install a full distribution
519 1.68 reed (which does not include a kernel) into DESTDIR, including
520 1.68 reed files in DESTDIR/dev, DESTDIR/etc, DESTDIR/root and
521 1.68 reed DESTDIR/var.
522 1.20 lukem
523 1.20 lukem buildworld As per ``make distribution'', except that it ensures that
524 1.20 lukem DESTDIR is not the root directory.
525 1.20 lukem
526 1.70 dholland installworld Install the distribution from DESTDIR to INSTALLWORLDDIR,
527 1.70 dholland which defaults to the root directory. Ensures that
528 1.52 jmc INSTALLWORLDDIR is not the root directory if cross compil-
529 1.20 lukem ing.
530 1.20 lukem
531 1.61 apb The INSTALLSETS environment variable may be set to a list
532 1.61 apb of distribution sets to be installed. By default, all sets
533 1.70 dholland except ``etc'' and ``xetc'' are installed, so most files in
534 1.70 dholland INSTALLWORLDDIR/etc will not be installed or modified.
535 1.61 apb
536 1.61 apb Note: Before performing this operation with
537 1.61 apb INSTALLWORLDDIR=/, it is highly recommended that you
538 1.61 apb upgrade your kernel and reboot. After performing this
539 1.61 apb operation, it is recommended that you use etcupdate(8) to
540 1.61 apb update files in INSTALLWORLDDIR/etc and that you use
541 1.61 apb postinstall(8) to check for inconsistencies (and possibly
542 1.61 apb to fix them).
543 1.20 lukem
544 1.25 lukem sets Create distribution sets from DESTDIR into
545 1.69 lukem RELEASEDIR/RELEASEMACHINEDIR/binary/sets. Should be run
546 1.70 dholland after ``make distribution'', as ``make build'' alone does
547 1.70 dholland not install all of the required files.
548 1.25 lukem
549 1.31 lukem sourcesets Create source sets of the source tree into
550 1.31 lukem RELEASEDIR/source/sets.
551 1.31 lukem
552 1.54 apb syspkgs Create syspkgs from DESTDIR into
553 1.69 lukem RELEASEDIR/RELEASEMACHINEDIR/binary/syspkgs. Should be run
554 1.70 dholland after ``make distribution'', as ``make build'' alone does
555 1.70 dholland not install all of the required files.
556 1.54 apb
557 1.44 lukem release Do a ``make distribution'', build kernels, distribution
558 1.44 lukem media, and install sets (this as per ``make sets''), and
559 1.44 lukem then package the system into a standard release layout as
560 1.44 lukem described by release(7). This requires that RELEASEDIR be
561 1.25 lukem set (see above).
562 1.1 tv
563 1.62 apb iso-image Create a NetBSD installation CD-ROM image in the
564 1.62 apb RELEASEDIR/iso directory. The CD-ROM file system will have
565 1.62 apb a layout as described in release(7).
566 1.62 apb
567 1.62 apb For most machine types, the CD-ROM will be bootable, and
568 1.62 apb will automatically run the sysinst(8) menu-based installa-
569 1.62 apb tion program, which can be used to install or upgrade a
570 1.62 apb NetBSD system. Bootable CD-ROMs also contain tools that
571 1.62 apb may be useful in repairing a damaged NetBSD installation.
572 1.62 apb
573 1.62 apb Before ``make iso-image'' is attempted, RELEASEDIR must be
574 1.62 apb populated by ``make release'' or equivalent.
575 1.62 apb
576 1.62 apb Note that other, smaller, CD-ROM images may be created in
577 1.69 lukem the RELEASEDIR/RELEASEMACHINEDIR/installation/cdrom direc-
578 1.69 lukem tory by ``make release''. These smaller images usually
579 1.69 lukem contain the same tools as the larger images in
580 1.69 lukem RELEASEDIR/iso, but do not contain additional content such
581 1.69 lukem as the distribution sets.
582 1.62 apb
583 1.62 apb Note that the mac68k port still uses an older method of
584 1.62 apb creating CD-ROM images. This requires the mkisofs(1) util-
585 1.62 apb ity, which is not part of NetBSD, but which can be
586 1.62 apb installed from pkgsrc/sysutils/cdrtools.
587 1.56 apb
588 1.64 jnemeth iso-image-source
589 1.64 jnemeth Create a NetBSD installation CD-ROM image in the
590 1.64 jnemeth RELEASEDIR/iso directory. The CD-ROM file system will have
591 1.64 jnemeth a layout as described in release(7). It will have top
592 1.64 jnemeth level directories for the machine type and source.
593 1.64 jnemeth
594 1.64 jnemeth For most machine types, the CD-ROM will be bootable, and
595 1.64 jnemeth will automatically run the sysinst(8) menu-based installa-
596 1.64 jnemeth tion program, which can be used to install or upgrade a
597 1.64 jnemeth NetBSD system. Bootable CD-ROMs also contain tools that
598 1.64 jnemeth may be useful in repairing a damaged NetBSD installation.
599 1.64 jnemeth
600 1.64 jnemeth Before ``make iso-image-source'' is attempted, RELEASEDIR
601 1.64 jnemeth must be populated by ``make sourcesets release'' or equiva-
602 1.64 jnemeth lent.
603 1.64 jnemeth
604 1.64 jnemeth Note that other, smaller, CD-ROM images may be created in
605 1.69 lukem the RELEASEDIR/RELEASEMACHINEDIR/installation/cdrom direc-
606 1.69 lukem tory by ``make release''. These smaller images usually
607 1.69 lukem contain the same tools as the larger images in
608 1.69 lukem RELEASEDIR/iso, but do not contain additional content such
609 1.69 lukem as the distribution sets.
610 1.64 jnemeth
611 1.64 jnemeth Note that the mac68k port still uses an older method of
612 1.64 jnemeth creating CD-ROM images. This requires the mkisofs(1) util-
613 1.64 jnemeth ity, which is not part of NetBSD, but which can be
614 1.64 jnemeth installed from pkgsrc/sysutils/cdrtools.
615 1.64 jnemeth
616 1.1 tv regression-tests
617 1.20 lukem Can only be run after building the regression tests in the
618 1.70 dholland directory ``regress''. Runs those compiled regression
619 1.70 dholland tests on the local host. Note that most tests are now man-
620 1.70 dholland aged instead using atf(7); this target should probably run
621 1.70 dholland those as well but currently does not.
622 1.1 tv
623 1.1 tv The "build.sh" script
624 1.1 tv This script file is a Bourne shell script designed to build the entire
625 1.1 tv NetBSD system on any host with a Bourne shell in /bin/sh, including many
626 1.1 tv that are not POSIX compliant. Note that if a host system's /bin/sh is
627 1.1 tv unusually old and broken, the Korn Shell (/bin/ksh), if available, may be
628 1.1 tv a usable alternative.
629 1.1 tv
630 1.1 tv All cross-compile builds, and most native builds, of the entire system
631 1.1 tv should make use of build.sh rather than just running ``make''. This way,
632 1.1 tv the make(1) program will be bootstrapped properly, in case the host sys-
633 1.1 tv tem has an older or incompatible ``make'' program.
634 1.1 tv
635 1.1 tv When compiling the entire system via build.sh, many make(1) variables are
636 1.1 tv set for you in order to help encapsulate the build process. In the list
637 1.1 tv of options below, variables that are automatically set by build.sh are
638 1.1 tv noted where applicable.
639 1.1 tv
640 1.22 lukem The following operations are supported by build.sh:
641 1.22 lukem
642 1.70 dholland build Build the system as per ``make build''. Before the main
643 1.70 dholland part of the build commences, this command runs the obj
644 1.70 dholland operation (unless the -o option is given), ``make
645 1.70 dholland cleandir'' (unless the -u option is given), and the tools
646 1.70 dholland operation.
647 1.22 lukem
648 1.22 lukem distribution Build a full distribution as per ``make distribution''.
649 1.70 dholland This command first runs the build operation.
650 1.22 lukem
651 1.70 dholland release Build a full release as per ``make release''. This command
652 1.70 dholland first runs the distribution operation.
653 1.22 lukem
654 1.23 lukem makewrapper Create the nbmake-MACHINE wrapper. This operation is auto-
655 1.23 lukem matically performed for any of the other operations.
656 1.23 lukem
657 1.75 lukem cleandir Perform ``make cleandir''.
658 1.75 lukem
659 1.22 lukem obj Perform ``make obj''.
660 1.22 lukem
661 1.70 dholland tools Build and install the host tools from src/tools. This com-
662 1.70 dholland mand will first run ``make obj'' and ``make cleandir'' in
663 1.70 dholland the tools subdirectory unless the -o or -u options (respec-
664 1.70 dholland tively) are given.
665 1.22 lukem
666 1.35 lukem install=idir Install the contents of DESTDIR to idir, using ``make
667 1.61 apb installworld''. Note that files that are part of the
668 1.61 apb ``etc'' or ``xetc'' sets will not be installed.
669 1.35 lukem
670 1.22 lukem kernel=kconf Build a new kernel. The kconf argument is the name of a
671 1.54 apb configuration file suitable for use by config(1). If kconf
672 1.22 lukem does not contain any `/' characters, the configuration file
673 1.22 lukem is expected to be found in the KERNCONFDIR directory, which
674 1.22 lukem is typically sys/arch/MACHINE/conf. The new kernel will be
675 1.22 lukem built in a subdirectory of KERNOBJDIR, which is typically
676 1.22 lukem sys/arch/MACHINE/compile or an associated object directory.
677 1.70 dholland
678 1.70 dholland This command does not imply the tools command; run the
679 1.70 dholland tools command first unless it is certain that the tools
680 1.70 dholland already exist and are up to date.
681 1.70 dholland
682 1.70 dholland This command will run ``make cleandir'' on the kernel in
683 1.70 dholland question first unless the -u option is given.
684 1.22 lukem
685 1.35 lukem releasekernel=kconf
686 1.70 dholland Install a gzip(1)ed copy of the kernel previously built by
687 1.69 lukem kernel=kconf into
688 1.69 lukem RELEASEDIR/RELEASEMACHINEDIR/binary/kernel, usually as
689 1.69 lukem netbsd-kconf.gz, although the ``netbsd'' prefix is deter-
690 1.69 lukem mined from the ``config'' directives in kconf.
691 1.24 lukem
692 1.24 lukem sets Perform ``make sets''.
693 1.31 lukem
694 1.31 lukem sourcesets Perform ``make sourcesets''.
695 1.22 lukem
696 1.54 apb syspkgs Perform ``make syspkgs''.
697 1.54 apb
698 1.56 apb iso-image Perform ``make iso-image''.
699 1.56 apb
700 1.65 jnemeth iso-image-source
701 1.65 jnemeth Perform ``make iso-image-source''.
702 1.65 jnemeth
703 1.51 wiz The following command line options alter the behaviour of the build.sh
704 1.51 wiz operations described above:
705 1.1 tv
706 1.1 tv -a arch Set the value of MACHINE_ARCH to arch.
707 1.9 thorpej
708 1.9 thorpej -B buildid
709 1.9 thorpej Set the value of BUILDID to buildid. This will also append the
710 1.67 sborrill build identifier to the name of the ``make'' wrapper script so
711 1.37 lukem that the resulting name is of the form
712 1.37 lukem ``nbmake-MACHINE-BUILDID''.
713 1.1 tv
714 1.67 sborrill -C cdextras
715 1.67 sborrill Set the value of CDEXTRA to cdextras which is a space-separated
716 1.67 sborrill list of files or directories which will be added in order to
717 1.67 sborrill the CD-ROM image when used in conjunction with ``iso-image'' or
718 1.67 sborrill ``iso-image-source''. Files will be added to the root of the
719 1.67 sborrill CD-ROM image, whereas directories will be copied recursively.
720 1.67 sborrill If relative paths are specified, they will be converted to
721 1.67 sborrill absolute paths before being used.
722 1.66 jnemeth
723 1.59 apb -D dest Set the value of DESTDIR to dest. If a relative path is speci-
724 1.59 apb fied, it will be converted to an absolute path before being
725 1.59 apb used.
726 1.18 lukem
727 1.23 lukem -E Set `expert' mode. This overrides various sanity checks, and
728 1.23 lukem allows: DESTDIR does not have to be set to a non-root path for
729 1.38 lukem builds, and MKUNPRIVED=yes does not have to be set when build-
730 1.38 lukem ing as a non-root user.
731 1.23 lukem
732 1.23 lukem Note: It is highly recommended that you know what you are doing
733 1.23 lukem when you use this option.
734 1.19 lukem
735 1.51 wiz -h Print a help message.
736 1.51 wiz
737 1.70 dholland -j njob Run up to njob make(1) subjobs in parallel; passed through to
738 1.74 apb make(1). If you see failures for reasons other than running
739 1.74 apb out of memory while using build.sh with -j, please save com-
740 1.74 apb plete build logs so the failures can be analyzed.
741 1.74 apb
742 1.74 apb To achieve the fastest builds, -j values between (1 + the num-
743 1.74 apb ber of CPUs) and (2 * the number of CPUs) are recommended. Use
744 1.74 apb lower values on machines with limited memory or I/O bandwidth.
745 1.1 tv
746 1.73 apb -M obj Set MAKEOBJDIRPREFIX to obj. For instance, if the source
747 1.73 apb directory is /usr/src, a setting of ``-M /usr/obj'' will place
748 1.73 apb build-time files under /usr/obj/usr/src/bin,
749 1.73 apb /usr/obj/usr/src/lib, /usr/obj/usr/src/usr.bin, and so forth.
750 1.73 apb If a relative path is specified, it will be converted to an
751 1.73 apb absolute path before being used. Unsets MAKEOBJDIR. See ``-O
752 1.73 apb -obj'' for more information.
753 1.18 lukem
754 1.60 apb -m mach Set the value of MACHINE to mach, except in some special cases
755 1.60 apb listed below. This will also override any value of
756 1.60 apb MACHINE_ARCH in the process environment with a value deduced
757 1.60 apb from mach, unless -a is specified. All cross builds require
758 1.60 apb -m, but if unset on a NetBSD host, the host's value of MACHINE
759 1.60 apb will be detected and used automatically.
760 1.60 apb
761 1.60 apb Some machines support multiple values for MACHINE_ARCH. The
762 1.60 apb following special cases for the mach argument are defined to
763 1.60 apb set the listed values of MACHINE and MACHINE_ARCH:
764 1.33 lukem
765 1.33 lukem mach MACHINE MACHINE_ARCH
766 1.60 apb evbarm evbarm (not set)
767 1.60 apb evbarm-eb evbarm armeb
768 1.60 apb evbarm-el evbarm arm
769 1.33 lukem evbmips evbmips (not set)
770 1.33 lukem evbmips-eb evbmips mipseb
771 1.33 lukem evbmips-el evbmips mipsel
772 1.33 lukem evbsh3 evbsh3 (not set)
773 1.33 lukem evbsh3-eb evbsh3 sh3eb
774 1.33 lukem evbsh3-el evbsh3 sh3el
775 1.33 lukem sbmips sbmips (not set)
776 1.33 lukem sbmips-eb sbmips mipseb
777 1.33 lukem sbmips-el sbmips mipsel
778 1.1 tv
779 1.45 lukem -N noiselevel
780 1.46 lukem Set the ``noisyness'' level of the build, by setting
781 1.46 lukem MAKEVERBOSE to noiselevel.
782 1.45 lukem
783 1.1 tv -n Show the commands that would be executed by build.sh, but do
784 1.1 tv not make any changes. This is similar in concept to ``make
785 1.1 tv -n''.
786 1.1 tv
787 1.18 lukem -O obj Create an appropriate transform macro for MAKEOBJDIR that will
788 1.73 apb place the built object files under obj. For instance, a set-
789 1.73 apb ting of ``-O /usr/obj'' will place build-time files under
790 1.73 apb /usr/obj/bin, /usr/obj/lib, /usr/obj/usr.bin, and so forth. If
791 1.73 apb a relative path is specified, it will be converted to an abso-
792 1.73 apb lute path before being used. Unsets MAKEOBJDIRPREFIX.
793 1.73 apb
794 1.73 apb In normal use, exactly one of the -M or -O options should be
795 1.78 apb specified. If neither -M nor -O is specified, then a default
796 1.78 apb object directory will be chosen according to rules in
797 1.78 apb <bsd.obj.mk>. Relying on this default is not recommended
798 1.78 apb because it is determined by complex rules that are influenced
799 1.78 apb by the values of several variables and by the location of the
800 1.78 apb source directory.
801 1.18 lukem
802 1.34 lukem -o Set the value of MKOBJDIRS to ``no''. Otherwise, it will be
803 1.70 dholland automatically set to ``yes''. This default is opposite to the
804 1.70 dholland behaviour when not using build.sh.
805 1.1 tv
806 1.59 apb -R rel Set the value of RELEASEDIR to rel. If a relative path is
807 1.59 apb specified, it will be converted to an absolute path before
808 1.59 apb being used.
809 1.18 lukem
810 1.1 tv -r Remove the contents of DESTDIR and TOOLDIR before building
811 1.1 tv (provides a clean starting point). This will skip deleting
812 1.1 tv DESTDIR if building on a native system to the root directory.
813 1.1 tv
814 1.72 perry -S seed Change the value of BUILDSEED to seed. This should rarely be
815 1.72 perry necessary.
816 1.72 perry
817 1.59 apb -T tools Set the value of TOOLDIR to tools. If a relative path is spec-
818 1.59 apb ified, it will be converted to an absolute path before being
819 1.70 dholland used. If set, the bootstrap ``make'' will only be rebuilt if
820 1.70 dholland the source files for make(1) have changed.
821 1.18 lukem
822 1.38 lukem -U Set MKUNPRIVED=yes.
823 1.18 lukem
824 1.38 lukem -u Set MKUPDATE=yes.
825 1.1 tv
826 1.21 lukem -V var=[value]
827 1.40 lukem Set the environment variable var to an optional value. This is
828 1.40 lukem propagated to the nbmake wrapper.
829 1.21 lukem
830 1.1 tv -w wrapper
831 1.1 tv Create the nbmake wrapper script (see below) in a custom loca-
832 1.1 tv tion, specified by wrapper. This allows, for instance, to
833 1.1 tv place the wrapper in PATH automatically. Note that wrapper is
834 1.59 apb the full name of the file, not just a directory name. If a
835 1.59 apb relative path is specified, it will be converted to an absolute
836 1.59 apb path before being used.
837 1.1 tv
838 1.49 lukem -X x11src
839 1.59 apb Set the value of X11SRCDIR to x11src. If a relative path is
840 1.59 apb specified, it will be converted to an absolute path before
841 1.59 apb being used.
842 1.49 lukem
843 1.49 lukem -x Set MKX11=yes.
844 1.49 lukem
845 1.40 lukem -Z var Unset ("zap") the environment variable var. This is propagated
846 1.40 lukem to the nbmake wrapper.
847 1.40 lukem
848 1.1 tv The "nbmake-MACHINE" wrapper script
849 1.1 tv If using the build.sh script to build NetBSD, a nbmake-MACHINE script
850 1.1 tv will be created in TOOLDIR/bin upon the first build to assist in building
851 1.1 tv subtrees on a cross-compile host.
852 1.1 tv
853 1.1 tv nbmake-MACHINE can be invoked in lieu of make(1), and will instead call
854 1.1 tv the up-to-date version of ``nbmake'' installed into TOOLDIR/bin with sev-
855 1.1 tv eral key variables pre-set, including MACHINE, MACHINE_ARCH, and TOOLDIR.
856 1.70 dholland nbmake-MACHINE will also set variables specified with -V, and unset vari-
857 1.70 dholland ables specified with -Z.
858 1.40 lukem
859 1.1 tv This script can be symlinked into a directory listed in PATH, or called
860 1.1 tv with an absolute path.
861 1.1 tv
862 1.16 lukem EXAMPLES
863 1.78 apb 1. % ./build.sh [options] tools kernel=GENERIC
864 1.28 lukem
865 1.28 lukem Build a new toolchain, and use the new toolchain to configure and
866 1.28 lukem build a new GENERIC kernel.
867 1.28 lukem
868 1.78 apb 2. % ./build.sh [options] -U distribution
869 1.28 lukem
870 1.30 lukem Using unprivileged mode, build a complete distribution to a DESTDIR
871 1.30 lukem directory that build.sh selects (and will display).
872 1.28 lukem
873 1.78 apb 3. # ./build.sh [options] -U install=/
874 1.28 lukem
875 1.29 lukem As root, install to / the distribution that was built by example 2.
876 1.29 lukem Even though this is run as root, -U is required so that the permis-
877 1.30 lukem sions stored in DESTDIR/METALOG are correctly applied to the files
878 1.30 lukem as they're copied to /.
879 1.28 lukem
880 1.78 apb 4. % ./build.sh [options] -U -u release
881 1.28 lukem
882 1.30 lukem Using unprivileged mode, build a complete release to DESTDIR and
883 1.30 lukem RELEASEDIR directories that build.sh selects (and will display).
884 1.38 lukem MKUPDATE=yes (-u) is set to prevent the ``make cleandir'', so that
885 1.38 lukem if this is run after example 2, it doesn't need to redo that portion
886 1.38 lukem of the release build.
887 1.16 lukem
888 1.10 sommerfe OBSOLETE VARIABLES
889 1.70 dholland NBUILDJOBS Use the make(1) option -j instead.
890 1.15 lukem
891 1.15 lukem USE_NEW_TOOLCHAIN
892 1.15 lukem The new toolchain is now the default. To disable, use
893 1.15 lukem TOOLCHAIN_MISSING=yes.
894 1.10 sommerfe
895 1.1 tv SEE ALSO
896 1.62 apb make(1), hier(7), release(7), etcupdate(8), postinstall(8), sysinst(8),
897 1.61 apb pkgsrc/sysutils/cdrtools
898 1.1 tv
899 1.1 tv HISTORY
900 1.15 lukem The build.sh based build scheme was introduced for NetBSD 1.6 as
901 1.15 lukem USE_NEW_TOOLCHAIN, and re-worked to TOOLCHAIN_MISSING after that.
902 1.1 tv
903 1.78 apb NetBSD September 10, 2008 NetBSD
904