BUILDING revision 1.156 1 1.104 wiz BUILDING(8) System Manager's Manual BUILDING(8)
2 1.1 tv
3 1.105 wiz NAME
4 1.150 lukem BUILDING - Procedure for building NetBSD from source code
5 1.1 tv
6 1.105 wiz REQUIREMENTS
7 1.1 tv NetBSD is designed to be buildable on most POSIX-compliant host systems.
8 1.105 wiz The basic build procedure is the same whether compiling natively (on the
9 1.105 wiz same NetBSD architecture) or cross compiling (on another architecture or
10 1.1 tv OS).
11 1.1 tv
12 1.126 wiz This source tree contains a special subtree, "tools", which uses the host
13 1.126 wiz system to create a build toolchain for the target architecture. The host
14 1.126 wiz system must have at least C and C++ compilers in order to create the
15 1.105 wiz toolchain (make is not required); all other tools are created as part of
16 1.147 lukem the NetBSD build process. (See the Environment variables section below
17 1.53 reed if you need to override or manually select your compilers.)
18 1.1 tv
19 1.155 lukem Note: Within this document, cross-references to manual pages are to the
20 1.155 lukem NetBSD manual pages, not the host system manual pages. The mdoc(7)
21 1.155 lukem source to the NetBSD manual pages can be found within the source tree,
22 1.155 lukem and these and can be formatted with mandoc(1) or nroff(1) if those are
23 1.155 lukem available on the host system. The NetBSD manual pages are also available
24 1.155 lukem at https://man.netbsd.org
25 1.155 lukem
26 1.105 wiz FILES
27 1.105 wiz Source tree layout
28 1.151 lukem BUILDING This document (in plaintext). Generated from
29 1.151 lukem doc/BUILDING.mdoc.
30 1.48 jmc
31 1.105 wiz Makefile The main Makefile for NetBSD; should only be run for
32 1.44 lukem native builds with an appropriately up-to-date version of
33 1.142 andvar NetBSD make(1). Intended for expert use with knowledge of
34 1.129 sevan its shortcomings, it has been superseded by the build.sh
35 1.129 sevan shell script as the recommended means for building NetBSD.
36 1.1 tv
37 1.105 wiz UPDATING Special notes for updating from an earlier revision of
38 1.1 tv NetBSD. It is important to read this file before every
39 1.1 tv build of an updated source tree.
40 1.1 tv
41 1.105 wiz build.sh Bourne-compatible shell script used for building the host
42 1.1 tv build tools and the NetBSD system from scratch. Can be
43 1.1 tv used for both native and cross builds, and should be used
44 1.129 sevan instead of make(1) as it performs additional checks to
45 1.129 sevan prevent common issues going undetected, such as building
46 1.129 sevan with an outdated version of make(1).
47 1.1 tv
48 1.105 wiz crypto/dist/, dist/, gnu/dist/
49 1.104 wiz Sources imported verbatim from third parties, without
50 1.104 wiz mangling the existing build structure. Other source trees
51 1.126 wiz in bin through usr.sbin use the NetBSD make(1) "reachover"
52 1.126 wiz Makefile semantics when building these programs for a
53 1.126 wiz native host.
54 1.104 wiz
55 1.151 lukem distrib/, etc/
56 1.151 lukem Sources for items used when making a full release
57 1.151 lukem snapshot, such as files installed in DESTDIR/etc on the
58 1.151 lukem destination system, boot media, and release notes.
59 1.151 lukem
60 1.151 lukem doc/BUILDING.mdoc
61 1.155 lukem The source to this document, in mdoc(7) format. Used to
62 1.155 lukem generate BUILDING.
63 1.151 lukem
64 1.106 wiz external, sys/external
65 1.106 wiz Sources and build infrastructure for components imported
66 1.106 wiz (mostly) unchanged from upstream maintainers, sorted by
67 1.106 wiz applicable license. This is (slowly) replacing the
68 1.106 wiz crypto/dist, dist, and gnu/dist directories.
69 1.106 wiz
70 1.151 lukem external/mit/xorg/
71 1.151 lukem "Reachover" build structure for modular Xorg; the source
72 1.151 lukem is in X11SRCDIR.
73 1.1 tv
74 1.151 lukem regress/, tests/
75 1.70 dholland Regression test harness. Can be cross-compiled, but only
76 1.105 wiz run natively. tests/ uses the atf(7) test framework;
77 1.105 wiz regress/ contains older tests that have not yet been
78 1.70 dholland migrated to atf(7).
79 1.1 tv
80 1.105 wiz sys/ NetBSD kernel sources.
81 1.1 tv
82 1.126 wiz tools/ "Reachover" build structure for the host build tools.
83 1.104 wiz This has a special method of determining out-of-date
84 1.104 wiz status.
85 1.1 tv
86 1.151 lukem tools/compat/README
87 1.151 lukem Special notes for cross-hosting a NetBSD build on non-
88 1.151 lukem NetBSD platforms.
89 1.151 lukem
90 1.151 lukem Other directories including bin/ ... usr.sbin/
91 1.1 tv Sources to the NetBSD userland (non-kernel) programs. If
92 1.1 tv any of these directories are missing, they will be skipped
93 1.1 tv during the build.
94 1.1 tv
95 1.105 wiz Build tree layout
96 1.156 lukem The NetBSD build tree is described in hier(7) (whose mdoc(7) source is in
97 1.155 lukem share/man/man7/hier.7), and the release layout is described in release(7)
98 1.156 lukem (whose mdoc(7) source is in share/man/man7/release.7).
99 1.1 tv
100 1.105 wiz CONFIGURATION
101 1.105 wiz Environment variables
102 1.8 lukem Several environment variables control the behaviour of NetBSD builds.
103 1.8 lukem
104 1.152 lukem HOST_CC Path name to C compiler used to create the toolchain.
105 1.58 apb
106 1.155 lukem Default: "cc".
107 1.155 lukem
108 1.152 lukem HOST_CFLAGS Flags passed to the host C compiler.
109 1.53 reed
110 1.155 lukem Default: "-O".
111 1.155 lukem
112 1.155 lukem HOST_CPPFLAGS Flags passed to the host C/C++ pre-processor.
113 1.155 lukem
114 1.155 lukem Default: Unset.
115 1.155 lukem
116 1.152 lukem HOST_CXX Path name to C++ compiler used to create the toolchain.
117 1.137 uwe
118 1.155 lukem Default: Unset, but defaults to "c++" where required.
119 1.155 lukem
120 1.152 lukem HOST_CXXFLAGS Flags passed to the host C++ compiler.
121 1.53 reed
122 1.155 lukem Default: Unset.
123 1.155 lukem
124 1.152 lukem HOST_SH Path name to a shell available on the host system and
125 1.152 lukem suitable for use during the build. The NetBSD build
126 1.152 lukem system requires a modern Bourne-like shell with POSIX-
127 1.152 lukem compliant features, and also requires support for the
128 1.152 lukem "local" keyword to declare local variables in shell
129 1.152 lukem functions (which is a widely-implemented but non-
130 1.152 lukem standardised feature).
131 1.152 lukem
132 1.152 lukem Depending on the host system, a suitable shell may be
133 1.152 lukem /bin/sh, /usr/xpg4/bin/sh, /bin/ksh (provided it is a
134 1.152 lukem variant of ksh that supports the "local" keyword, such as
135 1.152 lukem ksh88, but not ksh93), or /usr/local/bin/bash.
136 1.152 lukem
137 1.152 lukem Most parts of the build require HOST_SH to be an absolute
138 1.152 lukem path; however, build.sh allows it to be a simple command
139 1.152 lukem name, which will be converted to an absolute path by
140 1.152 lukem searching the PATH.
141 1.137 uwe
142 1.155 lukem Default: "sh".
143 1.155 lukem
144 1.147 lukem INSTALLBOOT_UBOOT_PATHS
145 1.152 lukem A colon-separated list of search paths used by
146 1.152 lukem installboot(8) to find U-Boot packages.
147 1.147 lukem
148 1.155 lukem Default: Unset.
149 1.155 lukem
150 1.152 lukem MACHINE Machine type, e.g., "macppc".
151 1.8 lukem
152 1.155 lukem Default: Unset.
153 1.155 lukem
154 1.152 lukem MACHINE_ARCH Machine architecture, e.g., "powerpc".
155 1.8 lukem
156 1.155 lukem Default: Unset.
157 1.155 lukem
158 1.152 lukem MAKE Path name to invoke make(1) as.
159 1.8 lukem
160 1.155 lukem Default: "make".
161 1.155 lukem
162 1.152 lukem MAKECONF The name of the make(1) configuration file. See "make"
163 1.152 lukem variables and mk.conf(5).
164 1.151 lukem
165 1.152 lukem Note: Only settable in the process environment.
166 1.151 lukem
167 1.155 lukem Default: "/etc/mk.conf".
168 1.151 lukem
169 1.152 lukem MAKEFLAGS Flags to invoke make(1) with.
170 1.151 lukem
171 1.152 lukem Note: build.sh ignores the value of MAKEFLAGS passed in
172 1.152 lukem the environment, but allows MAKEFLAGS to be set via the
173 1.152 lukem -V option.
174 1.151 lukem
175 1.155 lukem Default: "-X" on systems with a small ARG_MAX (Cygwin,
176 1.155 lukem Darwin, FreeBSD); otherwise unset.
177 1.155 lukem
178 1.152 lukem MAKEOBJDIR Directory to use as the .OBJDIR for the current
179 1.152 lukem directory. The value is subjected to variable expansion
180 1.152 lukem by make(1). Typical usage is to set this variable to a
181 1.152 lukem value involving the use of `${.CURDIR:S...}' or
182 1.152 lukem `${.CURDIR:C...}', to derive the value of .OBJDIR from
183 1.152 lukem the value of .CURDIR. Used only if MAKEOBJDIRPREFIX is
184 1.152 lukem not defined.
185 1.151 lukem
186 1.152 lukem Note: MAKEOBJDIR can be provided only in the environment
187 1.152 lukem or via the -O flag of build.sh; it cannot usefully be set
188 1.152 lukem inside a Makefile, including in mk.conf(5) or MAKECONF.
189 1.151 lukem
190 1.155 lukem Default: Unset.
191 1.155 lukem
192 1.151 lukem MAKEOBJDIRPREFIX
193 1.152 lukem Top level directory of the object directory tree. The
194 1.152 lukem value is subjected to variable expansion by make(1).
195 1.152 lukem build.sh will create the ${MAKEOBJDIRPREFIX} directory if
196 1.152 lukem necessary, but if make(1) is used without build.sh, then
197 1.152 lukem rules in <bsd.obj.mk> will abort the build if the
198 1.152 lukem ${MAKEOBJDIRPREFIX} directory does not exist. If the
199 1.152 lukem value is defined and valid, then
200 1.152 lukem ${MAKEOBJDIRPREFIX}/${.CURDIR} is used as the .OBJDIR for
201 1.152 lukem the current directory. The current directory may be read
202 1.152 lukem only.
203 1.152 lukem
204 1.152 lukem Note: MAKEOBJDIRPREFIX can be provided only in the
205 1.152 lukem environment or via the -M flag of build.sh; it cannot
206 1.152 lukem usefully be set inside a Makefile, including in
207 1.152 lukem mk.conf(5) or MAKECONF.
208 1.152 lukem
209 1.155 lukem Default: Unset.
210 1.155 lukem
211 1.152 lukem TMPDIR Top-level directory to store temporary directories used
212 1.152 lukem by build.sh before paths to other directories such as
213 1.152 lukem .OBJDIR can be determined.
214 1.149 lukem
215 1.152 lukem Note: Must support execution of binaries. I.e., without
216 1.152 lukem mount(8)'s -o noexec option.
217 1.149 lukem
218 1.152 lukem Default: "/tmp".
219 1.149 lukem
220 1.105 wiz "make" variables
221 1.156 lukem Variables that control the behavior of NetBSD builds are documented in
222 1.156 lukem mk.conf(5) (whose mdoc(7) source is in share/man/man5/mk.conf.5).
223 1.45 lukem
224 1.155 lukem Unless otherwise specified, these variables may be set in either the
225 1.155 lukem process environment or the make(1) configuration file mk.conf(5)
226 1.155 lukem specified by MAKECONF.
227 1.49 lukem
228 1.105 wiz BUILDING
229 1.105 wiz "make" command line options
230 1.52 jmc This is not a summary of all the options available to make(1); only the
231 1.52 jmc options used most frequently with NetBSD builds are listed here.
232 1.1 tv
233 1.105 wiz -j njob Run up to njob make(1) subjobs in parallel. Makefiles should
234 1.52 jmc use .WAIT or have explicit dependencies as necessary to
235 1.74 apb enforce build ordering.
236 1.10 sommerfe
237 1.105 wiz -m dir Specify the default directory for searching for system
238 1.104 wiz Makefile segments, mainly the <bsd.*.mk> files. When building
239 1.104 wiz any full NetBSD source tree, this should be set to the
240 1.126 wiz "share/mk" directory in the source tree. This is set
241 1.104 wiz automatically when building from the top level, or when using
242 1.105 wiz build.sh.
243 1.1 tv
244 1.148 lukem -n Show the commands that would have been executed, but do not
245 1.1 tv actually execute them. This will still cause recursion to
246 1.1 tv take place.
247 1.1 tv
248 1.148 lukem -V var Show make(1)'s idea of the value of var. Does not build any
249 1.1 tv targets.
250 1.1 tv
251 1.105 wiz var=value Set the variable var to value, overriding any setting
252 1.105 wiz specified by the process environment, the MAKECONF
253 1.104 wiz configuration file, or the system Makefile segments.
254 1.1 tv
255 1.105 wiz "make" targets
256 1.1 tv These default targets may be built by running make(1) in any subtree of
257 1.1 tv the NetBSD source code. It is recommended that none of these be used
258 1.126 wiz from the top level Makefile; as a specific exception, "make obj" and
259 1.126 wiz "make cleandir" are useful in that context.
260 1.1 tv
261 1.105 wiz all Build programs, libraries, and preformatted documentation.
262 1.1 tv
263 1.105 wiz clean Remove program and library object code files.
264 1.1 tv
265 1.105 wiz cleandir Same as clean, but also remove preformatted documentation,
266 1.126 wiz dependency files generated by "make depend", and any other
267 1.49 lukem files known to be created at build time.
268 1.1 tv
269 1.105 wiz depend Create dependency files (.depend) containing more detailed
270 1.44 lukem information about the dependencies of source code on header
271 1.1 tv files. Allows programs to be recompiled automatically when a
272 1.1 tv dependency changes.
273 1.1 tv
274 1.126 wiz dependall Does a "make depend" immediately followed by a "make all".
275 1.10 sommerfe This improves cache locality of the build since both passes
276 1.10 sommerfe read the source files in their entirety.
277 1.1 tv
278 1.105 wiz distclean Synonym for cleandir.
279 1.49 lukem
280 1.105 wiz includes Build and install system header files. Typically needed
281 1.44 lukem before any system libraries or programs can be built.
282 1.1 tv
283 1.105 wiz install Install programs, libraries, and documentation into DESTDIR.
284 1.105 wiz Few files will be installed to DESTDIR/dev, DESTDIR/etc,
285 1.105 wiz DESTDIR/root or DESTDIR/var in order to prevent user supplied
286 1.27 lukem configuration data from being overwritten.
287 1.1 tv
288 1.105 wiz lint Run lint(1) against the C source code, where appropriate, and
289 1.1 tv generate system-installed lint libraries.
290 1.1 tv
291 1.105 wiz obj Create object directories to be used for built files, instead
292 1.1 tv of building directly in the source tree.
293 1.1 tv
294 1.105 wiz tags Create ctags(1) searchable function lists usable by the ex(1)
295 1.1 tv and vi(1) text editors.
296 1.1 tv
297 1.105 wiz "make" targets for the top level
298 1.1 tv Additional make(1) targets are usable specifically from the top source
299 1.1 tv level to facilitate building the entire NetBSD source tree.
300 1.1 tv
301 1.105 wiz build Build the entire NetBSD system (except the kernel). This
302 1.68 reed orders portions of the source tree such that prerequisites
303 1.68 reed will be built in the proper order.
304 1.20 lukem
305 1.126 wiz distribution Do a "make build", and then install a full distribution
306 1.105 wiz (which does not include a kernel) into DESTDIR, including
307 1.105 wiz files in DESTDIR/dev, DESTDIR/etc, DESTDIR/root and
308 1.105 wiz DESTDIR/var.
309 1.20 lukem
310 1.126 wiz buildworld As per "make distribution", except that it ensures that
311 1.105 wiz DESTDIR is not the root directory.
312 1.20 lukem
313 1.105 wiz installworld Install the distribution from DESTDIR to INSTALLWORLDDIR,
314 1.70 dholland which defaults to the root directory. Ensures that
315 1.105 wiz INSTALLWORLDDIR is not the root directory if cross
316 1.104 wiz compiling.
317 1.20 lukem
318 1.105 wiz The INSTALLSETS environment variable may be set to a space-
319 1.95 apb separated list of distribution sets to be installed. By
320 1.126 wiz default, all sets except "etc" and "xetc" are installed, so
321 1.126 wiz most files in INSTALLWORLDDIR/etc will not be installed or
322 1.126 wiz modified.
323 1.61 apb
324 1.105 wiz Note: Before performing this operation with
325 1.105 wiz INSTALLWORLDDIR=/, it is highly recommended that you
326 1.61 apb upgrade your kernel and reboot. After performing this
327 1.61 apb operation, it is recommended that you use etcupdate(8) to
328 1.105 wiz update files in INSTALLWORLDDIR/etc, and postinstall(8) to
329 1.102 abs check for or fix inconsistencies.
330 1.20 lukem
331 1.105 wiz sets Create distribution sets from DESTDIR into
332 1.105 wiz RELEASEDIR/RELEASEMACHINEDIR/binary/sets. Should be run
333 1.126 wiz after "make distribution", as "make build" alone does not
334 1.126 wiz install all of the required files.
335 1.25 lukem
336 1.105 wiz sourcesets Create source sets of the source tree into
337 1.105 wiz RELEASEDIR/source/sets.
338 1.31 lukem
339 1.105 wiz syspkgs Create syspkgs from DESTDIR into
340 1.105 wiz RELEASEDIR/RELEASEMACHINEDIR/binary/syspkgs. Should be run
341 1.126 wiz after "make distribution", as "make build" alone does not
342 1.126 wiz install all of the required files.
343 1.54 apb
344 1.126 wiz release Do a "make distribution", build kernels, distribution
345 1.126 wiz media, and install sets (this as per "make sets"), and then
346 1.126 wiz package the system into a standard release layout as
347 1.105 wiz described by release(7). This requires that RELEASEDIR be
348 1.25 lukem set (see above).
349 1.1 tv
350 1.105 wiz iso-image Create a NetBSD installation CD-ROM image in the
351 1.114 snj RELEASEDIR/images directory. The CD-ROM file system will
352 1.114 snj have a layout as described in release(7).
353 1.62 apb
354 1.62 apb For most machine types, the CD-ROM will be bootable, and
355 1.104 wiz will automatically run the sysinst(8) menu-based
356 1.104 wiz installation program, which can be used to install or
357 1.104 wiz upgrade a NetBSD system. Bootable CD-ROMs also contain
358 1.104 wiz tools that may be useful in repairing a damaged NetBSD
359 1.104 wiz installation.
360 1.62 apb
361 1.126 wiz Before "make iso-image" is attempted, RELEASEDIR must be
362 1.126 wiz populated by "make release" or equivalent.
363 1.62 apb
364 1.151 lukem Note: Other, smaller, CD-ROM images may be created in the
365 1.151 lukem RELEASEDIR/RELEASEMACHINEDIR/installation/cdrom directory
366 1.151 lukem by "make release". These smaller images usually contain
367 1.151 lukem the same tools as the larger images in RELEASEDIR/images,
368 1.151 lukem but do not contain additional content such as the
369 1.151 lukem distribution sets.
370 1.62 apb
371 1.151 lukem Note: The mac68k port still uses an older method of
372 1.104 wiz creating CD-ROM images. This requires the mkisofs(1)
373 1.104 wiz utility, which is not part of NetBSD, but which can be
374 1.105 wiz installed from pkgsrc/sysutils/cdrtools.
375 1.56 apb
376 1.105 wiz iso-image-source
377 1.64 jnemeth Create a NetBSD installation CD-ROM image in the
378 1.114 snj RELEASEDIR/images directory. The CD-ROM file system will
379 1.114 snj have a layout as described in release(7). It will have top
380 1.64 jnemeth level directories for the machine type and source.
381 1.64 jnemeth
382 1.64 jnemeth For most machine types, the CD-ROM will be bootable, and
383 1.104 wiz will automatically run the sysinst(8) menu-based
384 1.104 wiz installation program, which can be used to install or
385 1.104 wiz upgrade a NetBSD system. Bootable CD-ROMs also contain
386 1.104 wiz tools that may be useful in repairing a damaged NetBSD
387 1.104 wiz installation.
388 1.64 jnemeth
389 1.126 wiz Before "make iso-image-source" is attempted, RELEASEDIR
390 1.126 wiz must be populated by "make sourcesets release" or
391 1.104 wiz equivalent.
392 1.64 jnemeth
393 1.151 lukem Note: Other, smaller, CD-ROM images may be created in the
394 1.151 lukem RELEASEDIR/RELEASEMACHINEDIR/installation/cdrom directory
395 1.151 lukem by "make release". These smaller images usually contain
396 1.151 lukem the same tools as the larger images in RELEASEDIR/images,
397 1.151 lukem but do not contain additional content such as the
398 1.151 lukem distribution sets.
399 1.64 jnemeth
400 1.151 lukem Note: The mac68k port still uses an older method of
401 1.104 wiz creating CD-ROM images. This requires the mkisofs(1)
402 1.104 wiz utility, which is not part of NetBSD, but which can be
403 1.105 wiz installed from pkgsrc/sysutils/cdrtools.
404 1.64 jnemeth
405 1.105 wiz install-image
406 1.98 apb Create a bootable NetBSD installation disk image in the
407 1.127 plunky RELEASEDIR/images directory. The installation disk image
408 1.127 plunky is suitable for copying to bootable USB flash memory
409 1.127 plunky sticks, etc., for machines which are able to boot from such
410 1.127 plunky devices. The file system in the bootable disk image will
411 1.127 plunky have a layout as described in release(7).
412 1.97 tsutsui
413 1.97 tsutsui The installation image is bootable, and will automatically
414 1.97 tsutsui run the sysinst(8) menu-based installation program, which
415 1.98 apb can be used to install or upgrade a NetBSD system. The
416 1.98 apb image also contains tools that may be useful in repairing a
417 1.98 apb damaged NetBSD installation.
418 1.97 tsutsui
419 1.126 wiz Before "make install-image" is attempted, RELEASEDIR must
420 1.126 wiz be populated by "make release" or equivalent. The build
421 1.126 wiz must have been performed with MKUNPRIVED=yes because "make
422 1.126 wiz install-image" relies on information in DESTDIR/METALOG.
423 1.97 tsutsui
424 1.120 pgoyette live-image Create NetBSD live images in the RELEASEDIR/images
425 1.104 wiz directory. The live image contains all necessary files to
426 1.104 wiz boot NetBSD up to multi-user mode, including all files
427 1.104 wiz which should be extracted during installation, NetBSD
428 1.104 wiz disklabel, bootloaders, etc.
429 1.104 wiz
430 1.104 wiz The live image is suitable for use as a disk image in
431 1.104 wiz virtual machine environments such as QEMU, and also useful
432 1.104 wiz to boot NetBSD from a USB flash memory stick on a real
433 1.98 apb machine, without the need for installation.
434 1.97 tsutsui
435 1.126 wiz Before "make live-image" is attempted, RELEASEDIR must be
436 1.126 wiz populated by "make release" or equivalent. The build must
437 1.126 wiz have been performed with MKUNPRIVED=yes because "make
438 1.126 wiz install-image" relies on information in DESTDIR/METALOG.
439 1.97 tsutsui
440 1.105 wiz regression-tests
441 1.20 lukem Can only be run after building the regression tests in the
442 1.126 wiz directory "regress". Runs those compiled regression tests
443 1.151 lukem on the local host.
444 1.151 lukem
445 1.151 lukem Note: Most tests are now managed instead using atf(7); this
446 1.151 lukem target should probably run those as well but currently does
447 1.151 lukem not.
448 1.1 tv
449 1.105 wiz The "build.sh" script
450 1.96 apb This script file is a shell script designed to build the entire NetBSD
451 1.104 wiz system on any host with a suitable modern shell and some common
452 1.105 wiz utilities. The required shell features are described under the HOST_SH
453 1.104 wiz variable.
454 1.96 apb
455 1.96 apb If a host system's default shell does support the required features, then
456 1.96 apb we suggest that you explicitly specify a suitable shell using a command
457 1.96 apb like
458 1.96 apb
459 1.105 wiz /path/to/suitable/shell build.sh [options]
460 1.96 apb
461 1.105 wiz The above command will usually enable build.sh to automatically set
462 1.105 wiz HOST_SH=/path/to/suitable/shell, but if that fails, then the following
463 1.96 apb set of commands may be used instead:
464 1.96 apb
465 1.105 wiz HOST_SH=/path/to/suitable/shell
466 1.96 apb export HOST_SH
467 1.105 wiz ${HOST_SH} build.sh [options]
468 1.96 apb
469 1.105 wiz If build.sh detects that it is being executed under an unsuitable shell,
470 1.148 lukem it attempts to exec a suitable shell instead, or shows an error message.
471 1.105 wiz If HOST_SH is not set explicitly, then build.sh sets a default using
472 1.96 apb heuristics dependent on the host platform, or from the shell under which
473 1.105 wiz build.sh is executed (if that can be determined), or using the first copy
474 1.105 wiz of sh found in PATH.
475 1.1 tv
476 1.1 tv All cross-compile builds, and most native builds, of the entire system
477 1.126 wiz should make use of build.sh rather than just running "make". This way,
478 1.104 wiz the make(1) program will be bootstrapped properly, in case the host
479 1.126 wiz system has an older or incompatible "make" program.
480 1.1 tv
481 1.105 wiz When compiling the entire system via build.sh, many make(1) variables are
482 1.1 tv set for you in order to help encapsulate the build process. In the list
483 1.105 wiz of options below, variables that are automatically set by build.sh are
484 1.1 tv noted where applicable.
485 1.1 tv
486 1.105 wiz The following operations are supported by build.sh:
487 1.22 lukem
488 1.126 wiz build Build the system as per "make build". Before the main part
489 1.126 wiz of the build commences, this command runs the obj operation
490 1.126 wiz (unless the -o option is given), "make cleandir" (unless
491 1.126 wiz the -u option is given), and the tools operation.
492 1.22 lukem
493 1.126 wiz distribution Build a full distribution as per "make distribution". This
494 1.126 wiz command first runs the build operation.
495 1.22 lukem
496 1.126 wiz release Build a full release as per "make release". This command
497 1.105 wiz first runs the distribution operation.
498 1.22 lukem
499 1.148 lukem help Show a help message, and exit.
500 1.148 lukem
501 1.105 wiz makewrapper Create the nbmake-MACHINE wrapper. This operation is
502 1.104 wiz automatically performed for any of the other operations.
503 1.23 lukem
504 1.126 wiz cleandir Perform "make cleandir".
505 1.75 lukem
506 1.126 wiz obj Perform "make obj".
507 1.22 lukem
508 1.105 wiz tools Build and install the host tools from src/tools. This
509 1.126 wiz command will first run "make obj" and "make cleandir" in
510 1.126 wiz the tools subdirectory unless the -o or -u options
511 1.104 wiz (respectively) are given.
512 1.22 lukem
513 1.126 wiz install=idir Install the contents of DESTDIR to idir, using "make
514 1.151 lukem installworld".
515 1.151 lukem
516 1.151 lukem Note: Files that are part of the "etc" or "xetc" sets will
517 1.151 lukem not be installed, unless overridden by the INSTALLSETS
518 1.151 lukem environment variable.
519 1.35 lukem
520 1.105 wiz kernel=kconf Build a new kernel. The kconf argument is the name of a
521 1.105 wiz configuration file suitable for use by config(1). If kconf
522 1.22 lukem does not contain any `/' characters, the configuration file
523 1.105 wiz is expected to be found in the KERNCONFDIR directory, which
524 1.105 wiz is typically sys/arch/MACHINE/conf. The new kernel will be
525 1.105 wiz built in a subdirectory of KERNOBJDIR, which is typically
526 1.105 wiz sys/arch/MACHINE/compile or an associated object directory.
527 1.70 dholland
528 1.105 wiz This command does not imply the tools command; run the
529 1.105 wiz tools command first unless it is certain that the tools
530 1.70 dholland already exist and are up to date.
531 1.70 dholland
532 1.126 wiz This command will run "make cleandir" on the kernel in
533 1.105 wiz question first unless the -u option is given.
534 1.22 lukem
535 1.106 wiz kernel.gdb=kconf
536 1.106 wiz Build a new kernel with debug information. Similar to the
537 1.106 wiz above kernel=kconf operation, but creates a netbsd.gdb file
538 1.106 wiz alongside of the kernel netbsd, which contains a full
539 1.106 wiz symbol table and can be used for debugging (for example
540 1.106 wiz with a cross-gdb built by MKCROSSGDB).
541 1.106 wiz
542 1.113 uebayasi kernels This command will build all kernels defined in port
543 1.113 uebayasi specific release build procedure.
544 1.111 uebayasi
545 1.112 uebayasi This command internally calls the kernel=kconf operation
546 1.112 uebayasi for each found kernel configuration file.
547 1.111 uebayasi
548 1.105 wiz modules This command will build kernel modules and install them
549 1.105 wiz into DESTDIR.
550 1.86 jnemeth
551 1.105 wiz releasekernel=kconf
552 1.70 dholland Install a gzip(1)ed copy of the kernel previously built by
553 1.105 wiz kernel=kconf into
554 1.105 wiz RELEASEDIR/RELEASEMACHINEDIR/binary/kernel, usually as
555 1.126 wiz netbsd-kconf.gz, although the "netbsd" prefix is determined
556 1.126 wiz from the "config" directives in kconf.
557 1.24 lukem
558 1.126 wiz sets Perform "make sets".
559 1.31 lukem
560 1.126 wiz sourcesets Perform "make sourcesets".
561 1.22 lukem
562 1.126 wiz syspkgs Perform "make syspkgs".
563 1.54 apb
564 1.126 wiz iso-image Perform "make iso-image".
565 1.56 apb
566 1.105 wiz iso-image-source
567 1.126 wiz Perform "make iso-image-source".
568 1.65 jnemeth
569 1.105 wiz install-image
570 1.126 wiz Perform "make install-image".
571 1.97 tsutsui
572 1.126 wiz live-image Perform "make live-image".
573 1.97 tsutsui
574 1.148 lukem list-arch Show a list of valid MACHINE and MACHINE_ARCH settings, the
575 1.148 lukem default MACHINE_ARCH for each MACHINE, and aliases for
576 1.109 apb MACHINE/MACHINE_ARCH pairs, and then exits. The -m or -a
577 1.109 apb options (or both) may be used to specify glob patterns that
578 1.109 apb will be used to narrow the list of results; for example,
579 1.131 leot "build.sh -m 'evb*' -a '*arm*' list-arch" will list all
580 1.109 apb known MACHINE/MACHINE_ARCH values in which either MACHINE
581 1.109 apb or ALIAS matches the pattern `evb*', and MACHINE_ARCH
582 1.109 apb matches the pattern `*arm*'.
583 1.109 apb
584 1.105 wiz The following command line options alter the behaviour of the build.sh
585 1.51 wiz operations described above:
586 1.1 tv
587 1.109 apb -a arch Set the value of MACHINE_ARCH to arch. See the -m option for
588 1.109 apb more information.
589 1.9 thorpej
590 1.105 wiz -B buildid
591 1.105 wiz Set the value of BUILDID to buildid. This will also append the
592 1.126 wiz build identifier to the name of the "make" wrapper script so
593 1.37 lukem that the resulting name is of the form
594 1.126 wiz "nbmake-MACHINE-BUILDID".
595 1.1 tv
596 1.105 wiz -C cdextras
597 1.105 wiz Append cdextras to the CDEXTRA variable, which is a space-
598 1.104 wiz separated list of files or directories that will be added to
599 1.126 wiz the CD-ROM image that may be create by the "iso-image" or
600 1.126 wiz "iso-image-source" operations. Files will be added to the root
601 1.126 wiz of the CD-ROM image, whereas directories will be copied
602 1.87 apb recursively. If relative paths are specified, they will be
603 1.87 apb converted to absolute paths before being used. Multiple paths
604 1.105 wiz may be specified via multiple -C options, or via a single
605 1.87 apb option whose argument contains multiple space-separated paths.
606 1.66 jnemeth
607 1.136 uwe -c compiler
608 1.136 uwe Select the compiler for the toolchain to build NetBSD and for
609 1.136 uwe inclusion in the NetBSD distribution. Supported choices:
610 1.136 uwe
611 1.136 uwe clang
612 1.136 uwe
613 1.136 uwe gcc [default]
614 1.136 uwe
615 1.136 uwe The compiler used to build the toolchain can be different; see
616 1.136 uwe HOST_CC and HOST_CXX.
617 1.136 uwe
618 1.105 wiz -D dest Set the value of DESTDIR to dest. If a relative path is
619 1.104 wiz specified, it will be converted to an absolute path before
620 1.104 wiz being used.
621 1.104 wiz
622 1.105 wiz -E Set `expert' mode. This overrides various sanity checks, and
623 1.105 wiz allows: DESTDIR does not have to be set to a non-root path for
624 1.105 wiz builds, and MKUNPRIVED=yes does not have to be set when
625 1.104 wiz building as a non-root user.
626 1.23 lukem
627 1.105 wiz Note: It is highly recommended that you know what you are doing
628 1.23 lukem when you use this option.
629 1.19 lukem
630 1.148 lukem -h Show a help message, and exit.
631 1.51 wiz
632 1.105 wiz -j njob Run up to njob make(1) subjobs in parallel; passed through to
633 1.74 apb make(1). If you see failures for reasons other than running
634 1.105 wiz out of memory while using build.sh with -j, please save
635 1.104 wiz complete build logs so the failures can be analyzed.
636 1.74 apb
637 1.105 wiz To achieve the fastest builds, -j values between (1 + the
638 1.104 wiz number of CPUs) and (2 * the number of CPUs) are recommended.
639 1.104 wiz Use lower values on machines with limited memory or I/O
640 1.104 wiz bandwidth.
641 1.104 wiz
642 1.126 wiz -M obj Set MAKEOBJDIRPREFIX to obj. Unsets MAKEOBJDIR. See "-O obj"
643 1.126 wiz for more information.
644 1.104 wiz
645 1.105 wiz For instance, if the source directory is /usr/src, a setting of
646 1.126 wiz "-M /usr/obj" will place build-time files under
647 1.105 wiz /usr/obj/usr/src/bin, /usr/obj/usr/src/lib,
648 1.105 wiz /usr/obj/usr/src/usr.bin, and so forth.
649 1.88 apb
650 1.73 apb If a relative path is specified, it will be converted to an
651 1.105 wiz absolute path before being used. build.sh imposes the
652 1.105 wiz restriction that the argument to the -M option must not begin
653 1.126 wiz with a "$" (dollar sign) character; otherwise it would be too
654 1.104 wiz difficult to determine whether the value is an absolute or a
655 1.104 wiz relative path. If the directory does not already exist,
656 1.105 wiz build.sh will create it.
657 1.18 lukem
658 1.109 apb -m mach Set the value of MACHINE to mach, unless the mach argument is
659 1.109 apb an alias that refers to a MACHINE/MACHINE_ARCH pair, in which
660 1.109 apb case both MACHINE and MACHINE_ARCH are set from the alias.
661 1.109 apb Such aliases are interpreted entirely by build.sh; they are not
662 1.109 apb used by any other part of the build system. The MACHINE_ARCH
663 1.109 apb setting implied by mach will override any value of MACHINE_ARCH
664 1.109 apb in the process environment, but will not override a value set
665 1.109 apb by the -a option. All cross builds require -m, but if unset on
666 1.109 apb a NetBSD host, the host's value of MACHINE will be detected and
667 1.109 apb used automatically.
668 1.109 apb
669 1.109 apb See the list-arch operation for a way to get a list of valid
670 1.109 apb MACHINE and MACHINE_ARCH settings.
671 1.1 tv
672 1.105 wiz -N noiselevel
673 1.126 wiz Set the "noisyness" level of the build, by setting MAKEVERBOSE
674 1.126 wiz to noiselevel.
675 1.45 lukem
676 1.105 wiz -n Show the commands that would be executed by build.sh, but do
677 1.126 wiz not make any changes. This is similar in concept to "make -n".
678 1.1 tv
679 1.105 wiz -O obj Create an appropriate transform macro for MAKEOBJDIR that will
680 1.105 wiz place the built object files under obj. Unsets
681 1.105 wiz MAKEOBJDIRPREFIX.
682 1.88 apb
683 1.126 wiz For instance, a setting of "-O /usr/obj" will place build-time
684 1.126 wiz files under /usr/obj/bin, /usr/obj/lib, /usr/obj/usr.bin, and
685 1.126 wiz so forth.
686 1.88 apb
687 1.88 apb If a relative path is specified, it will be converted to an
688 1.105 wiz absolute path before being used. build.sh imposes the
689 1.105 wiz restriction that the argument to the -O option must not contain
690 1.126 wiz a "$" (dollar sign) character. If the directory does not
691 1.105 wiz already exist, build.sh will create it.
692 1.73 apb
693 1.105 wiz In normal use, exactly one of the -M or -O options should be
694 1.105 wiz specified. If neither -M nor -O is specified, then a default
695 1.78 apb object directory will be chosen according to rules in
696 1.78 apb <bsd.obj.mk>. Relying on this default is not recommended
697 1.78 apb because it is determined by complex rules that are influenced
698 1.78 apb by the values of several variables and by the location of the
699 1.78 apb source directory.
700 1.18 lukem
701 1.151 lukem Note: Placing the obj directory location outside of the default
702 1.151 lukem source tree hierarchy makes it easier to manually clear out old
703 1.151 lukem files in the event the "make cleandir" operation is unable to
704 1.151 lukem do so. (See CAVEATS below.)
705 1.151 lukem
706 1.151 lukem Note: The use of one of -M or -O is the only means of building
707 1.151 lukem multiple machine architecture userlands from the same source
708 1.151 lukem tree without cleaning between builds (in which case, one would
709 1.151 lukem specify distinct obj locations for each).
710 1.109 apb
711 1.126 wiz -o Set the value of MKOBJDIRS to "no". Otherwise, it will be
712 1.126 wiz automatically set to "yes". This default is opposite to the
713 1.105 wiz behaviour when not using build.sh.
714 1.1 tv
715 1.148 lukem -P Set the value of MKREPRO and MKREPRO_TIMESTAMP to the latest
716 1.148 lukem source CVS timestamp for reproducible builds.
717 1.148 lukem
718 1.105 wiz -R rel Set the value of RELEASEDIR to rel. If a relative path is
719 1.59 apb specified, it will be converted to an absolute path before
720 1.59 apb being used.
721 1.18 lukem
722 1.105 wiz -r Remove the contents of DESTDIR and TOOLDIR before building
723 1.1 tv (provides a clean starting point). This will skip deleting
724 1.105 wiz DESTDIR if building on a native system to the root directory.
725 1.1 tv
726 1.105 wiz -S seed Change the value of BUILDSEED to seed. This should rarely be
727 1.72 perry necessary.
728 1.72 perry
729 1.105 wiz -T tools Set the value of TOOLDIR to tools. If a relative path is
730 1.104 wiz specified, it will be converted to an absolute path before
731 1.126 wiz being used. If set, the bootstrap "make" will only be rebuilt
732 1.126 wiz if the source files for make(1) have changed.
733 1.104 wiz
734 1.105 wiz -U Set MKUNPRIVED=yes.
735 1.104 wiz
736 1.105 wiz -u Set MKUPDATE=yes.
737 1.104 wiz
738 1.105 wiz -V var=[value]
739 1.105 wiz Set the environment variable var to an optional value. This is
740 1.105 wiz propagated to the nbmake wrapper.
741 1.105 wiz
742 1.105 wiz -w wrapper
743 1.105 wiz Create the nbmake wrapper script (see below) in a custom
744 1.105 wiz location, specified by wrapper. This allows, for instance, to
745 1.151 lukem place the wrapper in PATH automatically.
746 1.151 lukem
747 1.151 lukem Note: wrapper is the full name of the file, not just a
748 1.151 lukem directory name. If a relative path is specified, it will be
749 1.151 lukem converted to an absolute path before being used.
750 1.1 tv
751 1.105 wiz -X x11src
752 1.105 wiz Set the value of X11SRCDIR to x11src. If a relative path is
753 1.59 apb specified, it will be converted to an absolute path before
754 1.59 apb being used.
755 1.49 lukem
756 1.105 wiz -x Set MKX11=yes.
757 1.49 lukem
758 1.105 wiz -Z var Unset ("zap") the environment variable var. This is propagated
759 1.105 wiz to the nbmake wrapper.
760 1.40 lukem
761 1.148 lukem -? Show a help message, and exit.
762 1.148 lukem
763 1.105 wiz The "nbmake-MACHINE" wrapper script
764 1.105 wiz If using the build.sh script to build NetBSD, a nbmake-MACHINE script
765 1.105 wiz will be created in TOOLDIR/bin upon the first build to assist in building
766 1.1 tv subtrees on a cross-compile host.
767 1.1 tv
768 1.105 wiz nbmake-MACHINE can be invoked in lieu of make(1), and will instead call
769 1.126 wiz the up-to-date version of "nbmake" installed into TOOLDIR/bin with
770 1.105 wiz several key variables pre-set, including MACHINE, MACHINE_ARCH, and
771 1.105 wiz TOOLDIR. nbmake-MACHINE will also set variables specified with -V, and
772 1.105 wiz unset variables specified with -Z.
773 1.40 lukem
774 1.105 wiz This script can be symlinked into a directory listed in PATH, or called
775 1.1 tv with an absolute path.
776 1.1 tv
777 1.105 wiz EXAMPLES
778 1.151 lukem 1. % ./build.sh [OPTIONS] tools kernel=GENERIC
779 1.28 lukem
780 1.28 lukem Build a new toolchain, and use the new toolchain to configure and
781 1.28 lukem build a new GENERIC kernel.
782 1.28 lukem
783 1.151 lukem 2. % ./build.sh [OPTIONS] -U distribution
784 1.28 lukem
785 1.105 wiz Using unprivileged mode, build a complete distribution to a DESTDIR
786 1.148 lukem directory that build.sh selects (and will show).
787 1.28 lukem
788 1.151 lukem 3. # ./build.sh [OPTIONS] -U install=/
789 1.28 lukem
790 1.105 wiz As root, install to / the distribution that was built by example 2.
791 1.105 wiz Even though this is run as root, -U is required so that the
792 1.105 wiz permissions stored in DESTDIR/METALOG are correctly applied to the
793 1.105 wiz files as they're copied to /.
794 1.28 lukem
795 1.151 lukem 4. % ./build.sh [OPTIONS] -U -u release
796 1.28 lukem
797 1.105 wiz Using unprivileged mode, build a complete release to DESTDIR and
798 1.148 lukem RELEASEDIR directories that build.sh selects (and will show).
799 1.126 wiz MKUPDATE=yes (-u) is set to prevent the "make cleandir", so that if
800 1.126 wiz this is run after example 2, it doesn't need to redo that portion of
801 1.126 wiz the release build.
802 1.16 lukem
803 1.105 wiz SEE ALSO
804 1.155 lukem config(1), ctags(1), ex(1), gzip(1), lint(1), make(1), mandoc(1),
805 1.155 lukem mkisofs(1), nroff(1), vi(1), mk.conf(5), atf(7), hier(7), mdoc(7),
806 1.155 lukem release(7), etcupdate(8), installboot(8), mount(8), postinstall(8),
807 1.151 lukem sysinst(8), pkgsrc/sysutils/cdrtools
808 1.1 tv
809 1.155 lukem Note: The NetBSD manual pages are also available at
810 1.155 lukem https://man.netbsd.org
811 1.155 lukem
812 1.105 wiz HISTORY
813 1.105 wiz The build.sh based build scheme was introduced for NetBSD 1.6 as
814 1.105 wiz USE_NEW_TOOLCHAIN, and re-worked to TOOLCHAIN_MISSING after that.
815 1.1 tv
816 1.109 apb CAVEATS
817 1.109 apb After significant updates to third-party components in the source tree,
818 1.126 wiz the "make cleandir" operation may be insufficient to clean out old files
819 1.126 wiz in object directories. Instead, one may have to manually remove the
820 1.126 wiz files. Consult the UPDATING file for notices concerning this.
821 1.109 apb
822 1.156 lukem NetBSD July 5, 2023 NetBSD
823