Home | History | Annotate | Line # | Download | only in src
BUILDING revision 1.59
      1   1.1        tv BUILDING(8)             NetBSD System Manager's Manual             BUILDING(8)
      2   1.1        tv 
      3   1.1        tv NAME
      4  1.52       jmc      BUILDING -- Procedure for building NetBSD from source code.
      5   1.1        tv 
      6   1.1        tv STATUS
      7   1.1        tv      This document is a work-in-progress.  As such, the information described
      8   1.1        tv      here may not match the reality of the build system as of this writing.
      9   1.1        tv      Once this document is completely in sync with reality, this paragraph
     10   1.1        tv      will be removed.
     11   1.1        tv 
     12  1.44     lukem      Discrepancies between this documentation and the current reality of
     13  1.44     lukem      implementation are noted specially, as with the note below:
     14   1.1        tv 
     15   1.1        tv      Note: This document applies only to platforms which use the new toolchain
     16  1.15     lukem      as indicated by the default setting of TOOLCHAIN_MISSING in <bsd.own.mk>.
     17   1.5        tv      Platforms which have not yet been switched to the new toolchain should
     18   1.5        tv      continue building traditionally, using the notes specified in the file
     19   1.5        tv      UPDATING.
     20   1.1        tv 
     21   1.1        tv REQUIREMENTS
     22   1.1        tv      NetBSD is designed to be buildable on most POSIX-compliant host systems.
     23   1.1        tv      The basic build procedure is the same whether compiling natively (on the
     24   1.1        tv      same NetBSD architecture) or cross compiling (on another architecture or
     25   1.1        tv      OS).
     26   1.1        tv 
     27   1.1        tv      This source tree contains a special subtree, ``tools'', which uses the
     28   1.1        tv      host system to create a build toolchain for the target architecture.  The
     29   1.1        tv      host system must have at least C and C++ compilers in order to create the
     30   1.1        tv      toolchain (make is not required); all other tools are created as part of
     31  1.53      reed      the NetBSD build process.  (See the environment variables section below
     32  1.53      reed      if you need to override or manually select your compilers.)
     33   1.1        tv 
     34   1.1        tv FILES
     35   1.1        tv    Source tree layout
     36  1.17       wiz      doc/BUILDING.mdoc
     37  1.17       wiz                     This document (in -mdoc troff format; the original copy).
     38   1.1        tv 
     39   1.2       wiz      BUILDING       This document (in plaintext).
     40   1.1        tv 
     41  1.48       jmc      tools/compat/README
     42  1.48       jmc                     Special notes for cross-hosting a NetBSD build on non-
     43  1.48       jmc                     NetBSD platforms.
     44  1.48       jmc 
     45  1.44     lukem      Makefile       The main Makefile for NetBSD; should only be run for
     46  1.44     lukem                     native builds with an appropriately up-to-date version of
     47   1.1        tv                     NetBSD make(1).  (For building from out-of-date systems or
     48   1.1        tv                     on a non-native host, see the build.sh shell script.)
     49   1.1        tv 
     50   1.1        tv      UPDATING       Special notes for updating from an earlier revision of
     51   1.1        tv                     NetBSD.  It is important to read this file before every
     52   1.1        tv                     build of an updated source tree.
     53   1.1        tv 
     54   1.1        tv      build.sh       Bourne-compatible shell script used for building the host
     55   1.1        tv                     build tools and the NetBSD system from scratch.  Can be
     56   1.1        tv                     used for both native and cross builds, and should be used
     57   1.1        tv                     instead of make(1) for any source tree that is updated and
     58   1.1        tv                     recompiled regularly.
     59   1.1        tv 
     60   1.1        tv      crypto/dist/, dist/, gnu/dist/
     61   1.1        tv                     Sources imported verbatim from third parties, without man-
     62   1.1        tv                     gling the existing build structure.  Other source trees in
     63   1.1        tv                     bin through usr.sbin use the NetBSD make(1) ``reachover''
     64  1.44     lukem                     Makefile semantics when building these programs for a
     65  1.44     lukem                     native host.
     66   1.1        tv 
     67   1.1        tv      distrib/, etc/
     68   1.1        tv                     Sources for items used when making a full release snap-
     69  1.27     lukem                     shot, such as files installed in DESTDIR/etc on the desti-
     70  1.27     lukem                     nation system, boot media, and release notes.
     71   1.1        tv 
     72   1.1        tv      regress/       Regression test harness.  Can be cross-compiled, but only
     73   1.1        tv                     run natively.
     74   1.1        tv 
     75   1.1        tv      sys/           NetBSD kernel sources.
     76   1.1        tv 
     77   1.1        tv      tools/         ``Reachover'' build structure for the host build tools.
     78   1.1        tv                     This has a special method of determining out-of-date sta-
     79   1.1        tv                     tus.
     80   1.1        tv 
     81   1.1        tv      bin/ ... usr.sbin/
     82   1.1        tv                     Sources to the NetBSD userland (non-kernel) programs.  If
     83   1.1        tv                     any of these directories are missing, they will be skipped
     84   1.1        tv                     during the build.
     85   1.1        tv 
     86  1.49     lukem      x11/           ``Reachover'' build structure for X11R6; the source is in
     87  1.49     lukem                     X11SRCDIR.
     88  1.49     lukem 
     89   1.1        tv    Build tree layout
     90   1.1        tv      The NetBSD build tree is described in hier(7), and the release layout is
     91   1.1        tv      described in release(7).
     92   1.1        tv 
     93   1.1        tv CONFIGURATION
     94   1.8     lukem    Environment variables
     95   1.8     lukem      Several environment variables control the behaviour of NetBSD builds.
     96   1.8     lukem 
     97  1.58       apb      HOST_SH           Path name to a POSIX-compliant shell.  If this is not
     98  1.58       apb                        set explicitly, then the default is set using heuris-
     99  1.58       apb                        tics dependent on the host platform, or from the shell
    100  1.58       apb                        under which build.sh is executed (if that can be deter-
    101  1.58       apb                        mined), or using the first copy of sh found in PATH.
    102  1.58       apb                        If the host system's /bin/sh is not POSIX-compliant, we
    103  1.58       apb                        suggest that you build using commands like
    104  1.58       apb 
    105  1.58       apb                              HOST_SH=/path/to/working/shell
    106  1.58       apb                              export HOST_SH
    107  1.58       apb                              ${HOST_SH} build.sh [options]
    108  1.58       apb 
    109  1.53      reed      HOST_CC           Path name to C compiler used to create the toolchain.
    110  1.53      reed 
    111  1.53      reed      HOST_CXX          Path name to C++ compiler used to create the toolchain.
    112  1.53      reed 
    113   1.8     lukem      MACHINE           Machine type.
    114   1.8     lukem 
    115   1.8     lukem      MACHINE_ARCH      Machine architecture.
    116   1.8     lukem 
    117   1.8     lukem      MAKE              Path name to invoke make(1) as.
    118   1.8     lukem 
    119   1.8     lukem      MAKEFLAGS         Flags to invoke make(1) with.
    120   1.8     lukem 
    121   1.8     lukem      MAKEOBJDIR        Directory to use as the .OBJDIR for the current direc-
    122  1.59       apb                        tory.  The value is subjected to variable expansion by
    123  1.59       apb                        make(1).  Used only if MAKEOBJDIRPREFIX is not defined.
    124  1.36     lukem                        MAKEOBJDIR can only be provided in the environment or
    125  1.41     lukem                        via the -O flag of build.sh.
    126   1.8     lukem 
    127   1.8     lukem      MAKEOBJDIRPREFIX  Top level directory of the object directory tree.  If
    128  1.59       apb                        specified, must be an absolute path.  If this is
    129  1.59       apb                        defined, ${MAKEOBJDIRPREFIX}/${.CURDIR} is used as the
    130  1.59       apb                        .OBJDIR for the current directory.  The current direc-
    131  1.59       apb                        tory may be read only.  MAKEOBJDIRPREFIX can only be
    132  1.59       apb                        provided in the environment or via the -M flag of
    133  1.36     lukem                        build.sh.
    134   1.8     lukem 
    135   1.1        tv    "make" variables
    136   1.1        tv      Several variables control the behavior of NetBSD builds.  Unless other-
    137   1.1        tv      wise specified, these variables may be set in either the process environ-
    138   1.1        tv      ment or the make(1) configuration file specified by MAKECONF.
    139   1.1        tv 
    140   1.9   thorpej      BUILDID     Identifier for the build.  The identifier will be appended to
    141   1.9   thorpej                  object directory names, and can be consulted in the make(1)
    142   1.9   thorpej                  configuration file in order to set additional build parame-
    143   1.9   thorpej                  ters, such as compiler flags.
    144   1.9   thorpej 
    145   1.1        tv      DESTDIR     Directory to contain the built NetBSD system.  If set, spe-
    146   1.1        tv                  cial options are passed to the compilation tools to prevent
    147   1.1        tv                  their default use of the host system's /usr/include,
    148  1.59       apb                  /usr/lib, and so forth.  This pathname must be an absolute
    149  1.59       apb                  path, and should not end with a slash (/) character.  (For
    150  1.59       apb                  installation into the system's root directory, set DESTDIR to
    151  1.59       apb                  an empty string, not to ``/'').  The directory must reside on
    152  1.59       apb                  a file system which supports long file names and hard links.
    153   1.1        tv 
    154   1.1        tv                  Default: Empty string if USETOOLS is ``yes''; unset other-
    155   1.1        tv                  wise.
    156   1.1        tv 
    157  1.30     lukem                  Note: build.sh will provide a default of destdir.MACHINE (in
    158  1.30     lukem                  the top-level .OBJDIR) unless run in `expert' mode
    159  1.30     lukem 
    160   1.1        tv      MAKECONF    The name of the make(1) configuration file.  Only settable in
    161   1.1        tv                  the process environment.
    162   1.1        tv 
    163   1.1        tv                  Default: ``/etc/mk.conf''
    164   1.1        tv 
    165  1.45     lukem      MAKEVERBOSE
    166  1.45     lukem                  Level of verbosity of status messages.  Supported values:
    167  1.45     lukem 
    168  1.45     lukem                  0    No descriptive messages are shown.
    169  1.45     lukem 
    170  1.45     lukem                  1    Descriptive messages are shown.
    171  1.45     lukem 
    172  1.45     lukem                  2    Descriptive messages (prefixed with a `#') and command
    173  1.45     lukem                       output is not suppressed.
    174  1.45     lukem 
    175  1.45     lukem                  Default: 2
    176  1.45     lukem 
    177   1.1        tv      MKCATPAGES  Can be set to ``yes'' or ``no''.  Indicates whether prefor-
    178   1.1        tv                  matted plaintext manual pages will be created during a build.
    179   1.1        tv 
    180   1.1        tv                  Default: ``yes''
    181   1.1        tv 
    182   1.1        tv      MKCRYPTO    Can be set to ``yes'' or ``no''.  Indicates whether crypto-
    183   1.1        tv                  graphic code will be included in a build; provided for the
    184   1.1        tv                  benefit of countries that do not allow strong cryptography.
    185  1.44     lukem                  Will not affect use of the standard low-security password
    186  1.44     lukem                  encryption system, crypt(3).
    187   1.1        tv 
    188   1.1        tv                  Default: ``yes''
    189   1.1        tv 
    190   1.1        tv      MKDOC       Can be set to ``yes'' or ``no''.  Indicates whether system
    191  1.44     lukem                  documentation destined for DESTDIR/usr/share/doc will be
    192  1.44     lukem                  installed during a build.
    193   1.1        tv 
    194   1.1        tv                  Default: ``yes''
    195   1.1        tv 
    196   1.4        tv      MKHOSTOBJ   Can be set to ``yes'' or ``no''.  If set to ``yes'', then for
    197   1.4        tv                  programs intended to be run on the compile host, the name,
    198   1.4        tv                  release, and architecture of the host operating system will
    199   1.4        tv                  be suffixed to the name of the object directory created by
    200   1.4        tv                  ``make obj''.  (This allows multiple host systems to compile
    201   1.4        tv                  NetBSD for a single target.)  If set to ``no'', then programs
    202   1.4        tv                  built to be run on the compile host will use the same object
    203   1.4        tv                  directory names as programs built to be run on the target.
    204   1.4        tv 
    205   1.4        tv                  Default: ``no''
    206   1.4        tv 
    207   1.1        tv      MKINFO      Can be set to ``yes'' or ``no''.  Indicates whether GNU Info
    208   1.1        tv                  files, used for the documentation for most of the compilation
    209   1.1        tv                  tools, will be created and installed during a build.
    210   1.1        tv 
    211   1.1        tv                  Default: ``yes''
    212   1.1        tv 
    213   1.1        tv      MKLINT      Can be set to ``yes'' or ``no''.  Indicates whether lint(1)
    214   1.1        tv                  will be run against portions of the NetBSD source code during
    215   1.1        tv                  the build, and whether lint libraries will be installed into
    216  1.27     lukem                  DESTDIR/usr/libdata/lint.
    217   1.1        tv 
    218   1.1        tv                  Default: ``yes''
    219   1.1        tv 
    220   1.1        tv      MKMAN       Can be set to ``yes'' or ``no''.  Indicates whether manual
    221   1.1        tv                  pages will be installed during a build.
    222   1.1        tv 
    223   1.1        tv                  Default: ``yes''
    224   1.1        tv 
    225   1.1        tv      MKNLS       Can be set to ``yes'' or ``no''.  Indicates whether Native
    226  1.44     lukem                  Language System locale zone files will be compiled and
    227  1.44     lukem                  installed during a build.
    228   1.1        tv 
    229   1.1        tv                  Default: ``yes''
    230   1.1        tv 
    231   1.1        tv      MKOBJ       Can be set to ``yes'' or ``no''.  Indicates whether object
    232   1.1        tv                  directories will be created when running ``make obj''.  If
    233   1.1        tv                  set to ``no'', then all built files will be located inside
    234   1.1        tv                  the regular source tree.
    235   1.1        tv 
    236   1.1        tv                  Default: ``yes''
    237   1.1        tv 
    238   1.1        tv      MKPIC       Can be set to ``yes'' or ``no''.  Indicates whether shared
    239   1.1        tv                  objects and libraries will be created and installed during a
    240   1.1        tv                  build.  If set to ``no'', the entire built system will be
    241   1.1        tv                  statically linked.
    242   1.1        tv 
    243   1.1        tv                  Default: Platform dependent.  As of this writing, all plat-
    244   1.1        tv                  forms except sh3 default to ``yes''.
    245   1.1        tv 
    246   1.1        tv      MKPICINSTALL
    247   1.1        tv                  Can be set to ``yes'' or ``no''.  Indicates whether the ar(1)
    248  1.44     lukem                  format libraries (lib*_pic.a), used to generate shared
    249  1.44     lukem                  libraries, are installed during a build.
    250   1.1        tv 
    251   1.1        tv                  Default: ``yes''
    252   1.1        tv 
    253   1.1        tv      MKPROFILE   Can be set to ``yes'' or ``no''.  Indicates whether profiled
    254   1.1        tv                  libraries (lib*_p.a) will be built and installed during a
    255   1.1        tv                  build.
    256   1.1        tv 
    257   1.1        tv                  Default: ``yes''; however, some platforms turn off MKPROFILE
    258   1.1        tv                  by default at times due to toolchain problems with profiled
    259   1.1        tv                  code.
    260   1.1        tv 
    261   1.1        tv      MKSHARE     Can be set to ``yes'' or ``no''.  Indicates whether files
    262  1.44     lukem                  destined to reside in DESTDIR/usr/share will be built and
    263  1.44     lukem                  installed during a build.  If set to ``no'', then all of
    264  1.27     lukem                  MKCATPAGES, MKDOC, MKINFO, MKMAN, and MKNLS will be set to
    265  1.27     lukem                  ``no'' unconditionally.
    266   1.1        tv 
    267   1.1        tv                  Default: ``yes''
    268   1.1        tv 
    269  1.50       wiz      MKTTINTERP  Can be set to ``yes'' or ``no''.  For X builds, decides if
    270  1.50       wiz                  the TrueType bytecode interpreter is turned on.  See
    271  1.50       wiz                  http://www.freetype.org/patents.html for details.
    272  1.50       wiz 
    273  1.50       wiz                  Default: ``no''
    274  1.50       wiz 
    275  1.44     lukem      MKUNPRIVED  Can be set to ``yes'' or ``no''.  Indicates whether an
    276  1.44     lukem                  unprivileged install will occur.  The user, group, permis-
    277  1.52       jmc                  sions, and file flags, will not be set on the installed
    278  1.52       jmc                  items; instead the information will be appended to a file
    279  1.52       jmc                  called METALOG in DESTDIR.  The contents of METALOG are used
    280  1.52       jmc                  during the generation of the distribution tar files to ensure
    281  1.52       jmc                  that the appropriate file ownership is stored.
    282  1.38     lukem 
    283  1.38     lukem                  Default: ``no''
    284  1.38     lukem 
    285  1.44     lukem      MKUPDATE    Can be set to ``yes'' or ``no''.  Indicates whether all
    286  1.44     lukem                  install operations intended to write to DESTDIR will compare
    287  1.38     lukem                  file timestamps before installing, and skip the install phase
    288  1.44     lukem                  if the destination files are up-to-date.  This also has
    289  1.44     lukem                  implications on full builds (see next subsection).
    290  1.38     lukem 
    291  1.38     lukem                  Default: ``no''
    292  1.38     lukem 
    293  1.49     lukem      MKX11       Can be set to ``yes'' or ``no''.  Indicates whether X11R6 is
    294  1.49     lukem                  built from X11SRCDIR.
    295  1.49     lukem 
    296  1.49     lukem                  Default: ``no''
    297  1.49     lukem 
    298  1.59       apb      TOOLDIR     Directory to hold the host tools, once built.  If specified,
    299  1.59       apb                  must be an absolute path.  This directory should be unique to
    300  1.59       apb                  a given host system and NetBSD source tree.  (However, multi-
    301  1.59       apb                  ple targets may share the same TOOLDIR; the target-dependent
    302  1.59       apb                  files have unique names.)  If unset, a default based on the
    303  1.59       apb                  uname(1) information of the host platform will be created in
    304  1.59       apb                  the .OBJDIR of src.
    305   1.1        tv 
    306   1.1        tv                  Default: Unset.
    307   1.1        tv 
    308   1.1        tv      USETOOLS    Indicates whether the tools specified by TOOLDIR should be
    309   1.1        tv                  used as part of a build in progress.  Must be set to ``yes''
    310   1.1        tv                  if cross-compiling.
    311   1.1        tv 
    312   1.1        tv                  yes    Use the tools from TOOLDIR.
    313   1.1        tv 
    314   1.1        tv                  no     Do not use the tools from TOOLDIR, but refuse to build
    315   1.1        tv                         native compilation tool components that are version-
    316   1.1        tv                         specific for that tool.
    317   1.1        tv 
    318   1.1        tv                  never  Do not use the tools from TOOLDIR, even when building
    319   1.1        tv                         native tool components.  This is similar to the tradi-
    320   1.1        tv                         tional NetBSD build method, but does not verify that
    321   1.1        tv                         the compilation tools in use are up-to-date enough in
    322   1.1        tv                         order to build the tree successfully.  This may cause
    323   1.1        tv                         build or runtime problems when building the whole
    324   1.1        tv                         NetBSD source tree.
    325   1.1        tv 
    326   1.1        tv                  Default: ``yes'' if building all or part of a whole NetBSD
    327   1.1        tv                  source tree (detected automatically); ``no'' otherwise (to
    328  1.44     lukem                  preserve traditional semantics of the <bsd.*.mk> make(1)
    329  1.44     lukem                  include files).
    330   1.1        tv 
    331  1.59       apb      X11SRCDIR   Directory containing the X11R6 source.  If specified, must be
    332  1.59       apb                  an absolute path.  The main X11R6 source is found in
    333  1.59       apb                  X11SRCDIR/xfree/xc.
    334  1.49     lukem 
    335  1.49     lukem                  Default: ``/usr/xsrc''
    336  1.49     lukem 
    337   1.1        tv    "make" variables for full builds
    338   1.7     lukem      These variables only affect the top level ``Makefile'' and do not affect
    339   1.7     lukem      manually building subtrees of the NetBSD source code.
    340   1.1        tv 
    341  1.20     lukem      INSTALLWORLDDIR  Location for the ``make installworld'' target to install
    342  1.59       apb                       to.  If specified, must be an absolute path.
    343   1.1        tv 
    344  1.20     lukem                       Default: ``/''
    345   1.1        tv 
    346  1.44     lukem      MKOBJDIRS        Can be set to ``yes'' or ``no''.  Indicates whether
    347  1.44     lukem                       object directories will be created automatically (via a
    348  1.20     lukem                       ``make obj'' pass) at the start of a build.
    349   1.1        tv 
    350  1.34     lukem                       Default: ``no''
    351   1.1        tv 
    352  1.38     lukem      MKUPDATE         Can be set to ``yes'' or ``no''.  If set, then in addi-
    353  1.38     lukem                       tion to the effects described for MKUPDATE=yes above,
    354  1.38     lukem                       this implies the effects of NOCLEANDIR (i.e., ``make
    355  1.38     lukem                       cleandir'' is avoided).
    356  1.38     lukem 
    357  1.38     lukem                       Default: ``no''
    358  1.38     lukem 
    359  1.20     lukem      NBUILDJOBS       Now obsolete.  Use the make(1) option -j, instead (see
    360  1.20     lukem                       below)
    361   1.1        tv 
    362  1.20     lukem                       Default: Unset.
    363   1.1        tv 
    364  1.20     lukem      NOCLEANDIR       If set, avoids the ``make cleandir'' phase of a full
    365  1.20     lukem                       build.  This has the effect of allowing only changed
    366  1.20     lukem                       files in a source tree to be recompiled.  This can speed
    367  1.20     lukem                       up builds when updating only a few files in the tree.
    368   1.1        tv 
    369  1.20     lukem                       Default: Unset.
    370   1.1        tv 
    371  1.20     lukem      NODISTRIBDIRS    If set, avoids the ``make distrib-dirs'' phase of a full
    372  1.20     lukem                       build.  This skips running mtree(8) on DESTDIR, useful
    373  1.20     lukem                       on systems where building as an unprivileged user, or
    374  1.20     lukem                       where it is known that the system-wide mtree files have
    375  1.20     lukem                       not changed.
    376   1.1        tv 
    377  1.20     lukem                       Default: Unset.
    378   1.1        tv 
    379  1.20     lukem      NOINCLUDES       If set, avoids the ``make includes'' phase of a full
    380  1.20     lukem                       build.  This has the effect of preventing make(1) from
    381  1.44     lukem                       thinking that some programs are out-of-date simply
    382  1.44     lukem                       because the system include files have changed.  However,
    383  1.20     lukem                       this option should not be used when updating the entire
    384  1.20     lukem                       NetBSD source tree arbitrarily; it is suggested to use
    385  1.38     lukem                       MKUPDATE=yes in that case.
    386   1.1        tv 
    387  1.20     lukem                       Default: Unset.
    388   1.1        tv 
    389  1.20     lukem      RELEASEDIR       If set, specifies the directory to which a release(7)
    390  1.20     lukem                       layout will be written at the end of a ``make release''.
    391  1.59       apb                       If specified, must be an absolute path.
    392  1.20     lukem 
    393  1.20     lukem                       Default: Unset.
    394  1.20     lukem 
    395  1.30     lukem                       Note: build.sh will provide a default of releasedir (in
    396  1.30     lukem                       the top-level .OBJDIR) unless run in `expert' mode
    397  1.30     lukem 
    398   1.1        tv BUILDING
    399   1.1        tv    "make" command line options
    400  1.52       jmc      This is not a summary of all the options available to make(1); only the
    401  1.52       jmc      options used most frequently with NetBSD builds are listed here.
    402   1.1        tv 
    403  1.10  sommerfe      -j njob    Run up to njob make(1) subjobs in parallel.  Makefiles should
    404  1.52       jmc                 use .WAIT or have explicit dependencies as necessary to
    405  1.44     lukem                 enforce build ordering.  If you see build failures with -j,
    406  1.10  sommerfe                 please save complete build logs so the failures can be ana-
    407  1.10  sommerfe                 lyzed.
    408  1.10  sommerfe 
    409   1.1        tv      -m dir     Specify the default directory for searching for system Make-
    410   1.1        tv                 file segments, mainly the <bsd.*.mk> files.  When building any
    411   1.1        tv                 full NetBSD source tree, this should be set to the
    412   1.1        tv                 ``share/mk'' directory in the source tree.  (This is set auto-
    413   1.1        tv                 matically when building from the top level.)
    414   1.1        tv 
    415   1.1        tv      -n         Display the commands that would have been executed, but do not
    416   1.1        tv                 actually execute them.  This will still cause recursion to
    417   1.1        tv                 take place.
    418   1.1        tv 
    419  1.47    zuntum      -V var     Print make(1)'s idea of the value of var.  Does not build any
    420   1.1        tv                 targets.
    421   1.1        tv 
    422   1.1        tv      var=value  Set the variable var to value, overriding any setting speci-
    423   1.1        tv                 fied by the process environment, the MAKECONF configuration
    424   1.1        tv                 file, or the system Makefile segments.
    425   1.1        tv 
    426   1.1        tv    "make" targets
    427   1.1        tv      These default targets may be built by running make(1) in any subtree of
    428   1.1        tv      the NetBSD source code.  It is recommended that none of these be used
    429   1.1        tv      from the top level Makefile; as a specific exception, ``make obj'' and
    430   1.1        tv      ``make cleandir'' are useful in that context.
    431   1.1        tv 
    432   1.1        tv      all        Build programs, libraries, and preformatted documentation.
    433   1.1        tv 
    434   1.1        tv      clean      Remove program and library object code files.
    435   1.1        tv 
    436  1.44     lukem      cleandir   Same as clean, but also remove preformatted documentation,
    437  1.44     lukem                 dependency files generated by ``make depend'', and any other
    438  1.49     lukem                 files known to be created at build time.
    439   1.1        tv 
    440  1.44     lukem      depend     Create dependency files (.depend) containing more detailed
    441  1.44     lukem                 information about the dependencies of source code on header
    442   1.1        tv                 files.  Allows programs to be recompiled automatically when a
    443   1.1        tv                 dependency changes.
    444   1.1        tv 
    445   1.1        tv      dependall  Does a ``make depend'' immediately followed by a ``make all''.
    446  1.10  sommerfe                 This improves cache locality of the build since both passes
    447  1.10  sommerfe                 read the source files in their entirety.
    448   1.1        tv 
    449  1.49     lukem      distclean  Synonym for cleandir.
    450  1.49     lukem 
    451  1.44     lukem      includes   Build and install system header files.  Typically needed
    452  1.44     lukem                 before any system libraries or programs can be built.
    453   1.1        tv 
    454   1.1        tv      install    Install programs, libraries, and documentation into DESTDIR.
    455  1.27     lukem                 Few files will be installed to DESTDIR/dev, DESTDIR/etc,
    456  1.27     lukem                 DESTDIR/root or DESTDIR/var in order to prevent user supplied
    457  1.27     lukem                 configuration data from being overwritten.
    458   1.1        tv 
    459   1.1        tv      lint       Run lint(1) against the C source code, where appropriate, and
    460   1.1        tv                 generate system-installed lint libraries.
    461   1.1        tv 
    462   1.1        tv      obj        Create object directories to be used for built files, instead
    463   1.1        tv                 of building directly in the source tree.
    464   1.1        tv 
    465   1.1        tv      tags       Create ctags(1) searchable function lists usable by the ex(1)
    466   1.1        tv                 and vi(1) text editors.
    467   1.1        tv 
    468   1.1        tv    "make" targets for the top level
    469   1.1        tv      Additional make(1) targets are usable specifically from the top source
    470   1.1        tv      level to facilitate building the entire NetBSD source tree.
    471   1.1        tv 
    472  1.20     lukem      build         Build the entire NetBSD system.  This orders portions of
    473  1.20     lukem                    the source tree such that prerequisites will be built in
    474  1.20     lukem                    the proper order.
    475  1.20     lukem 
    476  1.20     lukem      distribution  Do a ``make build'', and then install a full distribution
    477  1.27     lukem                    into DESTDIR, including files in DESTDIR/dev, DESTDIR/etc,
    478  1.27     lukem                    DESTDIR/root and DESTDIR/var.
    479  1.20     lukem 
    480  1.20     lukem      buildworld    As per ``make distribution'', except that it ensures that
    481  1.20     lukem                    DESTDIR is not the root directory.
    482  1.20     lukem 
    483  1.20     lukem      installworld  Install the distribution from DESTDIR to INSTALLWORLDDIR
    484  1.20     lukem                    (which defaults to the root directory).  Ensures that
    485  1.52       jmc                    INSTALLWORLDDIR is not the root directory if cross compil-
    486  1.20     lukem                    ing.
    487  1.20     lukem 
    488  1.20     lukem                    Note: It is highly recommended that you upgrade your kernel
    489  1.20     lukem                    and reboot before performing this operation.
    490  1.20     lukem 
    491  1.25     lukem      sets          Create distribution sets from DESTDIR into
    492  1.25     lukem                    RELEASEDIR/MACHINE/binary/sets.  Should be run after ``make
    493  1.25     lukem                    distribution'' (as ``make build'' does not install all of
    494  1.25     lukem                    the required files).
    495  1.25     lukem 
    496  1.31     lukem      sourcesets    Create source sets of the source tree into
    497  1.31     lukem                    RELEASEDIR/source/sets.
    498  1.31     lukem 
    499  1.54       apb      syspkgs       Create syspkgs from DESTDIR into
    500  1.54       apb                    RELEASEDIR/MACHINE/binary/syspkgs.  Should be run after
    501  1.54       apb                    ``make distribution'' (as ``make build'' does not install
    502  1.54       apb                    all of the required files).
    503  1.54       apb 
    504  1.44     lukem      release       Do a ``make distribution'', build kernels, distribution
    505  1.44     lukem                    media, and install sets (this as per ``make sets''), and
    506  1.44     lukem                    then package the system into a standard release layout as
    507  1.44     lukem                    described by release(7).  This requires that RELEASEDIR be
    508  1.25     lukem                    set (see above).
    509   1.1        tv 
    510  1.56       apb      iso-image     Create a CD-ROM image in
    511  1.56       apb                    RELEASEDIR/MACHINE/installation/cdrom.  RELEASEDIR must
    512  1.56       apb                    already have been populated by ``make release'' or equiva-
    513  1.56       apb                    lent.  This requires the mkisofs(1) utility, which is not
    514  1.56       apb                    part of NetBSD, but which can be installed from
    515  1.57       apb                    pkgsrc/sysutils/cdrtools.
    516  1.56       apb 
    517   1.1        tv      regression-tests
    518  1.20     lukem                    Can only be run after building the regression tests in the
    519  1.20     lukem                    directory ``regress''.  Runs the compiled regression tests
    520  1.20     lukem                    on the local host.
    521   1.1        tv 
    522   1.1        tv    The "build.sh" script
    523   1.1        tv      This script file is a Bourne shell script designed to build the entire
    524   1.1        tv      NetBSD system on any host with a Bourne shell in /bin/sh, including many
    525   1.1        tv      that are not POSIX compliant.  Note that if a host system's /bin/sh is
    526   1.1        tv      unusually old and broken, the Korn Shell (/bin/ksh), if available, may be
    527   1.1        tv      a usable alternative.
    528   1.1        tv 
    529   1.1        tv      All cross-compile builds, and most native builds, of the entire system
    530   1.1        tv      should make use of build.sh rather than just running ``make''.  This way,
    531   1.1        tv      the make(1) program will be bootstrapped properly, in case the host sys-
    532   1.1        tv      tem has an older or incompatible ``make'' program.
    533   1.1        tv 
    534   1.1        tv      When compiling the entire system via build.sh, many make(1) variables are
    535   1.1        tv      set for you in order to help encapsulate the build process.  In the list
    536   1.1        tv      of options below, variables that are automatically set by build.sh are
    537   1.1        tv      noted where applicable.
    538   1.1        tv 
    539  1.22     lukem      The following operations are supported by build.sh:
    540  1.22     lukem 
    541  1.44     lukem      build         Build the system as per ``make build''.  This option
    542  1.44     lukem                    implies the obj and tools operations.
    543  1.22     lukem 
    544  1.22     lukem      distribution  Build a full distribution as per ``make distribution''.
    545  1.22     lukem                    This option implies the build operation.
    546  1.22     lukem 
    547  1.22     lukem      release       Build a full release as per ``make release''.  This option
    548  1.22     lukem                    implies the distribution operation.
    549  1.22     lukem 
    550  1.23     lukem      makewrapper   Create the nbmake-MACHINE wrapper.  This operation is auto-
    551  1.23     lukem                    matically performed for any of the other operations.
    552  1.23     lukem 
    553  1.22     lukem      obj           Perform ``make obj''.
    554  1.22     lukem 
    555  1.22     lukem      tools         Build and install the host tools from src/tools.
    556  1.22     lukem 
    557  1.35     lukem      install=idir  Install the contents of DESTDIR to idir, using ``make
    558  1.35     lukem                    installworld''.
    559  1.35     lukem 
    560  1.22     lukem      kernel=kconf  Build a new kernel.  The kconf argument is the name of a
    561  1.54       apb                    configuration file suitable for use by config(1).  If kconf
    562  1.22     lukem                    does not contain any `/' characters, the configuration file
    563  1.22     lukem                    is expected to be found in the KERNCONFDIR directory, which
    564  1.22     lukem                    is typically sys/arch/MACHINE/conf.  The new kernel will be
    565  1.22     lukem                    built in a subdirectory of KERNOBJDIR, which is typically
    566  1.22     lukem                    sys/arch/MACHINE/compile or an associated object directory.
    567  1.22     lukem                    In order to ensure that the kernel is built using up-to-
    568  1.22     lukem                    date tools, it is strongly recommended that the tools be
    569  1.22     lukem                    rebuilt (using the tools operation).
    570  1.22     lukem 
    571  1.35     lukem      releasekernel=kconf
    572  1.35     lukem                    Install a gzip(1)ed copy of the kernel built by
    573  1.35     lukem                    kernel=kconf into RELEASEDIR/MACHINE/binary/kernel, usually
    574  1.44     lukem                    as netbsd-kconf.gz, although the ``netbsd'' prefix is
    575  1.44     lukem                    determined from the ``config'' directives in kconf.
    576  1.24     lukem 
    577  1.24     lukem      sets          Perform ``make sets''.
    578  1.31     lukem 
    579  1.31     lukem      sourcesets    Perform ``make sourcesets''.
    580  1.22     lukem 
    581  1.54       apb      syspkgs       Perform ``make syspkgs''.
    582  1.54       apb 
    583  1.56       apb      iso-image     Perform ``make iso-image''.
    584  1.56       apb 
    585  1.51       wiz      The following command line options alter the behaviour of the build.sh
    586  1.51       wiz      operations described above:
    587   1.1        tv 
    588   1.1        tv      -a arch   Set the value of MACHINE_ARCH to arch.
    589   1.9   thorpej 
    590   1.9   thorpej      -B buildid
    591   1.9   thorpej                Set the value of BUILDID to buildid.  This will also append the
    592   1.9   thorpej                build idenfitier to the name of the ``make'' wrapper script so
    593  1.37     lukem                that the resulting name is of the form
    594  1.37     lukem                ``nbmake-MACHINE-BUILDID''.
    595   1.1        tv 
    596  1.59       apb      -D dest   Set the value of DESTDIR to dest.  If a relative path is speci-
    597  1.59       apb                fied, it will be converted to an absolute path before being
    598  1.59       apb                used.
    599  1.18     lukem 
    600  1.23     lukem      -E        Set `expert' mode.  This overrides various sanity checks, and
    601  1.23     lukem                allows: DESTDIR does not have to be set to a non-root path for
    602  1.38     lukem                builds, and MKUNPRIVED=yes does not have to be set when build-
    603  1.38     lukem                ing as a non-root user.
    604  1.23     lukem 
    605  1.23     lukem                Note: It is highly recommended that you know what you are doing
    606  1.23     lukem                when you use this option.
    607  1.19     lukem 
    608  1.51       wiz      -h        Print a help message.
    609  1.51       wiz 
    610  1.10  sommerfe      -j njob   Passed through to make(1).  Makefiles should use .WAIT or have
    611  1.10  sommerfe                explicit dependancies as necessary to enforce build ordering.
    612  1.10  sommerfe                If you see build failures with -j, please save complete build
    613  1.10  sommerfe                logs so the failures can be analyzed.
    614   1.1        tv 
    615  1.59       apb      -M obj    Set MAKEOBJDIRPREFIX to obj.  If a relative path is specified,
    616  1.59       apb                it will be converted to an absolute path before being used.
    617  1.59       apb                Unsets MAKEOBJDIR.
    618  1.18     lukem 
    619   1.1        tv      -m mach   Set the value of MACHINE to mach.  This will also override any
    620   1.1        tv                value of MACHINE_ARCH in the process environment with a value
    621  1.33     lukem                deduced from mach, unless -a is specified, or mach is a special
    622  1.33     lukem                case listed below.  All cross builds require -m, but if unset
    623  1.33     lukem                on a NetBSD host, the host's value of MACHINE will be detected
    624  1.33     lukem                and used automatically.
    625  1.33     lukem 
    626  1.33     lukem                Some machines support multiple values for MACHINE_ARCH.  For a
    627  1.33     lukem                given value of mach, the following MACHINE and MACHINE_ARCH
    628  1.33     lukem                values will result:
    629  1.33     lukem 
    630  1.33     lukem                      mach          MACHINE    MACHINE_ARCH
    631  1.33     lukem                      evbmips       evbmips    (not set)
    632  1.33     lukem                      evbmips-eb    evbmips    mipseb
    633  1.33     lukem                      evbmips-el    evbmips    mipsel
    634  1.33     lukem                      evbsh3        evbsh3     (not set)
    635  1.33     lukem                      evbsh3-eb     evbsh3     sh3eb
    636  1.33     lukem                      evbsh3-el     evbsh3     sh3el
    637  1.33     lukem                      sbmips        sbmips     (not set)
    638  1.33     lukem                      sbmips-eb     sbmips     mipseb
    639  1.33     lukem                      sbmips-el     sbmips     mipsel
    640   1.1        tv 
    641  1.45     lukem      -N noiselevel
    642  1.46     lukem                Set the ``noisyness'' level of the build, by setting
    643  1.46     lukem                MAKEVERBOSE to noiselevel.
    644  1.45     lukem 
    645   1.1        tv      -n        Show the commands that would be executed by build.sh, but do
    646   1.1        tv                not make any changes.  This is similar in concept to ``make
    647   1.1        tv                -n''.
    648   1.1        tv 
    649  1.18     lukem      -O obj    Create an appropriate transform macro for MAKEOBJDIR that will
    650  1.59       apb                place the built object files under obj.  If a relative path is
    651  1.59       apb                specified, it will be converted to an absolute path before
    652  1.59       apb                being used.  For instance, a setting of /usr/obj will place
    653  1.59       apb                build-time files under /usr/obj/bin, /usr/obj/lib,
    654  1.59       apb                /usr/obj/usr.bin, and so forth.  Unsets MAKEOBJDIRPREFIX.
    655  1.18     lukem 
    656  1.34     lukem      -o        Set the value of MKOBJDIRS to ``no''.  Otherwise, it will be
    657  1.34     lukem                automatically set to ``yes'' (which is opposite to the default
    658  1.34     lukem                behaviour).
    659   1.1        tv 
    660  1.59       apb      -R rel    Set the value of RELEASEDIR to rel.  If a relative path is
    661  1.59       apb                specified, it will be converted to an absolute path before
    662  1.59       apb                being used.
    663  1.18     lukem 
    664   1.1        tv      -r        Remove the contents of DESTDIR and TOOLDIR before building
    665   1.1        tv                (provides a clean starting point).  This will skip deleting
    666   1.1        tv                DESTDIR if building on a native system to the root directory.
    667   1.1        tv 
    668  1.59       apb      -T tools  Set the value of TOOLDIR to tools.  If a relative path is spec-
    669  1.59       apb                ified, it will be converted to an absolute path before being
    670  1.59       apb                used.  If set, the bootstrap ``make'' will only be rebuilt as
    671  1.59       apb                needed (when the source files for make(1) change).
    672  1.18     lukem 
    673  1.38     lukem      -U        Set MKUNPRIVED=yes.
    674  1.18     lukem 
    675  1.38     lukem      -u        Set MKUPDATE=yes.
    676   1.1        tv 
    677  1.21     lukem      -V var=[value]
    678  1.40     lukem                Set the environment variable var to an optional value.  This is
    679  1.40     lukem                propagated to the nbmake wrapper.
    680  1.21     lukem 
    681   1.1        tv      -w wrapper
    682   1.1        tv                Create the nbmake wrapper script (see below) in a custom loca-
    683   1.1        tv                tion, specified by wrapper.  This allows, for instance, to
    684   1.1        tv                place the wrapper in PATH automatically.  Note that wrapper is
    685  1.59       apb                the full name of the file, not just a directory name.  If a
    686  1.59       apb                relative path is specified, it will be converted to an absolute
    687  1.59       apb                path before being used.
    688   1.1        tv 
    689  1.49     lukem      -X x11src
    690  1.59       apb                Set the value of X11SRCDIR to x11src.  If a relative path is
    691  1.59       apb                specified, it will be converted to an absolute path before
    692  1.59       apb                being used.
    693  1.49     lukem 
    694  1.49     lukem      -x        Set MKX11=yes.
    695  1.49     lukem 
    696  1.40     lukem      -Z var    Unset ("zap") the environment variable var.  This is propagated
    697  1.40     lukem                to the nbmake wrapper.
    698  1.40     lukem 
    699   1.1        tv    The "nbmake-MACHINE" wrapper script
    700   1.1        tv      If using the build.sh script to build NetBSD, a nbmake-MACHINE script
    701   1.1        tv      will be created in TOOLDIR/bin upon the first build to assist in building
    702   1.1        tv      subtrees on a cross-compile host.
    703   1.1        tv 
    704   1.1        tv      nbmake-MACHINE can be invoked in lieu of make(1), and will instead call
    705   1.1        tv      the up-to-date version of ``nbmake'' installed into TOOLDIR/bin with sev-
    706   1.1        tv      eral key variables pre-set, including MACHINE, MACHINE_ARCH, and TOOLDIR.
    707  1.40     lukem      build.sh will also set variables specified with -V, and unset variables
    708  1.40     lukem      specified with -Z.
    709  1.40     lukem 
    710   1.1        tv      This script can be symlinked into a directory listed in PATH, or called
    711   1.1        tv      with an absolute path.
    712   1.1        tv 
    713  1.16     lukem EXAMPLES
    714  1.44     lukem      1.   % ./build.sh tools kernel=GENERIC
    715  1.28     lukem 
    716  1.28     lukem           Build a new toolchain, and use the new toolchain to configure and
    717  1.28     lukem           build a new GENERIC kernel.
    718  1.28     lukem 
    719  1.44     lukem      2.   % ./build.sh -U distribution
    720  1.28     lukem 
    721  1.30     lukem           Using unprivileged mode, build a complete distribution to a DESTDIR
    722  1.30     lukem           directory that build.sh selects (and will display).
    723  1.28     lukem 
    724  1.43    martti      3.   # ./build.sh -U install=/
    725  1.28     lukem 
    726  1.29     lukem           As root, install to / the distribution that was built by example 2.
    727  1.29     lukem           Even though this is run as root, -U is required so that the permis-
    728  1.30     lukem           sions stored in DESTDIR/METALOG are correctly applied to the files
    729  1.30     lukem           as they're copied to /.
    730  1.28     lukem 
    731  1.44     lukem      4.   % ./build.sh -U -u release
    732  1.28     lukem 
    733  1.30     lukem           Using unprivileged mode, build a complete release to DESTDIR and
    734  1.30     lukem           RELEASEDIR directories that build.sh selects (and will display).
    735  1.38     lukem           MKUPDATE=yes (-u) is set to prevent the ``make cleandir'', so that
    736  1.38     lukem           if this is run after example 2, it doesn't need to redo that portion
    737  1.38     lukem           of the release build.
    738  1.16     lukem 
    739  1.10  sommerfe OBSOLETE VARIABLES
    740  1.15     lukem      NBUILDJOBS  Use the make(1) option -j, instead.
    741  1.15     lukem 
    742  1.15     lukem      USE_NEW_TOOLCHAIN
    743  1.15     lukem                  The new toolchain is now the default.  To disable, use
    744  1.15     lukem                  TOOLCHAIN_MISSING=yes.
    745  1.10  sommerfe 
    746   1.1        tv SEE ALSO
    747  1.57       apb      make(1), hier(7), release(7), pkgsrc/sysutils/cdrtools
    748   1.1        tv 
    749   1.1        tv HISTORY
    750  1.15     lukem      The build.sh based build scheme was introduced for NetBSD 1.6 as
    751  1.15     lukem      USE_NEW_TOOLCHAIN, and re-worked to TOOLCHAIN_MISSING after that.
    752   1.1        tv 
    753   1.1        tv BUGS
    754  1.15     lukem      A few platforms are not yet using this build system.
    755   1.1        tv 
    756  1.55       wiz NetBSD                          January 4, 2006                         NetBSD
    757