.. Copyright Spack Project Developers. See COPYRIGHT file for details. SPDX-License-Identifier: (Apache-2.0 OR MIT) .. meta:: :description lang=en: Learn how Spack's bootstrapping feature automatically fetches and installs essential build tools when they are not available on the host system. .. _bootstrapping: .. _cmd-spack-bootstrap: .. _cmd-spack-bootstrap-status: .. _cmd-spack-bootstrap-now: Bootstrapping ============= In the :ref:`Getting started ` section, we already mentioned that Spack can bootstrap some of its dependencies, including ``clingo``. In fact, there is an entire command dedicated to the management of every aspect of bootstrapping: .. command-output:: spack bootstrap --help Spack bootstraps its dependencies automatically the first time they are needed. You can readily check if any prerequisite for using Spack is missing by running: .. code-block:: console % spack bootstrap status Spack v0.19.0 - python@3.8 [FAIL] Core Functionalities [B] MISSING "clingo": required to concretize specs [FAIL] Binary packages [B] MISSING "gpg2": required to sign/verify buildcaches Spack will take care of bootstrapping any missing dependency marked as [B]. Dependencies marked as [-] are instead required to be found on the system. % echo $? 1 In the case of the output shown above, Spack detected that both ``clingo`` and ``gnupg`` are missing, and it's giving detailed information on why they are needed and whether they can be bootstrapped. The return code of this command summarizes the results; if any dependencies are missing, the return code is ``1``, otherwise ``0``. Running a command that concretizes a spec, like: .. code-block:: console % spack solve zlib ==> Installing "clingo-bootstrap@spack%apple-clang@12.0.0~docs~ipo+python build_type=Release arch=darwin-catalina-x86_64" from a buildcache [ ... ] automatically triggers the bootstrapping of clingo from pre-built binaries as expected. Users can also bootstrap all Spack's dependencies in a single command, which is useful to set up containers or other similar environments: .. code-block:: console $ spack bootstrap now ==> Installing "clingo-bootstrap@spack%gcc@10.2.1~docs~ipo+python+static_libstdcpp build_type=Release arch=linux-centos7-x86_64" from a buildcache ==> Installing "patchelf@0.15.0%gcc@10.2.1 ldflags="-static-libstdc++ -static-libgcc" arch=linux-centos7-x86_64" from a buildcache .. _cmd-spack-bootstrap-root: The Bootstrapping Store ----------------------- The software installed for bootstrapping purposes is deployed in a separate store. You can check its location with the following command: .. code-block:: console % spack bootstrap root You can also change it by specifying the desired path: .. code-block:: console % spack bootstrap root /opt/spack/bootstrap You can check what is installed in the bootstrapping store at any time using: .. code-block:: console % spack -b find ==> Showing internal bootstrap store at "/Users/spack/.spack/bootstrap/store" ==> 11 installed packages -- darwin-catalina-x86_64 / apple-clang@12.0.0 ------------------ clingo-bootstrap@spack libassuan@2.5.5 libgpg-error@1.42 libksba@1.5.1 pinentry@1.1.1 zlib@1.2.11 gnupg@2.3.1 libgcrypt@1.9.3 libiconv@1.16 npth@1.6 python@3.8 If needed, you can remove all the software in the current bootstrapping store with: .. code-block:: console % spack clean -b ==> Removing bootstrapped software and configuration in "/Users/spack/.spack/bootstrap" % spack -b find ==> Showing internal bootstrap store at "/Users/spack/.spack/bootstrap/store" ==> 0 installed packages .. _cmd-spack-bootstrap-list: .. _cmd-spack-bootstrap-disable: .. _cmd-spack-bootstrap-enable: .. _cmd-spack-bootstrap-reset: Enabling and Disabling Bootstrapping Methods -------------------------------------------- Bootstrapping is performed by trying the methods listed by: .. command-output:: spack bootstrap list in the order they appear, from top to bottom. By default, Spack is configured to try bootstrapping from pre-built binaries first and to fall back to bootstrapping from sources if that fails. If needed, you can disable bootstrapping altogether by running: .. code-block:: console % spack bootstrap disable in which case, it's your responsibility to ensure Spack runs in an environment where all its prerequisites are installed. You can also configure Spack to skip certain bootstrapping methods by disabling them specifically: .. code-block:: console % spack bootstrap disable github-actions ==> "github-actions" is now disabled and will not be used for bootstrapping tells Spack to skip trying to bootstrap from binaries. To add the "github-actions" method back, you can: .. code-block:: console % spack bootstrap enable github-actions You can also reset the bootstrapping configuration to Spack's defaults: .. code-block:: console % spack bootstrap reset ==> Bootstrapping configuration is being reset to Spack's defaults. Current configuration will be lost. Do you want to continue? [Y/n] % .. _cmd-spack-bootstrap-mirror: .. _cmd-spack-bootstrap-add: Creating a Mirror for Air-Gapped Systems ---------------------------------------- Spack's default bootstrapping configuration requires internet connection to fetch precompiled binaries or source tarballs. Sometimes, though, Spack is deployed on air-gapped systems where such access is denied. To help in these situations, Spack provides a command to create a local mirror containing the source tarballs and/or binary packages needed for bootstrapping. .. code-block:: console % spack bootstrap mirror --binary-packages /opt/bootstrap ==> Adding "clingo-bootstrap@spack+python %apple-clang target=x86_64" and dependencies to the mirror at /opt/bootstrap/local-mirror ==> Adding "gnupg@2.3: %apple-clang target=x86_64" and dependencies to the mirror at /opt/bootstrap/local-mirror ==> Adding "patchelf@0.13.1:0.13.99 %apple-clang target=x86_64" and dependencies to the mirror at /opt/bootstrap/local-mirror ==> Adding binary packages from "https://github.com/alalazo/spack-bootstrap-mirrors/releases/download/v0.1-rc.2/bootstrap-buildcache.tar.gz" to the mirror at /opt/bootstrap/local-mirror To register the mirror on the platform where it's supposed to be used run the following command(s): % spack bootstrap add --trust local-sources /opt/bootstrap/metadata/sources % spack bootstrap add --trust local-binaries /opt/bootstrap/metadata/binaries % spack buildcache update-index /opt/bootstrap/bootstrap_cache Run this command on a machine with internet access, then move the resulting folder to the air-gapped system. Once the local sources are added using the commands suggested at the prompt, they can be used to bootstrap Spack.