manifest.toml - declarative environment configuration format
SYNOPSIS
The manifest.toml file is a declarative format for specifying the
packages installed in an environment, environment variables to make
available to the environment, a shell script to run upon activation of
the environment, and other options to change the behavior of the
environment.
DESCRIPTION
Flox environments come with a declarative manifest in TOML
format. An environment can be defined
entirely by this one file. The file is divided into just a few sections
that are represented as TOML tables:
The [install] table is the core of the environment, specifying which
packages you’d like installed in the environment. An example of the
[install] table is shown below:
Flox will use the first format by default when automatically editing the
manifest.
Package names
Packages are organized in a hierarchical structure such that certain
packages are found at the top level (e.g. ripgrep), and other packages
are found under package sets (e.g. python310Packages.pip). We call
this location within the catalog the “pkg-path”.
The pkg-path is searched when you execute a flox search command. The
pkg-path is what’s shown by flox show. Finally, the pkg-path appears
in your manifest after a flox install.
Each entry in the [install] table is a key-value pair. The key in the
key-value pair (e.g. ripgrep, pip) is referred to as an “install
ID”, and represents the name by which you will refer to a particular
package e.g. if you wanted to uninstall or upgrade the package. Install
IDs are inferred from the last attribute in the pkg-path, but may also
be specified either at install-time via the -i option or interactively
via flox-edit(1).
The value in the key-value pair is called a “package descriptor”. A
package is specified by a number of available options which are separate
from the install ID, so you are free to change them independently of one
another. This allows you to change package details while keeping a
stable install ID, for example upgrading from gcc.pkg-path = "gcc12"
to gcc.pkg-path = "gcc13".
Most package descriptors will be catalog descriptors, which allow
specifying packages from the Flox catalog. A second format, flake
descriptors, is also supported, which allows specifying software to
install from an arbitrary Nix flake.
By specifying some of these options you create a set of requirements
that the installed program must satisfy, otherwise installation will
fail.
By default, all packages belong to the same pkg-group, which means
providing specific versions for two different packages can quickly lead
to installation failures. To avoid such failures, either give a looser
version constraint, or move one of the packages to a different package
group.
Each option is described below:
pkg-group
Marks a package as belonging to a pkg-group.
The pkg-group is a collection of software that is known to work together
at a point in time. Adding packages to a pkg-group enables packages in
the pkg-group to share the same libraries and dependencies, which
ensures maximum compatibility and minimizes the size of the environment.
Packages are marked as belonging to a pkg-group simply by setting this
option to the name of the pkg-group. Packages that do not have a
pkg-group specified belong to the same group.
Multiple pkg-groups may resolve to the same version of the catalog.
Pkg-groups are upgraded as a unit, ensuring that the packages within the
pkg-group continue to work together. See
flox-upgrade(1) for more details on how
pkg-groups and packages interact during upgrades.
version
Requires that the package match either an exact version or a semver
range.
The semantic version can be specified with the typical qualifiers such
as ^, >=, etc. Semantic versions that do not specify all three
fields (MAJOR.MINOR.PATCH) will treat the unspecified fields as
wildcards. This instructs Flox to find the latest versions for those
fields. For example version = "1.2" would select the latest version in
the 1.2.X series.
systems
A list of systems on which to install this package. When omitted this
defaults to the same systems that the manifest specifies that it
supports via options.systems.
pkg-path
The abbreviated location of a package within a catalog. A pkg-path is a
sequence of one or more attributes joined by a delimiter. For example,
both ripgrep and python310Packages.pip are pkg-paths. A pkg-path
that contains more than one attribute can be represented as either a
single string that contains a ‘.’-delimited sequence of the attributes,
or it can be represented as a TOML array of strings where each string is
an attribute. For example, both "python310Packages.pip" and
["python310Packages", "pip"] are equivalent for the pkg-path option.
This option is mutually exclusive with abs-path.
priority
A priority used to resolve file conflicts where lower values indicate
higher priority.
Each package internally has /bin, /man, /include, and other
directories for the files they provide. These directories from all
packages in the environment are merged when building the environment.
Two packages that provide the same /bin/foo file cause a conflict, and
it’s ambiguous which file should ultimately be placed into the
environment. Such conflicts can be resolved by assigning different
priorities to the conflicting packages.
The default priority is 5. Packages with a lower priority value will
take precedence over packages with higher priority values.
Flake descriptors
Flake descriptors allow installing software from an arbitrary Nix flake.
Only flake is required. systems and priority behave the same as
described above for catalog descriptors, and flake is described below:
flake
Specifies a Nix flake installable, which Nix refers to as a flake output
attribute and documents at
https://nix.dev/manual/nix/2.17/command-ref/new-cli/nix#flake-output-attribute.
Flake installables are of the form flakeref[#attrpath], where flakeref
is a flake reference and attrpath is an optional attribute path.
Flox tries to use the same fallback behavior as Nix; if no attrpath is
specified, the flake is checked for containing
packages.$system.default or defaultPackage.$system. If an attrpath
is specified, it is checked whether packages.$system.$attrpath or
legacyPackages.$system.$attrpath exist.
Store paths
Store path descriptors allow installing software from an arbitrary Nix
store path.
The full list of store path descriptor options is:
Only store-path is required. priority behaves the same as described
above for catalog descriptors and flake installables, and store-path
is described below:
store-path
Specifies a nix store path, i.e. a nix built package in /nix/store.
This can be the result of a native Nix operations such as nix build,
nix copy, etc. The store path has to be available on the current
system in order to build the environment. The environment will fail to
build on other systems without first distributing the store path via Nix
tooling. As such, this feature is most suitable for local experiments
and ad-hoc interoperability with Nix.
system
Behaves equally to the system attribute of catalog descriptors and
flakes installables. Unlike the former, users are encouraged to specify
it, because store paths are generally system dependent.
[vars]
The [vars] section allows you to define environment variables for your
environment that are set during environment activation. The environment
variables specified here cannot reference one another. The names and
values of the environment variables are copied verbatim into the
activation script, so capitalization will be preserved.
The on-activate script in the [hook] section is useful for
performing initialization in a predictable Bash shell environment.
on-activate
The on-activate script is sourced from a bash shell, and it can be
useful for spawning processes, dynamically setting environment
variables, and creating files and directories to be used by the
subsequent profile scripts, commands, and shells.
Hook scripts inherit environment variables set in the [vars] section,
and variables set here will in turn be inherited by the [profile]
scripts described below.
Any output written to stdout in a hook script is redirected to
stderr to avoid it being mixed with the output of profile section
scripts that write to stdout for “in-place” activations.
[hook]on-activate=""" # Interact with the tty as you would in any script echo "Starting up $FLOX_ENV_DESCRIPTION environment ..." read -e -p "Favourite colour or favorite color? " value # Set variables, create files and directories venv_dir="$(mktemp -d)" export venv_dir # Perform initialization steps, e.g. create a python venv python -m venv "$venv_dir" # Invoke apps that configure the environment via stdout eval "$(ssh-agent)""""
The on-activate script is not re-run when multiple activations are run
at the same time; for instance, if flox activate is run in two
different shells, the first activation will run the hook, but the second
will not. After all activations exit, the next flox activate will once
again run the hook. Currently, environment variables set by the first
run of the on-activate script are captured and then set by activations
that don’t run on-activate, but this behavior may change.
The on-activate script may be re-run by other flox commands; we may
create ephemeral activations and thus run the script multiple times for
commands such as services start. For this reason, it’s best practice
to make on-activate idempotent. However, the environment of your
current shell is only affected by the initial run of the script for the
first activation for your shell.
It’s also best practice to write hooks defensively, assuming the user is
using the environment from any directory on their machine.
script - DEPRECATED
This field was deprecated in favor of the profile section.
[profile]
Scripts defined in the [profile] section are sourced by your shell
and inherit environment variables set in the [vars] section and by the
[hook] scripts. The profile.common script is sourced for every
shell, and special care should be taken to ensure compatibility with all
shells, after which exactly one of profile.{bash,fish,tcsh,zsh} is
sourced by the corresponding shell.
These scripts are useful for performing shell-specific customizations
such as setting aliases or configuring the prompt.
[profile]common=""" echo "it's gettin' flox in here""""bash=""" source $venv_dir/bin/activate alias foo="echo bar" set -o vi"""zsh=""" source $venv_dir/bin/activate alias foo="echo bar" bindkey -v"""fish=""" source $venv_dir/bin/activate.fish alias foo="echo bar" fish_vi_key_bindings"""
Profile scripts are re-run for nested activations. A nested activation
can occur when an environment is already active and either
eval "$(flox activate)" or flox activate -- CMD is run. In this
scenario, profile scripts are run a second time. Re-running profile
scripts allows aliases to be set in subshells that inherit from a parent
shell with an already active environment.
[services]
The [services] section of the manifest allows you to describe the
services you would like to run as part of your environment e.g. a web
server or a database. The services you define here use the packages
provided by the [install] section and any variables you’ve defined in
the [vars] section or hook.on-activate script.
The [services] section is a table of key-value pairs where the keys
determine the service names, and the values (service descriptors)
determine how to configure and run the services.
command
The command to run (interpreted by a Bash shell) to start the service.
This command can use any environment variables that were set in the
[vars] section, the hook.on-activate script, or the service-specific
vars table.
vars
A table of environment variables to set for the invocation of this
specific service. Nothing outside of this service will observe these
environment variables.
is-daemon
Whether this service spawns a daemon when it starts. Some commands start
a background process and then terminate instead of themselves running
for an extended period of time. These programs need special handling
when it comes time to shut down the services, so you must mark them with
the is-daemon field. If this field is set to true you must also
specify the shutdown.command field, otherwise the process will
continue to run after calling flox services stop or after exiting the
last activation of the environment.
shutdown.command
A command to run to shut down the service instead of delivering the
SIGTERM signal to the process. Some programs require special handling to
shut down properly e.g. a program that spawns a server process and uses
a client to tell the server to shut down. Sending a SIGTERM to a client
in that case may not shut down the server. In those cases you may
provide a specific shutdown command to run instead of relying on the
default behavior of sending a SIGTERM to the service. This field is
required if the is-daemon field is true.
systems
An optional list of systems on which to run this service. If omitted,
the service is not restricted.
[options]
The [options] section of the manifest details settings for the
environment itself.
systems
The allowlist of systems that this environment supports. Valid values
are x86_64-linux, aarch64-linux, x86_64-darwin, and
aarch64-darwin. flox init automatically populates
this list with the current system type. A user that attempts to pull an
environment from FloxHub when their environment isn’t explicitly
supported will be prompted whether to automatically add their system to
this list. See flox-pull(1) for more details.
allow.unfree
Allows packages with unfree licenses to be installed and appear in
search results. The default is false.
allow.broken
Allows packages that are marked broken in the catalog to be installed
and appear in search results. The default is false.
allow.licenses
An allowlist of software licenses to allow in search results in
installs. Valid entries are SPDX
Identifiers.
semver.allow-pre-releases
Whether to allow pre-release software for package installations. The
default is false. Setting this value to true would allow a package
version 4.2.0-pre rather than 4.1.9.
cuda-detection
Whether to detect CUDA libraries and provide them to the environment.
The default is true. When enabled, Flox will detect if you have an
Nvidia device and attempt to locate libcuda in well-known paths.