A key design principle behind GNU Guix as a package manager is its extensibility, i.e. allowing users to easily write their own package definitions. Thus this post aims to serve as a starting reference for doing precisely that.
The package I'll be using for this demonstration is LÖVE-Nuklear, which provide bindings to the immediate mode GUI library, Nuklear for the Lua game engine, LÖVE.
Load Required Modules
All Guix packages are defined in source files written in Guile Scheme, with each source corresponding to a single module that contains packages related along a common theme. For example, libraries for specific programming languages like Golang or Rust, enduser applications for music or games, implementations of particular protocols like FTP or IPFS, and so on.
My example module shall only contain a single package, but in general there can be many. To begin, we first load the modules required to define the package:
(define-module (love-nuklear)
#:use-module (guix packages)
#:use-module (guix git-download)
#:use-module (guix build-system cmake)
#:use-module (guix licenses)
#:use-module (gnu packages lua))
All package definitions require at least 4 modules, which are all
located in the guix
namespace:
-
packages
, this module exports the<package>
record type, of which your package definition shall become an instance of -
source code retrieval module, typically
download
(for downloading sources over HTTP(S)) orgit-download
(as shall be seen in this example); other methods such ashg-download
andsvn-download
are also available -
build-system, such as
gnu
(GNU Make being its core),meson
with itsninja
backend for C/C++,dune
(for OCaml),cmake
(used for this example), etc. -
licenses
, which is self-explanatory
Of course in practice, the vast majority of software contain
dependencies that must also be loaded. And if these dependencies are
already packaged, then they can be found under the gnu packages
namespace. For my example of love-nuklear
, the only dependency is the
luajit
package from the lua
module.
Fill Basic Info & Metadata
Now it's time to define the actual package, starting with its basic information and metadata:
(define-public love-nuklear
(let ((version "v2.6")
(commit "fef4e00a602efb16c57ae962850b6e7a01f7a29a"))
(package
(name "love-nuklear")
(version (git-version version "+4commits" commit))
;; ...
;; ...
;; ...
(synopsis "Lightweight immediate mode GUI for LÖVE games")
(description "LÖVE is a Lua framework for making 2D games. Nuklear
is a minimal state immediate mode graphical user interface toolkit. This
package is the Nuklear bindings for LÖVE created by Kevin Harrison.")
(home-page "https://github.com/keharriso/love-nuklear/")
(license expat))))
A few points worth mentioning:
-
Guix packages are defined via
define-public
by convention. This eliminates having to manually declare the package definiton forexport
as part of the module's public interface. -
The
version
field can be any string, so a simple"v2.6"
string literal would be equally valid in the above. But since I'll be usinggit-download
, I wanted to provide maximum versioning info for the sake of reproduciblity. Thus thegit-version
procedure was used, which takes 3 arguments:version
,revision
,commit
hash, and evaluates to an informative yet succinct string to be used as the version ID of the package. -
If the software being packaged is multi-licensed, the
license
field can be set to a list representing such
Fetch Source
As briefly mentioned earlier, although Guix supports several source
fetching methods, in practice you'll mostly be using either url-fetch
from the download
module, or git-fetch
from the git-download
module. Whenever possible, you should prefer the former, since it is
more efficient.
For LÖVE-Nuklear however, git-fetch
was needed because the source
code of Nuklear, which
is not bundled in the tarball release, but is instead tracked as a
git-submodule, is required to build the final shared object. So to do
this, we use git-fetch
with (recursive? #t)
, as shown below:
(source (origin
(method git-fetch)
(uri (git-reference
(url "https://github.com/keharriso/love-nuklear/")
(commit commit)
(recursive? #t)))
;; NOTE: the HEAD of the Nuklear git-submodule is at commit
;; "adc52d710fe3c87194b99f540c53e82eb75c2521" of Oct 1 2019
(file-name (git-file-name name version))
(sha256
(base32
"15qmy8mfwkxy2x9rmxs6f9cyvjvwwj6yf78bs863xmc56dmjzzbn"))))
Before building from the source, Guix checks that the hash of the
downloaded files is the same as that supplied by you, the packager.
When using url-fetch
, the base32 hash of the project's source will
be directly computed by Guix and displayed for your convenience after
you execute $ guix download <https://url-package-source>
. When
using git-fetch
however, you must first git clone
the repository
(including the submodules if applicable), then invoke $ guix hash -xr
<path/to/git/source>
, where the -x
flag tells Guix to ignore VCS
files and -r
tells Guix to compute the hash recursively.
Specify Dependencies
Guix differentiates between 3 types of dependencies:
-
native-inputs
: build but not runtime dependencies -
inputs
: runtime dependencies -
propagated-inputs
: similar toinputs
, but can also be useful for specifying packages that should be installed alongside your main package. You might want this when for example, header files from another library are required to compile the package in question, or to gain access to runtime libraries in languages that lack the facility to record runtime search paths.
As already stated, the only runtime dependency, and thus input
of
love-nuklear
is luajit
:
(inputs
`(("luajit" ,luajit)))
Fine-Tune Build Procedure
At the time of writing, Guix provides modules for 30+ build
systems.
From the foundational gnu-build-system
, which all other build
systems inherit from to one degree or another, to language specific
ones like cargo-build-system
for Rust, dune-build-system
for
OCaml, python-build-system
, etc., to build script generators like
meson-build-system
and cmake-build-system
.
Note that in addition to representing the build procedure to be used,
the build-system
field also implicitly specify dependencies of said
build procedure. Thus it is unnecessary to manually specify these build
dependencies as native-inputs
.
The following snippet shows the first build procedure that was
successful in installing the love-nuklear
package:
(build-system cmake-build-system)
(arguments
`(#:build-type "Release"
#:tests? #f
#:phases
(modify-phases %standard-phases
(replace 'install
(lambda* (#:key outputs #:allow-other-keys)
(let* ((out (assoc-ref outputs "out"))
(share (string-append out "/share")))
(install-file "nuklear.so" share)
#t))))))
-
The
#:build-type
argument is specific to thecmake-build-system
, which can also accommodate other build flags typically passed on the command line tocmake
. -
All build systems accept the
#:tests?
argument, which indicates whether tests should be run after your package has been successfully built (#t
by default). -
The phases of the build procedure itself are modifiable. And quite often, one may find oneself needing to do just that, since not all software fully adhere to standarized build procedures.
-
This was the case for LÖVE-Nuklear when I began my attempt in packaging it. Its CMake file did not generate an install target for the output
nuklear.so
. Therefore the standard'install
phase of the build procedure was replaced by a custom one defined by thelambda
expression seen above. -
out
represents the location of the output directory, which is obtained by Guix via agetenv
call under-the-hood during runtime, as it cannot be known beforehand due to it depending on all the inputs of the package definition.
In the end though, I decided it was better to make the change
upstream, i.e. add an install target to the CMake build procedure of
LÖVE-Nuklear. After this change was kindly merged by its author,
love-nuklear
was then able to be built and installed smoothly with
zero modifications to the standard phases of the cmake-build-system
,
resulting in the cleaner snippet shown below:
(build-system cmake-build-system)
(arguments
`(#:build-type "Release"
#:tests? #f))
But just keep in mind that, in order to produce a successful package build, sometimes the only option is to modify the standard phases of one's build system.
Test Package Definition
Once the first draft of your package definition is complete, you are then ready to test out its correctness by attempting to build it locally.
To do so, just run $ guix build -K --file=<path/to/package/def>
.
Make sure to add a line at the end of your package module to actually
evaluate the package definiton (love-nuklear
for my example), as
the --file
flag tells Guix to build the package that the source
within <path/to/package/def>
evaluates to. The -K
flag is short for
--keep-failed
, thus failed partial build results will be left in your
/tmp
directory instead of being removed.
Another source of useful debugging information is the build log, which
in addition to being printed to STDIN on each build, is also written to
an appropriate directory identified by its build hash in /var/guix/
.
Through the iterative process of fixing errors reported in the build log, and occasionally inspecting the contents of failed partial builds, I was able to quickly bring the package definition of LÖVE-Nuklear to a successful state, whose constituent components are exactly the snippets already showcased earlier. But for viewing convenience, here's the finalized package definiton in its totality:
TODO: show full love-nuklear
definition gist
Contribute to Guix
If you'd like to submit your package definition upstream,
i.e. have it added to the GNU Guix ecosystem, then it's
important to run $ guix lint
before submitting it to the
project as a patch. This command
performs useful checks on your package definition, ensuring it conforms
to the GNU Guix standard. All available checkers can be listed with $
guix lint --list-checkers
. Here are what some of them do:
-
Provide basic validations, such as checking the formatting of your package's synopsis and description, the existence of the project's home-page URL, and validity of the license(s)
-
Offer technical suggestions, such as the appropriateness of the categorizations of your specified inputs, the success or failure of compiling a package to its derivation (which of course should succeed if you were able to run
guix build
successfully)
Lastly, I'm pleased to inform that my package definition for LÖVE-Nuklear has been accepted into the GNU Guix project. So if you'd like to check out this cool GUI module for the LÖVE game engine on Guix yourself, then it's as simple as:
$ guix pull
to get the latest updates for Guix$ guix package --install love-nuklear