Clone of Guile-Hoot (https://gitlab.com/spritely/guile-hoot) Scheme to WebAssembly compiler from the Spritely Institute

David Thompson 2ad7e501fd Document --user-imports flag in compile-wasm help output. 2 viikkoa sitten
bin 690aacf394 Fix bin/call.scm 3 kuukautta sitten
design 94e2e26722 Fix compilation of `null?` 1 vuosi sitten
doc 3b50d27800 Add finalization registry interface. 1 kuukausi sitten
examples 181bf222a2 Attempt to update example 7 kuukautta sitten
js-runner ad1e68d87a module: scripts: compile-wasm: Add support for user imports. 1 kuukausi sitten
lib 063bfe026c Merge branch 'export-print-backtrace' into 'main' 3 viikkoa sitten
module 2ad7e501fd Document --user-imports flag in compile-wasm help output. 2 viikkoa sitten
reflect-js 3b50d27800 Add finalization registry interface. 1 kuukausi sitten
reflect-wasm a91322c5b5 Add low-level support for syntax transformers 1 kuukausi sitten
test 58e7463721 Fix cond-expand in define-library forms. 2 viikkoa sitten
.dir-locals.el 270692ceb1 Update .dir-locals to correctly indent "import" 1 kuukausi sitten
.gitignore 65a0cb06fc Update .gitignore. 5 kuukautta sitten
.gitlab-ci.yml 2ae80f8d6b ci: Change image back to latest. 5 kuukautta sitten
COPYING d3c885f9d0 Add license file 1 vuosi sitten
LICENSE.txt d3c885f9d0 Add license file 1 vuosi sitten
Makefile.am 2d583e6e52 Add modules library 4 viikkoa sitten
README.md 9d0cfedef7 Update docs to reflect changes in reflection library. 4 kuukautta sitten
acinclude.m4 a69a6c92a4 Add guile.m4 to acinclude 1 vuosi sitten
bootstrap.sh 7774463b71 Add autotools build system. 1 vuosi sitten
ci-manifest.scm e39176bf4b Move manifest.scm to ci-manifest.scm. 1 vuosi sitten
configure.ac 207aca9989 Bump version to 0.5.0. 2 kuukautta sitten
guix.scm 207aca9989 Bump version to 0.5.0. 2 kuukautta sitten
hoot.ase f8ddb0fb4c Update brightness a bit on logo 1 vuosi sitten
hoot.png f8ddb0fb4c Update brightness a bit on logo 1 vuosi sitten
pre-inst-env.in f102fd5bf4 Move Scheme standard library out to lib/ 7 kuukautta sitten
size-metrics.scm 75468b5bf8 ci: Gather binary size metrics. 10 kuukautta sitten
upload-ci-image bc8c971f84 Use zstd to compress docker image 8 kuukautta sitten

README.md

Guile Hoot

Hoot logo

Hoot is the codename for the Guile->WebAssembly project launched by the Spritely Institute. In addition to the compiler, Hoot contains a full WebAssembly toolchain with a WAT parser, an assembler, a disassembler, an interpreter, etc.

For a fuller picture of project status, including known limitations, see the "Status" section of our documentation..

Project goals and timeframe

Hoot aims to be an ahead-of-time compiler for all of R7RS-small Scheme to WebAssembly (aka Wasm). Hoot uses several Wasm extensions such as tail calls and garbage collection. The good news is that these extensions are already available in major browsers such as Mozilla Firefox and Google Chrome, and will soon be making their way into stable browser releases everywhere!

After completing R7RS-small support, we will move on to supporting all of Guile. We are keeping this end-goal in mind as we build the early deliverable.

Resulting code should all run on stock Guile. Currently, we require a Guile built from the main branch of Git as we have upstreamed several changes to Guile that have not yet been released.

The shape of things

In the end we expect to be able to compile Scheme programs to single WebAssembly files. To deploy on web browsers there is an associated JavaScript module. Some non-web targets are hosted by JavaScript implementations (e.g. node); those are similar to web browsers. Otherwise on WASI hosts we expect to have a WASI-specific support module eventually.

The minimal compiled module size is some tens of kilobytes, uncompressed. The auxiliary WebAssembly module to do impedance matching with JavaScript is about four kilobytes uncompressed, and the generic JS library is about 500 lines of unminified JS. As we implement more of Scheme, we hope to preserve this "small programs compile to small files" property, rather than having every compiled program include the whole of Guile's standard library.

But... why the name "Hoot"?

We thought this project deserved a cute project name and mascot, and everyone at the time agreed an owl was nice, and Christine Lemmer-Webber had recently just drawn up this owl pixel art, and so it became the mascot. The name naturally flowed from there.

Project updates

See the log file.

Installing Hoot's stable releases

Note that at the time of writing, Hoot requires a development version of Guile. This may not be the case at your time of reading!

Below are system-specific instructions for installing Hoot.

On Guix

Hoot is already available in Guix:

guix shell --pure guile-next guile-hoot

On Mac OS (homebrew)

Hoot is available in Mac OS thanks to to Alex Conchillo Flaqué (whose instructions we are repeating here)!

Add the Guile Homebrew tap if you haven't already:

brew tap aconchillo/guile

If Guile is already installed with Homebrew, unlink it since we need a newer version:

brew unlink guile

Now, just install Hoot:

brew install guile-hoot

This will also install guile-next, a bleeding edge version of Guile, so it might take a while if there's no bottle available.

Building from source

Easy path: Use Guix

This is by far the easiest path because Guix does all the hard work for you.

First, clone the repository:

git clone https://gitlab.com/spritely/guile-hoot
cd guile-hoot
guix shell
./bootstrap.sh && ./configure && make

The guix shell step will take a while to build because we're using a custom version of Guile and a bleeding edge version of V8. If everything worked okay you can now run make check:

make check

Did everything pass? Cool! That means Hoot works on your machine!

Advanced path: Build dependencies on your own

Maybe you want to understand better what Hoot is actually doing, or maybe you want to hack on the version of Guile used for Hoot, or etc! This section is for you.

First, you need to build Guile from the main branch.

Then you can clone and build this repo:

git clone https://gitlab.com/spritely/guile-hoot
cd guile-hoot
./bootstrap.sh && ./configure && make

To run the test suite against a production Wasm host, you will need a recent version of V8 or a V8 distribution such as NodeJS 22+. NodeJS is the easiest route.

Building V8 is annoying. You need to have depot_tools installed; see https://v8.dev/docs/source-code. Once you have that see https://v8.dev/docs/build to build. You will end up with a d8 binary in out/x64.release (if you are on an x86-64 platform).

If all that works you should be able to make check:

make check

If you want to skip the V8 stuff, you can run the test suite against our own Wasm interpreter instead:

make check WASM_HOST=hoot

Try it out

Hoot is a self-contained system, so the easiest way to try it is from the Guile REPL:

./pre-inst-env guile

From the Guile prompt, enter the following to evaluate the program 42 in Hoot's built-in Wasm interpreter:

scheme@(guile-user)> ,use (hoot reflect)
scheme@(guile-user)> (compile-value 42)
$5 = 42

More interestingly, Scheme procedures that live within the Wasm guest module can be called from Scheme as if they were host procedures:

scheme@(guile-user)> (define hello (compile-value '(lambda (x) (list "hello" x))))
scheme@(guile-user)> hello
$6 = #<hoot #<procedure>>
scheme@(guile-user)> (hello "world")
$7 = #<hoot ("hello" "world")>

Hoot also introduces the guild compile-wasm subcommand which can be used to compile a Scheme file to Wasm via the CLI or a build script:

echo 42 > 42.scm
./pre-inst-env guild compile-wasm -o 42.wasm 42.scm

To actually load 42.wasm you could use the Hoot VM as mentioned above or use a production WebAssembly implementation such as a web browser. Hoot is compatible with Firefox 121+ and Chrome 119+. WebKit-based browsers such as Safari are not currently compatible as WebKit does not yet have the Wasm GC and tail call features that Hoot relies upon.

The generated WebAssembly doesn't depend on a web browser/JavaScript, but it does take some capabilities from the host system, such as the BigInt implementation. For web browsers, these facilities are provided by reflect.js. This reflection library requires two auxiliary WebAssembly modules:

1) reflect.wasm, which is compiled from reflect.wat

2) wtf8.wasm, which is compiled from wtf8.wat.

See the manual for a more in-depth tutorial and full API documentation!

Examples

For quickly getting started with a new project, see examples/project-template/README.md for an explanation of how to use our project template.

For more examples of using Hoot, check out a couple of our other repos:

Maintenance

GitLab CI

Here's how to build a Docker image for use in GitLab CI. Guix produces the actual image, but skopeo is required to upload it to the GitLab container registry.

Get skopeo:

guix shell skopeo

If this is your first time using the GitLab registry, you need to login. This requires setting up a GitLab personal access token with read_api and write_registry permissions. Once you have a token, run:

skopeo login registry.gitlab.com

Build and upload the image:

./upload-ci-image