Initial implementation of cross-compilation to Knuth's MMIX by siraben · Pull Request #102766 · NixOS/nixpkgs

siraben · 2020-11-04T14:32:56Z

Motivation for this change

Let's make Nix one of the first Linux package managers to have cross-compile support for MMIX!

The following command cross-builds GNU Hello and runs it in Knuth's mmixware simulator for MMIX showing that indeed it works.

$ nix-shell -E 'with import ./. { }; runCommand "" { buildInputs = [ pkgsCross.mmix.hello mmixware ]; } ""' \                            
            --run 'mmix $(which hello)'
Hello, world!

Some variations I'm trying (failed ones are strikethroughed)

Looks like we will only be able to use newlib, as it has mmixware support.

Things done

pkgs/development/tools/mmixware/default.nix

lib/systems/examples.nix

SuperSandro2000 · 2020-11-05T01:35:25Z

Result of nixpkgs-review pr 102766 run on x86_64-linux 1

1 package built:

mmixware

lib/systems/parse.nix

Ericson2314 · 2020-11-05T03:47:22Z

There are these two nones left over. Note you will also need to make mmixware a "kernel". (We should really rename "kernel" to something better!!)

siraben · 2020-11-05T03:49:00Z

~~Where's the two nones? I found one in doubles.nix~~ (answered on IRC)

vikanezrimaya · 2020-11-05T10:22:47Z

Please clarify: can this architecture run the Linux kernel or is it just bare-metal for now?

siraben · 2020-11-05T10:34:20Z

Currently bare metal. I'll adjust the top comment with variations tried.

siraben · 2020-11-05T10:36:52Z

It appears possible to boot a patched Linux kernel, see http://mmix.cs.hm.edu/examples/Linux/index.html

vikanezrimaya

I am unable to reproduce the nix-shell example above. Maybe I'm doing something wrong?

pkgs/development/tools/mmixware/default.nix

siraben · 2020-11-05T12:09:52Z

@kisik21 Please try again.

vikanezrimaya · 2020-11-05T12:15:07Z

@siraben yay, it's compiling!

siraben · 2020-11-05T12:18:38Z

@Ericson2314 I added this target locally, and it works.

  mmix-embedded = {
    config = "mmix";
    libc = "newlib";
  };

However GNU hello's diff seems to be very small. Are they really different targets?

diff --git a/hello_mmixware.txt b/hello_mmixware-embedded.txt
index 99e4e08..0ca8e94 100644
--- a/hello_mmixware.txt
+++ b/hello_mmixware-embedded.txt
@@ -1,4 +1,4 @@
-00000000: 9809 0101 5fa2 a96c 9801 0002 0000 0000  ...._..l........
+00000000: 9809 0101 5fa3 ea56 9801 0002 0000 0000  ...._..V........
 00000010: 0000 0100 6000 0000 0000 0000 0000 0000  ....`...........
 00000020: 0002 9758 0000 0000 0002 983c 2000 0000  ...X.......< ...
 00000030: 0000 0000 2000 0000 0000 1480 e3ff 0020  .... ..........

vikanezrimaya

Built and run the provided example successfully!

vikanezrimaya · 2020-11-05T13:37:13Z

It looks like ./lib/tests/release.nix needs updating to not see the new architecture as an error.

siraben · 2020-11-05T15:06:58Z

Looks like

It looks like ./lib/tests/release.nix needs updating to not see the new architecture as an error.

What do you mean by this?

vikanezrimaya · 2020-11-05T19:48:06Z

$ nix-build --arg pkgs 'import ./. {}' ./lib/tests/release.nix
warning: unknown setting 'extra-sandbox-paths'
error: --- ThrownError ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ nix-build
[{"expected":["aarch64-darwin","aarch64-genode","aarch64-linux","aarch64-none","arm-none","armv5tel-linux","armv6l-linux","armv6l-none","armv7a-darwin","armv7a-linux","armv7l-linux","avr-none","i686-cygwin","i686-darwin","i686-freebsd","i686-genode","i686-linux","i686-netbsd","i686-none","i686-openbsd","i686-windows","js-ghcjs","mipsel-linux","msp430-none","powerpc-none","powerpc64le-linux","riscv32-linux","riscv32-none","riscv64-linux","riscv64-none","vc4-none","wasm32-wasi","wasm64-wasi","x86_64-cygwin","x86_64-darwin","x86_64-freebsd","x86_64-genode","x86_64-linux","x86_64-netbsd","x86_64-none","x86_64-openbsd","x86_64-redox","x86_64-solaris","x86_64-windows"],"name":"testall","result":["aarch64-darwin","aarch64-genode","aarch64-linux","aarch64-none","arm-none","armv5tel-linux","armv6l-linux","armv6l-none","armv7a-darwin","armv7a-linux","armv7l-linux","avr-none","i686-cygwin","i686-darwin","i686-freebsd","i686-genode","i686-linux","i686-netbsd","i686-none","i686-openbsd","i686-windows","js-ghcjs","mipsel-linux","mmix-mmixware","msp430-none","powerpc-none","powerpc64le-linux","riscv32-linux","riscv32-none","riscv64-linux","riscv64-none","vc4-none","wasm32-wasi","wasm64-wasi","x86_64-cygwin","x86_64-darwin","x86_64-freebsd","x86_64-genode","x86_64-linux","x86_64-netbsd","x86_64-none","x86_64-openbsd","x86_64-redox","x86_64-solaris","x86_64-windows"]}]

Passing that through jq '.[0].result - .[0].expected' gets me ["mmix-mmixware"] - it means that the lib test suite doesn't expect to see the new double in the list of available doubles.

SuperSandro2000 · 2020-11-07T01:41:26Z

Result of nixpkgs-review pr 102766 run on x86_64-darwin 1

1 package built:

mmixware

siraben · 2020-11-07T02:55:02Z

@kisik21 I'm not sure what files I have to change to resolve that error.

FRidh · 2020-11-08T12:37:50Z

You need to add the new arch to lib/tests/systems.nix. I suggest having a look at the file's log, because this issue happened more often when new architectures were added.

Ericson2314 · 2020-11-13T18:43:52Z

@kisik21

Please clarify: can this architecture run the Linux kernel or is it just bare-metal for now?

The simulator supports some basic system calls. So it's like having a basic OS that just read writes out to serial ports or something.

Ericson2314

Looks good!

siraben requested review from Ericson2314, matthewbauer and nbp as code owners November 4, 2020 14:32

siraben changed the title ~~Initial implementation of cross-compilation of Knuth's MMIX~~ Initial implementation of cross-compilation to Knuth's MMIX Nov 4, 2020

SuperSandro2000 reviewed Nov 4, 2020

View reviewed changes

pkgs/development/tools/mmixware/default.nix Outdated Show resolved Hide resolved

pkgs/development/tools/mmixware/default.nix Outdated Show resolved Hide resolved

jtojnar reviewed Nov 4, 2020

View reviewed changes

pkgs/development/tools/mmixware/default.nix Outdated Show resolved Hide resolved

pkgs/development/tools/mmixware/default.nix Outdated Show resolved Hide resolved

siraben force-pushed the mmix branch 8 times, most recently from a3fe794 to 368d56c Compare November 4, 2020 16:57

Ericson2314 reviewed Nov 4, 2020

View reviewed changes

lib/systems/examples.nix Outdated Show resolved Hide resolved

veprbl added the 6.topic: cross-compilation Building packages on a different platform than they will be used on label Nov 4, 2020

siraben force-pushed the mmix branch 2 times, most recently from f40586a to 0927413 Compare November 5, 2020 01:30

Ericson2314 reviewed Nov 5, 2020

View reviewed changes

lib/systems/parse.nix Outdated Show resolved Hide resolved

siraben force-pushed the mmix branch 2 times, most recently from d40042a to 0bb2aa8 Compare November 5, 2020 06:53

siraben force-pushed the mmix branch 2 times, most recently from bc501b7 to 94aeca5 Compare November 5, 2020 08:09

vikanezrimaya suggested changes Nov 5, 2020

View reviewed changes

pkgs/development/tools/mmixware/default.nix Outdated Show resolved Hide resolved

pkgs/development/tools/mmixware/default.nix Outdated Show resolved Hide resolved

siraben force-pushed the mmix branch from 94aeca5 to 44e53e4 Compare November 5, 2020 12:09

vikanezrimaya approved these changes Nov 5, 2020

View reviewed changes

siraben force-pushed the mmix branch from 44e53e4 to fc6c74a Compare November 8, 2020 12:44

siraben requested review from edolstra and infinisil as code owners November 8, 2020 12:44

Initial implementation of mmix cross-compile

445dde6

siraben force-pushed the mmix branch from fc6c74a to 445dde6 Compare November 9, 2020 12:50

Ericson2314 approved these changes Nov 14, 2020

View reviewed changes

Ericson2314 merged commit 86fedc3 into NixOS:master Nov 14, 2020

siraben deleted the mmix branch November 14, 2020 17:51

This was referenced Jun 16, 2021

Revamp cross-compilation docs #127115

Open

[2018-2024] Nixpkgs committer nominations NixOS/nixpkgs-committers#60

Closed

Uh oh!

Conversation

siraben commented Nov 4, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation for this change

Things done

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

SuperSandro2000 commented Nov 5, 2020

Uh oh!

Uh oh!

Ericson2314 commented Nov 5, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

siraben commented Nov 5, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

vikanezrimaya commented Nov 5, 2020

Uh oh!

siraben commented Nov 5, 2020

Uh oh!

siraben commented Nov 5, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

vikanezrimaya left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

siraben commented Nov 5, 2020

Uh oh!

vikanezrimaya commented Nov 5, 2020

Uh oh!

siraben commented Nov 5, 2020

Uh oh!

vikanezrimaya left a comment

Choose a reason for hiding this comment

Uh oh!

vikanezrimaya commented Nov 5, 2020

Uh oh!

siraben commented Nov 5, 2020

Uh oh!

vikanezrimaya commented Nov 5, 2020

Uh oh!

SuperSandro2000 commented Nov 7, 2020

Uh oh!

siraben commented Nov 7, 2020

Uh oh!

FRidh commented Nov 8, 2020

Uh oh!

Ericson2314 commented Nov 13, 2020

Uh oh!

Ericson2314 left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

siraben commented Nov 4, 2020 •

edited

Loading

Ericson2314 commented Nov 5, 2020 •

edited

Loading

siraben commented Nov 5, 2020 •

edited

Loading

siraben commented Nov 5, 2020 •

edited

Loading