Giter Club home page Giter Club logo

aarch64-build-box's Introduction

aarch64-build-box's People

Contributors

adisbladis avatar andir avatar angerman avatar aszlig avatar cole-h avatar colemickens avatar craigem avatar cstrahan avatar dhess avatar dtzwill avatar ehmry avatar erictapen avatar flokli avatar gaelan avatar ghuntley avatar grahamc avatar jtojnar avatar kiwi avatar lheckemann avatar lovesegfault avatar lukateras avatar ma27 avatar mic92 avatar misuzu avatar mogorman avatar mweinelt avatar samueldr avatar timokau avatar worldofpeace avatar zowoq avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

aarch64-build-box's Issues

ofborg failures because the build users have run out

When using ofborg, sometimes the build users run out and ofborg comments on the PR with a text such as the following:

Failure on aarch64-linux (full log)

Partial log (click to expand)

building '/nix/store/lm0s1yhqslr1yf2n892qkwpld3r3ykia-unit-systemd-journal-flush.service.drv'...
building '/nix/store/hf1qr9bqillcz54wwr58fiy75d4mbga1-unit-systemd-journald.service.drv'...
building '/nix/store/g54j9nmdzcqdaz0jn1x1cbiflz5jvkvv-unit-systemd-logind.service.drv'...
building '/nix/store/fsvhkwx4xv9d0c3fpwy7sjqxiyqmxl04-unit-systemd-modules-load.service.drv'...
building '/nix/store/r858h9vsgbzyfgrcw6gx7syxc8iikpga-unit-systemd-random-seed.service.drv'...
building '/nix/store/cs4k3mggbq661qhlv44c16f9xsx8l1jn-unit-systemd-remount-fs.service.drv'...
building '/nix/store/2cyv967hcb8iywbqabn9c0cbghfq5vyl-unit-systemd-timedated.service.drv'...
building '/nix/store/jksb7zx5p7m3h37yqpml1zi5aib2hry3-unit-systemd-update-utmp.service.drv'...
building '/nix/store/07yvcq5x9r8sbzkx6c398w79fcqb30yz-unit-systemd-user-sessions.service.drv'...
�[31;1merror:�[0m all build users are currently in use; consider creating additional users and adding them to the 'nixbld' group

ofborg should probably get special rights or a fallback to ensure there’s always build users for it.

MacOS Mojave entering no password restults in this

Bryans-MacBook-Air:aarch64-build-box b$ sudo su
Password:
sh-3.2# ssh [email protected] -i /root/a-private-key
Warning: Identity file /root/a-private-key not accessible: No such file or directory.
ssh: Could not resolve hostname aarch64.nixos.commnity: nodename nor servname provided, or not known
sh-3.2# ssh ~[email protected] -i /root/a-private-key
Warning: Identity file /root/a-private-key not accessible: No such file or directory.
ssh: Could not resolve hostname aarch64.nixos.commnity: nodename nor servname provided, or not known
sh-3.2# ssh [email protected] -i /root/a-private-key
Warning: Identity file /root/a-private-key not accessible: No such file or directory.
The authenticity of host 'aarch64.nixos.community (147.75.79.198)' can't be established.
ED25519 key fingerprint is SHA256:iPNPF+wdJezn9hz9tn02ONpwALemteTvq5Nz5xdsNa8.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'aarch64.nixos.community,147.75.79.198' (ED25519) to the list of known hosts.
Password:
Password:
Password:
[email protected]'s password:
Permission denied, please try again.
[email protected]'s password:
Permission denied, please try again.
[email protected]'s password:
Received disconnect from 147.75.79.198 port 22:2: Too many authentication failures
Disconnected from 147.75.79.198 port 22
sh-3.2# ssh [email protected] -i /root/a-private-key
Warning: Identity file /root/a-private-key not accessible: No such file or directory.
Password:
Password:
Password:
[email protected]'s password:
Permission denied, please try again.
[email protected]'s password:
Permission denied, please try again.
[email protected]'s password:
Received disconnect from 147.75.79.198 port 22:2: Too many authentication failures
Disconnected from 147.75.79.198 port 22
sh-3.2#

ssh key not accepted

Worked yesterday, but not today for strange reasons.

$ ssh -v [email protected]
...
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug1: Server host key: ssh-ed25519 SHA256:iPNPF+wdJezn9hz9tn02ONpwALemteTvq5Nz5xdsNa8
debug1: Host 'aarch64.nixos.community' is known and matches the ED25519 host key.
debug1: Found key in /home/joerg/.ssh/known_hosts:670
debug1: rekey after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: rekey after 134217728 blocks
debug1: SSH2_MSG_EXT_INFO received
debug1: kex_input_ext_info: server-sig-algs=<ssh-ed25519,ssh-rsa,rsa-sha2-256,rsa-sha2-512,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521>
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey,password,keyboard-interactive
debug1: Next authentication method: publickey
debug1: Offering public key: RSA SHA256:XpoaLC+zD21MS6WMEv5Kg3W1x9Nzxdu7gKrmpHuhh+A /home/joerg/.ssh/id_rsa
debug1: Authentications that can continue: publickey,password,keyboard-interactive
debug1: Offering public key: ECDSA SHA256:LU3XtPD6Y+Ayu9o5ZzuScgIwnJ4xtpieME0f/W0Ti0o /home/joerg/.ssh/id_ecdsa
debug1: Authentications that can continue: publickey,password,keyboard-interactive
debug1: Offering public key: ED25519 SHA256:Qi7vN+Yxl1jC979xlAQGJoixoT6N+Ta2Npf2OAWLnUU /home/joerg/.ssh/id_ed25519
debug1: Authentications that can continue: publickey,password,keyboard-interactive
debug1: Trying private key: /home/joerg/.ssh/id_dsa
debug1: Next authentication method: keyboard-interactive
Password:

libeatmydata causing odd stack trace for golang app executing as post-build-hook

Hi. I'm working on a new tool to manage/upload to Nix binary caches. One of it's features is to queue uploads via a post-build-hook, allowing for uploading build artifacts that would otherwise be difficult in some specific build scenarios.

In testing, I found that it worked in most places, but one of my final real world usage tests was to use aarch64.nixos.community to build somethings and cache them. However, I have run into this issue:

When my application executes under nix-daemon, as it invokes the post-build-hook, the child process, my application, crashes with a backtrace pointing to libeatmydata:

Core was generated by `/nix/store/qbbmsd6ldg1x4laxpa0128l5li6h79cb-nnnnn-16228faf4e6935a9cd4e9edc2621c'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x0000ffffaa2d21ac in dlsym () from /nix/store/akyy80zkwyiy0n51kc4vx0qpxma77701-glibc-2.30/lib/libdl.so.2
warning: Missing auto-load script at offset 0 in section .debug_gdb_scripts
of file /nix/store/qbbmsd6ldg1x4laxpa0128l5li6h79cb-nnnnn-16228faf4e6935a9cd4e9edc2621cca7cca0b725/bin/nnnnnn.
Use `info auto-load python-scripts [REGEXP]' to list them.
(gdb) bt
#0  0x0000ffffaa2d21ac in dlsym () from /nix/store/akyy80zkwyiy0n51kc4vx0qpxma77701-glibc-2.30/lib/libdl.so.2
#1  0x0000ffffaa48195c in eatmydata_init () from /nix/store/6kjxy32r1qzhsdm2h77ljg2nzxhdsiv1-libeatmydata-105/lib/libeatmydata.so
#2  0x0000ffffaa4a2298 in call_init () from /nix/store/6diwpjpcjz497wxwj4mdbfg8hl1hi8l2-glibc-2.32/lib/ld-linux-aarch64.so.1
#3  0x0000ffffaa4a2394 in _dl_init () from /nix/store/6diwpjpcjz497wxwj4mdbfg8hl1hi8l2-glibc-2.32/lib/ld-linux-aarch64.so.1
#4  0x0000ffffaa495048 in _dl_start_user () from /nix/store/6diwpjpcjz497wxwj4mdbfg8hl1hi8l2-glibc-2.32/lib/ld-linux-aarch64.so.1
Backtrace stopped: previous frame identical to this frame (corrupt stack?)

This backtrace doesn't appear to be anywhere near my code, and I'm guessing is related the this piece of the community box configuration:

https://github.com/nix-community/aarch64-build-box/blob/709f2f5bf678c83292d4058bea7944de56328040/configuration.nix#L160-L164

I'm mostly filing this because I'm looking for clues or hints as to what's going on. Is this something I can mitigate, somehow, in the package derivation? (Maybe I can do something to the binary to keep it from being affected negatively by libeatmydata?)

(I mention go in the issue title, not because I've successfully tested with a non-go app, but just because I've had issues with other nix things like patchelf with Go in the past.)

Update nixpkgs to fix Nix's /bin/sh

I was trying to build a Linux kernel and I ran into this failure:

manual-config configurePhase buildRoot=/build/source/build pwd=/build/source
'/build/source/build/.config' -> '/nix/store/wajbysr2cxiszvwh3rlk9rvqndkgsjlq-linux-config-4.4.115'
make[1]: Entering directory '/build/source/build'
/bin/sh: syntax error: support for $((arith)) is disabled

The problem is that Nix's /bin/sh isn't compiled with arithmetic expression support (along with a few other things). This was fixed in NixOS/nixpkgs#34628 and NixOS/nixpkgs#34677.

Could we bump the nixpkgs version to get these fixes, please? (Or, at the least, backport the first patch)

document build.cfg and build.sh

build.cfg seems to contain some settings like buildHost, target, pxeHost, pxeDir, opensslServer, opensslPort (and more?), and is used from build.sh to build a netboot image.

README.md should not only document how to use the builder, but also how to build a new builder.

Nixpkgs repo at /tmp/nixpkgs.git does not exist

Tried the fast clone trick recommended in the README, but the repo does not exist.

[hexa@aarch64:~]$ nix-shell -p git --run "git clone https://github.com/nixos/nixpkgs.git --reference /tmp/nix
pkgs.git"
these 13 paths will be fetched (31.75 MiB download, 167.40 MiB unpacked):
  /nix/store/11r888qq91kjb2prbrl8m44qyl8dl2vw-gcc-wrapper-9.5.0
  /nix/store/1mdw8fg1l2147iwzg1mn3hww9ln4qv4p-update-autotools-gnu-config-scripts-hook
  /nix/store/3c0dqm093ylw8ks7myzxdaif0m16rgcl-binutils-2.40
  /nix/store/3lqycwbv6jhbnc7f6ak8lh6cgfg5njpv-gnu-config-2021-01-25
  /nix/store/4mhhaggjp57h7sr8diiiskbb86nh4ppy-gcc-9.5.0
  /nix/store/5a0iicx9hfz46a2l64ydplawyl6shjcw-binutils-wrapper-2.40
  /nix/store/60llnv6dacqy7xs9naycx28kpc9qy9qy-binutils-2.40-lib
  /nix/store/6c6d6shr3qkm0yxg9lb6l1jsf4cs3y9l-gnumake-4.4
  /nix/store/ga5c1r4dq3gjgxvqzizb8ybqc7agq162-stdenv-linux
  /nix/store/gv72k5xl2x6z5mn3jkzjaysalgbahx70-patchelf-0.15.0
  /nix/store/q881kp1pk06p73h1d649smm25209rzzw-glibc-2.35-224-dev
  /nix/store/rgzwfhgmywcfq0mgqkgvii3p6jpws8zf-file-5.44
  /nix/store/x0jplj3nsiqw1625mwcmxbhgndkgbdp9-expand-response-params
copying path '/nix/store/3lqycwbv6jhbnc7f6ak8lh6cgfg5njpv-gnu-config-2021-01-25' from 'https://cache.nixos.org'...
copying path '/nix/store/x0jplj3nsiqw1625mwcmxbhgndkgbdp9-expand-response-params' from 'https://cache.nixos.org'...
copying path '/nix/store/rgzwfhgmywcfq0mgqkgvii3p6jpws8zf-file-5.44' from 'https://cache.nixos.org'...
copying path '/nix/store/6c6d6shr3qkm0yxg9lb6l1jsf4cs3y9l-gnumake-4.4' from 'https://cache.nixos.org'...
copying path '/nix/store/gv72k5xl2x6z5mn3jkzjaysalgbahx70-patchelf-0.15.0' from 'https://cache.nixos.org'...
copying path '/nix/store/q881kp1pk06p73h1d649smm25209rzzw-glibc-2.35-224-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/60llnv6dacqy7xs9naycx28kpc9qy9qy-binutils-2.40-lib' from 'https://cache.nixos.org'...
copying path '/nix/store/1mdw8fg1l2147iwzg1mn3hww9ln4qv4p-update-autotools-gnu-config-scripts-hook' from 'https://cache.nixos.org'...
copying path '/nix/store/3c0dqm093ylw8ks7myzxdaif0m16rgcl-binutils-2.40' from 'https://cache.nixos.org'...
copying path '/nix/store/4mhhaggjp57h7sr8diiiskbb86nh4ppy-gcc-9.5.0' from 'https://cache.nixos.org'...
copying path '/nix/store/5a0iicx9hfz46a2l64ydplawyl6shjcw-binutils-wrapper-2.40' from 'https://cache.nixos.org'...
copying path '/nix/store/11r888qq91kjb2prbrl8m44qyl8dl2vw-gcc-wrapper-9.5.0' from 'https://cache.nixos.org'...
copying path '/nix/store/ga5c1r4dq3gjgxvqzizb8ybqc7agq162-stdenv-linux' from 'https://cache.nixos.org'...
Cloning into 'nixpkgs'...
fatal: reference repository '/tmp/nixpkgs.git' is not a local repository.

I can't connect to the aarch64-build-box anymore.

It worked after my PR got merged and I noticed it stopped a few days ago. I asked some one with access to the box to check the /etc/passwd file and my user isn't in it anymore. I guess it stopped working with the merge of #161 which was merged after my pr but has a older commit.

cc @zowoq

experimental Nix feature 'nix-command' is disabled

I used to use this command to log into the box when I needed to do something interactive:

ssh -t aarch64-nix-community 'nix run nixpkgs.htop nixpkgs.vim nixpkgs.git nixpkgs.tmux nixpkgs.nix-review'

This now fails with the error message referenced in the issue title. That's no big deal of course, I can just replace nix run with nix-shell. But I'm wondering if there's a reason for disabling nix2?

Error build: unexpected end-of-file

Runnig command:

nix-build . -A mariadb --argstr system aarch64-linux

Error:

these derivations will be built:
  /nix/store/dcfaw938zaqjwr1nmr1axs9mvscgqfbs-builder.pl.drv
  /nix/store/15kxspjxzvkdpi3vhlsi6nbayyihfi9z-perl-5.30.3-env.drv
  /nix/store/64fmqmq90ifx0yrcxzpzz51xaffqjgx4-mariadb-server-10.5.4.drv
these paths will be fetched (22.19 MiB download, 206.27 MiB unpacked):
  /nix/store/1s49412znwc37n8pq37b00ff5a3rb2w7-mariadb-connector-c-3.1.8
  /nix/store/2q6kfd52l2jrh9wyx7p4kfh0birirl1d-shadow-4.8
  /nix/store/33vy9nppxj5fhx662i9zk4f3hjhc069j-systemd-245.6
  /nix/store/5j9svfn3k5mi8f8w20iywghl51r7a7np-perl5.30.3-Devel-CheckLib-1.14
  /nix/store/7ppnbg50fx112lxxlm0riv3g497qa25g-libxml2-2.9.10-dev
  /nix/store/8n3f4f3dhdcp0hi7yqiinwsy2a289r5j-gcc-wrapper-9.3.0
  /nix/store/bbqlf4cs3pbh7kvp3gg9xf4khm9qh38b-perl5.30.3-DBI-1.642
  /nix/store/dpq2apg5q8cjssghb8ad0n5mi0xdbkgz-systemd-245.6-dev
  /nix/store/fv55b93p72hpfz6lj2vnsmw9qlbxfv0x-perl5.30.3-DBD-mysql-4.050
  /nix/store/gm59pqf641zb8kfrr315hc3vbjazlj2k-cmake-3.17.3
  /nix/store/gpkblqazbn4qnfny4p2bqfnl9s1jbfp8-libmicrohttpd-0.9.70
  /nix/store/nwfisv57z29dak533dhrbnxwj5ggnnjm-stdenv-linux
  /nix/store/qb5h4jlgk488zs3z6ivjyvprwb0s68qj-curl-7.70.0-dev
  /nix/store/ryapbw649mh3ram2dlnqg39ibdkc5rbx-kbd-2.0.4
  /nix/store/v1xxgxsgzd8vpfi7ri2w32fbw4y5zixa-boost-1.69.0-dev
  /nix/store/w7za1xrn9fcq7d4fdi8fk27c03fzq0qv-boost-1.69.0
  /nix/store/z24nddk8zn0d8djjjvcavirhg4qgqrzn-util-linux-2.35.1-bin
copying path '/nix/store/gm59pqf641zb8kfrr315hc3vbjazlj2k-cmake-3.17.3' from 'https://cache.nixos.org'...
copying path '/nix/store/qb5h4jlgk488zs3z6ivjyvprwb0s68qj-curl-7.70.0-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/7ppnbg50fx112lxxlm0riv3g497qa25g-libxml2-2.9.10-dev' from 'https://cache.nixos.org'...
building '/nix/store/dcfaw938zaqjwr1nmr1axs9mvscgqfbs-builder.pl.drv' on 'ssh://[email protected]'...
copying path '/nix/store/w7za1xrn9fcq7d4fdi8fk27c03fzq0qv-boost-1.69.0' from 'https://cache.nixos.org'...
copying path '/nix/store/8n3f4f3dhdcp0hi7yqiinwsy2a289r5j-gcc-wrapper-9.3.0' from 'https://cache.nixos.org'...
copying path '/nix/store/bbqlf4cs3pbh7kvp3gg9xf4khm9qh38b-perl5.30.3-DBI-1.642' from 'https://cache.nixos.org'...
copying path '/nix/store/ryapbw649mh3ram2dlnqg39ibdkc5rbx-kbd-2.0.4' from 'https://cache.nixos.org'...
copying path '/nix/store/gpkblqazbn4qnfny4p2bqfnl9s1jbfp8-libmicrohttpd-0.9.70' from 'https://cache.nixos.org'...
copying path '/nix/store/5j9svfn3k5mi8f8w20iywghl51r7a7np-perl5.30.3-Devel-CheckLib-1.14' from 'https://cache.nixos.org'...
copying path '/nix/store/2q6kfd52l2jrh9wyx7p4kfh0birirl1d-shadow-4.8' from 'https://cache.nixos.org'...
copying path '/nix/store/1s49412znwc37n8pq37b00ff5a3rb2w7-mariadb-connector-c-3.1.8' from 'https://cache.nixos.org'...
copying path '/nix/store/nwfisv57z29dak533dhrbnxwj5ggnnjm-stdenv-linux' from 'https://cache.nixos.org'...
copying path '/nix/store/z24nddk8zn0d8djjjvcavirhg4qgqrzn-util-linux-2.35.1-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/fv55b93p72hpfz6lj2vnsmw9qlbxfv0x-perl5.30.3-DBD-mysql-4.050' from 'https://cache.nixos.org'...
error: --- Error --- nix-store
error: --- BadHash --- nix-daemon
hash '' has wrong length for hash type 'md5'
error: unexpected end-of-file
builder for '/nix/store/dcfaw938zaqjwr1nmr1axs9mvscgqfbs-builder.pl.drv' failed with exit code 1
cannot build derivation '/nix/store/15kxspjxzvkdpi3vhlsi6nbayyihfi9z-perl-5.30.3-env.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/64fmqmq90ifx0yrcxzpzz51xaffqjgx4-mariadb-server-10.5.4.drv': 1 dependencies couldn't be built
error: build of '/nix/store/64fmqmq90ifx0yrcxzpzz51xaffqjgx4-mariadb-server-10.5.4.drv' failed
Time: 0h:00m:03s

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.