MirrorHub/nixpkgs
0
0
Fork 0
mirror of https://github.com/NixOS/nixpkgs.git synced 2024-11-15 06:14:57 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions
nixpkgs/pkgs/top-level/release-haskell.nix

359 lines
10 KiB
Nix
Raw Normal View History

pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
/*
release-haskell: add documentation explaining what this file is used for
2021-05-15 04:49:00 +02:00
This is the Hydra jobset for the `haskell-updates` branch in Nixpkgs.
You can see the status of this jobset at
https://hydra.nixos.org/jobset/nixpkgs/haskell-updates.
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
To debug this expression you can use `hydra-eval-jobs` from
`pkgs.hydra-unstable` which prints the jobset description
to `stdout`:
$ hydra-eval-jobs -I . pkgs/top-level/release-haskell.nix
*/
top-level/release-haskell.nix: support aarch64-linux and x86_64-darwin top-level/release.nix builds haskellPackages on those systems as well, so we should test on them as well. Currently we have virtually no insight into the state on there.
2021-05-05 14:51:03 +02:00
{ supportedSystems ? [ "x86_64-linux" "x86_64-darwin" "aarch64-linux" ] }:
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
let
releaseLib = import ./release-lib.nix {
inherit supportedSystems;
};
inherit (releaseLib)
pkgs
packagePlatforms
mapTestOn
aggregate
;
inherit (pkgs) lib;
# helper function which traverses a (nested) set
# of derivations produced by mapTestOn and flattens
# it to a list of derivations suitable to be passed
# to `releaseTools.aggregate` as constituents.
accumulateDerivations = jobList:
lib.concatMap (
attrs:
if lib.isDerivation attrs
then [ attrs ]
else if lib.isAttrs attrs
then accumulateDerivations (lib.attrValues attrs)
else []
) jobList;
# names of all subsets of `pkgs.haskell.packages`
compilerNames = lib.mapAttrs (name: _: name) pkgs.haskell.packages;
# list of all compilers to test specific packages on
all = with compilerNames; [
ghc884
ghc8104
ghc901
];
# packagePlatforms applied to `haskell.packages.*`
compilerPlatforms = lib.mapAttrs
(_: v: packagePlatforms v)
pkgs.haskell.packages;
# This function lets you specify specific packages
# which are to be tested on a list of specific GHC
# versions and returns a job set for all specified
# combinations. See `jobs` below for an example.
versionedCompilerJobs = config: mapTestOn {
haskell.packages =
(lib.mapAttrs (
ghc: jobs:
lib.filterAttrs (
jobName: platforms:
lib.elem ghc (config."${jobName}" or [])
) jobs
) compilerPlatforms);
};
# hydra jobs for `pkgs` of which we import a subset of
top-level/release-haskell.nix: use top-level git-annex attribute This saves us from the annoyances of the gitAndTools attribute set which doesn't have recurseForDerivations and is thus ignored by packagePlatforms.
2021-05-04 15:38:20 +02:00
pkgsPlatforms = packagePlatforms pkgs;
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
pkgs/release-haskell.nix: add aggregate job of all pkgs with maintainers
2021-05-01 23:37:42 +02:00
# names of packages in an attribute set that are maintained
maintainedPkgNames = set: builtins.attrNames
(lib.filterAttrs (
_: v: builtins.length (v.meta.maintainers or []) > 0
) set);
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
recursiveUpdateMany = builtins.foldl' lib.recursiveUpdate {};
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
top-level/release-haskell.nix: test static linking as well This way we can keep track of any new regressions to this as well as have some binary cache, so using this infrastructure doesn't require compiling GHC all the time.
2021-05-22 15:05:10 +02:00
staticHaskellPackagesPlatforms =
top-level/release-haskell.nix: use integer-simple GHC for static CI This should avoid any licensing problems wrt GMP being LGPL.
2021-07-04 21:36:49 +02:00
packagePlatforms pkgs.pkgsStatic.haskell.packages.integer-simple.ghc8104;
top-level/release-haskell.nix: test static linking as well This way we can keep track of any new regressions to this as well as have some binary cache, so using this infrastructure doesn't require compiling GHC all the time.
2021-05-22 15:05:10 +02:00
top-level/release.nix: fix evaluation of jobset We need to merge the set of complete jobs not of platforms to test on since our aggregate jobs will always be “proper” jobs.
2021-05-09 01:49:17 +02:00
jobs = recursiveUpdateMany [
(mapTestOn {
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
haskellPackages = packagePlatforms pkgs.haskellPackages;
haskell.compiler = packagePlatforms pkgs.haskell.compiler;
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
top-level/release-haskell.nix: test writers on all platforms Since the rust writer doesn't seem to get fixed on darwin, we'll just wrap the haskell writer test in our own derivation (which is possible since tests.writers exposes a bunch of internals via passthru) and expose it via tests.haskell which are already in mergeable. Finally a way to test the (hopefully) working haskell writer on darwin again!
2021-07-13 15:19:36 +02:00
tests.haskell = packagePlatforms pkgs.tests.haskell;
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
top-level/release-haskell.nix: add agda packages and test to jobset Since the agda compiler is updated via haskellPackages.Agda, we are quite likely to cause regressions in agdaPackages when the language is changed via compiler updates. Thus we should build agdaPackages (which is very small) as part of the haskell-updates jobset and track if basic agda functionality (compiler and standard library) is working.
2021-07-15 12:35:15 +02:00
nixosTests.agda = (packagePlatforms pkgs.nixosTests).agda;
agdaPackages = packagePlatforms pkgs.agdaPackages;
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
# top-level packages that depend on haskellPackages
inherit (pkgsPlatforms)
agda
arion
bench
bustle
blucontrol
cabal-install
cabal2nix
cachix
carp
cedille
client-ip-echo
darcs
dconf2nix
dhall
dhall-bash
dhall-docs
dhall-lsp-server
dhall-json
dhall-nix
dhall-text
diagrams-builder
elm2nix
fffuu
futhark
ghcid
git-annex
git-brunch
gitit
glirc
hadolint
haskell-ci
haskell-language-server
hasura-graphql-engine
hci
hercules-ci-agent
hinit
hedgewars
hledger
hledger-iadd
hledger-interest
hledger-ui
hledger-web
hlint
hpack
hyper-haskell
hyper-haskell-server-with-packages
icepeak
idris
ihaskell
jl
koka
krank
lambdabot
madlang
matterhorn
mueval
neuron-notes
niv
nix-delegate
nix-deploy
nix-diff
nix-linter
nix-output-monitor
nix-script
nix-tree
nixfmt
nota
top-level/release-haskell.nix: add missing top-level packages Inherit nvfetcher and uusi jobs from top-level for extra visibility.
2021-06-03 11:51:34 +02:00
nvfetcher
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
ormolu
pandoc
pakcs
petrinizer
place-cursor-at
pinboard-notes-backup
pretty-simple
shake
shellcheck
sourceAndTags
spacecookie
spago
splot
stack
stack2nix
stutter
stylish-haskell
taffybar
tamarin-prover
taskell
termonad-with-packages
tldr-hs
tweet-hs
update-nix-fetchgit
top-level/release-haskell.nix: add missing top-level packages Inherit nvfetcher and uusi jobs from top-level for extra visibility.
2021-06-03 11:51:34 +02:00
uusi
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
uqm
uuagc
vaultenv
wstunnel
xmobar
xmonad-with-packages
yi
zsh-git-prompt
;
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
elmPackages.elm = pkgsPlatforms.elmPackages.elm;
release-haskell: stop building aarch64 and darwin static haskell packages The statically-linked Haskell packages on Darwin are not currently working because libiconv is not building statically on Darwin. The statically-linked Haskell packages on aarch64 are timing out on Hydra.
2021-07-18 08:14:30 +02:00
release-haskell: stop building musl integer-simple GHCs integer-simple GHCs appear to be broken when linking against musl and non-static-linking.
2021-07-18 08:17:02 +02:00
# GHCs linked to musl.
pkgsMusl.haskell.compiler = packagePlatforms pkgs.pkgsMusl.haskell.compiler // {
# remove musl ghc865Binary since it is known to be broken and
# causes an evaluation error on darwin.
# TODO: remove ghc865Binary altogether and use ghc8102Binary
ghc865Binary = {};
# remove integer-simple because it appears to be broken with
# musl and non-static-linking.
integer-simple = {};
};
release-haskell: stop building aarch64 and darwin static haskell packages The statically-linked Haskell packages on Darwin are not currently working because libiconv is not building statically on Darwin. The statically-linked Haskell packages on aarch64 are timing out on Hydra.
2021-07-18 08:14:30 +02:00
# Test some statically linked packages to catch regressions
# and get some cache going for static compilation with GHC.
# Use integer-simple to avoid GMP linking problems (LGPL)
pkgsStatic.haskell.packages.integer-simple.ghc8104 =
removePlatforms
[
"aarch64-linux" # times out on Hydra
"x86_64-darwin" # TODO: reenable when static libiconv works on darwin
]
{
inherit (packagePlatforms pkgs.pkgsStatic.haskell.packages.integer-simple.ghc8104)
hello
lens
random
;
};
top-level/release.nix: fix evaluation of jobset We need to merge the set of complete jobs not of platforms to test on since our aggregate jobs will always be “proper” jobs.
2021-05-09 01:49:17 +02:00
})
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
(versionedCompilerJobs {
# Packages which should be checked on more than the
# default GHC version. This list can be used to test
# the state of the package set with newer compilers
# and to confirm that critical packages for the
# package sets (like Cabal, jailbreak-cabal) are
# working as expected.
cabal-install = all;
Cabal_3_4_0_0 = with compilerNames; [ ghc884 ghc8104 ];
haskellPackages.cabal2nix-unstable: 2021-06-10 -> 2021-06-12 Adds support for GHC 9.0.x which we also test by compiling it with all available GHC versions on Hydra.
2021-06-12 00:36:30 +02:00
cabal2nix-unstable = all;
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
funcmp = all;
haskell-language-server: disable hydra tests for ghc-9.0
2021-05-16 07:41:24 +02:00
# Doesn't currently work on ghc-9.0:
# https://github.com/haskell/haskell-language-server/issues/297
haskell-language-server = with compilerNames; [ ghc884 ghc8104 ];
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
hoogle = all;
hsdns = all;
jailbreak-cabal = all;
language-nix = all;
nix-paths = all;
titlecase = all;
})
{
mergeable = pkgs.releaseTools.aggregate {
name = "haskell-updates-mergeable";
meta = {
description = ''
Critical haskell packages that should work at all times,
serves as minimum requirement for an update merge
'';
maintainers = lib.teams.haskell.members;
};
constituents = accumulateDerivations [
# haskell specific tests
release-haskell: disable the x86_64-darwin writers test
2021-07-17 06:30:51 +02:00
#
# TODO: The writers test appears to be failing on darwin for unknown
# reasons. See https://github.com/NixOS/nixpkgs/pull/129606#issuecomment-881307871.
(lib.recursiveUpdate jobs.tests.haskell { writers.x86_64-darwin = null; })
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
# important top-level packages
jobs.cabal-install
jobs.cabal2nix
jobs.cachix
jobs.darcs
jobs.haskell-language-server
jobs.hledger
jobs.hledger-ui
jobs.hpack
jobs.niv
jobs.pandoc
jobs.stack
jobs.stylish-haskell
# important haskell (library) packages
jobs.haskellPackages.cabal-plan
jobs.haskellPackages.distribution-nixpkgs
jobs.haskellPackages.hackage-db
jobs.haskellPackages.policeman
jobs.haskellPackages.xmonad
jobs.haskellPackages.xmonad-contrib
# haskell packages maintained by @peti
# imported from the old hydra jobset
jobs.haskellPackages.hopenssl
jobs.haskellPackages.hsemail
jobs.haskellPackages.hsyslog
];
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
};
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
maintained = pkgs.releaseTools.aggregate {
name = "maintained-haskell-packages";
meta = {
description = "Aggregate jobset of all haskell packages with a maintainer";
maintainers = lib.teams.haskell.members;
};
constituents = accumulateDerivations
(builtins.map
(name: jobs.haskellPackages."${name}")
(maintainedPkgNames pkgs.haskellPackages));
pkgs/release-haskell.nix: add aggregate job of all pkgs with maintainers
2021-05-01 23:37:42 +02:00
};
release-haskell: move location of muslGHCs so that musl always comes before static This is just a small reorganization.
2021-07-18 08:00:58 +02:00
muslGHCs = pkgs.releaseTools.aggregate {
name = "haskell-pkgsMusl-ghcs";
meta = {
description = "GHCs built with musl";
maintainers = with lib.maintainers; [
nh2
];
};
constituents = accumulateDerivations [
jobs.pkgsMusl.haskell.compiler.ghc8102Binary
jobs.pkgsMusl.haskell.compiler.ghc884
jobs.pkgsMusl.haskell.compiler.ghc8104
jobs.pkgsMusl.haskell.compiler.ghc901
];
};
top-level/release-haskell.nix: test static linking as well This way we can keep track of any new regressions to this as well as have some binary cache, so using this infrastructure doesn't require compiling GHC all the time.
2021-05-22 15:05:10 +02:00
staticHaskellPackages = pkgs.releaseTools.aggregate {
name = "static-haskell-packages";
meta = {
description = "Static haskell builds using the pkgsStatic infrastructure";
maintainers = [
lib.maintainers.sternenseemann
lib.maintainers.rnhmjoj
];
};
top-level/release-haskell.nix: no darwin in static aggregate job Since libiconv doesn't build in pkgsStatic on darwin, having these builds in our aggregate jobset are just gonna make it fail due to reason not really in scope for our jobset here.
2021-05-25 12:38:30 +02:00
constituents = [
release-haskell: disable aarch64 builds from staticHaskellPackages These aarch64 builds appear to be timing out.
2021-07-18 08:04:43 +02:00
# aarch64-linux
#
# TODO: Times out on Hydra
# jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.hello.aarch64-linux
# jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.lens.aarch64-linux
# jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.random.aarch64-linux
# x86_64-darwin
#
top-level/release-haskell.nix: no darwin in static aggregate job Since libiconv doesn't build in pkgsStatic on darwin, having these builds in our aggregate jobset are just gonna make it fail due to reason not really in scope for our jobset here.
2021-05-25 12:38:30 +02:00
# TODO: reenable darwin builds if static libiconv works
release-haskell: disable aarch64 builds from staticHaskellPackages These aarch64 builds appear to be timing out.
2021-07-18 08:04:43 +02:00
# jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.hello.x86_64-darwin
# jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.lens.x86_64-darwin
# jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.random.x86_64-darwin
# x86_64-linux
top-level/release-haskell.nix: use integer-simple GHC for static CI This should avoid any licensing problems wrt GMP being LGPL.
2021-07-04 21:36:49 +02:00
jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.hello.x86_64-linux
jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.lens.x86_64-linux
jobs.pkgsStatic.haskell.packages.integer-simple.ghc8104.random.x86_64-linux
top-level/release-haskell.nix: no darwin in static aggregate job Since libiconv doesn't build in pkgsStatic on darwin, having these builds in our aggregate jobset are just gonna make it fail due to reason not really in scope for our jobset here.
2021-05-25 12:38:30 +02:00
];
top-level/release-haskell.nix: test static linking as well This way we can keep track of any new regressions to this as well as have some binary cache, so using this infrastructure doesn't require compiling GHC all the time.
2021-05-22 15:05:10 +02:00
};
top-level/release-haskell.nix: merge jobs using lib.recursiveUpdate We have different attribute sets defining jobs: The list of base jobs, the ones generated by versionedCompilerJobs and our added aggregate jobs. During this we define `haskell` twice: Once for `haskell.compiler` and once for `haskell.packages.*`. The `//` operator throws a way the former which is fixed by using lib.recursiveUpdate. Unfortunately makes the expression less pretty, but at least we have our compiler jobs back.
2021-05-08 18:27:47 +02:00
}
top-level/release.nix: fix evaluation of jobset We need to merge the set of complete jobs not of platforms to test on since our aggregate jobs will always be “proper” jobs.
2021-05-09 01:49:17 +02:00
];
pkgs/top-level: init expression for haskell-updates jobset release-haskell.nix is intended to be a replacement for https://github.com/peti/ci/blob/master/haskell-nixpkgs.nix which is currently the main expression for the haskell-updates jobset on hydra (in the nixpkgs project). It has the same jobs as the old haskell-nixpkgs.nix file: * haskellPackages.* * haskell.compiler.* * Some extra haskell packages for certain compilers The following jobs are new: * tests.haskell.* * A manually maintained list of top-level haskell packages (most of them using justStaticExecutables) * An aggregate job which is intended to aid merging the haskell-updates branch: It holds an arbitrary list of haskell-related packages and tests we intend have working at all times. This is still somewhat incomplete and should be extendend in the future. Additionally a lot of refactoring has been done and some unnecessary code has been eliminated. Due to the increased set of jobs and my ideas of convenience however, the code size has grown overall. I've tried document the individual parts and would be happy about feedback in general. One future improvement could be making adding top-level haskell packages more convenient and adding them all to the aggregate job automatically.
2021-05-01 18:00:40 +02:00
in jobs
Reference in a new issue Copy permalink