Commit Graph

260 Commits

Author SHA1 Message Date
Andreas Ländle
019156f6a0 Sleep for one hour in nightly build loop to make it easier for humans to calculate when next build will start. 2024-10-31 07:13:47 +01:00
Jens Petersen
9dbaf1e32b build.sh: really fix build tee log output 2024-10-28 13:12:14 +08:00
Jens Petersen
97962d2cc2 build.sh: fix quoting for curator build to fix logging 2024-10-27 14:08:41 +08:00
Jens Petersen
3d5403249f build.sh: fix quoting of combined "..." and '...' shell blocks
Though really wish for a simple way to make a single block here.
2024-10-20 17:35:29 +08:00
Jens Petersen
74fd692a6d build.sh: rename work/lts-XX to work/ltsXX (ie same as TAG) 2024-10-20 17:35:29 +08:00
Jens Petersen
06927a849a build.sh: bind mount ~/.aws/config and use ARGS_PREBUILD in ARGS_UPLOAD 2024-10-15 14:58:18 +08:00
Jens Petersen
75bc96e9a3 run-nightly: exit if an (interactive) command was passed 2024-10-13 16:59:48 +02:00
Jens Petersen
8d9716a4e3 build.sh: refactoring to docker run multiline bash scripts
- combine curator and stack --version docker runs (container is slow to start)
- drop 'exec curator's (not sure why/if they were really needed?)
  (there are still a few more exec's around
- combine prebuild docker invocations
2024-10-13 16:59:48 +02:00
Jens Petersen
85165af5c5 run-nightly.sh now passes command arg to build.sh; fix -n test
[skip ci]
2024-10-11 18:46:11 +02:00
Jens Petersen
85d846a643 [fixup] build.sh: use $2 as command for interactive container
[skip ci]

avoids: "./build.sh: line 107: $2: unbound variable"
2024-10-11 15:55:20 +02:00
Jens Petersen
b53ff1c050 add ulimit (commercialhaskell/curator#43); increase s3.max_concurrent_requests
latter: see commercialhaskell/stackage-infrastructure#4

[skip ci]
2024-10-11 15:45:20 +02:00
Jens Petersen
1701775d9f build.sh: use $2 as command for interactive container debug session
[skip ci]
2024-10-11 15:35:26 +02:00
Jens Petersen
d81696a6b8 build.sh: always pull latest image
[skip ci]
2024-07-11 13:51:37 +08:00
Jens Petersen
ebd3df2f8b build.sh: bump stack to latest 2.15.7 2024-07-11 13:17:01 +08:00
Jens Petersen
76196ee894 instead add dockerfiles/lts-22.29 to bump stack version in next minor
Revert "dockerfiles/lts-22.28: bump stack from 2.13 to 2.15"

This reverts commit d7a78c946ac260466332d54727d72dd164048a8b.

[skip ci]
2024-07-10 18:17:23 +08:00
Jens Petersen
e1715622c5 dockerfiles/lts-22.28: bump stack from 2.13 to 2.15
Should fix/update the snapshots.json url in particular
2024-07-10 11:36:37 +08:00
Jens Petersen
df051e037b add dockerfiles/lts-22.28 2024-07-04 19:42:35 +08:00
Jens Petersen
c8cec93f49 add missing dockerfiles/lts-22.21 2024-07-04 19:42:35 +08:00
Jens Petersen
6e5cc63ca5 build.sh: use newest curator to debug doc upload issue
https://github.com/commercialhaskell/stackage-infrastructure/issues/4
2024-05-21 21:28:51 +08:00
Jens Petersen
ea88407592 also time the haddock uploading 2024-05-13 21:41:32 +08:00
Jens Petersen
773d92b46c wrap the haddock uploading with date output to time it 2024-05-13 21:40:07 +08:00
Jens Petersen
4972df92bb bump our stack version to 2.15.5 2024-05-13 20:24:25 +08:00
Dan Burton
a735020f23
update stack version used for build.sh 2024-03-07 12:07:16 -08:00
Bryan Richter
cf82b84caf
automation: Stop writing haddocks to both buckets
The experiment was a success. Time for a full switch to the new bucket.
2024-02-15 12:09:15 +02:00
Andreas Ländle
e6f8adfb91 build.sh: bump stack to 2.15.1 release 2024-02-10 08:40:07 +01:00
Bryan Richter
1f43e5fd3b
automation: Re-enable required word splitting 2024-02-09 10:21:19 +02:00
Bryan Richter
7f8a96770c
Temporarily push to both buckets (#7310) 2024-02-08 18:26:37 +01:00
Bryan Richter
67da967977
automation: new bucket prep
* Revert "Revert "Merge pull request #7299 from chreekat/b/new-bucket-prep""

This reverts commit 76a9ef5030.

* automation: fix typo
2024-02-07 14:30:36 +01:00
Andreas Ländle
76a9ef5030 Revert "Merge pull request #7299 from chreekat/b/new-bucket-prep"
This reverts commit 21ede1359e, reversing
changes made to 99acb5a43a.
2024-02-05 06:25:09 +01:00
Bryan Richter
8f8fc126b1
Enable overriding bucket name and AWS_ENDPOINT_URL
No change in behavior if they are unset.
2024-01-30 11:29:48 +02:00
Bryan Richter
91685e52e4
Update to curator that supports R2 2024-01-30 11:29:48 +02:00
Bryan Richter
56aab7119e
Make empty NOPLAN safe 2024-01-30 11:29:48 +02:00
Bryan Richter
b7a2b25eb2
Make USERID and HOME on the container overrideable 2024-01-30 11:29:47 +02:00
Jens Petersen
9013e10854 remove NOPLAN: no longer necessary with new lts workflow 2024-01-30 15:25:13 +08:00
Jens Petersen
8122daddd6 run-nightly: bump sleep to 49min to reduce power consumption
[skip ci]
2024-01-19 14:08:21 +08:00
Jens Petersen
85a01ed58c build.sh: for lts warn not to edit work files manually
[skip ci]
2024-01-19 13:52:57 +08:00
Jens Petersen
dc4f9e728b add dockerfiles/lts-22.7 for ghc 9.6.4 2024-01-17 22:56:28 +08:00
Jens Petersen
00440d8b56 build.sh: bump curator to 558215d
b1528dc5ee
2024-01-17 22:40:23 +08:00
Mihai Maruseac
0ffb61bf75
Prepare Dockerfile
Signed-off-by: Mihai Maruseac <mihai.maruseac@gmail.com>
2023-12-15 21:51:57 -08:00
Jens Petersen
648f192274 add dockerfiles/lts-21.22 2023-11-21 13:28:23 +08:00
Jens Petersen
c0d9fa8f53 build.sh: bump stack to stable 2.13.1 release for nightly and lts 2023-11-21 13:21:03 +08:00
Jens Petersen
0ae350f8b4 build.sh: bump jobs to 16 for the new build server 2023-11-21 13:13:00 +08:00
Jens Petersen
7a4287c10e curator 558215d to suppress ghc warnings 2023-09-30 14:25:27 +08:00
Jens Petersen
8a01337705 switch nightly to use stack-2.13.1 release 2023-09-30 14:09:41 +08:00
Jens Petersen
5547c5bc45 build.sh: use latest curator 2023-09-18 17:27:01 +08:00
Jens Petersen
773b683577 switch nightly formally to stack-2.13.0.1 RC
instead of current temporary git merge snapshot
2023-09-17 22:43:34 +08:00
Jens Petersen
983b19e02c add dockerfiles/lts-21.12 for 9.4.7 2023-09-14 10:48:47 +08:00
Jens Petersen
5678c7fc85 add dockerfiles/lts-21.7 2023-08-19 20:02:10 +08:00
Andreas Ländle
485ee146af Corrected shell script location (closes #6959) - addendum. 2023-08-03 14:31:19 +02:00
Andreas Ländle
9343d4973a Corrected shell script location (closes #6959). 2023-08-03 13:30:31 +02:00
Stackage Curators
19e95e2b9f Include lts-21 Dockerfile #7021 2023-06-24 03:56:41 +00:00
Jens Petersen
3ed27a7ca7 build.sh: use stack-2.11.1 2023-06-08 23:10:52 +02:00
Jens Petersen
f72a12f7d0 build.sh: use stack-2.9.3 2022-12-30 22:17:26 +08:00
Stackage Curators
552dcfae9d Include lts-20 Dockerfile #6785 2022-11-30 14:26:02 +00:00
Jens Petersen
64e8d451b0 run-nightly.sh: do a git pull first
This ensures we have the latest repo files locally before starting
2022-10-25 19:11:49 +08:00
Jens Petersen
a37fba8d55 build.sh: update to newest curator (quieten docs s3 upload) 2022-10-25 17:40:29 +08:00
Jens Petersen
76403e4be4 build.sh: update to latest curator 2022-10-25 17:20:46 +08:00
Michael Snoyman
5dab6d26d2
Bump Stack version 2022-09-24 19:54:19 +03:00
Jens Petersen
fb338c496e build.sh: formally change to JOBS=3
This change was originally done locally in the build-server by Adam Bergmark
and seems to be work okay for some time now
2022-08-30 11:27:04 +08:00
Jens Petersen
e3eb59e4cc build.sh: use stack-2.7.5 2022-08-29 18:44:03 +08:00
Adam Bergmark
6b0dd33f06 Update curator 2022-06-05 22:45:47 +02:00
Jens Petersen
62ae47ba61 build.sh: keep a copy of the previous build.log for reference
This should be quite useful specially when looping with run-nightly.sh
since otherwise the old log file is immediately lost.

We might consider later if we want to keep more logs around,
though with nightly they would build up quite fast

[skip ci]
2022-03-19 12:13:24 +08:00
Jens Petersen
10b2fcffe6 build.sh: commit JOBS=1 for nightly
This has already been the case in production for quite a while,
so just formalizing this for nightly (already used for longer on lts)

There are too frequent load collisions between heavy packages otherwise:
unfortunately the non-parallel-builds section has no effect with curator2
2022-03-19 11:46:08 +08:00
Jens Petersen
471634cf09 add dockerfiles/lts-19.0 after the fact
[skip ci]
2022-03-18 21:17:59 +08:00
Emanuel Borsboom
2232b7bd9c Add lts-18.27/Dockerfile for stack-2.7.5 2022-03-06 13:39:22 -08:00
Stackage Curators
6c0dee274e Add missing lts 18.9 Dockerfile #6320 2022-02-15 11:44:11 +00:00
Jens Petersen
71d7ec6ee5 build.sh: use stack-2.7.3
but then do we need stack already in the build image?
2021-10-07 00:35:48 +08:00
Stackage Curators
7ee12a9d91 Fix Dockerfile minor version 2021-08-20 09:46:16 +00:00
Michael Snoyman
5dd77186e6
Fix NOPLAN=2 case 2021-08-20 12:37:58 +03:00
Stackage Curators
576eda726f Switch to ghcr.io registry 2021-08-19 08:41:11 +00:00
Stackage Curators
5057346ca6 Support NOPLAN=2 2021-08-19 08:37:49 +00:00
Stackage Curators
ba347bb39a Add Dockerfiles 2021-08-19 08:37:17 +00:00
Jens Petersen
53190f7156 build.sh: use stack-2.7.1
stack-2.5 warns about not supporting Cabal-3.2 or ghc > 8.10
2021-06-17 14:06:13 +08:00
Emanuel Borsboom
5af2268aca Add automated/dockerfiles/lts-17.10/Dockerfile 2021-05-07 14:37:06 -07:00
Jens Petersen
549f5bf09c
Merge pull request #5893 from commercialhaskell/revert-5815-jkachmar/preserve-noplan-snapshot-overrides
Revert "Preserves snapshot-incomplete with NOPLAN=1"
2021-04-20 01:22:16 +08:00
Jens Petersen
cf5a7625b3 build.sh: update to latest curator build
with commercialhaskell/curator#24
2021-04-19 23:16:44 +08:00
Jens Petersen
6cf1307ce3 build.sh: hackage distro upload should work soon again
https://github.com/commercialhaskell/curator/issues/8
2021-04-19 19:48:26 +08:00
Michael Snoyman
48bfa85f7b
Add dockerfiles for lts 17.0 and 17.3 2021-03-31 22:47:56 +03:00
Jens Petersen
b932a4f408 build.sh: update to latest curator
already being used in production
2021-03-26 13:01:07 +08:00
Joe Kachmar
79a26debdf
Revert "Preserves snapshot-incomplete with NOPLAN=1" 2021-03-04 02:19:36 +00:00
Joe Kachmar
e160b7aa3e Preserves snapshot-incomplete with NOPLAN=1
Previously, 'NOPLAN=1' would overwrite the 'snapshot-incomplete.yaml'
file. This makes it difficult tweak things (e.g. by explicitly bumping a
package in response to maintainer request).

Now 'NOPLAN=1' will skip generating 'snapshot-incomplete.yaml' entirely,
and it will be up to a previous run w/out a 'NOPLAN' override to set
this up properly.
2021-01-06 00:15:35 -05:00
Jens Petersen
c801372762 Revert back to stack-2.5.1 from stack-2.3.3: seems same rebuilding
This reverts commit f40638cf5c.
2020-12-31 16:52:39 +08:00
Jens Petersen
f40638cf5c revert to stack-2.3.3 for building
to see if it reduces build churn
2020-12-30 13:22:29 +08:00
Jens Petersen
b5c18cd1a7 build.sh: update stack to 2.5.1 2020-12-25 14:26:26 +08:00
Michael Snoyman
b6320f213e Bump GHC version for LTS 16.12
Fixes #5642
2020-09-15 08:49:49 +00:00
Michael Snoyman
448f4e45a5
Use official Stack 2.3.3 2020-08-31 13:13:57 +03:00
Emanuel Borsboom
9c5642ed97 Add automated/dockerfiles/lts-16.8/Dockerfile 2020-08-06 04:51:26 -07:00
Emanuel Borsboom
f130e511ab Dockerfile for fpco/stack-build:lts-16.x 2020-06-18 19:05:16 -07:00
Jens Petersen
3fe1e38cec build.sh: remove legacy-bulk conversion and commits
this allowed saving some server diskspace:
ie removing dot-stackage/curator/stackage-{lts,nightly}
2020-05-16 12:55:18 +08:00
Michael Snoyman
a6d666a0bf Download jq 2020-05-03 04:42:01 +00:00
Michael Snoyman
4aec71898c
Install jq 2020-05-03 07:36:57 +03:00
Emanuel Borsboom
9734fa9eca Add automated/dockerfiles/lts-15.10/Dockerfile
For stack-2.3.1
2020-04-29 13:52:49 -07:00
Michael Snoyman
a5361ec29c
Newer Stack executable with more debugging 2020-04-21 07:15:53 +03:00
Michael Snoyman
4bb6147268
Newer curator exe 2020-04-16 13:32:19 +03:00
Michael Snoyman
1afd08ff0a
Newer curator 2020-04-16 12:20:39 +03:00
Emanuel Borsboom
286bdeea57
Merge pull request #5265 from jeffhappily/update-docker-build
Update docker build
2020-04-12 11:45:26 -07:00
Michael Snoyman
551069dfdb
Follow redirects 2020-04-04 21:55:47 +03:00
Jeff Happily
c45ea76fe5
Modify logic to allow building old version 2020-03-27 17:21:06 +08:00
Jeff Happily
19cdd05b84
Add dockerfile for lts-15.5 2020-03-26 23:25:05 +08:00
Jeff Happily
92f939c609
Add dockerfile for lts 15 2020-02-17 16:06:48 +08:00