Releases: IBM/lunchpail
Releases · IBM/lunchpail
v0.27.0
What's Changed
- fix:target=ibmcloud components workstealer and workdispatcher default sa not found by @aavarghese in #225
- feat: port tests/bin/helpers.sh from kubectl logs to lunchpail logs by @starpit in #227
- feat: runs command and update helpers.sh to use it by @starpit in #228
- test: remove unused
local queue=
shell variable in tests/bin/helpers.sh by @starpit in #230 - test: eliminate unused waitForStatus in helpers.sh by @starpit in #232
- test: update the second run_name= in helpers.sh by @starpit in #233
- test: eliminate watch from helpers.sh by @starpit in #234
- test: eliminate unnecessary kubectl waits from helper.sh by @starpit in #235
- feat: lunchpail run instances by @starpit in #236
- test: update test7 validator to expect 6 output files by @starpit in #237
- feat: qls and qcat in compiled mode by @starpit in #238
- test: isolate securityContext tests into test7-security-context by @starpit in #239
- feat: update qin to support running in compiled mode by @starpit in #240
- fix: eliminate rclone CLI dependence from tests by @starpit in #241
- feat: do away with hack/init by having be/kubernetes.Ok() prompt to create cluster by @starpit in #242
- fix: update kubernetes ListRuns to look for pods not jobs by @starpit in #243
- fix: remove leftover debug comments by @starpit in #244
- fix: minio server command sleeps twice before exit by @starpit in #245
- feat: lunchpail copyout by @starpit in #246
- feat: move copyout impl from be/kubernetes into fe/transformer by @starpit in #247
- fix: job parallelism for all VSIs together can be more than requested worker bug by @aavarghese in #248
- fix: front-end has kubernetes-specific queue endpoint (service address) by @starpit in #251
- fix: remove leftover debug output by @starpit in #250
- fix: avoid kubernetes-isms in test rclone config by @starpit in #252
- fix: ibmcloud be should delete cloud resources for multiple runs by @aavarghese in #253
- fix: remove leftover debug output by @starpit in #255
- fix: s3 DownloadFile should wait for bucket to exist by @starpit in #254
- fix: avoid /workdir absolute path in qout call by @starpit in #256
- refactor: pull out common parts of qstat streaming by @starpit in #257
- feat: update qstat streamer to support line channels by @starpit in #258
- feat: local backend by @starpit in #223
- feat: --run option and run list --all option by @starpit in #259
- fix: avoid using fixed in-pod (or process) port 9000 for minio by @starpit in #260
- feat: allow --target to be provided at compile time by @starpit in #261
- fix: pass through context to streamer APIs by @starpit in #262
- fix: update backend.Up/Down to pass through context by @starpit in #263
- fix: avoid context.TODO() in pkg/be/kubernetes by @starpit in #265
- fix: ListRuns/Singleton/WaitForRun should require a context by @starpit in #266
- fix: remove unintended context.Background remnant in be/kubernetes by @starpit in #267
- fix: compiler.Compile should accept a context by @starpit in #268
- fix: backend.Queue should accept a context by @starpit in #269
- fix: pkg/runtime/queue funcs should accept a context by @starpit in #270
- fix: backend.InstanceCount() should accept a context by @starpit in #271
- fix: ChangeWorkers should accept a context by @starpit in #272
- fix: backend.Ok() should accept a context by @starpit in #273
- test: add test to validate that pkg/ is free of context.Background/TODO by @starpit in #274
- fix: adding verbose + debug flags by @aavarghese in #276
- fix: auto-disable watch mode if stdout is not a tty by @starpit in #275
- fix: removing verbose as parameter and use compilationOptions by @aavarghese in #277
- fix: unknown --verbose in lunchpail enqueue file by @aavarghese in #279
- chore: bump charmbracelet (status ui) dependencies by @starpit in #280
- Fix code scanning alert #2: Incorrect conversion between integer types by @starpit in #282
- fix: down with kubernetes target does not clean up done runs by @starpit in #283
- fix: removing verbose as parameter and use compilationOptions cont.. by @aavarghese in #278
- fix: support minio component logs by @aavarghese in #285
- fix: clean up
minio server
code by @starpit in #284 - fix: implement
RunComponentUpdates
for local backend by @starpit in #286 - fix: restore target/log options from compile time by @aavarghese in #287
- fix: update streamer.RunComponentUpdates() to put caller in charge of channels and goroutines by @starpit in #288
- fix: remove some remnants of namespace in pkg/observe by @starpit in #290
- fix: workerpool InstanceName should include run name by @starpit in #289
- fix: restore original pool name label by @starpit in #293
- fix: Streamer.QueueStats() api should place caller in control of goroutines and channels by @starpit in #292
- test: reduce verbosity of test output vs logs by @starpit in #291
- fix: Streamer.Utilization() should place caller in charge of goroutines and channels by @starpit in #294
- fix: kube utilization streamer may send on closed channel by @starpit in #295
- fix: add another s3 retry for 'Server not initialized yet' by @starpit in #297
- fix: local run list --all does not show all runs by @starpit in #298
- feat: simplify up to stream logs only (for now) by @starpit in #296
- feat: add component prefix to log line output by @starpit in #299
- fix: parametersweep dispatcher has two printenvs by @starpit in #300
- fix: clean up parametersweep output, e.g. echo -n shows -n by @starpit in #301
- feat: add Utilization impl to local backend by @starpit in #302
- test: add test-python by @starpit in #303
- fix: boot/up without watch results in hanging channel send by @starpit in #304
- fix: local run instances does not check if pids are still running by @starpit in #305
- refactor: rename test-python to python-basic by @starpit in #307
- test: update wait-to-die validators to pass current run name to instance count by @starpit in #306
- refactor: eliminate linker.ConfigureOptions by @starpit in #308
- refactor: eliminate fe.CompileOptions by @starpit in #309
- refactor: clean up linker.Configure API to remove unneeded args and returns by @starpit in #310
- refactor: no need to return compilation options from PrepareForRun by @starpit in #311
- refactor: simply boot/up,down by avoiding needless reuse by @starpit in #312
- fix: remove lingering UpOptions.UseThisRunName by @starpit in #313
- chore: code cleanup and comments for prepare-run by @starpit in #315
- refactor: rename hlir.AppModel -> hlir.HLIR by @starpit in #316
- feat: update runtime/queue/CopyIn to accept an array of files/paths to copy in by @starpit in #317
- feat: update runtime/queue.CopyIn to support copying ...
v0.26.0
What's Changed
- feat: begin update llir to be kubernetes-agnostic by @starpit in #182
- fix: up subcommand positional argument validation by @starpit in #185
- feat: a bit more lunchpail.xxx namespacing of lunchpail-provided template values by @starpit in #186
- refactor: shift helm values for shell component out of fe and into be/kubernetes by @starpit in #188
- fix: metadata ns should not be specified in template, only during apply by @aavarghese in #189
- fix: set ns in llir by @aavarghese in #190
- fix: cloud-init cmd to include ns with apply by @aavarghese in #191
- refactor: move kubernetes common chart into be/kubernetes by @starpit in #195
- refactor: move kubernetes-specific functions into pkg/be/kubernetes out of pkg/fe/transformer by @starpit in #196
- refactor: move pkg/fe/template to pkg/be/helm by @starpit in #197
- fix: avoid creating multiple workstealers by @starpit in #198
- refactor: eliminate use of namespace from transformer by @starpit in #199
- refactor: split out be.New logic into separate file by @starpit in #200
- refactor: move remnants of be/delegation into be.Backend interface by @starpit in #201
- chore: reduce docker image size by @starpit in #202
- fix: trim more from the image builds by @starpit in #203
- feat: log qstat info to a file in the queue folder by @starpit in #109
- refactor: move qstat and utilization streamer kubernetes logic into backend by @starpit in #204
- fix: stabilize tests by @starpit in #206
- refactor: move kubernetes logic from pkg/observe/logs into pkg/be by @starpit in #205
- fix: more shrinking of binary by @starpit in #207
- refactor: remove unused backend variable from pkg/fe by @starpit in #208
- refactor: pkg/be/platform -> pkg/be/options by @starpit in #209
- refactor: rename backend.DeleteNamespace() to backend.Purge() by @starpit in #210
- feat: introduce backend.DryRun by @starpit in #211
- fix: make namespace field private in kubernetes backend by @starpit in #212
- fix: simplify the way we trim out the backend by @starpit in #213
- fix: remove some lingering "appname" variables scattered throughout by @starpit in #214
- fix: shift +/- does not change pool size by @starpit in #215
- fix: remove superfluous Runname from Linked struct by @starpit in #216
- fix: remove superfluous ir.Linked struct altogether by @starpit in #217
- fix: simplify/consolidate opts in the backend by @starpit in #218
- fix: -t/--target parameter has no effect by @starpit in #220
- fix: further simplify options in backend by having llir.Options by @starpit in #219
- fix: no minio component with external s3 by @aavarghese in #221
- feat: port minio.sh to
lunchpail minio server
by @starpit in #224
Full Changelog: v0.25.0...v0.26.0
v0.25.0
What's Changed
- fix: only create and use service account if needed by @starpit in #159
- feat: update minio component to transpile to shell by @starpit in #162
- refactor: update workstealer to transpile to shell (remove charts/workstealer) by @starpit in #163
- fix: add sleep before exit in minio and terminationGracePeriodSeconds when running tests by @starpit in #164
- feat: Port workerpool to transpile to shell by @starpit in #165
- fix: remove unnecessary charts/values.yaml and charts/requirements.lock by @starpit in #166
- refactor: move charts/shell into pkg/ by @starpit in #167
- fix: add field comments to ApplicationInstanceSpec by @starpit in #168
- refactor: more charts/ into pkg/fe/template/chart by @starpit in #169
- refactor: move images/base-images into docs/base-images by @starpit in #170
- chore: remove old commented code in workerpool/lower by @starpit in #171
- fix: remove unnecessarily duplicated RemoveAll of transformer template by @starpit in #172
- chore: remove unused template values in configure.go by @starpit in #173
- fix: up --create-namespace regression by @starpit in #174
- fix: regression base chart.tar.gz may not get updated by @starpit in #175
- refactor: further simplify template values in configure.go by @starpit in #176
- feat: pass through yaml values to transformer by @starpit in #177
- feat: remove Values.enclosingRun by @starpit in #178
- refactor: rename ApplicationInstanceSpec -> ShellSpec by @starpit in #180
- chore: cleanup same tests, and spread to another layer by @aavarghese in #181
- chore: bump to 0.25.0 by @starpit in #179
Full Changelog: v0.24.0...v0.25.0
v0.24.0
What's Changed
- feat: internal s3 in a separate component by @aavarghese in #142
- feat:
lunchpail enqueue file --wait
by @starpit in #143 - fix: remove remnants of internal s3 from workstealer chart by @starpit in #144
- feat: update minio chart to use minio image directly by @starpit in #147
- fix: remove unused Secret from workerpool chart by @starpit in #150
- feat: minio container self-destruct when run finishes by @starpit in #149
- fix: restructure Dockerfile to avoid proliferation of 1.8Gi image build layers by @starpit in #152
- fix: remove unused queue-related volume/volumeMounts from workerpool chart by @starpit in #151
- fix: remove more remnants of old workdir logic from charts by @starpit in #153
- fix: skip empty env with lowering to llir by @starpit in #154
- fix: simplify charts/shell env by removing configmap by @starpit in #155
- fix: simplify charts/workerpool env by removing configmap by @starpit in #156
- fix: remove old 'run as root' bits from charts by @starpit in #158
- fix: more work on optimizing proliferation of docker layers by @starpit in #157
- feat: enqueue --wait returns task exit code by @aavarghese in #148
- chore: bump to 0.24.0 by @aavarghese in #161
Full Changelog: v0.23.0...v0.24.0
v0.23.0
What's Changed
- fix: clean up handling of queue paths by @starpit in #101
- chore: bump workstealer/worker-watcher golang 1.22.1 -> 1.22.6 by @starpit in #102
- chore: bump golang 1.22.1 -> 1.22.6 by @starpit in #103
- chore: update issue templates by @aavarghese in #105
- chore: refactor assemble terminology to compile by @aavarghese in #108
- feat: remove support for Application
repo
field andPlatformRepoSecret
by @starpit in #111 - chore: remove lunchpail-workdir image by @starpit in #112
- chore: remove untested lunchpail-tasksimulator-parquet image by @starpit in #113
- chore: remove unused python-alpine component image by @aavarghese in #114
- feat: use alpine:3 as the default Application image by @starpit in #115
- feat: update workstealer image to use alpine rather than debian slim by @starpit in #117
- feat: pull worker-watcher into main lunchpail binary by @starpit in #116
- feat: port workstealer.sh to go by @starpit in #118
- refactor: move workstealer out of its own image into pkg/runtime/workstealer by @starpit in #119
- doc: remove reference to old 'images/components' by @starpit in #120
- refactor: rename copyin.go -> qin.go by @starpit in #121
- feat: lunchpail enqueue commands by @starpit in #122
- chore: purge remnants of bash-based workerpool watcher by @starpit in #123
- chore: clean out prestop shell script in charts/shell by @starpit in #124
- chore: remove unused tests/base-images by @starpit in #125
- chore: remove unused ibmcloud create_vm by @starpit in #126
- chore: remove unused tests/bin/mc.sh by @starpit in #127
- chore: remove unused tests/bin/s3-copyin by @starpit in #128
- chore: remove now-unused lunchpail-rclone base image by @starpit in #129
- refactor: introduce hlir.NewApplication()` by @starpit in #130
- refactor: move runtime queue logic into pkg/runtime/queue by @starpit in #131
- fix: retry s3 on i/o timeout by @starpit in #132
- chore: remove vestiges of AppWrapper from workstealer chart by @starpit in #133
- chore: remove vestiges of AppWrapper from shell chart by @starpit in #134
- chore: remove vestiges of AppWrapper from workerpool chart by @starpit in #135
- fix: remove last use of LUNCHPAIL_RUN_NAME env var from workers by @starpit in #136
- fix: remove a few env vars by @starpit in #137
- fix: remove a few more env vars by @starpit in #140
- chore: bump to 0.23.0 by @starpit in #141
Full Changelog: v0.22.0...v0.23.0
v0.22.0
What's Changed
- doc: update README badge link to reflect actions.yml -> tests.yml workflow change by @starpit in #51
- doc: update demo docs to reflect --create-namespace changes by @starpit in #52
- doc: add gif to readme by @starpit in #53
- doc: add descriptions for images/gifs by @starpit in #54
- doc: leverage github's support for Notes rendering by @starpit in #55
- doc: tweak readme image sizes by @starpit in #56
- doc: split out user roles from main readme by @starpit in #57
- doc: add usage and example to build readme by @starpit in #58
- docs: restructure into docs/architecture by @starpit in #59
- feat: allow backend to provide values to linker.Configure, and do so to infer ClusterIsOpenShift by @starpit in #60
- chore: bump IBM/go-sdk-core v4 -> v5 by @starpit in #61
- feat: up --target-platform/-p -> --target/-t by @starpit in #62
- feat: down --target-platform/-p -> --target/-t by @starpit in #64
- fix: casing for target deployment types by @aavarghese in #66
- feat: support bearer token auth for ibmcloud target by @starpit in #67
- feat: looping for cluster ready check by @aavarghese in #70
- fix: overriding global type for openshift clusters by @aavarghese in #71
- feat: log creation times for ibmcloud backend by @starpit in #73
- feat: parallelize ibmcloud VSI creation calls by @starpit in #75
- feat: using randomized zone from region discovery by @aavarghese in #74
- feat: add username to runname by @aavarghese in #76
- feat: allow for re-assembly i.e.
assemble
against an assembled binary by @starpit in #78 - refactor: introduce interface-based Backend by @starpit in #79
- fix: clean up default-queue secret by @starpit in #80
- fix: clean up workstealer queue variables by @starpit in #81
- fix: begin consolidation of queue prefix path logic by @starpit in #82
- fix: continue consolidate of queue variables by @starpit in #83
- fix: disallow kubernetes api access from our pods by @starpit in #85
- fix: clean up workerpool and shell queue variables by @starpit in #84
- doc: flesh out docs/contribute/README.md by @starpit in #87
- fix: ipv6 address should not fail security group creation by @aavarghese in #88
- doc: clarify up versus down in demo docs by @starpit in #90
- doc: place conventional commits in TIP block by @starpit in #91
- doc: make top-level README consistent with doc/demos in naming of binaries by @starpit in #92
- fix: be interface missing assemble option for apikey, random zone only if config resouregroup exists by @aavarghese in #93
- feat: remove unnecessary api: field of Application by @starpit in #95
- doc: fix typo in docs/contribute by @starpit in #96
- feat: discover existing sshkey from userdir for ibmcloud be, reuse existing sshkey resource if exists by @aavarghese in #89
- feat: add support for
--set-file
by @starpit in #97 - fix: set apikey for cloud authenticator with down cmd by @aavarghese in #98
- fix: status UI fails to show task cells for workers by @starpit in #99
- chore: bump to 0.22.0 by @starpit in #100
Full Changelog: v0.21.2...v0.22.0
0.21.2
What's Changed
- doc: improve demo download wording and links a bit by @starpit in #34
- chore: add LICENSE file by @starpit in #33
- doc: tweak and tighten intro by @starpit in #35
- chore: remove outdated architecture image by @starpit in #36
- doc: add screenshots to readme by @starpit in #37
- doc: split up README into docs/demos docs/build docs/contribute by @starpit in #38
- doc: add OpenROAD demo to demos README by @starpit in #39
- test: tests should run up --no-watch by @starpit in #42
- feat: be.Ok() API and update up() to use it as a prereq by @starpit in #41
- fix: update internal minio service name to include 'lunchpail' by @starpit in #43
- fix: fully-qualify alpine:3 -> docker.io/alpine:3 by @starpit in #44
- test: remove outdated test6b by @starpit in #45
- test: split out test7* into two workflows for github actions by @starpit in #46
- fix: disable internal s3 for remote cos by @aavarghese in #40
- fix: wait before kubectl apply, platform type, vsi(s) per component, etc by @aavarghese in #7
- feat: allow --create-namespace to be specified at assembly time by @starpit in #47
- chore: bump go module versions by @starpit in #48
- chore: rename github action test workflow actions.yml -> tests.yml by @starpit in #50
- chore: bump to 0.21.2 by @starpit in #49
New Contributors
- @aavarghese made their first contribution in #40
Full Changelog: v0.21.1...v0.21.2
0.21.1
What's Changed
- fix: update two go.mod to point to new repo by @starpit in #11
- test: remove archived tests by @starpit in #12
- fix: update comment to use public github by @starpit in #13
- feat: add --all-platforms/-A option to assemble by @starpit in #14
- feat: allow app to pass through app version by @starpit in #15
- doc: add release badge to readme by @starpit in #16
- doc: update readme to remove outdated info by @starpit in #17
- doc: update readme to point to latest lunchpail-demo release by @starpit in #18
- feat: version command should show both app version and lunchpail version by @starpit in #29
- feat: improve local UX with up --create-cluster and --watch by default by @starpit in #20
- fix: status UI hangs with a blank screen; shows no pool updates by @starpit in #31
- chore: bump to 0.21.1 by @starpit in #32
Full Changelog: v0.21.0...v0.21.1