What's new?
- Updated Go to v1.23.0
Bug fixes
Bug fixes
- Event jsonl output file deletion is now handled correctly. (#960).
trigger run
command now exits when the execution is paused. (#962).
Bug fixes
- Fix crashing cases when using
--output json
. (#594). - Coerce variables set in interactive console to their declared type. (#595).
- Nested pipelines now correctly pauses parent pipelines. (#955).
- Pipeline with
max_concurrency
setting is now automatically paused and will successfully resume. (#957). form_url
is now sanitized.
What's new?
connection
resource to manage credentials. Documentation.connection
andnotifier
types for variables and params. (#871)enum
validation for variables and params.- Defined exit codes for various CLI operations. Documentation.
Bug fixes
- Passing pipeline references to nested mods for execution. (#908)
- Do not crash if pipeline reference is set to a string. (#911)
Deprecation
credential
andcredential_import
are deprecated to be replaced withconnection
andconnection_import
.
Bug fixes
trigger
introspection output correctly showsparam
attribute. (#900)
What's new?
tags
attribute inpipeline param
andmod variable
resources. (#898).- Updated
Docker
dependency to v27.1.2.
Bug fixes
source
attribute in function step is now evaluated relative to the its mod directory rather than the root mod directory. (#895).
What's new?
trigger list
command includes triggers from root mod's immediate dependencies. (#892).
Bug fixes
- Function step will no longer randomly fail in slower host machines. (#888).
- Mod variable definition now matches Powerpipe's definition. (#889).
Bug fixes
- Complex nested map data types in
pipeline param
no longer fails with amismatched types
error. (#879).
What's new?
Bug fixes
- Complex data type in
pipeline param
no longer fails with amismatched types
error. (#879). - Pipeline
param
default value is not nested in amap
data type. (#880).
Bug fixes
- The
variable
command no longer fails if the.flowpipe
directory in the user's home directory is not created yet. (#872).
What's new?
- Interactive workflows in the terminal via console integration. Blog.
- Simplified progress output for
flowpipe pipeline run
command when running in Client mode and not using the--verbose
arg. --data-dir
parameter to specify the location of the event store database. (#852).--execution-id
parameter to specify custom execution id for pipeline run. (#856).- Update
Go
version to v1.22.4.
Bug fixes
- Return a non-zero exit code if there's a failure. (#855).
loop
block now respect theif
step attribute. (#858).
What's new?
-
Add support for installing mods from a branch or from the local file system. (#849).
To install from a branch:
flowpipe mod install github.com/turbot/flowpipe-mod-aws-thrifty#main
To reference a mod in the local file system:
flowpipe mod install ../mods/local_mod_folder
-
Add
--pull
flag tomod
command to control the mod update strategy. (#849). Possible update strategies are:full
- check branch and tags for both latest and accuracylatest
- update everything to latest, but only branches - not tags - are commit checked (which is the same as latest)development
- update branches and broken constraints to latest, leave satisfied constraints unchangedminimal
- only update broken constraints, do not check branches for new commits
- Variable list and show commands. (#373)
Bug fixes
- Pipeline references declared in subsequent files are correctly identified and processed.
- Preserves pipeline params ordering as specified in the pipeline definition. (#408)
Bug fixes
- Load
locals
in order of dependency. (#399).
Bug fixes
- Pipeline execution no longer stalls when concurrency limit is applied and if clause returns false. (#836).
- Trigger's common attributes (title, description, tags, documentation) allow functions and expresions. (#394).
Bug fixes
- Param can be used in query step's args attribute. (#830).
- File watcher now correctly detect changes in the
loop
block. (#808). - Duplicate step names are now detected and reported as an error. (#820).
- Better error message for invalid notifier reference. (#826).
Bug fixes
- Lazy create
flowpipe.db
. (#808). - Respect
max_concurrency
inpipeline
andinput
steps. (#815). - Misleading error message for invalid step dependencies. (#816).
- HTTP integration address is shown correctly at the beginning of each input step loop. (#818).
Bug fixes
loop
block now works incontainer
,function
,message
andinput
steps.- Use HCL expressions in
max_concurrency
step argument. (#800). throw
,retry
anderror
block now works forinput
step.
Bug fixes
- Input step respects the
max_concurrency
argument. (#798). - Erroneous error message detecting a missing credential where there isn't one.
- HCL
try()
function should be evaluated at runtime rather than parse time. - Integration and input step URLs should use the provided custom host & port. (#792).
- Shows filename and line number for invalid step references.
What's new?
- Microsoft Teams integration. Documentation.
Bug fixes
- Step output attribute should be called
response
notresult
. (#789) - Pipeline execution should not fail when a string argument is passed with double quotes. (#791)
Bug fixes
- Multiselect Inputs with preselected Options now correctly pre-populate in Slack.
- Change detection in
throw
andoutput
block in pipeline steps works correctly with ternary operators and will not trigger mod reload for white space changes.
Bug fixes
- Multi-select option in input step now works. (#776).
- Input step white space changes will not trigger mod reload. (#297).
v0.3.0 [2024-03-05] Human workflow, Slack and email messaging, Import Steampipe credentials, Concurrency controls.
What's new?
- Workflow - message step for easy notifications. Documentation.
- Workflow - input step for buttons, text and other data. Documentation.
- Workflow - simple, reusable integration and notifier configuration for HTTP, Slack and Email. Documentation.
- Import Steampipe connections as Flowpipe credentials. Documentation.
- Manage concurrency of pipelines and steps.
- New credential types:
alicloud
andmastodon
. - Shorter hash for HTTP triggers for simpler URLs.
- DuckDB support in query step & trigger.
- Step metadata, like
started_at
andfinished_at
added under aflowpipe
attribute. - Moved
flowpipe.db
into the mod-level.flowpipe
directory. connection_string
in query step and trigger renamed todatabase
.
Deprecation
- Email step. Please use the new message step instead.
Bug fixes
log_level
workspace setting is now respected (#618).- Default
listen
flag should be network, not localhost (#694). - Trigger attributes are now validated (#225).
- Pipeline output attributes are now validated (#239).
- Pipeline param default value data type is now validated against the specified type (#262).
- Removed titles when merging multiple error messages (#263).
- Runtime resolution of pipeline reference and credentials are now working correctly. (#732).
- Scheduled triggers are now re-scheduled when mod files have changed.
- File watcher reliability improvements.
Bug fixes
- Only trigger pipeline failure after a step has completed all retries (#630).
DOCKER_HOST
,DOCKER_API_VERSION
,DOCKER_CERT_PATH
,DOCKER_TLS_VERIFY
environment variables are now correctly passed to the Docker client (#651).- Do not set memory_swappiness when using Podman (#652).
Bug fixes
- Build error no longer suppressed in container and function steps (#625).
- Handles complex data types in step output (#626).
Bug fixes
- Map MySQL query results to correct types (#604).
- Handle null values in query trigger results (#611).
- Convert binary data in query results to a string.
- Docker containers now clear the cache to get correct parameters (#561).
- Improved error message when Flowpipe CLI port is already in use (#603).
What's new?
- Query trigger type to watch & event on to database changes. Documentation.
- HTTP trigger can now handle both GET and POST methods. Documentation.
- Query steps & triggers now support Postgres, MySQL, SQLite and Postgres.
- Define container step using a
source
argument for inline image definitions. - Add a
timeout
to pipeline steps. - Enable or disable triggers using
enabled
attribute. - Improved and expanded output for
flowpipe server
. - Improved and standardized output for CLI
list
andshow
commands. - Expanded intervals available in schedule and query triggers (e.g.
5m
,10m
, etc). - New credential types: BitBucket, Datadog, Freshdesk, JumpCloud, ServiceNow, Turbot Guardrails.
Bug fixes
- Implemented a more descriptive error message for server startup failures.
- Fixed Step Arguments unable to be referenced in the Pipeline definition.
- Added missing
execution_mode
argument to HTTP Trigger (#533). - Fixed
args
arguments unable to be updated in the Pipeline Step loop block (#559). - Fixed an issue in the bootstrap process for identifying the config path.
Bug fixes
- Removed inaccurate SQL Query string validation to check for arguments. (#516)
Introducing Flowpipe, a cloud scripting engine. Automation and workflow to connect your clouds to the people, systems and data that matter. Pipelines for DevOps written in HCL.
Initial support for:
- Pipeline execution
- Steps: container, email, function, http, pipeline, query, sleep, transform
- Triggers: schedule, http
- Credential management
- Mod composition
Learn more at:
- Website - https://flowpipe.io
- Docs - https://flowpipe.io/docs
- Hub - https://hub.flowpipe.io
- Introduction - https://flowpipe.io/blog/introducing-flowpipe