Can We Fix It? Yes We Can!

Changelog

0.10.2

Released on Apr 14, 2020.

Features

• None

Enhancements

• Task logical operators (e.g. And, Or, ...) no longer implicitly cast to bool - #2303
• Allow for dynamically changing secret names at runtime - #2302
• Update ifelse and switch to return tasks representing the output of the run branch - #2310

Task Library

• Rename the base secret tasks for clarity - #2302

Fixes

• Fix possible subprocess deadlocks when sending stdout to subprocess.PIPE - #2293, #2295
• Fix issue with Flow registration to non-standard Cloud backends - #2292
• Fix issue with registering Flows with Server that have required scheduled Parameters - #2296
• Fix interpolation of config for dev services CLI for Apollo - #2299
• Fix pytest Cloud and Core server backend fixtures - #2319
• Fix AzureResultHandler choosing an empty Secret over provided connection string - #2316
• Fix containers created by Docker agent on Linux not being able to reach out to host API - #2324

Deprecations

• None

Breaking Changes

• Remove env_var initialization from EnvVarSecret in favor of name - #2302

Contributors

• Brad McElroy

Port of Call

Changelog

0.10.1

Released on Apr 7, 2020.

Features

• CI build for prefect server images - #2229, #2275
• Allow kwargs to boto3 in S3ResultHandler - #2240

Enhancements

• Add flags to prefect server start for disabling service port mapping - #2228
• Add options to prefect server start for mapping to host ports - #2228
• Return flow_run_id from CLI run methods for programmatic use - #2242
• Add JSON output option to describe CLI commands - #1813
• Add ConstantResult for eventually replacing ConstantResultHandler - #2145
• Add new diagnostics mode for timing requests made to Cloud - #2283

Task Library

• Make project_name optional for FlowRunTask to allow for use with Prefect Core's server - #2266
• Adds prefect.tasks.docker.container.RemoveContainer

Fixes

• Fix S3ResultHandler safe retrieval of _client attribute - #2232
• Change default log timestamp value in database to be identical to other tables instead of a hard coded value - #2230

Deprecations

• None

Breaking Changes

• None

Contributors

• Manuel Aristarán
• szelenka
• Aditya Bhumbla
• Alex Cano

Open Source Database Backend, GraphQL API and UI

Changelog

0.10.0

Released on Mar 29, 2020.

Features

• Open source database backend, GraphQL API and UI - #2218
• Add prefect server start CLI command for spinning up database and UI - #2214

Enhancements

• Add ValidationFailed state and signal in anticipation of validating task outputs - #2143
• Add max polling option to all agents - #2037
• Add GCSResult type #2141
• Add Result.validate method that runs validator functions initialized on Result #2144
• Convert all GraphQL calls to have consistent casing - #2185 #2198
• Add prefect backend CLI command for switching between Prefect Core server and Prefect Cloud - #2203
• Add prefect run server CLI command for starting flow runs without use of project name - #2203
• Make project_name optional during flow registration to support Prefect Core's server - #2203
• Send flow run and task run heartbeat at beginning of run time - #2203

Task Library

• None

Fixes

• Fix issue with heartbeat failing if any Cloud config var is not present - #2190
• Fix issue where run cloud CLI command would pull final state before last batch of logs - #2192
• Fix issue where the S3ResultHandler would attempt to access uninitialized attribute - #2204

Deprecations

• None

Breaking Changes

• Drop support for Python 3.5 - #2191
• Remove Client.write_run_log - #2184
• Remove Client.deploy and flow.deploy - #2183

Contributors

• None

WFH Release

Changelog

0.9.8

Released on Mar 18, 2020.

Features

• None

Enhancements

• Update Cloud config name for heartbeat settings - #2081
• Add examples to Interactive API Docs - #2122
• Allow users to skip Docker healthchecks - #2150
• Add exists, read, and write interfaces to Result #2139
• Add Cloud UI links to Slack Notifications - #2112

Task Library

• None

Fixes

• Fix S3ResultHandler use of a new boto3 session per thread - #2108
• Fix issue with stateful function reference deserialization logic mutating state - #2159
• Fix issue with DateClock serializer - #2166
• Fix issue with scheduling required parameters - #2166

Deprecations

• Deprecate cache_* and result_handler options on Task and Flow objects #2140

Breaking Changes

• None

Contributors

• alexisprince1994

Update Task Attribute Retrieval

Changelog

0.9.7

Released on Mar 4, 2020.

Fixes

• Change task.log_stdout retrieval from task runner to getattr in order to preserve running flows of older 0.9.x versions - #2120

Now Supporting Python 3.8!

Changelog

0.9.6

Released on Mar 4, 2020.

Features

• Add new diagnostics utility to assist in troubleshooting issues - #2062
• Add a jira_notification state handler to create jira tickets for failed tasks or flows - #1861
• Add support for Python 3.8 - #2080

Enhancements

• Add PIN 15 (skip refactor) - #2070
• Update docs and docstrings related to Result Handlers - #1792
• Add volume option to Docker Agent - #2013
• DaskKubernetesEnvironment now elevates important autoscaling logs as well as possible Kubernetes issues - #2089
• Add optional scheduler_logs kwarg to theDaskKubernetesEnvironment - #2089
• Add ERROR log if heartbeat process dies - #2097
• Enable stdout logging from inside a task with the kwarg log_stdout=True - #2092
• Direct links to Cloud flows and flow runs now shown on creation time - #2109
• Update docs related to using Context - #2077

Task Library

• Fix expanding of V1DeleteOptions kwargs for Kubernetes tasks - #2083

Fixes

• Fix extra_loggers config variable not being able to be set via environment variable - #2089
• Fix environments not passing down their extra_loggers to any created infrastructure - #2089
• Don't mutate data when serializing or deserializing - #2098

Deprecations

• None

Breaking Changes

• None

Contributors

• Romain Thalineau

Fastest Import in the West

Changelog

0.9.5

Released on Feb 21, 2020.

Features

• None

Enhancements

• Better exception for unsubscriptable mapping arguments - #1821
• Add DaskGateway tip to docs - #1959
• Upload package to PyPI on tag push to master - #2030
• Improve package import time - #2046

Task Library

• Fix V1DeleteOptions call for Kubernetes tasks - #2050
• Add kwargs to V1DeleteOptions for Kubernetes tasks - #2051

Fixes

• Ensure microseconds are respected on start_date provided to CronClock - #2031
• Fix duplicate Client connections when using --logs flag from run cloud CLI command - #2056

Deprecations

• None

Breaking Changes

• None

Contributors

• Romain Thalineau

Never Skip the Tutorial

Changelog

0.9.4

Released on Feb 14, 2020.

Features

• None

Enhancements

• Add incremental tutorial - #1953
• Improve error handling for unsupported callables - #1993
• Accept additional boto3 client parameters in S3 storage - #2000
• Add optional version_group_id kwarg to create_flow_run for a stable API for flow runs - #1987
• Add extra_loggers logging configuration for non-Prefect logs in stdout and cloud - #2010

Task Library

• None

Fixes

• Ensure ifelse casts its condition to bool prior to evaluation - #1991
• Do not perform ast.literal_eval on cpu and memory task_definition kwargs for Fargate Agent - #2010
• Fix new agent processing with Threadpool causing problem for Fargate Agent with task revisions enabled - #2022

Deprecations

• None

Breaking Changes

• Remove Airflow Tasks - #1992

Contributors

• Giorgio Pellero
• Braun Reyes

Schrodinger's Zombies

Changelog

0.9.3

Released on Feb 05, 2020.

Features

• None

Enhancements

• Improve heartbeat functionality to be robust across platforms - #1973
• Run storage healthchecks on other options besides Docker - 1963
• Cloud logger now attempts to elevate logger errors to flow run logs - #1961
• Attach Flow and Task attributes to LogRecords - #1938

Task Library

• None

Fixes

• Fix uncaught Fargate Agent kwarg parse SyntaxError from literal_eval - #1968
• Fix FargateTaskEnvironment passing empty auth token to run task - #1976
• Fix imagePullSecrets not being automatically passed to jobs created by Kubernetes Agent - #1982

Deprecations

• None

Breaking Changes

• Remove cancellation hooks - #1973

Contributors

• None

Parameterized Schedules

Changelog

0.9.2

Released on Jan 30, 2020.

Features

• Allow for parameter defaults to vary based on clock - #1946

Enhancements

• More graceful handling of Agents competing for work - #1956

Task Library

• None

Fixes

• Eliminated possible duplicate flow run issue in all agents - #1956

Deprecations

• None

Breaking Changes

• None

Contributors

• None