Changelog

Not Yet Released

Code Changes (opens new window).

v0.10.0, 13 Jul, 2021

Code Changes (opens new window).

• New Task Type: qrcode_generate. #67 (opens new window).
• New Task Type: notion_api_call. #66 (opens new window).
• New Task Type: papermill_execute. #65 (opens new window).
• Enhancement: New variable field required. #64 (opens new window).
• Documentation: Generated Python API References (opens new window) using pdoc3. #63 (opens new window).
• Enhancement: Validate payloads for core tasks using attrs. #62 (opens new window).

v0.9.0, 8 Jul, 2021

Code Changes (opens new window).

• Bugfix: _retry not working for tenacity>=8.0.0. #60 (opens new window).
• New Task Type: telegram_api_call. #61 (opens new window).
• New Task Type: feed_parse. #60 (opens new window).
• New Task Type: pushbullet_push. #59 (opens new window).
• New Task Type: smtp_send. #58 (opens new window).
• Enhancement: Support installing all extras packages via runflow[all]. #59 (opens new window).
• Tutorial: Use Scikit-Learn and Runflow (opens new window).

v0.8.1, 6 Jul, 2021

Code Changes (opens new window).

• Code Quality: Add type hints and mypy check. #56 (opens new window).
• New Task Type: slack_api_call. #55 (opens new window).
• Documentation: https://runflow.org/concepts.html (opens new window). #54 (opens new window).
• Enhancement: Add upstream task reference if the task is a FlowRunTask. #53 (opens new window).
• Enhancement: Support import a flow as a new task type. #52 (opens new window).
• Enhancement: Support _timeout for all task types. #51 (opens new window).
• Bugfix: The direction of flow graph direction is wrong. #50 (opens new window).
• Enhancement: Remove parameter context from Task.run. #49 (opens new window).
• Bugfix: Can't detect implicit task dependency in hcl2 call syntax. #48 (opens new window).

v0.8.0, 2 Jul, 2021

Code Changes (opens new window).

• Enhancement: HCL parser support star args and double-star args using .... #47 (opens new window).
• Enhancement: New argument b64content for task type file_write. #46 (opens new window).
• Enhancement: New option --var-file for command runflow run. #45 (opens new window).
• Enhancement: New command: runflow visualize. #44 (opens new window).

v0.7.0, 2 Jul, 2021

Code Changes (opens new window).

• Enhancement: Support _retry for all tasks. #41 (opens new window), #43 (opens new window).
• Enhancement: Task flow_run can now export variables through export blocks. #36 (opens new window), #42 (opens new window).
• Enhancement: Task private arguments are now starting with an underscore _. #37 (opens new window).
• Enhancement: Task can now keep running if all of its upstream are successful. #38 (opens new window).

v0.6.0, 24 Jun, 2021

Code Changes (opens new window).

• Enhancement: import block now supports setting the task names and function names. Please check the updated documentation (opens new window). #35 (opens new window).
• Performance Enhancement: use lark standalone parser. #34 (opens new window).

v0.5.1, 23 Jun, 2021

Code Changes (opens new window).

• Code Quality: Auto-format code via black. #33 (opens new window).
• Code Quality: Passed pylint & flake8 checks. #28 (opens new window), #32 (opens new window).
• Code Quality: Removed all circular imports. #31 (opens new window).
• Documentation: Added argument reference to all task types. #30 (opens new window).
• Enhancement: Task file_read & file_write can now read file from local, FTP, zip, Git, GitHub. #29 (opens new window).

v0.5.0, 21 Jun, 2021

Code Changes (opens new window).

• New task type: sql_row. #26 (opens new window).
• New task type: sql_exec. #26 (opens new window).
• Deprecate task type: sqlte3_exec. #26 (opens new window).
• Deprecate task type: sqlte3_exec. #26 (opens new window).
• Support Task.run() as synchronous method. #25 (opens new window).

v0.4.4, 21 Jun, 2021

Code Changes (opens new window).

• Built-In function: call(). #24 (opens new window).
• Built-In function: datetime() & todatetime(). #23 (opens new window).
• Docs: integrate with apscheduler (opens new window).
• Docs: built-in functions (opens new window).
• New task type: flow_run. #21 (opens new window).
• Enhancement: Task file_write supports writing to /dev/stdout. #20 (opens new window).
• Python API: runflow() supports loading from path, module, source, or a Flow object. #19 (opens new window).

v0.4.2, 17 Jun, 2021

Code Changes (opens new window).

• Added Runflow Specification. #18 (opens new window).
• Rewrote HCL2 parse & eval engine. #16 (opens new window), #17 (opens new window).
• New task type: hcl2_template (previous know as template).
• New task type: bash_run (previous known as command). #15 (opens new window).
• New block type: import. #14 (opens new window), #17 (opens new window).
• Load envvar RUNFLOW_VAR_xxx for variable "xxx". #13 (opens new window).
• New task type: sqlite3_row. #12 (opens new window).
• New task type: sqlite3_exec. #12 (opens new window).
• New task type: http_request. #11 (opens new window).

v0.3.0, 12 Jun, 2021

Code Changes (opens new window).

• Unified vars. #10 (opens new window)
• New task type: template.
• New task type: file_write. #9 (opens new window).
• New task type: file_read. #9 (opens new window).
• New task type: docker_run. #8 (opens new window).
• Load hcl files via magic runflow.autoloader. #7 (opens new window).

v0.2.0, 7 Jun, 2021

Code Changes (opens new window).

• Command Task now supports setting env.
• Task explicit & implicit dependency.
• Detect acyclic task dependency and abort from running.
• Added entry point: runflow.
• Drop Python 3.6 support.
• Added GitHub Actions: unit-testing, auto-packaging.

v0.1.0, 6 Jun, 2021

Yay! Runflow is now open sourced and released with its first version.

Check the docs site: https://runflow.org (opens new window)