Release Changelog

Databand v.0.48

This version was released on 31 August 2021.

New features

Task ID	Description
AS-1200463416979272	Run metrics in the list of metrics are now selected by default and are available from the filters in the Databand UI.
AS-1200794953399592	A new look for the Dataset page.
AS-1200667723456248	Metrics page added - see all the metrics, alerts, and trends for numeric values in one place (coming in a later minor release).

Improvements

AS-1200876485130367: Dropped py27 support for dbnd-examples.
AS-1200854192669862: Dropped support for Tensorflow <2.4 and py27 in dbnd-tensorflow plugin.
AS-1200495012906365: Defined and implemented Network Policy to isolate workloads in namespaces.
AS-1200845451577692: Delete alert definitions in bulk using the “Delete” button.
AS-1200791698233717: Trigger value of Missing Operation alert now reflects the total number of missing operations in the run.
AS-1200667315624593: Tooltip in schema change now opens on click.

Bug fixes

AS-1200587432732541: Text in the UI now aligns to the left after a line break.
AS-1200785050007987: Fixed a bug where the “last modified” field returned an empty value.
AS-1200847984199269: Fixed a “type change” reporting bug in schema change alerts.

Databand v.0.47

This version was released on 19 August 2021.

New features

Task ID	Description
AS-1200526324086051	BigQuery connector - Databand can now sync with your BigQuery tables.
AS-1200667621364917	Databand Dashboard can now be shared and will include filters, metrics, and aggregations.

Improvements

AS-1200700177752978: Airflow Monitor V1 is deprecated.
AS-1200618993918094: Improved visibility of missing operations in Affected Datasets.
AS-1200721895327001: Updated the UI on the Integrations page.
AS-1200624166545000: Full table path in the Affected Datasets tab is now a tooltip.

Bug fixes

AS-1200654355859365: Source and project names are displayed correctly.
AS-1200670021315930: Missing operations are now properly represented in the History Trend chart in the Affected Datasets tab.
AS-1200655482328132: Fixed the dropdown table column in the 'Add new alert' page.

Databand v.0.46

This version was released on 03 August 2021.

New features

Task ID	Description
AS-1200619480835694	Pipeline and run lists optimized for tracking.
AS-1200597628980930	Now you can choose whether to have alerts fire on historical runs by editing alert definitions.
AS-1200347108016370	Range alerts added. Now it’s possible to add an alert if the metric's value is in a predefined range or out of range.
AS-1200700419038963	New schema Alert flow changes in Affected Datasets: schema changes in a data operation are now shown in the Affected Datasets screen. Now you'll know when a column is added, removed, or when its type changes. Some minor cosmetic changes in the UI were also implemented.

Improvements

AS-1200610543227298: Simplified usage of in_cluster in cases where in_cluster is None.

Bug fixes

AS-1200629604891227: Run view performance improvements.

Databand v.0.45

This version was released on 21 July 2021.

New features

Task ID	Description
AS-1200535318342009	Databand Alerting now supports email as a notification channel.
AS-1200401288822416	Per Project and Source Alert routing - you can define Alerts on any job as you like.
AS-1200443526055542	New Run duration metrics: Duration, Total Duration, Compute Time.
AS-1200596368463950	New alert type: get notifications when a schema changes on the data you logged with `log_dataset_op`.

Improvements

AS-1200535433472848: Dashboard widgets now show the project or source name if there are multiple sources. This addresses the case of a pipeline with the same name coming from 2 sources.
AS-1200587432732540: Look at the affected datasets of past Runs by clicking on Runs.
AS-1200557294252243: New tooltip added to the Dataset overview chart - you now can display the Run status and add/view label.
AS-1200602972144983: Dataset overview chart changed from stacked to a regular graph.
AS-1200526324086040: New alert type: when using log_dataset_op, you can get notifications when a pipeline didn’t read or write as expected.
AS-1200430856087576: Alerts can now be set directly from the Alerts page.
AS-1200557294252244: Missing operations are now prominently displayed in the history chart and in the Trend operation bars graph.
AS-1200557294252253: Improved coloring for better readability of dataset graphs.

Bug fixes

AS-1200587833068258: The description in the alert pop-up is no longer missing.
AS-1200587301890745: Datasets page sorting and filtering are fixed - dataset operations are sorted by most recent first.
AS-1200557970734951: Current Run is marked as usual.
AS-1200579848765971: Datasets page filters project correctly.

Databand v.0.44

This version was released on 07 July 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1200404227512965	Choose and view any suitable metric in a new chart in the Favorite Metric widget.
Databand	AS-1200369882031623	View Run's data operations (writes, schema, etc.) in the Run with alerts and see what happened in the last 6 Runs.
Databand	AS-1200526450615526	Helm chart variables now support Global image configs.

Improvements

AS-1200526450615534: Improved performance of Databand Web UI configuration.
AS-1200371843828304: Errors from Airflow are now displayed in the Run list.
AS-1200463339266254: An extensive round of improvements of the metrics reporting and display processes.
AS-1200258862047040: Access to custom metrics is now available. Reporting metrics and discovering what metrics are reported within Databand got much easier.
AS-1199332360687562: [Breaking change!] Deprecated __execute tasks and separation for root-Run and sub-Runs per Airflow task. All the information which was previously reported on <task_name>__execute task (like metrics or log) is now reported on <task_name> task.
AS-1200483852764557: The log_dataset_op behavior is now the same for read and write.
AS-1200445773961847: log_dataset_op can have the log_df functionality.

Databand v.0.43

This version was released on 22 June 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1200445773961849	Introducing `log_dataset_op` - now you can manually log the dataset you are interacting with.
Databand	AS-1200130408884030	Outside-of-the-box tracking support for PySpark with Databricks.
Databand	AS-1199370081934662	Added Live Logs for Kubernetes workers in the Airflow UI.
Databand	AS-1200401140575119	Missing Data now triggers an alert.
Databand	AS-1200454655158822	Now you can calculate metric aggregations like SUM/AVG and others and display them in the Favorite charts widget. You can also compare trends over the filtered time period and display trends.
Databand	AS-1200430623687636	Dataset Screen is deprecated and replaced by Data Targets and Datasets screen in the UI.
Databand	AS-1200466625626565	Added support for custom headers for Alert Manager webhooks.

Improvements

AS-1200403795815183: Improved Favorite Metric widget usability.
AS-1200463339266254: Improved Metric tab interface.
AS-1200452512156534: ‘Triggered by column’ is removed from the Run list.
AS-1200408168252754: History tab is removed from the Run details.
AS-1200430599620006: Timeline Tab in the Run details is deprecated.
AS-1200181993522176: Proper support for DagRun submit args and XCom; values are reported with correct types.
AS-1200275295497774: Added support for the Airflow retries and restarts in Alerts.
AS-1200372371285197: It’s now possible to expose Run env and user in the stats_api for alerting.

Bug Fixes

AS-1200402990123287: Fixed a bug that prevented proper tracking from Databricks.
AS-1200358546721956: Metrics that cannot be presented in a graph now cannot be added.
AS-1200275951379648: Fixed incorrect handling of attempts.
AS-1200440061411916: Fixed tracking tasks from @task.
AS-1200035644894886: Fixed browser ‘Back’ button behavior in the Run details page.
And other bug fixes.

Databand v.0.42

This version was released on 10 June 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1200378732521423	Airflow Monitor v2 now supports Airflow 2.0.
Databand	AS-1200392175180332 AS-1200276920662511	The Favorite Metric widget in the Dashboard now automatically displays anomalies for metrics.
Databand	AS-1200213466288282	Now supporting Google Composer for Airflow tracking.
Databand	AS-1200340430085787	Main menu now expands to include titles.
Databand	AS-1200321463111129	Added a chart display toggle for switching between Run charts in the Favorite Metric widget.
Databand	AS-1200095672805698	Users can select the main page view. The default mode is Dashboard; options: Dashboard or Pipelines.
Databand	AS-1200309661632765	The Syncer page was moved to the Settings page.
Databand	AS-1200284286454068	Now you can identify errors in different Runs - both the error message and the error type now lead to the Run page; the task that triggered the error is selected so you can view the error.

Improvements

AS-1200403425760171: Added new Syncer issue counters in the Settings section.
AS-1200420269065898: Only the table is now scrollable in the Metrics widget.
AS-1200400792119627: Changes in the chart type design.
AS-1200400792119629: Changes in the Dashboard chart tooltips - now, the nearest point tooltip will be displayed.
AS-1200251794221201: Improved the readability of the metric charts tooltip.
AS-1200378661150501: Added Error Column to All Runs and Pipeline Runs lists.
AS-1200369692119674: Improved usability of the Alert Definition section.
AS-1200374990956464: Tasks in Airflow sub-processes are now automatically assigned unique names.
AS-1200102937873725: Added a unified context manager for handling log dataset operations.
AS-1200279378863216: Aligned and improved alert counters in the Pipeline and Run lists.

Bug fixes

AS-1200401407223048: Fixed custom date picker behavior and placed it next to the Pipeline filter.
AS-1200126969897499: Task ID is now correctly displayed in the UI.
And other bug fixes.

Databand v.0.41

This version was released on 26 May 2021.

New features

Functionality	Asana ID	Description
DBND	AS-1200253837838312	Added Deequ + PySpark integration.
Databand	AS-1200245988366766	Added multiple metrics support in the Favorite Metric widget.
Databand	AS-1200095672805698	Home Screen selection option is now available in the Settings Page.
DBND	AS-1200306047670389	It’s now possible to enable debug mode in PyDev from the CLI.
Databand	AS-1200179220565213	Slack notifications can now be received from the Databand UI.

Improvements

AS-1199965369989833: Tracking is now compatible with Airflow 2.0.
AS-1200213466288282: Airflow tracking is running on Google Composer.
AS-1200105822969991: Added support for liveness probe check in Airflow Monitor v2.0.
AS-1200327639593933: Latest Pandas version (1.2.x) is now supported.
AS-1200223284217045: Improved Alert screen.
AS-1200345876827058: Alert rules can be enabled based on the Run env.
AS-1200269646547649: “Last Active” widget moved to the bottom of the screen.
AS-1200269646547644: Pipeline screen's default view is set to “List”.
AS-1200310831229608: PyWheel build tasks are not displayed in the UI now.
AS-1200315872631815: Changed the cursor in Favorite Charts.

Bug fixes

AS-1200305391366264: Fixed missing filters and Run names in the Alert API.
AS-1200324498682162: Identified and fixed the issue with Sentry integration.
AS-1200275951379648: Fixed incorrect handling of attempts.
AS-1200290917819476: Changed Error Widget headline to “Top Errors”.
AS-1200359124635729: Fixed error on wrong outputs’ schema in Orchestration.

Databand v.0.40

This version was released on 12 May 2021.
Databand v.0.40.1 was released on 13 May 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1200183306770565	Stats widget changed to display the top failure rate Pipelines.
Databand	AS-1200191541441378	Server-side sorting for Pipeline stats widget.
Databand	AS-1200258224502988	New Anomaly Detection alert is triggered if Custom Metric grows too fast.
Databand	AS-1200259328525645	Airflow Monitor v.2.
Databand	AS-1200183150156169	It’s now possible to see an alert’s effect on the affected data.

Improvements

AS-1200044288700180: Drill down to Runs & Pipelines from the Dashboard.
AS-1200259770331112: Click iteration and reporting stats added to Dashboard.
AS-1200058439151159: Airflow monitor heartbeat indication.
AS-1200243606518228: Errors Discovery Flow added for non-Python Operators.

Bug fixes

AS-1200276060368190: Negative values are now displayed in Dashboard charts.
AS-1200285224722668: Fixed Docker version incompatibility issue (extended the number of supported versions).
AS-1200275951379659: Fixed Kubernetes execution bug when tasks were wrongly marked as canceled on the end of Pipelines.

Databand v.0.39

This version was released on 28 April 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1168991558489592	Auto-log paths became available for Spark JVM I/O (Alpha version).
Databand	AS-1200183406021457	It’s now possible to trigger a numeric alert when an anomaly is detected.
Databand	AS-1200182230484446	Added alerts integration with Opsgenie.

Improvements

AS-1199534439165430: Tracking system error handling is out - enjoy safe tracking without the performance penalty.
AS-1200183406021460: See how a newly defined alert would have affected your past runs.
AS-1200183406021459: Define sensitivity and the number of runs for anomaly detection.
AS-1200194910187394: Slack alert headline now leads to the Alert page and displays the number of firing alerts.

Bug fixes

AS-1200141500926246: Fixed the URL in Slack message alerts.
AS-1200194910187389: Slack alert’s link is now leading to the first alert.

Databand v.0.38

This version was released on 15 April 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1199905812865631	Added Favorite Metrics widget.
Databand	AS-1199905812865626	Added reference date and fix time range widget.
Databand	AS-1200036364804040	Added support for Date picker in the UI.
Databand	AS-1199908347034091	Added Python Spark Metrics listener (similar to JVM).
Databand	AS-1200135620545740	New alerting mechanism for on-prem users (available on demand).
DBND	AS-1200130408884041	Zero-cost integration of SQL Airflow DAGs with Snowflake (in DBND SDK).

Improvements

AS-1199510429341979: Configured POC alerting.
AS-1199592642123487: Run name/run description is now editable from the UI.
AS-1199917986044490: It’s now possible to access the latest webserver logs via the webserver.
AS-1200092086191209: Added a descriptive error message that appears when installing Airflow Monitor not in the same folder as Airflow.

Databand v.0.37

This version was released on 31 March 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1200016204502957	Search bar is back in the details view.
Databand	AS-1200030168701007	Users who have Airflow with Docker Compose environment can now use the Databand cloud solution.
Databand	AS-1200016767253591	Favorite charts now appear in a separate tab in the Runs page, making it possible to see more metric information in one place at the same time.
DBND	AS-1200058439151184	A flag for switching on\off the transmission (sending) of the source code was added.

Improvements

AS-1199921442266004: AlertDef history now displays seconds in the UI.
AS-1199995565427900: Version and Environment badges are now displayed on the Login page.
AS-1200093251774759: Graphic info card in the Dashboard is now black.
AS-1200127804370172: Quick updates tab added to the integration page.
AS-1199657019529688: QueryApi.force_pagination is now enabled by default.
AS-1200126969897487: Remote logs are truncated.
AS-1200058448826966: Support for "zero computational cost" data insights and preview added.

Bug fixes

AS-1200129802903561: Databand logo back on the Login page.
AS-1200111167427102: Time format bug is fixed.
AS-1199965226804188: The search bar is back in Details view.
AS-1200091724058557: Runs and Task by Start Time are a stacked graph.

Databand v.0.36

This version was released on 18 March 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1199594880117673 AS-1200010989003368 AS-1199979138757912	Introducing the Cloud Environment of Databand Web server.
Databand	AS-1199643165776154	New Design and filters for Run List including sticky filters.
Databand	AS-1199914881669553	Project filters now support Airflow tags.
Databand	AS-1199914881669552	Azkaban projects are now supported.
Databand	AS-1199371447621207	You can now track Log paths from Spark.
Databand	AS-1199674986608158	Extended tracking of Operational Health in the Dashboard: see Runs and Task Runs over time.

Improvements

AS-1199965687445132: Added columns for the task table in the Dashboard.
AS-1199917986044517: Added Spark LogPath.

Databand v.0.35

This version was released in early March 2021.

New features

Functionality	Asana ID	Description
Databand	AS-1199534085669848	Added orchestration error reporting.
Databand	AS-1199382295296733	Project filters added in the Databand UI (phase 1).
Databand	AS-1199562651279654	Multiple Azkaban instances are now supported.

Improvements

AS-1199562651279659: Azkaban Client SDK-related improvement - support of multiple Azkaban instances.
AS-1199873906435234: Airflow System Grafana Dashboard bugs fixed.
AS-1199965687445132: Task and task attempt info is now displayed in the dashboard.
AS-1199894674400827: Fixed the alert list checkbox color.
AS-1199700822487533: Changed the default sync name from http:// to an empty string.
AS-1199593767695403: Removed the wrong config values from databand-core (Airflow).
AS-1199685842345221: Added ability to merge configuration from task class level and a selected section.
AS-1199198703043527: Grafana dashboard can now present system metrics for Airflow monitoring.