Release Changelog

This is a log of all historical changes in the Databand product (including with new features, improvements, and fixes).

Databand v.0.48

This version was released on 31 August 2021.

New features

Task ID

Description

AS-1200463416979272

Run metrics in the list of metrics are now selected by default and are available from the filters in the Databand UI.

AS-1200794953399592

A new look for the Dataset page.

AS-1200667723456248

Metrics page added - see all the metrics, alerts, and trends for numeric values in one place (coming in a later minor release).

Improvements

  • AS-1200876485130367: Dropped py27 support for dbnd-examples.
  • AS-1200854192669862: Dropped support for Tensorflow <2.4 and py27 in dbnd-tensorflow plugin.
  • AS-1200495012906365: Defined and implemented Network Policy to isolate workloads in namespaces.
  • AS-1200845451577692: Delete alert definitions in bulk using the “Delete” button.
  • AS-1200791698233717: Trigger value of Missing Operation alert now reflects the total number of missing operations in the run.
  • AS-1200667315624593: Tooltip in schema change now opens on click.

Bug fixes

  • AS-1200587432732541: Text in the UI now aligns to the left after a line break.
  • AS-1200785050007987: Fixed a bug where the “last modified” field returned an empty value.
  • AS-1200847984199269: Fixed a “type change” reporting bug in schema change alerts.

Databand v.0.47

This version was released on 19 August 2021.

New features

Task ID

Description

AS-1200526324086051

BigQuery connector - Databand can now sync with your BigQuery tables.

AS-1200667621364917

Databand Dashboard can now be shared and will include filters, metrics, and aggregations.

Improvements

  • AS-1200700177752978: Airflow Monitor V1 is deprecated.
  • AS-1200618993918094: Improved visibility of missing operations in Affected Datasets.
  • AS-1200721895327001: Updated the UI on the Integrations page.
  • AS-1200624166545000: Full table path in the Affected Datasets tab is now a tooltip.

Bug fixes

  • AS-1200654355859365: Source and project names are displayed correctly.
  • AS-1200670021315930: Missing operations are now properly represented in the History Trend chart in the Affected Datasets tab.
  • AS-1200655482328132: Fixed the dropdown table column in the 'Add new alert' page.

Databand v.0.46

This version was released on 03 August 2021.

New features

Task ID

Description

AS-1200619480835694

Pipeline and run lists optimized for tracking.

AS-1200597628980930

Now you can choose whether to have alerts fire on historical runs by editing alert definitions.

AS-1200347108016370

Range alerts added. Now it’s possible to add an alert if the metric's value is in a predefined range or out of range.

AS-1200700419038963

New schema Alert flow changes in Affected Datasets: schema changes in a data operation are now shown in the Affected Datasets screen. Now you'll know when a column is added, removed, or when its type changes. Some minor cosmetic changes in the UI were also implemented.

Improvements

  • AS-1200610543227298: Simplified usage of in_cluster in cases where in_cluster is None.

Bug fixes

  • AS-1200629604891227: Run view performance improvements.

Databand v.0.45

This version was released on 21 July 2021.

New features

Task ID

Description

AS-1200535318342009

Databand Alerting now supports email as a notification channel.

AS-1200401288822416

Per Project and Source Alert routing - you can define Alerts on any job as you like.

AS-1200443526055542

New Run duration metrics: Duration, Total Duration, Compute Time.

AS-1200596368463950

New alert type: get notifications when a schema changes on the data you logged with log_dataset_op.

Improvements

  • AS-1200535433472848: Dashboard widgets now show the project or source name if there are multiple sources. This addresses the case of a pipeline with the same name coming from 2 sources.
  • AS-1200587432732540: Look at the affected datasets of past Runs by clicking on Runs.
  • AS-1200557294252243: New tooltip added to the Dataset overview chart - you now can display the Run status and add/view label.
  • AS-1200602972144983: Dataset overview chart changed from stacked to a regular graph.
  • AS-1200526324086040: New alert type: when using log_dataset_op, you can get notifications when a pipeline didn’t read or write as expected.
  • AS-1200430856087576: Alerts can now be set directly from the Alerts page.
  • AS-1200557294252244: Missing operations are now prominently displayed in the history chart and in the Trend operation bars graph.
  • AS-1200557294252253: Improved coloring for better readability of dataset graphs.

Bug fixes

  • AS-1200587833068258: The description in the alert pop-up is no longer missing.
  • AS-1200587301890745: Datasets page sorting and filtering are fixed - dataset operations are sorted by most recent first.
  • AS-1200557970734951: Current Run is marked as usual.
  • AS-1200579848765971: Datasets page filters project correctly.

Databand v.0.44

This version was released on 07 July 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1200404227512965

Choose and view any suitable metric in a new chart in the Favorite Metric widget.

Databand

AS-1200369882031623

View Run's data operations (writes, schema, etc.) in the Run with alerts and see what happened in the last 6 Runs.

Databand

AS-1200526450615526

Helm chart variables now support Global image configs.

Improvements

  • AS-1200526450615534: Improved performance of Databand Web UI configuration.
  • AS-1200371843828304: Errors from Airflow are now displayed in the Run list.
  • AS-1200463339266254: An extensive round of improvements of the metrics reporting and display processes.
  • AS-1200258862047040: Access to custom metrics is now available. Reporting metrics and discovering what metrics are reported within Databand got much easier.
  • AS-1199332360687562: [Breaking change!] Deprecated __execute tasks and separation for root-Run and sub-Runs per Airflow task. All the information which was previously reported on <task_name>__execute task (like metrics or log) is now reported on <task_name> task.
  • AS-1200483852764557: The log_dataset_op behavior is now the same for read and write.
  • AS-1200445773961847: log_dataset_op can have the log_df functionality.

Databand v.0.43

This version was released on 22 June 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1200445773961849

Introducing log_dataset_op - now you can manually log the dataset you are interacting with.

Databand

AS-1200130408884030

Outside-of-the-box tracking support for PySpark with Databricks.

Databand

AS-1199370081934662

Added Live Logs for Kubernetes workers in the Airflow UI.

Databand

AS-1200401140575119

Missing Data now triggers an alert.

Databand

AS-1200454655158822

Now you can calculate metric aggregations like SUM/AVG and others and display them in the Favorite charts widget. You can also compare trends over the filtered time period and display trends.

Databand

AS-1200430623687636

Dataset Screen is deprecated and replaced by Data Targets and Datasets screen in the UI.

Databand

AS-1200466625626565

Added support for custom headers for Alert Manager webhooks.

Improvements

  • AS-1200403795815183: Improved Favorite Metric widget usability.
  • AS-1200463339266254: Improved Metric tab interface.
  • AS-1200452512156534: ‘Triggered by column’ is removed from the Run list.
  • AS-1200408168252754: History tab is removed from the Run details.
  • AS-1200430599620006: Timeline Tab in the Run details is deprecated.
  • AS-1200181993522176: Proper support for DagRun submit args and XCom; values are reported with correct types.
  • AS-1200275295497774: Added support for the Airflow retries and restarts in Alerts.
  • AS-1200372371285197: It’s now possible to expose Run env and user in the stats_api for alerting.

Bug Fixes

  • AS-1200402990123287: Fixed a bug that prevented proper tracking from Databricks.
  • AS-1200358546721956: Metrics that cannot be presented in a graph now cannot be added.
  • AS-1200275951379648: Fixed incorrect handling of attempts.
  • AS-1200440061411916: Fixed tracking tasks from @task.
  • AS-1200035644894886: Fixed browser ‘Back’ button behavior in the Run details page.
    And other bug fixes.

Databand v.0.42

This version was released on 10 June 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1200378732521423

Airflow Monitor v2 now supports Airflow 2.0.

Databand

AS-1200392175180332
AS-1200276920662511

The Favorite Metric widget in the Dashboard now automatically displays anomalies for metrics.

Databand

AS-1200213466288282

Now supporting Google Composer for Airflow tracking.

Databand

AS-1200340430085787

Main menu now expands to include titles.

Databand

AS-1200321463111129

Added a chart display toggle for switching between Run charts in the Favorite Metric widget.

Databand

AS-1200095672805698

Users can select the main page view. The default mode is Dashboard; options: Dashboard or Pipelines.

Databand

AS-1200309661632765

The Syncer page was moved to the Settings page.

Databand

AS-1200284286454068

Now you can identify errors in different Runs - both the error message and the error type now lead to the Run page; the task that triggered the error is selected so you can view the error.

Improvements

  • AS-1200403425760171: Added new Syncer issue counters in the Settings section.
  • AS-1200420269065898: Only the table is now scrollable in the Metrics widget.
  • AS-1200400792119627: Changes in the chart type design.
  • AS-1200400792119629: Changes in the Dashboard chart tooltips - now, the nearest point tooltip will be displayed.
  • AS-1200251794221201: Improved the readability of the metric charts tooltip.
  • AS-1200378661150501: Added Error Column to All Runs and Pipeline Runs lists.
  • AS-1200369692119674: Improved usability of the Alert Definition section.
  • AS-1200374990956464: Tasks in Airflow sub-processes are now automatically assigned unique names.
  • AS-1200102937873725: Added a unified context manager for handling log dataset operations.
  • AS-1200279378863216: Aligned and improved alert counters in the Pipeline and Run lists.

Bug fixes

  • AS-1200401407223048: Fixed custom date picker behavior and placed it next to the Pipeline filter.
  • AS-1200126969897499: Task ID is now correctly displayed in the UI.
    And other bug fixes.

Databand v.0.41

This version was released on 26 May 2021.

New features

Functionality

Asana ID

Description

DBND

AS-1200253837838312

Added Deequ + PySpark integration.

Databand

AS-1200245988366766

Added multiple metrics support in the Favorite Metric widget.

Databand

AS-1200095672805698

Home Screen selection option is now available in the Settings Page.

DBND

AS-1200306047670389

It’s now possible to enable debug mode in PyDev from the CLI.

Databand

AS-1200179220565213

Slack notifications can now be received from the Databand UI.

Improvements

  • AS-1199965369989833: Tracking is now compatible with Airflow 2.0.
  • AS-1200213466288282: Airflow tracking is running on Google Composer.
  • AS-1200105822969991: Added support for liveness probe check in Airflow Monitor v2.0.
  • AS-1200327639593933: Latest Pandas version (1.2.x) is now supported.
  • AS-1200223284217045: Improved Alert screen.
  • AS-1200345876827058: Alert rules can be enabled based on the Run env.
  • AS-1200269646547649: “Last Active” widget moved to the bottom of the screen.
  • AS-1200269646547644: Pipeline screen's default view is set to “List”.
  • AS-1200310831229608: PyWheel build tasks are not displayed in the UI now.
  • AS-1200315872631815: Changed the cursor in Favorite Charts.

Bug fixes

  • AS-1200305391366264: Fixed missing filters and Run names in the Alert API.
  • AS-1200324498682162: Identified and fixed the issue with Sentry integration.
  • AS-1200275951379648: Fixed incorrect handling of attempts.
  • AS-1200290917819476: Changed Error Widget headline to “Top Errors”.
  • AS-1200359124635729: Fixed error on wrong outputs’ schema in Orchestration.

Databand v.0.40

This version was released on 12 May 2021.
Databand v.0.40.1 was released on 13 May 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1200183306770565

Stats widget changed to display the top failure rate Pipelines.

Databand

AS-1200191541441378

Server-side sorting for Pipeline stats widget.

Databand

AS-1200258224502988

New Anomaly Detection alert is triggered if Custom Metric grows too fast.

Databand

AS-1200259328525645

Airflow Monitor v.2.

Databand

AS-1200183150156169

It’s now possible to see an alert’s effect on the affected data.

Improvements

  • AS-1200044288700180: Drill down to Runs & Pipelines from the Dashboard.
  • AS-1200259770331112: Click iteration and reporting stats added to Dashboard.
  • AS-1200058439151159: Airflow monitor heartbeat indication.
  • AS-1200243606518228: Errors Discovery Flow added for non-Python Operators.

Bug fixes

  • AS-1200276060368190: Negative values are now displayed in Dashboard charts.
  • AS-1200285224722668: Fixed Docker version incompatibility issue (extended the number of supported versions).
  • AS-1200275951379659: Fixed Kubernetes execution bug when tasks were wrongly marked as canceled on the end of Pipelines.

Databand v.0.39

This version was released on 28 April 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1168991558489592

Auto-log paths became available for Spark JVM I/O (Alpha version).

Databand

AS-1200183406021457

It’s now possible to trigger a numeric alert when an anomaly is detected.

Databand

AS-1200182230484446

Added alerts integration with Opsgenie.

Improvements

  • AS-1199534439165430: Tracking system error handling is out - enjoy safe tracking without the performance penalty.
  • AS-1200183406021460: See how a newly defined alert would have affected your past runs.
  • AS-1200183406021459: Define sensitivity and the number of runs for anomaly detection.
  • AS-1200194910187394: Slack alert headline now leads to the Alert page and displays the number of firing alerts.

Bug fixes

  • AS-1200141500926246: Fixed the URL in Slack message alerts.
  • AS-1200194910187389: Slack alert’s link is now leading to the first alert.

Databand v.0.38

This version was released on 15 April 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1199905812865631

Added Favorite Metrics widget.

Databand

AS-1199905812865626

Added reference date and fix time range widget.

Databand

AS-1200036364804040

Added support for Date picker in the UI.

Databand

AS-1199908347034091

Added Python Spark Metrics listener (similar to JVM).

Databand

AS-1200135620545740

New alerting mechanism for on-prem users (available on demand).

DBND

AS-1200130408884041

Zero-cost integration of SQL Airflow DAGs with Snowflake (in DBND SDK).

Improvements

  • AS-1199510429341979: Configured POC alerting.
  • AS-1199592642123487: Run name/run description is now editable from the UI.
  • AS-1199917986044490: It’s now possible to access the latest webserver logs via the webserver.
  • AS-1200092086191209: Added a descriptive error message that appears when installing Airflow Monitor not in the same folder as Airflow.

Databand v.0.37

This version was released on 31 March 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1200016204502957

Search bar is back in the details view.

Databand

AS-1200030168701007

Users who have Airflow with Docker Compose environment can now use the Databand cloud solution.

Databand

AS-1200016767253591

Favorite charts now appear in a separate tab in the Runs page, making it possible to see more metric information in one place at the same time.

DBND

AS-1200058439151184

A flag for switching on\off the transmission (sending) of the source code was added.

Improvements

  • AS-1199921442266004: AlertDef history now displays seconds in the UI.
  • AS-1199995565427900: Version and Environment badges are now displayed on the Login page.
  • AS-1200093251774759: Graphic info card in the Dashboard is now black.
  • AS-1200127804370172: Quick updates tab added to the integration page.
  • AS-1199657019529688: QueryApi.force_pagination is now enabled by default.
  • AS-1200126969897487: Remote logs are truncated.
  • AS-1200058448826966: Support for "zero computational cost" data insights and preview added.

Bug fixes

  • AS-1200129802903561: Databand logo back on the Login page.
  • AS-1200111167427102: Time format bug is fixed.
  • AS-1199965226804188: The search bar is back in Details view.
  • AS-1200091724058557: Runs and Task by Start Time are a stacked graph.

Databand v.0.36

This version was released on 18 March 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1199594880117673
AS-1200010989003368
AS-1199979138757912

Introducing the Cloud Environment of Databand Web server.

Databand

AS-1199643165776154

New Design and filters for Run List including sticky filters.

Databand

AS-1199914881669553

Project filters now support Airflow tags.

Databand

AS-1199914881669552

Azkaban projects are now supported.

Databand

AS-1199371447621207

You can now track Log paths from Spark.

Databand

AS-1199674986608158

Extended tracking of Operational Health in the Dashboard: see Runs and Task Runs over time.

Improvements

  • AS-1199965687445132: Added columns for the task table in the Dashboard.
  • AS-1199917986044517: Added Spark LogPath.

Databand v.0.35

This version was released in early March 2021.

New features

Functionality

Asana ID

Description

Databand

AS-1199534085669848

Added orchestration error reporting.

Databand

AS-1199382295296733

Project filters added in the Databand UI (phase 1).

Databand

AS-1199562651279654

Multiple Azkaban instances are now supported.

Improvements

  • AS-1199562651279659: Azkaban Client SDK-related improvement - support of multiple Azkaban instances.
  • AS-1199873906435234: Airflow System Grafana Dashboard bugs fixed.
  • AS-1199965687445132: Task and task attempt info is now displayed in the dashboard.
  • AS-1199894674400827: Fixed the alert list checkbox color.
  • AS-1199700822487533: Changed the default sync name from http:// to an empty string.
  • AS-1199593767695403: Removed the wrong config values from databand-core (Airflow).
  • AS-1199685842345221: Added ability to merge configuration from task class level and a selected section.
  • AS-1199198703043527: Grafana dashboard can now present system metrics for Airflow monitoring.

Did this page help you?