Databricks launches LakeFlow to help its customers build their data pipelines (opens in new tab)

(techcrunch.com)

9 pointsctc241y ago2 comments

2 comments

No mention of data lineage, governance or logging.

Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.

j / k navigate · click thread line to collapse

Databricks launches LakeFlow to help its customers build their data pipelines (opens in new tab)

(techcrunch.com)

9 pointsctc241y ago2 comments

2 comments

datavirtue1y ago

No mention of data lineage, governance or logging.

memhole1y ago

Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.

j / k navigate · click thread line to collapse