Blog

Apache Spark

Tech Review: Tracing Data Lineage from Notebooks into Microsoft Purview

Integrating SparkLin with Microsoft Purview allows for capturing and visualizing end-to-end data lineage in Spark environments. This enhances governance, transparency, and audit readiness. The refined SparkLin codebase ensures seamless integration into data governance frameworks.

Read More

Accelerating Spark Notebook Development with MSSparkUtils for Microsoft Fabric

In this technical blog post, we will explore the key features and benefits of MSSparkUtils, and how it can be effectively utilized to accelerate working with Spark on Azure Fabric.

Read More