Blog Post

Delta Lake over Spark Connect

,

All Spark Connect Posts

I have just finished an update for the spark connect dotnet lib that contains the DeltaTable implementation so that we can now use .NET to maintain delta tables, over and above what we get out of the box by using DataFrame.Write.Format("delta"), this is an example of how to use the delta api from .NET:

var deltaTable = DeltaTable.ForPath(spark, deltaPath); deltaTable.History().Show(10, 1000); deltaTable.Update("id < 10", (Col("id"), Lit(0))); deltaTable.

Original post (opens in new tab)

Rate

You rated this post out of 5. Change rating

Share

Share

Rate

You rated this post out of 5. Change rating