Apache Spark

Technical Article

Improving Performance In Spark Using Partitions

  • DatabaseWeekly

In this blog post we are going to show how to optimize your Spark job by partitioning the data correctly. To demonstrate this we are going to use the College Score Card public dataset, which has several key data points from colleges all around the United States. We will compute the average student fees by state with this dataset.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

You rated this post out of 5. Change rating

2019-04-12

Blogs

A Pursuit of Lifelong Learning

By

The following came across my YouTube feed today. It’s an interview with General James...

Advice I Like: Time and Focus

By

“You don’t need more time because you already have all the time that you...

Book Review: Microsoft 365 Copilot and Agent Administration Fundamentals

By

I don’t currently manage Microsoft 365 Copilot in an enterprise environment, but it is...

Read the latest Blogs

Forums

Alamat Telp BCA KCP Cipondoh Cs 0823-7497-7784

By m4l4mt194

Wa:082374977784 Jl. KH. Hasyim Ashari Km. 1,5 Blok C-D, RT.002/RW.003, Poris Plawad Indah, Kec....

MiniMax m3 and SQL Server

By Daniel Calbimonte

Comments posted to this topic are about the item MiniMax m3 and SQL Server

Making an Impression

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Making an Impression

Visit the forum

Question of the Day

SQL Server Vector Support I

What are vectors in SQL Server 2025, as related to the new AI features?

See possible answers