Apache Spark Jobs - April 2026

Using LLMs to build neural optimizers, neural scheduling systems, and neural workload tuners. Applying ML to make data warehouses and Spark jobs more efficient. Hiring staff ML engineers to train models that predict compute needs, scaling behavior, and job pl…

We use ML to make data warehouses and spark jobs more efficient. We're hiring staff ML engineers to train models that can understand how much compute a job needs, how it scales to larger machines, whether a machine can run more jobs, and so on; and staff infr…

Wir bei control-f sind echte Daten-Nerds und bauen Big Data Plattformen für Telemetriedaten in der Industrie. Wir suchen jemanden, der Lust hat, mit uns gemeinsam aus Daten-Chaos smarte Lösungen zu machen. Wenn du Spaß daran hast, mit PySpark und Databricks r…

We have an open headcount on my team at Databricks (Compute Lifecycle) for a senior or staff engineer! Typically this means 5+ years of experience. For this role, we're also looking for experience with distributed systems (and ideally experience running Kuber…

Amazon Elastic MapReduce (EMR) is the industry-leading cloud big data platform for petabyte-scale data processing, interactive analytics, and machine learning using open-source frameworks such as Apache Spark, Apache Hive, Presto and HBase. Amazon Athena is a…

Utiligize is looking for a Senior Data Engineer to solve one of the most difficult problems in decarbonization: building out power system infrastructure to support huge increases in electricity demand and production. You will take on development of data pipel…