Kindredventures is building a Large Physics foundation Model and seeks a data engineer to design and operate the data platform for petabyte-scale storage, real-time and batch queries, and scalable ingestion.
You will own the compute and orchestration platforms (Spark, Ray, Beam), optimize data loading to training, and implement cataloging, lineage, and monitoring across the data lifecycle. Collaboration across research and engineering is essential.
#J-18808-Ljbffr
The following role is for a Staff Data Platform Engineer - Petabyte-Scale Pipelines with Kindredventures.
This is a genuine opening to take on the Staff Data Platform Engineer - Petabyte-Scale Pipelines role at Kindredventures.
As a Staff Data Platform Engineer - Petabyte-Scale Pipelines, you will play an important part at Kindredventures in San Francisco, CA, United States.
We invite applications for the Staff Data Platform Engineer - Petabyte-Scale Pipelines position located in San Francisco, CA, United States.