Description:
Key Responsibilities: Design, build, and scale robust distributed compute infrastructure optimized for high throughput offline processing. Architect and develop scalable solutions leveraging frameworks like Ray, Spark, Dask, Hadoop, Flink, or Beam. Interface directly with quantitative researchers and data-driven teams to ensure their computational workloads run efficiently. Implement and manage cluster management technologies such as Kubernetes, Docker Swarm, YARN, SLURM, or Nomad. Troubleshoot
Nov 4, 2025;
from:
dice.com