Description:
Role: Lead Data Engineer c2c Duration: Long Term contract Location: San Francisco, CA Required Skills Python and PySpark. Kafka and Kafka streams. MySQL and MySQL Heat. Azure Delta Lake. ETL processes. Kafka integrations using Spring Boot Java. Data streaming with Spark. Additional Skills Experience with Delta Lake on Azure Tableau or similar data visualization tools Unity Catalog in Databricks Airflow for pipeline management Responsibilities Development Tasks: Collect metrics based on user i
Apr 3, 2025;
from:
dice.com