Description: Key ResponsibilitiesDesign and implement end-to-end data architecture on Databricks (Spark, Delta Lake, MLflow). Develop and optimize large-scale ETL/ELT pipelines using PySpark/SQL. Architect data lakes and lakehouses integrating cloud ...
6 days ago