Resultados de la búsqueda

We're seeking an experienced Senior Data Engineer to help our team, focusing on building and optimizing data pipelines for Machine Learning (ML) projects using the Databricks platform.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines for ML projects on Databricks.
• Implement ETL processes using Databricks' Delta Lake and Spark SQL.
• Optimize data workflows for efficient ML model training and deployment.
• Collaborate with data scientists to prepare and transform data for ML models.
• Utilize Databricks' MLflow for ML experiment tracking and model management.
• Implement data quality checks and monitoring solutions.
  Leverage Databricks' Unity Catalog for data discovery and governance.
• Contribute to the development of ML feature stores and automated feature engineering.
• Assist in deploying ML models to production environments.
  Mentor junior data engineers and promote best practices.

Qualifications:

• Bachelor's degree in Computer Science, Data Science, or a related field. 
• 5+ years of experience in data engineering, with at least 2 years focusing on ML projects.
• Proficient in Mandarin (Chinese).
  
• Strong expertise in Databricks platform and its components (Delta Lake, MLflow, Spark SQL).
• Proficiency in Python and SQL; experience with Scala is a plus.
• Familiarity with ML workflows and requirements for data preparation.
• Knowledge of data modeling, data warehousing, and dimensional modeling concepts.
• Experience with version control systems (e.g., GitlaB) and CI/CD pipelines.

Preferred Qualifications:

• Databricks certifications (e.g., Databricks Certified Data Engineer Associate).
• Experience with Databricks' AutoML and Feature Store capabilities.
• Knowledge of real-time data streaming technologies (e.g., Kafka, Spark Streaming).
• Familiarity with containerization technologies (Docker, Kubernetes).
• Experience with graph processing and analytics. 

Why Join Us:

• Full-time position
• Payment in US dollars
• 100% remote anywhere in LATAM
• 12 PTO per year
• Holiday from your country off and paid
• Birthday off and paid
• Career Path
• Recognition Program
• Paid Leaves

If you meet these requirements and are interested in applying for this position, please let us know. We look forward to the possibility of working with you.