Resultados de la búsqueda

Designs, develops and implements data and analytics cloud-based analytics platforms (DAP) and pipelines which acquire, cleanse, transform and publish data. Assemble large, complex data sets which meets functional and non-functional business requirements. Partners with data asset managers and architects to ensure technical solution provides data which is fit for use and in line with architecture blueprints. Leverages coding standards and best practices to ensure efficient and re-usable services and components.

Key Responsibilities:

Data Pipeline Development:

• Design, build, and maintain ETL/ELT processes to ingest, process, and integrate data from various sources into Azure data services.

• Utilize Azure Data Factory, Azure Databricks, and Azure Synapse Analytics to orchestrate data workflows.

Big Data Management:

• Implement big data solutions using Azure Data Lake Storage, Azure HDInsight, and other big data technologies.

• Optimize data storage and retrieval techniques to ensure high performance and scalability.

Data Modeling:

• Develop and maintain data models, schemas, and metadata to support analytical and reporting needs.

• Collaborate with data architects and analysts to understand data requirements and implement solutions accordingly.

Data Quality and Governance:

• Establish data quality metrics and monitoring frameworks to ensure data accuracy and integrity.

• Implement data governance practices to manage data access, security, and compliance.

Collaboration and Communication:

• Work closely with cross-functional teams including data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.

• Document data engineering processes, architecture designs, and best practices.

Performance Tuning:

• Monitor and optimize data processing workflows for performance and cost-efficiency.

• Troubleshoot and resolve data-related issues in a timely manner.

Technology Evaluation:

• Stay updated on emerging technologies and trends in data engineering, big data, and cloud computing.

• Evaluate and recommend new tools and technologies that align with business needs.

Front End Development:

• Exposure to Front end BI Development

• Experience with tools like Power BI, Java Script for BI/Web app Development