Data Eghineer

• Maintain update- to- date documentation of data catalog, ETL flows, data dictionary.
• Practice sustainable incident response and blameless postmortems.
• Support data scientists, data analyst to explore data in Data warehouse.
• Creation of technical specifications for integrations related to data management, system integration, reporting, transformation and performance.
• Participate in end to end engineering solutions with regard to data processing and data delivery and integration, including data processing job/pipeline tool suite, batch framework and platform, micro- service framework and platform.
• Work closely with stakeholders to identify improvements in existing processes and new processes that bring meaningful and actionable insight to the underlying data.
• Evaluate and define KPIs to monitor and manage data quality
• Build and maintain integration data flow provided to other departments.
• Design and build of ETL solutions and data integrations
• Tuning and improving the performance of DB/DWH.
• Build and maintain data pipelines using tools such as NIFI, Airflow, etc.
• Design, implement, maintain data models with Ralph Kimball’s Dimensional Modelling methodology. Ensuring technical, security and performance standards are met

• Experienced with data- lake, data warehouse, data mart
• English proficiency is required
• Have experience writing complex SQL queries and using BI tools & libraries, such as Airbyte, Airflow, dbt, Supserset, Kafka, Prefect etc.
• Completion of a degree or diploma in Computer Science, Information Technology, Engineering or a related discipline.
• Have experience with a programming language (Python / Go / Javascript) for data processing and analysis.
• Having experience with AWS services
• Experience building Test and Monitoring pipeline is a plus
• Experience designing SQL tables, indexing, tuning queries, and optimizations across different functional environments
• Understanding analytical models (preferred)
• Be familiar with modern software development practices. (CI/CD, TDD etc.)
• At least three years of hands- on experience, preferably in big data infrastructure

- A flat hierarchy and a culture of collaboration across all disciplines
- 13th month salary, social insurance
- Opportunity to work on new technologies and tools
- Performance review and adjust salary twice a year
- Modern workplace
- Opportunity to work with multicultural environment and travel.
- Very attractive remuneration package

Cập nhật gần nhất lúc: 2024-03-15 09:20:45