Data Engineer( Andersen )
29 Октября 2024
Город:
Астана
Занятость:
Полная занятость
Компания "Andersen"
The IT company Andersen invites an experienced Data Engineer to work on a project for our Uzbekistani partner.
The customer is one of the leading commercial banks in Uzbekistan. The bank offers a wide range of financial services, including lending, deposits, international settlements, and electronic banking services. Its network covers more than 200 branches and mini-banks across the country, serving over 1 million customers. The bank actively collaborates with international financial institutions and strives to implement modern banking technologies to improve service quality.
The project involves creating a comprehensive Data Document that outlines approved project goals, logical data sources, and the physical tables/UI forms where relevant data can be found, along with the necessary formulas and algorithms for data transformation. Additionally, an Initial Project Backlog will be developed, detailing milestones and tasks for the development team.
Responsibilities:
- Participating in the implementation of the designed data warehouse.
- Taking part in developing data delivery and transformation processes.
- Implementing and automating data quality and integrity checks.
- Configuring and orchestrating ETL processes.
- Performing monitoring and troubleshooting.
- Collaborating with DevOps on orchestrating, configuring, and setting up CI/CD pipelines.
Must-haves:
- Experience as a Data Engineer for 4+ years.
- Proficiency in Python.
- Experience with Advanced SQL and T-SQL.
- Experience in MS SQL Server.
- Experience with HDFS (Hadoop).
- Knowledge of using data indexing/referencing techniques, leveraging foreign/clustered keys, Row/Columnstore Indexing, Partitioning.
- Experience with dbt (data build tool) for transforming data in the warehouse.
- Understanding the principles and best practices for organizing data marts.
- Experience with Apache Spark and PySpark.
- Experience with Apache Airflow.
- Strong knowledge of PostgreSQL.
- Experience in designing and implementing ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines.
- Ability to schedule data processing jobs and monitor their status to ensure timely and accurate data flow.
- Knowledge of Continuous Integration and Continuous Deployment (CI/CD) practices.
- Proficiency in using Git for version control, including branching, merging, and managing code repositories.
- Understanding data security principles at various levels of granularity (row-level, column-level, table-level, system-level).
- Familiarity with data masking and obfuscation techniques.
- Level of English – from Intermediate and above.
Nice-to-haves:
- Expertise in using SQL Server Integration Services (SSIS).
- Experience with Jupyter.
- Understanding data security principles at various levels of granularity.
- Familiarity with data masking and obfuscation techniques.
Reasons why this job would be interesting to you:
- Andersen cooperates with such businesses as Samsung, Reuter Gruppe, T-Systems, TUI, Ryanair, Johnson & Johnson, etc. This project is just your beginning here – working with us means reliability and prospects.
- We have been strengthening our expertise since 2007. During this time, we have formed an excellent BA & SA team with streamlined processes, which now consists of more than 200 qualified analysts.
- We welcome specialists from every part of the world.
- Salaries at Andersen are pegged to the EUR, and our employees are provided with a benefit package and an extensive set of bonuses.
- We give our employees an opportunity to attend and participate in the company’s BA meetups, as well as offer a compensation program for international professional certificates.
- There are many different ways to grow and develop at our company. You can improve as a tech specialist or a resource manager, and all your activities will be decently rewarded.
- You will have an opportunity to take on the role of a mentor and help a group of BA/SA beginners grow.
- Our employees have access to Andersen Knowledge Base, where they can take courses in a variety of areas: the art of negotiation, PreSale & Discovery, Agile essentials, product ownership, microservice architecture, API design, SQL, AWS, GDPR, UX/UI, people management, and more.
Join us!
Зарегистрируйтесь или войдите, чтобы открыть контакты работодателя
Прикрепите резюме для отклика
Уже с нами?
Войдите, чтобы отправить резюме
27 Октября
SRE/DevOps Engineer (Golang)( Noveo )
Астана
Компания "Noveo" НОВЕО - международная компания, с 2002 года предоставляющая услуги по заказной разработке ПО для западноевропейского рынка....
01 Ноября
Lead Software Engineer C++ (Gameplay)
Астана
Компания "Playrix" Playrix — одна из самых успешных компаний по разработке мобильных игр в мире. По доходам среди всех мобильных приложений мы...
01 Ноября
Senior Software Engineer С++ (Gameplay)
Астана
Компания "Playrix" Playrix — одна из самых успешных компаний по разработке мобильных игр в мире. По доходам среди всех мобильных приложений мы...
01 Ноября
Астана
Компания "YATT YULDASHEV PULAT BAXTIYOROVICH" Компания Quasar79 , лидер в области разработки решений на основе искусственного интеллекта в...
02 Ноября
Астана
Компания "Назарбаев интеллектуальные школы, Автономная организация образования" Обязанности: Анализ текущих IT платформ центра, разработка...
Вакансия размещена в отрасли