Infopulse Ukraine is inviting talented professionals to join our project as a Cloud Data Engineer. Our customer is one of the Big Four companies providing audit, tax, consulting, and financial advisory services.

This is a data managing project on both Azure & AWS cloud platforms, as well as the vendor platform democratizing access to data and enabling enterprises to build their own path to AI in a human-centric way.

Areas of Responsibility

• Develop Azure Data Factory pipelines and AWS Glue jobs to extract data from various sources to the cloud storage services
• Schedule Jobs/Pipelines, troubleshoot execution failures
• Write custom scripts for data transformations
• Control data consistency and support data consumers with related issues
• Support Databricks and Spark operational activities
• Troubleshoot Databricks notebook issues
• Participate in different PoCs that enhance or optimize platform operations

Qualifications

• Experience with the AWS platform. Good knowledge of: AWS Glue, AWS Sep Functions, AWS Athena, AWS S3, AWS Cloud Watch
• Experience with the Azure platform. Good knowledge of: Azure Databricks, Azure Data Factory, Azure Storages
• Strong knowledge of Python or R
• Knowledge of Pyspark (SparkR)
• Experience with AWS & Spark errors troubleshooting
• SQL, SAP HANA
• Jupyter Notebook
• JSON definition
• Fast learning new technologies and products