MIDDLE/SENIOR BIGDATA SOFTWARE ENGINEER (#14061630) Referral fee — $2 000
24.09.21
Про роботу
Senior BigData Software Engineer
About the client
Our client, is one of Europe's fastest growing mobile companies with over five million active customers, 1,000 employees worldwide and operations in eight countries. The client is using the mobile virtual network operator business model. As one of their core services they provide “Pay As You Go” mobile SIM cards, targeted towards the needs of international communities and migrant workers. To cope with rapidly growing business demands our client is launching its R&D center in Lviv, Ukraine, with us.
Responsibilities:
- Development of Campaign management tool
- Bring in new data sources and transform and load into Data Lake
- Develop (Spark) streaming applications for supporting real time data processing
- Develop and support end-to-end data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, and error handling
- Create jobs and queries to perform auditing and error handling
Requirements:
- 3+ years of software development experience
- Understanding of Spark ecosystem
- Apache Spark including an understanding of optimization techniques
- Experience with Python
- Experience with SQL
- Good communication skills in English (verbally and written)
Advantages:
- Azure Event hubs, Azure Data Lake Gen2
- Experience with Linux
- Good understanding of iterative software development methodologies
- Experience with JIRA and Confluence
- Being result-oriented, ability to make things done
We offer:
- Flexible working hours
- Flixible working days (extra pay for the weekend days, if employee desires to work on the weekends)
- Bonuses for the extra work (if employee desires to work extra time)
- A competitive salary and good compensation package