A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for a Senior Azure Data Engineer to help develop best practices and drive improvements in data engineering across the business and across a wide range of industries such as mining, telco’s, retail and financial services.
Responsibilities:
- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare data sets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage technical delivery of projects
- Mentor junior data engineers
Qualifications and Experience:
- Graduate or Postgraduate degree in Computer Science, Information Technology, Statistics, Engineering or related technical field.
- 2-6 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimizing and managing data pipelines for large and complex datasets
- Experience in Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Data bricks, Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Reference Number for this position is NG59096 this is a Permanent position in Johannesburg offering a salary of R900k to 1.1mil CTC salary negotiable based on experience. E-mail Nokuthula on nokuthulag@e-merge.co.za or call her for a chat on 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? e-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the e-Merge IT website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals
