Back to jobs
        
	    
	        
	            
	               
			      
			         
			             
			      
		             
		         
			      
		           	
                
                
                    
                        
                        
                    
                 
            
		
	
		
		  
		    
		
	    	
		    
		    
            
            
    
 
 
    
    
        
	
	 
		
		   
           
		
		
		
	
	
Data Engineer
- Posted 31 August 2021
 - SalaryNegotiable
 - LocationSydney
 - Job type Contract
 - DisciplineBI, Data & Analytics
 - Reference110149
 
Job description
 To ensure success in the role you will possess the following skills -
- Minimum of 5+ years of experience as a solution designer, developer, tester or support role in IT Consulting or other technology business units across the industry
 - Minimum of 3+ years of hands-on development, testing, support and administration experience Apache Flink or Akka(Actors) solutions written in Scala or Java
 - Experience in applying industry best practices, design patterns and first-of-a-kind technical solutions as developer or administrator on data and non-data specific platforms and applications
 - Experience in implementing near real-time data flows/pipelines and distributed streaming applications
 - Experience in implementing traditional ETL, data warehousing and BI solutions
 - Hands-on development experience and working skill level in Python, Scalar, SQL, shell scripting and other programming/scripting languages
 - Hands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over and geographical redundancy
 - Working knowledge and hands-on experience with Cloud Platform such as Azure, AWS, GCP and IBM and other modern data platforms
 - Solid understanding of containerisation (Docker, Kubernetes etc), virtualisation, infrastructure and networking
 - Diverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall etc
 - Degree in Computer Science, Information Technology or related Engineering courses
 - One or more industry-recognised technology certifications or badges
 
 The Data Engineer is responsible for building and supporting the big data platform. As a Data Engineer - Big Data, your responsibilities include -
- Develop, test and support future-ready data solutions for customers across industry verticals
 - Develop, test and support end-to-end batch and near real-time data flows/pipelines
 - Demonstrate understanding in data architectures, modern data platforms, big data, ML/AI, analytics, cloud platforms, data governance and information management and associated technologies
 - Develop and demonstrate Proof of Concepts and Working Demos
 - Support and collaborate with other internal/external consultants in consulting, workshops and delivery engagements
 - Mentor junior IBM consultants in the practice and delivery engagements