About the company
My client is a leading global multinational investment bank and financial services company. It is headquartered and listed in Australian stock exchange and employs nearly 15000 staff in over 20 countries is the world's largest asset manager in infrastructure and Australia's top ranked mergers and acquisitions adviser with almost half a trillion dollars in assets under management.
About the role
Because of their immense growth in their Data Engineering portfolio, an exciting opportunity has come up in one of their offices in Sydney. You will be joining their elite engineering team and playing a key role in driving the data integration across their global teams. You’ll be building, implementing and enhancing enterprise scale data platforms. You’ll be working as a Lead engineer you will have end-to-end accountability for designing, developing, deploying and supporting your data assets, as well having a lens around identifying bottlenecks, observability, performance enhancements and optimisations .
They are urgently looking for an experienced Lead Data Engineer with very strong SQL and PySpark development experience and experience working in data Integration projects.
Only Australian Permanent Residents and Citizens required for this role
Skill Sets
You need to have the following skill sets to excel in this role:
... - Experience leading significant data engineering projects in an enterprise environment
- The ability to mentor and lead a team with best practices for data engineering and data warehousing, identifying bottlenecks, performance optimisations and enhancements of the systems and proactive monitoring
- Big Data and Hadoop experience with main focus on Spark, Hive, big data storage formats (such as Parquet, ORC, Avro), Bamboo/Ansible (or other CICD tools)
- Experience working in a cloud based environment (ideally AWS or GCP)
- Excellent Python, SQL and spark skills
- Experience working on ETL tools like Talend/Informatica/Datastage and an understanding of programming languages like Scala
- Broad knowledge of technical solutions, design patterns, and code for complex applications deployed in distributed computing environment.
It is an urgent position and my client is interviewing candidates at the moment. It is an exceptional opportunity for someone who has significant Data Engineering experience and has worked inPySpark and Data Warehousing.
For more information on the role, please either apply or contact Nathan Sabherwal on 0430880196. Urgent opportunity, excellent project, excellent salary, great career path, interviews happening now
At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.