A leading Australian bank is seeking a skilled Lead Engineer - Big Data to support and enhance its big data platform. This role is designed for a motivated data engineering professional who excels in building and managing robust, future-ready data solutions within the financial sector.
Key Responsibilities:
- Design, develop, test, and support data solutions across batch and near real-time pipelines.
- Produce detailed solution designs and act as a technical lead, supporting data engineers and testers.
- Demonstrate expertise in data architectures, big data, data modeling, analytics, cloud platforms, and data governance.
- Lead proof-of-concept and demo sessions for innovative data solutions.
- Collaborate closely with internal and external consultants on consulting and delivery engagements.
- Mentor junior team members in data engineering practices and project delivery.
What You Need to Succeed:
- Minimum 5 years’ experience in solution design, development, or tech leadership within IT consulting, ideally in banking or financial services.
- At least 3 years’ hands-on experience with Big Data/Data Lake technologies in cloud and on-premise settings.
- Expertise with NoSQL databases (e.g., HBase) and distributed streaming platforms (e.g., Apache Kafka).
- Proficiency in data modeling concepts, ETL, data warehousing, and BI solutions.
- Strong coding skills in Scala, Python, SQL, and shell scripting.
- Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
- Solid understanding of containerization, virtualization, infrastructure, and networking.
... #scr-hannah-macleod
At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.
