Data Engineer

Professional Recruitment Australia · Sydney NSW · Full time
Posted 7d ago

Data Engineer

Professional Recruitment Australia
Sydney NSW

·

Full time

~$120k - $240k(Estimated)
KEY POINTS WE FOUND
  • Build and optimise production batch and streaming data pipelines and governed data platforms using SQL, Python, Spark, AWS and/or Databricks.
  • At lead and senior lead levels, lead teams or workstreams, own data architecture and engage with stakeholders on commercial matters.
  • Bring hands-on data engineering experience; financial services or regulated-industry experience is preferred.

PRA has been engaged to build out three engineering tracks across the financial services sector for a client in Sydney. 

Hiring at three levels - Senior Data Engineer, Data Engineering Lead and Senior Data Engineering Lead, You'll build the governed data platforms that analytics, machine learning and generative AI are built on.

The role

  • Build and optimise batch and streaming pipelines and ETL/ELT frameworks with SQL, Python and Spark
  • Deliver data platforms on AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation) and/or Databricks (Unity Catalog, Delta Lake)
  • Model data for real query patterns across warehouse and lakehouse, including open table formats such as Iceberg
  • Build data quality, lineage, access control and FinOps into the platform, with IaC and CI/CD throughout
  • At Lead level and above: lead a workstream and grow a team. Senior Leads own the data architecture across a programme and the commercial conversation with stakeholders

What you'll bring

  • Senior Data Engineer: 3-6 years.
  • Lead: 6-10 years.
  • Senior Lead: 10-15 years in data engineering, data architecture or technical leadership
  • Hands-on AWS and/or Databricks data platform experience, with strong SQL, Python and Spark
  • Pipelines you've taken into production and kept running
  • At Lead level and above: a track record leading teams and delivering complex data platforms end to end, ideally including time in consulting or professional services
  • Financial services or regulated industry experience is preferred

It's a bonus if you've worked with Kafka or Flink, Airflow, dbt, or Lake Formation or DataZone governance, built RAG retrieval layers, or hold AWS, Databricks, dbt or Snowflake certifications.

Culture

  • A collaborative data and AI engineering community that shares what works
  • Mentoring and coaching at every level
  • Hybrid in Sydney, with time on site with the team at agreed intervals

What's on offer

  • $120k-$240k package, depending on level
  • Permanent, or contract at $800-$1,200 per day
  • Support to gain AWS, Databricks and other certifications
  • A fast process: CVs reviewed within 48 hours and no take-home or live coding test.

If this sounds like you or someone you know, "Apply Now", or message Guy Nardo at PRA for a confidential conversation. A start pre Christmas is available for successful applicants.

Stay Safe While Job Hunting

We vet all employer accounts and do our best to keep job ads safe, but scams can still occur. Be cautious when sharing personal information — never provide financial details or make payments during the application process. For extra security, use the Apply button on our site when proceeding.

Skills

0 of 31 matched
Access controlAmazon athenaAmazon mskAmazon redshiftApache airflowApache flinkApache icebergApache kafkaApache sparkAwsAws glueAws lake formationBatch data processingCi/cdData governanceData lineageData modellingData platform engineeringData qualityDatabricksDbtDelta lakeEtl/eltFinopsInfrastructure as codeMentoringPythonSqlStakeholder managementStream processingTeam leadership

Licenses & certifications

0 of 4 matched
Aws certificationDatabricks certificationDbt certificationSnowflake certification

Perks & benefits

0 of 2 matched
Mentoring and coachingSupport to gain aws, databricks and other certifications

Professional Recruitment Australia