data engineer in Auckland

apply now

job details

posted
location
auckland
specialism
IT & ICT
job type
permanent
salary
NZ$ 90,000 - NZ$ 120,000 per year
reference number
90M0346900_1529640666
contact
richard van ark, randstad
phone
+6493360352
apply now

job description

The company

Based in Auckland CBD, this is one of NZ's most iconic brands. The company cultivates a high performance culture which translates in achieving to deliver an outstanding service to their customers. Because of this innovation and technologies play a key part to maintain and nurture these high costumer service standards.

The role

As a Big Data Engineer, you will be responsible for helping the Data Architect to build, design and manage the big data environment in the Cloud. You’ll be fine tuning the infrastructure and collecting data from different data sources and make this user ready for the team of Analyst’s and Data scientist’s.

As part of the Big Data team, you need to ensure all big data infrastructure is running smoothly and ready to use on an every day bases. It’s is a growing team offering lots of opportunity to discover and explore the world of Big Data with the support of management to do this. Good communication skills are key as the Data Science team is working in an Agile environment plus you need to have the ability to communicate meaningful data solutions to different levels of stakeholders. Another crucial requirement is therefore also high attention to detail & time/task management skills.

The requirements

Main responsibilities:

  • Help the architect to build a Hadoop based big-data environment especially Cloudera
  • Tune and fine-tune the big data infrastructure to ensure it runs smoothly and efficiently
  • Acquire data from policy administration systems, CRM tools, HR systems, digital platforms, third-party and other data sources
  • Provision data within the big-data infrastructure ready for use by Data Scientists and Analysts
  • ETLsoftware to extend solutions to provide big data extraction, transformation, and loading between Hadoop and traditional data management platforms.

To be successful in this role, you will need to demonstrate:

  • Hadoop, Spark, Impala, Kafka, Hive, NoSQL, SQL, data streaming and programming skills
  • Acquisition of data from multiple administration systems and toolsets
  • Design, management and tuning of big-data environments
  • ETL experience of big-data into Hadoop system
  • Curious with a track record of helping to thinking laterally to solve problems
  • Agile/Scrum experience

This role would suit someone with a Mathematics, Statistics or Computer Science/Engineering degree, a couple of years working experience within the big data space and exposure to the tools mentioned above.

If you would like to further explore this role or talk about other relevant opportunities in the analytics space and big data space, please contact Richard van Ark on 093360347. To be considered for this role immediately, please submit your CV (MS Word format) via the "Apply Now" button.

Please note that you need to be in New Zealand and have a valid work visa, to be considered for this role.

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.

skills

Data engineer, Hadoop, Cloudera, Big Data

educational requirements

Bachelor Degree