Big Data Engineer

Are you an experienced Big Data Engineer with a track record in building scalable solutions? Have you used continuous integration tools to build data processing pipelines in a commercial environment? Would you like to help teach a multinational business about Big Data?

This global eCommerce business is at the beginning of their Big Data journey and is now looking for a Senior Big Data Engineer to drive a new Hadoop platform build up and scale out. They are specifically looking for someone who can advise them on, as well as implement solutions for the collection, storage and batch and near real-time processing of huge datasets.

As their new Senior Big Data Engineer you will work closely with the Head of Engineering to prepare and optimise their Big Data infrastructure according to best practice, ensuring no problems and monitoring performance of the integrated solutions you put in place. You’ll be responsible for developing, testing and maintaining data ingestion and integration pipelines, transforming business requirements into data models.

You’ll need to demonstrate previous experience of setting up Hadoop clusters (ideally Hortonworks) as well as stream processing with either Kafka or Spark Streaming. Prior experience with Flume, Hive or Pig would be beneficial. You’ll also need experience with object-oriented programming languages.

This is a unique opportunity to help shape the Big Data infrastructure of one of the fastest growing companies in the world. The company will support visas for the right person. Sound like it could be fun?

 

Big Cloud is a Data Science and Machine Learning recruiting firm. We’re lucky enough to recruit the best candidates into the most exciting companies all over the world. We try to reply to all unsuccessful applications, but we’re human (for now)!

Check out our jobs to see what else we’re recruiting for.

Country: PT

City: Porto

Contract: Permanent

Type: Data Engineering

Big Data Engineer application form

  • Drop files here or
  • Drop files here or
  • This field is for validation purposes and should be left unchanged.

Hear first hand what our happy candidates and clients think.
They put it better than we ever could.

Speaking to great people, working with great companies and having fun whilst we do it is what drives us! Become a part of the new innovative age and work with one of the biggest recruiters in Big Data, Data Science and Machine Learning across the world.

Our clients Our candidates

Similar jobs

Senior DevOps Engineer

Data Engineering

Singapore, Singapore

Do you want to work with one of Singapore’s best start-up tech companies? Are you a great problem-solver? Can you work in an environment that records terabytes of data every day? Big Cloud are working with one of Singapore’s most exciting tech unicorns. They are looking to add to their…

Senior Data/Machine Learning Engineer

Data Engineering

Hamburg, Germany

Join the Machine Learning innovation lab of a globally leading logistics company.

Senior Data Engineer

Data Engineering

Singapore, Singapore

Are you interested in the world of Big Data? Does the opportunity to build real-time data processing platforms excite you? Do you have experience managing data engineering teams? Great … Read on!   An exciting Fintech company based out of Singapore are looking for a Senior Data Engineer…