Data Pipeline Engineer

Are you a talented Data Engineer? Do you have a proven background in developing Kafka pipelines and working at the Petabyte scale? Would you like to join one of the world’s fastest growing tech labs?

One of the world’s blue-chips is looking to scale their AI offering with a focus on NLP and speech technology. They are now looking to recruit three experienced Data Pipeline Engineers.

You’ll be responsible for building and managing data pipelines and stream processing infrastructure.

Other responsibilities will include:

·    Building and maintaining the core petabyte scale data storage system as a hybrid of Hibernate and Amazon S3.

·    Building and maintaing Kafka pipelines.

·    Building pipelines to support new artificial intelligence models.

You’ll have…

·    More than 3 years’ commercial experience with skills in Python/Java and JSON

·    Strong Cluster Computing experience

·    Applied experience with Amazon S3

·    Prior experience of building infrastructure at the petabyte scale

Country: USC

City: Mountain View

Contract: Permanent

Type: Data Engineering

Data Pipeline Engineer application form

  • Drop files here or
  • Drop files here or
  • This field is for validation purposes and should be left unchanged.

Hear first hand what our happy candidates and clients think.
They put it better than we ever could.

Speaking to great people, working with great companies and having fun whilst we do it is what drives us! Become a part of the new innovative age and work with one of the biggest recruiters in Big Data, Data Science and Machine Learning across the world.

Our clients Our candidates

Similar jobs

Senior Data/Machine Learning Engineer

Data Engineering

Hamburg, Germany

Join the Machine Learning innovation lab of a globally leading logistics company.

Big Data Engineer

Data Engineering

Porto, Portugal

Are you an experienced Big Data Engineer with a track record in building scalable solutions? Have you used continuous integration tools to build data processing pipelines in a commercial environment? Would you like to help teach a multinational business about Big Data? This global eCommerce business is at the beginning…

Computer Vision – Team Lead

Data Engineering

Berlin, Germany

Using autonomous robot navigation technology, advanced SLAM algorithms, AI-driven real-time robotic control, we will revolutionize the way factories work; in turn this will improve the time it takes to bring products to production. Data is the lifeblood of robotics. As a team Lead you will manage a team of highly…