Senior Big Data Engineer

OVERVIEW

Search on its own is a highly complex data-set. Captify’s technologies have been built to extract maximum value from search for brands, partners and businesses all over the world and also to innovate & improve the consumer experience.

Captify’s world-class engineers, semantic specialists, and product teams are building the future of Search and as part of our Engineering Team you will play a key part in developing our offering.

Our Big Data team is enabling the optimal storage, organisation and timely retrieval of our data.

They are responsible for optimisation of ETL pipelines, maintaining over 60 Spark jobs. Building a data lake for data scientists and analysts.

We work in small cross-functional pods of developers who focus on a particular product areas and we encourage people to rotate across teams More detail around each of the team's responsibilities can be found here.

We’ve been growing rapidly and as we start our international roll-out, we’re looking for ambitious engineers to help us build the future of work. 

Our engineering guide -  will give you a good feel for how we work together. Our company values are important to us and influence how we work together.

With exciting projects, technologies and services in the pipeline now is a great time to be part of our journey.


KEY RESPONSIBILITIES

  • You will help architect and build solutions to business-critical problems
  • You will be participating in interesting projects such as:
  • Carrying out efficient integration with our data providers via various API endpoints and data representation formats.
  • Building and deploying an in-house distributed ETL pipeline for processing petabytes of data per day
  • Enable an accurate, comprehensive and reliable data storage in our distributed data warehouses based on the needs of other teams
  • Providing continuous improvements in the way data is being processed and stored based on the feedback and needs of the business or other teams
  • Setting up monitoring for key performance metrics and overall systems' behaviour to promptly react in case any anomaly detected
  • You will be responsible for optimisation of ETL pipelines, maintaining over 60 Spark jobs. Building a data lake for data scientists and analysts.
  • Experimenting with new tools and technologies to produce cutting-edge solutions to business problems
  • Be a part of a self-organising, results-oriented agile team using Kanban to complete new product launches


What you need to be successful:

We’re looking for a mid to senior-level candidate who has opinions but wants to do the right thing; we want you to own the product, and care about the direction it goes in 

You also:

  • have ~5 years experience in software development and have exceptional problem-solving skills 
  • have a  strong desire to improve your skills with modern development and production environment - Unix/Linux, bash, python, virtualisation (docker, Kubernetes), 
  • have deployment orchestration (chef, puppet, ansible), configuration servers ZooKeeper, monitoring and distributed logging (Prometheus, Grafana, GrayLog) experience
  • have strong knowledge of Java or any JVM based language 
  • have proven experience with Spark 
  • have proven experience of building production-ready ETL processing pipelines
  • have a proven track record of building integration with third parties via various APIs (http, file, message base)
  • have familiarity with Big Data persistent distributed storages Impala, Elasticsearch,  Aerospike, HBase
  • have proven working record with relational databases (e.g. PostgreSQL (stored functions, triggers))
  • are passionate about working in a fast paced, startup like environment.
  • are a proactive self-starter who works well independently and as part of a team
  • have good written and verbal English communication skills

You earn bonus points for the following:

  • Scala knowledge
  • Experience in AWS S3 environment (S3 storage) 
  • Some experience in the AdTech sector is advantageous
  • Previous experience in Bank or any Accounting field is a strong advantage 
  • Experience with working in an international team
  • A B.Sc. in Computer Science or related field qualification


What is in it for you:

  • Flexible working – We give you the option to Work from Home or better still you can work from any Captify office for 2 weeks in total per year.
  • Sharing culture - If you have learned something new, we welcome you sharing to the to share it with the team through a short presentation.
  • Diversity – You will be working in global diverse teams with intelligent and like-minded individuals
  • Days off - You will get 20 days holiday per year plus 2 bonus days off including your birthday. We get all 11 of the Ukraine public holidays off 
  • Limited Company - We help manage your Limited Company and provide you with supporting where needed


CAPTIFY EXPLAINED 

Captify is the largest holder of consumer search data outside of Google, and its unique technology understands the intent of consumers across all channels, including voice Search, desktop on-site search and in-app search. Captify’s privacy centric Search Intelligence technology powers programmatic advertising and unique audience insights for the world’s biggest brands, such as Apple, Disney, Adidas, American Express and Microsoft.


OUR CULTURE AND VALUES:

Here at Captify we are proud of our culture - It’s contagious. Pass it on. 

Step inside any of our global offices and one thing that is blissfully obvious is that while we’re putting blood, sweat and tears into disrupting the Search game, we’re having a seriously good time doing it. We’ve travelled the world together, enjoyed Captify Festivals, parties and our famous events across every market. We always take time to stop to celebrate milestones and wins.

We champion diversity and inclusion. Our ‘BeTheChange’ programme and internal D&I Taskforce brings our teams together to challenge, learn and build a more equal Captify.

We live by our core values;. 

  • Building this together
  • Gives a shit
  • Fail fast to succeed faster
  • Unlimited potential 

Find out more about our culture here: https://careers.captify.co.uk/


EQUAL OPPORTUNITIES

You are welcome at Captify for who you are, no matter where you come from, what you look like, or what your search history says about you. At Captify, equality is at the core of our culture and we are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact.  We don’t want you to fit in with our culture, we want you to add to our culture.

For candidates, view our EU HR Candidate Privacy Notice here

Or, know someone who would be a perfect fit? Let them know!

Kyiv

Business-center Senator
01010 Kyiv Directions

We are Fearless. Challengers. Disruptors.

Captify's award-winning global team is regularly recognized for driving innovation and growth: 

- AdExchanger's 'Programmatic Power Players'

- Business Insider's 'Hottest Ad Tech Companies'

- Campaign's 'Best Places to Work'

- Forbes '5 Fastest-Growing British Businesses to Watch'

Already working at Captify?

Let’s recruit together and find your next colleague.

email
@captify.co.uk
Teamtailor

Applicant tracking system by Teamtailor