Senior Software Engineer - Data Infrastructure

OVERVIEW

Search on its own is a highly complex data-set. Captify’s technologies have been built to extract maximum value from search for brands, partners and businesses all over the world and also to innovate & improve the consumer experience.

Captify’s world-class engineers, semantic specialists, and product teams are building the future of Search and as part of our Engineering Team you will play a key part in developing our offering.

Our Big Data team is enabling the optimal storage, organisation and timely retrieval of our data.

They are responsible for optimisation of ETL pipelines, maintaining over 60 Spark jobs. Building a data lake for data scientists and analysts.

We work in small cross-functional pods of developers who focus on a particular product areas and we encourage people to rotate across teams More detail around each of the team's responsibilities can be found here.

We’ve been growing rapidly and as we start our international roll-out, we’re looking for ambitious engineers to help us build the future of work. 

Our engineering guide -  will give you a good feel for how we work together. Our company values are important to us and influence how we work together.

With exciting projects, technologies and services in the pipeline now is a great time to be part of our journey.


KEY RESPONSIBILITIES

  • You will help architect and build solutions to business-critical problems
  • You will be participating in interesting projects such as:
  • Carrying out efficient integration with our data providers via various API endpoints and data representation formats.
  • Building and deploying an in-house distributed ETL pipeline for processing petabytes of data per day
  • Enable an accurate, comprehensive and reliable data storage in our distributed data warehouses based on the needs of other teams
  • Providing continuous improvements in the way data is being processed and stored based on the feedback and needs of the business or other teams
  • Setting up monitoring for key performance metrics and overall systems' behaviour to promptly react in case any anomaly detected
  • You will be responsible for optimisation of ETL pipelines, maintaining over 60 Spark jobs. Building a data lake for data scientists and analysts.
  • Experimenting with new tools and technologies to produce cutting-edge solutions to business problems
  • Be a part of a self-organising, results-oriented agile team using Kanban to complete new product launches


What you need to be successful:

We’re looking for a mid to senior-level candidate who has opinions but wants to do the right thing; we want you to own the product, and care about the direction it goes in.

You also:

  • have 5+ years experience in software development and have exceptional problem-solving skills
  • solid hands on Scala programming language (proven production experience)
  • solid hands on Apache Spark framework (proven production experience)
  • solid hands on Apache Spark SQL
  • have proven production experience with at least on of the following big data warehousing engines (distributed storages): Apache Impala and/or Presto and/or Amazon Athena; queries optimisation, data analytics
  • have proven working record with RDMS (relational databases) (e.g. PostgreSQL/MySQL (stored functions, triggers, command line tools))
  • have proven production experience with at least one of the following resource sharing frameworks Apache Mesos and/or Kubernetes and/or Yarn: jobs deployment, jobs scheduling, resource allocation, jobs execution debugging, logs collection and analysis
  • have proven production experience with monitoring tools and distributed logging frameworks (Prometheus, Grafana, GrayLog)
  • have proven production experience with at least one of the cloud services providers AWS Cloud services and/or Google Cloud services: command line tooling , data access, integrations, authentication etc.
  • are Unix OS family (Linux/FreeBSD/OSX) advocate: shell scripting and essential  commands knowledge
  • are familiar with Docker and use it in your integration tests
  • are passionate about following best industry practices: TDD, BDD , CI/CD etc
  • have understanding and working production experience with HTTP/HTTPS protocols; ability to setup and deploy a simple web server if needed; 3d party HTTP/HTTPS integrations;
  • have proven experience of building production-ready ETL processing pipelines
  • have a proven track record of building integration with third parties via various APIs (http, file, message base)
  • are passionate about working in a fast paced, startup like environment.
  • are a proactive self-starter who works well independently and as part of a team
  • have good written and verbal English communication skills

You earn bonus points for the following:

  • experience with striming frameworks Apache Kafka and/or Apache Flink
  • experience with distributed key value stores: Aerospike, HBase etc
  • experience with Python and JavaScript
  • experience with workflow frameworks (e.g. Apache Airflow etc.)
  • some experience in the AdTech sector is advantageous
  • previous experience in Bank or any Accounting field in a role of analyst is an advantage
  • experience with working in an international team


What is in it for you:

  • Flexible working – We give you the option to Work from Home or better still you can work from any Captify office for 2 weeks in total per year.
  • Sharing culture - If you have learned something new, we welcome you sharing to the to share it with the team through a short presentation.
  • Diversity – You will be working in global diverse teams with intelligent and like-minded individuals
  • Days off - You will get 20 days holiday per year plus 2 bonus days off including your birthday. We get all 11 of the Ukraine public holidays off 
  • Limited Company - We help manage your Limited Company and provide you with supporting where needed


CAPTIFY EXPLAINED 

Captify is the leading Search Intelligence Platform for the open web and the largest independent holder of first-party search data outside of Google, connecting the real-time searches from over 2 billion devices globally. Its Search Intelligence technology powers omnichannel programmatic advertising and real-time insights for the world’s biggest brands, such as Disney, Unilever, eBay, Mercedes-Benz, Microsoft, Nestle, GSK, Uber, Mars, P&G, Sony and Toyota—without reliance on third-party cookies. Captify brings brands more customers, publishers greater yield and consumers the most relevant digital experiences.


OUR CULTURE AND VALUES:

Here at Captify we are proud of our culture - It’s contagious. Pass it on. 

Step inside any of our global offices and one thing that is blissfully obvious is that while we’re putting blood, sweat and tears into disrupting the Search game, we’re having a seriously good time doing it. We’ve travelled the world together, enjoyed Captify Festivals, parties and our famous events across every market. We always take time to stop to celebrate milestones and wins.

We champion diversity and inclusion. Our ‘BeTheChange’ programme and internal D&I Taskforce brings our teams together to challenge, learn and build a more equal Captify.

We live by our core values;. 

  • Building this together
  • Gives a shit
  • Fail fast to succeed faster
  • Unlimited potential 

Find out more about our culture here: https://careers.captify.co.uk/


EQUAL OPPORTUNITIES

You are welcome at Captify for who you are, no matter where you come from, what you look like, or what your search history says about you. At Captify, equality is at the core of our culture and we are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact.  We don’t want you to fit in with our culture, we want you to add to our culture.

For candidates, view our EU HR Candidate Privacy Notice here

Additional information

  • Remote status

    Temporarily remote

Or, know someone who would be a perfect fit? Let them know!

Kyiv

Business-center Senator
01010 Kyiv Directions

A decade of innovation and growth

Celebrating milestones and memories

From hosting our inaugural Captify at Cannes event, expanding in 13 markets across the globe to launching our D&I Taskforce—hear from our brilliant Captifyers across the globe about their unforgettable memories and Captify's biggest milestones over the past decade, here.

Already working at Captify?

Let’s recruit together and find your next colleague.

email
@captify.co.uk
Teamtailor

Applicant tracking system by Teamtailor