Data Engineer

You will build the pipelines that move data from where it is created to where people can use it. Clients often have data spread across databases, spreadsheets and third-party tools, and your job is to bring it together in a form that is reliable and documented.

We value pipelines that fail loudly and are easy to rerun over clever ones that nobody understands.

Day to day:

• Build and maintain data pipelines
• Design warehouse tables and transformations
• Pull data from APIs, databases and files
• Add checks so bad data is caught early
• Document what each pipeline does and who depends on it

• 3 to 5 years working with data pipelines
• Strong SQL and Python
• Experience with a data warehouse such as BigQuery, Snowflake, Redshift or PostgreSQL
• Experience with an orchestration tool such as Airflow or Dagster
• Understanding of data modelling

Nice to have:

• dbt
• Streaming tools such as Kafka
• Experience supporting dashboards or machine learning work