Senior Data Engineer
At AND, we accelerate the development of digital capabilities. In practice, that means helping ambitious leaders and organisations build the teams, products, processes and even operational structures they need to close the digital skills gap within their organisation today, so that they thrive tomorrow.
Clients rely on our experience, agility and craft skills across tech and business strategy, software development and product management to address some of the toughest challenges facing their businesses.
We bring aboard thinkers, tinkerers, passionate software craftspeople and inspiring technologists to help us solve these challenges. Together, we’re united by a sense of pragmatism, purpose and a deeply-held belief that digital products and technology alone won’t transform a business or save the world: it’s the people that count.
As a Senior Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture.
You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.
As a result you will need to be able to:
Build and design scalable data architecture
Carry out data extractions
Transform data to make it usable to analysts and data scientists
Load data into data platforms
Write code as part of the ingestion or transformation process
Process data from a variety of sources from large scale batch processing to streaming real time events or change data capture
SQL and Python coding background
Dimensional modelling and Data Warehouse patterns
Exposure to at least one cloud platform
Experience with Data lakes or Big data storage
Experience with DataOps concepts
Experience of working within Agile environments
Javascript programming experience
Experience of working with Data tools such as Spark, Hadoop or Hive
Experience with Columnar storage, AWS Redshift or Apache Parquet
Kafka, Kinesis or Azure Event Hubs exposure
From the work we deliver, to the way we serve and support our people, we work hard to ensure that there’s nowhere quite like AND. But joining a company is a two-way street: the fit has to work on both sides. So before you apply, here’s three key things to understand about us:
We’re built for people - like, real humans. Not ‘resources’ or ‘staff’. That means happiness and wellbeing really do matter to us, and we hate unnecessary hierarchy and bureaucracy.
There’s no well-trodden path ahead: AND is growing fast and forging a new trail. That’s exciting, and gives us all the autonomy and opportunity we love - but bear in mind it also demands focus, patience and resilience.
Diversity is a priority. After all, to build great products that a wide variety of different people love to use, we need a wide variety of people to help us build them. So diversity is more than a policy or a word: it’s business critical for us.