AND Digital/Join/Open Roles

Senior Data Engineer

Location: Edinburgh

At AND, we accelerate the development of digital capabilities. In practice, that means helping ambitious leaders and organisations build the teams, products, processes and even operational structures they need to close the digital skills gap within their organisation today, so that they thrive tomorrow.

Clients rely on our experience, agility and craft skills across tech and business strategy, software development and product management to address some of the toughest challenges facing their businesses.

We bring aboard thinkers, tinkerers, passionate software craftspeople and inspiring technologists to help us solve these challenges. Together, we’re united by a sense of pragmatism, purpose and a deeply-held belief that digital products and technology alone won’t transform a business or save the world: it’s the people that count.

About you

As a Senior Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production-safe manner, using the latest technologies and with a DataOps culture.

You’ll work in a fast moving, agile environment, within multi-disciplinary teams, delivering modern data platforms into large organisations.

As a result you will need to be able to:

  • Build and design scalable data architecture

  • Carry out data extractions

  • Transform data to make it usable to analysts and data scientists

  • Load data into data platforms

  • Write code as part of the ingestion or transformation process

  • Process data from a variety of sources from large scale batch processing to streaming real time events or change data capture

To do that it's essential you'll bring the following

  • SQL and Python coding background

  • Dimensional modelling and Data Warehouse patterns

  • Exposure to at least one cloud platform

  • Experience with Data lakes or Big data storage

  • Experience with DataOps concepts

It's helpful if you also have

  • Experience of working within Agile environments

  • Javascript programming experience

  • Experience of working with Data tools such as Spark, Hadoop or Hive

  • Experience with Columnar storage, AWS Redshift or Apache Parquet

  • Kafka, Kinesis or Azure Event Hubs exposure

Joining AND

From the work we deliver, to the way we serve and support our people, we work hard to ensure that there’s nowhere quite like AND. But joining a company is a two-way street: the fit has to work on both sides. So before you apply, here’s three key things to understand about us:

  • We’re built for people - like, real humans. Not ‘resources’ or ‘staff’. That means happiness and wellbeing really do matter to us, and we hate unnecessary hierarchy and bureaucracy.

  • There’s no well-trodden path ahead: AND is growing fast and forging a new trail. That’s exciting, and gives us all the autonomy and opportunity we love - but bear in mind it also demands focus, patience and resilience.

  • Diversity is a priority. After all, to build great products that a wide variety of different people love to use, we need a wide variety of people to help us build them. So diversity is more than a policy or a word: it’s business critical for us.