Principal Data Engineer
At AND, we accelerate the development of digital capabilities. In practice, that means helping ambitious leaders and organisations build the teams, products, processes and even operational structures they need to close the digital skills gap within their organisation today, so that they thrive tomorrow.
Clients rely on our experience, agility and craft skills across tech and business strategy, software development and product management to address some of the toughest challenges facing their businesses.
We bring aboard thinkers, tinkerers, passionate software craftspeople and inspiring technologists to help us solve these challenges. Together, we’re united by a sense of pragmatism, purpose and a deeply-held belief that digital products and technology alone won’t transform a business or save the world: it’s the people that count.
As a Principal Data Engineer for a club of over 80 people, you will be a hands on, senior data technologist with accountability for developing a team of cross functional Data Engineers. Working within a team that has high impact and importance for the business, providing team support, driving technical excellence, fostering a culture of innovation while delivering customer value at pace and insisting on high quality and simplicity.
You’ll also make a real impact by taking an active role in the team’s Agile Development practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data and processes.
You will spend the majority of your time helping deliver client data engineering opportunities, building our data engineering capabilities, growing our technologists and influencing how we think about data, both within AND and for our clients. This will include...
Helping grow Data Engineering capability, both for your Club and their clients:
A servant-leader approach, mentoring senior and high-potential developers in your club as well as clients in the field of Data Engineering. Including building close relationships with developers in your Club, understanding their needs and the challenges they are facing on client engagements
Helping to curate technical training content both for the Club and the AND Academy alongside shaping performance and progression in the field of Data Engineering
Guiding and supporting the acquisition or improvement of data skills for the junior to senior developers in your Club, during their time in internal projects between client assignments
Providing assistance in interviewing and recruiting new Data Engineers and analysts
Defining best practices and standards and ensuring that they are followed during client assignment
Providing technical oversight for client work on the Club’s most challenging data engineering activities, working alongside the Club’s Product Developers, Technical Leads and clients
Enabling and supporting an inclusive and diverse technology culture in your Club, and supporting these values on our client engagements
Influencing technical direction:
Providing insight and conducting research in progressive data engineering techniques and technologies, feeding into the internal AND data capability and community of practice
Engaging actively with our Consultancy Data Strategy and Insight practice, to help define and materialise clients’ data strategies
Collaborating with the technologists of the Consulting team to help establish AND’s wider Data proposition and develop thought leadership
Supporting the club in setting up engagements for success, ensuring that technical direction and choices are appropriate for clients’ needs, providing technical oversight and supporting the project resourcing during discovery phase
Championing and upholding high technical quality standards
Representing the field of Data Engineering at company functions, including hiring, and within our client acquisition to support growth and academy teams
Proven track record of leadership of teams and problem solving at the enterprise scale in the field of Data Architecture, Science or Analytics. With hands-on technical delivery of client-facing data projects across the full SDLC from design to migration, integration and live service in a multi-vendor environment
Strong skills in languages such as Python, R, SQL or Scala, alongside experience of using modern and traditional data technologies including: ElasticSearch, MongoDB, PostgreSQL, mySQL/mariaDB, Oracle, SQL Server, Hadoop, Kafka, Splunk/ELK or other logging and monitoring tools, BI and Data Warehousing solutions and ETL and migration technologies. This should be backed with strong cloud-native data engineering skills e.g. AWS RDS, Aurora, Redshift, Kinesis, Glue or Azure CosmosDB, DataFactory, DataWarehouse, SQL DB etc.
Proven experience in quality assuring data programmes, including non-functional testing and performance tuning
Hands-on experience of modern software delivery, including CI/CD and DevOps practices with a deep understanding and extensive track record of delivering complex data solutions using Agile methods including Scrum, SAFe etc.
A keen understanding of industry best-practice around standards, quality and continuous improvement in the field of Data Engineering
Experience in conducting large scale enterprise batch and real-time processing from varying sources
Experience in building and designing scalable and extensible enterprise data architectures
Consultancy experience across a number of sectors, including thinking about technology strategically, creating flexible and robust plans for investment and change, and communicating sensitive and impactful messages/solutions upwards and across teams
Coaching and providing career progression to senior developers and tech leads, supporting highly experienced developers create exciting and inspiring career ambitions
Supporting and enabling developer communities (both inside and outside your organisation), helping them have purpose and influence on company policy and approach
Experience of managing technologists across multiple teams to ensure they are working toward a holistic vision or goal
Experience in the use of machine learning models to transform and prepare data within the data pipeline
As an added bonus, you may be a well established figure in your field; perhaps you are a recognised conference speaker or tech blogger/writer, are an industry expert in the field of data, or have contributed to open source projects or charitable technical projects
From the work we deliver, to the way we serve and support our people, we work hard to ensure that there’s nowhere quite like AND. But joining a company is a two-way street: the fit has to work on both sides. So before you apply, here’s three key things to understand about us:
We’re built for people - like, real humans. Not ‘resources’ or ‘staff’. That means happiness and wellbeing really do matter to us, and we hate unnecessary hierarchy and bureaucracy.
There’s no well-trodden path ahead: AND is growing fast and forging a new trail. That’s exciting, and gives us all the autonomy and opportunity we love - but bear in mind it also demands focus, patience and resilience.
Diversity is a priority. After all, to build great products that a wide variety of different people love to use, we need a wide variety of people to help us build them. So diversity is more than a policy or a word: it’s business critical for us.