If you enjoy working with the latest developments in data engineering and want to deliver work that protects consumers and makes a real impact on society, then you will be interested in this exciting opportunity to join the expanding Data, Technology and Analytics (DaTA) unit at the Competition and Markets Authority (CMA).

The CMA is a world-leading competition authority at the forefront of tackling pressing public policy questions, including the regulation of the biggest data and technology markets. Our mission is to make markets and businesses work well in the interests of consumers. We undertake objective, evidence-based analysis that has a direct and substantial impact on the economy and economic prosperity.

Job description

As a Data Engineer, you will play a central role in our ever-growing data work in technology markets, the analysis of digital competition, and the day-to-day running of an organisation which ingests and processes large amounts of data from many different sources. The DaTA unit allows the CMA to work effectively on data sets which competition authorities have historically struggled to handle, from billion-dollar multinational mergers to digital market investigations with terabytes of data. We ingest, process and analyse these data on our state-of-the-art platform that we have built in the public cloud using open-source technologies. We are agile and open-minded in our methods and you will have the opportunity to influence the design of our infrastructure and processes. The Data Engineering team sits within multi-disciplinary unit of over 35 people that includes data scientists, behavioural scientists, digital forensics specialists and technologists.


You will be responsible for selecting and implementing appropriate data engineering techniques; developing our cloud data platform and internal apps; and creating pipelines that integrate with our operational systems and processes. You will work with data scientists from across the unit to develop machine learning projects and deliver them into live operations. You will also build our understanding of how firms are engineering and exploiting their data assets in their pricing, ranking, demand forecasting and more.

A masters degree in a quantitative or computer science subject or equivalent experience gained working in data engineering, data science or development in the public cloud is essential. Equally important is experience of writing code, including Python, to work with large and messy datasets, ideally using cloud services such as AWS, Azure or Google Cloud. You will also need a proven interest in learning about and understanding the latest methods and technologies within data science and engineering.

About the benefits

The CMA is a hugely rewarding and stimulating place to work – an opportunity to work for the public good and to stretch and develop yourself in doing so.
In return we offer generous benefits, including an excellent pension scheme, at least 25 days leave (increasing to 30 over five years), and generous maternity/paternity leave provision. You can also take advantage of interest-free season ticket loans, a cycle to work scheme, our employee well-being programme and favourable consideration of flexible working.

Applications are welcome from candidates who wish to be based within either our London or Edinburgh offices.

Equal Opportunity

The Civil Service is committed to providing services and developing policies which embrace diversity, promote equality of opportunity and eliminate unlawful discrimination. We are an equal opportunities employer and treat every application on the basis of merit alone. We also offer a guaranteed interview scheme for disabled applicants who meet our minimum selection criteria.

The Equality Act 2010 prohibits unlawful discrimination on the basis of the following protected characteristics: Age, Disability, Gender reassignment, Race, Religion or Belief, Sex, Sexual Orientation, Marriage & Civil Partnership, Pregnancy & Maternity and we will not tolerate any discrimination on those grounds.

The CMA is an accredited Disability Confident Employer and are Stonewall Diversity Champions. Disabled applicants meeting the minimum criteria for the job will be given the opportunity to demonstrate their abilities at an interview. As an equal opportunities employer, we welcome suitably qualified applicants from all backgrounds and recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles.


We'll assess you against these behaviours during the selection process:

  • Making Effective Decisions
  • Communicating and Influencing
  • Working Together
  • Delivering at Pace
  • Technical skills

    We'll assess you against these technical skills during the selection process:

  • Data Science and Data Engineering technical knowledge and practical experience
  • Benefits

    All CMA employees enjoy the following benefits package: An excellent pension scheme
    • 25 days leave (increasing to 30 days over five years)
    • Favourable consideration of flexible working
    • Generous maternity/paternity leave provision
    • Interest-free season ticket loans
    • Cycle to work scheme and our employee assistance programme.

    If you’re already a civil servant being appointed on level transfer, you’ll retain your existing terms, including annual leave. Where you’re being promoted, however, you’ll receive the greater of a 10% pay increase or the new grade minimum. Applicants new to the civil service may be considered for appointment at a salary higher than the starting point indicated above (depending on skills, knowledge, experience and qualifications.

    Things you need to know


    Successful candidates must pass a disclosure and barring security check.People working with government assets must complete basic personnel security standard checks.

    Nationality requirements

    This job is broadly open to the following groups:

  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries
  • nationals from the EU, EEA or Switzerland with (or eligible for) status under the European Union Settlement Scheme (EUSS)
  • relevant EU, EEA, Swiss or Turkish nationals working in the Civil Service
  • relevant EU, EEA, Swiss or Turkish nationals who have built up the right to work in the Civil Service
  • certain family members of the relevant EU, EEA, Swiss or Turkish nationals
  • Further information on nationality requirements

    Working for the Civil Service

    The Civil Service Code sets out the standards of behaviour expected of civil servants.

    We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles.The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

    Apply Now

    Send your application to the employer.

    Send your Application