Extracting Insights from Procurement Data – A Text Mining Approach for Social Housing Retrofits in the West Midlands
File type: pdf
File size: 4.42Mb

Annum Rafique
City-REDI, University of Birmingham

Pei-Yu Yuan
Alliance Manchester Business School
Understanding trends in public sector spending, supplier engagement, and funding allocation effectiveness is crucial in building trust in the government. A comprehensive understanding of procurement contracts enhances accountability and provides actionable intelligence for policymakers and stakeholders, enabling them to assess the effectiveness of procurement strategies and monitor progress toward sustainability goals.
This research brief explores the methodological approach of text mining and using it for procurement contract analysis. The approach focuses on keyword-based filtering and data extraction to identify relevant contracts, providing a practical approach for researchers, policymakers, and stakeholders without specialised expertise in natural language processing (NLP) or machine learning.
Using the methodology, we analysed structured data from Tussell database for the year 2022, examining social housing retrofitting contracts in the West Midlands. To gain a deeper understanding of the procurement landscape in the West Midlands Combined Authority (WMCA) area, a subregion within the broader West Midlands, refer to the IPEC publication: “Retrofitting Social Housing in the West Midlands Combined Authority (WMCA) Area”. This report by Annum Rafique (2025) provides valuable insights into procurement challenges, supply chain dynamics, and policy considerations specific to the region.
Applying the text mining methodology to Tussell’s procurement data provided several key insights:
These findings provide a data-driven foundation for improving procurement strategies, enabling policymakers to extend contract durations, support regional supplier development, and enhance SME participation. The insights derived from this methodology support evidence-based decision-making and reinforce procurement as a strategic tool for driving innovation, economic resilience, and the transition to a low-carbon economy.

Extracting Insights from Procurement Data – A Text Mining Approach for Social Housing Retrofits in the West Midlands
File type: pdf
File size: 4.42Mb
Public procurement in the UK is worth nearly £400bn a year, yet many organisations still struggle to use it as a tool for driving change.
At IPEC, we believe procurement isn’t just about process; it’s about unlocking opportunities, supporting local economies, and delivering better public services. That’s why we’re empowering local authorities to take a more strategic, innovation-friendly approach.
In our latest panel discussion at the IPEC Annual Reception, we brought together industry leaders to explore key issues shaping the future of public sector procurement. Featuring:
Together they explore:

Have you used innovation in your procurement processes? Whether it led to success or uncovered challenges, your experience can help others.
We’re gathering case studies from local and combined authorities to share practical insights on what worked, what didn’t, and what others can learn.
By sharing your journey, you’ll contribute to a growing knowledge base that supports better procurement across the public sector.
Answer:
Key risks include not conducting PME early enough in the procurement process and failing to integrate insights from PME into the procurement strategy, reducing its impact. This is particularly pertinent if we are bringing new innovative solutions forward.
Answer:
PME should include market research to identify potential suppliers and their ownership structures. For procurements with national security implications, organisations should engage with security teams to ensure compliance with regulations.
Answer:
We are seeing some good examples from across the public sector when it comes innovating through procurement but not enough. To drive innovation procurement at scale, it is crucial to create the right internal culture for innovation through procurement to thrive. Sharing successful examples and providing training on risk management and innovation procurement will also improve outcomes.
Answer:
It is about working with initiatives like IPEC with the aim to empower colleagues in the public sector to use procurement in a new way. Subsequently, it is then about creating new communication vehicles e.g. establishing a dedicated platform or network within local government can facilitate the sharing of successful procurement approaches, enabling different teams to learn from each other and adopt proven solutions.
Answer:
Barriers often stem from governance, funding structures, and organisational culture. Addressing these challenges requires clearer communication between legal and procurement teams, better training, and a more open approach to risk management.
Answer:
The Competitive Flexible Procedure can be suitable for procuring long-term innovative solutions which creates more room for R&D, iteration as well as scale, but councils need to ensure that the outcome of a pilot does not unfairly advantage a supplier. Contract specifications, payment structures, and performance measures must be carefully considered, especially for SMEs.
Answer:
The new Procurement Act introduces a “Procurement Review Unit” to ensure compliance. While the centralisation of procurement listings is not guaranteed, it may help address accessibility and transparency concerns.
Answer:
Not necessarily. In cases such as framework agreements, competition may have already occurred earlier. Value for money should be assessed through governance processes to ensure that the awarded supplier meets the requirements.
Answer:
Frameworks can both enable and hinder innovation. Open, dynamic frameworks can provide access to innovative solutions, but traditional frameworks tend to prioritise pre-vetted suppliers, which may not always be the most innovative.
Answer:
Innovation is often mistakenly defined as something entirely new. However, it can take many forms. Each procurement process should clearly define innovation in its specific context, whether it involves proven technology, transformational change, incremental improvement, or co-designing solutions with suppliers.
Answer:
Collaboration across local authorities to pool resources can help with large-scale challenges like environmental improvements. However, governance complexities can make managing joint projects difficult. Clear governance structures and effective facilitation are key to ensuring successful outcomes.
Answer:
Standard model contracts can be useful if thoughtfully designed, adaptable, and crafted by experienced procurement and legal professionals. They should be tailored to suit the specific needs of innovation procurement, especially for SMEs.
Answer:
Yes. Rigid specifications can hinder innovation. A clear problem statement, coupled with early market engagement, allows for flexibility and better exploration of potential solutions, helping to achieve the desired outcome.
Answer:
Ultimately, it’s about generating new value. At a macro level, there has been a Return on Investment if innovation through procurement is to work. The nature of innovation means that it is inevitable that some things won’t work as initially hoped but at an aggregate level, there should be overall value.
It can be quantified by several factors:
Ultimately, it’s about generating new value. At a macro level, there has been a Return on Investment if innovation through procurement is to work. The nature of innovation means that it is inevitable that some things won’t work as initially hoped but at an aggregate level, there should be overall value.
It can be quantified by several factors:
These factors suggest that success is measurable and achievable, leading to more effective, inclusive, and sustainable innovation procurement.
Authors

Xiuqin Li
Alliance Manchester Business School

Xin Deng
Alliance Manchester Business School

Elvira Uyarra
University of Manchester
Knowledge-Intensive Business Services (KIBS) are the cornerstone of innovation in a knowledge-based economy. Acting as facilitators, carriers, and sources of innovation, KIBS firms play a pivotal role in enhancing both public and private sector capabilities. These services encompass a wide range of expertise, from accountancy and management consultancy (Professional KIBS or P-KIBS) to IT and R&D services (Technology-based KIBS or T-KIBS).
Public procurement offers an invaluable opportunity for fostering innovation through KIBS. By serving as suppliers to government agencies, KIBS firms contribute to technological advancements, public service transformation, and regional economic growth. Our research analyses the dynamics of KIBS engagement in UK public procurement from 2016 to 2022, shedding light on patterns, trends, and opportunities.
Key Findings:
To maximise the contributions of KIBS, especially SMEs, to public procurement and innovation, the following strategies are essential:
KIBS firms hold immense potential to drive innovation, economic growth, and public service transformation. However, achieving this requires a nuanced approach that balances the strengths of T-KIBS and P-KIBS, promotes regional diversity, and ensures sustainable procurement practices. By addressing these challenges, public procurement can unlock the full potential of KIBS to reshape the innovation landscape.

Exploring the roles of public procurement on the performance of Knowledge intensive business services (KIBS)
File type: pdf
File size: 4.61Mb

Annum Rafique
City-REDI, University of Birmingham
The UK is at a critical point in its transition to a net-zero future, with one of the most urgent challenges being the retrofitting of social housing to transform them into energy-efficient, low-carbon homes to meet the 2050 net-zero targets. While the benefits of this transition are apparent (lower emissions, higher living standards, and cheaper energy prices), attaining it will necessitate overcoming numerous barriers. Public procurement is at the heart of this challenge: the mechanism through which funding is secured for projects, quality is maintained, and key stakeholders are aligned.
This research brief explores the procurement barriers associated with retrofitting social housing in the West Midlands Combined Authority (WMCA) area and the innovative solutions and initiatives used to overcome them. Key barriers, such as financial constraints, quality assurance concerns, and coordination complexity, are examined alongside actionable solutions implemented in the area. The WMCA area serves as a good example of how to address the intricacies of retrofitting at scale. Securing funding through initiatives such as the Social Housing Decarbonisation Fund (SHDF), as well as collaborations with industry and academia, has allowed local and regional governments in the WMCA area to address funding constraints, ensure quality assurance, and develop a skilled workforce capable of driving low-carbon transitions.
By fostering collaboration and embracing innovative procurement approaches, the area is transforming challenges into opportunities, setting a benchmark for progress in the housing sector. By leveraging these strategies, policymakers, researchers, and stakeholders can accelerate the transition to energy-efficient social housing.
Key Points from the Brief:

Retrofitting Social Housing in the West Midlands Combined Authority (WMCA) Area: Overcoming Procurement Barriers for a Net-Zero Future
File type: pdf
File size: 3.29Mb

Elvira Uyarra
University of Manchester

Pei-Yu Yuan
Alliance Manchester Business School

Xin Deng
Alliance Manchester Business School

Raquel Ortega-Argilés
Alliance Manchester Business School
Public procurement represents a pivotal mechanism for fostering innovation, constituting nearly 15% of GDP in OECD countries. In the UK, this accounts for a significant portion of public expenditure, with SMEs playing a vital yet underutilised role. This research publication investigates how public procurement influences SME innovation, with a particular focus on patenting activity from 2016 to 2019.
Key Findings:
SMEs constitute 99% of UK businesses yet account for only 20% of direct public procurement spending. Despite this, the research highlights procurement’s stabilizing influence on innovation, even amidst challenges such as delayed patent data capture and economic disruptions.
Central Government’s Strategic Impact: Central procurement supports cutting-edge innovation tied to national priorities, showcasing the potential of large-scale contracts to steer technological advancements.
Local Government’s Regional Focus: Local procurement enhances community-level infrastructure and applied technological solutions, aligning regional innovation efforts with broader policy objectives.
To unlock the full potential of SMEs in driving innovation, the following strategies are recommended:

Public procurement and SMEs’ innovation in the UK
File type: pdf
File size: 5.66Mb
The incoming Procurement Act 2023 prioritises Preliminary Market Engagement (PME) to simplify processes, boost innovation, and enhance supplier diversity. Created by IPEC and Gardiner & Theobald, this guide provides the tools to stay ahead, ensuring your procurement practices align with future-focused policy goals like net-zero transitions and mission-focused outcomes.
The UK public sector spends over £380 billion annually, yet much of its procurement potential remains untapped as a driver of innovation. This guide demonstrates how Preliminary Market Engagement (PME) can diversify the supplier base by engaging SMEs and new entrants, capture cutting-edge innovations, foster buyer-supplier collaboration for mutual value creation, and mitigate risks by refining procurement requirements early in the process.
Pre-market engagement is the key to finding innovative solutions to pressing challenges. This guide is your essential tool for unlocking the public sector’s potential to deliver transformative outcomes.Rikesh Shah, Head of IPEC
Engaging with supply chains early creates informed clients, inspires innovative thinking, and ensures projects deliver maximum value.John Mead, Partner, Gardiner u0026amp; Theobald
Key Insights You’ll Gain:
Download the guide now to access practical tools for innovative, impactful results.

Download a PDF of this page for quick and easy access anytime!
The Connected Places Catapult welcomes the Government’s consultation on a new Industrial Strategy. As the UK’s innovation accelerator for transport, cities and place leadership we are excited about the opportunity this represents. We are encouraged by the strong focus on the importance of unlocking the complexities of place, as well as the role that data and digital technologies have to play in raising the economic productivity of our cities and regions.
As the Resolution Foundation and others have demonstrated, the UK struggles with the dual challenges of low growth and high inequality, which has left us lagging our European peers in terms of living standards and productivity. Closing that productivity gap would yield incredible returns – an additional £100 billion in gross value added (GVA) per year. According to the Centre for Cities, hundreds of thousands of new jobs would be created if UK core cities achieved productivity levels equivalent to their European counterparts.
An Industrial Strategy that recognises the importance of place, connectivity and innovation is critical to that endeavour.
We welcome the fact that the Green Paper articulates the important role of place. It is also encouraging to see cities explicitly referenced as places that require focus given the important role that they can play in driving economic growth.
We recognise the Government’s need to focus the outputs of the Industrial Strategy around sectors to maximise the potential for long-term sustainable growth. But the economy is a matrix of both places and sectors. We would encourage the Government to ensure that there is no disconnect between the Green Paper’s recognition of the importance of place and the focus on sectors.
A strictly sectoral focus does not allow for challenge-based emerging sectors to occur. In our experience ‘emerging sectors’ occur where technological capabilities with place-based applications are applied across sectors. This often happens as opportunities to work with government and industry create new commercial propositions that respond to place-based challenges.
We also support the focus on clusters and basing investments on robust analysis of strengths and opportunities. We caution against an overreliance on single sectors in any given area, noting the huge opportunity for innovation when diverse sectors intersect and ideas share between one industry/cluster to another. Places which fixate on a single cluster also lack resilience and agility. There is a risk in emphasising clusters that we create unhealthy competition between regions.
Through our work with place leaders across the UK (e.g. the Innovation Places Leadership Academy, the UK Innovation Districts Group, the Freeport Innovation Network), we are also well placed to provide practical support to those seeking to deliver innovation-led local growth.
We see an opportunity for the Industrial Strategy, complemented by robust Local Growth Plans, to promote nationwide collaboration between places and clusters which make up different parts of our innovation value chains. This will promote mutually beneficial flows of talent, investment and knowledge across all parts of the chain. We see this as an opportunity to apply a market-driven focus to cluster development, emphasising access to emerging markets and creating tangible business opportunities, as companies join clusters to grow their bottom line.
Capacity to deliver innovation-led local growth is unevenly distributed across combined and local authorities as they face multiple competing fiscal and other pressures. This requires new thinking and resourcing approaches to capacity development and new strategic thinking. Without building innovation capability, there is a danger that the gap between innovation rich and experienced regions, and those regions with untapped potential, will grow. Without broader coordination, Local Growth Plans risk unnecessary fragmentation, competition or duplication.
Investments in high-productivity sectors will deliver a weak return if the places in which they are based are not optimised. Local Growth Plans need to not only describe how places will deliver sectoral improvements in support of the national growth mission, but also place-based transformations in the physical, digital and civic fabric of the place to support a flourishing innovation economy.
We can help unlock innovation in local growth planning and delivery, strengthen regional digital capability and capacity, and align local plans into national activity and vice versa providing a consistent approach across the UK.
We welcome the Green Paper’s focus on the role of data in supporting the Industrial Strategy, as well as the role of Government in removing the barriers to sharing data to improve business operations and decision making.
It is important that Government plays a leading role in reusing public sector data by adopting the principle of “collect once, use many times,” treating data as essential infrastructure. It should incentivise data sharing to unlock regional and sectoral potential while aligning policies with global best practices and market standards. Public sector data, including the proposed National Data Library, should be prioritised as a driver of innovation and growth.
We welcome the provisions in the Data (Use and Access) Bill – mandatory sharing, funding mechanisms, and enforcement—extend across sectors. A cross-sector Smart Data framework should promote secure, standardised sharing, enhancing productivity and innovation. Clear governance, pro-innovation regulation, and alignment with international frameworks, such as the Interoperable Europe Act, are essential.
Improving data literacy and capabilities within businesses will enhance their use of data across supply chains, foster collaboration, and strengthen competition in data-driven markets. These efforts will ensure the UK’s public and private sectors thrive in an increasingly data-driven economy.
It is also important to adopt a standardised approach across Government, industry, academia and Catapults. A decentralised approach to data sharing infrastructure is vital for unifying fragmented systems across transport, energy, and water, reducing costs and boosting productivity.
This will:
Thanks to technical advances we are seeing incredible innovations being unlocked in the UK by new suppliers from academic spinouts, small and medium sized businesses (including start-ups), scale-ups, venture capitalists, accelerators, corporate innovation teams and many others. These diverse suppliers are helping to achieve better, cheaper and quicker outcomes and create more value from the £400bn the public purse spend per annum on third party suppliers.
If just 5% of public sector contracts were brought to market in this way, it would transform £19bn of existing spend into innovation fuel annually. There is an opportunity to nurture this approach further and reform how the public sector shapes markets by not only effectively delivering public policy outcomes, but also by creating new businesses that could be exporting services across the world. To achieve this, we must go beyond Research and Development and use procurement to realise more value by scaling solutions.

Elvira Uyarra
University of Manchester

Oishee Kundu
University of Manchester

Pei-Yu Yuan
Alliance Manchester Business School

Xin Deng
Alliance Manchester Business School

Raquel Ortega-Argilés
Alliance Manchester Business School
Public procurement holds significant potential to drive innovation across industries. Despite its importance, the role of public procurement in fostering innovation is underrepresented in the UK Innovation Survey (UKIS). Enhancing this tool to capture procurement’s impact can yield vital insights for achieving goals such as sustainability, healthcare advancements, and economic resilience.
Key areas where improved procurement data is critical include:
Innovation Procurement Empowerment Centre commissioned experts from the University of Manchester to develop evidence-base that would inform procurement processes and unlock the full potential of government spending to drive the transformation of UK economy. This research brief highlights several gaps in current edition of UKIS, which limit the understanding of procurement’s role in stimulating innovation. To address this, the following steps are recommended:
By addressing these gaps, policymakers can better understand how public procurement fosters innovation, ultimately enabling the design of more effective policies that align with broader economic and sustainability goals.

How to measure procurement with innovation surveys: recommendations for the UK Innovation Survey
File type: pdf
File size: 2.89Mb
The Procuring Innovation Playbook is your go-to guide for breaking down procurement myths and unlocking innovation opportunities. It provides practical solutions to overcome procurement barriers, explores innovation pilots, outlines diverse procurement routes, and offers insights on designing effective evaluation criteria—alongside successful case-studies and much more.
This playbook is tailored for procurement professionals, innovators, decision-makers, and public sector teams ready to:
What you’ll gain:
Download the playbook now to access practical steps to build a future-ready procurement strategy, expert advice on navigating procurement rules while fostering innovation, and tools to manage risks while achieving transformative results.

Download a PDF of this page for quick and easy access anytime!

Conrad Parke
Centre for Local Economic Strategies (CL
The city of Birmingham is using public procurement to address its socioeconomic challenges and make its local economy more equitable. In this research brief, “Mobilising the Power of Local Spending – East Birmingham Inclusive Growth Strategy (Part 2),” Conrad Parke from the Centre for Local Economic Strategies (CLES) builds on the work outlined in the previous brief, “Working with the Anchor Institutions (Part 1),” to examine the practical application of innovative procurement strategies.
As the coordinator of the Birmingham Anchor Network, Conrad has been working closely with procurement managers and officers from the Network partners, and this brief captures lessons and insights from their collaborative efforts to foster inclusive growth in East Birmingham.
The previous brief (Working with the Anchor Institutions. Research brief no. 11/2024 – 4) introduced the concept of anchor institutions—large public sector organisations with substantial local influence—as key players in driving economic inclusivity and highlighted the barriers to embedding social value in procurement. This brief (Mobilising the Power of Local Spending – East Birmingham Inclusive Growth Strategy. Research brief no. 11/2024 – 5) focuses on the implementation of these ideas in East Birmingham, an area with significant socioeconomic challenges and a local economy dominated by micro-enterprises.
Through initiatives such as hyper-local spending, simplifying procurement processes for smaller contracts, and fostering direct connections between anchor institutions and local businesses, the Birmingham Anchor Network is piloting approaches to address these barriers. This brief highlights the practical challenges encountered, the innovative solutions being tested, and the potential for these efforts to transform public procurement into a tool for equitable economic growth. This brief also offers an understanding of the practical application of procurement strategies, showcasing their potential to support local businesses, create jobs, and build resilient communities.
Key Points from the Brief:

Practising Innovation in Public Sector Procurement: Mobilising the Power of Local Spending – East Birmingham Inclusive Growth Strategy
File type: pdf
File size: 2.67Mb

