This piece either reflects professional experience and direct exposure to the sectors and challenges discussed, or thoughts based on my understanding of the matter, rather than formal research or peer-reviewed findings. It is offered as informed perspective, not an empirical or academic claim.
The global conversation on artificial intelligence is increasingly moving from possibility to implementation. Countries are developing national AI strategies, establishing governance structures, investing in infrastructure, and promoting innovation ecosystems.
Yet one fundamental question remains:
How will we know whether AI is actually being adopted, and whether it is delivering measurable value?
This question has been central to my doctoral research and led to the development of the Three-Layer AI Visibility Framework (3L-AiVF™).
The framework emerged from a broader challenge facing policymakers, researchers and development practitioners: while many digital transformation indicators measure whether capabilities exist, they often do not reveal whether AI is being adopted by identifiable entities or whether observed outcomes can reasonably be attributed to AI.
3L-AiVF™ was developed to address this measurement challenge by examining the evidence that policies and strategies provide about AI adoption.
It distinguishes between three levels of AI visibility:
The framework does not assess whether an AI policy is good or bad. Instead, it asks a narrower but important question:
What does the policy enable us to measure about AI adoption?
Kenya's draft National AI and Emerging Technologies Policy, and the monitoring framework it proposes, provides an important opportunity to demonstrate the application of this framework.
Kenya is among Africa's leading countries in recognising the strategic importance of AI and developing a comprehensive policy response. Its policy demonstrates ambition across governance, infrastructure, skills development, research, innovation and responsible AI adoption.
Applying 3L-AiVF™ to the policy is therefore not an exercise in criticism. It is an opportunity to explore how even ambitious AI strategies can make their implementation journeys more measurable.
The assessment demonstrates a pattern likely to be relevant far beyond Kenya.
If implemented as designed, the policy's proposed monitoring framework would provide strong visibility of AI diffusion.
Many measurable commitments relate to:
Approximately 70% of the policy's measurable commitments connected to AI adoption sit at this diffusion level. For a first-generation national AI policy, that is a reasonable starting point, but it also shows where the greatest opportunity for improvement lies.
These foundations are essential. Without them, AI adoption cannot scale.
The assessment also identifies emerging evidence of countable AI adoption.
Some indicators identify specific institutions, firms, startups and other entities connected to AI implementation.
However, many indicators remain focused on ecosystem participation or readiness rather than confirmed adoption of AI systems by identifiable users.
This distinction matters.
An organisation receiving AI-related support, infrastructure or training is not automatically equivalent to an organisation actively deploying AI systems.
Measurement must distinguish between creating the conditions for adoption and demonstrating that adoption has occurred.
Encouragingly, some of the policy's own proposed mechanisms already point toward a way forward. A national registry of deployed AI systems, a vetted marketplace of AI solutions for government use, and an audit process for high-risk systems each have the potential to link a specific system to a specific adopting institution, the foundation attributable measurement requires. Whether they deliver on that potential will depend on a single design choice: whether each entry can identify both the system and the institution using it, not just one or the other.
The most significant finding relates to AI outcomes.
The policy contains important ambitions around improved service delivery, productivity, competitiveness and public value.
For example, the policy sets targets for improved productivity and service delivery linked to AI adoption across government agencies, yet its accompanying indicators do not yet specify how such gains would be distinguished from other digital transformation efforts happening at the same time.
Essentially, the current measurement architecture does not yet consistently provide for enough evidence to establish attributable AI outcomes.
This does not mean AI will not generate outcomes.
It means that demonstrating those outcomes requires stronger measurement systems capable of linking:
This challenge is not unique to Kenya.
It is particularly relevant across developing countries and least developed countries, where fragmented data systems, limited interoperability and uneven institutional capacity can constrain the ability to track technology adoption and impact.
The Kenya policy itself recognises the importance of addressing data gaps and weak interoperability. This highlights a broader reality: successful AI transformation depends not only on technology adoption, but also on the ability to generate reliable evidence about that adoption.
It is worth noting that, on a purely technical basis, the policy's proposed indicators already correspond to the large majority of its own stated commitments, a sign of a genuinely thorough monitoring design, even where the resulting visibility into AI adoption itself remains limited.
This perspective draws from Monitoring, Evaluation, Accountability and Learning (MEAL) principles, but 3L-AiVF™ is not a MEAL assessment framework.
It does not evaluate:
Instead, it applies measurement principles to examine whether AI adoption is visible, measurable and attributable.
My contribution is therefore not to evaluate Kenya's policy design. It is to contribute a measurement perspective to an emerging global challenge.
Pioneering countries help create the pathways that others follow. Measurement frameworks help ensure those pathways can be understood, evaluated and improved.
Kenya is helping Africa imagine what responsible AI governance can look like.
Through 3L-AiVF™, I hope to contribute to the equally important question:
How will Africa know when it has achieved it?
Penias Pen Chabwela (NWU South Africa PhD Candidate — Economics) is a development economist and international development consultant with over two decades of experience in economic development, private sector development, public policy, strategy, institutional strengthening, monitoring and evaluation, and organisational development. He has advised governments, development partners, regional organisations and the private sector across Africa, and writes about the ideas shaping the future of development.
We use cookies to run this site and, if you agree, to understand how it's used. Necessary cookies are always on. See our cookie policy for details.