Generative AI (GenAI) has emerged as a transformative force across industries. However, with this potential comes significant challenges, particularly for CEOs and CFOs tasked with managing costs and demonstrating return on investment.
Based on insights from a recent webinar by Gartner featuring AI economics expert Nate Suda, Senior Director Analyst at Gartner, Benjamin Seesel, VP of advisory at Gartner, and Clement Christensen, Senior Director Analyst at Gartner, this guide aims to provide a strategic framework for unlocking GenAI's potential by aligning expectations on value and cost.
GenAI has rapidly risen to prominence in board-level discussions. It has even surpassed cloud computing and digital transformation in strategic importance. For CFOs, this shift presents a unique set of challenges:
Pressure for ROI justification: With the era of cheap cash ending, CFOs face increasing pressure to justify every dollar invested in GenAI. The board and stakeholders are demanding clear evidence of returns, putting CFOs in the spotlight to demonstrate the value of these often substantial investments.
Uncertainty in ROI calculations: Unlike more established technologies, GenAI's potential returns are often speculative and difficult to quantify. This uncertainty makes traditional ROI calculations challenging and potentially unreliable.
Balancing innovation with fiscal responsibility: CFOs must balance innovation and maintaining financial discipline. CFOs face a delicate balancing act. They must weigh the fear of missing out on GenAI's potential against the need for prudent economic management.
Lack of established benchmarks: GenAI is a relatively new technology, so industry benchmarks or best practices for financial planning and performance measurement are scarce.
Talent and resource allocation: It's challenging to determine the appropriate level of investment in GenAI talent and infrastructure. This is especially true when GenAI competes with other strategic initiatives for limited resources.
Understanding and managing the cost dynamics of GenAI is crucial for its successful implementation. The webinar experts highlighted several key factors:
Significant cost overruns: Over half of organizations abandon their GenAI efforts due to miscalculated potential costs. Alarmingly, cost overruns of 500% to 1,000% are not uncommon in GenAI projects.
User behavior impact: A major factor contributing to these overruns is the underestimation of user behavior, particularly regarding how frequently they interact with GenAI tools. The cost model for many GenAI applications is based on usage, similar to being charged per word in a meeting, which can lead to unexpected expenses as adoption increases.
API usage costs: Organizations must carefully consider the cost implications of API usage. Many GenAI tools differ from traditional software with fixed licensing costs. Instead, they charge based on interaction volume. This can lead to quickly escalating costs as adoption becomes widespread.
Data preparation costs: The expenses associated with data cleansing and preparation are often underestimated. In some cases, these costs can far exceed the actual implementation costs of the GenAI solution.
Ongoing operational costs: Beyond initial implementation, the ongoing costs of running, maintaining, and scaling GenAI systems can be substantial and are often overlooked in initial budgeting.
Hidden costs of experimentation: Many organizations fail to account for the costs associated with experimentation and failed initiatives, which are often necessary to find the right GenAI applications for their business.
In response to these challenges, CFOs are adopting more sophisticated and flexible approaches to managing GenAI investments:
Shift to proof-of-concept funding models: CFOs are moving away from traditional net present value (NPV) calculations and are increasingly adopting proof-of-concept funding models. These models incorporate stage gates based on value-aligned metrics, allowing for more flexibility and de-risking of investments while maintaining control over the business case.
Focus on operational indicators: In the early stages of GenAI adoption, CFOs are shifting focus. Instead of relying solely on financial metrics, they look at operational indicators, which often precede financial returns. This approach allows a more nuanced understanding of the technology's impact and potential.
Portfolio approach to investments: CFOs are beginning to manage GenAI investments as a portfolio, balancing high-risk, high-reward projects with more conservative initiatives to spread risk and maximize potential returns.
Collaboration with IT and business units: CFOs are recognizing the complexity of GenAI and are working more closely with IT departments and business units to better understand the technology and its potential applications.
Emphasis on value harvesting: There's a growing focus on having clear plans for converting productivity gains from GenAI into tangible value, whether through revenue growth or cost savings.
Adaptive budgeting processes: Some CFOs are implementing more flexible budgeting processes that allow for rapid resource reallocation based on the results of GenAI experiments and pilots.
The experts outlined three main business case patterns for GenAI, each with distinct cost dynamics, value propositions, and ROI expectations:
Focus: Competitive parity and individual productivity
Cost range: Approximately $500 per year per worker
Value proposition: Improves employee productivity and satisfaction but may not directly impact top or bottom line
ROI expectation: Often marginal in financial terms, but can significantly improve employee Net Promoter Score and retention
Example: Implementing AI-powered productivity tools like Copilot
Focus: Enhancing existing processes for differentiation
Cost range: Starting at about $2 million
Value proposition: This can lead to significant improvements in specific business processes.
ROI expectation: Typically sees a 2:1 to 4:1 benefit-to-cost ratio
Example: Using GenAI to improve customer service response times and quality
Focus: Radically reshaping business models
Cost range: $20 million to nearly $1 billion
Value proposition: Potential to transform the industry and create entirely new revenue streams
ROI expectation: High risk, but the potential for returns as high as 100:1
Example: Using GenAI for drug discovery in pharmaceuticals
Organizations must align their GenAI initiatives with the appropriate pattern to set realistic expectations and accurately measure success. It's crucial to understand that these patterns are not necessarily sequential stages but rather different approaches that can coexist within an organization's GenAI strategy.
Building a compelling business case for GenAI investments is complex. It requires a nuanced approach that goes beyond traditional ROI calculations. Consider the following strategies:
Align value statements with technology: Clearly articulate how the GenAI initiative supports broader business objectives and strategy.
Tailor metrics to the business case pattern:
For "defend" initiatives: Focus on return on employee (ROE) metrics like employee satisfaction, productivity perception, and reduced turnover.
For "extend" initiatives: Use established KPIs such as ticket resolution time, customer satisfaction scores, or process efficiency improvements.
For "upend" initiatives: Develop long-term value metrics that capture the potential for industry transformation and new revenue streams.
Quantify the problem: Start by defining and quantifying the business problem or opportunity that GenAI aims to address. This provides a baseline for measuring impact.
Stage-gate approach: Implement a stage-gate funding process. In this approach, additional investment is tied to specific achievements. These may include reaching certain milestones or proving key hypotheses.
Consider indirect benefits: Factor in indirect benefits such as improved decision-making quality, faster time-to-market, or enhanced innovation capabilities.
Risk-adjusted returns: Incorporate risk assessments into the business case, acknowledging the uncertainties associated with GenAI implementations.
Scenario planning: Develop multiple scenarios to account for different levels of success and adoption rates, providing a more realistic range of potential outcomes.
Maximizing productivity gains from GenAI requires a holistic understanding of how the technology can impact various aspects of work:
Identifying high-value use cases for GenAI requires a strategic approach:
Effective budgeting and portfolio management for GenAI investments requires a strategic and flexible approach:
Unlocking GenAI's potential requires a strategic, multifaceted approach that balances innovation with financial prudence. CEOs and CFOs must work together to create a culture that embraces experimentation while maintaining financial discipline.
Organizations can navigate the challenges and uncertainties surrounding GenAI by:
The journey to realizing value from GenAI is likely to be complex and, at times, unpredictable. However, by applying the insights and strategies outlined in this guide, organizations can position themselves to capitalize on GenAI's transformative potential while effectively managing the associated risks and costs.
Long-term success in the evolving GenAI landscape will depend on several factors:
Want to explore how GenAI tools like Alltius can help CFOs?