Altman Solon - AWS - Telecoms Generative AI Study
Altman Solon - AWS - Telecoms Generative AI Study
Generative AI Study
September 2023
1
Contents
Appendix 45
Glossary 46
Definitions 47
Endnotes 50
Acknowledgments 53
01 Introduction
& Background
01 l Introduction & Background
The telecommunications sector presents one of the richest case studies of generative AI usage.
Leveraging vast amounts of available data while navigating regulatory and technology challenges
makes it a compelling candidate for exploration and implementation:
2. Significant Risk with Data: Because communication service providers handle a vast
amount of sensitive data, compounded by regulations that impose strict data protection
requirements, the telecommunications industry has been risk-averse with technology
investments compared to other sectors despite an increasingly data-driven landscape.
While the telecommunications industry is not the sole beneficiary, generative AI thrives on large
datasets, making the sector well-suited to process, interact, and derive insights from this data. At the
same time, generative AI can also help communication service providers (CSPs) navigate the goals of
risk, cost-efficiency, and innovation by facilitating use cases that can enhance customer experience,
spur innovation, and improve operational efficiency.
4
01 l Introduction & Background
To date, few early-adopter communication service providers have embarked on plans to experiment,
test, and explore the potential of generative AI across multiple business functions and use cases.
A major U.S. telecommunication services provider noted exploring generative AI for network
optimization1, while a European provider is feeding anonymized transcripts to create summaries
and analyze customer conversations;2 an Asia-Pacific provider uses a large language model for
a chatroom experience where customers can have conversations with a generated AI character;
multiple major Asian providers have announced plans to develop a multilingual large language model
customized for global telecommunications firms.3,4
However, as the industry gravitates toward integrating generative AI, it faces its share of challenges.
Telcos seek high-performance models trained on their data for specific purposes, which can be
resource-intensive and time-consuming. Compliance with regulations is a priority, encompassing
ethical use and user data privacy. Legacy system integration, data security, scalability, infrastructure
costs, talent availability, and expertise are also areas of careful consideration.
Informed by in-depth discussions and research with telecom executives worldwide, this whitepaper
delves into the myriad applications and benefits of generative AI within the telecommunications
sector, how companies are approaching deployment, and the challenges that lie ahead.
5
02 About The
Study
02 l About The Study
Asia Pacific / Oceania aims to share new learnings and analyses on the
Non-Mobile
Directors and Senior Managers.
23% Operator
phics Mobile
Additionally, Altman Solon drew on the experience
77%
Operator
of 25 industry experts through live, anonymized, in-
depth interviews to understand the relevant use cases
Business Size
and top concerns regarding generative AI tools of
27%
26%
MNO = Mobile Operator or CSP’s who (in addition to other
1
global wireless, wireline, and cable companies.
23% services) mobile network (e.g. LTE/5G) Non-MNO = Non-Mobile Operator or CSP’s who are not
mobile network operators but may provide other services such as fixed wireless, fiberoptics, cable, and/or telephony
15%
Europe
9%
Altman Solon combines output from this new survey
with proprietary insights from its recent study, Putting
Less than $1B $1B to <$10B $10B to <$20B $20B to <$50B Greater than
or equal to
$50B Generative AI to Work, from Spring 2023, which
surveyed 292 senior business leaders and interviewed
Title
der Type 1
21 industry experts to understand the adoption of
Director / Senior
Director Equivalent
56% generative AI tools for specific high-impact enterprise
% Head / Vice
use cases, key considerations for development
26%
President Equivalent
and deployment, and implications to organizations’
9%
Wireless Cable
erator Operator
MNO = Mobile Operator or CSP’s who (in addition to other services) mobile network (e.g. LTE/5G) Non-MNO = Non-Mobile Operator or CSP’s who are not mobile
1
network operators but may provide other services such as fixed wireless, fiberoptics, cable, and/or telephony
Non-Mobile 7
Operator
03 What Is
Generative
AI?
03 l What Is Generative AI?
Altman Solon defines deep generative models (i.e., generative AI) as a subset of artificial intelligence
distinguished by its ability to create new content based on a user’s prompt. While other AI models
have been around longer, these existing, traditional artificial intelligence or machine learning tools (AI/
ML) analyze data to enable decisions, classifications, or predictions rather than generate new content.
Rule-Based AI Models
have long been used to predict purchasing
likelihood, classify images into specific
Machine Learning (ML)
Altman Solon categorizes generative AI models by the type of content they create, including (but not
limited to) language, image, audio, video, or 3D. These five different model types can be characterized
by their capabilities. For example, the core capabilities of language generation include retrieving
responses through search, summarization, text translation (from one language to another, including
code), and autocomplete functions. For image generation, users can convert text to images or alter
existing images to produce a new image. Language and image capabilities are more mature today
than other generative AI models like video or 3D images. Future generative AI models are expected to
be multimodal, combining various data types.
9
04 Key Insights
& Findings
04 l Key Insights & Findings
2. CSPs have kick-started their generative AI journey and while still early in their
journey, some have already implemented use cases, which are now in production
a. The current adoption rate for the tested use cases averages at 19%. However, this
number is poised to increase significantly to 48% in the next two years, indicating
telcos implementing generative AI across more and more use cases.
b. North American CSPs marginally lead adoption (average use case adoption is 21%),
with Europe only marginally behind (19% average use case adoption); APAC slightly
lags at 16%, given the perception of limited capabilities in non-English languages of
existing generative AI models, and lower perceived data capabilities.
c. Survey results indicate CSPs will rapidly increase their generative AI spend as much
as 6x in the next two years; for instance, 45% anticipate their generative AI spend to
be 2-6% of total technology spend in two years, up from less than 1% today.
11
04 l Key Insights & Findings
4. Data security and governance (i.e., data management principles, policies, processes,
and practices) are top challenges and critical enablers when implementing
generative AI solutions
a. Universally, CSPs see data governance and ownership as the greatest gaps,
especially given the importance of security, privacy, and regulation compliance.
b. While data governance is a greater concern than data infrastructure, CSPs will still
encounter data siloes during implementation of generative AI. Hence, CSPs will need
to integrate these data siloes, which will prove to be more critical than building new
infrastructure.
c. Organizations ranking in the top 30% for data proficiency tend to perceive revenue-
generating use cases as less complex to implement, signifying a higher level of
readiness.
d. More data capable CSPs leading in generative AI adoption organizationally share
certain characteristics: a dedicated AI center of excellence, pervasive use of
advanced data analytics, and modern data infrastructure (e.g., cloud).
5. Most CSPs expect to use off-the-shelf models rather than develop foundation models
in-house, but best practices are still being debated as CSPs learn cost-benefits of
generative AI
a. Fifteen percent of CSPs indicated an inclination to build foundation models in-house,
with the rest indicating purchasing and using off-the-shelf models.
b. Over 65% of CSPs anticipate training off-the-shelf models primarily using their
proprietary internal data to tailor them for their specific needs.
c. The jury is still out on a universal approach to training off-the-shelf models, with most
CSPs evaluating both context learning/prompt engineering (i.e., inference) and fine-
tuning (i.e., training) approaches.
d. The telecommunication sector seems to be leaning towards context learning; this
technique is becoming increasingly popular as it is less resource-intensive and
provides ‘good enough’ performance for many use cases.
e. CSPs note the unknown cost of implementing generative AI as a top business
concern; the availability of 3rd party generative AI solutions and platforms, including
model-as-a-service (MaaS), are critical accelerators to adoption.
12
05
Overall
Telecommunications
Perspective
05 l Overall Telecommunications Perspective
Generative AI is a new wave of artificial intelligence, and in our study, communication service
providers (CSPs) affirmed interest in and adoption of this innovative technology. A majority of CSPs’
executives noted using traditional AI/ML technology within the organization. Even so,
telecommunications companies see generative AI as a means to create distinct, significant
incremental value, even for use cases that might be utilizing traditional AI/ML. Similarly, 70% of CSPs
see generative AI’s incremental value as distinct and significant. Sixty-four percent of CSPs indicate
these use cases as net-new and not simply a replacement for existing machine learning applications.
Exhibit 3:3:
Exhibit Communication Service
Communication Providers’
Service SentimentsSentiments
Providers’ on Existing AI/ML & Generative
on Existing AI & Generative AI1
AI/ML
1
% of
% oftotal
totalrespondents, N = 102N = 102
respondents,
Please indicate your organization’s sentiment on statements regarding your organization’s pre-existing non-generative AI solution
1
14
05 l Overall Telecommunications Perspective
Although still in the early stages, CSPs have kick-started their generative AI journey, piloting and
actively implementing use cases in production. Average use case adoption is 19% among surveyed
CSP respondents, and our survey indicates this will grow to 34% in the next year and 48% in the next
two years.
Exhibit
Exhibit 4: Communication
4: Communication Service Provider(s)
Service Provider(s) Generative
Generative AI Average AI Average
Use Case Adoption1 Use Case Adoption1
% of
oftotal
totalrespondents
respondents who
who have
have implemented
implemented or areorimplementing
are implementing a generative
a generative AI use
AI use case, case,by
N varies N region
varies and
by region and
business business
type type respectively
respectively
37% 38%
of communication service providers of communication service providers
anticipate their spending on generative anticipate their spend on generative AI
AI use cases to be <4% of total use cases to be 4-8% of total
technology spend in 2 years technology spend in 2 years
1
Please indicate the current stage of adoption of the following generative AI use cases within each business domain.
North American CSPs marginally lead adoption (current average of 21% adoption of tested use cases)
compared to peers, potentially benefiting from from regional proximity to generative AI investments.
The Bay Area has been the main hub for generative AI technology investment, attracting over $18B
from venture capital and investors in the last four years, sixteen times the largest global hub outside
the US (i.e., Tel Aviv $433M).5
European CSPs are more cautious about adopting generative AI given regional data residency
restrictions such as GDPR. Particularly for CSPs outside North America, present and future
governmental regulation on AI usage and data restrictions and residency continues to be a key
consideration. Countries such as China and the EU are tightening AI regulation and monitoring for AI,
while the U.S. and India seek a more passive approach.
15
05 l Overall Telecommunications Perspective
Exhibit5:5:Key
Exhibit KeyAIAI Global
Global Regulatory
Regulatory Considerations
Considerations
The EU’s General Data Protection Regulation (GDPR) (2016) requires consent before data
European transfer can occur and asks that tools disclose content generated by AI. Models must also
Union prevent illegal content generation, and AI deemed a threat to safety and rights will be
assessed before widespread usage.1
The EU AI Act (2023) restricts AI use in products, requires safe and ethical
European implementation, and ranks AI systems by risk. High-risk systems require impact
Union assessments and audits, and unacceptable risk AI, like real-time biometric monitoring and
social scoring systems, being forbidden in the EU.
India currently does not plan to regulate the growth of AI, considering it a "significant and
India strategic" sector for the nation, focusing instead on fostering a robust AI ecosystem and
promoting entrepreneurship and innovation in the field.
China is rolling out comprehensive regulations (2023) governing artificial intelligence (AI),
including measures on recommendation algorithms and synthetically generated content
China (deep synthesis), and strict draft rules on generative AI (AI chatbots like ChatGPT), with a
goal of information control and requiring developers to make filings to the algorithm registry.
UK abides by EU GDPR policy but not the EU AI Act (currently creating similar policy for AI Use)
1
16
05 l Overall Telecommunications Perspective
APAC lags slightly at 16% current average use case adoption despite featuring many leading CSPs
looking to implement more innovative and top-line impacting use cases. According to our survey,
APAC CSPs ranked their data capabilities much lower than their North American and European
peers. This suggests that CSPs in the Asia-Pacific region believe they need to do more in cleaning
up their data assets before they can fully realize benefits from generative AI. Additionally, APAC
telecommunications executives perceive current generative AI models to be limited in their ability to
handle non-English languages6. These perceptions may be easing through efforts such as AWS’s LLM
development program7, working to help Japanese organizations planning to build their own LLMs.
17
05 l Overall Telecommunications Perspective
Our study reveals CSPs anticipate a sustained increase in investment in generative AI. CSPs already
adopting generative AI are allocating less than 1% of their total technology expenditure towards these
capabilities. However, 45% of CSPs expect this spending on generative AI use cases to surge to 2-6%
within the next two years. This suggests that CSP spending on generative AI could grow by as much
as six times in the near future as CSPs scale implementations and explore newer use cases, especially
as familiarity with the technology grows.
“Of our total technology budget, around 30% is allocated to AI and data.
Within that, generative AI accounts for about 1 to 2%. This is primarily
due to many use cases being in the proof-of-concept stage and not yet
scaled. Over time, I predict that data and AI will become 50 to 60% of
the overall spend, and generative AI will become 30 to 40% of the overall
spend.
Director of AI and Product Management
Wireless CSP, USA
Organizationally, CSPs need to navigate several stakeholders when adopting generative AI. Both
CSP business domain and IT stakeholders are critical in evaluating and implementing generative AI
solutions. Leaders of business function departments (e.g., customer service, marketing, network, etc.)
are involved in the ideation processes for generative AI and shepherding proof of concept with other
stakeholders such as legal or risk/compliance. On the other hand, IT departments have less of a role
in evaluation. They are often the key owner of the generative AI use case implementation, especially
around deployment choice, data implications, and maintenance and governance of the data and
model. Together, these two key stakeholders determine whether generative AI has a place in the
organization, and which use cases to deploy.
18
06
Generative AI
Telecommunications-
Specific Use Cases
06 l Generative AI Telecommunications-Specific Use Cases
CSPs are optimistic about the potential for generative AI to create significant and incremental value.
They see the technology as a means to streamline existing processes, drive innovation, create new
opportunities, and unlock new sources of value in the telecommunications industry. In many of our
executive discussions, the most frequently mentioned KPIs for generative AI were reduction in call
volume, decreased time to resolution, and headcount reduction due to efficiency gains, though CSP
executives acknowledged realization of these benefits is still developing.
As part of the study, we tested 17 use cases across four domains (Product & Marketing, Customer
Service, IT, and Network). Unanimously across varying global CSPs, the foremost use case being
actively implemented was a customer chatbot, emphasizing the paramount importance of customer-
centricity.
Nonetheless, during our conversations, it became evident that these near-term implementations are
limited in their transformative potential. Numerous CSPs have articulated their reliance on rule-based
chatbots, previously utilizing AI/ML technologies. Executives expect to use generative AI to provide
a more conversational, “chatty,” human-like interaction to extend existing capabilities and features
to provide information to customers, thereby reducing call volume. However, in the longer term,
executives envision using generative AI to drive real-time customer action and decisions without
human intervention.
20
06 l Generative AI Telecommunications-Specific Use Cases
1
% of total respondents who noted they are currently implementing & currently evaluating with high likelihood to adopt the use case
“
Wireless CSP, Western Europe
We're exploring how much intelligence generative AI can inject into these
interactions and how customers might engage with it. It's not just about
pushing information to the customer; we want to facilitate a dialogue where
we can notify them of important issues, potentially ask them to make a
decision and answer any questions they might have before they make that
decision. We just don't know enough as to how that's going to go.
Former VP Managed Services
Cable CSP, USA
21
06 l Generative AI Telecommunications-Specific Use Cases
Other use cases seeing immediate traction often enable operational efficiency, such as guided
employee assistance and documentation in customer service and IT. In fact, improving efficiency and
productivity by using generative AI is by far the highest value driver. Forty-one percent of CSPs see
generative AI as assisting employees in producing quicker and higher quality output.
Exhibit
Exhibit 7:
7: Communication
Communication Service
Service Providers’ Data Capabilities
Providers’ Data Capabilities1
% of unique responses that chose driver for use cases selected as adopted, highly likely, or interested; N varies by respective domain
Weighted average on scale 1 (less proficient) to 5 (more proficient), N = varies by respective domain
Please choose the top driver for selection for each use case your organization is interested in and in the process of adoption
Majority
Increased Effi ciency Internal Employee Customer
Competitive Advantage Experience Experience
Cost Savings & Productivity
Providing a more Providing a more # of Respondents
Automating tasks Assisting employees Producing more revenue and
user-friendly experience user-friendly experience for a Selecting Use Cases As
and replacing human in producing quicker and more offering a better end-product
for a given process given element of the customer Adopted, Highly Likely,
labor / other tools quality output as opposed to competitors
for employees journey Or Interested
1
Please choose the top driver for selection for each use case your organization is interested and in the process of adoption
Many of these productivity use cases are considered easy to implement and lower risk because they
can largely leverage existing pre-trained, off-the-shelf models alongside existing knowledgebase and
documentation to enable summarization and accessible search functions.
“
Our decision to use a generative AI tool is based purely on productivity.
While it's beneficial if the representatives perform better with the tool, the
primary goal is to improve their performance.
CEO
Wireline CSP, USA
22
06 l Generative AI Telecommunications-Specific Use Cases
The healthy tension between business value and implementation complexity helps CSPs understand
which use cases to prioritize and how fast can these be adopted. Our study highlights the nine
specific high-impact use cases for CSPs, which we qualify as Clear Wins and Big Bets.
1
Please rate each use case your organization is in the process of adopting by ease of implementation and incremental business benefit on a scale of 1 to 5
23
06 l Generative AI Telecommunications-Specific Use Cases
Clear Telecommunications generative AI use cases with high incremental business benefit and less
difficult implementation effort.
Wins
These use cases often focus on employee assistance, such as contact center documentation
and network operations knowledge management. Of the “clear win” use cases, nearly 41% of
Network Operations
Guided employee assistance for installation
troubleshooting, and maintenance
Retrieve and respond to network service engineers
with information to aid in installation,
troubleshooting, and maintenance network devices
and infrastructure like routers, switches, and
firewalls
Customer Service
Contact center documentation
Generate transcription of calls,
summarize customer interactions and
suggest follow-up actions
Customer Service
Customer chatbot
Interpreting and responding to customer
queries and requests in a human-like
conversational manner
IT Software Development
Automated code documentation
The use of automated tools to generate
documentation for code that is similar to existing
documentation, often using natural language
processing or non-generative AI
Product
Insight generation
Generating new customer insights to
inform product enhancements and
service improvements based on customer
information
24
06 l Generative AI Telecommunications-Specific Use Cases
Big
Telecommunications generative AI use cases with high incremental business benefit but more
difficult implementation effort.
As noted, many of our discussions with CSP executives mentioned the potential for generative AI
Bets high value but more complex in implementation, and hence, not use cases for immediate adoption.
Marketing
Personalization
Generating tailored marketing messages
and content based on customer information
(e.g., demographic, history, behavior)
Network Planning
Generative route/network design and network
configuration
Generate a variety of possible network designs
optimized for key parameters (e.g., topography,
costs, power, etc.)
Network Planning
Synthetic data generation for security testing
Artificial data that mimics real-world data, which
is then used in testing security systems and identify
vulnerabilities without needing to use real customer
information
IT Software Development
Automated code generation, debugging, testing
The use of automated tools to create code,
find and fix errors in code, and test code
25
06 l Generative AI Telecommunications-Specific Use Cases
Outside of guided assistance for network technicians, CSPs are hesitant to roll out network planning
use cases since they involve sensitive network data. In fact, while generative AI holds promise for
optimizing network planning and management, networks’ complex and critical nature drives a long-
term outlook on this front. One CSP executive noted using generative AI for asset management of field
technicians, dispatching them before an outage occurs while en route to a scheduled preventative
maintenance job.
Although network planning use cases are often regarded as significant strategic investments (“Big
Bets”), our extensive discussions with CSPs have revealed a notable degree of uncertainty regarding
the perceived value of these investments compared to existing machine learning technologies already
deployed. For example, a large CSP in Europe mentioned that AI is already being used in network
design generation. While acknowledging the potential of generative AI, they do not foresee generative
AI delivering significant incremental value in this particular context.
“
Wireless CSP, USA
Furthermore, while not classified as a “Clear Win” or “Big Bet” in our analysis, CSP in-depth
discussions also highlighted their interest in the concept of a “customer service employee coach.”
These executives recognize the potential of generative AI-powered employee coaches, which can
leverage data from customer interactions to offer coaching and performance enhancement guidance
to customer service representatives.
“I see generative AI also for customer service and sales AI coach. We have
also experimented with AI tools through a private company for real-time
sales coaching, primarily for commercial use. These tools listen to calls
and provide post-call coaching to the representative, including directions
for follow-up.
CEO
Wireline CSP, USA
26
06 l Generative AI Telecommunications-Specific Use Cases
Many CSPs noted piloting and using generative AI for software code development. For example,
a major European CSP described using the technology for writing code, leading to a 30-45%
productivity gain in a trial with around 250 developers.2 Interestingly, we also heard some reservations
regarding tools’ security and ability to handle complex code. For example, some CSPs indicated
concerns about using existing offerings, given the need to keep code in-house and secure.
Additionally, some perceive generative AI to be more suitable for less complex code but not as well-
suited for more complex, unique, telecommunications-specific code.
“
In terms of coding, there is a debate. I believe that a significant portion of
code, perhaps 80 percent, is common, and only 20 percent is unique. The
common code, such as expanding a database by a column, adding a field,
or moving it, has already been written. We need human developers for the
unique code that is specific to us. Generative AI is not awesome but also
not horrible at creating code.
Former SVP Technology Architecture
Wireless CSP, APAC
We also examined how the perception of use cases differs among CSPs based on their data
capabilities. Among the top 30% of CSPs with advanced data capabilities (based on evaluation of 8
distinct capabilities covered in the next section), there is a shift in focus from only productivity tools to
product and marketing use cases that directly impact revenue generation and competitive advantage.
Unlike their peers, these CSPs see product and marketing use cases like search term generation and
insight generation as Clear Wins that enable a competitive advantage.
27
06 l Generative AI Telecommunications-Specific Use Cases
Exhibit 9: Clear
Exhibit 9: Clear Win andWin and
Big Bet UseBig Bet
Cases Use Cases
for Leading for
& Lagging Leading
Data & Lagging Data Capable CSPs
Capable CSPs
Product & Marketing Network Planning Network Operations Customer Service IT Operations IT Software Development
Our conversations with larger CSPs also noted interest in product-related use cases. Recently,
a European CSP announced using generative AI to create new offerings in the sports market,
expanding their capabilities and understanding of how generative AI can be monetized (within the
media environment).8 Another example is a CSP from the Asia-Pacific region, which has developed
a consumer-focused application that enables users to interact with its digital services such as music
streaming, payments, and actions like sending texts and managing schedules.9 This is in line with our
survey findings, where APAC CSPs noted product and marketing use cases such as personalization
and new future ideation as high-value opportunities.
Meanwhile, European CSPs notably view customer service use cases as primary focus areas
and Clear Wins. One large European CSP explained that cost pressure, while universal in the
telecommunications industry, is particularly palatable in Europe. Thus, the focus is acutely on lowering
service costs, making generative AI use cases for customer service even more attractive.
Generative AI is an emerging technology with significant potential across a multitude of use cases in
the telecom industry. Certain use cases are poised for earlier implementation, promising immediate
benefits. In contrast, others remain firmly rooted in the longer-term horizon, requiring comprehensive
planning and adaptation to fully realize their potential.
28
07
Constraints &
Complexities
07 l Constraints & Complexities
As CSPs delve deeper into deployment of generative AI, realizing these opportunities is not without
challenges and complexities. The biggest concern many CSPs share is the current state of data
practices and processes within the organization. Specifically, data security, privacy, and governance
considerations are noted as top concerns.
Exhibit
Exhibit 10: 10:
TopTop 3 Technical
3 Technical Concerns
Concerns1 1
% of
% total respondents
of total responding
respondents responding in in
thethe
toptop
3; N3;= N = 102
102
61% “We are also considering how to ensure data security when
working with providers, whose servers are based in the U.S.
Security, privacy, and data We need to ensure that our data is secure and not used by
governance concerns of data other actors.”
used by generative AI models
Head of IT Architecture and Infrastructure Strategy,
Wireless CSP, Western Europe
51% build their own LLM. Are they willing to take the risk
and invest in building a large LLM? This involves cost,
Lack of internal technical manpower, and potentially changing the company’s
expertise to implement direction.”
and manage generative AI
CTO, Wireless CSP, APAC
46%
Concerns about accuracy
of generative AI. The tool is not fully mature yet, so
the quality of the output must be reliable enough for
production use without fear of errors.”
& reliability of generative
AI output Head of IT Architecture and Infrastructure Strategy,
Wireless CSP, Western Europe
Choose and rank the top 3 technical concerns/challenges related to adoption and scaling of generative AI-related use cases at your organization.
1
Informed by our discussions with executives, we analyzed data dependency concerning generative
AI, focusing on three specific dimensions of data capabilities: the what of data (i.e., data infrastructure),
the who of data (i.e., data fluency), and the how of data (i.e., data processes).
30
07 l Constraints & Complexities
Exhibit11:
Exhibit 11:Communication
CommunicationService
ServiceProviders’
Providers’Data
Data Capabilities
Capabilities
Using the evaluation of these distinct data capabilities, most CSPs view their state of data as overall
sufficient but lacking specifically in data governance. This remains a top concern even for the top 30%
of data capable CSPs.
1
For each of the following components of your data environment, please rate your organization’s proficiency from 1 to 5; 2) Per market experts, weights are
60% data infrastructure, 15% data fluency, and 25% data processes
“ A lack of data governance and data ownership procedures are slowing the
pace of generative AI adoption at telcos.
Senior Executive Engineering
Wireless CSP, USA
31
07 l Constraints & Complexities
“Data is important from two main standpoints: data availability and data
governance, including processes around who can access that data.
Director of Product Management
Wireless CSP, USA
It is important to note that while CSPs consider data infrastructure to be more “ready” for generative
AI and relatively more proficient, they also acknowledge, at times, data siloes are inevitable. Forty-six
percent of CSPs agreed their internal data is highly siloed and not well integrated compared to the
34% that disagreed.
1
Please indicate your organization’s sentiment on the following statements regarding your organization’s data capabilities.
Please indicate your organization’s sentiment on the following statements regarding your organization’s data capabilities.
1
Given that the current state of data capabilities is top of mind for telecommunications companies, we
took a closer look at CSPs that are more data capable and lead in generative AI adoption. As noted
earlier, these data capable CSPs exhibit greater emphasis on near-term use cases focused on revenue
generation. They also consider these use cases to be, on average, 8% less complex to implement on a
data readiness rating scale.
32
07 l Constraints & Complexities
• Pervasive Use of Advanced Analytics – CSPs with data-leading capabilities often use
advanced analytics throughout the organization, not just certain business domains or
specialists. These CSPs make it their mission to enable users within the organization to
access data on a self-service basis and use it for data-driven decision making. Such
companies encourage a data-driven culture, have strong governance practices in place,
and foster greater adoption of new AI technologies.
Telecom companies’ data capabilities and maturity play a pivotal role in shaping their adoption of
generative AI. Companies with advanced data capabilities tend to be more proactive in embracing
generative AI, leveraging their proficiency to experiment and adopt applications that address both
efficiency and revenue generation objectives.
33
08
Deployment &
Implementation
08 l Deployment & Implementation
The discussion about improving data capabilities and proficiency is crucial because CSPs expect to
primarily use pre-trained, off-the-shelf foundation models, but train these models on CSP-owned,
internal data. Across all business domains, more than 65% of CSPs intend to use internal proprietary
data for generative AI use cases. This reliance on internal data is consistent with CSPs’ objectives
of customizing pre-trained models, tailoring them to handle industry-specific terminology and
context, and ultimately enhancing output quality. Hence, having a robust data infrastructure and
governance is essential to ensure that the foundation model is trained on high-quality and relevant
telecommunications data.
“ Many telcos do not have the in-house expertise to build their own
LLM, so they might opt for a pre-trained model.
model The challenge lies in
the expertise and the company's vision. Are they willing to take the risk
and invest in building a large LLM? This involves cost, manpower, and
potentially changing the company's direction.
CTO
Wireless CSP, APAC
CSPs are broadly considering two relatively different approaches for adapting large language
models (LLMs) for specific tasks: fine-tuning or prompt and context learning. These techniques vary
based on whether the organization will be customizing the training of the foundation model versus
inference. Fine-tuning trains the foundation LLM by adjusting its parameters and feeding the model
additional data. On the other hand, prompt engineering and context learning is used to customize the”
inference,” i.e., the output of the generative AI model to make it relevant to the domain context while
keeping the foundation model parameters frozen.
35
08 l Deployment & Implementation
Exhibit 14: Fine Tuning vs. Context Learning & Prompt Engineering Comparison
Exhibit
% of total14: Fine Tuning
respondents; vs. Context Learning & Prompt Engineering Comparison
N = 102
Inference Training
An external process that utilizes any base model A modification made to the model that
deployed (fine-tuned or not) and enhances input, fundamentally alters its parameters and underlying
output, or both for a specific use case weights into a new model
Reinforcement Learning
A method by which a model can automatically
modify its framework over time based on maximizing
rewards and minimizing penalties associated with its
responses to previous tasks.
Fine-tuning can improve model performance on specific tasks by adjusting a sub-set of model
parameters and training the model on a curated task-specific dataset. In contrast, prompt engineering
and context learning involve providing the model with a small number of task-specific examples as
input. The model then uses these examples to quickly adapt to the task at hand and enhance input,
output, or even both in specific cases. This approach can be more resource efficient than fine-tuning,
as it requires less training data and computational resources with an output noted as ”good enough.”
CSPs are concerned about the costs required when implementing generative AI. In fact, 31% of CSPs
note concerns around significant operating costs to maintain the model and infrastructure (i.e., opex).
Since in-context learning is the cheaper technique as it does not involve any form of training, it is
attractive to CSPs given its low resource intensity, only referencing other data provided with prompts
for a sufficient-enough output.
But the jury is still out on trade-offs between prompt engineering/context learning and fine-tuning,
and their suitability for the various use cases. Both are being explored: 38% of CSPs preferred using
prompt and context learning and 40% for fine-tuning to train off-the-shelf pre-trained LLMs. In fact,
one CSP executive noted investing in both fine-tuning and prompt/context learning, with the former
showing only slightly better results for some use cases. They also stated that fine-tuning required
more time, expensive talent, and higher compute resource costs since they were fine-tuning a multi-
billion parameter model. In contrast, prompt and context learning was less costly and allowed them to
experiment with various open-source models.
36
08 l Deployment & Implementation
“ Right now we’re indexing our data in a real-time manner and improving
prompts and pre-prompts. We’re vectoring data for fast results, but we
intend to look more into fine-tuning once GPT3 & 4 allow fine-tuning.
VP Data & AI
Wireline CSP, USA
Exhibit15:
Exhibit 15: Communication
Communication Service
Service Providers’
Providers’ Preferred
Preferred Generative
Generative AI Implementation
AI Model Implementation Method1Method1
%ofoftotal
% responses, NN
respondents, varies bybyrespective
= varies domain
respective domain
Please indicate the likely implementation method for generative AI models for the business domain(s) seslected.
1
Please indicate the likely implementation method for generative AI models for the business domain(s) selected.
1
“
We invested in both fine-tuning and prompt engineering and found similar
results for a number of use cases. There were few use cases where fine-
tuning was slightly better. However, the fine-tuning team required more
time, more expensive talent, and significantly more money on GPUs. As a
result, we shifted our focus to prompt engineering.
Director of Technology
Wireless CSP, USA
It is also worthwhile to note that there are additional techniques for customizing pre-trained LLMs,
such as Retrieval-Augmented Generation (RAG) and reinforcement learning through human feedback.
RAG works at the inference level, improving output of the LLM by allowing access to additional data
sources (including organization’s own data) and retrieve up-to-date information without modifying
the underlying model. Reinforcement learning, on the other hand, is a method by which a model
can automatically modify its framework dynamically over time based on maximizing “rewards” with
its responses to previous asks. However, reinforcement learning can also be expensive if it utilizes
feedback from humans (e.g., ranking answers). The associated cost can be a function of how many
answers are provided and how thorough the human feedback process is.
37
08 l Deployment & Implementation
While a notable 15% of CSPs indicated interest in building foundation models in-house, this number
seems somewhat inflated. Upon closer examination and further discussions with CSPs, an emerging
trend becomes apparent: the in-house development of small custom models tailored to telecom-
specific needs. These smaller models utilize the LLMs as a framework and are then customized for a
specific purpose. For instance, one CSP remarked crafting a custom language model with fewer than
15,000 parameters—a significant contrast to the billion-parameter scale of open-source GPT models.
They integrated this model with the LLM to ensure that the CSPs’ distinctive voice and communication
guidelines were reflected in the results. Similarly, a major CSP is developing an in-house model with
over 200 million parameters, which will be used to fine-tune and integrate with third-party LLMs.
By using these smaller models to tailor LLMs, telecom providers can improve their performance in
specific tasks and improve capabilities such as multilingualism and interpretability. This aligns with
our survey results, where some CSPs mentioned developing their in-house models, but often on a
more modest scale. Forty-three percent of CSPs also indicated a need to integrate both a large and a
smaller language model into their systems.
“ Our solution takes GPT and adds a smaller customized LLM on top of
GPT to ensure it has our telco ‘voice’ and/or communication guidelines
come through in the output versus general English.
Strategy Director
Cable CSP, USA
“ We took the initiative to build our own large language models (LLMs)
for specific use cases and domains because there was nothing available
in our country and we wanted to be first movers in that space. From an
efficiency and latency perspective, we believe there are smaller models that
we can train and use for certain applications.
Senior Director of Technology and Business Development
Wireless CSP, APAC
38
08 l Deployment & Implementation
Exhibit
Exhibit16:16:
Generative AI Product
Generative Offerings
AI Product Most Important
Offerings to CSPs1 to CSPs1
Most Important
% of total respondents ranking in the top 3, N = 102
% of total respondents ranking in the top 3, N = 102
Providing context-learning
65%
tools and services
Provide off-the-shelf
applications
40%
1What product offerings are most important to you when selecting a generative AI solution or provider?
1
What product offerings are most important to you when selecting a generative AI solution or provider
An emerging, notable development is the rise of generative AI-managed service platforms and
Model-as-a-Service (MaaS) providers. Managed service providers, for instance, can offer licenses to
multiple pre-trained models, enabling companies to access cutting-edge generative AI models via the
cloud. This allows organizations to generate innovative content without starting from scratch, akin to a
subscription-based software model.
Generative AI fully managed service platforms enable enterprises to integrate multiple models across
various premises without being locked into a single provider. Forty-four percent of CSPs plan to use
fully managed service platforms like Hugging Face or Lang Chain for their generative AI models.
These emerging business models (i.e., Managed Services Platforms and MaaS) offer end-to-end
service solutions without the infrastructure and cost demands of a fully custom, in-house build.
39
08 l Deployment & Implementation
“ The real issue [for CSPs] is the lack of [technical] resources. Many
partners and large language model providers understand that
telecommunications companies may not have the necessary resources. And
vendors provide their own studio and professional services and help with
fine-tuning or help CSPs to fine-tune themselves. I personally believe that
this will be the key accelerator for generative AI in telcos.
General Manager of Advanced Analytics
Wireless CSP, APAC
While much attention is understandably devoted to the complexity of model customization and
deployment, it is essential to consider the application layer. Interestingly, 69% of CSPs prefer
purchasing off-the-shelf end-user application interfaces for their generative AI solutions rather
than building them. This trend spans business domain use cases, particularly focusing on product
& marketing and customer service. The rationale behind this preference lies in the convenience of
ready-to-use applications, which accelerates time to market and minimizes maintenance.
40
09
Implications &
Outlooks
09 l Implications & Outlooks
Generative AI adoption within the telecommunications industry is only beginning and will continue to
evolve dynamically. This study underscores:
• “Clear Win” use cases, such as customer chatbots and employee assistance, are ripe for
implementation. Many of these use cases require a lighter implementation touch and can
use an off-the-shelf model with some adjustments.
• More transformative high-value use cases, or “Big Bets,” such as network planning and
optimization, are of interest but dependent on high-quality and sensitive internal data.
Establishing strong data governance practices becomes imperative for CSPs seeking to
prepare for potential use cases, especially those related to these “Big Bets.”
• CSPs should explore various implementation and deployment options and be aware that
the future of generative AI in the telecommunications space will be shaped by technology
developments, such as managed service platforms and tools enabling easy customization
and development of LLMs (e.g., Amazon Bedrock10 enabling enterprise developers to
evaluate and fine-tune foundation models of choice using custom data or build generative
AI apps from scratch), and AI regulations.
The significance of high-quality data cannot be overstated, especially when it comes to training
generative AI models for telecom-specific tasks and contexts. The reliability of these models, as well
as the transparency and trust they inspire through their outputs, hinges on the quality of the data they
are trained on.
While many CSPs prefer off-the-shelf models to expedite their generative AI initiatives, the off-the-
shelf approach comes with its own set of considerations. Telecom companies are acutely aware of the
importance of model customization to suit their unique requirements. This necessitates external
vendor platforms that not only provide access to pre-trained models, but also support various
methods for model fine-tuning, model training, and model development.
42
09 l Implications & Outlooks
Moreover, the choice of generative AI deployment heavily weighs the security and privacy concerns
of data used by generative AI models. As discussed in the previous section, 61% of CSPs noted
security as the top technical concerns when considering generative AI.
However, there are increasingly more 3rd party solutions to ease these concerns for CSPs who
are considering implementing generative AI. These external vendor platforms are seen as critical
accelerators in the telecommunications industry’s AI journey. They not only bridge the expertise
gap but also empower telecom companies to leverage the advantages of generative AI without
compromising on the customization and control they seek. AWS, for instance, is democratizing
access to this technology and providing flexible approaches to meet enterprises where they need -
whether that be providing infrastructure to build their own foundational models, leveraging pre-trained
foundational models to build their applications, or fine-tuning available models with additional data.
Amazon Bedrock allows CSPs the flexibility to work with publicly available models or build their own
foundation models based on custom silicon (Inferentia and Tranium chips), in addition to instances
built using leading chip providers, to offer price performance infrastructure. With platforms such as
Amazon Bedrock, CSPs can strike a delicate balance between expediency and precision, ensuring
they stay at the forefront of innovation in their highly competitive landscape.
Regardless, the fact remains that generative AI is already making waves in the telecommunications
industry with multiple use cases being tested and implemented in the near future. For communication
service providers who are looking to better understand the relative risk and technical complexity
when adopting certain generative AI use cases, here are tactical questions to consider:
Exhibit
Exhibit 17:17:
KeyKey Questions
Questions to Understand
to Understand Relative
Relative Risk and TechnicalRisk and Technical
Complexity of Generative Complexity
AI Use Cases of Generative AI Use Cases
Relative Tech
Question Options Relative Risk
Complexity
Common General Purpose (Knowledge search, guided
Lower Lower
What type of use case is under assistance)
considerations?
Highly domain specific & niche Higher Higher
In databases, which are available and accessible by the team Lower Lower
Where is the internal data stored that will be
used to train/build the model?
In multiple siloed databases, which are not well integrated Neutral Higher
43
09 l Implications & Outlooks
The fusion of generative AI and telecommunication isn’t just innovative; it’s imperative. Having clear
answers to use case types, deployment preferences, and data dependencies, communication service
providers can ready themselves for the transformative journey generative AI can enable. To thrive
in this dynamic landscape, companies must embrace weaving generative AI into the fabric of their
operations, and this study can arm them with the insights needed to navigate concerns.
44
10 Appendix
10 l Appendix
Glossary
46
10 l Appendix
Definitions
Business Domains
Use Cases
1. Marketing
• Content Generation (Text, Image, Video): Creating valuable, relevant, and
consistent marketing content for various channels (e.g., ads, email, social media, web
pages, etc.); includes copy generation and web page content generation.
• Search Term Generation: Generating the most optimal relevant keywords and
phrases for search engine optimization (SEO).
• Personalization: Generating tailored marketing messages and content based on
customer information (e.g., demographic, history, behavior).
Product
• Insight Generation: Generating new customer insights to inform product
enhancements and service improvements based on customer information.
• New Feature Ideation: Generating the most optimal relevant keywords and phrases
for search engine optimization (SEO).
2. Customer Service
• Customer Chatbot: Interpreting and responding to customer queries and requests in
a human-like conversational manner.
• Employee Coach: Uses data on customer interactions to provide coaching and
performance improvement guidance to customer service representatives.
• Guided Employee Assistance for Knowledge Management and Troubleshooting:
Retrieve and respond to employee queries using knowledge base of articles, FAQs,
customer case history and other documentation for issue resolution.
47
• Contact Center Documentation: Generate transcription of calls, summarize
customer interactions and suggest follow-up actions.
3. Network Planning
• Generative Route/Network Design and Network Configuration: Generate a variety
of possible network designs optimized for key parameters (e.g., topography, costs,
power, etc.).
• Network Image Generation: Generate designs such as CAD of physical aspects of a
network project scheme including but not limited to maps, blueprints, etc.
• Synthetic Data Generation for Security Testing: Artificial data that mimics real-
world data, which is then used in testing security systems and identify vulnerabilities
without needing to use real customer information.
4. Network Operations
• Guided Employee Assistance for Installation, Troubleshooting, and Maintenance:
Retrieve and respond to network service engineers with information to aid in
installation, troubleshooting, and maintenance network devices and infrastructure like
routers, switches, and firewalls.
5. IT Operations
• Guided Employee Assistance for Installation, Troubleshooting, and Maintenance:
Generate responses or summarized information when employees install, troubleshoot,
and maintain software and hardware systems within an organization, specifically
those encompassing end-user devices and applications like computers, tablets, and
CRM software.
• Employee Self-Service Desk: Generative chatbot where internal employees can
self-service IT issues
6. IT Software Development
• Automated Code Generation, Debugging, Testing: The use of automated tools to
create code, find and fix errors in code, and test code.
• Automated Code Documentation: The use of automated tools to generate
documentation for code that is similar to existing documentation often using natural
language processing or non-generative AI.
Process Terminology
• Evaluation: The process by which an organization assesses a use case for technical
performance and capabilities to decide whether to implement or not
• Implementation: The process by which an organization deploys and integrates the
use case into the day-to-day operations of the company
• Adoption: The process of the evaluation and implementation of a use case at an
organization; in this study, we define current adoption as if the organization has
fully implemented/implementing the generative AI solution while interest is if the
organization has implemented OR has a high likelihood of implementing the solution
48
Data Capabilities
• Centralized Data Management: Degree to which data is collected and stored in a
centralized manner, avoiding data siloes to ensure data is easily accessible and usage
across the organization (e.g., data lake, data warehouse, etc.)
• Data Quality and Integration: Degree to which organization has implemented tools
and practices for master data management to maintain accurate data as well as
integration capabilities to enable data flow between various systems and multiple
vector bases.
• Scalability of Data Infrastructure: Degree to which data platform is designed to
handle large volumes of structured and unstructured data.
• Data Analytics: Degree to which the organization uses advanced analytics, AI/ ML to
gain insights from data, improve business operations and drive decision making.
• Data Infrastructure Modernization: Degree to which organization data resides on
virtual private and/or public cloud (includes isolated instances, etc.)
• Data Governance: Establishment of practices for data documentation, collecting,
storing, using and deleting data AND clearly defined data ownership responsibilities.
• MLOps Practices: Degree to which practices and processes are established for
building, deploying, monitoring and maintaining machine learning models.
• In-House Technical Expertise: In-house talent and technical expertise to maintain
data infrastructure and architecture for existing systems and emerging technology
solutions (e.g., data scientists, scrum masters, etc.)
Adoption Methods
• Off-The-Shelf: Model that is pre-trained on a large dataset and available for purchase
or free use.
• Prompt Engineering: A process of manually feeding the model prompts to guide
model output; requires a small amount of data to be trained.
• Context Learning: A process of using internal data to provide prompts to pre-trained
model to enable it to understand the problem or task at hand and provide telecom
relevant responses; requires a medium amount of data to be trained.
• Fine-Tuning: A process of updating and/or adding parameters to a pre-trained model
using a new dataset; requires a large amount of data to be trained.
• Build In-house: Model that is developed and trained on a custom dataset and is
owned and operated internally.
Data Sources
• First Party Data: Data the company collects directly from customers, website visitors,
or social media followers.
• Third Party Data: Data the company obtains from external sources or organizations
that are often specialized in collecting and aggregating data from diverse sources.
49
10 l Appendix
End Notes
1. Kusterer Ziser, Kelsey, “Verizon’s Debika Bhattacharya on the endless possibilities for generative
AI,” Light Reading, May 22, 2023
2. Morris, Iain, “Google and Microsoft loom large in Vodafone’s gen AI plans,” Light Reading, August
4, 2023.
3. Park, Kate, “AI Startup Anthropic raises $100M from Korean telco giant SK Telecom,” TechCrunch,
August 14, 2023
4. Bilan, Maryna, “Improving CX with Generative AI Chatbot in Telecom: Success Stories and
Potential Use Cases,” Master of Code, September 22, 2023.
5. “Guide: Generative AI,” Dealroom.co, 2023
6. Dave, Paresh, “ChatGPT Is Cutting Non-English Languages Out of the AI Revolution,” Wired, May
31, 2023
7. Sivasubramanian, Swami, “Announcing New Tools for Building with Generative AI on AWS,” AWS
Amazon, April 13, 2023
8. “AI, Sport, and Cyberdefense: Orange at Viva Technology 2023,” Orange Press Release, June 13,
2023
9. “SKT Introduces New AI Service ‘A’”, SK Telecom Press Release, May 16, 2022
10. https://aws.amazon.com/bedrock/
50
10 l Appendix
Altman Solon is the largest global strategy consulting firm exclusively working in the
Telecommunications, Media, and Technology industries. With thirteen offices across the Americas,
Europe, and Asia Pacific, our team of consultants possess a diverse range of expertise in strategy,
commercial, operational, technical, and capital markets. We work with market leaders, challenger
brands, and investors worldwide to help them identify, develop, and implement effective company
strategies, new market entry approaches, digital transformation, and global M&A. We also provide
comprehensive market understanding to conduct due diligence and enable high-stakes, confident
decision making for investors.
Altman Solon combines this new Survey with proprietary insights from its recent study, Putting
Generative AI to Work, from Spring 2023, which analyzed emerging enterprise use cases by
examining generative AI companies and capabilities. Our team surveyed 292 senior business leaders
and spoke to 21 industry experts to understand the adoption of generative AI tools for specific high-
impact enterprise use cases. The surveyed decision-makers’ roles covered a range of strategic and
technical functions, and the findings highlight adoption and adoption reasons for generative AI. All
survey respondents were from the United States of varying business sizes. Altman Solon focused on
four areas with strong momentum: software development, marketing, customer service, and product
design, and found the highest adoption in software development and marketing and emerging
adoption in customer service and product design.
51
10 l Appendix
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud, offering
over 200 fully featured services from data centers globally. Millions of customers are using AWS to
lower costs, become more agile, and innovate faster.
AWS for Telecom is raising the bar on what’s possible for CSPs. Harnessing the robust, mature, proven,
and smart platform, to deliver innovative use cases that are digitizing industries, transforming telcos,
and reimagining the consumer experience. With the power of the AWS Global Cloud Infrastructure,
that’s architected to be flexible and secure, AWS for Telecom help CSPs take their business to the next
level. Through simplifying operations, cloudifying networks, monetizing assets, and innovating at scale
using AIML and generative AI services.
52
10 l Appendix
Acknowledgements
The research underpinning this report was led by Swope Fleming, Partner – Boston; Priya Mehra,
Director – New York; and Elisabeth Sum, Senior Consultant – San Francisco. The Altman Solon project
team also included Danny Malloy, Analyst - New York.
We are grateful to the following AWS advisers who provided their knowledge and added new insights:
Ishwar Parulkar – AWS Telecom CTO; Ross McWalter – Head of AWS Telecom Business Applications;
Dafna Yanay – Head of Telecom Marketing; Allison Bishop – Telecom PR Lead; and Jeff Dillon –
Telecom AR Lead.
This research benefited immensely from the expertise and perspective of many Altman Solon
colleagues, including:
We also thank our Altman Solon marketing and communications colleagues: Kate Fagan, Madeline
Taylor, and Sebastian Denkiewicz.
53