Available online at www.sciencedirect.

com

ScienceDirect
Procedia CIRP 119 (2023) 21–28

33rd CIRP Design Conference

Opportunities and challenges of ChatGPT for design knowledge

management
Xin Hua,*,Yu Tiana, Keisuke Nagatob, Masayuki Nakaob, Ang Liua
a
The University of New South Wales, Kensington, NSW, Australia, 2052
b
The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, Japan, 113-8656

* Corresponding author. Tel.: +61-(0)-424573180. E-mail address: xin.hu4@unsw.edu.au

Abstract

Recent advancements in Natural Language Processing have opened up new possibilities for the development of large language
models like ChatGPT, which can facilitate knowledge management in the design process by providing designers with access to a
vast array of relevant information. However, integrating ChatGPT into the design process also presents new challenges. In this
paper, we provide a concise review of the classification and representation of design knowledge, and past efforts to support
designers in acquiring knowledge. We analyze the opportunities and challenges that ChatGPT presents for knowledge management
in design and propose promising future research directions. A case study is conducted to validate the advantages and drawbacks of
ChatGPT, showing that designers can acquire targeted knowledge from various domains, but the quality of the acquired knowledge
is highly dependent on the prompt.
© 2023 The Authors. Published by Elsevier B.V.
This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0)
Peer review under the responsibility of the scientific committee of the 33rd CIRP Design Conference
Keywords: Engineering design; Knowledge management; ChatGPT; Responsible AI

1. Introduction algorithm [4], and knowledge acquisition and learning function

of the network organization [5]. Despite the advancements in
Engineering design is a knowledge-intensive process, and design knowledge management, there is still a need for more
acquiring design knowledge is its kernel [1]. The process of efficient and effective methods for acquiring and utilizing
creating new desirable artifacts involves defining a problem, design knowledge.
proposing a solution, and coevolving between the problem and Recent advancements in Natural Language Processing have
the solution, which requires a broad range of knowledge and an opened new possibilities for design knowledge acquisition.
effective knowledge share between teams consisting of With the increasing availability of large language models such
different managers, engineers, and designers [2]. The ability to as ChatGPT, the potential for using AI to facilitate design
efficiently acquire, store, and utilize design knowledge is knowledge acquisition has become a promising area of research.
crucial for improving the quality of design outcomes and ChatGPT is a transformer-based language model developed by
reducing the time required for the design process. This has led OpenAI that has been trained on a massive corpus of text data.
to a significant amount of research in the field of design This model can generate text in a wide range of styles and
knowledge management, aimed at developing effective formats, making it a potentially valuable tool for design
methods for acquiring and utilizing design knowledge to knowledge acquisition. The use of ChatGPT in design
support decision-making, such as knowledge acquisition based knowledge acquisition is still in its early stages and has yet to
on knowledge graph [3] and a multi-objective evolution be fully explored. There are several potential benefits of using

2212-8271 © 2023 The Authors. Published by Elsevier B.V.

This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0)
Peer review under the responsibility of the scientific committee of the 33rd CIRP Design Conference
10.1016/j.procir.2023.05.001
22 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28

ChatGPT in this context, including the potential to provide 2.2.1. Classification of knowledge
more accurate and comprehensive information, and the ability Domain-specific, common-sense, and cross-domain
to integrate generated knowledge into the design process more engineering and technical knowledge are the main types of
easily. However, there are also several challenges associated knowledge employed in design studies [7], as shown in Fig.1.
with the use of ChatGPT in design knowledge acquisition, such
as the difficulty of controlling the quality and accuracy of the
information, the potential to be biased, and the challenge of
ensuring that the information is relevant and useful for the
specific design task at hand. The purpose of this paper is to
explore the opportunities and challenges of ChatGPT for design
knowledge acquisition.
This paper is organized as follows: In section 2, an overview
of existing research on design knowledge acquisition is
detailed. Section 3 outlines the opportunities, challenges, and
research opportunities that are brought to design knowledge
acquisition by ChatGPT, and illustrates a case, followed by the
conclusion and future work in Section 4.

2. Literature review Fig. 1. Scope and depth of three types of knowledge.

2.1. ChatGPT Design knowledge consists of different domain-specific

knowledge that is specific to a particular domain or subject area,
such as knowledge related to a particular industry or field.
ChatGPT is an advanced language model that utilizes
Common-sense knowledge that all humans have, such as
transformer-based neural network architecture to understand
‘traditional cars are powered by engines that work differently
complex language structures and generate contextually
than the electric motors used in electric cars’, contains cross-
relevant and coherent responses. Compared to its predecessors, domain general knowledge, but is limited to the depth of the
such as GPT-3 and InstructGPT, ChatGPT first stands out for knowledge. it is useful in solving general problems and making
its exceptional conversational capability and ability to interact decisions in the engineering design process. Engineering and
seamlessly with users. Besides, ChatGPT is trained by a diverse technical knowledge is applicable across a range of domains,
range of text data from various sources. It can provide such as physics, chemistry, material, etc., and is generally
engineers with access to a wealth of information and insights. considered more fundamental in nature.
Thirdly, Reinforcement Learning from Human Feedback
(RLHF) is adopted in ChatGPT, outputting the more desirable 2.2.2. Classification of knowledge representation
results. Through RLHF, the model can learn and improve from One of the key roles of knowledge representation is making
feedback provided by users, leading to the production of more knowledge explicit. There are five categories of knowledge
desirable design solutions. representation in the context of engineering design: pictorial,
symbolic, linguistic, virtual, and algorithmic. Table 1 shows
2.2. Knowledge in engineering design some of the various representation forms for engineering
design [8]. According to the study by Pahl and Beitz [9],
Engineering design refers to the iterative process of linguistic forms of knowledge occur in all stages of engineering
developing solutions to problems by drawing insights from design, and are predominantly in the early stages, while the

Table 1. Classification of knowledge representations in engineering design

Pictorial Symbolic Linguistic Virtual Algorithmic
Sketches, Detailed Decision tables, Production Customer Requirements, CAD models, CAE Mathematical Equations,
drawings, Photographs, rules, Flow charts, FMEA Design Rules, Customer simulations, VR simulations, Parametrizations, Constraint
CAD model diagram, Assembly tree, feedback, Verbal Virtual prototypes, solvers, Computer Algorithms,
Fishbone diagrams, Ontologies communication Animations, Multimedia Design/ operational procedures

both natural and engineering sciences while considering the other representation appears in the latter stage. Utilizing a
specific conditions and constraints of the given task. From the linguistic representation of knowledge has several advantages
knowledge perspective, it is argued that engineering design is in this regard. One advantage of linguistic knowledge
the instrument of exploration, description, arrangement, representation is that it allows for clear and concise
rationalization, and utilization of design knowledge [6]. Hence, communication of knowledge [10]. This not only facilitates the
simply put, knowledge in engineering design is explored, transfer of knowledge between design team members but also
understood, and used to find solutions for certain problems. allows for easy access and retrieval of information for future
Exploring knowledge effectively requires properly classifying design projects. Furthermore, linguistic representations are
and representing knowledge, which enhances understanding often more accessible and understandable to a wider range of
and utilization of the knowledge during the design process. individuals, which can facilitate knowledge share and
 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28 23

collaboration across different departments an,d industries [11]. design process. Balancing the breadth and depth of knowledge
Also, there is a large collection of information accumulated is difficult, which necessitates the use of different knowledge
by the end of the design process that could be beneficial for providers for acquiring knowledge, leading to inefficiencies for
future designs if it was made available to the designer at an the designer. In addition, it requires the seeker to have a clear
earlier stage [12]. By effectively capturing and organizing understanding of the question being asked. Particularly for
design knowledge in a linguistic format, the design process can novice designers, may make it challenging for them to clearly
be streamlined, and designers can benefit from the experiences articulate the problem they are trying to solve, leading to a lack
and insights gained from previous projects. It is therefore of effective and useful knowledge. Moreover, there is a lack of
essential to equip all relevant stakeholders throughout the sufficient interaction between the seeker and the provider the
process of design with an integrated tool that provides designer is a passive information receiver. It is limited to a
linguistic knowledge.
question-and-answer format without supporting context, which
is sequential in nature. As a result, the knowledge provider
2.3. Design knowledge acquisition
caters to only one knowledge seeker at an inquiry round. This
poses a challenge in supporting team collaboration during the
Design knowledge acquisition involves the interaction
design process as it restricts the capability to attend to multiple
between two the knowledge provider and the knowledge seeker
knowledge seekers simultaneously.
in certain problem domains, as represented in Fig.2. In recent
years, the knowledge provider is characterized by digital
3. Proposition: opportunities, challenges, and future
knowledge bases that are in the forms of semantic networks [7].
research directions
Semantic networks are graphical representations of knowledge
that depict relationships between concepts, and the
3.1. Opportunities for design knowledge acquisition
relationships between concepts and instances, which function
as knowledge retrieval, association, and reasoning. The nodes
Engineering design is a highly involved, often ill-defined,
in a semantic network represent concepts, while the edges
complicated, and iterative problem-solving process, requiring
represent relationships between the concepts. These networks
access to a vast and diverse array of knowledge. Design
can be used for acquiring domain-specific, common-sense, and
problems are characterized by the term “wicked problems” that
engineering and technical knowledge, such as WordNet,
have a large problem space and no fixed problem-solving
ConceptNet, B-Link, and TechNet, which contributes to idea
sequences [19]. By leveraging design knowledge, engineers
generation, conceptual design, and design representation in real
can better explore the problem space, identify potential
applications [13-15].
solutions, and make informed decisions about how to proceed
with the design process. The integration of ChatGPT in design
knowledge acquisition provides several opportunities to
support the design process from the perspectives of the
knowledge provider, the knowledge seeker, and their
interaction, as depicted in Fig.3. In the following text, these
opportunities will be detailed.

Fig.2. Design knowledge acquisition process.

For the interaction, several methods have been developed to

understand the semantic information from the knowledge
seeker and accurately match the required knowledge. These
methods include TBSL [16], semantic parsing [17], and deep
learning-based approaches [18]. These methods aim to improve
the accuracy of knowledge acquisition and retrieval by
analyzing the context of questions and identifying relevant
knowledge sources. Moreover, a multi-objective evolutionary
algorithm is proposed by Saracoglu [4], which is designed to
find multiple solutions to a problem, rather than just a single
solution. This approach helps to ensure that the knowledge
acquired is the best possible and meets the needs of the
designers.
However, the use of semantic networks and interacting
methods for knowledge acquisition in the design process
presents several challenges. One challenge is the requirement
Fig.3. ChatGPT-centered design knowledge acquisition.
for different knowledge providers at different stages of the
24 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28

3.1.1. Points of an integrated knowledge provider effectively steers them toward increasingly optimal and precise
ChatGPT provides a novel opportunity for design solutions.
knowledge acquisition through its ability to offer a general,
common, and integrated platform for knowledge retrieval. In 3.1.3. Points of knowledge seekers
such a single and centralized platform, designers can acquire In the context of design, concurrent engineering often
sufficient knowledge that pertains to common sense knowledge, involves multiple stakeholders from various domains and at
various domain-specific knowledge, as well as engineering and different stages of the design process. Collaboration is
technique knowledge, which support design decisions therefore essential for the successful development of a design
throughout the design process. Consequently, it is potential for solution. ChatGPT has the potential to support concurrent
designers to alter knowledge providers less when defining and engineering by serving as a shared knowledge platform that
solving problems derived from diverse stages of the design enables team members to acquire knowledge and collaborate
process. The reduction in the need for designers to frequently effectively. This multi-object interactive process encourages
switch between different knowledge provides help streamline collaboration and knowledge exchange among team members,
the design process and improve workflow efficiency. In enabling them to holistically view problems. Specifically,
addition, such an integrated knowledge tool can facilitate better relevant stakeholders can ask questions, seek clarification, and
collaboration and communication among designers by explore problem space from their different disciplines. For
allowing them to work on the same platform and share example, a mechanical engineer may ask ChatGPT for
knowledge easily. This can improve team productivity and information about the design of a robotic arm, while an
reduce the risk of errors or miscommunications. electrical engineer may ask about electrical systems. It can
It is also important to understand that the design process is provide relevant information to both designers in real-time,
not a linear, step-by-step process and that there is no fixed allowing them to proceed with their work in parallel and
structure or sequence that designers must follow [12]. However, coordinate their efforts.
past design knowledge providers were more rigid and forced Furthermore, ChatGPT also has the potential to facilitate
designers to use specific tools and follow certain procedures at expansive learning, which involves acquiring new knowledge
different design processes, which impedes the ideation process and skills through the process of engaging in new and
and the creativity of designers. With its comprehensive challenging activities [20]. By enabling team members to
integration that brings flexibility to designers, ChatGPT is acquire and transfer knowledge effectively, team members can
exactly the knowledge provider to aid the designer rather than develop a shared understanding of the design problem, identify
dictate the design process. knowledge gaps, and co-create new knowledge that can
enhance the quality and effectiveness of the design solution.
3.1.2. Points of situated interaction
The traditional methods of knowledge acquisition in the 3.2. Challenges for design knowledge acquisition
field of design follow a linear and discrete inquiry to acquire
knowledge. This approach is effective for conveying single ChatGPT, a highly prevalent language model, is widely
basic information but can be limited when it comes to more utilized by users globally owing to its cost-free access,
complex design problems. ChatGPT offers an alternative multilingual question-answering abilities, and continual
approach to knowledge acquisition in design that is more learning capability. Nonetheless, being an AI system, it
dynamic and interactive. Rather than following a linear and confronts the obstacle of enhancing its responsibility during
discrete inquiry process, it enables designers to engage in human-computer interaction. Responsible AI encompasses the
situated interactions that are tailored to their specific design capacity of AI to furnish human-oriented courses of action
problem by understanding the semantic and contextual from an ethical and legally compliant standpoint [21]. In this
information of the designer’s inquiry. Through a back-and- section, we outline four prevalent challenges faced by
force conversational interaction with ChatGPT, designers can ChatGPT in its pursuit of becoming a more responsible AI.
continually ask questions and receive answers in real-time,
enabling them to explore different aspects of a design problem 3.2.1. Bias
The prevalence of bias in language-based models during
and to seek clarification and additional information as needed.
training is a well-documented issue, and ChatGPT, as a
In the context of design, iterative and continual knowledge
reinforced machine learning system, is susceptible to being
acquisition is particularly beneficial for an ill-defined problem
influenced by the training data without conscious awareness,
and an optimal solution, requiring consideration of multiple potentially inheriting biases present in the dataset [22]. As a
perspectives. The ability of ChatGPT to support iterative multilingual human-computer interaction platform, ChatGPT
knowledge acquisition enables designers to continually refine must provide fluent and natural responses to users in various
their understanding of a design problem as they work through countries with diverse semantic cultures. However, users have
the design process. As such, it helps identify constraints and reported perceiving ChatGPT as exhibiting bias and unfairness.
objectives, enabling focused exploration of innovative Zhuo's [23] 2023 survey conducted an extensive analysis of
solutions that cater to specific needs. Furthermore, designers 305,701 tweets associated with ChatGPT, highlighting
can engage with ChatGPT as an intelligent design assistant, significant issues concerning stereotypes, misunderstandings
empowering them to iteratively navigate various solution across diverse cultural contexts, and unfair discrimination.
spaces and assimilate diverse perspectives. This process In this study, we provide an illustrative example of the bias
present in language-based models. Specifically, we present a
 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28 25

conversation with ChatGPT, as shown in Table 2, in which the As observed in the case of ChatGPT, users have reported
user inquires about the reasons why Chinese and American instances of common-sense errors and fabricated information
families prefer to use a floor sweeper. Interestingly, the that can have unpredictable and even harmful consequences.
responses generated by ChatGPT demonstrate clear bias and For users who cannot discern credible information from
unfair discrimination against the countries in question. For untrustworthy information, these errors can be especially
instance, when asked about the reasons why American misleading. As evidenced in Table 3, ChatGPT can produce
households prefer to use a floor cleaning robot, ChatGPT cites inaccurate and falsified output, as seen in the mismatch
the convenience and time-saving benefits associated with this between paper titles, authors, and publication dates. This can
cleaning tool. However, in the case of Chinese households, lead to a proliferation of incorrect content and undermine the
ChatGPT emphasizes that the use of a floor cleaning robot is a rigor of academic work if the user relies solely on ChatGPT for
answers. Therefore, it is crucial to ensure the quality and
luxury item that enhances social status, rather than highlighting
accuracy of the training set used to develop natural language
the practical advantages of this cleaning tool. Notably, these
models and to ensure that the models do not fabricate answers
two questions are identical, with the sole difference being the
when unable to provide accurate responses, which can cause
countries referenced. These two questions are the same, only unnecessary confusion and misunderstanding.
the countries are different, yet ChatGPT gives a biased answer
based on unfair discrimination against the countries. Table 3. Recommended information for the article on errors.
Information was Correct/Existing Correct
Table 2. Different answers to identical questions in different country settings.
given by ChatGPT Information
Character Context Biased
Title "Finite element ✓
User Why do Chinese families like to use floor analysis of stresses in
cleaning robots? beam structures"
ChatGPT The popularity of floor cleaning robots among ✓ Author G. R. Liu and S. S.  Conrad Arnan
Chinese families may be attributed to their Quek Ribas
convenience and time-saving benefits, alignment
Published 2002  2010
with cultural values concerning cleanliness and
hygiene, and their status as a technological luxury Title “A review of additive ✓
item. The use of floor cleaning robots may also be manufacturing”
perceived as a symbol of social status and Author J. M. Pearce  K. V. Wong &
modernity. A. Hernandez
User Why do American families like to use floor Published 2014  2012
cleaning robots?
ChatGPT The convenience, timesaving, efficiency, and 
health benefits of floor cleaning robots may make 3.2.3. Low Transparency
them an attractive option for American families Enhancing the transparency of AI is crucial to responsible
looking to keep their homes clean and tidy. development. As AI continues to advance, there is a growing
consensus within the community to increase transparency in AI
ChatGPT is an increasingly popular conversational AI that decision-making systems [25]. Transparency refers to the
claims its multi-lingual capability and sustainable learning. ability of users to understand the basis and sources of
Despite these advancements, the issue of bias looms over the ChatGPT's answers to questions, allowing them to verify the
platform, impacting user judgement and outputting potentially accuracy of the information provided. Despite the benefits of
biased information that can exacerbate discrimination based on ChatGPT's ability to swiftly respond to a wide range of
factors such as race, gender, age, and culture. To mitigate this inquiries across various domains, its transparency is relatively
problem, models must be trained on a large number of high- low. There are concerns that ChatGPT may use users'
quality, impartial, and multilingual corpora, and criteria for information to train the model, thereby jeopardizing the privacy
screening and identifying bias must be developed to minimize and compromising the accuracy and transparency of the data.
its production. Further research is necessary to advance these The near-exclusive control of large technology corporations,
efforts and promote greater fairness and inclusivity in natural such as Microsoft, over conversational AI technology, has
language processing models. resulted in a lack of transparency regarding the retrieval, access,
and processing of textual information that underlies these
systems. The opaque nature of these internal workings creates
3.2.2. Unreliable Data
barriers to understanding and limits the ability of outside
The reliability of natural language models is a crucial aspect
researchers to assess the reliability and validity of these
of their research and development [24]. The reliability of these
systems. To address this challenge, the promotion and support
models directly impacts the accuracy of the output content,
of open-source AI development present a potential solution to
ultimately affecting the acceptance and impact of the product.
increase transparency and promote responsible AI
In the presence of false and outdated information that is biased
development [26]. By enabling researchers to have greater
in a particular direction, the generated output information can
access to AI technology and its internal workings, open-source
be incorrect, thereby reducing the reliability of the AI and
development can help to foster a more transparent and open
undermining the trust of the users.
ecosystem for the development of AI technologies.
In the context of the growing use of natural language models
such as ChatGPT, ensuring the accuracy and reliability of the
output generated by these models is of paramount importance. 3.2.4. Explainability
The proliferation of AI has seen its increasing usage in
26 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28

various fields of study. Nonetheless, AI is sometimes viewed generate misinformation for specific requirement parameters,
as an opaque ‘black box’ by both users and developers, thereby such as "150W" and "1.5 liters," which may vary across
presenting difficulties in recognizing the internal workings of different standards.
AI [27]. Consequently, over-reliance on the output from AI
may arise, leading to uncertainty in determining the correctness
of the output. To address this issue, users and developers must
improve the explainability of ChatGPT models by mitigating
the opaque dependencies between input and output generated
during the learning process [28]. By placing the user at the
center of the process and enhancing the explainability of
ChatGPT models, it is possible to create a suitable level of
understanding and trust in the user, thereby unveiling the AI
decision-making process 'black box' and meeting the user's
needs [29]. Moreover, improving explainability leads to
increased transparency, as users can more easily understand the
AI decision-making process [30]. As such, ensuring
explainability and transparency in AI development is
paramount, and should be prioritized by researchers and
developers.

3.3. Case study

This section outlines the utilization of ChatGPT to support

the problem definition of the design practice: Vacuum cleaner.
Problem definition is one of the most critical steps in design,
including the definition of customer needs, functional
requirements, design constraints, and problem context [31].To
facilitate this stage, two questions related to distinct problem
domains are posed, as described in Fig.4.

Fig.5. Deeper inquiry with prompts in one specific domain.

3.4. Future research opportunities

Inspired by the opportunities and challenges mentioned

earlier, this part will propose potential research opportunities
from the perspective of the knowledge provider, the knowledge
seeker, and the interaction, as depicted in Fig.6.

Fig.4. Enquiry from different domains.

The two questions posed to ChatGPT illustrate its capability

to understand the semantic and contextual information required
for designers' inquiries. Despite "vacuum cleaner" not being
mentioned in the second question, ChatGPT generates relevant
responses, albeit being overly general and insufficient for
supporting problem definitions. Therefore, a deeper inquiry
into the definition of functional requirements is necessary, as
illustrated in Fig.5. With appropriate prompts, ChatGPT
generates correct representations of functional requirements,
Fig.6. Future research opportunities.
indicating its ability to generate deeper domain-specific
knowledge. However, it should be noted that ChatGPT may
 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28 27

3.4.1. Points of the knowledge provider This involves conducting empirical studies to evaluate the
Research direction 1: Neuro-editing for design knowledge performance of designers who use ChatGPT-based design tools
acquisition will lead to more accurate outputs. Neuro-editing versus those who do not and assessing the impact of ChatGPT
refers to the process of manipulating the neural representations on various design outcomes, such as creativity, usability, and
of a language model to enhance or suppress certain features, quality. By analyzing the strengths and limitations of ChatGPT
such as bias or toxicity. By applying neuro-editing techniques for different types of designers, researchers could better
to ChatGPT-based design tools, researchers could potentially understand how to optimize its use and tailor its features to
mitigate some of the ethical concerns associated with AI- different design contexts.
generated design, such as the potential for bias or Research direction 7: There is a need to investigate the
discrimination. By addressing these ethical concerns, impact of ChatGPT on designers' learning and skill
researchers could help promote the responsible use of ChatGPT development. ChatGPT can potentially support designers in
in design and other domains. acquiring and applying design knowledge in new ways, which
Research direction 2: Investigating the potential ethical may enhance their learning and skill dev4. elopment over time.
and social implications of using ChatGPT will contribute to Researchers can explore how designers use ChatGPT for
more responsible AI. As with any AI technology, there are learning and skill development and evaluate the effectiveness
concerns about the potential biases, errors, and unintended of different learning strategies and feedback mechanisms.
consequences of using ChatGPT in design. Researchers can
explore ways to address these issues, such as developing 4. Conclusion, limitations, and future work
transparency and accountability mechanisms for ChatGPT,
ensuring diversity and inclusiveness in the training data, and This paper provides an analysis of ChatGPT's opportunities,
engaging with stakeholders to understand their perspectives challenges, and future research directions in design knowledge
and needs. management, as well as a case study validating its potential
Research direction 3: It is necessary to develop hybrid benefits and issues. The study identifies opportunities for
approaches that combine with other knowledge-based systems. knowledge providers, seekers, and their interaction, including
ChatGPT is a powerful language model that can generate the provision of a comprehensive knowledge base, iterative
responses to a wide range of queries, but it is not the only linguistic interactions, and facilitating expansive learning and
source of design knowledge. There are other knowledge knowledge transfer among designers. However, the use of
providers, such as knowledge graph, that can complement ChatGPT for design knowledge management presents
ChatGPT in providing a more comprehensive and context- challenges, particularly in the context of responsible AI,
sensitive design knowledge base. This can involve integrating including potential biases, reliability concerns, and the lack of
ChatGPT with existing knowledge graphs or developing new transparency in outputs. The paper proposes several research
knowledge graphs that incorporate ChatGPT-generated opportunities, including integration with other knowledge-
knowledge. based systems, exploring ethical and social implications,
investigating effectiveness for novice designers and experts,
3.4.2. Points of interaction and analyzing individual and collaborative interaction patterns.
Research direction 4: Researching interaction patterns for Afterward, the case study showcases the vast information and
design knowledge acquisition will lead to more effective contextual awareness that ChatGPT can offer, while
knowledge acquisition. This involves examining how designers highlighting the crucial role of suitable prompts and
can best interact with ChatGPT to elicit design knowledge from verification in ensuring the accuracy and relevance of
the system. For instance, researchers could explore the use of generated information.
different prompts, or interactive feedback mechanisms to In terms of the limitations, this work focuses mainly on the
enhance the usability and usefulness of ChatGPT-based design core aspect of knowledge management, which is the acquisition
tools. By discovering effective interaction patterns, researchers of knowledge for designers. However, there are other areas of
could help designers maximize the value of ChatGPT and research in design knowledge management that this paper does
streamline the design process. not cover, such as knowledge storage, dissemination, and
Research direction 5: Exploring the potential of ChatGPT utilization. Moreover, this paper primarily focuses on the
for collaborative design is important in the layer of teams. individual and design team layers of knowledge management
Design is often a collaborative process that involves multiple and does not involve the organizational layer.
stakeholders with different perspectives and expertise. Future work will investigate the potential of integrating
ChatGPT has the potential to facilitate collaboration by ChatGPT with knowledge graph to support engineer design
providing a common platform for sharing and acquiring design processes and analyze interaction patterns to evaluate the
knowledge. Future research can explore the potential of effectiveness of ChatGPT in supporting design knowledge
ChatGPT for collaborative design and investigate how to acquisition. This investigation will identify the advantages and
optimize the interaction between ChatGPT and multiple limitations of each interaction pattern and the scenarios where
designers. they are most effective.

3.4.3. Points of the knowledge seeker Acknowledgements

Research direction 6: Analyzing the effectiveness of
ChatGPT for novice designers and experts is also significant. Some of the authors are grateful for the financial support
28 Xin Hu et al. / Procedia CIRP 119 (2023) 21–28

of JSPS Invitational Fellowship for Research in Japan under [19] R. Buchanan, "Wicked problems in design thinking," Design issues, vol.
the Fellowship ID L22501 8, no. 2, pp. 5-21, 1992.
[20] V. Tessier, "Expansive learning for collaborative design," Design Studies,
vol. 83, p. 101135, 2022.
[21] V. Dignum, Responsible artificial intelligence: how to develop and use AI
References in a responsible way. Springer, 2019.
[22] A. Domnich and G. Anbarjafari, "Responsible AI: Gender bias assessment
[1] D. Zhong, J. Fan, G. Yang, B. Tian, and Y. Zhang, "Knowledge in emotion recognition," arXiv preprint arXiv:2103.11436, 2021.
management of product design: A requirements-oriented knowledge [23] T. Y. Zhuo, Y. Huang, C. Chen, and Z. Xing, "Exploring AI Ethics of
management framework based on Kansei engineering and knowledge ChatGPT: A Diagnostic Analysis," arXiv preprint arXiv:2301.12867, 2023.
map," Advanced Engineering Informatics, vol. 52, p. 101541, 2022. [24] J. Jang et al., "Towards continual knowledge learning of language
[2] A. Liu and S. Lu, "Functional design framework for innovative design models," arXiv preprint arXiv:2110.03215, 2021.
thinking in product development," CIRP Journal of Manufacturing Science [25] H. Felzmann, E. Fosch-Villaronga, C. Lutz, and A. Tamò-Larrieux,
and Technology, vol. 30, pp. 105-117, 2020/08/01/ 2020, doi: "Towards transparency by design for artificial intelligence," Science and
https://doi.org/10.1016/j.cirpj.2020.04.008. Engineering Ethics, vol. 26, no. 6, pp. 3333-3361, 2020.
[3] S. Ji, S. Pan, E. Cambria, P. Marttinen, and S. Y. Philip, "A survey on [26] E. A. van Dis, J. Bollen, W. Zuidema, R. van Rooij, and C. L. Bockting,
knowledge graphs: Representation, acquisition, and applications," IEEE "ChatGPT: five priorities for research," Nature, vol. 614, no. 7947, pp. 224-
Trans. Neural Netw. Learn. Syst., vol. 33, no. 2, pp. 494-514, 2021. 226, 2023.
[4] B. O. Saracoglu and M. De Simón Martín, "Initialization of a multi- [27] C. Meske, E. Bunde, J. Schneider, and M. Gersch, "Explainable artificial
objective evolutionary algorithms knowledge acquisition system for intelligence: objectives, stakeholders, and future research opportunities,"
renewable energy power plants," Journal of applied research on industrial Information Systems Management, vol. 39, no. 1, pp. 53-63, 2022.
engineering, vol. 5, no. 3, pp. 185-204, 2018. [28] D. Cliff, D. Brown, and P. Treleaven, "Technology trends in the financial
[5] C. Qi and P. Y. K. Chau, "Will enterprise social networking systems markets: A 2020 vision," 2011.
promote knowledge management and organizational learning? An [29] M. Förster, M. Klier, K. Kluge, and I. Sigler, "Fostering human agency:
empirical study," Journal of Organizational Computing and Electronic A process for the design of user-centric XAI systems," 2020.
Commerce, vol. 28, no. 1, pp. 31-57, 2018. [30] A. Adadi and M. Berrada, "Peeking Inside the Black-Box: A Survey on
[6] S. Pugh, "Engineering design—unscrambling the research issues," Journal Explainable Artificial Intelligence (XAI)," (in English), IEEE Access,
of Engineering Design, vol. 1, no. 1, pp. 65-72, 1990. Article vol. 6, pp. 52138-52160, 2018, doi: 10.1109/access.2018.2870052.
[7] J. Han, S. Sarica, F. Shi, and J. Luo, "Semantic networks for engineering [31] A. Liu, "Problem Definition," in Design Engineering and Science, N. P.
design: state of the art and future directions," Journal of Mechanical Design, Suh, M. Cavique, and J. T. Foley Eds. Cham: Springer International
vol. 144, no. 2, 2022. Publishing, 2021, pp. 167-189
[8] R. Owen and I. Horváth, "Towards product-related knowledge asset
warehousing in enterprises," in Proceedings of the 4th international
symposium on tools and methods of competitive engineering, TMCE, 2002,
vol. 2002: Citeseer, pp. 155-70.
[9] R. Arboretti, R. Ceccato, L. Pegoraro, and L. Salmaso, "Design of
Experiments and machine learning for product innovation: A systematic
literature review," Quality and Reliability Engineering International,
Review vol. 38, no. 2, pp. 1131-1156, 2022, doi: 10.1002/qre.3025.
[10] R. Davis, H. Shrobe, and P. Szolovits, "What is a knowledge
representation?," AI Mag., vol. 14, no. 1, pp. 17-17, 1993.
[11] R. Canestrino, P. Magliocca, and Y. Li, "The Impact of Language
Diversity on Knowledge Sharing Within International University Research
Teams: Evidence From TED Project," Frontiers in Psychology, vol. 13,
2022.
[12] S. K. Chandrasegaran et al., "The evolution, challenges, and future of
knowledge representation in product design systems," Computer-aided
design, vol. 45, no. 2, pp. 204-228, 2013.
[13] L. Chen et al., "An artificial intelligence based data-driven approach for
design ideation," Journal of Visual Communication and Image
Representation, vol. 61, pp. 10-22, 2019.
[14] S. Acharya and A. Chakrabarti, "A conceptual tool for environmentally
benign design: development and evaluation of a “proof of concept”," AI
EDAM, vol. 34, no. 1, pp. 30-44, 2020.
[15] J. Luo, B. Song, L. Blessing, and K. Wood, "Design opportunity
conception using the total technology space map," Ai Edam, vol. 32, no. 4,
pp. 449-461, 2018.
[16] A. Abujabal, M. Yahya, M. Riedewald, and G. Weikum, "Automated
template generation for question answering over knowledge graphs," in
Proceedings of the 26th international conference on world wide web, 2017,
pp. 1191-1200.
[17] S. W.-t. Yih, M.-W. Chang, X. He, and J. Gao, "Semantic parsing via
staged query graph generation: Question answering with knowledge base,"
in Proceedings of the Joint Conference of the 53rd Annual Meeting of the
ACL and the 7th International Joint Conference on Natural Language
Processing of the AFNLP, 2015.
[18] Y. Hao et al., "An end-to-end model for question answering over
knowledge base with cross-attention combining global knowledge," in
Proceedings of the 55th Annual Meeting of the Association for
Computational Linguistics (Volume 1: Long Papers), 2017, pp. 221-231.