Complejidad Ciencias Educación
Complejidad Ciencias Educación
Complejidad Ciencias Educación
sciences
Commentary
Applications of Network Science to Education
Research: Quantifying Knowledge and the
Development of Expertise through Network Analysis
Cynthia S. Q. Siew
Department of Psychology, National University of Singapore, Singapore 117570, Singapore; cynthia@nus.edu.sg
Received: 31 January 2020; Accepted: 3 April 2020; Published: 8 April 2020
Abstract: A fundamental goal of education is to inspire and instill deep, meaningful, and long-lasting
conceptual change within the knowledge landscapes of students. This commentary posits that the
tools of network science could be useful in helping educators achieve this goal in two ways. First,
methods from cognitive psychology and network science could be helpful in quantifying and analyzing
the structure of students’ knowledge of a given discipline as a knowledge network of interconnected
concepts. Second, network science methods could be relevant for investigating the developmental
trajectories of knowledge structures by quantifying structural change in knowledge networks,
and potentially inform instructional design in order to optimize the acquisition of meaningful
knowledge as the student progresses from being a novice to an expert in the subject. This commentary
provides a brief introduction to common network science measures and suggests how they might
be relevant for shedding light on the cognitive processes that underlie learning and retrieval,
and discusses ways in which generative network growth models could inform pedagogical strategies
to enable meaningful long-term conceptual change and knowledge development among students.
1. Introduction
Cognitive scientists have had a long-standing interest in quantifying cognitive structures and
representations [1,2]. The empirical evidence from cognitive psychology and psycholinguistics
demonstrates that the structure of cognitive systems influences the psychological processes that
operate within them. Classic studies in cognitive psychology demonstrated that experts are able
to uncover the deep structure of physics problems whereas novices tend to overemphasize surface
features of the same problems [3], and that expert chess players have better memory for meaningful
chess formations than novices [4]. Together, such studies show that the cognitive representations
that experts and novices construct are different, and experts’ hierarchical organization of cognitive
structures enable them to make new inferences or solve problems in their domain of expertise more
effectively [5]. More recent literature in psycholinguistics shows that structural properties of words in
the mental lexicon and semantic memory affects many cognitive and language related processes, such as
word recognition [6,7] and production [8,9], cognitive search [10], word learning [11], and children’s
vocabulary development [12,13]. Taken together, this indicates that a complete understanding of
cognitive processes is not possible without considering the structure of the cognitive representations
that these processes necessarily interact with [14].
The notion that the structure of the cognitive system affects the psychological processes that operate
in that system is especially important within the context of education and learning. All educators
aspire to teach students important, meaningful, and useful information about the world. This implies
teaching with the goal of students acquiring meaningful knowledge and becoming experts in a given
domain, rather than with the goal of students assembling a random assortment of facts and information
lacking in cohesiveness. However, it is striking that within the field of cognitive science of learning,
the literature seems to mostly emphasize the processes and mechanisms underlying learning, with less
consideration of the cognitive or knowledge structures that students possess.
A recent tutorial paper by [15] provided a comprehensive overview of cognitive learning strategies
that have been well supported by the empirical research. Such strategies included spaced practice,
interleaving, retrieval-based practice, elaboration, concrete examples, and dual coding; although little
was mentioned about how these strategies contributed to the development of students’ knowledge
representations. This is curious considering that other research in the cognitive sciences has previously
demonstrated that expertise is associated with the development of complex, hierarchical cognitive
structures that enhance performance on highly skilled tasks [5]. This commentary provides a broad
review of the research conducted in the fields of cognitive psychology and psycholinguistics that
demonstrate the relevance and usefulness of network analysis as a way to quantify and measure
cognitive structure. In the later part of the commentary, the author’s own views on some of the
ways in which the network science approach could be applied to examine the knowledge structure of
students are presented. There are two main aims of this commentary: the first is to demonstrate how
network science methods could be harnessed to quantify these conceptual representations and track
the development of expertise, and the second is to urge and inspire cognitive psychologists, educators
and learning scientists to deeply consider the internal structure of the conceptual representations that
learners are acquiring.
As an example, consider a prominent empirical finding in the cognitive science of learning
literature—retrieval-based practice, which is the finding that being tested on the material that you
are trying to learn helps you learn the material better than simply restudying the material [16,17].
The typical experimental protocol in these studies is to provide students with a text passage to
study, with one group of students having more opportunities to restudy the material and another
group of students being repeatedly tested on their knowledge of the material. It is the latter group
(i.e., retrieval group) that out-performs the former (i.e., restudy group) on the test administered at the
end of the experimental session. However, it is important to point out that such an experimental
design is limited in its ability to examine how learners represent, acquire, and ultimately retrieve a
hierarchical, complex organization of concepts because the implicit assumption in these studies is that
the number of “informational units” that students retrieve on the test serves as a reasonable proxy for
what students have learned. Hence, it is difficult to know if retrieval-based learning can be readily
translated to the learning of knowledge that has a more complex, hierarchal structure, particularly in a
realistic setting where the informational space that learners are embedded in is complex, ambiguous,
and noisy. Such studies are unfortunately unable to directly inform educators about the cognitive
processes involved in the construction of deep, meaningful knowledge structures.
It is suggested that the main reason for why investigations of students’ knowledge representations
are not prominently featured in the cognitive science of learning literature is that it is notoriously difficult
to quantify “knowledge”. There are many valid ways of defining and representing knowledge, which is
a keenly debated topic in philosophy of science and epistemology [18,19]. The approach suggested in
this paper makes the necessarily simplifying assumption that knowledge can be reasonably represented
as a network structure of nodes and edges, where nodes represent isolated units of information
(i.e., concepts) related to a general topic area and edges or connections represent some sort of
relationship that could exist between these concepts (e.g., associative, sequential, co-occurrence, if-then,
etc.). While it is important to acknowledge that this is certainly not the only way to define and quantify
knowledge, representing knowledge as a network of interconnected concepts brings with it quite a few
methodological advantages.
First, it permits the application of tools and techniques from network science that can be brought
to bear on questions related to (i) quantifying the internal structural properties of the knowledge
Educ. Sci. 2020, 10, 101 3 of 16
that students are acquiring and (ii) tracking the development of expertise and knowledge acquisition.
Second, conceptualizing knowledge as a network of interconnected concepts is analogous to the
way in which cognitive scientists have historically modeled the structure of semantic memory—as a
network of concepts that are connected based on associative relationships or shared features [20,21].
Hence, the application of behavioral paradigms commonly used to estimate the structure of semantic
memory in cognitive psychology and psycholinguistics could potentially be adapted to estimate the
knowledge landscapes of students. Finally, it is worth noting that representing knowledge as a network
of interconnected concepts aligns a bit more closely with our intuition of what meaningful knowledge
looks like—that knowledge is more than simply learning new information, but is also about making
new connections and building associations between ideas.
Before proceeding, it is worthwhile to point out that there are some areas in the education sciences
that are already using network analysis in interesting ways. One example is the application of network
analysis to study the social networks of students collaborating and interacting asynchronously on
an online learning platform [22]. As another example, researchers analyzed the epistemic frames
of students using network analysis to track how students’ “ways of knowing” evolved over the
course of an online game [23]. As a final example, Wise and Cui [24] analyzed the reflection essays
of dental students as word co-occurrence networks. However, it is important to point out that these
papers do not focus on analyzing the students’ knowledge structures of a given domain; i.e., these
investigations focused on epistemic frames or ways of knowing [23], looked at the social interactions
among learners [22], or ref [24] analyzed reflection essays rather than objective measurements of
domain-specific knowledge and skill [24]. This commentary specifically focusses on the internal
knowledge structure of students, i.e., what they know (rather than how they know, as in [23]), because
a key aim of education is to nurture novice students to become, or at least approximate, experts in a
given subject or domain area. Although it is by no means easy to measure expertise in fine-grained
ways [25], it is suggested that network analysis could be a useful methodological framework for
education research as it could offer education researchers new, and more fine-grained, insights into the
developmental trajectories of conceptual structures and perhaps some ideas as to how to optimize its
developmental trajectory.
In the rest of this commentary, two areas in which the application of network analysis could
be especially relevant to the research conducted in the learning and education sciences are further
discussed. The first section provides a gentle introduction of the ways in which knowledge or
conceptual structure can be measured and represented as a network of interconnected concepts, and
how network analysis can be used to quantify the structural characteristics at various levels of the
knowledge network. The second section is more speculative in nature, focusing on how long-term
conceptual change and knowledge development might be quantified via a network science framework.
The section concludes with brief discussion of two specific examples in which the tools of network
analysis could be beneficial for educators in informing the design and planning of course syllabi and
lessons in order to maximize the development of subject expertise among students.
an analysis of the structure of knowledge networks at multiple scales as well as a brief discussion of
how these network measures might be relevant for educational research and practice.
of fluency data generated in this task is that individuals tend to list semantically related items
sequentially [42]. For instance, a participant asked to list animals might list a sequence of pets (“dog”,
“cat”, “hamster”) before switching to another cluster of animals (zoo animals like “lion”, “giraffe”,
“zebra”). Hence, it is possible to estimate a semantic network of a given category from a corpus of
fluency data, at both the population or group-level and at the level of individuals [43]. The behavioral
data obtained from this task has been used to study how people forage or search their semantic
memory for information [10] and examine the mechanisms underlying semantic memory impairment
among patients with Alzheimer’s disease [44]. Within the context of the education sciences, this task
could be adapted to measure students’ knowledge structures—instead of listing category members
from a general category such as animals, students could be asked to list as many concepts or ideas
as possible related to a given subtopic in a general field (e.g., electromagnetism in physics) or within
a general topic (e.g., physics). Similar to the free association task, it is possible to construct separate
fluency networks for different populations (e.g., for better or less well performing students) or across
longitudinal designs (e.g., students who complete the free association task at the beginning or at the
end of the course).
Finally, computational methods from natural language processing could be adopted to measure
the knowledge structure of textbooks and other reading materials that students are exposed to.
The development of computational tools to extract meaning from billions of words has informed
research on word recognition [45,46], semantic memory structure [10], and diachronic changes in word
meanings [47]. These tools rely on distributional semantics, where words are embedded in vector spaces
that reflect their co-occurrence relationships [48,49]—words with similar patterns of co-occurrence
relationships with other words are said to be most semantically similar [50]. Co-occurrence relationships
among words in a corpus can be represented as a language network where edges are placed between
words that co-occur with each other in a corpus [51,52]. Note that this approach differs from the
methods discussed previously that derive network representations from behavioral data provided by
students. In this case, the focus is on quantifying the information spaces, or the learning environment,
that students are exposed to, which over time shape the internal knowledge representations of students
to some extent. Research in language development indicates that children’s cognitive and vocabulary
development are influenced by the quantity and quality of language input provided by the parent
or caregiver [53,54], and children tend to learn words that are central or stand out in the semantic
landscape of words that they are exposed to [39,55]. These results suggest that it is important to
consider the role that the structure of the “input” provided to the students plays in their learning and
the development of their knowledge networks.
Table 1. Commonly used network measures and their potential application to the educational sciences.
Measures in italics were discussed in the paper.
Closeness centrality measures the extent to which a node is “close” to other nodes in the network.
A node with high closeness centrality is close to many nodes in the network as there is a short path
between the target node and all other nodes, whereas a node with low closeness centrality is far
from many nodes in the network as there is a long path between the target node and all other nodes.
Psycholinguistic studies have shown that the closeness centrality of words in a lexical network affects
the speed of retrieval of words in a word recognition task, such that words with greater closeness
centralities tend to be recognized more quickly than words with lower closeness centralities [59,60].
Similarly, we may expect that concepts with high and low closeness centralities to also have some
influence on learning and retrieval processes. For instance, concepts with high closeness centralities
may represent especially important concepts that occupy central locations in the knowledge space and
that need to be grasped in order to facilitate connections to other concepts.
Betweenness centrality measures the extent to which a node lies on the shortest path between any
two nodes in the network. A node with high betweenness centrality frequently lies in “between” the
shortest path between all possible pairs of nodes in the network, whereas a node with low betweenness
centrality does not tend to lie on the shortest path between all possible pairs of nodes in the network.
Betweenness centrality is a potentially important network measure for education and learning scientists
to consider because concepts with high betweenness centralities might represent landmark concepts
that are crucial linking concepts that bridge distant concepts in a knowledge space, and it could be
informative for how students navigate the knowledge network.
2.3. Summary
This section provided a gentle introduction to how methods from cognitive psychology could
be used to infer knowledge and conceptual networks, and how these networks could be analyzed at
different levels, or scales, of the network structure. An introduction to some network science measures
and their potential applications to education research is also provided. The main takeaway from this
section is that representing what students know as a “knowledge network” affords the application
of network analysis to quantify various aspects of its structure, which have the potential to inform
research in the educational and learning sciences. Indeed, it is striking that researchers interested in
understanding learning, encoding, and retrieval processes among students are not capitalizing on
the tools of network analysis to investigate the underlying knowledge networks that students are
necessarily constructing over the course of their learning [15,16]. In addition, representing concepts
and their interrelationships as a complex network aligns more closely to our intuition that knowledge
is inherently relational in nature, and that expertise is reflected in an interconnected, well-integrated
organization of concepts in a given domain.
network growth models developed by network scientists to examine the mechanisms to explain the
various structural features of networks.
One prominent example of a generative network growth model is preferential attachment, where
new nodes are more likely to attach to existing nodes in network that already have many connections [70].
Networks grown via the mechanism of preferential attachment have a power law degree distribution,
where there are few “hub” nodes with many connections and many nodes with fewer connections [70].
When adapted for the context of language acquisition, generative network growth models could be
considered as learning biases or algorithms that can ultimately shape the overall structure of the
learner’s mental lexicon. As compared to a random acquisition model where new words are randomly
added to the language network, language networks that prioritize the acquisition of words that have
many semantic connections (i.e., high degree) in the learning environment are more probable given
the empirical data [39,55]. This network growth model is known as preferential acquisition in the
literature [39]. In other words, children appear to learn new words that occupy “central” locations and
would otherwise “stand out” in the language environment that they are exposed to. In contrast, the
preferential attachment model did not provide good fits to the empirical data. Overall, the literature
suggests that language acquisition processes in young children appear to be more sensitive to the
structure of the language environment that they are exposed to (i.e., preferential acquisition) rather
than to the internal structure of the children’s existing vocabulary (i.e., preferential attachment).
These generative network growth models could similarly be translated to learning within the
educational context. Figure 2 provides an overview of three network growth models commonly
investigated in language development and suggests how they might be relevant in an educational
context. Recall that the preferential attachment model states that the learner would be more likely to
learn new nodes that, when added to the network, tend to be connected to existing nodes with many
connections. In the context of a knowledge network of concepts, this model corresponds to learning
that is driven by the internal connectivity of a learner’s existing knowledge network. Here, prior
knowledge plays a strong role in guiding the concepts that are most likely to be acquired, such that
richly connected concepts tend to become more richly connected over time. This jives with education
research showing that prior knowledge of learners strongly affects how they search, process, and
interpret new pieces of information [71–73]. The preferential acquisition model states that the learner
would be more likely to learn new nodes that have many connections in the learning environment.
Hence, it is the structure in the external, learning environment that learners are exposed to that drives
growth in the knowledge network, whereby salient, “landmark” concepts are most likely to be learned.
Finally, the lure of the associates model states that the learner would be more likely to learn new nodes
that would form many connections with existing nodes in the network [58]. Within the context of a
developing knowledge network, this is analogous to learning that is driven by making connections
between a learner’s existing knowledge and the material to be learned. New concepts that have many
“hooks” and connect readily to many aspects of what the learner already knows are more readily
integrated into the knowledge network.
learned. Finally, the lure of the associates model states that the learner would be more likely to learn
new nodes that would form many connections with existing nodes in the network [58]. Within the
context of a developing knowledge network, this is analogous to learning that is driven by making
connections between a learner’s existing knowledge and the material to be learned. New concepts
that
Educ. Sci.have
2020,many
10, 101“hooks” and connect readily to many aspects of what the learner already knows10 are
of 16
more readily integrated into the knowledge network.
Internal structure drives growth External structure drives growth Connections between internal and
external structure drive growth
o Learner’s prior knowledge o Structure in the learning o Connections made between
drives growth environment drives growth classroom material and
o “Rich” concepts become o Salient, “landmark” current knowledge drive
more richly connected concepts are learned first growth
o Concepts with more “hooks”
are learned first
Figure
Figure 2. Modeling
2. Modeling thethe growth
growth of knowledge
of knowledge networks
networks with with generative
generative network network
growthgrowth models.
models. Smaller,
Smaller, grey nodes represent concepts already known by the learner (i.e., prior
grey nodes represent concepts already known by the learner (i.e., prior knowledge). Larger knowledge). Larger
white
white
and red and red nodes
nodes represent
represent the concepts
the concepts to be
to be learned(i.e.,
learned (i.e.,the
the external,
external, learning
learningenvironment).
environment).
Connections
Connections between
between concepts
concepts indicate
indicate the existence
the existence of a meaningful
of a meaningful relationship
relationship between
between the
the concepts.
concepts. Connections in bold are relevant for computing the network growth model prediction. Red
Connections in bold are relevant for computing the network growth model prediction. Red nodes
nodes represent the concept that is most likely to be acquired based on the network growth model
represent the concept that is most likely to be acquired based on the network growth model prediction.
prediction.
When applied to the context of education and learning, these network growth models could
potentially provide new ways of quantitatively tracking the learning trajectories of students. It could
also be important for helping educators decide what sort of learning or teaching strategy would be
most appropriate given the interactions between the student’s current knowledge and the nature
of the content to be acquired. For instance, when the learner is very new to a topic, preferential
acquisition might be a more useful approach as the focus is on capitalizing on structure in the new
content to facilitate learning. In the classroom, the educator could emphasize central, landmark ideas
in the discipline and make them more salient to students. On the other hand, when the learner has
accumulated more knowledge about the topic, we might expect that the structure of the existing
knowledge network would begin to drive learning in different ways (i.e., preferential attachment).
An educator might also exploit the lure of the associates mechanism by making explicit as many
connections as possible between a student’s existing knowledge and the new material, scaffolding the
development of the learner’s knowledge network.
Finally, the evidence suggests that students tend to mis-regulate their learning [80,81]. In other
words, students are not accurate judges of how well they have learned a topic, particularly if the
topic was challenging [81]. It may be possible to improve metacognitive or self-regulatory skills of
students by being strategic about the introduction of core principles and specific ideas in the discipline
that purposely creates “gaps” in the knowledge space. Computational simulations conducted by [55]
showed that young children acquire new words in a fashion that purposely creates gaps, or sparsely
connected areas, in their language networks, which persist for some time before being filled in.
The authors suggested that this process of gap formation and gap filling may be especially important
for building language networks with a robust global structure despite the variability of the language
input that children are exposed to [82,83]. Perhaps a similar process could be induced among students
trying to acquire a complex network of discipline knowledge. The presence of “unknowns” in the
knowledge landscape might naturally motivate learning based on information seeking strategies that
attempt to reduce uncertainty [84], for example, via an information seeking strategy of searching
for specific pieces of information to fill in knowledge gaps. By being explicit and upfront about the
enduring understandings that students should take away from the course, educators could mimic a
universal property of learning in complex environments by intentionally “setting up” an underspecified
knowledge network that contains knowledge gaps. Educators could then design constructive learning
activities and assessments that enable students to proceed from learning about coarse-grained concepts
to fine-grained concepts, leading to the development of a robust and in-depth knowledge landscape.
3.3. Summary
This section provided an overview of generative network growth models, as well as a brief review
of how these models have been used within the context of language development and how they could
potentially be adapted to investigate long-term conceptual change in knowledge networks. The main
takeaway from this section is that long-term conceptual change and knowledge development could
be meaningfully quantified via the network science perspective. Generative network growth models
could be used to examine the development of knowledge networks, and it is further suggested that
the network science perspective could offer a useful conceptual framework for assisting educators in
the design and planning of course syllabi and lessons in order to enhance the development of subject
expertise among students.
4. Conclusions
Ultimately, the goal of education is to inspire and instill deep, meaningful, and long-lasting
conceptual change in the knowledge landscapes of students. This commentary puts forward the
idea that the network science approach could be useful in helping educators to achieve this goal.
Although it is not easy to quantify or measure expertise [25], network science approaches could be
useful for measuring the knowledge networks of students, and provide new ways of quantifying
and tracking the development of domain expertise. By representing student knowledge as a network
of interconnected concepts, the tools of network science and behavioral paradigms from cognitive
psychology could be combined to measure and quantify the structure of such knowledge networks at
various levels of analysis, as discussed in Section 2. In addition, the tools of network science could be
relevant for investigating the developmental trajectories of knowledge structures, and further inform
instructional design to maximize the acquisition of meaningful knowledge, as discussed in Section 3.
A deep consideration of the knowledge representation that students are acquiring provides
an important complement to the current dogma in the field of cognitive science of learning, which
predominantly focusses on the “process” of learning [15], as well as other areas of the learning
sciences, which has focused on a variety of aspects ranging from the social network structure of
learners [22] to how students develop their epistemic frames [23]. Although network science methods
permit the quantification of knowledge representations and their developmental trajectories, long-term
conceptual change will likely emerge from real-time feedback loops where the processes of retrieval
Educ. Sci. 2020, 10, 101 13 of 16
and learning interact with, and are grounded within, the structure of knowledge landscapes that
students are building.
References
1. Castro, N.; Siew, C.S.Q. Contributions of Modern Network Science to the Cognitive Sciences: Revisiting
research spirals of representation and process. PsyArXiv 2019. [CrossRef]
2. Siew, C.S.Q.; Wulff, D.U.; Beckage, N.M.; Kenett, Y.N. Cognitive Network Science: A Review of Research on
Cognition through the Lens of Network Representations, Processes, and Dynamics. Complexity 2019, 2019,
1–24. [CrossRef]
3. Chi, M.T.H.; Feltovich, P.J.; Glaser, R. Categorization and Representation of Physics Problems by Experts and
Novices. Cogn. Sci. 1981, 5, 121–152. [CrossRef]
4. Chi, M.T. Knowledge structures and memory development. Child. Think. What Dev. 1978, 1, 75–96.
5. Gobbo, C.; Chi, M. How knowledge is structured and used by expert and novice children. Cogn. Dev. 1986,
1, 221–237. [CrossRef]
6. Chan, K.Y.; Vitevitch, M. The influence of the phonological neighborhood clustering coefficient on spoken
word recognition. J. Exp. Psychol. Hum. Percept. Perform. 2009, 35, 1934–1949. [CrossRef]
7. Siew, C.S.Q.; Vitevitch, M.S. The phonographic language network: Using network science to investigate the
phonological and orthographic similarity structure of language. J. Exp. Psychol. Gen. 2019, 148, 475–500.
[CrossRef]
8. Castro, N.; Stella, M.; Siew, C.S.Q. Quantifying the interplay of semantics and phonology during failures of
word retrieval by people with aphasia using a multiplex lexical network. PsyArXiv 2019. [CrossRef]
9. Castro, N.; Stella, M. The multiplex structure of the mental lexicon influences picture naming in people with
aphasia. J. Complex Netw. 2019, 7, 913–931. [CrossRef]
10. Hills, T.T.; Jones, M.N.; Todd, P.M. Optimal foraging in semantic memory. Psychol. Rev. 2012, 119, 431–440.
[CrossRef]
11. Goldstein, R.; Vitevitch, M. The influence of clustering coefficient on word-learning: How groups of similar
sounding words facilitate acquisition. Front. Psychol. 2014, 5, 5. [CrossRef] [PubMed]
12. Beckage, N.; Smith, L.; Hills, T. Small Worlds and Semantic Network Growth in Typical and Late Talkers.
PLoS ONE 2011, 6, 19348. [CrossRef] [PubMed]
13. Stella, M.; Beckage, N.M.; Brede, M. Multiplex lexical networks reveal patterns in early word acquisition in
children. Sci. Rep. 2017, 7, 46730. [CrossRef] [PubMed]
14. Strogatz, S.H. Exploring complex networks. Nature 2001, 410, 268–276. [CrossRef]
15. Weinstein, Y.; Madan, C.R.; Sumeracki, M.A. Teaching the science of learning. Cogn. Res. Princ. Implic. 2018,
3, 2. [CrossRef] [PubMed]
16. Roediger, H.L., III; Karpicke, J.D. Test-enhanced learning: Taking memory tests improves long-term retention.
Psychol. Sci. 2006, 17, 249–255. [CrossRef]
17. Roediger, H.L., III; Putnam, A.L.; Smith, M.A. Ten benefits of testing and their applications to educational
practice. In Psychology of Learning and Motivation; Elsevier: Amsterdam, The Netherlands, 2011; Volume 55,
pp. 1–36.
18. Disessa, A.A.; Sherin, B. What changes in conceptual change? Int. J. Sci. Educ. 1998, 20, 1155–1191. [CrossRef]
19. Linn, M.C. The Knowledge Integration Perspective on Learning and Instruction; Cambridge University Press:
Cambridge, UK, 2006.
20. Collins, A.M.; Loftus, E.F. A spreading-activation theory of semantic processing. Psychol. Rev. 1975, 82,
407–428. [CrossRef]
21. Smith, E.E.; Shoben, E.J.; Rips, L.J. Structure and process in semantic memory: A featural model for semantic
decisions. Psychol. Rev. 1974, 81, 214–241. [CrossRef]
Educ. Sci. 2020, 10, 101 14 of 16
22. Aviv, R.; Erlich, Z.; Ravid, G.; Geva, A. Network analysis of knowledge construction in asynchronous learning
networks. J. Asynchronous Learn. Netw. 2003, 7, 1–23. [CrossRef]
23. Shaffer, D.W.; Hatfield, D.; Svarovsky, G.N.; Nash, P.; Nulty, A.; Bagley, E.; Frank, K.; Rupp, A.A.; Mislevy, R.
Epistemic Network Analysis: A Prototype for 21st-Century Assessment of Learning. Int. J. Learn. Media
2009, 1, 33–53. [CrossRef]
24. Wise, A.F.; Cui, Y. Top concept networks of professional education reflections. In Proceedings of the 9th
International Conference on Learning Analytics & Knowledge, Tempe, AZ, USA, 4–8 March 2019; pp. 260–264.
25. Hoffman, R.R. Scientific Methodology and Expertise Studies: Massaging the Scar Tissue. In The Science of
Expertise; Routledge: Abingdon, UK, 2017; pp. 444–452.
26. Novak, J.D. Learning, Creating, and Using Knowledge: Concept Maps as Facilitative Tools in Schools and Corporations;
Routledge: Abingdon, UK, 2010.
27. Kinchin, I.M.; Hay, D.B.; Adams, A. How a qualitative approach to concept map analysis can be used to aid
learning by illustrating patterns of conceptual development. Educ. Res. 2000, 42, 43–57. [CrossRef]
28. Lavigne, N.C. Mutually informative measures of knowledge: Concept maps plus problem sorts in statistics.
Educ. Assess. 2005, 10, 39–71. [CrossRef]
29. Koponen, I.T.; Nousiainen, M. Pre-service teachers’ knowledge of relational structure of physics concepts:
Finding key concepts of electricity and magnetism. Educ. Sci. 2019, 9, 18. [CrossRef]
30. Siew, C.S. Using network science to analyze concept maps of psychology undergraduates. Appl. Cogn.
Psychol. 2018, 33, 662–668. [CrossRef]
31. Steyvers, M.; Tenenbaum, J.B. The large-scale structure of semantic networks: Statistical analyses and a
model of semantic growth. Cogn. Sci. 2005, 29, 41–78. [CrossRef]
32. De Deyne, S.; Navarro, D.J.; Perfors, A.; Brysbaert, M.; Storms, G. The “Small World of Words” English word
association norms for over 12,000 cue words. Behav. Res. Methods 2018, 51, 987–1006. [CrossRef]
33. Kiss, G.R.; Armstrong, C.; Milroy, R.; Piper, J. An associative thesaurus of English and its computer analysis.
Comput. Lit. Stud. 1973, 153–165.
34. Nelson, D.L.; McEvoy, C.L.; Schreiber, T.A. The University of South Florida free association, rhyme, and
word fragment norms. Behav. Res. Methods Instrum. Comput. 2004, 36, 402–407. [CrossRef] [PubMed]
35. De Deyne, S.; Navarro, D.J.; Storms, G. Better explanations of lexical and semantic cognition using networks
derived from continued rather than single-word associations. Behav. Res. Methods 2013, 45, 480–498.
[CrossRef]
36. Stella, M.; De Nigris, S.; Aloric, A.; Siew, C.S. Forma mentis networks quantify crucial differences in STEM
perception between students and experts. PLoS ONE 2019, 14, e0222870. [CrossRef] [PubMed]
37. McRae, K.; Cree, G.S.; Seidenberg, M.S.; McNorgan, C. Semantic feature production norms for a large set of
living and nonliving things. Behav. Res. Methods 2005, 37, 547–559. [CrossRef] [PubMed]
38. Buchanan, E.M.; Valentine, K.D.; Maxwell, N.P. English semantic feature production norms: An extended
database of 4436 concepts. Behav. Res. Methods 2019, 51, 1849–1863. [CrossRef] [PubMed]
39. Hills, T.T.; Maouene, M.; Maouene, J.; Sheya, A.; Smith, L. Longitudinal analysis of early semantic networks.
Psychol. Sci. 2009, 20, 729–739. [CrossRef] [PubMed]
40. Hills, T.T.; Maouene, M.; Maouene, J.; Sheya, A.; Smith, L. Categorical structure among shared features in
networks of early-learned nouns. Cognition 2009, 112, 381–396. [CrossRef]
41. Siew, C.S.Q. Feature distinctiveness effects in language acquisition and lexical processing: Insights from
megastudies. Cogn. Process 2020. [CrossRef]
42. Troyer, A.K.; Moscovitch, M.; Winocur, G.; Alexander, M.P.; Stuss, D.O.N. Clustering and switching on verbal
fluency: The effects of focal frontal-and temporal-lobe lesions. Neuropsychologia 1998, 36, 499–504. [CrossRef]
43. Zemla, J.C.; Austerweil, J.L. Estimating semantic networks of groups and individuals from fluency data.
Comput. Brain Behav. 2018, 1, 36–58. [CrossRef]
44. Zemla, J.C.; Austerweil, J.L. Analyzing knowledge retrieval impairments associated with Alzheimer’s disease
using network analyses. Complexity 2019, 2019, 1–12. [CrossRef]
45. Jones, M.N.; Mewhort, D.J. Representing word meaning and order information in a composite holographic
lexicon. Psychol. Rev. 2007, 114, 1. [CrossRef]
46. Lund, K.; Burgess, C. Producing high-dimensional semantic spaces from lexical co-occurrence. Behav. Res.
Methods Instrum. Comput. 1996, 28, 203–208. [CrossRef]
Educ. Sci. 2020, 10, 101 15 of 16
47. Li, Y.; Engelthaler, T.; Siew, C.S.; Hills, T.T. The Macroscope: A tool for examining the historical structure of
language. Behav. Res. Methods 2019, 51, 1864–1877. [CrossRef] [PubMed]
48. Bullinaria, J.A.; Levy, J.P. Extracting semantic representations from word co-occurrence statistics: A
computational study. Behav. Res. Methods 2007, 39, 510–526. [CrossRef] [PubMed]
49. Turney, P.D.; Pantel, P. From frequency to meaning: Vector space models of semantics. J. Artif. Intell. Res.
2010, 37, 141–188. [CrossRef]
50. Firth, J.R. A synopsis of linguistic theory, 1930–1955. In Studies in Linguistic Analysis; Philological Society:
Oxford, UK, 1957.
51. Cancho, R.F.I.; Solé, R.V. The small world of human language. Proc. R. Soc. Lond. Ser. B Biol. Sci. 2001, 268,
2261–2265. [CrossRef]
52. Ke, J.; Yao, Y.A.O. Analysing language development from a network approach. J. Quant. Linguist. 2008, 15,
70–99. [CrossRef]
53. Hart, B.; Risley, T.R. Meaningful Differences in the Everyday Experience of Young American Children; Paul H
Brookes Publishing: Baltimore, MD, USA, 1995.
54. Huttenlocher, J.; Haight, W.; Bryk, A.; Seltzer, M.; Lyons, T. Early vocabulary growth: Relation to language
input and gender. Dev. Psychol. 1991, 27, 236. [CrossRef]
55. Sizemore, A.E.; Karuza, E.A.; Giusti, C.; Bassett, D.S. Knowledge gaps in the early growth of semantic feature
networks. Nat. Hum. Behav. 2018, 2, 682–692. [CrossRef]
56. Borgatti, S.P. Centrality and network flow. Soc. Netw. 2005, 27, 55–71. [CrossRef]
57. Luce, P.A.; Pisoni, D.B. Recognizing spoken words: The Neighborhood Activation Model. Ear Hear 1998, 19,
1–36. [CrossRef]
58. Storkel, H.L. Learning new words. J. Speech Lang. Hear. Res. 2001, 44, 1321–1337. [CrossRef]
59. Goldstein, R.; Vitevitch, M.S. The influence of closeness centrality on lexical processing. Front. Psychol. 2017,
8, 1683. [CrossRef] [PubMed]
60. Siew, C.S. The orthographic similarity structure of English words: Insights from network science. Appl. Netw.
Sci. 2018, 3, 13. [CrossRef]
61. Watts, D.J.; Strogatz, S.H. Collective dynamics of ‘small-world’networks. Nature 1998, 393, 440–442.
[CrossRef] [PubMed]
62. Bullmore, E.; Sporns, O. Complex brain networks: Graph theoretical analysis of structural and functional
systems. Nat. Rev. Neurosci. 2009, 10, 186–198. [CrossRef] [PubMed]
63. Kleinberg, J.M. Navigation in a small world. Nature 2000, 406, 845. [CrossRef]
64. Humphries, M.D.; Gurney, K. Network ‘small-world-ness’: A quantitative method for determining canonical
network equivalence. PLoS ONE 2008, 3, e0002051. [CrossRef]
65. Newman, M.E. Modularity and community structure in networks. Proc. Natl. Acad. Sci. USA 2006, 103,
8577–8582. [CrossRef]
66. Fortunato, S. Community detection in graphs. Phys. Rep. 2010, 486, 75–174. [CrossRef]
67. Lommi, H.; Koponen, I.T. Network cartography of university students’ knowledge landscapes about the
history of science: Landmarks and thematic communities. Appl. Netw. Sci. 2019, 4, 6. [CrossRef]
68. Beckage, N.M.; Colunga, E. Network Growth Modeling to Capture Individual Lexical Learning. Complexity
2019, 2019, 1–17. [CrossRef]
69. Peters, R.; Borovsky, A. Modeling early lexico-semantic network development: Perceptual features matter
most. J. Exp. Psychol. Gen. 2019, 148, 763. [CrossRef] [PubMed]
70. Barabási, A.-L.; Albert, R. Emergence of scaling in random networks. Science 1999, 286, 509–512. [CrossRef]
[PubMed]
71. Fidel, R.; Davies, R.K.; Douglass, M.H.; Holder, J.K.; Hopkins, C.J.; Kushner, E.J.; Miyagishima, B.K.;
Toney, C.D. A visit to the information mall: Web searching behavior of high school students. J. Am. Soc. Inf.
Sci. 1999, 50, 24–37. [CrossRef]
72. Kalyuga, S.; Chandler, P.; Sweller, J. When redundant on-screen text in multimedia technical instruction can
interfere with learning. Hum. Factors 2004, 46, 567–581. [CrossRef]
73. Nievelstein, F.; Van Gog, T.; Boshuizen, H.P.; Prins, F.J. Expertise-related differences in conceptual and
ontological knowledge in the legal domain. Eur. J. Cogn. Psychol. 2008, 20, 1043–1064. [CrossRef]
74. Wiggins, G.; Wiggins, G.P.; McTighe, J. Understanding by Design. Available online: https://www.ascd.org/
ASCD/pdf/siteASCD/publications/UbD_WhitePaper0312.pdf (accessed on 8 April 2020).
Educ. Sci. 2020, 10, 101 16 of 16
75. Iyengar, S.R.S.; Madhavan, C.E.V.; Zweig, K.A.; Natarajan, A. Understanding human navigation using
network analysis. Top. Cogn. Sci. 2012, 4, 121–134. [CrossRef]
76. Vitevitch, M.S. What can graph theory tell us about word learning and lexical retrieval? J. Speech Lang. Hear.
Res. 2008, 51, 408–422. [CrossRef]
77. Arbesman, S.; Strogatz, S.H.; Vitevitch, M.S. The structure of phonological networks across multiple languages.
Int. J. Bifurc. Chaos 2010, 20, 679–685. [CrossRef]
78. Koponen, I.T.; Nousiainen, M. Concept networks in learning: Finding key concepts in learners’ representations
of the interlinked structure of scientific knowledge. J. Complex Netw. 2014, 2, 187–202. [CrossRef]
79. Koponen, I.T.; Pehkonen, M. Coherent knowledge structures of physics represented as concept networks in
teacher education. Sci. Educ. 2010, 19, 259–282. [CrossRef]
80. DiFrancesca, D.; Nietfeld, J.L.; Cao, L. A comparison of high and low achieving students on self-regulated
learning variables. Learn. Individ. Differ. 2016, 45, 228–236. [CrossRef]
81. Hartwig, M.K.; Dunlosky, J. Category learning judgments in the classroom: Can students judge how well
they know course topics? Contemp. Educ. Psychol. 2017, 49, 80–90. [CrossRef]
82. Hills, T.T.; Siew, C.S. Filling gaps in early word learning. Nat. Hum. Behav. 2018, 2, 622. [CrossRef] [PubMed]
83. Hills, T.T.; Maouene, J.; Riordan, B.; Smith, L.B. The associative structure of language: Contextual diversity
in early word learning. J. Mem. Lang. 2010, 63, 259–273. [CrossRef] [PubMed]
84. Lydon-Staley, D.M.; Zhou, D.; Blevins, A.S.; Zurn, P.; Bassett, D.S. Hunters, busybodies, and the knowledge
network building associated with curiosity. PsyArXiv 2019.
© 2020 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).