Cuadernos de Psicología del Deporte, vol.

22, 2, 258-267 © Copyright 2018: Servicio de Publicaciones de la Universidad de Murcia

Recibido: 01/10/2021 Murcia (España) ISSN edición impresa: 1578-8423
Aceptado: 08/10/2021 ISSN edición web (http://revistas.um.es/cpd ): 1989-5879

Cita: Güral, Y.; Gürcan, M.; Devecioğlu, S.; Halisdemir, Talha A. (2022). Investigation of the
Performance of Esports Games with Data Envelopment Analysis. Cuadernos de Psicología del
Deporte, 22(2), 258-267

Investigación del Rendimiento de los Juegos de Esports con Análisis

Envolvente de Datos
Investigation of the Performance of Esports Games with Data
Envelopment Analysis
Investigação do Desempenho dos Jogos Esports com Análise de
Envelopamento de Dados

Güral, Y1, Gürcan, M1, Devecioğlu, S2, Halisdemir, T A3

1
Firat University, Faculty of Science, Department of Statistics (Elazığ, TURKEY);2 Firat University,
Faculty of Sports Sciences, Department of Sports Management (Elazığ, TURKEY ); 3Firat University,
Faculty of Economics and Administrative Sciences, Department of Economics (Elazığ, TURKEY )

RESUMEN
Hoy en día, los torneos de deportes electrónicos como el Juego Cibernético Mundial, se organizan el Campeonato
de las Naciones Europeas, la serie Internacional de Premiership y la Serie ESL Pro. Estos torneos incluyen juegos
populares como contraataque, Dota 2, League of Legends, Starcraft 2, Super Smash Bros y Street Fighter. En este
estudio, las actuaciones de los juegos de eSports se analizarán con el Análisis Envolvente de Datos (DEA). En
consecuencia, está dirigido a ayudar a las empresas de eSports a que sean efectivas determinando las eficiencias
relativas de los Juegos de ESPort, unidades de toma de decisiones efectivas e ineficaces (unidades de producción de
DMU que producen resultados similares utilizando insumos similares). Para este propósito determinando los juegos
efectivos y comparando los otros juegos según ellos permite la optimización de los valores de las variables de salida
según la variable de entrada.
La DEA es un método no paramétrico utilizado para estudiar la efectividad relativa de las Unidades de Toma de
Decisiones cuando hay múltiples entradas y múltiples salidas. El Análisis de la Envolvente de Datos (DEA) es un
método no paramétrico utilizado para examinar la eficiencia relativa de las Unidades de Toma de Decisiones
(unidades de producción de DMUs que producen salidas similares utilizando entradas similares) cuando hay entradas
múltiples y múltiples salidas. La medición de la eficiencia de las empresas y conocer la fuente de su ineficiencia es
un tema importante para los ESPorts como en todos los sectores. El análisis de envolvimiento de datos se usa
frecuentemente para medir la eficiencia de DMU.
En este estudio, el análisis de eficiencia se realizó teniendo en cuenta los 27 juegos en los primeros 200 juegos en el
sitio web de e-charts en 2018. Con este análisis, se intentó obtener las eficiencias y los cambios de eficiencias de los
juegos en 2018. Según los resultados de la investigación: Counter-Strike y Minecraft se determinó que eran juegos
eficaces. Dado que los otros 25 juegos son eficientes, los valores objetivo para estos juegos se dan en el estudio.

Palabras clave: eSports, Juegos digitales, DEA, Eficiencia.

Correspondence to: Yunus Güral. Address: Firat University, Faculty of

Science Elazığ, TURKEY. Email: ygural@firat.edu.tr

Cuadernos de Psicología del Deporte, 22, 2 (abril)

 Performance of Esports Games with Data Envelopment Analysis

ABSTRACT
Today, electronic sports tournaments such as the World Cyber Game, European Nations Championship, International
Premiership Series and Esl Pro Series are organized. These tournaments include popular games such as Counter-
Strike, Dota 2, League of Legends, StarCraft 2, Super Smash Bros and Street Fighter. In this study, the performances
of eSports games will be analyzed with Data Envelopment Analysis (DEA). Accordingly, it is aimed to help eSports
companies to be effective by determining the relative efficiencies of eSport games, effective and ineffective Decision-
Making Units (DMUs production units that produce similar outputs using similar inputs). For this purpose,
determining the effective games and comparing the other games according to them enables the optimization of the
values of the output variables according to the input variable.
DEA is a non-parametric method used to study the relative effectiveness of Decision Making Units when there are
multiple inputs and multiple outputs. Data Envelopment Analysis (DEA) is a non-parametric method used to examine
the relative efficiency of Decision Making Units (DMUs production units that produce similar outputs using similar
inputs) when there are multiple inputs and multiple outputs. Measuring the efficiency of businesses and knowing the
source of their inefficiency is an important issue for eSports as in every sector. Data Envelopment Analysis is
frequently used for measuring the efficiency of DMU.
In this study, efficiency analysis was performed by taking into consideration the 27 games in the first 200 games on
the e-charts website in 2018. With this analysis, the efficiencies and changes of efficiencies of the games in 2018
were tried to be obtained. According to the results of the research: Counter-Strike and Minecraft were determined to
be effective games. Since the other 25 games are inefficient, target values for these games are given in the study.
Keywords: eSports, Digital Games, DEA, Efficiency.
RESUMO
Hoje em dia, os torneios esportivos eletrônicos, como o World Cyber Game, são organizados pelo Campeonato
Europeu das Nações, a série internacional de Premiership e a série ESL Pro. Esses torneios incluem jogos populares
como contra-ataque, DotA 2, League of Legends, Starcraft 2, Super Smash Bros e Street Fighter. Neste estudo, os
desempenhos dos jogos eSports serão analisados com análise de envelope de dados (DEA). Consequentemente, visa
ajudar as empresas de espantar a serem eficazes determinando as eficiências relativas de jogos de esportes, unidades
de decisão eficazes e ineficazes (unidades de produção DMU que produzem resultados semelhantes com insumos
semelhantes). Para este propósito determinar os jogos eficazes e comparando os outros jogos de acordo com eles
permite a optimização dos valores das variáveis de saida de acordo com a variável de entrada.
O DEA é um método não paramétrico usado para estudar a eficácia relativa das unidades de decisão quando existem
várias entradas e várias saídas. A análise do envelope de dados (DEA) é um método não paramétrico usado para
examinar a eficiência relativa das unidades de decisão (unidades de produção DMU que produzem saídas semelhantes
usando entradas semelhantes) quando várias entradas e várias saídas. A medição da eficiência das empresas e
conhecer a fonte de sua ineficiência é uma questão importante para o eSports como em todos os setores. A análise de
envolvimento de dados é freqüentemente usada para medir a eficiência do DMU.
Neste estudo, a análise de eficiência foi realizada levando em conta os 27 jogos nos primeiros 200 jogos no site do
E-Charts em 2018. Com esta análise, foi tentada obter eficiências e mudanças de eficiências de jogos em 2018. De
acordo com os resultados da investigação: Contra-ataque e minecraft foi determinado que eles eram jogos eficazes.
Como os outros 25 jogos são eficientes, os valores alvo para esses jogos são dados no estudo.
Palavras chave eSportes, Jogos digitais, DEA, eficiência.

INTRODUCTION tournaments organized today includes different factors

It has been an important factor in the individual and as well as the success power of the teams participating
relational success of team players in tournaments in the tournament. For example, the viewing rate of a
organized since ancient times. In most of the studies tournament is very important as it will increase
on the subject in the literature, this situation has been advertising revenues. This factor is directly related to
examined in detail. However, the effectiveness of the the large number of teams participating in the

Cuadernos de Psicología del Deporte, 22, 2 (abril) 259

 Güral et al.

tournament. Considering such factors, it is a Wagner defined eSports as sports activities that
preliminary information for inactive tournaments by develop and train mental and physical abilities using
determining the most active games in tournaments. people's information and communication technologies
When the literature is examined from this point of (Wagner, 2006). Hamari and Sjöblom (2015) defined
view, very few studies can be found. Just at this stage, eSports as the simplified form of primary aspects of
it is possible to use many possibilities that today's sport by electronic systems. Electronic sport is a sport
technology gives us. In particular, DEA is an that has both physical and mental features. eSports
important tool in determining the most effective differ from traditional sports due to its ability to be
games according to the factors determined within the applied individually and as a team, to require tools and
games. In this way, by identifying the games with high equipment specific to its nature, to be performed from
efficiency, suggestions can be made to increase the all ages, genders, climatic conditions, and to
effectiveness of other games according to these games. participate in more than one game (Argan et al., 2006).
For this reason, it is important to examine the digital
games that date back to the 1940s, which have turned Today, many eSports tournaments are organized all
into eSports tournaments today, from this point of over the world. The best known are the World Cyber
view, in order to increase the effectiveness of the Game, the European Nations Championship, the
tournaments. International Premiership Series, and the Esl Pro
Series. In these tournaments, there are subcategories
The history of digital games called computer games or such as adventure, role play, FSP, sports, war, action,
video games dates back to the 1940s. The first simulation, and strategy (Argan et al., 2006). Among
interactive game ‘Spacewar’ was developed in 1962 the most popular eSports games are Counter-Strike,
by MIT (Massachusetts Institute of Technology). In Dota 2, League of Legends, StarCraft 2, Super Smash
1972, the ‘Pong’ game that could be connected to TV, Bros and Street Fighter (Çolak et al., 2018; Parshakov
was put on the market and opened the way for people et al., 2015).
from all walks of life to access digital games. In 1992,
the first 3D game ‘Wolfenstein’ was introduced to the It is very important to evaluate the competition
gaming market, followed by the ‘Doom’ game, so FSP between the games statistically by evaluating the
(first-person shot) games entered our lives and earnings offered by the eSports games to the
computer sales increased considerably (Yılmaz et al., participants and to eliminate the deficiencies of the
2004). With the Internet, games around the world have games based on the defined variables. At this stage,
become online. As a result, games have ceased to be many factors need to be taken into account in ranking
single-player and have become multiplayer. The the games from the best to the worst. In this respect,
resulting competition elements and the reward the games examined in this study were subjected to a
platform led players to gather in various game groups multi-factor ranking by defining the input and output
(Coşkun et al., 2016). In 1993, with the FSP game variables, and the factors that needed improvement of
called Doom, teams started to compete in online the inefficient ones according to the efficient games
tournaments. In 1997, the Cyberathlete Professional were determined. It is important to improve these
League was established in the United States. In 1999, factors in increasing the success ranking of the games.
Counter-Strike introduced a new era of competitive
games. With the developments in the West, real-time Types of eSports
strategy games and MMORPG (massively online role-
playing games) began to develop in South Korea in the • MOBA (Massively Online Battle Arena): Two
90s (Wagner, 2006). Electronic Sports (eSports) can competing teams, usually five people, try to destroy
be defined as a field played by various modes of each other's energy resources on a map.
competitive multiplayer digital games, which are
introduced as a new form of sport and played online or • FPS (First Person Shot): The player sees the digital
offline, individually and/or as a team via Computer / game environment through the eyes of the virtual
Console / Mobile platforms. Each country classifies character. Features such as reflex, quick decision
eSports differently as a sport, a game, or an making, team management are essential for success in
intelligence sport (Youth research newsletter, 2018). this type of game.

Cuadernos de Psicología del Deporte, 22, 2 (abril)

260
 Performance of Esports Games with Data Envelopment Analysis

• RTS (Real-Time Strategy): In this type of game, the analysts, human resources, organizers, event
player manages the resources correctly and establishes managers, financing, and lawyers (Youth research
an army and tries to defeat the opponent's armies. newsletter, 2018).

• Fighter: The player tries to defeat the virtual In 1962, the first analog game was accepted as
characters chosen by other players, representing a Spacewar by Steve Russel and colleagues at the
certain martial discipline. It is commonly played as a Massachusetts Institute of Technology (Akbulut,
player versus a player. 2009).

• Sports: It is a form of traditional sports adapted to The presence of digital games in different
virtual environment. environments increases diversity. Digital games are a
kind of game that derives from the differentiation of
• MMORPG (Massively Multiplayer Online Role- the environment. It includes Atari games, computer
Playing Game): They are role-playing games played games, console games, mobile games, and all different
by connecting to any server. genres. In this context, digital gaming has become an
individual communication environment that
incorporates features such as digitality, interactivity,
virtuality, variability, and modularity (Coşkun et al.,
2016).

As the popularity of computer games has increased,

the number of players has increased. This determines
the profits of the industry. However, since e-sports is
a young industry, there are not many academic articles
on this subject. Although the data show that strong
country disparities are influential on players' success,
to our knowledge, no research examines the difference
in country players' earnings (Parshakov, 2018).

Although the scientific significance of eSports has

been emphasized more than a decade ago, academic
research on this topic is relatively sparse. Only a small
number of studies have addressed aspects of content
production. Studies in game design aim to improve the
Figure 1: Types of eSports (Youth research user interface of eSports games (Block et al., 2018).
newsletter, 2018)
In this study, efficiency analysis was conducted by
In the eSports games shown in Figure 1, they have to considering 27 games that are ranked in the top 200
show different performances to win according to the games on the e-charts website in 2018 (Esports charts,
games. For example, while speed and correct decision 2019). With this analysis, the efficiencies and changes
is effective in one game, using resources effectively in of efficiencies of the games in 2018 were tried to be
another game is more effective in winning the game. obtained. The reasons for ineffectiveness were
To connect to any server and get a better idea of what determined and it is aimed to develop future targets. In
eSports is, it is necessary to understand the eSports Classic Data Envelopment Analysis models, prize
ecosystem. Game Companies, Competitions, Teams, money given per tournament is considered as input
Platforms, Players, Brands, Fans are defined as actors variables; hours of watch, peak viewer, average
in the eSports ecosystem. viewer, peak channels, average channels, and players
were determined as output variables. In the second
In eSports, each game and tournament sets its own part, data envelopment analysis is given. In the third
rules. eSports offer many career opportunities such as part analysis, results, and in the last part discussion are
professional athletes, coaches, referees, publishers, given.

Cuadernos de Psicología del Deporte, 22, 2 (abril) 261

 Güral et al.

MATERIAL AND METHODS DEA is a convenient way to analyze existing data

appropriately to help individual decision-makers build
In a production area, a production function can be
the best organization and generate new managerial and
formed by using regression equations using input and
theoretical ideas by identifying the best frontier
output data. However, this function is the product of a
values. The advantages of this method and the results
parametric approach that shows how much output can
that can be obtained are given as follows (Charnes et
be achieved on average with a given input. However,
al., 1994),
the main objective is to achieve maximum output with
a certain input in the production function in efficiency
- Gives results based on individual observations as
measurements. In this respect, the regression equation
opposed to mean density,
obtained by the Least Squares method is technically
inadequate. The non-parametric linear programming- - Determines the source of ineffectiveness by
based DEA method is used frequently to overcome
determining effective and ineffective decision units,
this deficiency. This method is able to evaluate a
multi-input and multi-output production process and - Providing the optimal input combination as a single
determine the appropriate efficiency components with total value to produce the desired outputs,
the theoretical infrastructure of the production
economy (Tarım, 2001). In addition, DEA determines - It helps to identify the units that will make reference
the effective ones among DMUs and makes to inefficient decision units,
comparisons according to these DMUs. It was first
introduced in the literature by Farrell in 1957. In the - Simultaneously use multiple inputs and outputs sets
following years, it was tried to be developed by or even dummy variables in calculations,
different researchers. It was examined in detail by
Charnes, Cooper, and Rhodes in 1978 and has taken - DEA calculations give appropriate results for
its current form (Charnes et al., 1978). exogenous changes,
The DEA method was first used by Charnes, Cooper, - Does not require the production relationship to be
and Rhodes (CCR), and later, the model (BCC) was limited to the functional form,
developed by Banker, Charnes, and Cooper. The DEA
analyzes according to a method leading to the frontiers - Determine the most appropriate criteria for the
rather than the central tendency (mean values) and relative development of each decision unit.
involves the creation of a linear surface that can grasp
the observed extreme values. The most important The number of decision units with s input and m
feature of this method is the ability of decision units to output should not be less than 𝑛 = 𝑚 + 𝑠 + 1 and
determine the level and source of inefficiency. Input the decision-making unit should be at least twice the
and output-oriented efficiency analysis can be number of variables (Boussofiane et al., 1991). The
performed in two stages and it is preferred by output-input ratio that satisfies the maximization
economists, industrial engineers, and managers condition can be expressed mathematically as follows
(Charnes et al., 1994). (Cooper et al., 2000),

The decision unit constituting the efficiency limit is

determined and summarizes the status of each unit as
a relative efficiency score. ∑#
"$% 𝑎" 𝑌"!
𝑀𝑎𝑘𝑠 𝑓! = '
∑&$% 𝑏& 𝑋&!
The distance or inefficiency levels of inefficiency
units to the frontier are determined with reference to # '
the specified efficiency limit, and decision-makers can 0 ≤ 2 𝑎" 𝑌"( 32 𝑏& 𝑋&( ≤ 1 ; 𝑗 = 1,2, … , 𝑛
develop their situation with objectives that will "$% &$%
improve their situation with reference units.
𝑎" > 0 ; 𝑖 = 1, … , 𝑚

Cuadernos de Psicología del Deporte, 22, 2 (abril)

262
 Performance of Esports Games with Data Envelopment Analysis

𝑏& > 0 ; 𝑟 = 1, … , 𝑠 Super Efficiency Model

Some disadvantages of the DEA method can be listed In the first step, the dual of the CCR-I model is solved
as follows (Perman, 1991), to find the best value 𝛷∗ of the objective function. In
the second step, using 𝛷∗ , we get the values of dual
- DEA is very sensitive to measurement errors since it variables 𝜆∗ , 𝑆&∗ , 𝑆"∗ .
is based on the maximum frontier technique,
' #

- Although it is sufficient to measure the performance 𝑀𝑖𝑛𝛷! − Ɛ 2 𝑆&+ − Ɛ 2 𝑆",

of decision-making units, it is insufficient in terms of &$% "$%
absolute effectiveness assessment,
-

- Does not allow the use of statistical test tools as a 𝑆&+ + 2 𝜆(! 𝑋&( − 𝛷! 𝑋&! = 0
non-parametric technique, ($%

- It can perform a static or comparative static analysis, -

not suitable for dynamic analysis, −𝑆", + 2 𝜆(! 𝑌"( = 𝑌&!

($%
- Large-scale problems may take a long time to be
solved unless appropriate and convenient package 𝜆(! , 𝑆&+ , 𝑆", ≥ 0
programs are used.
For an ineffective DMU to be effective, target values
Charnes, Cooper, Rhodes (CCR) are calculated using the following formula.
CCR is a basic DEA model developed by Charnes, 𝑋&! = 𝛷!∗ 𝑋&! − 𝑆&+∗ ; 𝑟 = 1, … , 𝑠
Cooper, Rhodes. The input-oriented CCR is related to
how much input is reduced to achieve the desired 𝑌"! = 𝑌"! + 𝑆",∗ ; 𝑖 = 1, … , 𝑚
output. Output-oriented CCR is related to how much
output level will increase with the amount of input RESULTS
available.
In this study, efficiency analysis was conducted by
CCR-I considering 27 games that are ranked in the top 200
games on the e-charts website in 2018 (Esports charts,
The input-oriented CCR is related to how much input 2019). With this analysis, the efficiencies and changes
is reduced to achieve the desired output. Primal CCR- of efficiencies of the games in 2018 were tried to be
I model and dual are as follows, obtained. In this study, efficiency analysis was
#
conducted by examining 27 games from eSports
games whose data can be reached on the e-charts
𝑀𝑎𝑘𝑠 2 𝑎"! 𝑌"! ; 𝑘 = 1, … , 𝑛 website in 2018.
"$%
# '
The input used in the analysis is the awarding prize per
2 𝑎"! 𝑌"( − 2 𝑏&! 𝑋&( ≤ 0 ; 𝑗 = 1, … , 𝑛
tournament. Outputs; players, hours of watch, peak
"$% &$%
) viewers, average viewers, peak channels, average
channels. The output-oriented model was evaluated
2 𝑏&! 𝑋&( = 1
using DEA EXCEL SOLVER. The efficiency values
&$%
of eSports games and the ranking among themselves
𝑎"! ≥ 0 ; 𝑖 = 1, … , 𝑚 are given in Table 1. The actual data and
improvements of the eSports games as a percentage
𝑏&! ≥ 0 ; 𝑟 = 1, … , 𝑠 difference are given in Table 2.

Cuadernos de Psicología del Deporte, 22, 2 (abril) 263

Cuadernos de Psicología del Deporte, vol. 22, 2, 258-267 © Copyright 2018: Servicio de Publicaciones de la Universidad de Murcia
Recibido: 01/10/2021 Murcia (España) ISSN edición impresa: 1578-8423
Aceptado: 08/10/2021 ISSN edición web (http://revistas.um.es/cpd ): 1989-5879

Table 1. Efficiency Scores of eSports games

Game No DMU Score Rank

1 Counter-Strike: GO 1 1
2 Shadowverse 0,0005 27
3 Fortnite 0,4548 6
4 Dota 2 0,0729 19
5 Starcraft II 0,367 8
6 Player unknown’s Battlegrounds 0,265 10
7 Fifa 18 0,0364 22
8 League Of Legends 0,4475 7
9 Street Fighter V 0,1212 17
10 Rocket League 0,1363 15
11 Quake Champions 0,1619 14
12 Hearthstone 0,5273 4
13 Rainbow Six Siege 0,1255 16
14 Tekken 7 0,2565 11
15 Madden NFL 0,0053 26
16 Warcraft III 0,8578 3
17 Magic: The Gathering Arena 0,1648 13
18 Minecraft 1 1
19 Osu! 0,4692 5
20 Overwatch 0,2043 12
21 World Of Warcraft 0,3399 9
22 Heroes Of The Storm 0,0211 23
23 Smite 0,0134 24
24 Call Of Duty 0,0946 18
25 Gwent 0,0551 20
26 Clash Royale 0,047 21
27 Paladins 0,0106 25

In Table 1, 27 games included in the research are listed

according to their efficiency score. In addition,
Counter-Strike: GO and Minecraft are efficient games.
The other 25 games are listed according to these two
games. Counter-Strike: GO and Minecraft games are
followed by Warcraft III, Hearthstone, Osu! games.

Correspondence to: Yunus Güral. Address: Firat University, Faculty of

Science Elazığ, TURKEY. Email: ygural@firat.edu.tr

Cuadernos de Psicología del Deporte, 22, 2 (abril)

 Performance of Esports Games with Data Envelopment Analysis

Table 2. Efficiencies of eSports games

Input Output
GAMES Awarding Watched Hours Peak Viewers Avg. Viewers Peak Channels Avg. Channels Players
Prize/Tournaments
Diff. Diff. Diff. Diff. Diff. Diff. Diff.
DMU Data (%) Data (%) Data (%) Data (%) Data (%) Data (%) Data (%)

1 27364,6 0 402290000 0 5101790 0 552589 0 24248 0 11939 0 4548 0

2 1310000 -99,9 10042220 88,6 176595 0 18342 41,3 822 243,2 369 290,6 24 0
3 115263 -54,5 1358990000 12,6 8529075 65,4 1857676 12,7 232381 0 108920 9,08 1442 0
4 252488 -92,7 473750000 0,1 3942343 16,5 649072 0 14484 356,3 7070 376,8 1114 0
5 9152,96 -63,2 61820000 14,8 749314 0 84660 14,8 1914 331,2 1127 271,6 352 0
6 71500 -73,5 454550000 0,17 3029210 49,8 623419 0 41732 43,8 24239 26,1 1459 0
7 62234,7 -96,3 40377080 22,2 482770 6,4 67106 0,73 5931 0 1471 104,8 223 0
8 81896,7 -55,2 986730000 0,14 6300484 49,1 1352056 0 42274 236,6 25520 184,7 1795 0
9 24957,2 -87,8 30040000 183,7 796242 0 45145 158,3 1519 732,6 571 1031,9 113 0
10 31045,5 -86,3 49260000 114,7 1037249 0 67447 114,6 6997 105,8 3665 100,3 287 0
11 4928,54 -83,8 10141390 31,7 156995 0,64 18328 0 1090 1,39 500 10,7 117 0
12 21638,9 -47,2 358090000 0,17 1884864 70,6 490557 0 9234 515,1 3194 810,2 64 10,5
13 47024,4 -87,4 116070000 29,5 1276949 14,5 159329 29,2 20497 1,38 10600 0 373 0
14 9125,68 -74,3 19469830 248,7 627213 0 31924 190,9 1151 791,4 552 850,2 69 0
15 259000 -99,4 13462510 199,4 166516 121,8 20713 166,2 6172 0 2565 23,1 32 0
16 1563,75 -14,2 24690000 40,4 335293 0 37233 27,4 925 423,7 500 394,3 80 0
17 10000 -83,5 50860000 0,7 375429 22,8 70044 0 2365 240,7 917 349,7 16 0
18 1613,05 0 50710000 0 454576 0 69347 0 8030 0 4110 0 10 0
19 4320 -53,1 10518140 264,7 143158 198,1 15893 230,9 3451 12,7 1965 0 255 0
20 69369,4 -79,57 302540000 0,12 2535760 25,4 415003 0 31517 13,2 15515 16,7 1452 0
21 27407,4 -66,0 260540000 9,7 2046032 26,3 356585 9,6 44676 0 12426 83,9 124 0
22 155214 -97,8 66690000 0,06 530117 35,2 91457 0 3735 99,1 2235 68,5 368 0
23 107591 -98,6 24440000 27,4 243086 33,7 33763 26,4 3725 0 1871 1,12 143 0
24 15872,1 -90,5 11082800 203,5 78114 342,7 17414 164,5 3924 5,9 2114 0 139 0
25 24397,7 -94,5 16581440 127,9 353419 0 24942 107,3 881 535,7 342 736,9 51 0
26 21775,9 -95,3 13485850 104,6 262273 0 31672 19,2 557 613,8 321 532,5 50 0
27 93166,7 -98,9 9459060 131,8 161125 40,6 21704 38,4 2555 4,9 1363 0 94 0

In Table 2, the comparisons of the other 25 games findings: the top five games include Counter-Strike,
against the two efficient games are given. The outputs Minecraft, Warcraft III, Hearthstone, and Osu! games.
obtained in response to the awarding prize selected as For Warcraft III to be effective, it should reduce the
input are shown in Table 2. According to the results of awarding price by 14%; it should increase watched
the research: CS and Minecraft were determined to be hours by 40.4%, average viewers by 27.4%, peak
effective games (Efficiency score = 1). Since the other channels by 423.7%, average channels by 394.3%. For
25 games are inefficient, the target values for these Hearthstone to be effective, it should reduce the
games are shown in Table 1. According to the awarding price by %47.2 %; it should increase

Cuadernos de Psicología del Deporte, 22, 2 (abril) 265

 Güral et al.

watched hours by 0.17%, peak viewers by 70.6%, the tournament. This important factor can reduce the
peak channels by 515.1%, average channels by participation of amateur participants in tournaments
810.2%, players by 10.5%. For Osu! to be effective, it where prize money is very high. Therefore, due to the
should reduce the awarding price by 53.1%; it should lack of amateur participants in eSports games, factors
increase watched hours by 264.7%, peak viewers by such as the time of watching the tournament, the
198.1%, average viewers by 230.49, peak channels by number of viewers, the number of channels watched,
12.7%. Improvements for other ineffective games to and the number of players affect the decrease. This
be effective are given in Table 2. fact can be observed in the study. Some numerical
values given in the results of the study emphasize that
DISCUSSION the prize money of the eSports games that were
effective in the 27 eSports tournaments discussed in
In this study, 27 games in the eSports game sector the study is less than the other 27 tournaments. In
were evaluated by using DEA. The results of the addition, the conclusion that the prize money should
efficiency analysis were obtained using CCR-I. Many be reduced in order to increase the efficiency of the
researchers have studied the performance of players other teams participating in the tournament is an
(both professional and non-professional players) in the important finding obtained from the research. One of
field of eSports (Khromov et al., 2019), the effect of the important factors in eSports games is the high
country levels for a single game (Parshakov, 2018). participation rate. In particular, according to the
However, eSports games are quite complex today and information presented in reference (Parshakov, 2018),
many variables affect game performance. In this it is said that “a 1% increase in prize money causes an
respect, when we consider the e-sports games as a increase of 2.2% per player”. In such a case, the
whole, we see a complex structure. Analysis of this increase in the prize money does not cause an increase
structure is possible by comparing the performance of in the participant, on the contrary, it causes a decrease
the game by properly defining the relevant variables. in the participant and an increase in the prize money
In this respect, the study is completely different from per capita. In this case, the effectiveness of the eSports
other studies in the literature. In this study, we have game decreases. Evaluation of eSports games in terms
obtained striking results by considering popular of effectiveness is not common in other studies on this
eSports games and important variables. As a result, subject. In the studies on the subject in the literature,
when eSports games are compared with each other, it the characteristics that affect the success of the players
is focused on which variables of other games should in eSports tournaments were examined, as in the
be improved according to the games that are effective reference (Pérez-Rubio et al., 2017; Rodríguez
from the numerical values in Table 2. González et al., 2018).

Sport is an activity that can be done individually or as REFERENCES

a team. Team sports have been the focus of attention
of people since ancient times. For this reason, sports 1. Akbulut, H. (2009). Dijital oyun rehberi
tournaments organized in every age have succeeded in (Gelenekselden dijitale, mekandan uzama oyun
bringing large communities together. With the kültürü (Der.)). Kalkedon Yayınları, 45.
developing technology, sports games can also find
players and audiences in virtual environments. Today, 2. Argan, M., Özer, A., & Akın, E. (2006).
eSports tournaments held in the virtual environment Elektronik Spor: Türkiye’deki siber sporcuların
continue to be the focus of attention with the tutum ve davranışları. Spor Yönetimi ve Bilgi
opportunities they offer to the participants. While Teknolojileri Dergisi, 1(2), 1306-4371.
there is a group of players who choose eSports as a https://doi.org/10.1501/sporm_0000000204.
profession, there is also a group of players who 3. Block, F., Hodge, V., Hobson, S., Septhon, N.,
participate in these eSports games as amateurs. Most Devlin, S., Ursu, M.F., Drachen, A., & Cowling,
of the participants in eSports games are amateur P.I. (2018). Narrative Bytes: Data-Driven content
participants. For such participants to decide to production in esports. TVX 2018 - Proceedings of
participate in an eSports tournament, it is an important the 2018 ACM International Conference on
factor that they carry the psychology that they can Interactive Experiences for TV and Online Video.
compete with the professional athletes participating in

Cuadernos de Psicología del Deporte, 22, 2 (abril)

266
 Performance of Esports Games with Data Envelopment Analysis

New York, NY: ACM Press, 29-41. 13. Parshakov, P., & Marina A. Z. (2015). Success in
https://doi.org/10.1145/3210825.3210833. eSports: Does country matter?. Emerald, 211-232.
https://doi.org/10.2139/ssrn.2662343.
4. Boussofiane, A., Dyson, R.G., & Thanassoulis E.
(1991). Applied data envelopment analysis. 14. Parshakov, P. (2018). Determinants of
EJOR, 52(1), 1-15. https://doi.org/10.1016/0377- performance in eSports: A country-level analysis.
2217(91)90331-O. International Journal of Sport Finance, 2018,
13(1), 34-51.
5. Charnes, A., Cooper, W.W. & Rhodes, E., (1978).
Measuring the efficiency of decision making 15. Pérez-Rubio, C., González, J., & Garces de los
units. European Journal of Operational Research, Fayos, E. (2017). Personalidad y burnout en
2, 429 444. https://doi.org/10.1016/0377- jugadores profesionales de e-sports. Cuadernos de
2217(78)90138-8. Psicología del Deporte, 17(1), 41–50.
https://revistas.um.es/cpd/article/view/291901.
6. Charnes, A., Cooper, W., Lewin, A.Y., & Seifard
L.M., (1994). DEA, Theory, methodology and 16. Perman, R., (1991). Cointegration: An
applications. Springer. introduction to the literature. Journal of Economic
https://doi.org/10.1007/978-94-011-0637-5. Studies, 18(3), 15-28.
https://doi.org/10.1108/EUM0000000000151.
7. Cooper, W. & Seifard, L.M. (2000). DEA: A
Comprehensive Text with Models, Applications, 17. Rodríguez González, C., & Del Moral Pérez, E.
References and DEA-Solver Software. Kluiwer (2018). Enhanced skills with e - Sport League of
Academic Publishers, London. Legends: unique case design. Interuniversity
Journal of Research in Educational Technology,
8. Coşkun E., & Öztürk C. M. (2016). Steam
(4). https://doi.org/10.6018/riite/2018/333771.
dünyası: dijital oyun bloglarına yönelik bir
değerlendirme. Gümüşhane Üniversitesi İletişim 18. Yılmaz, E., Çağıltay, K. (2004). Elektronik
Fakültesi Elektronik Dergisi. 4(2), 667-702. oyunlar ve Türkiye. TBD 21. Ulusal Bilişim
https://doi.org/10.19145/gujofoc.04411. Çolak, Kurultayı. Ankara.
S., Örs, A., Çolak, E., Son, M., Güzelordu, D.,
19. Youth research newsletter, (2018) E-Sports report.
Çolak, T., & Yargıcı, M. (2018).
T.C. Ministry of Youth and Sports. 5(1). Retrieved
9. Research on knowledge level of faculty of sports from
science students about e-sports. KOSBED, 35, http://yayinlar.gsb.gov.tr/Public/Files/2018.05.14
121-127. _16.57.28_espor-raporu-say%C4%B15.pdf.
10. Esports charts, (2019). E-charts. 20. Wagner, M. (2006). On the scientific relevance of
https://escharts.com/games. esports. In Proceedings of the 2006 İnternational
Conference on Internet Computing and
11. Hamari, J., & Sjöblom, M. (2015). What is esports
Conference on Computer Game Development.
and why do people watch it?. Internet Research.
LasVegas, Nevada: CSREA Press, 437-440.
27(2), 211-232. https://doi.org/10.1108/IntR-04-
2016-0085. 21. Tarım, A. (2001). Veri zarflama analizi
matematiksel programlama tabanlı göreli etkinlik
12. Khromov, N., Korotin, A., Lange, A., Stepanov,
ölçüm yaklaşımı. Sayıştay Yayınları araştırma
A., Burnaev, E., & Somov, A. (2019). Esports
inceleme ve çeviri dizisi, 15, Ankara.
Athletes and Players: A Comparative Study. IEEE
https://doi.org/10.1501/sbfder_0000001878.
Pervasive Computing, 18(3), 31-39.
https://doi.org/10.1109/MPRV.2019.2926247.

Cuadernos de Psicología del Deporte, 22, 2 (abril) 267

 © 2022. This work is published under
https://creativecommons.org/licenses/by-nc-nd/3.0/es/(the “License”).
Notwithstanding the ProQuest Terms and Conditions, you may use this
content in accordance with the terms of the License.