Website Development and Evaluation in The Chinese Tourism Industry
Website Development and Evaluation in The Chinese Tourism Industry
Website Development and Evaluation in The Chinese Tourism Industry
Abstract.— The web-based technologies have become a strategic necessity for tourism organizations. Through
switching to online services, tourism organizations are achieving better positions in the digital-based com-
petitive market. The Chinese tourism industry is investing in the development of a ‘Golden Tourism Project’
which includes tourism E-commerce website development and evaluation as one of main parts. This study
investigates tourism E-commerce website development in China from three perspectives: the tourism website
functionality, the tourism website user and the tourism website provider. Based on a web search and a ques-
tionnaire survey, this paper analyses the distribution and classifications of tourism websites, explores the
functionality of these websites, and assesses user satisfaction for current tourism websites. The results show
that the majority of tourism website providers are regional tourism destination organizations that mainly
provide comprehensive local tourism information and services. The results also show the level of regional eco-
nomic development has a significant impact on the construction of these local tourism websites. It is found
that obtaining information is still the main aim of web users, however, the difficulties are slow Internet
access. Finally, through a web master interview, this paper discusses the main barriers in developing high
quality websites for tourism organizations in China.
Résumé.— “Développement de sites Web et tourisme en Chine”. La maîtrise des technologies de l’Internet
est devenue une nécessité stratégique pour l’industrie touristique. L’auteur étudie les sites web chinois rela-
tifs au tourisme. Il souligne que, parmi les difficultés, la lenteur des transactions est un frein important.
INTRODUCTION
technologies, a whole new set of challenges and opportunities are made available
for the tourism industry, including travel, accommodation, and tourist destination
organizations. In the last few years, both tourism suppliers and tourism agencies
have started to offer their products and services directly online. They have thus
obtained benefits in reducing service costs, providing more effective service and
attracting customers. Web-based technologies are also facilitating tourists to access
useful and up to date information, search tourist product catalogues, and make
variable bookings.
Tourism E-commerce in developed countries has been studied. For example,
Rita (2000) reported the promotion and management of tourism destinations
through web-based destination marketing system by analysing ten European web-
sites. Cano and Prentice (1998) proposed a communication concept for the design
and management of websites for tourism businesses and presented tourism web-
sites developed in Scotland. Standing and Vasudavan (2000) explored the levels of
planning and strategies used by Australian travel agencies when investigating the
use of the web. Burgess et al. (2001) explored the level of uptake of the web as a
marketing tool by businesses in the regional tourism industry sector in Australia.
The Chinese tourism industry has developed its online services and obtained some
initial experience. China, as a developing country, has a different tourism E-com-
merce development environment, barriers, challenges and requirements that are
indicative of a developing country compared to these of a developed country.
However, there is no research into the classification and evaluation of tourism web-
sites in China. Although in the case of general website assessment, some publica-
tions of results do exist but they do not specifically address tourism websites in
developing countries.
The objectives of this study are to explore the distribution and classification
of tourism websites (online services), evaluate the development of tourism web-
sites and identify existing problems. The main research methods used in the study
include a questionary survey, a web search and a web master interview. The find-
ings of the study are expected to assist Chinese government tourism administrative
departments and tourism website providers to understand current user require-
ments and to support planning for further tourism website development, particu-
larly, to help the implementation of ‘Golden Tourism Project’.
Following the introduction, website evaluation methods and frameworks are
reviewed in Section 2. Section 3 presents the research methods used in the study.
Section 4 explores the distribution, classification and functionality for tourism web-
site development in China. Section 5 assesses user satisfaction, consisting of two cat-
egories : information of contents and ease of use. Principal barriers and challenges
to tourism organizations in the development of online tourism services in China are
discussed in Section 6. Section 7 is the conclusions. This study does not distinguish
websites and E-commerce websites, as the methods for website evaluation can also
be employed for E-commerce website evaluation (Hahn and Kauffman, 2002).
WEBSITE DEVELOPMENT AND EVALUATION IN THE CHINESE TOURISM INDUSTRY 193
E-commerce website evaluation has been studied and many research frame-
works and models have been proposed, such as Rayman-bacchus and Molina
(2001), Kaukal et al. (2000). These studies used various research approaches, such
as survey, web search (observation), case study and conceptual modelling, to con-
duct research into E-commerce websites assessment models, evaluation frame-
works, cost benefit analysis and customer satisfaction measurement. It has been
found that websites are increasingly being measured not only with the use of com-
puter-to-computer techniques but also with business values and customer satisfac-
tion. In general, website evaluation research results can be categorised into four
classes : (1) application functionality evaluation ; (2) cost benefit analysis ; (3) cus-
tomer (user) satisfaction assessment ; and (4) success factors identification.
The websites functionality evaluation focuses on online service functions pro-
vided by E-commerce websites. Most such evaluation frameworks and models are
from a customer perspective to investigate the extent, scope and comprehensiveness
of the online offering. Some authors such as Elliot (2000) and Lu et al. (2001) address
general functions provided by websites. Elliot (2000) proposed a website functional-
ity evaluation framework which consists of six categories each with five elements
which in principle reflect a growing level of sophistication. The first category is com-
pany information, the second category is about product and service information and
promotion, the third category is transaction processing, the fourth one is customer
services, the next one is ease of use and the last one is innovation in services and
technology. Lu et al. (2001) gave a seven-function evaluation model and used the
seven functions as criteria to classify websites. Another set of studies focus on web-
site development in specific industries. For example, Barnes and Vidgen (2000)
reported an evaluation result of Internet bookshop websites. Through data analysis,
the research examined the validity and reliability of bookshop websites and provid-
ed an interpretation of the results. Standing and Vasudavan (2000) analysed the func-
tionality of the travel agencies’ websites in Australia, and investigate the marketing
models used and the types of information provided by these websites. Literature
review also shows that some research attempts to identify the relationships between
the functionality and customer satisfaction such as Rehesaar (2001). The main pur-
pose of these studies is to identify which E-commerce application function is partic-
ularly important for attracting customers and improving customer satisfaction.
Cost benefit analysis is one of the popular methods to evaluate an informa-
tion system. As an E-commerce application is a kind of information systems, many
researches have attempted to identify main cost benefit factors and conduct cost
benefit analysis for E-commerce applications such as Lu (2001) and Brown (2002).
The core cost factors identified in Lu (2001) include the expense of setting up E-com-
merce, maintaining E-commerce, Internet connection, hardware/software and rapid
technology changes. The core benefit factors include accessing a greater customer
194 NETCOM, vol. 16, n° 3-4, 2002
base, broadening market reach, lowering of entry barrier to new markets, alternative
communication channel, increasing services, enhancing perceived company image
and gaining competitive advantages. There are also some studies addressing the
evaluation of E-commerce investments such Dohety and McAulay (2002) and
Mehler-Bicher (2002). The evaluation for business value of E-commerce is discussed
in literature as well. For example, Lee et al. (1999) proposed a framework for eval-
uating business value of B2B E-commerce. One of the main differences between E-
commerce applications and traditional information systems is that E-commerce
applications can be operated by both internal and external users. E-commerce appli-
cations will thus benefit both suppliers and customers. This issue has attracted atten-
tion too. For example, Poon (1999) explored the E-commerce benefit for partner
firms, competitors, suppliers and customers.
Customer satisfaction (user satisfaction) as an important aspect to evaluate
websites has prompted the research community to explore how to measure and
model it. Customer satisfaction is positively related to the provision of customer
needs (Woodroof and Kasper, 1998). Web-based E-commerce applications are alter-
ing the ways in which businesses operate and interact with customers. In general, an
E-commerce application fits within three classifications : pre-sale phase which focus-
es on attracting customers, online sale phase which makes the E-commerce trust-
worthy and dependable, and after-sale phase which should obtain customer satis-
faction by meeting demand and pleasing customers (Liu and Arnett, 2000). Recent
studies have found that convenient site design and financial security had a signifi-
cant effect on customer assessment for E-commerce applications. Lu and Zhang
(2002) proposed a set of criteria to assess customer satisfaction, including informa-
tion content satisfaction, usability satisfaction, security satisfaction, convenience sat-
isfaction, efficiency satisfaction and flexibility satisfaction. Each of the factors may
imply more detailed criteria. For instance, usability satisfaction involves user satis-
faction in information up-to-date, clear language style and links to appropriate
resources. E-service website format design, facilitated browsing, search engine pro-
vided, accessing speed and customer control of a transaction process are considered
as sub-criteria for convenience satisfaction. However, companies have become
aware that while an E-commerce application can be technically successful, but still
be considered a failure if their customers are dissatisfied with the services (Trepper,
2000). Customer satisfaction has become one of the dominant factors for the success
of an E-commerce application.
Liu and Arnett (2000) proposed a framework to identify website success fac-
tors. Through completing a survey of 1 000 website masters, four factors that are
critical to website success were identified : information and service quality, system
use, playfulness and system design quality. More recently, Al-Mashari and Al-Sanad
(2002) lists a number of critical success factors for E-commerce through analysing
several reported case studies of successful E-commerce applications. Totally 14 suc-
cess factors were identified based on an analysis for the case Dell (www.dell.com).
WEBSITE DEVELOPMENT AND EVALUATION IN THE CHINESE TOURISM INDUSTRY 195
These factors include user-friendly web interface, top management support, main-
taining strong links with customers and suppliers, powering website with strong
search engine, ensuring customer acceptance, and providing up-to-date informa-
tion. From an E-marketing point of view, Rita (2000) indicated that successful web
marketing requires an articulated approach to three critical tasks : website design,
promoting the website and assessing the website marketing effectiveness.
that were not relevant to the tourism activities and behaviour of tourists, such as
‘Tourist shoes factory web’. Finally, from the 2,710 websites, 912 tourism websites
were identified for the study. However, some tourism websites were not included
as they did not have the word ‘tourism’ as part of their registered name. From the
912 websites identified, relevant data were collected for the study during 4 to
24 November 2001.
Finally, a total of 15 tourism websites were randomly selected from those
tourism websites registered in Hebei province. The 15 tourism websites belonged
to nine cities (regions) of twelve Hebei province cities. The research group tested
web information and service functionality presented in the 15 websites. The group
also evaluated these websites and contacted several web masters in order to iden-
tify existing problems in tourism website development.
120
100
80
60
40
20
0
i i i i ui in n g g xi xi i i
ng a su ng ou an ng an e e an ng an x j a n n ou lin n ng gu su ia a ng x
iji gh ng do zh en jia hu Hub Heb un oni nn ang Anh ian uji gqi jia han ang izh Ji aina jia ng an ngx ngh iza han
Be han Jia an ng H he Sic H ia Yu u T F n ng S Ji u H i n
X ei m
e G i
N Q
i X S
S Sh Gua Z L G ho lo G
C Hei N
in all 31 provinces of China. (Taiwan and Hong Kong are not included for this
study.) The diffusion of tourism information has played an important role in trans-
forming neutral resource advantages to marketing advantages. It also can be found
from Figure I that the level of regional economic development has a significant
impact on the construction of local websites. From the 912 selected websites, 67 %
are distributed in Southeastern coastal of provinces as these regions have higher
levels of economic development. Five coastal provinces (Beijing, Shanghai,
Shandong, Guangdong, and Zhejiang) have more than 50 tourism websites.
In order to explore the significance of tourism website development, the
study also analyses the relationships between the level of local economic develop-
ment, (particularly tourism economic development), the number of websites, and
the number of web users from the data of CNNIC (2001). The results (Figure II) show
that local tourism economic development is relevant to the average consumption
%
70
60
50
40
30
20
10
0
ilo Jilin
g
Sh ei
N gxi
Jia g
g
Sh jing
N ai
ing
Q su
xia
ng
g
Tia ai
ing
i
Zh su
Gu an
Gu ng
ng
Ga i
Jia n
Sic n
an an
Yu u
Ha xi
an
H i
hu
Sh ngx
x
be
Ch njin
na
n
en
o
an
jia
ina
an
b
an
h
g
gh
n
ng
jia
za
izh
hu
o
do
Gu un
nn
An
an
He
ing
ing
gq
on
an
Hu
eim
i
He
eji
Fu
nji
gd
Be
Sh
an
ng
Xi
an
Lia
on
Xi
He
Figure II.– The relationships between regional distribution of web users, tourism websites average
consumption level, and tourism income/GDP.
198 NETCOM, vol. 16, n° 3-4, 2002
level and tourism income/GDP. The correlation coefficient between the distribution
of users and tourism income is 0.88695. The distribution of users and average con-
sumption level is 0.89156, and the distribution of tourism websites and tourism
income is 0.94705.
Personal, 0.3
Tourism destination
Provider
organization, 64.58
Accommodation, 16.56
Others, 9.38
Regional comprehensive
service, 53.83
Service
Series 1
addresses to allow customers to make enquiries about products and services. Only
4 % provided brochures, maps and other associated tourism information. This is a
weak aspect when compared with developed countries.
The third function is similar to the second one, but it has a more effective
way of attracting potential customers to buy tourism products and services as it pro-
vides prices. However, for some businesses, it is difficult to present product/serv-
ice prices on the web, for example, for tour guide and language translators.
200 NETCOM, vol. 16, n° 3-4, 2002
700
600
500
400
300
200
100
0
e
s
rs
ck
k
l
ns
es
s
y
ip
n
g
or
ai
w
nc
el
oo
lin
er
io
in
to
ba
ag
io
em
ne
sp
ot
rie
at
qu
ds
ok
isi
b
ct
ism
ed
ck
an
lic
fv
en
's
ism
bo
tra
pe
ct
e
pa
or
Fe
pp
Tr
ur
in
ta
ro
fri
ex
at
ur
e
sit
To
nl
on
ra
in
ism
ild
be
To
of
ng
Vi
nl
C
be
Bu
um
n
ur
O
gi
io
em
To
an
N
at
M
ch
rm
Ex
fo
In
Figure V.– The number and percentage of 15 functions offered by selected websites.
202 NETCOM, vol. 16, n° 3-4, 2002
information’ has listed first. Therefore, as obtaining information is still the main aim
of web users, improving the quality and level of web information presentation and
management are major tasks for current tourism website development.
Page design, associate information, target user service, information dynam-
ic/update, and information integrity are the factors of information content used in
the survey. The main aspects of dissatisfaction in page design are unclear classifi-
cation for content and not user-oriented design. In associated information provi-
sion, there is a lack guidance and information in maps, healthcare, culture and law.
No clear targeted user service and poor information updates and integration were.
About 24 % of responses indicated that tourism information provided in tourism
websites did not meet their requirements.
In general, a tourism activity involves the six basic tourism elements : eating,
accommodation, travelling, wandering, relaxation, and shopping. Tourism website
users would like to get relevant information for the six elements from a destination
website before they go on tour. Tourism websites thus should be built with suffi-
cient links to other relevant sites and have the ability to develop various packages
that integrate a group of relevant services. However, through testing the selected
websites, the reality is that most tourism websites do not have links to relevant sites
or they only have implemented an overly simplistic page. For example, from a
national park website, customers can only find a list of local hotels but there is no
link to a hotel website. The name of the hotel does not allow for a direct booking
and this complicates planning.
Today, the number of business tourists and private tourists are rapidly
increasing in China. The two categories of tourists have different travel purposes
and requirements concerning travel, accommodation, tourism activity and time
duration. Tourism websites are expected to offer services to different target groups
of tourists. However, most tourism websites in China only focus on private tourists,
or do not specify their target groups. Obviously, some websites should focus on
customers and some should focus on private tourists, and some on both. For exam-
ple, an industry exhibition activity or a conference center website should concen-
trate on business tourists, a zoo website should focus on private tourists and a hotel
should cater for both.
Like any type of information system, the key factor for developing a success-
ful tourism online application is to correctly define user requirements. Some tourism
204 NETCOM, vol. 16, n° 3-4, 2002
websites are not satisfactory due to ill-defined requirements that do not meet the
expectations of users. E-commerce technology is still a new experience for most
tourism managers and tourists. The tourism organization managers cannot clearly
define expectations and do not have enough online service experience and online
service feedback from their customers. Therefore, website developers have to be
leaders in the process of defining user (external customer) requirements. The pres-
ent situation is one of the main reasons for user dissatisfaction with many aspects of
current tourism websites.
Users have to make a phone call or fax for booking. Another problem is online
security for payment.
CONCLUSIONS
Online tourism services have been developing in China for several years.
However, many aspects of online tourism services need to be improved. This study
investigates online tourism service development in China from three perspectives :
the tourism website, the tourism website user and the tourism website provider
(organizations). From a website perspective, the study finds that there is a higher
percentage in the regional compressive websites developed by government tourism
departments. These websites aim to provide services, not to conduct business,
which is different from websites hosted by companies. From an E-government point
of view, these websites will be a part of E-government. However, most tourism web-
sites have only implemented basic functions, providing information and email reser-
vations. Very few websites can perform online transactions. As most tourism web-
sites are available only in Chinese, they can thus only provide services to local
tourists and lost a place in global market. From the users’ side, the difficulties are low
Internet access speed. The main unsatisfactory aspects are poor web information
provision and a lack of interactive support. As an example, many accommodations
have not built their own websites but only provided information on an isolated web-
site such as a city site. This makes information update very difficult and users have
to make an offline booking and payment. Tourism organizations see the impact of
WEBSITE DEVELOPMENT AND EVALUATION IN THE CHINESE TOURISM INDUSTRY 207
the web as being significant to the industry, but they have not utilised it as a major
catalyst for change. Most of them have not adopted the web as a strategic initiative
with transformational capabilities. From the tourism organizations interviewed, their
businesses have not obtained obvious benefits from the website but they have
invested in the project.
The primary limitation of this study is that data were gathered from the users
of Shijiazhuang city only. Although Shijiazhuang is a typical middle-level city in
population and economic development the data provided are bounded by local
culture. Further studies could focus on two aspects : (1) to build a three-dimension
framework for exploring the relationships between the results obtained from the
tourism website, the tourism website user and the tourism website provider ; (2) to
conduct performance evaluation of tourism websites in selected websites. The per-
formance evaluation can be used to find a way to improve the business process that
customers can participate in improving business performance.
REFERENCES
AL-MASHARIS M. & AL-SANAD A. (2002). “A best practice model for measuring readiness
levels for e-commerce, e-business and e-government applications”. 9th European
conference on IT evaluation, p. 11-16.
AUSTRALIA DAILY (2002). [Online], Available : http://www.ausdaily.net.au/
BARNES J. & VIDGEN R. (2000). “Information and Interaction quality : evaluating internet
bookshop web sites with Webqual”. Electronic Commerce : The End of the
Beginning, 13th International Bled Electronic commerce conference, p. 426-444.
BROWN A. (2002). “The evaluation of Fortis Bank’s internet business website”. 9th European
conference on IT evaluation, p. 87-98.
BURGESS L., COOPER J. & ALCOCK C. (2001). “The adoption of the web as a marketing tool
by regional tourism associations (RTAs) in Australia”. The twelfth Australasian con-
ference on information systems, p. 493-502.
CANO P.V. & PRENTICE R. (1998). “Opportunities for endearment to place through elec-
tronic visiting-www homepages and the tourism promotion of Scotland”. Tourism
Management, vol. 19, n° 1, p. 67-73.
CHINA NATIONAL NETWORK INFORMATION CENTER [CNNIC] (2001). “China National
Network Information Center” [Online], Available : http://www.cnnic.net
CHINA NATIONAL NETWORK INFORMATION CENTER [CNNIC] (2002). “China National
Network Information Center” [Online], Available : http://www.cnnic.net
DOHETY N. & MCAULAY L. (2002). “The relationship between the ex-ante and ex-post IT
evaluation : reflections from the literature and the practise of evaluating E-commerce
investments”. 9th European conference on IT evaluation, p. 129-136.
ELLIOT S.R. (2000). “Towards a framework for evaluation of commercial web sites”.
Electronic commerce : The end of the Beginning, 13th International Bled Electronic
Commerce Conference, p. 69-86.
208 NETCOM, vol. 16, n° 3-4, 2002
HAHN J. & KAUFFMAN R.J. (2002). “Evaluating selling web site performance from a business
value perspective”. International conference on e-business (ICEB2002), p. 435-443.
KAUKAL M., HOPKEN W. & WERTHNER H. (2000). “An approach to enable interoperabili-
ty in electronic tourism markets”. The 8th European Conference on Information
Systems (ECIS) 2000, p. 1104-1111.
LEE C., SEDDON P. & CORBITT B. (1999). “Evaluating the business value of Internet-based
business-to-business electronic commerce”. 10th Australasian conference on
Information Systems, p. 508-518.
LIU C. & ARNETT K.P. (2000). “Exploring the factors associated with web site success in the
context of electronic commerce”. Information & Management, vol. 38, p. 23-33.
LU J. (2001). “Measuring cost/benefits of e-business applications and customer satisfaction”.
2nd International Web Conference, p. 139-147.
LU J., TANG S. & MCCULLOUGH G. (2001). “An assessment for internet-based electronic com-
merce development in businesses of New Zealand”. Electronic Markets : International
Journal of Electronic Commerce and Business Media, vol. 11, n° 2, p. 107-115.
LU J. & ZHANG G. (2002). “Cost and benefit analysis for e-service applications”.
International Conference of E-business.
LU Z. (2002). “Development and evaluation frameworks for tourism online service in China”.
The Second Wuhan International Conference on Electronic Business, 21st Century
E-commerce : Integration and Innovation, p. 263-273.
LU Z., ZHANG C. & LU J. (2002). “Tourism website development and investment decision in
China”. The International Conference of Group Decision and Negotiation, p. 64-72.
MEHLER-BICHER A. (2002). “Evaluating e-business investments by defining profiles”. 9th
European conference on IT evaluation, p. 317-324.
POON S. (1999). “The effect of industry sector and value systems on internet commerce ben-
efit, Managing IT Resources in Organizations”. IRMA International Conference,
p. 959-964.
RAYMAN-BACCHUS L. & MOLINA A. (2001). “Internet-based tourism service : business
issues and trends”. Futures, vol. 33, n° 7, p. 587-605.
REHESAAR H. (2001). “Promoting user satisfaction”. The Twelfth Australia Conference on
Information Systems (ACIS), p. 523-526.
RITA P. (2000). “Web marketing tourism destinations”. The 8th European Conference on
Information Systems (ECIS), p. 1096-1103.
SMITH A.G. (2001). “Applying evaluation criteria to New Zealand government websites”.
International Journal of Information Management, vol. 21, p. 137-149.
STANDING C. & VASUDAVAN T. (2000). “Diffusion of internet technologies in travel agen-
cies in Australia”. The 8th European Conference on Information Systems (ECIS),
p. 1112-1119.
TREPPER C.H. (2000). E-commerce Strategies. Washington, Microsoft Press.
WOODROOF J.B. & KASPER G.M. (1998). “Conceptual development of process and out-
come user satisfaction”. in GARRITY E.J. & SANDERS G.L. (eds.), Series In
Information Technology Management, IDEA Group Publishing.