Presentation: Methods of Evaluation of Information System

Presentation on:
Methods of evaluation of
information system
Presentation By:
Kumari Richa (BBA/40095/18)

What is Information system?
1) In very simple terms Information System may be considered as any system

that facilitate decision making in an organization.
2) In technical terms Information system may be defined as an integration of

various components that collect, manipulate, process, analyze and distribute
information to support decision making and provide a FEEDBACK
MECHANISM to monitor performance.
Types of Information system
1) Executive Information System (EIS)
• Executive information system is a type of information system which is
concerned with providing information that is relevant for making decision
which are strategic in nature.
• This type of information system is generally used by top-level
management.
2) Decision Support System (DSS)

• Decision support system refers to a category of information system which
facilitate decision making by senior managers.
• Decision support system are very interactive and also have modelling
capabilities.
3) Management Information System (MIS)
• Management information systems are concerned with providing relevant
information to middle & lower managerial level.
• This type of system deals with part & present rather than future.
2)Transaction Processing System (TPS)

• Transaction processing system are not concerned with decision making directly but
they are meant for effective processing of business transaction enterprises.
• It’s mostly used by operational, personnel and supervisory staff.
Why to Evaluate Information System?
1) In order to direct the process of management information in systems in the

right direction and the activity of evaluation provides supervision.
2) Evaluation attempt to gauge how well information system is helping in

meeting a particular expectation, objective or need.
3) The main purpose of to evaluate is to upgrade and improve the efficiency

of system.
Types of evaluation
1) Formative evaluation
It’s a type of evaluation in which organization evaluates in order to increase the
performance, focusing on the future (ex-ante).
2) Summative evaluation
Summative evaluations are exclusively executed to observe the quality of past
performance (ex-post).
 Any evaluation should consist of a monitoring and a forecasting aspect..

Comparison between
formative and summative
Dimensions Formative Summative

Target audience Programme manager, Decision-makers,
practitioners funders or the public
Focus of data Qualitative evidence Quantitative outcome
collection to clarify aims, measures
content and structure
of the programme
Role of evaluator Two way interaction Independent and one-
way communication
Methodology Heavy use of Experimental and

qualitative design one-way
communication
Reporting Informal via group Formal reports
Procedure discussion and meetings
Frequency of During the overall After completion of

reporting process of evaluation evaluation
Methods of evaluation of IS
1) Goal-based evaluation
• The goal based approach evaluation was first developed by Tyler in 1942 as a
deductive methodology, in which a set of clear, specific and measurable goals are
derived from an organizational prior to evaluation.
• According to Patton (1990) goal based evaluation is described as measuring the extent to
which a program or intervention has attained clear and specific objective.
• Quantitative data collection methods are traditionally adopted in goal-based

evaluation .
• Many critics disapproved this method because such evaluation often mainly
focuses on technical and economical aspects, rather than on human and social
dimensions.
• This method can have major negative consequences in terms of decreased user
satisfaction but also organizational consequences in terms of system value.
• The basic strategy of this approach is to measure if predefined goals are
fulfilled or not; to what extent and in what ways.
• The approach is deductive in nature.
• What is measured depends on the character of the goals and a

Quantitative approach as well as qualitative approach used.
2) Goal-free evaluation
• The goal-free evaluation means that no explicit goals are used.
• It is an inductive and situationally driven strategy.
• The major objective of this interpretive evaluation is to gain thorough

understanding of the nature of what is to be evaluated and to create
motivation and commitment.
• The involvement of array of stakeholder groups is often considered

essential to this approach of evaluation. But this can also be practical
hindrance where time or resources for the evaluation is short.
• Goal-free evaluation is elaborated as collecting data on a broad array of

actual effects and evaluating the importance of these effects in meeting
demonstrated needs.
• The evaluator makes a thoughtful attempt to
i) Avoid all rhetoric related to program goals.
ii) No, discussion about goals is held with staff
iii) No, program brochures or proposals are read
Only the program's outcomes and measurable effects are studied.
• The aim of goal-free evaluation is to

i) Avoid the risk of narrowly studying stated program objectives and
thereby missing important unanticipated outcomes, eliminate the
negative undertone attached to discovery of unanticipated effect.
ii) To eliminate the perceptual biases introduced into an evaluation by

knowledge of goals and maintain evaluator objectivity and
independence through goal-free conditions.
3) Criteria-based evaluation
• Criteria-based evaluation means that some explicit general criteria are used
as an evaluation yardstick.
• There are numerous criteria-based approaches around such as checklists,

heuristics, principles or quality ideals.
• In this approach, the IT-systems interface and/or the interaction between

users and IT-systems act as a basis for the evaluation together with a set of
predefined criteria.
Thank you.

Presentation: Methods of Evaluation of Information System

Uploaded by

Copyright:

Available Formats

Presentation: Methods of Evaluation of Information System

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Presentation: Methods of Evaluation of Information System

Uploaded by

Copyright:

Available Formats

Presentation on:

Kumari Richa (BBA/40095/18)

1) In very simple terms Information System may be considered as any system

2) In technical terms Information system may be defined as an integration of

2) Decision Support System (DSS)

2)Transaction Processing System (TPS)

1) In order to direct the process of management information in systems in the

2) Evaluation attempt to gauge how well information system is helping in

3) The main purpose of to evaluate is to upgrade and improve the efficiency

 Any evaluation should consist of a monitoring and a forecasting aspect..

Dimensions Formative Summative

Methodology Heavy use of Experimental and

Frequency of During the overall After completion of

• Quantitative data collection methods are traditionally adopted in goal-based

• The approach is deductive in nature.

• What is measured depends on the character of the goals and a

• It is an inductive and situationally driven strategy.

• The major objective of this interpretive evaluation is to gain thorough

• The involvement of array of stakeholder groups is often considered

• Goal-free evaluation is elaborated as collecting data on a broad array of

• The aim of goal-free evaluation is to

ii) To eliminate the perceptual biases introduced into an evaluation by

• There are numerous criteria-based approaches around such as checklists,

• In this approach, the IT-systems interface and/or the interaction between

You might also like

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.