The ICT Processes
The ICT Processes
The ICT Processes
Prepared In
January 2002
By
OMSAR
Table of Contents
The Guide commences with a set of Activities that are general. They do not fall under
any specific Information Process. Most are fundamental processes in that they apply to
the whole Department.
Objectives : this Activity defines the steps needed to establish Policies and Goals for
using its current and projected ICT Systems. This Activity also assesses the degree to
which business/organizational plans and ICT plans are aligned. It determines the
appropriateness of the mechanisms for establishing the priorities of ICT investments
(New projects, changes to existing systems, etc). It establishes the governing rules and
structure of the ICT unit as a whole. Of critical importance is an assessment of ICT
spending.
Scope of usage : to cover all ICT Systems under current use or that are projected for
future use.
Risks : should such goals and policies not be defined, the Department risks acquiring
the wrong systems, using them in the wrong manner or even not estimating budgets
properly.
Objectives : the Good Practices Project is an ongoing process. The Department will
benefit from an ongoing application of Good Practices. The Good Practices to be
implemented in the Department should form part of a long term Project that is well
planned, executed and monitored. The objectives of this Activity are to plan the Good
Practices Project according to modern project management techniques.
Scope of usage : restricted to the Good Practices Project. The Project will not be
involved in any other ICT projects except in so far as it may propose and implement
good practices for them.
Risks : should the Department not plan the Good Practices project properly, it risks the
following :
Critical Risk : one of the major risks involved is that of the Department not having a
Project Manager nor being able to assign a Project Team for the Project. This is a serious
situation and can be known in advance. It is suggested that the Department contact
OMSAR in such a case to study various other alternatives such as outsourcing, assistance
by other Departments, etc.
2) Assign a capable Project Manager. Usually, this would be the Head of the ICT
Unit. However, in the case where the Unit has not been formed yet, the
Management may find other parties for this role.
3) Identify all stakeholders of the project. Stakeholders are all parties within and
outside the Department that may have a positive or negative interest in the
Project.
4) Ensure that the Project Objectives are understood by all stakeholders or persons
with active interest in the project. To do that, refer to the document developed in
Use the document arrived at in Activity 1)
5) Analyze the Guide of Good Practices to identify the ICT Processes of interest to
the Department and to determine the Activities that the Department needs to
implement.
7) Define and establish the three main elements of any project. These consist of the
core elements of the Project Plan :
8) Highlight all exclusions : these are usually functions within the Project that some
stakeholder will “assume” are part of it but may not be. Identifying them at this
stage would save a lot of time and avoid disputes.
9) Identify all Project constraints. The assumptions are the “Implied” needs of
various Stakeholders. Convert implied needs to stated needs or drop them from
the Project.
10) State all assumptions. Assumptions often relate to various aspects of the Project
or the ICT Processes. Assumptions usually hide “implied” needs and cause gaps
between what was promised and what was delivered. This would reduce the
Quality of the Project.
11) Carry out Risk Analysis and Manage the Risks. (Refer to Activity 4)
12) Based on the above, define the Project Team, their responsibilities, authorities as
well as their lines of reporting. Typical roles in the team can be :
Management
Staff from the ICT Unit
Quality assurance or Internal auditors or inspectors
The units in which the systems are used
Refer to the note at the beginning of this Activity that points to the risk of not
being able to identify or assign such a team.
Some of the above activities will be expanded as specific Activities in the following
pages.
Documentation and Deliverables : the above definitions result in a Project Plan. This
has to be documented and circulated to all Stakeholders for final approval.
Objectives : to collect all documents that will be of use during the various stages of the
Good Practices project. Such documents should be verified to be correct and up to date.
Scope of usage : documents related to the Department as a whole as well as to the ICT
Systems in use by the Department.
Risks : should such documents not be available nor be up to date, time would be lost
during the completion of the various activities to collect and bring them up to date.
Department charter
Ministerial decrees
Various lists and registers
Studies relevant to the ICT Systems
Mission statements
Vision statements
Goals and Objectives
Strategies for reaching such goals
2) Catalog such documents under a Register until they are subsumed under the
proper Activities. The Register would include the document names, type, status
and location.
Documentation and Deliverables : all the above documents along with the Register
that identifies them.
Objectives : in the early stages of the Good Practices project, the Department is bound
to face many unknowns. This Activity presents a procedure for analyzing and mitigating
the risks facing the Department. This would allow it to avoid problems during the later
stages. A detailed discussion of Risk Management is presented in the Appendix of
Supplementary Material of Supplementary Material. Risk Management should be
carried out by the Project Manager.
Scope of usage : the whole Project itself. Note that at this moment, the Department
should not be concerned with Risk Management for its own ICT Systems. Risk analysis
for the ICT Projects of the Department should be handled within those projects.
Risks :
2) Assess the Risk or the likelihood or probability of each event taking place. This is
expressed as a percentage ranging from 0% (Not likely at all) to 100% (Certain
to take place).
3) Assess the Impact on the project should each event take place. Impacts are
assessed as a percentage that ranges from 0% (No significant impact at all) to
100% (Catastrophic impact).
5) Find the Exposure : Multiply the Risk (From Step 2) by the Impact (From Step 3)
for each event. This is the exposure of the Department to this risk. This will be a
number that is between 0% and 100%.
8) Address the topmost exposed events and find ways to manage the risk. This can
be managed by reducing the probability and/or by reducing the impact.
Documentation and Deliverables : a risk analysis document for the project as per the
structure proposed in the Appendix of Supplementary Material of Supplementary
Material.
1) Ongoing Review of Good Practices Project : review Risk Analysis during all
stages of the Project. The purpose would be to learn from earlier analysis as well
as to ensure that (a) none of the risks are still likely and (b) there are no new
risks.
2) Risk Analysis for the Rest of the ICT Systems : should be carried out on the
ICT Systems should any of the following situations arise :
Risk Analysis cannot be underestimated. It is usually the only way to avoid future
problems.
Acceptance Criteria : upon submission of the Risk Analysis document along with the
proposed solutions to all risky events, this Activity would be considered complete.
Objectives : Since the Project relies heavily on following “Quality” practices, it follows
that Communication between all concerned parties has to be properly defined for the
overall project. The objective of this Activity is to define the Communications schemes of
the Good Practices Project.
Risks : should the Department not have a proper Communications scheme for the
Project, the following risks may arise :
1) Issue the Project Charter : this is a document that formally recognizes the
existence of the Project and is the trigger for its launch :
2) Prepare a list of all persons involved in the project : the Management Responsible
for the Project, the Project Team, the ICT personnel who will assist the Project
Team, key Users, other parties outside the Department.
5) Identify the repository where such documents are to be kept and archived.
Acceptance Criteria : the Activity is considered completed when all the documents
mentioned in the above SOP are collected and approved by the Management, the Project
Manager and all involved parties.
Scope of usage : all aspects of work involving ICT. However, there is no reason why
the same methods cannot be used for other non-ICT processes in the Department.
Risks : not introducing a performance measurement scheme may lead to the following
risks :
1) Identify the Areas of Concern the Department needs to measure. Based on the
currently popular Balanced Scorecard, these are usually grouped in 4 major
areas :
Financial areas
Citizen based areas
Internal Business Processes (Operations including ICT indices)
Learning and Growth (Includes Human Resources)
For example, if the proportion of erroneous vouchers reaches more than 10% of
the total, the Department will need to look into what is causing such errors and
remedy the cause. The figure of “10%” is thus an indicator. The decision making
zone is any measurement above 10%.
6) When problem areas are identified through such measurements, develop remedial
actions to resolve them.
1) The Areas of Concern and the individual performance measurements showing the
indicators for each.
2) Measurements procedures which show how each measurement is to be taken.
3) Measurement results : statistics, tables or databases.
4) Recommendations and remedial actions that define the actions taken to remedy
problem or improvement areas.
2) Communicate the purpose behind the measurements. Very often, personnel are
suspicious of measurements as they might consider such activities as infringing
on their behavior.
3) Remain consistent with measurements. Changing the nature of the measure over
the years stops the Department from analyzing trends and growths.
• Legal infringements
• Inefficient ICT processes
• Drop in quality
2) Train the ICT Unit staff so that they can identify the areas of applications and
implement and monitor the standards.
Good Practices
1) The ICT Unit should be constantly on the lookout for standards that may be
emerging. Often, getting familiar with a standard during its inception will result in
more efficient implementation.
2) Various standards such as the various ISO levels need to be purchased as they
are not available in the public domain. It is a good practice to budget for such
acquisitions and to constantly revert to the related web sites for information
about upgrades and their related costs.
Scope of usage : covers all types of ICT Projects whether handled by the Department
or by its Suppliers.
Risks :
• Projects without management will eventually fail. Failed projects will not meet
their functional promises, their budgets nor their deadlines.
• Projects without managers will fail in the same manner.
• Managers without the right experience, profile and authority will not be able to
manage projects properly.
These two persons will work as counterparts jointly assuring the success of the
project.
It is recommended that the Department look into the possibility of training their
own staff in ICT Project Management. One web site to visit is the Project
Management Institute’s website : www. pmi.org. It is a focal point of modern and
standardized project management practices.
Scope of usage : the scope of the Configuration Management process totally depends
on what the Department wishes to include in the Configuration. At the most minimal
level, this would cover the ICT System hardware, network components and software
items. However, many other elements can be added.
Risks : not launching a Configuration Management process will lead to the following
damages :
• The Department will not know what is included in the ICT Systems which will
causes losses, open the system to pilferage, etc.
• The Department will have a difficult time updating, upgrading or gathering
information about the status of the system.
• Changes will take place in an ad hoc and uncontrolled manner leading to
discrepancies, losses, mismatches and other problems. This is especially
damaging in the case of software systems under development.
This procedure closely follows the detailed processed defined in the Appendix of
Supplementary Material of Supplementary Material. The steps discussed in the
Appendix are summarized below.
3) Develop other coding schemes that may be used such as tag numbers, etc.
5) Setup all items on the Configuration Database as they are on a specific date. This
becomes the Baseline Configuration. All subsequent additions, deletions and
modifications of items in the Configuration must adhere to the Change Control
System defined next.
1) Use the Change Control System to ensure that any change to the Configuration is
subjected to the following process :
2) Changes such as the following are also subject to the same mechanism : addition
of new items to the ICT Systems, deletion of items or their removal or
uninstallation as well as any changes such transferred locations, upgrades, etc.
3) Monitor and Track the Configuration through the analysis of the information being
processed in the Configuration. (Review the Appendix of Supplementary
Material of Supplementary Material for a more detailed list of such information).
Good Practices
The Configuration can include but not be restricted to the following items (In
alphabetic order) :
• Agreements
• Agreements with Suppliers
• Backup media
• Data sheets submitted by Suppliers for various equipment
• Items under maintenance agreements
• List of suppliers
• List of supplies
• Project plans
• System manuals and documentation
• Training institutions
• Training material
• Workshops and courses of such institutions
Over and above the actual software application to be used for Configuration
Management, the Appendix of Supplementary Material lists a variety of different
analytic reports to be reaped from such an application.
Human Resources are one of ICT’s major problems. The Technology is changing. Staff
are not progressively trained. Job Classifications are faulty and neither reflect the
Department’s needs nor the qualifications of the recruits. Responsibilities, generally
horizontal in the ICT environment, are not clearly understood nor efficiently
implemented.
The following sets of Activities provide some Procedures and Good Practices related to
ICT Human Resources.
Objectives : to define the Organizational Structure of the ICT Unit according to modern
principles. Different periods in ICT history have required different types of personnel with
different relationships. Different organizations operating in different environments have
also constantly had to change their structures. Hence, the Guide will not be able to
propose a standard Organization Chart for ICT Units. The Guide will propose a generic
Organizational structure that can be used as the basis for specific Units in each
Department. Such a structure is presented in the Appendix of Supplementary
Material of Supplementary Material to avoid disrupting the flow of Activities.
Scope of usage : the ICT Unit in the Department. However, some Departments might
have small isolated ICT units following major Directorates or Agencies that report to the
Ministry. These have to be considered as part of the overall structure even though they
may not report directly to the ICT Unit Director.
The Guide will use the term “Position” instead of a “Job”. The term position defines a
position that is created by the Department for a specific purpose. This position may or
may not be filled.
1) Identify all positions in the ICT Unit and the positions they report to.
2) Use a minor database to setup at least the following data elements for each
position :
Description
Date created
Grade / Subgrade
Date filled
Staff ID
Position it reports to
Responsibilities (Text)
The responsibilities of each person would be as they are doing the work today. It
would help to have the persons write down what they assume is their job. The
difference between what Management considers their job and what they consider
their job can often resolve a lot of issues.
6) If a position is occupied, ie, not vacant, link that position to a simple Employee
record containing at least the following data elements :
Staff ID
Name
Title
Date of birth
Date of joining the department
Educational level (Linked to multiple records)
Work experience (Linked to multiple records)
By now, the Department should have a fully detailed Organization Chart showing which
staff is in which position.
The above Chart can be in a hard copy but it is recommended to have it in an automated
form. Such a form can be as simple as a spreadsheet, a minor database application or a
diagram.
Acceptance Criteria :
Objectives : to identify which Competencies are required for each Position in the ICT
Unit. Competency is a special ability a staff member acquires through training, education
or experience. Within the ICT world, this could vary from technical to non-technical
competencies.
Competence is a major issue in ICT. The Technology changes so fast that staff who are
considered experienced this year may be without much experience in a year’s time.
Scope of usage : the whole Department but specifically, the ICT Unit.
1) Identify Expected or Required Staff Competencies for each Position by listing all
experience, knowledge, education or training that each position should have.
2) Review lists of training courses for ICT personnel. This would identify
Competencies that may be required.
Non-Technical
PC literacy
Managing Teams
Project Management
Configuration Management
Human Resources Development
Training
Business correspondence
Presentation skills
Reception work
English (Writing Level)
Arabic (Writing Level)
Etc
4) Within each Competency, it may be useful to define several attainment level. For
example, Office 2000 capabilities can be defined at beginner, intermediate and
advanced levels. The same may apply to Languages : Spoken, Read or Written
levels.
A list showing all the Competencies required or expected of the Staff holding such each
position in the ICT Unit.
Objectives : to analyze the education, experience, competence and project history of all
staff. From this analysis, the Department would get a list of the Actual Competencies
each person has. Later on, this can be used to compare the staff’s actual competencies
with the expected competencies as defined in the previous Activity. (Review Activity 11 :
Identify the Required Competencies per Position). In a later Activity, the Department can
analyze the gap between required and actual competencies therefore identifying training
needs. (Review Activity 13 : Analyze Competencies to Identify Training Requirements).
This would provide the Department with a solid basis for reaching the following :
Scope of usage : the whole Department but specifically, the ICT Unit.
Risks :
• Not knowing the education, experience, competence and project history of the
ICT staff may lead to improper use of current personnel, poor career path
planning and inefficient training.
• If qualified staff are kept in the wrong positions, this would lead to demotivation
and reduced performance as well as increase the risk of turnover.
A list of all staff currently in the employ of the Department showing the Competencies of
each.
1) Personal interviews may highlight Competencies that were not identified from the
paperwork analysis. They may also help the Department drop some
Competencies which were wrongly attributed to the staff member.
3) It is often useful to have staff review their own Competencies and those of other
colleagues. This would further help the Management with the identification
process.
Objectives : to identify the training requirements of staff so that the training can be
budgeted for, approved, planned and completed. Having completed the two previous
Activities of Identifying the required competencies per position and Identifying all staff
competency levels, the next step would be to analyze the “Balance” or the “Gap”
between what Competencies are required and what each staff actually has.
Scope of usage : the whole Department but specifically, the ICT Unit.
Risks :
1) Complete the Activities discussed in the previous two Activities. These should
produce a list of all required Competencies per position and a list of all Staff along
with their actual Competencies.
2) Compare the two lists and identify the “Gap” or the Competencies needed by
each staff member to be fit for the position that he or she is occupying.
The first two situations have to be dealt with by the Department’s management.
The last situation is what is being sought in this Activity. It identifies the staff
member who is short of his or her position’s qualifications and would also define
the Competencies needed to make the person fit for that position.
4) The list of all staff and their required competencies can now be sorted by
Competency. This allows the Department to plan the training for all staff.
A list of all staff and their required Competencies. This can be resorted to show each
Competency with a list of the Staff that require it.
Objectives : to setup and maintain a register of available training. There are many
institutes offering training courses, workshops and programs in the field of ICT. With the
advent of the Internet, many sites also offer free or chargeable online training.
Risks : not having lists that are up to date will lead to loss of time when training is
required. Secondly, not knowing what is available in terms of training may lead to
misconceptions about what the staff may require in terms of their training.
1) List all institutes that offer training with data about them : location, contacts,
type of workshops, etc.
5) Maintain a table of website links that offer free or chargeable online training.
1) The Department should have cost estimates for most of the training being
investigated.
2) Technical exhibitions and forums can be of major benefit. These do not represent
formal training. However, attending such exhibitions is always educational and
would provide the staff with exposure to new technologies and products as well
as present them with the chance to collect data sheets, attend lectures and
discussions.
Objectives : this Activity presents some Good Practices that aim at maintaining a list of
all training material : documents, CDs, tutorials, web sites, etc. Different persons will
attend different workshops or courses and bring back training material with them.
Invariably, such material gets spread around the Department and will not be shared
resulting in lost resources.
3) Share such registers or lists via the internal site of the Department or through
regular announcements or inter office memorandums.
The application would cover the following functions by setting up the following records :
Staff members
Training institutes or training resources
Available workshops/courses
Required Competencies
Actual Staff Competencies
Planned training (Workshops, courses, etc)
Records of the actual results with evaluations of courses, instructors and
attendants
Costing analysis
Suggested Approach
The Department can acquire such a system commercially. However, the design is not
very complex and can be easily developed into a minor database.
Objectives : to standardize recruitment practices and get the best out of recruitment of
staff. This Activity suggests a way to automate the Recruitment process. It also
recommends the maintenance of an applications register that allows the Department to
review its applicants and follow up on their recruitment.
Risks : if such practices are not implemented, the Department risks the following :
1) Irrespective of the title being advertised, it is best to include in the clear job
definitions to avoid receiving more applications than needed.
3) Many applicants skip over jobs they had problems with. Gaps should be checked.
6) It is usually the case that ICT staff only get checked by ICT experts. This practice
is not efficient as an employee is not only recruited for his or her technical
knowledge. Experts in related areas such as the unit that will benefit from ICT
Services or the Financial Unit or Human Resources should also be part of the
interviewing process.
7) On recruiting a person, it should be easy to find a short term project that the
person can complete as a test of his or her capabilities. Projects in the order of
one or two weeks should normally be sufficient to verify the competencies of the
new recruit.
8) It should be a simple matter to setup a basic database of all CVs received. Very
often, the Department may already have applications that they need on such a
database thus avoiding time loss and additional advertising costs.
Due to the wide variety of products and services needed by ICT Processes, suppliers
become a major part of the ICT Processes supplying the Department with such a variety
of products and services as the following :
• Hardware
• Networking components
• Telecommunications Services
• Web based services
• Software of all types : operating, tailored, off the shelf applications, office
technology, networking, development tools, database engines, etc
• Training
• Support and maintenance
• Recruitment
• Secondment of staff
• Etc
Some of the above products and services may be internally supplied, so that in a proper
ICT environment, it may be necessary to apply the same Good Practices to Suppliers as
to the internal sources.
Proviso
This ICT Process in this Section as well as those in the next Section on the various
Qualifications are closely related to Procurement Policies that the Government and/or the
Department may already have in place. It is important to recognize the Activities in
these Sections as being recommendations and guidelines and that in no way will the
recommended Procedures and Good Practices replace official procurement policies but
should be supplementary to them.
Objectives : to setup a list of Suppliers with their offered products and services.
Suppliers are no more specialized as they were in the 80s and 90s. Suppliers that only
sold one type of product can now sell hardware, software, web services and consulting.
Setting up a list of Suppliers on a minor database will allow the Department to easily
locate suppliers by product or by service. Furthermore, this list can be used to maintain
a history of the relationship with the supplier evaluating their performance, prices and
general quality.
This Activity does not replace that of Supplier Qualification or Audit presented in the next
Activity. It compliments it by providing the Department with a wider list of products and
services to select Suppliers from. After such a selection, Supplier Qualification may take
place.
Scope of usage : the Department can expand this Activity to cover all products and
services that it is interested in. However, the Activity will address ICT services and
products.
• It would take a longer time to arrive at the right choice of products and services
in the market.
• The lack of history tracking may cause the Department to purchase products and
services from suppliers that it had had a problem with in the past
1) Identify the major areas of Products and Services that the Department is
interested in.
2) Prepare a multilevel classification of such Products and Services. This can be used
to speed up search and cataloging.
3) Setup a minor database that contains a record for each Supplier. The database
can have the following functions :
The database setup above that can produce lists of Suppliers or lists of products and
services.
Furthermore, the experiences with different Suppliers may then be shared. This
would ensure that Suppliers improve their products and services.
3) Consult various directories to update the database. Currently, there are several
companies promoting business directories, some general and some directly
focused on ICT products and services.
Objectives : with such a wide variety of suppliers in the market, the Quality of the
supply process becomes a critical issue to the Department. This Activity prepares the
Department with some Good Practices that result in Qualifying Suppliers. This is not to
be confused with some very strict and disciplined procedures for “Prequalifying”
Suppliers which may be project specific. This Activity presents a single process that
allows the Department to qualify whether it wishes to acquire products and services from
this Supplier in the future or not.
Scope of usage : mostly applied to Suppliers with whom the Department enters into a
Commercial Agreement. However, it may often arise that the Department can be the
beneficiary of products and services from International or Local Donors. It also often
happens that the Department may acquire products and services from other
Departments. All of these have to be taken into consideration when Qualifying Suppliers
(Or sources).
Risks : should the Department not have a Supplier Qualification procedure, the
Department may end up dealing with Suppliers that are of lower quality than it expects.
3) Each of the above relationships should have its own Qualification Procedures.
For example, here is a typical definition of a Short List relationship :
“For the Supply of Office Technology Products Training, the Department requires
a minimum of 3 and a maximum of 6 Suppliers to form a Short List. These
Suppliers should be evaluated with the following criteria so that any Supplier not
scoring above 70% would be dropped from the evaluation and the Department
will then select the Suppliers with the top 6 scores :
Example : Long List Relationship : since this is a general list for use while
prospecting for Suppliers, rigorous testing may not be possible. Therefore, the
Department may find it simple and efficient to use 3 point scales for such
evaluations as the following :
Example : Short List Relationship : a Short List will usually result in a set of
Suppliers invited to bid on a specific project. Therefore, short lists are more
demanding. They would require to have more rigorous testing such as sample
work, site visits, documented evidence, etc. Therefore, the Department would
find it necessary to expand the evaluation scale and use percentages.
In all above tests, the Department should use the Weighed Indexing Scoring
Method to arrive at its results. This procedure allows the analyst to normalize and
convert such criteria into one evaluation score. (Review the Appendix of
Supplementary Material where a detailed presentation is given of the Weighted
Index Scoring Procedure).
• Documented evidence
• Certified evidence
• Letters expressing interest in joining projects
• Proposals
• Company profiles / brochures
• Company presentations
1) Coordinate with other Departments who may have already carried out the
exercise of preparing such lists. In the future, the whole Government should be
able to share such information, especially if it is web based. This would also make
it easier for the Suppliers to keep their data elements up to date.
1) Supplier Lists
2) Evaluation Criteria
3) Qualification Results
Generally, it would be Good Practice to setup a database for each Supplier and then
setup a record for each time the Supplier was subjected to a specific Qualification
Exercise.
Objectives : to prepare a list of all current agreements between the Department and
any outsourced services. The purpose would be to consolidate the location of such
agreements, monitor and track their performance as well as their other terms such as
renewal, expiry and payment schedules. Such a register would also allow the
Department to analyze possible cases of conflicts of interest.
The following types are some of the agreements this Activity covers :
• Purchase agreements
• Maintenance and support
• Training
• Consulting services
• Secondment
Risks : should a list of agreements not be available, the following might take place :
• Agreements might lapse giving the Supplier the chance to change his terms with
the Department.
• Conflict of interest may arise. For example, a Consultant might be assisting the
Department in one project only to find out that the same Consultant is bidding for
a Software Development project with the Department.
• Payment schedules may be missed.
4) On a regular basis, analyze the database to list all agreements that are about to
expire during the next month or two.
2) Link the agreements database with the Supplier database discussed in Activity 18
: Prepare a List of Supplier Products and Services.
1) Select the factors that best reflect the criteria that are important to the
Department and make them the Evaluation Criteria for the offer.
2) The following are examples of Evaluation Criteria that are mixed in that they
apply to different Information products and services :
Reliability
Technical fit with the Department’s requirements
Profile of the team
Profile of the company
Relevant experience
Knowledge of the business domain of the Department
Timing
Price
Offered features
Responsiveness to RFP (Have they understood what was requested)
Project Planning
Additional features
Price 100%
Price 30%
Company Profile 15%
Team’s Profile 20%
Responsiveness to RFP 10%
Relevant Experience 25%
Of course, any of the above criteria can be broken down further such as the
Experience in the last example :
“Companies that do not get 70% on their technical score will not be considered in
the overall selection”.
5) Publish the evaluation scheme in full detail in the Request for Proposal so that
Suppliers can prepare their proposals according to the defined weights.
6) On receiving the proposals, each offer needs to be evaluated and scores given to
each criterion. The best score would be computed using the Weighted Index
Scoring Procedure defined in the Appendix of Supplementary Material.
Documentation or Deliverables :
1) The full evaluation scheme : the criteria, the range of scores, the weights and any
pass or fail conditions.
2) A list of all items to be evaluated with all their scores
3) The computation of the Weighted Index Score for each item
Acceptance Criteria : when the best item is selected according to the Weighted Index
Scoring procedure, the Activity is accepted.
Objectives : many attempts have been made to develop Standard Agreements betwee
customers and suppliers. Due to the changing nature of technology, the different
circumstances surrounding each agreement and the various policies and strategies
followed in different Departments, it becomes very difficult to develop such Standards.
This is a fairly long Activity. It discusses a variety of problematic issues that may arise
while preparing Agreements and proposes solutions to such issues.
Scope of usage : the typical Agreements that will be considered are the following :
• Purchase Agreements
• Requests for Proposal
• Support Agreements
• Maintenance Agreements
• Warranties
Risks : poorly developed agreements may never be a risk until disputes take place. In
all cases, whether it wins or not, the Department would be the loser. It is the
Department’s objective not to have to fall back on Agreements and litigate. Therefore,
the major risks of these Activities are :
• Lack of agreements
• Poorly written agreements
• Agreements based on Supplier Proposals
• Agreements that over-pressure the Supplier leading to eventual poverty in
delivery and performance
• Agreements that do not address the issues discussed in the next few subsections
Specific Activities will have their own Risks and will be discussed in what follows.
In Section 4.0, the Guide presents a set of Qualifications, starting with the Specifications
Qualification (Review Activity 23 : Specification Qualification (SQ) and Activity 1 : Define
Business Objectives as Related to ICT). These two Activities provided SOPs that ensure
that proper designs have been made and that Specifications to be used as the basis of
delivery are in place. The Guide will not expand on this issue in this Section.
After the Technical Specifications, the second most important element in any project is
the Schedule and Timing of activities. Many Agreements present a broad listing of target
dates and delivery times. What is missing are some of the the following crucial dates :
1) The Department usually starts by defining a broad and general timing. This would
be based on key milestones in the project.
2) The Supplier will then analyze the Products and Services being proposed.
3) Based on such analysis, the Supplier will then prepare a rigorous timing plan that
contains all activities, their duration and their sequencing.
Usually, most agreements are overly concerned with financial issues. However, there are
various weaknesses to be avoided.
1) Internally, the Department should rigorously estimate the overall cost of the
products and services being requested. Poor estimates result in the following
risks :
3) Gear payments to the actual work or deliverables by the Supplier. Suppliers often
suffer because the schedule of payments does not reflect the work or deliverables
4) Exchange Rates : clarify currencies in which payments are to be made and what
happens on the dates of payment should the rates differ.
5) Escalation Factors : costs must be projected over the coming years. If that is
not possible, an escalation factor must be specified that the supplier of such
services must adhere to so that coming costs are not increased by more than the
said factor.
Software often goes through different releases and versions resulting in major upgrades
or minor updates.
4) Upgrades or updates may also require the updating of source code in developed
applications. The Department should clearly cater for this situation : who is to
redevelop the software, at which cost and how long that would take.
Source code is always an issue in Software Contracts. There are two perspectives to this
problem :
The Supplier’s Argument : the supplier may have spent a lot of effort to setup
standard interfaces, components, reusable routines, clever solutions of problems.
Suppliers are usually reluctant to expose such practices. Secondly, with the Source Code
in their hands, Suppliers ensure continued maintenance and support agreements.
Both these views seem reasonable. However, there are clarifications and solutions to the
stalemate that often arises regarding source code custody :
2) On acquiring the source code, most Suppliers would renounce their obligation to
support the application. The application responsibility becomes that of the
Department.
2) Agreements can state that the Source Code be placed in escrow with a Bank.
Under specific conditions, such as bankruptcy or stoppage of work, the Source
Code can be made available to the Department.
3) It is usual to state in such agreements that the Source Code is only to be used for
internal support of the Department’s application and that it cannot be used by
other parties nor divulged to them.
There is often confusion in the mind of ICT Units between Source Code and access to
data. In the case where the Department is only interested in accessing the data as it
pleases, problems can be avoided by the Supplier providing the Department with a clear
definition of the Database Structures. The ICT Unit can then use various Report
Generators or even develop software to access its own data analysis and report
production.
• Without proper documentation and training, users may not have a clear idea of
what the various data elements mean and how the data is structured within the
database. This might result in data inconsistencies and erroneous reporting.
• Inexperienced users may strain the system by devising queries that place major
loads on the system.
1) The Department must have the Supplier clearly spell out what parts of the
equipment can be replaced free of charge. Generally, parts that are fixed and
subject to failure would be while consumables or items that are under heavy
usage such as print heads are not cover by warranties.
2) Duty cycles should be observed and defined. Invariably, one does find a small line
of print that limits the usage of a specific product to so many hours of non-stop
work. (For example, some printers are not to operate continuously for more than
a specified number of hours).
Generally, here are the services generally provided as part of the Warranties and
Maintenance of Software items :
4) Upgrades and updates are often included as part of Warranty and Maintenance
services. (Review Section 3.4 for some restrictions on such upgrades and
updates).
1) Specify clearly when the Supplier can be called. Usually, a business shift is
specified so that calls outside it are either not answered or are chargeable at
different rates.
2) Specify clearly how long a Supplier can take before responding to the first call.
3) Having taken the first call, specify clearly how long a Supplier can take before
resolving the problem.
4) Specify clearly what contingency plan the Supplier has if the problem cannot be
solved.
Many agreements confuse support with maintenance and often combine the two. This
eventually leads to disputes.
Maintenance aims at retaining the system in the working state which it was supposed
to have been delivered in. It is the responsibility of the Supplier.
Support is any additional effort the Supplier has to put to support the Department.
• Additional training
• Resolving problems which are outside the control of the Supplier such as
breakdowns due to damages, power failures, force Majeure, etc.
• Assisting users in activities which are outside maintenance
• Developing minor reports, modifications and enhancements
• Secondment of personnel during critical periods such as end of month, end of
year, closings, etc
• Undertaking activities that are outside any agreed upon work such as upgrades,
migration, re-installing software, trouble shooting, etc.
2) Because such effort is to be booked in advanced, the Supplier will generally offer
them at a lower rate. The total is then booked at an agreed upon rate.
3) Should these hours not be used, the Supplier will still get compensated because
of the commitment he made.
4) Should the Department use more than the agreed upon hours, a rate for
additional hours will be agreed upon and used as part of the agreement.
Generally, it should be lower than the yearly rate.
5) Whenever support is needed, the Department will request it and document such
requests.
6) When possible, the Supplier will provide estimates of specific support work to be
carried out. The Department will need to approve such estimates before they can
be executed.
7) On a monthly basis, the Supplier will submit a statement of all hours used so far.
Only those officially requested and approved are included in the statement.
2) Spare Parts : with changing technology, products are often withdrawn from the
market after a few years and spare parts get into short supply. The Department
should estimate the life cycle of the products it is acquiring and ensure that spare
parts are made available by the Supplier during that period. Failure to do so
should result in compensation by the Supplier or change of equipment.
This is one of the most serious areas of disputes between Suppliers and their customers.
The main reason is the lack of an agreement on how such Deliveries are to be made and
what constitutes Acceptance Criteria.
Suppliers often deliver goods without there being a recognized party that has the final
authorization in certifying that the goods have been properly received. This will lead to
disputes because invariably, payment terms are tied to certified deliveries which in this
case would be postponed.
It is important to ascertain that persons expected to carry out key work in a project or
an agreement are authorized to do so. This is applicable on both the staff within the
Department and those carrying out the various activities in the agreement.
• Delivering it
• Installing it
• Ensuring that it is operational
• Certifying that it has been properly received as per agreement
3) In the case where such persons are to be changed, documented notices should be
issued by the Project Manager.
(Review Activity 2 : Initiate and Plan the Good Practices Project where the Guide
discusses the importance of Project Management and the role of the Project Manager).
Various problems arise when Suppliers supply systems with software that is not legally
licenses for that system. This often happens with built in databases or software that is
inadvertently left on the installed systems.
Risks :
1) Illegally installed software is theft. To ensure that the Department stays on the
right side of the law, make sure that a license document for each item of software
acquired is submitted with the software.
2) Always register the acquired software. This will make available to the Department
upgrades, patches, new announcements and support.
3) Note that “Shareware” is not equivalent to legally licensed software. The usage of
such software beyond specified time limits becomes illegal.
4) Investigate carefully the End User License Agreement (EULA) for the software.
Some software may only be licensed on specific number of machines or may be
restricted from usage in specific environment.
Qualification processes are usually required during any of the following processes :
1 SQ achieved during
Analysis and Specification
Design Qualification Design of Product
3 IQ Performed by
Installation
Installation Quality Assurance Staff
Qualification
Operational PQ Performed by
Qualification Quality Assurance Staff
4 IQ Performed by
Performance
Use Quality Assurance Staff
Qualification
1) Analysis and Design : during that phase of the overall delivery process,
Specifications produced by the Designers must be qualified. The Specifications
Qualification has the objective of ensuring that the Technical Design will result
in a product or a service that complies with the Requirements of the Users.
3) Installation : starts with delivery, goes through the installation of the products
and ends with the operation of the systems. Installation covers two major
Qualifications :
4) Use : once the systems or the products are ready for use, ie, they have passed
the Operational Qualification, Performance Qualification is carried out to
ensure that the products are performing within their expected performance
ranges. This normally includes response time, speed, capacity, throughput, etc.
The above four Qualifications are presented in the next few Activities.
Example : a UPS has Specifications such as power capacity, battery capacity in ampere-
hours, number of output connectors, whether there is an RS-232 connection and related
software to use on the connected PC or not, whether there is an alarm when power is
down or unstable, etc. These are technical Specifications and can be verified by a
Specifications Qualification. Other issues to be raised in the Specification relate to how
the UPS operates :
Scope of usage : all system processes listed at the beginning of this Section :
1) Identify the party that will approve the design specifications. The party should
be given the authority to approve such a design. This may be a single user or a
Technical Evaluation Committee.
Example : while defining a network, the Department may have a standard for
drawing the network topography may be used.
This is a critical step as it is such standards that will be used when evaluating the
design in this SOP.
3) Collect Required Documents : identify and collect the documentation that the
Design would be based on. Such documents as the following may be needed :
In the case of including the design in an RFP, such documents must be included in
the RFP as an appendix.
4) Involve Users : ensure that the staff who will be the direct beneficiaries and
users of the deliverables are part of the planning process that defines what is to
be designed. The users must then analyze all documentation and approve it.
5) Review Specifications : the team setup to evaluate the specifications will now
review the specifications and establish whether or not they consist of a complete
6) Approve the Specifications : once the Specifications are seen as fit, they can
be approved and hence, released as the Technical Terms of Reference.
Documentation or Deliverables :
1) In the case of complex designs, it may be useful to submit the design to experts
outside the Department. An independent objective review may pinpoint design
weaknesses that are hard to see by the team developing them. Such parties can
be other ICT Units in the Government or independent third parties such as
Consultants.
2) The presentation of the design in the RFP will be read by private sector parties. A
good practice is to ensure that the design, is very clearly presented. Some
designs that are included in RFPs are only clear to the parties that developed
them.
Acceptance Criteria :
Once the party authorized to approve the design has issued its approval, the
Qualification of Specification is considered as accepted.
Objectives : before an ICT System is brought into use, it should be properly installed
and confirmed as being capable of operation. The objective of this Activity is to provide
an SOP for the Qualification of installation of a wide variety of systems. This is
essentially a delivery process and should not be confused with operational qualification
to be discussed in the next Activity.
Definition : Installation qualification (IQ) is the documented verification that all key
aspects of the installation adhere to approved intentions. These intentions could have
been expressed through :
• Design specifications
• System specifications
• Manufacturers' recommendations
• Developers’ recommendations
• Data sheets
Risks : the lack of proper installation qualification will result in the following risks :
1) Identify the party that will approve the installation. The party should be given
the authority to approve the IQ. This may be a single user or a Technical
Evaluation Committee.
The SOP will ensure that all components of the ICT System are installed as per
the specifications of the supplier or developer. The SOP should contain the
following :
Should such a procedure not be available, then the ICT Department should
prepare one to ensure that the system is being installed according to a standard
process. The procedure may also include guidelines and related options.
3) Install the system as per the standard instructions and confirm each step.
4) Environment : make sure that physical location or site meets the installation
conditions specified in the system documentation for such factors as air
conditioning, low moisture, power, and room conditions.
5) Ensure that all related software is the proper version for the installation.
Acceptance Criteria : the system is fully installed when the installation process is
fulfilled as per the supplied Installation Procedure. It would then be ready for Operational
Qualification.
Objectives : Operational qualification (OQ) is the documented verification that each unit
or subsystem operates as intended throughout its anticipated operating range.
A system that has been properly installed is not often tested for proper use and
operation. Before bringing such systems into full operation, they should be properly
tested and confirmed as operating properly. The objective of this Activity is to provide an
SOP for the Qualification of Operation of a wide variety of systems.
OQ tests the built-in capabilities of the new system. In OQ there is a focus on specific
functions and how these functions can be tested. OQ consists of such assurances and
questions as the following :
Example : a software developer may install a full software application and confirm
that it can be launched, some menu items can be accessed and it can be shut
down without error. However, this does not mean that it is fully operational.
• The Department may not be able to know whether the system can operate
properly or not.
• The system may be operated by the wrong persons
• Major deficiencies may exist in the system to be identified during later stages of
its operation (End of month, year, etc).
2) Installation : ensure that the system has been installed properly through a
review of the Installation Qualifications results.
3) Operating Instructions : Ensure that the system has the proper operating
instructions. These could be SOP’s that define operation or use procedures for
each aspect of the system being tested. Operating Instructions should be defined
ahead of time by various parties depending on the nature of the system being
tested.
4) Test Procedures : ensure that the system has proper test procedures. It is
these tests that will decide whether the system is “Qualified” as operational or
not.
5) Operate each function of the system to ensure that they are in working order.
This can be carried out by the supplier of the system or by persons identified in
Step 1 above.
2) Cover all “testing zones”. For example, there are many systems that get passed
for regular operation leaving out of zone tests such as closing of periods or the
use of large values during data entry or the testing of record sharing and locking
in multi-user environments. Usually, the reason is due to lack of data, knowledge
or time.
Acceptance Criteria : the system is fully operational when the test process is
completed and no errors or missing functions are noted. Note that operation may be
completed and yet the system may not be performing properly. For this, the Department
may need to consult the Performance Qualification Activity.
Scope of usage : the system includes all hardware and software components,
associated equipment, people and procedures that make up the system.
• New systems that are being delivered and used for the first time
• Existing systems to be qualified on a regular basis
• Systems that have undergone modifications
• Systems that have had additional usage
• Systems that have seen sudden deterioration of performance should be tested
and qualified
• Systems expanded to operate at a higher capacity
Risks : should Performance Qualification not take place, the Department may face the
following risks :
• Systems will slow down or break down during critical periods causing time losses
and interruption of operations
• It will be difficult to hold suppliers responsible for performance problems if these
are not tested properly.
• By the time that problems arise, Supplier agreements may be closed making it
difficult to hold them responsible for performance problems.
The following procedure is used to qualify if a system is running within its proper “
“Zone” of performance :
2) Setting operational limits : the SOP shall include testing the system against
(but not exceeding) its operational capacity.
• When 20 users are using the system, the response time for accessing a
Citizen’s record should not be longer than 2 second.
• Opening a web page and viewing all images on the Intranet should take no
more than 1 second.
• Preparing a full statement of all certificates should not take longer than 15
minutes.
These indicators define the expected results of the test or the qualification.
3) Test Data : disputes will arise when different parties do not agree as to what
data is to be used. Agreements do not often specify that and Suppliers are
tempted to use test data rather than actual data. Users will often refuse to use
actual data stating that the data is not representative.
Therefore, the SOP should define what the Qualification Data is : actual data for a
full month? A full year? Random data generated specifically for the Qualification?
Abnormal data or data which is outside the operating ranges should also be
tested to ensure that it is handled correctly in the system.
5) Test Procedures or scripts : the SOP must contain one or more Qualification
Scripts that describe the procedures needed to verify the performance of the
system against the User Requirements or the Indicators established earlier.
They should simulate the operation of the system in a live situation, using all
system components and operating procedures.
Since test procedures are often carried out by persons not located in the same
room, it is necessary to have a good way of communicating the procedure and
ensuring that all users know how to execute it.
6) Test Results : enter the test results in form reserved for such results in the SOP.
The executor should record, sign and date the results. Screen prints or electronic
logs should be retained to verify the results.
8) Should the SOP result in disqualifying the system, two steps are required :
1) When systems are being designed or acquired from Suppliers, it would be the
right time to establish broad lines for Performance Qualification. At a later date,
more specific SOPs can refine the qualification criteria.
2) Where appropriate, automated testing tools may be used to record results. These
are available commercially.
5) While carrying out Performance Qualification tests, the Change Control history for
that system must be analyzed to ensure that no changes have been introduced
which would affect test results. (Example : some systems have their memory
reduced to be installed on other systems. This would affect test results).
6) The PQ should always be performed at the user site and will include testing
specific to the user environment and defined ways of working.
Acceptance Criteria :
Upon the successful completion of a Performance Qualification SOP for each system,
application, etc, that item is considered as passed. When remedial action is to be taken,
then the subsequent PQ will be subjected to the same conditions.
ICT Systems need to be secured so that specific functions can only be accessed by
specific staff. This is called the Logical System Access facility and is different from the
Physical access to the ICT Systems site. The latter is defined in Section 6.0 : Physical
System Protection, Access and Security.
2) Some processes are the responsibilities of specific persons and must therefore not
be processed by others. For example, posting vouchers should be identified by
the person who posted them. This creates the necessary transparency.
3) Some procedures can only be executed by persons with the proper background
and training.
4) Some information procedures may put the Department under a liability and hence
should be secured.
Objectives
The last Activity in this Section discusses the current Security Standard within the ISO
certification.
Objectives : in order to control logical access to the ICT systems, the Department has
to prepare a complete list of all functions that are to be secured. For each item in the
functions list there would be a definition of the kind of accesses that may be allowed.
1) The Department’s management must decide who can prepare such a list.
2) List all types of ICT systems to be secured (See above list under scope as a
guideline)
4) Define the nature of access. These are called Privileges. These can be of various
types or levels :
5) If the privilege is subject to an expiry period, then this has to be defined. This is
useful when employees are given time restricted privileges such as when the
supervisor is on leave and hands over his or her duties to someone else.
There is not one way of encrypting data. The Guide can only recommend that the
Department look into the facility of encrypting data that is to be secured.
4) Remote Access to Site : some Departments provide remote sites access to their
system. These sites are to be secured so that no illegal access takes place. It is
important to ensure that all access from such sites is password controlled. As
discussed in the previous paragraph, Encryption may be used to further secure
the access. Should the access be through wide area networks, the
communications protocols should be secured. It is important to be able to log the
remote access and analyze it. Patterns in the usage of remote access may show
illegal attempts at access.
Acceptance Criteria : The list is considered accepted when the Management approve
its content.
Objectives : having identified the functions to be secured on the ICT systems, the next
Activity is that of determining the staff who can access the various functions and assign
them these privileges.
Scope of usage : all staff who can access the system must be included. All the
privileges defined in the previous Activity must be included.
1) The Department’s management must decide who can assign such privileges to
the various members of staff.
2) Ensure that the previous Activity of identifying all Privileges and Access Rights
has been completed.
4) Prepare a list of all staff who might be able to access the system.
5) Group the staff by groups to ease the task of assigning privileges. For example,
all secretaries will have the same set of privileges. A new secretary will
automatically inherit the same privileges as the rest of the group.
4) The above two lists will form a matrix or a spreadsheet. At the top of each
column, enter the type of access. In each row, enter the name of the staff.
For example, under the column Exchange Rates and across from the Chief
Accountant row, you can enter ALL to signify that this person can create, read
or retrieve, update or delete a currency record. On the other hand, a specific
person, such as the Store Keeper, will have only R under his name because he
can only Retrieve the exchange rate but not delete it, update it or create a new
currency code.
Documentation and Deliverables : the list of all staff and their related Privileges and
Access Rights.
1) Review the list periodically as Staff may change posts and may retain privileges
they are not supposed to have. Secondly, they may then be restricted from
privileges they are supposed to use because of the change.
Acceptance Criteria : The list is considered accepted when the Management approve
its content.
Objectives : once the list of all functions is prepared and all staff are given the proper
privileges of accessing the ICT systems, it is time to setup the procedure for assigning
passwords to staff. This Activity presents an SOP that ensures that the process itself is
safe.
Scope of usage : all staff on the list prepared in the Activity 28 : Assign Privileges and
Access Rights.
Risks : without such an SOP, Leakage of Superuser passwords or password lists will
cause the Department to be exposed to insecure systems.
3) Each Superuser can then create Logon IDs and Passwords for the staff, assigning
them the Privileges and Access Rights defined in the earlier Activity.
4) Users will be informed of their IDs and Passwords through some scheme such as
email or sealed envelopes.
The list of IDs and Passwords. This is a very secure document and must be stored where
it cannot be located except by the Management who issued it and the Superuser.
1) In some cases, the system may be able to display the list of all users and their
passwords. Such a privilege should only be given to the Superuser and the Senior
Management.
2) It is good practice to keep the password list outside the Department. This is a
procedure that allows the Department access to the list in case it is lost or access
to the system breaks down. Such lists can be left in escrow with a Bank or parties
that the Department can trust.
3) Users should be instructed to regularly change their passwords. This avoids theft
of passwords. Checks on this can be made at random.
5) Instruct Users on how to prepare their own passwords. Most users tend to use
such easy passwords as their phone numbers, dates of birth, names of children or
loved ones. These are targets for hacking. On the other hand, if passwords are
• Suspend the screen if a user enters a faulty password more than 3 times
in a row within a specific time, say 15 minutes.
• Prepare weekly or fortnightly system warnings for users to change their
passwords
• Stamp all records with the ID of the user who created the record and the
ID of the user who last modified it. This is a good audit trail.
7) One of the two owners of Superuser rights should regularly check his or her
access to ensure that he or she has not been deliberately or inadvertently shut
out.
8) Many systems are assigned passwords that can be cracked by the Suppliers or
are even set by Suppliers. These have to be checked to ensure that only persons
within the Department have such passwords.
Acceptance Criteria : The list is considered accepted when the Management approves
its content, storage and means of frequent update.
Objectives : ISO has established a standard for security (ISO17799) which is slowly
getting implemented in a variety of ICT systems. This Activity introduces this standard
and prepares for its implementation.
What is ISO17799?
The standard is intended to serve as a single reference point for identifying a range of
controls needed for most situations where ICT systems are used in industry and
commerce facilitation of trading in a trusted environment
Background
The standard was first published as a Department of Trade and Industry Code of Practice
in the UK. In February 1995, it was repackaged and published by British Standards as
Version 1 of BS7799. At that time, it was not accepted widely because it was not flexible
enough. Furthermore, its acceptance was delayed because there were other issues such
as Y2K, etc. A major revision took place with the issue of Version 2 in May 1999 and
within the same year, formal certification and accreditation schemes were launched.
Supporting tools start to appear and it was soon published as an ISO standard.
• Many organizations in the West are quoting intent to use the standard
• Some are well on route to certification
• Some organizations already certified through BS7799 are converting to ISO17799
General Description
The Standard, even as far back as the BS7799, was made up of 10 sections :
• Security Policy
• Security Organization
• Assets Classification and control
• Personnel security
• Physical and environmental security
• Computer and network security
• System access control
• Systems development and maintenance
• Business continuity planning
• Compliance
Good Practices
The following set of Activities are concerned with the following aspects of the Information
Resources :
• Physical Protection
• Physical Access
• Security
• Practical usage
The next few Activities shall adopt a different format due to the nature of the items
being reviewed. Each one will have a set of countermeasures (Which automatically point
to the risk to be avoided) and a set of recommended good practices.
Note : the Guide does not provide technical guidance. For example, the Guide will not
present the reader with the best ways to test cables or install servers. These are part of
the technical specifications and would be covered as per the guidelines of Activity 23 :
Specification Qualification (SQ).
Standard Operating Procedure : here is the procedure recommended for all items :
2) Using the items on the list, two major paragraphs are presented. One presents a
list of possible threats or risks. The other presents a list of recommended
countermeasures.
3) The Department can then form a baseline by surveying all the items and checking
whether the countermeasures exist or not.
5) After the survey, the baseline is then updated. Indeed, the Department can
consider surveying the above material on an ongoing basis to ensure that the ICT
Resources are secure and protected.
Objectives : should the ICT Unit be hosted in a dedicated building, the Building would
have its own Physical Protection and Access schemes. However, these are so similar to
measures and practices taken for other computer rooms that the Guide has grouped
them together. The objective of this Activity is to list the various items that fall under
Server Rooms and other Computer locations and identify the threats and related
countermeasures need to avoid them. Refer to the introduction of this Section for an
SOP that covers this Activity as well as for other Infrastructural items.
Scope of usage : there are various rooms that should have special considerations such
as :
• Server Rooms
• Mainframe or mini-computer centers
• Media Archives Storage centers
• Technical Infrastructure Rooms
• Computer Centers
• Protective cabinets (Which may house servers)
Risks : there are various risks involved in the handling of rooms or physical sites. These
are avoided by the following countermeasures :
Recommended Countermeasures
Adapted segmentation of power circuits
Hand-held fire extinguishers
Use of safety doors
Closed windows and doors
Intruder and fire/smoke detection devices
Avoidance of water pipes
Overvoltage protection
Emergency circuit-breakers
Proper earthing schemes
Air conditioning with positive outward airflow
Local uninterruptible power supply (UPS)
Remote indication of malfunctions
Redundancies in the technical infrastructure (Additional hubs, etc)
Development and use of Standard Technical and Organizational requirements for
server rooms
Door key management
Supervising or escorting outside staff and/or visitors
Entry regulations and controls
Inspection rounds
Ban on smoking
Monitoring of access to the room
Shielding or change of location to avoid interference : electromagnetic radiation,
cellular networks or generators.
Good Practices
1) Any devices or equipment which require access by a large user group, e.g. a fax
machine or photocopier, must be located outside such rooms.
2) Combustible materials such as printer paper should not be stored in such rooms.
3) Avoid the use in computer centers of mobile phones or other units that have
transmission/reception facilities such as walkie-talkies and pagers. These can
cause considerable interference with the operation of the systems.
4) The rooms should not be occupied by regular staff. They should be used only
randomly and for short-term assignments.
Objectives : cabling of ICT Systems covers all cables and passive components of
networks. Their scope is from any existing delivery point of an extraneous network
(telephone, ISDN) to the terminal points of network subscribers. The objective of this
Activity is to list the various items that fall under cabling and identify the threats and
related countermeasures need to avoid them. Refer to the introduction of this Section for
an SOP that covers this Activity as well as for other Infrastructural items.
Risks : there are various risks involved in cabling. These are avoided by the following
countermeasures :
Recommended Countermeasures
Good Practices
1) Make available all cabling plans and drawings in an easily recognized location. It
is often the case that other infrastructural technicians may need to work on the
structures and would hence be helped by tracing the cables.
• Server-Based networks
• Networked Unix Systems
• Peer-to-Peer networks
• Windows NT networks
• Novell Netware based networks
• Heterogeneous networks
This Activity does not take network operating systems or the operating systems of client
PCs into account.
Risks : there are various risks involved in the handling of networks. These are avoided
by the following countermeasures :
Recommended Countermeasures
Good Practices
Network management includes all the precautions and activities for securing the
effective use of a network such as :
Objectives : to determine the staff who can access the various areas in the Computer
Center and assign them these privileges.
Scope of usage : all staff who can access the system must be included.
Risks : not assigning Physical Access Privileges properly will cause the Department to be
exposed to insecure operations.
A Department may introduce different types of physical access control schemes such as
the following :
1) Monitor entry manually through registration at the desk and the issuance of
visitor badges
2) Use automated badge card readers and provide staff with cards that can access
specific areas in the center.
3) Use password protected door locks
1) The Department’s management must decide who can assign such privileges to
the various members of staff.
2) Identify all systems that need to be physically secured and their locations.
4) The above two lists will form a matrix or a worksheet. In each row of this
worksheet, enter the staff names. At the top of each column, enter the
system/locations of access. In each cell where a row and a column meet, you can
then indicate the type of access for that staff.
5) Depending on the type of Access System used, the Department can then issue
passwords, cards, etc.
Documentation and Deliverables : the list of all staff and their related Physical Access
Privileges.
1) Staff may change posts and may retain Physical Access privileges they are not
supposed to have. Secondly, they may then be restricted from areas they are
supposed to use. Review the list periodically.
Acceptance Criteria : the list is considered accepted when the Management approve its
content.
Objectives : in some cases, Physical Access to ICT locations may require passwords.
Such schemes as password protected door locks and cards require issuing policies. This
Activity aims at setting up the procedure for assigning passwords and/or distributing
access cards to staff.
Scope of usage : all staff on the list prepared in the Activity 34 : Assign Physical Access
Privileges.
Risks : this is a very risky activity. Leakage of passwords or password lists will cause
the Department to be exposed to insecure systems.
2) The Access Administrator will then handle the creation of Passwords for all staff
and the production of the access cards.
3) Users will be informed of their Passwords through some scheme such as email or
sealed envelopes. Cards are also distributed through a secure scheme to ensure
that the right person has received the right card.
The list of and Passwords and/or the list of assigned Access Cards. This is a very secure
document and must be stored where it cannot be located except by the Management
who issued it and the Access Administrator.
1) It is good practice to keep the password list outside the Department. This is a
procedure that allows the Department access to the list in case it is lost or access
to the location where the list is kept is not possible. Such lists can be left in
escrow with a Bank or parties that the Department can trust.
2) The Access Administrator needs to regularly change passwords. This avoids theft
of passwords. Checks on this can be made at random.
Acceptance Criteria : the list is considered accepted when the Management approves
its content, storage and means of frequent update.
Objectives : to present a set of Good Practices that aim at insuring the various ICT
resources in the Department. The financial value of a Department’s systems along with
related equipment may reach a high enough value to warrant such an insurance.
Scope of usage : insurance can cover a variety of losses. These are defined in the Good
Practices section below.
3) Loss of Work : loss of time spent on work caused by Force Majeure or other
damaging situations can be insured. Such work can be insured : recovery costs,
rework, reentry of data, reinstallation of software and systems, cost of the
emergency procedures, etc.
4) Loss of Source Code : this often happens in different ways. Source code may
become inaccessible for various reasons. Source code may be corrupted. Wrong
backup may take place. Backup media may be destroyed due to various reasons.
The Department can also insure itself against such losses.
In many cases, losses can be averted by proper backup, increased Risk Analysis and
better physical security management as shown in the previous Activities in this Section.
In the case of setting up a Disaster Recovery System, various works can be insured.
Review paragraph (3) in the Activity 44 : Disaster Recovery – Good Practices.
One of the most frequent causes of damage or the highest risks in ICT Systems is loss of
data or its corruption. The reasons are many : equipment breakdown, operator error,
software bugs, etc. The only effective measure that can be taken to ensure that
Information Integrity is maintained in an acceptable state is to have a rigorous Backup
and Archiving policy.
Some Definitions
Backup is the storage of data, source code, software products, scripts, etc., on a
separate medium that can be used to restore the data to its initial form if need be. This
could be a regular or an ad hoc activity.
Archiving : this term is essentially the same as Backup. However, some centers use it
to signify removal of the data or cyclical backup that is not very frequent. In all cases,
the procedures are the same as for Backup, so this Guide will not differentiate between
the Backup and Archiving.
Purging : removing data from the initial medium to make space or reduce database
size. Example : transactions are kept within the operational database for the current and
the most recent 3 years. On completion of each year, the ICT Unit would need to purge
the oldest year from the database.
Checkpoints : these are points in time where the Department has to take a full backup
so that disaster recovery schemes can be used to restart the system from such
Checkpoints. (Review Activity 43 : Disaster Recovery Procedures)
The following Activities present various procedures and good practices related to the
above.
Objectives : the purpose of this Activity is to document the data and software that
needs to be backed up and/or purged. A Back Definition List will define the scope of
the data and will include a variety of information about each specific backup.
Scope of usage : the following is a recommended list of data and software but is not
restricted to these items. These are targets for back up :
Risks : not preparing a proper list of items to be backed up will cause the Department to
be exposed to loss of data.
1) Classify the types of data to be backed up as suitable for the Department. Refer
to the Scope of Backup above for a proposed classification.
3) Prepare the Backup Definition List which contains the following data
elements :
Good Practices :
1) User Input : it is good practice to include users when defining the Backup
Definition List. Users usually have a good sense of how to avoid data loss and
would indicate at which critical points backup is to be made.
In fact, any time the Department feels that there will be a risk of data corruption,
backup should take place.
4) Regularly review the Backup Definition List as it often arises that new systems or
situations arise such as those in the previous paragraph that will require the
Department to update the list.
Acceptance Criteria : the Backup Definition List is considered accepted when the
Management approves its content, storage and means of frequent update.
Risks : not backing up the data on a regular basis will cause the Department to be
exposed to loss of data and software items.
1) Consult the Backup Definition List on a regular basis to ensure that no backup is
missed.
2) Backup Media : ensure that there is available media for the backup well in
advance of the backup itself. Many centers lose valuable data because media is
not available and operators end up backing up over backed up media with useful
data.
3) Complete the backup and fill in a register that has the following recommended
columns :
Date of backup
Time of backup
Type of backup (Incremental, full, purge, etc)
Source data : describe it and its status
ID of the backup as per the Backup Definition List
(Refer to Activity 37 : Identify What is to be Backed Up and When)
Operator
Media type
Media label
Where the media is to be stored
Has restored testing been tried?
Result of restore testing
Remarks
Acceptance Criteria :
1) On a regular basis, the Backup Register should be checked against the actual
media. Verification can be made that the backup entries correspond totally to the
stored media.
2) On a regular basis, the Backup Register should be checked against the Backup
Definition List prepared in the earlier Activity 37 : Identify What is to be Backed
Up and When. Verification can be made that all items in the Backup Definition List
are being properly backed up. (To facilitate matters, the Backup Definition List ID
is included in the Backup Register).
2) More importantly, and this will be discussed in the next Activity, restore checking
should be made on random or specific backups. This should be part of the
Acceptance Criteria of the Backup Register preparation.
Objectives : many centers face major upsets upon realizing that their backed up media
is badly backed up or is corrupted. The main reason for such a state is the lack of testing
of the backed up media. Sometimes, it is a matter of deterioration of the backed up
media or its environmental corruption. This Activity presents a procedure that defines
what media is to be “Restore Tested”, how frequently and what the tests are.
Scope of usage : all data that is backed up may be subjected to Restore Testing.
Risks : not testing backed up data will cause the Department to be exposed to loss of
data and software items.
1) Identify the type of data to be Restore Tested and enter the relevant information
on the Backup Definition List prepared in Activity 37 : Identify What is to be
Backed Up and When. The ID of that item would then be known. A new List can
then be prepared which can be called the Restore Definition List.
3) For each item in the Restore Definition List, prepare a Test Plan that covers all
aspects of the Restore and its testing. A typical test plan is presented below :
Good Practices :
1) User Input : it is good practice to include the users when defining the Restore
Definition List. Users usually have a good sense of what is risky in their work.
They would help the ICT Unit identify which data is to be tested, when and what
constitutes a good Test Plan.
Acceptance Criteria : the Restore Definition List is considered accepted when the
Management approves its content, storage and means of frequent update.
Objectives : this Activity presents a procedure that allows the Department to reduce
the risk of bad backup media through regular Restore Testing.
Scope of usage : in most cases, it is too costly and time consuming to test all backed
up media. However, frequent and random tests can reduce the risk of damaging
situations.
Risks : not carrying out restore testing will cause the Department to be exposed to loss
of data.
1) Consult the Restore Definition List to identify the items that require Restore
Testing.
2) Prepare the receiving system for the Restore and restore the data
3) Apply the Restore Test Plan as indicated in the Restore Definition List.
4) Prepare a Register that shows the Restore Test details and results :
Identify the ID of the backed up media to get all the data elements for it
Date of Restore test
Time of Restore test
Type of backup (Incremental, full, purge, etc)
Operator
Test script or plan
Result of restore testing
Pass or Fail
If fail, remedial actions
Remarks
6) If the Restore Test fails, the Department would have unusable data. It becomes
the responsibility of operators to do one of two things :
Data recovery is possible : the operators will recover the data through some
means like reindexing, etc. Alternatively, they can get the data from duplicate
media stored outside the Department.
Data recovery is not possible : if neither of the above schemes is possible, the
operators would need to give warning to the ICT Unit Management and the user,
that such data is not available. In case of needing such data, it may have to be
re-entered and processed.
7) In all cases, enter the data related to the Restore Test in a Restore Test Register.
4) Auditing Restore Testing : similarly, some centers may wish to have auditors
or user representatives on the spot when such tests are carried out.
Acceptance Criteria :
On a regular basis, the Restore Register should be checked against the Restore
Definition List prepared in the earlier Activity 39 : Identify What is to be “Restore Tested”
and When. Verification can be made that all items in the Restore Definition List have
been properly tested.
Objectives : the main aim of this Activity is to present a set of Good Practices that
apply to the variety of back up procedures presented so far.
1) Media Availability : ensure that there is available media for the backup well in
advance of the backup itself. Many centers lose valuable data because media is
not available and operators end up backing up over valid and much needed
backed up media.
2) Labeling Procedures : one of the major problems facing ICT Units is that when
a backup medium is required for restore, the operators are never sure which data
it contains. Labeling is important but not sufficient. A rigorous scheme for labeling
must be followed and should be linked to the Backup Definition List identification.
This should also include Directory or File Listing so that file dates are clearly
shown.
3) What to do with Local Data? With the increasing spread of PCs on user desks,
larger and larger portions of a Department’s information will be processed on
these local PCs. This presents a risk to the Department because users are not
very disciplined about their own backups. There are two solutions to this
problem :
Server based data : force users to work on a folder hierarchy that is setup on
the Server and is secure, so that no other person than the specific user can
access such a hierarchy. This is a safe process. However, it does present an
additional load on the network since processing requires data traffic with the
server.
Locally based data that is regularly backed up : users can be shown how to
concentrate all their data in one main folder hierarchy on their own PC. On a
regular basis, scripts can be prepared to push that data from the local folders to
secure folders on the Server. This is more efficient in terms of network traffic but
is slightly more risky as the data is as fresh as the most recent backup.
4) Rotational Backup : ensure that there is a daily backup for all operational data
that is stored on separate media so that there is a tape for Monday, one for
Tuesday, etc. These can be rotated during the next week.
Once a week, prepare an end of week tape separately for each week in the
month. These can be rotated during the next month.
Once a month, prepare an end of month tape separately for each month in the
year. These can be kept as archives.
Of course, some Departments may consider the above too risky and would need
to establish daily or weekly backups that are rotated less frequently. Some may
even require hourly backup.
5) Offsite Locations : ensure that duplicate backups made for key periods such as
end of week or end of month or end of key closing periods are stored outside the
site to avoid theft, damage or loss. Usually, it is best to store such off site backup
media with a Bank or a branch of the Department.
6) Media Duplication : often magnetic media spoils with time. It is therefore highly
recommended to include in the above list backups whereby existing backups are
duplicated on other media. Both are then kept in case of need.
It is highly recommended that when the ICT Unit feels that a specific backup
media is being slowly phased out of the market (As what happened with the
LSI-120 disks), that all backed up data gets migrated onto more popular media.
8) Automating Backup : there are products in the market that automate the tasks
of Backup with such features as : scheduling, tracking, incremental backup, etc.
It is recommended that such software be used.
9) Mirroring : disk systems can be duplicated to allow the system to use mirroring
of data. Furthermore, the RAID technology allows such mirroring with the facility
of hot swapping in case of breakdowns, etc. This is also recommended.
Objectives : viruses are increasing in their damaging capability as well as the way they
carry out such damages. The aim of this Activity is to provide Good Practices that reduce
the problems associated with Virus infection to a minimum.
Risks : virus can corrupt data, stop access to systems, wipe out files and cause system
slow down. In web sites, they may create a denial of access to the site or even redirect
traffic.
1) Backup : one of the best insurance schemes against infection is proper data
backup. This includes all operating or application software. Review the earlier
activities in this Section for a discussion of backup procedures.
2) Use up to date anti-virus products with the latest patches and upgrades.
These have to be licensed to run on the various machines in the center.
4) System scans : on a regular basis, scan the whole system including zipped files.
This can be carried out at night when there is no work load on the system.
5) Importing data into the site : in the sites where there is a lot of traffic of data
to and from the outside world, it may be required to implement strict techniques
about using data on floppies or CDs or zip drive disks coming from the outside.
Some centers disable all such units. Others remove them completely. In the case
where a center cannot remove a CD drive because of its internal use, it becomes
critical to discipline users to scan CDs for viruses before using them.
6) Virus hoaxes : even though there are many virus hoaxes, it is better to be safe
than sorry. Stories should be believed until proven innocent. There are several
sites on the web published by the major anti-virus developers that list the hoax
viruses. Virus warnings sent by mail should be checked against these sites. Here
are some examples :
http://www.europe.f-secure.com/news/hoax.htm
http://vil.nai.com/VIL/hoaxes.asp
http://vil.mcafee.com/hoax.asp?
These and other sites will also list real viruses and explain what their effect is and
they can be treated.
Force Majeure situations may occur and disrupt business at the Department over periods
of different lengths. Such situations as the following can cause disasters :
• Civil strife
• Lack of access due to security reasons
• Flooding or water seepage
• Total electrical failure
• Construction damages
• Extreme weather conditions
• Chemical or toxic gases
• Etc
Whatever the case the Department’s ICT Processes should guarantee that there is a
continuity of the Department’s business by setting up countermeasures to such failures
and disasters.
Such plans should be available to describe how the Department can continue to operate
in the event of its ICT Systems not being available. The Plans should include :
Contingency procedures as well as Disaster Recovery procedures.
The recommended solutions cover different types of disasters. Departments may modify
these terms to suit their own "urgencies". The following Activities provide Procedures
and Good Practices for the following types of interruptions :
1) Stoppages within the center that result in an interruption of a few days. Such a
stoppage is short enough not to require relocation of the total system.
The Guide will provide three main Activities to ensure Business Continuity by grouping
the above 5 types of sites into 3 groups. Notice that the first type of stoppage is
considered non-critical and will be considered as part of the first group :
The following are broad steps to be followed depending on the size of site and criticality
of that site :
1) Prepare an agreement with another center a distant from the current site so that
the equipment in that center can be used in emergency situations.
2) Recover all software and data
3) Resume operations
2) Acquire a mirror system through purchase or agreement with a third party for use
in such situations. The system need not have the same capacity as the current
system. Minimally, it should be able to run the mission critical applications.
3) Install the software and ensure that the operating environments are compatible.
4) In an emergency situation, the Department can resume its work from the latest
Checkpoint.
Note : in the following discussion, the Guide will not differentiate between the above
choices but will present a generic Disaster Recovery Procedure or Plan for all types.
The Recovery Test Plan : a document that shows the procedure needed to
certify that the Recovery has been properly executed. For example, the Test Plan
can include :
File counts
File sizes
Tests on various reports (Transaction listings, etc)
Database record counts
Date checking
Etc
Keep the above documents ready outside the Department so that they can be
immediately accessed in the case of Disaster.
Note that even if agreements exist for such systems, the organization in question
might also be under the same disaster, so it is preferable to have recourse to
more than one such site.
The frequency of such backup should be commensurate with the time of stoppage
that the Department can afford. For example, if the Department is worried about
interruptions that may last more than 1 week, then the backup should be taken
at least once a week, preferably on daily basis.
Recovery Procedure
3) Conduct a test of the recovery procedure as per the Test Plan prepared earlier.
4) Inform all users as to when they can start in the sequence of their work. This
totally depends on the most recent restoration of the data.
Objectives : the previous Activity presented a procedure for handling the recovery from
disaster by preparing alternative systems. This Activity supplements the previous
Activity by presenting good practices to be followed when handling such situations.
The following Good Practices are suggested as a support to the Disaster Recovery
Procedures of the previous Activity
1) Outsourcing : the major servers needed as Recovery Systems may not always
be available within the Department. Indeed, in some cases, it has been known to
resort to such systems outside the country. Therefore, any outsourcing to be
made to have access to such systems must be submitted to rigorous qualification.
Furthermore, it is critical to regularly test the alternate site to ensure that the
Recovery System is ready for operation.
5) Risk Analysis : much of the cost and time loss of the Disaster Recovery can be
avoided by a rigorous Risk Analysis of such situations. Ensure that Disasters are
included in the Risk Events to be analyzed in the Department.
Objectives : as an insurance against the possibility that a system may not be available
for any reason, it is essential to have recourse to Manual Operating Procedures.
Technology being addictive, most organizations forget how to process their work in a
manual fashion and end up losing time and money in case Disasters take place. The aim
of this Activity is to prepare a procedure that defines how Manual Operating Procedures
can take place in case the ICT Systems are not available.
1) Prepare a Procedure for each of the information processes within the system. For
example, Entry of project data is one such procedure.
• Define the reports that define the status of the data at specific
checkpoints.
• Identify the transactions through their manual vouchers
• Define the procedure used to update the data manually and check it
• Define the procedure to be used upon re-starting the system
3) On turning into the Manual procedure, follow the steps of each of the above
procedures.
Example : the following is a typical procedure for the Maintenance of the Vehicle Fleet in
the Ministry of Public Works :
Prerequisites : a daily list showing all vehicles with transactions on each starting from
the beginning of the month. There will be a list identifying the following vouchers :
change of location, change of department, entry of petrol usage, entry of distance
counter, change of vehicle particulars (Color, chassis, etc), entry of maintenance
summary, etc.
2) As each voucher is received, then manually update the statement by adding one
line by hand showing the specifics of the particular transaction.
3) In case cumulative totals are required such as in the case of Maintenance Costs,
these can be computed on the hard copy report.
4) On a weekly basis, prepare a summary list of all totals (In the above case, only
the accumulated costs).
Upon resuming the system, the operators can re-enter the data directly from the
manually prepared transaction histories.
Throughout the past 30 years, the ICT industry has been plagued with problems that
were and still are mostly caused by poor software. The basic reason is simple. The
Software Technology is still young and has not had the chance to develop a standard
methodology for architecture and contracting, as was successfully done in the
Construction Industry.
Software Development Processes (SDPs) have started arising and as is normal in such
situations, there are many competing processes.
Objectives : Most ICT Units suffer from not having a defined and documented Software
Development Process (SPD). Suppliers delivery customized software applications to the
Department may suffer from a similar shortcoming. Selecting and adapting an SDP is not
a simple matter. The Guide will not present such a procedure. However, this Activity will
define software development processes, emphasize their importance and provide
guidelines on how to select them.
Scope of usage : this covers any software development effort whether for :
It is critical to note that SDPs are called “Processes”. This is to emphasize that they are
not simple step by step “Procedures”. Indeed, many have failed in the past because they
were forced into tight waterfall “Procedures”.
Risks : not using a Software Development Process may result in the following risks :
With the above restrictions, the Guide will neither be able to recommend a specific
Standard Operating Procedure for an SDP nor provide a set of Good Practices for one.
• A methodology that follows a Project Plan and not just tips and techniques
for development.
• It must rely on Modern Project Management practices
• Be based on a modern modeling scheme so that the documentation across
its phases is visual, simple and accepted internationally
• The SDP must not have a strict waterfall approach. The waterfall method
of analysis, design, development, testing and implementation must be
avoided. The alternative is a two dimensional approach where the phases
correspond to those of a modern project as discussed in the Project
Management Institute’s site at www.pmi.org. Within each phase, there will
be a variety of processes such as analysis, design, building, testing, etc.
• Documentation must be a high priority for the process.
• Reuse of components
• Must be flexible and it must be subject to reconfiguration so that it can be
used in different environments.
• Platform and development language independent
• Application independent
• Rely on horizontal Teamwork as opposed to Hierarchical structures
• Iterative and incremental Development
• Efficient and Quality controlled Requirements Management
• The use of Component Architecture
• Traceability of models
• Relies on Risk Management
3) Selecting the SDP must submit to the same procedures presented in Activity 49 :
Selecting Software Applications.
4) Once an SDP is introduced, special effort must be put on maintaining its practices
as planned. Various organizations fall into the trap of applying an SDP only to
start drifting from its standardized procedures.
Objectives : various development tools and platforms (Database systems) can be used
to assist the software development process. This Activity highlights the importance of
using such tools. It also presents some of them and emphasizes the need to justify them
operationally and financially.
Scope of usage : software tools are needed to support the Software Development
Process selected by the Department.
Risks : not using the proper software development tools would result in the following
risks :
CASE Tools
Integrated Development Environments
Commercially available libraries of components, routines, etc
Business Modeling tools
Source code repositories
Debuggers
Automated testing systems
Commercially available Software Development Processes
Help file generators
Code generators
Report generators
Data warehousing and OLAP tools
2) The Department should select the products that it requires and present a
justification for their acquisition. The justification should be documented.
3) Proper training should be had of all such tools otherwise they will not be
efficiently used.
4) Tools that enforce a standard must be widely utilized as the tools would have a
negative impact if part of the Department does and the other part does not use
them.
5) It is often possible to acquire trial or evaluation products that can be used and
tested before purchasing them.
Objectives : with the large number of development platforms, and due to the hurried
nature of development itself, the development profession has not been able to
standardize its work. There are many reasons for this shortcoming that the Guide shall
not go into. However, the Guide will recommend a set of Good Practices that serve to
establish programming standards.
Scope of usage : the scope of this Activity is not limited to one development platform
but is presented as a generic set of practices to be setup for each.
1) Study the development platform under use and establish Programming Standards
that apply to it.
2) Publish the standards and ensure compliance with them. This can be carried out
by frequent checking, dry testing and code review.
3) The following are the areas that need to be addressed when setting up a
Programming Standards document. Review web sites and academic material for
work already done in these areas, especially if a specific development platform is
in use :
• Access to Hardware
• Argument Passing
• Comments
• Data Declarations
• Defining Constants
• Documentation
• Error Handling
• Function Declarations and Returns
• Function Layout
• Including Files
• Modular Coding
• Module Layout
• Naming Files
• Naming Variables
• Source Code Formatting
• Standard techniques and algorithms
• Style consistency
• Version Control
4) The Department should use source code repositories. These have the following
useful features :
Scope of usage : covers the selection of all types of software applications and tools.
Standard Procedure :
3) Create and Issue RFP : where the RFP must include all relevant sections
discussed earlier in Activity 22 : Recommended Issues to Consider in ICT
Agreements. Especially important is the presentation in the RFP of the basis of
the evaluation scheme to be used to select the supplier and the product.
4) Create and Issue Demo Scripts : on receiving the proposals, and part of the
evaluation of the products, the Department must issue scripts to be used in the
demonstration of the products. These are test and evaluation scripts that will
verify that each of the functions stated in the design or specifications is part of
the product and is working as expected.
5) Visit other user sites : one of the most efficient means of analyzing software
products is to view them under actual usage. This exercise also confirms that the
supplier has already installed the product elsewhere and that as such, he has the
proper experience in supporting the product.
7) Project Plan : in parallel with finalizing the draft agreement, the Supplier and
the Department must prepare a final Project Plan for the acquisition, installation,
operation and performance testing of the software product. The plan must be
subject to the criteria established in the various Qualification Processes :
Installation, Operation and Performance Qualifications discussed in Section 4.0.
Documentation or Deliverables :
1) Software specifications
2) Evaluation criteria and weights
3) The request for proposal (RFP)
4) Demo or test scripts
5) The test results
6) The evaluation results
7) The implementation project plan
Acceptance Criteria : upon the submission of all the above documents, the Activity can
be considered complete.
There are various Procedures and Good Practices that should be followed by the
Operations Unit to meet the above objectives. The functions of this Unit were clearly
stated in the Appendix of Supplementary Material. Therefore, in this Section, the
Guide shall not repeat the functions of data entry, data flow, etc.
The Activities that follow cover some procedures related to the Operations Function. The
following Section covers procedures related to the Data Entry functions.
Objectives : one of the main causes of disputes between the following parties is that
lack of coordination on Support and Maintenance : users, third parties supporting or
maintaining systems, Suppliers and the ICT Unit. This Activity presents a procedure that
defines the means of logging all support calls for the purpose of tracking, analysis and
control.
Risks : not having a register will lead to lost calls, improper traceability and reduced
analysis of problem causing areas.
1) Valid users : establish a list of all persons who can call regarding Maintenance
and Support services. Persons outside this list should either be considered for
inclusion or given special lower priority treatment.
2) Valid items to maintain or support : establish a list of all items that can be
supported. Items outside the list should either be considered for inclusion or
given special lower priority treatment. (This could be linked to the Configuration
Management database).
1) Each call should be registered or logged on the selected media : printed form,
email, intranet web page, application, etc.
2) The Maintenance and Support Request form should contain the following data :
Time/Date
Name of User / Department
Type of call (To be entered by the user and later modified if need be)
Description of problem
Priority (To be set by the user)
Expected date for completion (To be set by the user)
3) The Calls should be processed by support staff who can tell which one is to be
support by which unit. They will then be routed accordingly. During routing, the
support person can enter the receiving party’s name on the form.
5) The support person will then review the situation, visiting the user if need be. On
completion, the following is entered on the call form :
6) In case the call is being handled by a Supplier, then the Supplier must complete
the call and fill in some of the information above.
1) Since users generally consider all their problems as high priority, it may be a
good practice to prepare a Help Desk that filters these calls, directing the user to
note down his or her problem on paper or electronically if that problem is judged
to be of medium or low priority.
2) Whenever there are changes to the Configuration, these should be posted onto
the Configuration Management database by the person completing the
Maintenance or Support Request.
Scope of usage : all displays and reports are included in this Procedure. Moreover, with
the popularity of exporting data from various databases for use on local employee
stations, such data is also included.
Risks : not being able to control the dissemination of hard copies may lead to the
following risks :
• Lack of security
• Overproduction of reports
• Storage of paper reports instead of on electronic media leading to loss of space
1) Prepare a list of all reports, major screen outputs and exported data
2) Define the frequency of the reports when they are cyclical. The rest can be
produced on request.
3) Prepare a list of all users and which reports they should receive
6) The Reports Distribution List : by now, the Operations Unit would have a list
of all reports to be produced for which user and at what frequency.
As this list, produce the reports where it is the responsibility of the Operations
Unit to do so, otherwise, that is left for the user.
1) Electronic Storage : in the past, it was always the case that reports should be
produced for auditing and checking purposes. With more reliable software, it is
recommended that users should be store reports in electronic format on their
individual PCs. This would save in printed paper and time of production.
Here, it may be beneficial for the Department to resort to the use of COLD
technology (Computer Output on Laser Disk). This technology converts any report
being sent to a printer into an Acrobat Reader PDF or ASCII text mode in an
electronic format providing a variety of search services, annotations, etc.
4) Security : sometimes reports have part of their data that needs to be secured.
For example, an inventory list in the Municipality’s Vehicles Maintenance
Department should be viewed by anyone. However, not anyone should be able to
review the cost prices. Therefore, the design should cater for such security checks
at the data element level.
Acceptance Criteria :
The Reports Distribution List should be approved by the Management of the Department
before any reports are released.
Objectives : with the spread of Office Technology, User Support is currently a wider
function than simply that of supporting an application. The Support Unit is described in
the Appendix of Supplementary Material. The objective of this Activity is to present a
set of Good Practices for the Planning, Execution and Control of User Support.
• Management
• Technical and Operational Staff
• Users accessing the system from outside the Department (Citizens, companies,
etc)
Risks : not having proper user support may lead to the following problems :
1) Ensure that the Procedure defined in Activity 52 : Good Practices for User Support
is setup for logging Support Calls. This is useful to track calls and follow them up.
When analyzed, the types of support calls direct the Department towards the
solution of the problems causing these calls.
2) Ensure that Users are properly trained in all products that they use. It has been
regularly shown that properly trained users translates into a major drop in the
volume and criticality of support calls.
3) Encourage Users to resort to Help Files and user Documentation. This would also
translate into a drop in the volume of support calls.
Objectives : to present a set of Good Practices that allow the Department to better
manage the supplies needed for the various ICT Systems. Essentially, these aim at
ensuring that supplies have the right quality, capacity, standard and availability.
2) Define the expected usage for the next period (Usually, one year).
3) Survey the market and qualify the Suppliers and their supplies.
6) On a regular basis, analyze the above inventory to ensure that there is enough
material to avoid shortages.
1) Some supplies have special storage requirements which should be observed. For
example, some computer continuous forms should be stored in computer rooms
to avoid humidity which may cause paper jams. Magnetic media should be stored
in areas that are protected against interference.
2) Pay special attention to Backup Media Control. Shortage of such media can be
most damaging.
Objectives : generally, most work done on improving the standards of data entry
covers the entry of data for operational, financial or administrative applications. These
are either developed for the Department or acquired as Commercial products. This
Activity presents some Good Practices for ensuring that all data entry procedures are
properly documented.
Scope of usage : generally, this would apply to data entry for operational,
administrative and financial application software. However, in some cases, there are data
entry procedures that are covered by Office Technology products.
Risks : not having proper data entry procedures would lead to the following :
• Improper entry of data causing errors, rework and possibly damages with citizens
and other users of the data.
• Erroneous or slow entry of data leading to loss of time and re-entry
• More rigorous training of new staff
1) For each data entry form in each software application, a detailed Data Entry
Procedure is to be prepared. Generally, the software would have such procedures
if it is well documented. In such a case, the Department should check if such
procedures are sufficient, otherwise, they would be used as the basis for a
redeveloped Data Entry Procedure.
Training
Day to day entry tasks
Validation and consistency checking
Auditing purposes
Refreshing the user
2) On preparing a Data Entry Procedure, it should be tested to ensure that all data
elements are clearly explained and that the procedure is easy to understand and
use.
5) Use Audit Trails when possible. Audit Trails are rigorous ways of verifying
proper data entry. Throughout the years, the term got distorted to mean the
following : a list of transactions as entered. This is not correct. Audit trails
technically mean the following. A batch of vouchers is entered. One of its fields is
accumulated manually, say the amount on the voucher. The batch is controlled as
one single group of vouchers by the system. The batch or Audit Trail is entered
into the system. The batch is not updated or posted to the database unless the
computed total equals the entered total. Along with this checking, the system
must be able to produce a validation list of all vouchers before committing the
entry.
6) Data Integrity : various systems are designed without proper data integrity. For
example, there are many Inventory Management systems that allow the quantity
to go negative. There are cases where the accounting vouchers posted from an
operational module do not correspond to the totals recognized by the accounting
system. For example, purchases in the Inventory Management system do not
correspond to the total inventory in the Accounting System. Such areas should be
investigated and checked on a regular basis to ensure that there is Data Integrity.
Acceptance Criteria : data entry procedures are critical and must be validated by the
developers of the software and the users in the related Departments. Upon full validation
that such procedures are corrected, it is recommended that they be tested. They can
then be accepted.
The following types of checks and controls are important to have in the data entry
screens in all software applications :
The above guidelines should be standardized across various applications to ensure that
users get familiar with the look and feel of applications and hence require less training.
Scope of usage : covers all PC based applications that are used on a stand alone basis
by the users. This covers such products as word processors, spreadsheets, personal
information managers, email, faxing products, illustrators, minor databases, web page
editors and a variety of other office technology products.
1) User Training : one of the most prevalent problems is that of lack of familiarity
with Office Technology Products (OTP) in use. Most products are simple to “start
using”. However, as soon as users hit difficulties, they are on their own without
assistance. This is due to lack of proper training and poor practices. The first step
to ensure proper use of Office Technology Products is to provide regular training
of users.
4) Standardized File Naming : for files that are used internally and between
different users, it is best that a standardized naming procedure is followed. This
may be linked to a reference generator that is setup on a published register. For
example, on issuing a specific type of certificate, the user can open a centrally
accessible spreadsheet, get the next reference, register the certificate on the
6) Using standard forms : many organizations fall in the trap of using different
forms for their standard correspond and issues. Forms can be standardized and
setup as templates on the user systems or on the central server. Linked with the
reference generating practice discussed above, this would give the Department a
more efficient control of correspondence. Such forms as the following can be
standardized :
7) Version Issues : office technology product suppliers often update and upgrade
their products resulting in documents not being compatible between one version
and the next. Often, this causes inconvenience and time loss for users
exchanging such documents. It is therefore important to ensure that all users
have the same versions of office technology products or at least have the proper
converters for such products.
Most large computer centers require specific environmental conditions so that the
equipment is maintained in proper running order. This is an Information Process that
covers the definition of environmental conditions, the drivers used to maintain such
conditions within the correct operating zones and the testers needed to warn against
such conditions going out of their operating zones.
Objectives : this Activity presents a Procedure that defines the technical specifications
required of the environment of the site where various ICT systems reside.
Scope of usage : the environment covers large computer sites, server rooms,
communications rooms, cabinets, media storage, etc. Equipment is required to monitor
the environment for such purposes as :
Risks : not knowing what the proper environmental conditions are may lead to
• Building improper sites : either too lax which may cause system problems or too
strict which may require excessive costs.
• Not recognizing that the systems are operating outside their proper operating
zones and hence expose the Department to environment problems
The following Procedure should be prepared with the help of Suppliers, Site Engineers
and in some cases, the architects of the site. It consists of the development of 5 types of
documents :
Temperature levels
Dust levels
Humidity levels
Quality, stability and continuity of power
Radiation interference (Radars, cellular networks and phones, motors, etc)
Smoke levels
Fire
Other gases
A/C quality
Etc
2) Range of Operation : define the ranges allowed for each of the above for the
specific site. These are technical specifications and should be validated with the
Suppliers or the Manufacturers of the Equipment.
These are also critical items since in some cases, insurance, warranties and
maintenance agreements may be voided if the environment is not within its
required limits.
• Stoppage of work due to the environment creeping out of its valid operating
zones
• Damage to equipment in the short and long term
• Corruption of data on current and backed up media
• Voidance of warranties and maintenance terms by Suppliers who will claim that
their equipment may have been operating outside their acceptable operating
zone.
1) Ensure that the 5 lists required in Activity 57 : Define the Required Environmental
Conditions have been properly prepared.
2) Ensure that the required monitors as defined in the above lists are acquired on
time and installed according to the proper IQ and OQ procedures presented
earlier.
6) Diagnosis and Remedial Action : in case monitors give results that show that
the various environment parameters are veering out of the acceptable operating
range, the related parties responsible for such systems should be contacted for
diagnosis and remedial action.
Acceptance Criteria :