This paper critically reviews approaches for the evaluation of investments in information
systems prior to their implementation. First, the ground for the review is prepared by
examining characteristics of evaluation, information systems and value. A classification of 54
evaluation approaches identified in English and German literature is then presented. Examples
of each class are reviewed and their advantages and drawbacks are discussed. Their use in
evaluation practice is analysed through the examination of empirical studies and directions for
future research are given. Today, a significant share of corporate funds is spent on the implementation, upgrading and
maintenance of an information system (IS). Recent studies show that in 2001 the IS budget of
companies worldwide accounted for an averaged 8.8% of total corporate revenues (cf. CSC,
2001). Consequently, a thorough evaluation of investments in information systems before,
during and after the implementation of a project is important. However, the normative
literature reports a great deal of difficulty in the appraisal of these investments (cf. Irani,
2002:11). Although IS evaluation has been an issue for both academics and managers for
more than three decades now, there are still serious concerns about how to select projects for
investments, how to control the development and how to measure benefits after the
implementation (cf. Farbey, 1999:189). This concern has been matched by increased research
activity which prevailed through two broad streams. The first stream aimed to directly
measure the payoff of IS investments for companies and came to mixed conclusions (cf.
Dehning and Richardson, 2002:8). The second stream addressed the question of how IS
investments can actually be assessed by decision-makers and particularly focussed on the
research of evaluation criteria, evaluation methods and the very nature of the evaluation
process (cf. Avgerou, 2000:570). Of late, several deficiencies in the field of evaluation methods have induced calls for in-depth
research. Academics have criticised the current state of the field as being immature and
fragmented (cf. Mahmood and Szewczak, 1999:491) and have thus demanded “an overview
of the whole panoply of evaluation methods, together with … the assumptions they depend on
...[in order to enable]... the identification of gaps.” (Farbey, Land and Targett, 1999: 205). [...]
Inhaltsverzeichnis (Table of Contents)
- 1. INTRODUCTION
- 2. THEMATIC BACKGROUND
- 2.1. Information Systems
- 2.2. Evaluation
- 2.3. Value
- 3. CRITICAL REVIEW OF EVALUATION APPROACHES
- 3.1. Antecedents to the Review
- 3.2. Effect-Assessing Approaches
- 3.3. Effect-Locating Approaches
- 3.4. Discussion of Usability of Approaches
- 4. EVALUATION IN PRACTICE
- 4.1. Review of Empirical Studies
- 4.2. Interpretation of Empirical Studies
- 4.3. Discussion and Future Research
- 5. CONCLUSIONS
Zielsetzung und Themenschwerpunkte (Objectives and Key Themes)
This work aims to provide a comprehensive review of ex-ante evaluation approaches for information systems, critically analyzing existing methods and highlighting their practical usability. The study seeks to understand the limitations and strengths of various evaluation frameworks in assessing the potential value and impact of information systems before implementation.
- Evaluation of Information Systems
- Ex-ante Evaluation Approaches
- Value Creation and Measurement
- Usability and Practical Application of Evaluation Frameworks
- Future Directions for Information Systems Evaluation
Zusammenfassung der Kapitel (Chapter Summaries)
Chapter 1 introduces the topic of ex-ante evaluation of information systems and outlines the scope and structure of the dissertation. Chapter 2 provides a thematic background, defining key concepts such as information systems, evaluation, and value. Chapter 3 critically reviews existing evaluation approaches, classifying them into effect-assessing and effect-locating frameworks. This chapter analyzes the strengths, weaknesses, and limitations of each approach, discussing their suitability for ex-ante evaluation. Chapter 4 examines evaluation in practice, reviewing empirical studies and interpreting their findings. This chapter explores the practical challenges of implementing evaluation methods and discusses future research directions. Chapter 5 summarizes the key findings and conclusions of the study, highlighting the implications for information systems evaluation.
Schlüsselwörter (Keywords)
The primary keywords and focus topics of this work are: information systems, ex-ante evaluation, value creation, evaluation approaches, effect-assessing methods, effect-locating methods, empirical studies, practical usability, future research directions.
- Quote paper
- Sascha Walter (Author), 2003, Approaches to the Ex-ante Evaluation of Information Systems: A Critical Review, Munich, GRIN Verlag, https://www.grin.com/document/15706
