During the early 2000s, it was argued that there was a need for ways to determine the quality of qualitative studies in medicine, and therefore, a need for developing appraisal criteria for qualitative research. Critically appraising journal articles allow one to filter out the low-quality studies and distinguish misleading information. In an attempt to apply this to the field of management, whilst reducing the possibility of flaws and classification errors, the CEBMa adapted appraisal questionnaires for specific study designs, one of which – ‘Appraisal of a Case Study’ – shall act the basis of this critical essay.
The article in review is featured in Elsevier's 'International Journal of Project Management' and was made available online on ScienceDirect.com on the 8th of January 2016. As declared in the journal’s ‘Author Information Pack’ document, papers by the editorial board are selected for publication based on their relevance, clarity, topicality, the extent to which they advance knowledge, and their contribution to inspiring further development and research. The information pack contains a strict and lengthy checklist of requirements and guidelines for researchers to adhere to, before submitting their research for publishing in the IJPM. Hence, a journal article undergoes a rigorous test prior to being released and therefore, at face value, one can expect this study to be trustworthy and of adequate quality.
Authors, M.A. Terlizzi, F. de Souza Meirelles, and H.R.O.C. de Moraes researched under the auspices of the São Paulo School of Business Administration, a Brazilian Higher Education institution. All three are Brazilian nationals and hold considerable experience in IT, IT Governance, Business Administration, Project Management, and Academia. The researchers did not comment on their own role and any professional bias they might have possibly caused. As emphasised by Coates (2011), it is important that researchers are aware of their own preconceptions and strive to ensure that they do not allow them to bias their interpretation of the data.
Table of Contents
1. Introduction
2. Background
3. Title, abstract and keywords
4. Research question(s) and study design
5. References, citations and search strategy
6. Methodology, sample selection and collection of data
7. Analysis and results
8. Ethics
9. Transferability to other settings
10. Concluding remarks
Objectives and Topics
This work provides a critical appraisal of a case study regarding the obstacles encountered when implementing IT Project Management Methodologies within a large financial institution. The paper evaluates the methodological rigor, the quality of data collection, and the validity of the conclusions drawn in the original study.
- Evidence-based management and appraisal criteria for qualitative research
- Evaluation of research design and the selection of case study approaches
- Analysis of literature search strategies and citation relevance
- Assessment of project management methodology usage in the Brazilian financial sector
- Methodological critique of sampling techniques and data collection processes
Excerpt from the Book
Methodology, sample selection and collection of data
Decisions need to be made continually throughout the research process (Willig, 2008); the research question, method of data collection and data analysis all depend on each other. Therefore it is of benefit to the reader to know about the determination of the research method.
Qualitative research looks at social phenomena, giving people the opportunity to understand what people do and why. Here, the researchers are trying to highlight the attitudes, experiences and emotions of participants concerning barriers to the use of project management methodology. The research does not use statistics, rather participant's responses and their subjective experiences around the topic.
Having managed to get access to organisational information, the researchers did their utmost to acquire quality data, for which collection methods were clearly described. In-depth interviews were conducted with the bank’s Project Management Office experts, as well as four senior managers; the latter was done with the aim of building on the second question in the survey. In order to maximise on the extraction of data from the organisation’s database, the authors had to understand project statuses to be able to apply strict selection criteria and review the best possible number of projects. Finally, the online software ‘Survey Monkey’ was used to send an electronic questionnaire. Via their exercise, the researchers gathered hard data (project details and success rates) as well as soft data (perceptions on the use of PMM from employees as well as additional feedback).
Summary of Chapters
Introduction: Explains the necessity of appraising qualitative research in management using adapted questionnaires for specific study designs.
Background: Reviews the publication context of the article in the International Journal of Project Management and details the qualifications of the researchers.
Title, abstract and keywords: Analyzes the clarity of the article's title and keywords regarding the specific geographic and industrial context of the study.
Research question(s) and study design: Discusses the exploratory nature of the research questions and validates the suitability of the case study design.
References, citations and search strategy: Examines the authors' citation practices and the relevance of the literature used to support their findings.
Methodology, sample selection and collection of data: Details the qualitative approach and the specific methods used to collect data from professionals within the banking organization.
Analysis and results: Critiques the credibility of the qualitative feedback and the stakeholder involvement in finalizing the study's conclusions.
Ethics: Addresses potential ethical concerns regarding participant privacy and the presumption of informed consent.
Transferability to other settings: Evaluates the study's potential application to global Financial Services Industries despite its focus on a single Brazilian company.
Concluding remarks: Summarizes the overall adherence to evidence-based practice and notes the limitations identified by the researchers.
Keywords
Project Management Methodology, PMM, IT Governance, Case Study, Banking Industry, Qualitative Research, Financial Services, Evidence-based Practice, Research Design, Data Collection, Methodology Appraisal, Project Success, Organizational Barriers, IT Professionals, Stakeholder Analysis.
Frequently Asked Questions
What is the core focus of this critical appraisal?
The work focuses on critically evaluating a specific case study that examines the barriers to implementing IT Project Management Methodologies (PMM) within a large financial institution.
What are the primary thematic areas covered?
Key themes include research methodology, evidence-based management, project success factors, and the specific challenges of implementing IT processes in the financial services sector.
What is the primary objective of this critique?
The main objective is to assess the trustworthiness, methodological rigor, and overall quality of the original article using established appraisal criteria.
Which scientific method is applied?
The original study utilizes a qualitative approach, employing an embedded case study design that includes in-depth interviews and electronic questionnaires.
What does the main body of the work analyze?
The main body examines the research design, citation strategy, sampling methods, data collection practices, and the generalizability of the findings.
Which keywords characterize the essence of this report?
Essential keywords include PMM, Case Study, IT Governance, Qualitative Research, and Project Management Methodology.
How does the author evaluate the research sampling reported in the original study?
The author identifies the sampling as purposive convenience sampling and discusses potential limitations regarding the generalizability of the results to the entire organization.
What observation is made about the ethical standards in the studied article?
The author notes that while specific ethical approvals are not mentioned, the nature of the collaborative research implies that informed consent was likely obtained.
Does the paper consider the findings to be universally applicable?
No, the report emphasizes that because the study is specific to one Brazilian financial institution, its findings may face limitations in transferability to other global settings.
- Arbeit zitieren
- Anonym (Autor:in), 2018, Barriers to the use of an IT PMM in a large financial institution, München, GRIN Verlag, https://www.grin.com/document/1446237
