This paper investigates the evaluation of the measurement properties of collage research. After a classification and an introduction about the qualitative and visual research, the collage technique is described. Different characteristics and aspects of a collage are shown.
Then, the classical measurement properties are explained in detail: Objectivity, reliability and validity. A conclusion is always pointed out of the results for the collage research. All in all, the classical measurement properties cannot be adapted simply to the collage technique. Finally, the most important issues are resumed and an outlook for further researches is taken.
The analysis is focused on expert literature like market research papers and different textbooks. The difficulty was to develop guidelines for the collage research based on the classical measurement properties. Besides, a discussion with a researcher enforced the results in a qualitative way. Finally the soundness of the findings is guaranteed due to the continuous review of the sources and the data.
Table of Contents
1 Development of brand representations and collage research
2 Collage research – Classification and definition
2.1 Qualitative research
2.2 Visual research
2.3 Characteristics of the collage technique
3 Measurement properties in general and evaluating measurement properties in collage research
3.1 Objectivity
3.2 Reliability
3.2.1 Forms of obtaining reliability
3.2.2 Conclusions for the collage research
3.3 Validity
3.3.2 Content validity
3.3.3 Construct validity
3.3.4 Criterion or instrumental validity
3.3.5 Theoretical validity
3.3.6 Consultative validity
3.3.7 Conclusions for the collage research
4 Subsumption and outlook
5 References
Research Objective and Topics
The primary objective of this work is to critically examine the applicability of classical scientific measurement properties—specifically objectivity, reliability, and validity—to the qualitative collage research technique. It investigates how these traditional benchmarks of quantitative research can be adapted or reinterpreted to evaluate the soundness and quality of collage-based methodologies in market research.
- Theoretical classification of collage research within qualitative and visual research methods.
- Detailed analysis of the criteria for objectivity, reliability, and validity in the context of visual stimuli.
- Methodological evaluation of the collage technique's potential and limitations in brand research.
- Discussion of consultative validity and methodological transparency as alternatives to traditional standardization.
Excerpt from the Book
3.3.2 Content validity
“Content validity is the extent to which the content of the test or procedure adequately represents all that is required for validity.” It explains in which way the variables of a measuring instrument belong to a semantic context of a construct and it shows how well the built items present all characteristics of this construct. Content validity also presumes that the instrumentals have to be logical and factual.
The items are supposed to present the interested concept exactly and completely and only the relevant factors should be considered. One type of content validity is apparent or face validity. Apparent validity can be achieved „[…] when a measuring instrument is so closely linked to the phenomena under observation that it is ‘obviously’ providing valid data.” In other words, if feelings and meanings are expressed, opinions, views and ideas are generated or simply expected information is found, then the methods are valid.
Instrumental or theoretical validity is sufficient but not necessary for apparent validity. Finally, researchers have to be careful with implications of apparent validity because they can be deceptive. A research or a test has face validity if it "looks like" it is going to measure what it is supposed to measure. By contrast it does not prove that it really works. Consequently it can be stated that face validity is often contrasted with content validity. For people who are not research methodology experts, face validity can be “valid enough”.
Summary of Chapters
1 Development of brand representations and collage research: This chapter highlights the growing importance of collage research in understanding brand representations, particularly when textual expression is insufficient.
2 Collage research – Classification and definition: This section classifies collage research as a form of visual and qualitative research and outlines its core characteristics.
3 Measurement properties in general and evaluating measurement properties in collage research: This comprehensive section discusses the challenges of applying traditional scientific criteria (objectivity, reliability, validity) to subjective, qualitative visual methods.
4 Subsumption and outlook: This final chapter synthesizes the findings, arguing for the necessity of adjusting validation criteria and emphasizing the researcher's role in constructing reality through transparent methodology.
5 References: This chapter lists the academic literature and expert sources consulted throughout the paper.
Keywords
Collage research, qualitative research, visual research, measurement properties, objectivity, reliability, validity, brand representation, brand knowledge, market research, methodological transparency, consultative validity, construct validity, consumer feelings, qualitative interpretation.
Frequently Asked Questions
What is the core focus of this publication?
The paper focuses on evaluating the quality and scientific rigor of the "collage research" technique by testing it against classical measurement properties derived from quantitative research.
Which research fields are covered in this work?
The work primarily addresses market research, branding, and qualitative research methodology with a specific emphasis on visual research techniques.
What is the primary goal of the author?
The goal is to determine if and how classical reliability and validity standards can be applied to collage research, or if they need to be redefined to suit the non-linear, visual nature of this method.
Which specific research method is at the center of the study?
The collage technique, defined as an aesthetic-technical method where participants express brand knowledge by composing and gluing visual materials, is the primary subject.
What does the main body of the work cover?
It covers the classification of qualitative and visual research, the three key measurement properties (objectivity, reliability, validity), and specific sub-types of validity like content, construct, and consultative validity.
Which terms characterize this research?
Key terms include qualitative methodology, visual stimuli, measurement properties, brand bricolage, and methodological transparency.
Why is standardizing collage research considered difficult?
Because collages are inherently subjective, interpretative, and based on individual emotions and metaphors, they cannot be standardized in the same way as quantitative metrics.
What is "Consultative Validity" in the context of this book?
It refers to the process of discussing research problems and findings with participants to minimize misunderstandings and concretize interpretations.
- Quote paper
- Daniel Lehmann (Author), 2006, Evaluating measurement properties of collage research, Munich, GRIN Verlag, https://www.grin.com/document/131168
