Department of Marketing and Statistics, MAPP, Aarhus School of Business, Aarhus University, Aarhus, Denmark;
Ulrich Hamm
Faculty of Organic Agricultural Sciences, Department of Agricultural and Food Marketing, Witzenhausen, Germany
Acknowledgement: The authors would like to thank the two anonymous reviewers as well as the editors for their help and valuable comments.
Consumer research has a wide range of
methods at its disposal. In view of the fast pace of change in the conditions under
which consumption takes place, these consumer research methods must be continuously
reevaluated. The process-tracing technique called
information-display-matrix (IDM) has been applied predominantly
to investigate information acquisition behavior as part of research into the basic
premises of the discipline in the 1970s and 1980s. However, the number of studies on
this method, and the number using it, has remained small albeit steady since this
period. In the recent past, the IDM has been utilized in a series of studies
published after 2000 (e.g.,
There are good reasons to believe that
IDM has the potential to increase in standing because the research environment has
changed. While the method is becoming more alike to consumer choice situations, the
consumer choice surrounding becomes more alike to the method as well. On the one
hand, the technological developments have made an improved and more realistic
research design form possible which allows a better simulation of the everyday
consumer choice context, with further progress to come (
The aim of the paper at hand is to familiarize the reader with the method, the course of its development, as well as its advantages and disadvantages in comparison to other methods of process-tracing. In particular, it aims to show where the current disadvantages of the method might be alleviated, and where approaches for the future development of the method might be found against a background of technological progress and changing consumer behavior. In order to demonstrate the possibilities offered by IDM for analysis, this paper will close with results from a study about information acquisition behavior of different groups of fair-trade coffee consumers. The data for this study were obtained by using a newly developed, computer-based IDM-application. The major contribution of the paper is that it gives a uniquely comprehensive description of the method – up to this point frequently mentioned, but insufficiently explained in most textbooks and articles – and that it summarizes the starting points for its further development and use in a changing research environment.
A helpful way to explain the central
principle behind IDM is to refer to the tables and matrices used in magazines
produced by consumer organizations. Just as with this type of publication, each
column is headed by a product (also called product alternative,
stimulus, or option in IDM terminology),
either named or imaged, and each row is led by a characteristic of the product (also
known as attribute, property, or
dimension in IDM). An example of an IDM is shown in
This description makes clear that the
method in question is an observational method which aims to document information
acquisition behavior. It can thus be classified as a process-tracing method. The
most important process-tracing methods in consumer research, beside IDM itself,
include: direct observation, eye-tracking, and verbal or think-aloud protocols
(
The opposite of process-tracing
techniques is, in terms of method, structural modeling. Using this method, the
process itself is not observed: Instead, variations in the starting point for the
experiment are compared to final decision outcomes; from this, hypotheses about
information acquisition are then elaborated (
Payne and Jacoby were the first to use
information-display-matrices in their work in the USA at the end of the 1970s and
beginning of the 1980s (
In the early 1980s, researchers
started to use computers to display the information and then record information
acquisition behavior in process-tracing exercises. Operationally, researchers made
use of a variety of solutions for a computer-based IDM: A major difference in these
solutions was between matrices shown on the screen (classic IDM)
and applications offering pull-down menus for subjects to choose the information
(menu-based IDM), as described by
Researchers applying the IDM made use
of several variations of the method in order to adapt the research design to the
questions in the study at hand. In the early studies, the size of the matrix was
varied by changing the number of product alternatives and characteristics listed
(
Criticism of IDM is primarily directed
at questioning the external validity of the method. A central criticism in this
regard is that the presentation of separate pieces of information, out of context
and only available in a chronological order, does not correspond to consumer
reality, where much information is absorbed simultaneously. Often, too much
information is offered (
Criticism goes further in stating that
some aspects crucial to information processing cannot be measured by IDM: The method
cannot give a sure answer to the question of whether the information accessed is
actually cognitively processed or not (
Some of these criticisms, especially
those directed at external validity, are true of other process-tracing methods such
as eye-tracking and think-aloud protocols as well. Direct observation is the least
likely of process-tracing methods to exert an influence on the behavior that is
being examined; its one major disadvantage, however, and the reason for its limited
use is the comparatively meagre yield of information for the purpose of the research
(
In comparing the main advantages and disadvantages of the three process-tracing methods, it must be noted that the methods concentrate on different points of the information acquisition process: While eye-tracking traces the accession of all information – including information viewed in a focused, although not necessarily attentive manner – IDM only documents information that has been purposefully accessed. Think-aloud protocols, in turn, can only deal with information which has been internalized by the subjects and can thus be verbalized.
As opposed to IDM, eye-tracking is
able to offer subjects a very realistic, holistic depiction of the information in
question (e.g., on a single poster or actual packaging), as well as to present a
situation in which information acquisition is done visually and with little extra
effort. The disadvantages of this method are the high costs, the cumbersome
technology involved (
Think-aloud protocols are, in
comparison both to eye-tracking and IDM, far less complicated and expensive,
requiring nothing more than an audio recording device. This also makes the research
more mobile and flexible, that is, the information can be depicted in a real-life
situation, such as at the actual point of sale. Further, only this method allows
researchers to track the use of the information after it has been acquired and
includes analysis of the use of internal information. A disadvantage of this method
is that the evaluation is time-consuming and difficult (
Due to enhanced technological
possibilities, increased use of information technology, and changes in consumption
patterns in the last decade, the information search in the IDM has moved closer to
the actual information acquisition and purchasing situations it seeks to simulate;
this is especially true in terms of Internet shopping. The central criticism of IDM
– that is, concerns about its external validity – is thus
becoming increasingly weak. Furthermore, improvements can also be achieved through
combining IDM research with other methods. Possibilities for further development are
described in the following:
Usually, the indicators used in
IDM-analysis are divided into measures of depth,
content, and sequence (see
The content measures are used to
quantify the relative weight given to the various types of information on offer, as
expressed by the differences in information acquisition behavior registered between
different types of information. They are useful in answering the question of how
important different pieces of information are in deciding in favor of certain
products, and allow researchers to pinpoint crucial key information. The underlying
assumption is that information which is accessed earlier and more frequently has a
comparatively higher importance (
Analyzing measures of sequence means
examining the structure of the information acquisition process involved. Such
analyses can show, for example, to what extent decisions are taken by comparing
product alternatives (also called by-brand) and to what extent
decisions are taken by comparing attributes of the products themselves (i.e.,
by-attribute); they can also show how frequently and indeed at
which points in the experiment the subjects switched from one strategy to the other.
Knowing the type of information strategy applied enables the researcher to infer
which decision heuristic is used by the consumer when buying the product in question
(
The latter two measures shown in
The IDM-application described in this paper is based on the Microsoft Access database program. It allows between one and ten product alternatives or product attributes to be listed. If participants have been questioned beforehand, it is possible to display only those attributes desired by the subjects. The content of the field opened appears each time as an enlarged pop-up. The pop-up solution represents an improvement in comparison to previous computer-based IDM-applications in that it offers more space for longer field contents and increases legibility. The information fields, as well as the line- and column-headings, can be filled with either text or graphics; if the researcher wishes to allow that, up to five fields can be opened at a time. These then appear in reduced size and in the order of the accession in a memory-column at the edge of the matrix. The time for the field-opening phase, as well as the total number that can be opened, can be limited. Further to this, participants can be given the opportunity of ruling out product alternatives or attributes by eliminating them from further information searching (the column or line that has been eliminated is kept in the matrix, but looks faded). Position of product alternatives or attributes in the matrix is randomized. The subjects can take a test-run before the actual experiment begins in order to familiarize themselves with the system. Help-texts are included to help the participants navigate their way through the system, and users are asked to confirm their decision, allowing unintentional decisions to be undone. The optical presentation of the matrix is orientated toward the structure of reports produced by consumer organizations, as well as that of online shops. After the IDM experiment has run its course, a sheet can be automatically called up which contains a questionnaire. This questionnaire can be filled in by the participants themselves (although this was not done in the study for the purpose of comparing methods: Questions were asked by the interviewer during a face-to-face-interview). For the analysis, simplified evaluation is enabled through preprogramming of crucial measures, which can be selected by the researcher from a list. The results of this stage of the experiment are automatically exported to the Excel program.
The data set in this study comes
from 150 consumers buying fair-trade coffee who participated in the laptop-based
survey at the point of sale. Of the 150 consumers, 90 people were asked outside
supermarkets (or food retail stores, FRS), and 60 outside one-world-shops (OWS).
The IDM contained six products (labeled A–F); information about these
products was divided into six attributes, which were: product price, production
system (conventional/organic), environmental standards in the coffee
production, price premium as benefit to the coffee producers (the fair component
of price), origin of the product (with regard to geographical region or kind of
producer organization), and child protection (regarding child-labor
prevention/children’s rights) in the coffee production
stage. The overall aim of the study was to analyze both the importance of the
various attributes, as well as the preferences within the scope of the
attributes themselves. Furthermore, the study aimed to compare the information
acquisition behavior of the two samples (FRS and OWS). Based on the assumption
that consumers in the specialized shops (OWS) are different with regard to
several variables, for example, that they are characterized by a higher
involvement toward the issue of fair-trade, several hypotheses were developed.
It was hypothesized that OWS-consumers show a more extensive information search
behavior, tend to conduct a more compensatory search strategy, and give less
importance to price but more importance to the issue-related information, as
measured by the indicators of content. Independent from the type of customers,
it was further hypothesized that information acquisition behavior differs in
depth, content, and sequence between participants of different gender, age, and
education, assuming that men search less intensively than women (see
Some of the results are shown in
Another way of approaching the
data is not to look at groups which have been previously defined, but rather to
compare groups which differentiate themselves during the study relating to their
information acquisition behavior. In the example at hand, for each indicator
listed in
The IDM results can be linked to
the final choice as well as to the results of the face-to-face-interview. The
assumption behind recording the percentage at which a certain attribute is
called up first is that the earlier information is accessed, the more important
it is in the decision-making process. The respective results described in
In the study, 80% of
the participants chose an organic fair-trade coffee, although only
50% of the six stimuli were organic. Logistic regression analysis was
applied with the aim of testing the usefulness of the IDM-measures for
predicting choice decision outcome. The results are given in
In order to allow for a
method-comparison of IDM with the face-to-face-interview that followed, the
subjects were asked in the latter to place the six product attributes in order
of importance. This ranking can also be calculated using the measures of content
in the IDM-method (see
Summing up the results of the study, it was possible to confirm that customers from OWS differ in their information search behavior from fair-trade customers purchasing their products in supermarkets. Thus, the potential to detect differences in the depth, content, and sequence with the help of the IDM could be demonstrated. While the study indicated that the possible connection between age and familiarity with the computer technology should be kept in mind for interpretation, it could also be evidenced that the IDM appears to have the advantage of being less distorted by social desirability. However, the aim of the study was not to put all the ideas described in chapter five of a further development of the method into practice. The most important role of the study is basically being an example which shows what can be done and analyzed with the tool of the IDM in order to better understand the method, while the list of ideas for further development in the previous chapter has the role of being a “tool-box” for future applications of the method.
The criticism of IDM has been mainly directed at its lack of external validity due to the way information is presented. Yet it is argued that several measures resulting from technological progress in computer hard- and software and increased information technology uptake in the population at large, as well as a changing purchase environment can be taken to alleviate this deficiency, or indeed to turn it to advantage. From the possibilities for further development of the IDM-method discussed in this contribution, some but not all could be put into practice in the study described as an example, highlighting the potential of the method. The major contribution of the IDM-application used in the study is its easy handling and improved layout, mirroring that of Internet shops. Future studies of this kind should further explore the influence of the liberation from predefined structures, as in an “individualised” IDM, and the use of a whole but blurred picture on consumers’ information acquisition behavior. Furthermore, it is argued that the IDM is an obvious choice as part of a method combination of different, yet complementary process-tracing techniques with the aim of building up a comprehensive picture of information acquisition behavior. The IDM can also deliver data that can be used for evaluation along with structural models and experimental choice-tests.
For this reason, information display matrices are suitable instruments for use in consumer research and have the potential to be expanded in the future. There is a need for more research into validating the measures put forward in terms of realistic IDM setups. Furthermore, methodological comparisons of process-tracing techniques should follow further developments in the field. The main applications of IDM in practical consumer research would appear to lie in identifying the key information for consumers, in checking the contents of product- or service-descriptions for relevance to consumers, as well as in optimizing the design of communication content and images.
Alfnes, F., Guttormsen, A. G., Steine, G., & Kolstad, K. (2006). Consumers’ willingness to pay for the color of salmon: A choice experiment with real economic incentives. American Journal of Agricultural Economics, 88, 1050–1061.
Anderson, P. (2001). P1198. Software for tracing decision behavior in lending to small businesses. Behavior Research Methods, Instruments, & Computers, 33, 234–242.
Andersson, P. (2004). Does experience matter in lending? A process-tracing study on experienced loan officers and novices decision behaviour. Journal of Economic Psychology, 25, 471–492.
Bauer, H. H., Grether, M., & Sattler, C. (2002). Internetspiele als Marketinginstrument für Low-Involvement Produkte. [Online games as a marketing instrument for low-involvement products]. Marketing ZFP, 24, 265–276.
Bettman, J. R., & Kakkar, P. (1977). Effects of information presentation format on consumer information acquisition strategies. Journal of Consumer Research, 3, 233–241.
Biggs, S. F., Rosman, A. J., & Sergenian, G. K. (1993). Methodological issues in judgement and decision-making research: Concurrent verbal protocol validity and simultaneous traces of process. Journal of Behavioral Decision Making, 6, 187–206.
Brucks, M. (1988). Search monitor: An approach for computer-controlled experiments involving consumer information search. Journal of Consumer Research, 15, 117–121.
Büttner, O. B., Rauch, M., & Silberer, G. (2005). Consumer cognition at the point of sale: Results from a process tracing study. Contribution to Tracking Research. No. 11, Institute of Marketing and Retailing, Göttingen, Germany: University of Göttingen.
Covey, J., & Lovie, A. (1998). Information selection and utilization in hypothesis testing: A comparison of process-tracing and structural analysis techniques. Organizational Behavior and Human Decision Processes, 75, 56–74.
Felser, G. (2007). Werbe- und Konsumentenpsychologie. [Consumer psychology and advertising]. Heidelberg, Germany: Springer.
Ford, K. J., Schmitt, N., Schechtman, S. L., Hults, B. M., & Doherty, M. L. (1989). Process tracing methods: contributions, problems, and neglected research questions. Organizational Behavior and Human Decision Processes, 43, 75–117.
Harte, J. M., & Koele, P. (1995). A comparison of different methods for the elicitation of attribute weights: Structural modeling, process tracing, and self-reports. Organizational Behavior and Human Decision Processes, 64, 49–64.
Huneke, M. E., Cole, C., & Levin, I. P. (2004). How varying levels of knowledge and motivation affect search and confidence during consideration and choice. Marketing Letters, 15, 67–79.
Hwang, M. I., & Lin, J. W. (1999). Information dimension, information overload and decision quality. Journal of Information Science, 25, 213–218.
Ibanez, M., Czermak, S., & Sutter, M. (2008). Searching for a better deal – on the influence of group decision making, time pressure and gender on search behaviour. Journal of Economic Psychology, 30, 1–10.
Jacoby, J., Chestnut, R. W., & Fisher, W. A. (1978). A behavioral process approach to information acquisition in nondurable purchasing. Journal of Marketing Research, 15, 532–544.
Jacoby, J., Jaccard, J. J., Currim, I., Kuß, A., Ansari, A., & Troutman, T. (1994). Tracing the impact of item-by-item information accessing on uncertainty reduction. Journal of Consumer Research, 21, 291–303.
Jacoby, J., Jaccard, J., Kuß, A., Troutman, T., & Mazursky, D. (1987). New Directions in behaviorial process research: Implications for social psychology. Journal of Experimental Social Psychology, 23, 146–175.
Jasper, J., & Shapiro, J. ( 2002). Mouse Trace: A better mousetrap for catching decision processes. Behavior Research Methods, Instruments, & Computers, 34, 364–374.
Johnson, E. J. (1996). The last whole MouseLab manual.
Retrieved October 30, 2007, from
Johnson,
E., &
Willemsen, M. C. (2004).
MouselabWEB. Retrieved October 30, 2007,
from
Kleinmuntz, D. N., & Schkade, D. A. (1993). Information displays and decision processes. Psychological Science, 4, 221–227.
Kroeber-Riel, W., & Weinberg, P. (2003). Konsumentenverhalten [Consumer behavior]. Munich, Germany: Vahlen.
Lehmann, D. R., & Moore, W. L. (1980). Validity of information display boards: An assessment using longitudinal data. Journal of Marketing Research, 14, 450–459.
Louviere, J. J., Hensher, D. A., & Swait, J. D. (2000). Stated choice methods. Analysis and application. Cambridge, United Kingdom: Cambridge University Press.
Lusk, J. L., & Schroeder, T. C. (2004). Are choice experiments incentive compatible? A test with quality differentiated beef steaks. American Journal of Agricultural Economics, 86, 467–482.
Marten, U. (1992). Die Bedeutung von Information-Display-Matrices-Verfahren für die Konsumentenforschung[Significance of information display matrix for consumer research]. Dissertation, Bremen, Germany: University of Bremen.
Meyer, J.-A. (1994). Multimedia in der Werbe- und Konsumentenforschung[Multimedia in advertising and consumer research]. In Forschungsgruppe Konsum und Verhalten (Eds.), Konsumentenforschung (pp. 305–320). Munich, Germany: Gabler.
Mittal, B. (1989). Must consumer involvement always imply more information search?. Advances in Consumer Research, 16, 167–172.
Mühlbacher, S., & Kirchler, E. (2003). Informations-Display-Matrix: Einsatz und Analysemöglichkeiten[Information display matrix: Application and possibilities for analysis]. Der Markt: Zeitschrift für Absatzwirtschaft und Marketing, 42, 147–152.
Newell, B. R., Weston, N. J., & Shanks, D. R. (2003). Empirical tests of a fast-and-frugal heuristic: Not everyone “takes the best”. Organizational Behavior and Human Decision Processes, 91, 82–96.
Payne, J. W. (1976). Task complexity and contingent processing in decision making: An information search and protocol analysis. Organizational Behavior and Human Performance, 16, 366–387.
Peterson, R. A., & Merino, M. C. (2003). Consumer information search behavior and the Internet. Psychology & Marketing, 20, 99–121.
Ratchford, B. T., Taludkar, D., & Lee, M.-S. (2007). The impact of the Internet on consumers’ use of information sources for automobiles: A re-inquiry. Journal of Consumer Research, 34, 111–119.
Roßmanith, T. (2001). Informationsverhalten und Involvement im Internet. Eine Labor- und Feldstudie zu den Determinanten der Informationsnachfrage im World Wide Web[Information acquisition behavior and involvement online. A laboratory and field experiment about the determinants of information search in the World Wide Web]. Dissertation, Karlsruhe, Germany: University of Karlsruhe.
Scholderer, J., Hagemann, K., Sorensen, T. B., & Czienskowski, U. (2007). Consumer use of information about novel foods and food technologies, NOFORISK Deliverable 34, Project Paper No. 01/07. Berlin, Germany: MAPP, Aarhus, Denmark; Max Planck Institute for Human Development.
Schopphoven, I. (1996). Messung von Entscheidungsqualität. Konzeptualisierung, Operationalisierung und Validierung eines Meßinstrumentariums für Entscheidungsqualität[Measuring of decision making quality. Conceptualisation, operationalisation, and validation of a measurement]. Frankfurt am Main, Germany: Peter Lang.
Silberer, G. (2005). Die videogestützte Rekonstruktion kognitiver Prozesse beim Ladenbesuch[The video-based reconstruction of cognitive processes at the point of sale]. Marketing ZFP, 27, 263–280.
Trommsdorf, V. (2004). Konsumentenverhalten[Consumer behavior]. Stuttgart, Germany: Kohlhammer.
Tutz, G. (2000). Die Analyse kategorialer Daten. Anwendungsorientierte Einführung in Logit-Modellierung und kategoriale Regression[Analysis of categorical data. Application-oriented introduction to logit modeling and categorical regression]. Munich, Germany: Oldenbourg.
Verplanken, B., & Weenig, M. (1993). Graphic energy labels and consumers decisions about home appliances: A process tracing approach. Journal of Economic Psychology, 14, 739–752.
Weenig, M., & Maarleveld, M. (2002). The impact of time constraint on information search strategies in complex choice tasks. Journal of Economic Psychology, 23, 689–702.
Williamson, J., Ranyard, R., & Cuthbert, L. (2000). A conversation-based process tracing method for use with naturalistic decisions. An evaluation study. British Journal of Psychology, 91, 203–222.
Zielke, S. (2001). Kundegerechte Sortimentsgliederung am Point of Sale. Ansätze zur Erhebung kognitiver Strukturen als Richtgrößen für Warenplatzierungen und Category Management[Consumer oriented assortment policy at the point of sale. Approaches for measuring cognitive structures as a guideline for placement and category management]. Marketing ZFP, 23, 100–116.