VIEWPO1,NTS AND CONTROVERSIES IN SENSORY SCIENCE AND CONSUMER PRODUCT TESTING
F
N
PUBLICATIONS IN FOOD SCIENCE AND NUTRITION P
Books VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE, H.R. Moskowitz er al. PIONEERS IN FOOD SCIENCE, VOL. 2, J.J. Powers DRY-CURED MEAT PRODUCTS, F. ToldriI VEROCYTOTOXIGENIC E. coli, G. Duffy, P. Garvey and D.A. McDowell OPEN DATING OF FOODS, T.P. Labuza and L.M. Szybist NITRITE CURING OF MEAT: N-NITROSAMINE PROBLEM, R.B. Pegg and F. Shahidi DICTIONARY OF FLAVORS, D.A. DeRovira FOOD SAFETY: THE IMPLICATIONS OF CHANGE, J.J. Sheridan et al. FOOD FOR HEALTH IN THE PACIFIC RIM, J.R. Whitaker et al. DAIRY FOODS SAFETY: 1995-1996, A COMPENDIUM, E.H. Marth OLIVE OIL, SECOND EDITION, A.K. Kiritsakis MULTIVARIATE DATA ANALYSIS, G.B. Dijksterhuis NUTRACEUTICALS: DESIGNER FOODS 111. P.A. Lachance DESCRIPTIVE SENSORY ANALYSIS IN PRACTICE, M.C. Gacula, Jr. APPETITE FOR LIFE: AN AUTOBIOGRAPHY, S.A. Goldblith HACCP: MICROBIOLOGICAL SAFETY OF MEAT, J.J. Sheridan et al. OF MICROBES AND MOLECULES: FOOD TECHNOLOGY AT M.I.T., S.A. Goldblith MEAT PRESERVATION. R.G. Cassens PIONEERS IN FOOD SCIENCE, VOL. 1. S.A. Goldblith FOOD CONCEPTS AND PRODUCTS: JUST-IN-TIME DEVELOPMENT, H.R. Moskowitz MICROWAVE FOODS: NEW PRODUCT DEVELOPMENT, R.V. Decareau DESIGN AND ANALYSIS OF SENSORY OPTIMIZATION, M.C. Gacula, Jr. NUTRIENT ADDITIONS TO FOOD, J.C. Bauernfeind and P.A. Lachance NITRITE-CURED MEAT, R.G. Cassens CONTROLLEDlMODIFIED ATMOSPHERENACUUM PACKAGING, A.L. Brody NUTRITIONAL STATUS ASSESSMENT OF THE INDIVIDUAL, G.E. Livingston QUALITY ASSURANCE OF FOODS, J.E. Stauffer SCIENCE OF MEAT & MEAT PRODUCTS, 3RD ED., J.F. Price and B.S. Schweigen NEW DIRECTIONS FOR PRODUCT TESTING OF FOODS, H.R. Moskowitz PRODUCT DEVELOPMENT & DIETARY GUIDELINES, G.E. Livingston, et al. SHELF-LIFE DATING OF FOODS, T.P. Labuza Journals JOURNAL OF FOOD LIPIDS, F. Shahidi JOURNAL OF RAPID METHODS AND AUTOMATION IN MICROBIOLOGY, D.Y.C. Fung, M.C. Goldschmidt and D.H. Kang JOURNAL OF MUSCLE FOODS, M.S. Brewer JOURNAL OF SENSORY STUDIES, M.C. Gacula, Jr. FOODSERVICE RESEARCH INTERNATIONAL, P.L. Bordi JOURNAL OF FOOD BIOCHEMISTRY, N.F. Haard and B.K. Simpson JOURNAL OF FOOD PROCESS ENGINEERING, D.R. Heldman and R.P. Singh JOURNAL OF FOOD PROCESSING AND PRESERVATION, B.G. Swanson JOURNAL OF FOOD QUALITY, J.J. Powers JOURNAL OF FOOD SAFETY, T.J. Montville and K.R. Matthews JOURNAL OF TEXTURE STUDIES, M.C. Bourne, T. van Vliet and V.N.M. Rao
Newsletter FOOD, NUTRACEUTICALS AND NUTRITION, P.A. Lachance and M.C. Fisher
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE AND CONSUMER PRODUCT TESTING Howard R. Moskowitz, Ph.D. Moskowitz Jacobs Inc. White Plains, New York
Alejandra M. Mufioz, M.S. IRIS: International Resources for Insights and Solutions, LLC Mountainside, New Jersey
Maximo C. Gacula, Jr., Ph.D. Department of Psychology Arizona State University Tempe, Arizona
FOOD & NUTRITION PRESS, INC. TRUMBULL, CONNECTICUT 06611 USA
Copyright
@
2003 by
FOOD & NUTRITION PRESS, INC. 4527 Main Street Trumbull, Connecticut 04411 USA
All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means: electronic, electrostatic, magnetic tape, mechanical, photocopying, recording or otherwise, without permission in writing from the publisher.
Library of Congress Control Number: 2003109437
ISBN: 0-917678-57-5
Printed in the United States of America
DEDICATIONS To my mother, Leah Moskowitz. You have encouraged me over the years to develop my ideas, to write them down, and to share with others through publishing. To your constant support and guidance, I owe so much. Thank you. HOWARD R. MOSKOWITZ
To my son Ryan. Your being, smiles and love are my encouragement, inspiration and drive as a mother and a professional. My experiences and accomplishments are enriched by your presence and love. ALEJANDRA M. MUROZ
To my parents, Maxim0 Sr. and Elena Calo. Thank you so much for planting in me the value of education, courage, respect, and love while growing up, which became the foundation of my daily life. MAXIM0 C. GACULA, JR.
PREFACE We, the authors, thank you for spending some time with us by reading this book. You may have noticed from the title that the book is not a simple presentation of a field with a unified focus. Rather, we deal with controversies. Our field of sensory science has grown mightily in the past decades. To a great extent the growth has come from the resolution of different points of view regarding what is appropriate in sensory science, what are reasonable truths, and what are good practices hallowed by the experience of practitioners. In no case do we present points of view as ultimate truths. As the construction of the book reveals, we rather present different approaches to the same problem, and even different ways to look at the same type of data. In our discussions amongst ourselves and in our evidencing disagreements with each other, we sincerely hope that we provoke you to think more deeply about the issues involved in product assessment, the design of studies, and the analyses of data. If we cause you to think more critically about the problems and even take issue with our points of view (joint and several), we will have succeeded in our task. HOWARD R. MOSKOWITZ ALEJANDRA M. MUROZ MAXIM0 C. GACULA, JR.
ACKNOWLEDGMENTS It is an honor having the following individuals participating in this endeavor. ANDRE ARBOGAST
Biosystkmes 9, rue des Mardors F-21560 Couternon France Email:
[email protected]
DANIEL ENNIS, Ph.D.
The Institute for Perception 7629 Hull Street Road, Suite 200 Richmond, VA 23235 USA Email: ennis@i€press.com
CHRIS FINDLAY, Ph. D.
Compusense Inc. 111 Farquhar Street Guelph, Ontario Canada NlH 3N4 Email:
[email protected]
PAUL LICHTMAN
Sensory Computer Systems 16 South Street Morristown, NJ 07960 USA Email:
[email protected]
CONTENTS CHAPTER
PAGE
1 . The Role of Sensory Science in the Coming Decade . . . . . . . . . . . 1 2 . International Sensory Science . . . . . . . . . . . . . . . . . . . . . . . . 31 3 . Sensory Mythology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 4 . Contrasting R&D. Sensory Science. and Marketing Research Approaches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 5 . Validity and Reliability in Sensory Science . . . . . . . . . . . . . . . 97 6. The Interface Between Psychophysics and Sensory Science: Methods Versus Real Knowledge . . . . . . . . . . . . . . . . . . . 103 7 . Descriptive Panels/Experts Versus Consumers . . . . . . . . . . . . 109 8 . Sample Issues in Consumer Testing . . . . . . . . . . . . . . . . . . . 125 9 . Hedonics. Just-About-Right. Purchase and Other Scales in Consumer Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145 10. Asking Consumers to Rate Product Attributes . . . . . . . . . . . . . 173 11. Questionnaire Design . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 12. Choice of Population in Consumer Studies . . . . . . . . . . . . . . . 209 13 . Biases Due to Changing Market Conditions . . . . . . . . . . . . . . 231 14. Sample Size N. or Number of Respondents . . . . . . . . . . . . . . 241 15 . The Use and Caveats of Qualitative Research in the DecisionMaking Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255 16. The Four D’s of Sensory Science: Difference. Discrimination. Dissimilarity. Distance . . . . . . . . . . . . . . . . . . . . . . . . . 267 17 . Replication in Sensory and Consumer Testing . . . . . . . . . . . . . 299 18 . Language Development in Descriptive Analysis and the Formation of Sensory Concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . 313 19. Use of References in Descriptive Analysis . . . . . . . . . . . . . . . 337 20 . Training Time in Descriptive Analysis . . . . . . . . . . . . . . . . . 351 21 . Consumer-Descriptive Data Relationships in Sensory Science . . . 359 22. Product and Panelist Variability in Sensory Testing . . . . . . . . . 375 23 . Foundations of Sensory Science by Daniel M . Ennis . . . . . . . . 391 24 . Applications of SAS@Programming Language in Sensory Science by Maximo C . Gacula. Jr . . . . . . . . . . . . . . . . . . . . . . . . 433 25 . Advances and the Future of Data Collection Systems in Sensory Science by Andrd Arbogast. Chris Findlay and Paul Lichtman . 459 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 471
CHAPTER 1 THE ROLE OF SENSORY SCIENCE INTHECOMINGDECADE HOWARD R. MOSKOWITZ Sensory Science is enjoying a period of strong growth, both at the intellectual and at the practical levels. At the intellectual level the influx of statisticians, psychologists, in addition to the usual complement of food scientists, continues to increase the knowledge base and skill set. At the practical level Sensory Science has graduated to first class membership from its former role of a second-class citizen in both academia and corporations. Product developers and product marketers seek out sensory scientists for advice in designing studies, for assistance in collecting data from experts and consumers, and for guidance in interpreting results. Yet, for many years Sensory Science lacked solid intellectual foundations in many of its aspects, perhaps because Sensory Science grew organically, in an undisciplined fashion. The growth was dictated by the early use of Sensory Science as a practical, albeit “kitchen tool, and only later by the concerted efforts of researchers in science and business that would then establish the field on a more rigorous foundation. The beginnings of Sensory Science involved practitioners, and only later would involve scientists. This history flies counter to the usual order of events, whereby a field begins with science and evolves to practice. As a consequence, sensory scientists are only beginning to have available to them a coherent corpus of knowledge, embodied in textbooks and refereed journals, respectively. The first major text in the field (Principles of Sensory Evaluation of Food, Amerine et al. 1965) comprised short abstracts and mini-discussions of much of the work known to the researcher 35 years ago. The book reflects the bias and approach of Rose Marie Pangborn, one of the first in the field, and certainly the most prominent for the three decades during which she published and flourished. However, the literature in this seminal book was abstracted from contributions in many diverse fields, since Sensory Science itself had not been established. The current state of affairs is far different. Beginning in the early 1980s, authors in the field have contributed numerous volumes, both authored and edited. These volumes provide the reader with overviews as to how the senses work, how to describe product, how to measure sensory and hedonic responses, and how to combine sensory data with analytic data. Journals in the field include Journal of Sensory Studies (published by Food & Nutrition Press, Inc.), and Food Quality and Preference (published by Elsevier Ltd.), respectively. These journals were introduced in the late 1980s and middle 1990s, and reflect the demand for a 1
2
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
scientific corpus of knowledge beyond books and published proceedings of symposia. With the growth of any field there emerge currents and counter-currents that inevitably affect the way the field mamres, and the form that it takes. Sensory Science is no exception. We see today a variety of different trends that we believe will interact to shape the field. Some of them and their likely effects follow. These observations, written in the early years of the decade (2000-2010) may represent just a local perturbation, or may in fact represent a simple extension of trends that began two and three decades ago. One can only understand the full ramifications of a trend looking backward, and not peering forward. Trend 1 - More Education, More Universities as Centers of Excellence, Better Education Sensory scientists are becoming more educated in basic science and in the applications of sensory methods. The education obtained by the sensory scientist may be formal (from universities, with defined curricula) as well as practical (from research projects, undertaken in companies or at universities). More education means that the sensory scientist in the future will have a better understanding of where the field has been, what types of problems previous researchers and practitioners have faced, what is held to be true, and what methods have been accepted as standard. Some management consultants would call this an expansion of the "skill" set of the sensory researcher. Armed with this knowledge the sensory researcher may expect to gamer more respect in the scientific and business fields because Sensory Science itself will be recognized as a formal discipline. One can contrast this happy state of affairs with the situation faced by Pangborn and her professional colleagues some 30 to 40 years ago, when sensory researchers were few and far between, and there were no available courses or texts on Sensory Science. The education of a sensory scientist 40 years ago was crafted after discovering and then reading a literature widely dispersed in different content journals. It is also worth noting that there are many more universities offering education in Sensory Science, so that no one single viewpoint or world-view dominates. Twenty years ago it was the University of California at Davis, under Pangborn's inspired guidance. The Davis way represented, at that time, the way. the ne plus ultra, the revealed doctrine. Today there are a dozen universities or more offering a full series of courses on Sensory Science. Internationally, many more universities are recognizing the need for Sensory Science, and whereas before they had shrugged off this American phenomenon, now they embrace it and offer specialized majors. One need only attend conferences to recognize the
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
3
growth of the universities, and the internationalization of the academic field to recognize this development.
Trend 2 - Advanced Statistics Widely Available Today’s sensory scientists have access to numerous statistical packages available on personal computers. Some of these are powerful versions of traditional computational tools, such as analysis of variance, factor analysis, discriminant function analysis, and the like. Other statistical tools incorporate developments in mapping, where the objective is to locate the stimulus product or the panelist or the attribute (or even all three) in a geometrical space with the property that points “close together” in the space are similar along one or more characteristics. These tools go under the name of multidimensional scaling. A third set of tools involves the relation of two or more sets of variables. These methods include partial least-squares (PLS), and reverse engineering. A fourth set of tools involves modeling and optimization, with the objective to identify processing or ingredient conditions leading to a high level of customer satisfaction, while simultaneously maintaining the independent variables and specified dependent variables within the range tested. Properly used, these advanced statistics enable the sensory researcher to better understand relations among stimuli or relations among variables. They lead to new insights that make the results more valuable. For example, maps or models provide significant value both to the scientist looking to understand how nature works, and to the developer, looking to create new products that fulfill the consumer requirements.
Trend 3 - Increased Contact among Researchers Through Books, Journals and Specialized Conferences If we look back forty years ago, to 1960 or thereabouts, we find virtually no consistent recognition of Sensory Science as an emerging specialty. The articles on Sensory Science were scattered across different journals, often as “reviews” of “how to do things,” rather than as structured reports. There were no journals in the field devoted to Sensory Science per se. There might be featured articles from time to time about the importance of understanding the senses for a particular product category. However, there was no single source to which an interested person could turn to learn what was really known about the senses with regard to product development and consumer perception of products. Furthermore, there were no conferences dealing specifically with the sensory aspects of products. Conferences would feature one or another speaker talking about Sensory Science, but often such a speaker was relegated to a minor position on the program. Changes came in the 1960s. As noted above, the Amerine, Pangborn and Roessler book, which was the first to appear with extensive scientific literature
4
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
and approaches, was published in the middle of the decade. Indeed, it was only in the middle 1960s and afterward that any attention was paid to the chemical senses (taste, smell) and the ancillary use of these senses in Sensory Science. Among the first organized meetings was the Gordon Research Conference at Issaquah, Washington, devoted to the chemical, and an early meeting at the Swedish Institute for Food Preservation Research at Gothenberg, Sweden. These meetings promoted interaction among the sensory researchers who were just beginning to recognize that they were founding a distinct science. This author remembers the palpable excitement generated by the early meetings, where perhaps for the first time researchers in a variety of disciplines began to recognize that they were forming the nucleus of a new science. Researchers such as Emily Wick, of Arthur D. Little and then of MIT (Food Science) would later talk fondly about these early meetings and the agenda of research goals that they set. The trend today is for far more contact among researchers. The United States led the way in the 1970s by founding the Sensory Evaluation Division of the Institute of Food Technologists (IFT), and the Sensory Evaluation Division (E-18) of the American Society for Testing and Materials. The 1990s witnessed an explosive growth in societies, meetings, journals, and all forms of contacts among researchers. Annual meetings of the Sensory Evaluation of the IFT, long the mainstay of the sensory world, were complemented by professional meetings of Committee E-18 on Sensory Evaluation of the ASTM (American Society for Testing and Materials). Worldwide sensory scientists contact each other more frequently through meetings such as the triennial and now biennial Pangborn Symposium, the biennial Sensometrics meetings, and other organizations. Sensory scientists are also beginning to attend meetings such as Food Choice, and participate heavily in specialized conferences dedicated to one or another theme involving food. Trend 4
- Beyond Expert Panels Towards Consumer Research
Many sensory researchers now recognize that their specialization in product testing fits well with the emerging corporate needs in consumer research. They have changed their focus from experts to consumers. Twenty-five years ago it was rare for a sensory scientist to venture out into consumer or market research. Sensory scientists assumed a purist stance, demanding highly controlled test environments (the well-known “booths”), well-practiced panels, experts if possible, and analytical rigor (both in statistical terms and in conceptual terms). Consequently, sensory scientists ran their own in-house expert panels, and market researchers ran consumer studies, often on the same products. Sensory scientists asked relatively few questions of consumers, if they ever tested consumers, whereas market researchers asked much of consumers. The two
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
5
professions, Sensory Science and market research, never really met, or if they did then the encounter was simply one of the many chance encounters that inevitably occur at large meetings, perhaps in connection with a specific project. Both sensory scientists and consumer researchers attempted to gain corporate recognition for product guidance. Consumer researchers by and large were untrained in sensory methods, and more accustomed to what we might today consider primitive test procedures. There was the inevitable fight for “turf,” and for corporate recognition and resources. Often the fight took the guise of a polite interaction and disagreement. Just as often the fight took the guise of an all out confrontation for control, survival, and corporate respect. Today in many but not all corporations there is much more communication between sensory scientists and consumer researchers. Indeed, in some forwardlooking companies, sensory scientists and market researchers report to the same vice president, eliminating what traditionally has been an area of contention. As a consequence of the enhanced communication between the two disciplined groups responsible for guidance, many companies now enjoy the fruits of their knowledge. For example, advanced methods for product development, such as response-surface mefhods, once an arcane statistical discipline, are now widely used in many companies to identify the effects of ingredients on sensory and liking reactions, and to optimize foods along a limited number of formula dimensions. Consumer research procedures, such as category appraisal to assess a wide range of competitive products in regard to Drivers of Liking@have been adopted by sensory scientists for routine use. Sensory scientists have even gotten into the concept development business, along with consumer researchers. Rather than handing over to marketing the role of creating product concepts, R&D directors have accepted the challenge of membership in a team that creates concepts, joining forces with the marketing group. The interaction of sensory scientists and consumer researchers is not always a pleasant one because of the aforementioned turf issues, and because the relations between the two disciplines grew out of a history of competition, not cooperation.
Hazards and Remedies. With every advance, however, there are always hazards to overcome. One of these hazards is the tendency of sensory scientists to think of themselves as the low cost suppliers of data, a self-view reinforced by many short-term focused corporate managers. In the face of increasing costs to obtain consumer data, many sensory scientists still maintain that they can produce data at lower costs than that of conventional market researchers. Market researchers are also held to limited budgets, but over the years they have had the benefit of budgets that they can allocate to outside suppliers and consultants. Inevitably, market researchers become smarter as they interact with outsiders who bring to the problem a different point of view. In contrast, the sensory scientist may miss this opportunity to grow through outward focus. Sensory
6
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
scientists make the mistake of trying to do more maintenance work and less innovative development work. It is, in fact impossible for sensory scientists to mature, do more innovative work, when the majority of the budget and the corporate kudos come from the performance of maintenance work at ever-lower costs. Simply stated, the wrong behavior is being reinforced, and the sensory researcher is turned into a drone, ever so slowly, but ever so relentlessly. The Sensory Scientist as a Sensory Professional Forty years ago there were no sensory professionals. A sensory professional at best was someone conversant with the methods of testing, with experience, capable of carrying out fairly straightforward tests. The concept of a “sensory professional” in and of itself would not have been thinkable. There was no corpus of knowledge that this “professional” would access, other than the disparate articles in the different subject fields referred to above. In the middle 1970s, with the acceptance of Sensory Science by companies, but without the widespread knowledge base, sensory scientists needed to define themselves. For want of a better name they called themselves sensory professionals. They could not call themselves sensory researchers, for that was a label more appropriate to biologists and experimental psychologists. In the middle 1970s, therefore, the title of sensory professional served to legitimize the developing field and the workers therein. Looking back one can see how the use of the term “sensory professional” did indeed produce a greater espirit de corps, and more self-pride. As one might imagine, however, the use of the term “sensory professional” also hindered development and growth, simply because it gave the researcher a title that signified “arrival,” rather than “skill set.” The situation has dramatically changed during the past 25 years. The change has been continual, not discrete, with few individual points that signal a change. There is a corpus of knowledge, there are standard methods, and the sensory scientist continues to grow. The meaning of sensory professional is now changing, taking on more “baggage,” both positive and negative. The sensory professional has won some academic recognition, attends and presents at conferences, occasionally publishes, and interacts with other scientists in various subject fields. At the same time, the use of the term “sensory professional” appears to be diminishing as practitioners enter from other professions, e.g., psychology, food science, and sociology, equipped already with well accepted academic and professional credentials. The term “sensory professional” is now often used for the technician rather than the higher-level management end of the field, perhaps as a legitimizing device for those individuals. Happily, however, the upper strata of sensory scientists do not need the title of “sensory professional” in order to gain legitimacy.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
I
Can We Improve Sensory Education? Sensory education has come a long way in the past forty years. The early days of sensory education consisted primarily of statistical analysis techniques, and detailed descriptions of how to run studies. Both of these went together, because the food world perceived Sensory Science as “taste testing.” Indeed, the informal appellation of Sensory Science was “taste testing. ” Participants would be invited down for a “taste test” in the “taste-test kitchen.” In the main a sensory scientist would use inferential statistics (e.g., tests of difference to determine whether two or more products were different from each other, whether or not storage had an effect on sensory quality, and the like). Rarely did the sensory scientist venture beyond comparison among products to higher levels such as modeling. Indeed, the notion of modeling was antithetical to taste testing, except perhaps to model the effects of time of storage on product acceptance, and even in that case the demand for modeling came from the food scientist, not from the “taste tester.” With this type of history it is no wonder that for many years sensory researchers had little in the way of a formal, rich, education that would prepare them to advance the field. Execution, not education, was called for. Those who succeeded did the test properly, not the proper test. What about the future of sensory education? Today’s texts on Sensory Science amalgamate with various degree of success such different disciplines as sensory psychophysics and sensory biology, cognitive psychology, statistical analysis, and discussions of the numerous findings published in the literature on a variety of problems of interest to the sensory scientist. Some of these topics are intensity scaling, mixtures, time-intensity, expert panels, correlation of sensory and instrumental measures, etc. Sensory education appears to be developing appropriately, on schedule, with increasing scope and sophistication. The trends for the next generation of sensory education will probably encompass more cognitive psychology (e.g., concept development of food concepts; applied concept development), as well as higher level statistical techniques to discover patterns and relations in existing data (e.g., multidimensional scaling, partial least-squares, neural nets, etc.). Today’s professors of Sensory Science favor advanced thinking, along with more integration of information and modern techniques from other fields. Today’s sensory professors are well aware, as never before, of the profound inter-connectivity of different fields of research underlying Sensory Science. It should come as no surprise that the education is more rigorous, more thought provoking, and more wide-ranging than ever before. We may expect to see that happy trend continue, and the field mature even more. It is worthwhile noting that the issue of proficiency and accreditation is surfacing both in Sensory Science (see MuAoz, following), and in related areas,
8
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
such as marketing research (William Neal, personal communication to HRM, 1999). As the disciplines of study design, data acquisition, and analysis become more accepted in industry, and as the financial stakes rise and competition sets in, many individuals in market research “hang out their shingle,” and evolve rapidly into practitioners. These superficially trained individuals without depth experience in Sensory Science, like those individuals lacking any experience in Sensory Science, may ultimately harm the profession. It remains to be seen whether accreditation can be awarded on an equitable basis, without favoritism and nepotism. Yet, with the increasing financial importance of product successes, and with the intense competition among practitioners, it is vital that some form of validation of the researcher be instituted. Fads and Beliefs Versus Enduring Truths As Sensory Science matures into an accepted discipline we also see emerging a variety of fads, or to be less critical and more generous, a variety of different popular topics. Fads in Sensory Science comprise approaches to problems that endure for some time, but eventually fade away, either because they are founded on “me-too-ism,” or because they are well-funded by corporations that want to keep abreast of the most au courant methods. Each era of research brings its own fads, partly because of the cross-pollination of disciplines, partly because researchers want to do new work, and not simply shamble along well-trodden paths. Nothing so gratifies one as participating in research deemed to be “new and ground-breaking” by the so-called cognoscenti, or at least by those currently in power, in favor, or in positions of professional authority. Here are five fads that have enjoyed favor over the past years: (1) Scales: e.g., scaling procedures (different types of rating scales) and representation methods (e.g., different types of mapping). One has to be careful not to confuse fads with the honest attempt to bring methods/ procedures from other subject fields into Sensory Science. What is one person’s science may be another person’s fad. Only time will tell whether scaling procedures are faddish or substantive, and contributory.
(2) Panelist Selection: e.g., specific screening procedures to identify “sensitive panelists.” Extensive panelist screening may be a fad because all too often the sensitivity in the panelist screening has nothing to do with the product being evaluated, but is just adopted because someone in the corporation, or someone in the literature recommended doing so.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
9
(3) Replication: The reason for the replicates is not clearly stated, nor often even understood. Replication is faddish when the rationale is not provided, but simply followed blindly. On the other hand, replication is not faddish when it is used to estimate subject variability from evaluation to evaluation. (4) Product Test Limits: Limiting the number of products tested by a panelist
to very few because one assumes that the panelist cannot accurately evaluate more than a few products without becoming confused. This assumption of panelist’s lack of ability is belied by the observation that in every day life panelists have no discrimination problems when eating. They rarely if ever report loss of sensitivity during a meal, and in fact hardly pay attention to the fact that they are consuming mouthful after mouthful of product, without seeming to lose any sensitivity at all. ( 5 ) Expert Panelists as The Repository of Subjective Truth: The researcher uses expert panelists to describe the sensory magnitude of a stimulus, under the assumption that the consumer is absolutely incapable of validly scaling sensory magnitude of a stimulus on a variety of different sensory dimensions. This belief is a passing fad, belied by the literature, and simply spread through “me-too-ism” (viz., “I too have an expert panel to acquire valid sensory data”). The consumer, in turn, is relegated to ratings of liking. This is a particularly pernicious fad that, in this author’s opinion, has retarded progress in the field, and has been often motivated by less than noble reasons.
Enduring truths, in contrast, are usually of a much more prosaic nature, and seem almost trivial. Enduring truths may be the obvious: (1) You Can’t Describe What You Can’t Verbalize. For example, if the researcher wants to use novel terms for descriptive analysis, then the researcher should orient or train the panelist on these terms, or at least define them. Orientation does not necessarily mean weeks of intensive training. Orientation may simply entail a clear, usable explanation.
(2) Too Few Scale Points Hinder Discrimination. Another enduring truth is that by confining the panelist to a short scale (e.g., three scale points), the researcher loses a great deal of information about the differences among products. (3) People Perform Pretty Well. They are biologically adapted to do so. A third enduring truth is that panelists can accurately track the changes in physical characteristics of the product, especially if they understand the
10
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
meaning of the scale and the meaning of the attribute. Psychophysicists (Stevens 1975) and sensory scientists alike (Moskowitz 1983) have demonstrated this capability again and again, in numerous, well-controlled studies. It is unfortunate that many uneducated practitioners aver, quite vehemently, that panelists cannot do much. In contrast, the human being is a marvelously constructed organism that has no problem performing most evaluation tasks.
REFERENCES AMERINE, M.A., PANGBORN, R.M. and ROESSLER, E. 1965. Principles of Sensory Evaluation of Food, Academic Press, San Diego. MOSKOWITZ, H.R. 1983. Product Testing and Sensory Evaluation of Food: Marketing and R&D Approaches. Food and Nutrition Press, Trumbull, Conn. STEVENS, S.S. 1975. Psychophysics, An Introduction To Its Sensory, Neural And Social Prospects, John Wiley & Sons, New York.
ALEJANDRA M. -0Z Sensory Science has evolved from supporting “expert taste tastings” in the beer, wine and other similar industries (Hinreiner 1956; Amerine et al. 1959) to developing formal and sound methods, to incorporating elements of other disciplines, such as psychology, statistics and psychophysics in its methods and developments, and established itself as a respected science. In the last five decades, Sensory Science has been refined, has matured and been applied in other disciplines, and its professionals have learned and applied the existing methods in many industrial, academic and research applications (Pangborn 1964). In addition, sensory professionals have participated in and supported activities that have contributed to their continued education and growth including workshops, symposia and publications. Entering the new millennium we professionals in this field are awaiting and willing to support and contribute to our “next steps” and new developments. Sensory Science will continue to grow. How can we grow as individuals, and make our field grow in the next decade and new millennium? It will continue on the path of establishing itself as a well-known, well-accepted applied discipline and will expand into new areas never before pursued. Some of the areas Sensory Science will concentrate on in the next decade include the following, as viewed by this author.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
11
Continued Application of Existing Sound Sensory/Consumer Methods Experienced sensory professionals have used the sound sensory and consumer testing methods in a wide range of applications, modified and adapted them to new situations/applications, and confirmed their value through many successes over the years. As discussed below, we need to develop and apply new sensory techniques to contribute to the growth of our field. However, while we develop, test and validate new methods, we will continue using these wellknown, established and validated methods to accomplish our daily functions in industry, research and academia. In addition, we will teach these methods to our young professionals to provide them with a good foundation to operate in the field. These methods that have solid principles and that will continue being used by sensory professionals include standard discrimination tests (simple difference, triangle, duo trio tests, etc.) (Stone and Side1 1993; Meilgaard et al. 1999), consumer qualitative and quantitative consumer tests to collect consumer opinions, acceptance and/or preference responses as well as intensity/diagnostics product information (Peryam and Pilgrim 1957; Moskowitz 1983; Chambers and Smith 1991; Stepherd et al. 1991; Casey and Krueger 1994; Krueger 1994; Resurreccion 1998), as well as the fundamental descriptive methods, such as the Flavor and Texture Profile and the Quantitative Descriptive Analysis Methods (QDA), (Caul 1957; Brandt et al. 1963; Stone et al. 1974; ASTM 1992), and its derivatives, such as Modified Profile Methods (Muiioz and Civille 1992; Stampanoni 1994; Muiioz and Bleibaum 2001). In addition, to better understand and apply existing methods, sensory professionals should continue to learn from and to review the wealth of published information on sensory and consumer studies and their applications, which is published in journals such as the Journal of Sensory Studies, Food Quality and Preference, Chemical Senses, Journal of Texture Studies, etc. Hopefully, an effort can be made by the sensory professionals to set aside the time in order to keep up-to-date with this published information. As scientists, we should also encourage, support and commend the use of and the research on new methods and techniques, while continuing to apply existing methods. As these new methods and approaches appear in the scientific literature, we should expend the effort to learn these new developments, as well as have the courage to apply them.
The Development and/or Use of New Methods and Concepts As with any other science, Sensory Science is evolving and growing. New theories, methods and concepts are being developed and applied. Sensory professionals are encouraged to contribute to these developments and apply several of the new techniques.
12
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Challenging areas and new developments that have been addressed in the past few years that sensory professionals need to track, learn and apply include:
non traditional and new discrimination test theories and methods, especially those based on signal detection theory, Thurstonian scaling, R-index (O’Mahony 1979; Ennis 1993, 1998; Ennis and Bi 1998; Cliff ef al. 2000; Rousseau 2001; Rousseau and O’Mahony 2001). deeper consumer understanding and exploration of consumer articulated and unarticulated wants and needs, using new consumer testing approaches, such as, ethnography, projective and elicitation techniques (Swan ef al. 1996; Bech er al. 1997; Perry 1998; Baxter ef al. 1998; Rousset and Martin 2001; Muiioz and Everitt 2003; Urbick 2003; Woodland 2003). application of traditional and creative qualitative techniques (Krueger 1994; Dudek and Childrens 1999). new statistical applications and advanced analysis for sensory data and applications including analysis of categorical and replicated data, application of experimental design, new statistical approaches for data relationships, etc. (Pouplard er al. 1997; Wilkinson and Yuksel 1997; Brockhoff and Schlich 1998; Kunert 1998; Bi er al. 2000; Tang er al. 2000; Malundo er al. 2001; Best and Rayner 2001). data relationships techniques (consumer, descriptive, instrumental) to integrate product information and to understand products and populations (e.g., consumers) (McEwan 1996; ASTM 1997; Wilkinson and Yuksel 1997; Elmore ef al. 1999; Malundo ef al. 2001). monitoring techniques needed to calibrate attribute/descriptive panels (sensory and statistical methods) (Schlich 1994; McEwan 1999; Qannari and Meyners 2001; King er al. 2001).
Participation in, and Support of All Research Involving the Development of New Concepts and Methods Currently, most of the publicly available sensory research is conducted by universities. Sensory professionals working in industry are either too busy to participate in research studies, or are not allowed to publish, since this information sharing may not be supported by management. Our field can only grow to the extent that research and new developments are completed. Therefore, it is our obligation to encourage and participate in this activity. In
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
13
this upcoming decade we should participate in and/or support much of the research in our field.
Financial support is critical. Sensory programs in universities benefit from the support received by grants, industry and other organizations to be able to get involved in sensory research. Hopefully more support will be given to aid universities in completing more and better research. Even if some sensory professionals are unable to personally engage in research, they can still be part of the growth by reading and learning about the new developments and applying them. A number of sources of support have recently become available, giving practitioners and academics alike the prospect of even greater developments in the field. Recently the ASTM committee El8 on Sensory Evaluation has initiated discussions on the need to support additional research in the field of Sensory Science and thus formed a standing committee on sensory research. Its goal will be to select relevant topics needing research, obtaining funds and manage the research efforts within and outside its membership. Delineation of Sensory Science’s Name and Role When Sensory Science established itself as a science, it was named Sensory Evaluation and encompassed analytical/discriminative and consumer methods (Amerine et al. 1959; Pangborn 1964). In the past few years, two trends have been observed: (1) Many professionals refer to our field as Sensory Science vs. Sensory Analysis or Evaluation; and (2) Many companies and professionals limit the role of Sensory Science to analytical/discriminative testing, thus exclude consumer testing. In addition, many of these companies make a distinction between the roles and professional involvement of sensory and consumer scientists. We sensory professionals should be aware that there are three different names used interchangeably for our field: Sensory Science, Sensory Analysis and Sensory Evaluation. Currently, there is a trend toward preferring the use of the name Sensory Science to connote the nature of this discipline. However, we should be cognizant of the fact that many companies and individuals differentiate between Sensory Science and Consumer Science. Thus, nowadays the role of a Sensory Science group within an organization cannot be easily inferred. An explanation of the tasks and involvement of a sensory group is needed to understand its role. In this author’s opinion the differentiation should not exist. A sensory professional should be recognized as one who is knowledgeable and uses BOTH sensory and consumer methods to provide answers and guidance. It is our responsibility to clarify the role of Sensory Science and ensure that individuals and companies understand the basis and role of this discipline. Until this
14
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
happens, it is important to recognize that this differentiation will continue to exist. In this publication, this author will use the word sensory professional or scientist to describe the individual who is knowledgeable and uses BOTH sensory and consumer methods to fulfill his job responsibilities. Occasionally, if necessary, the term sensory/consumer scientist may be used. Global Sensory Science Sensory Science like other sciences has taken a global view (Stone and Side1 1995). This global perspective is needed, due to: (1) the extensive collaboration taking place among professionals around the world; and (2) the need to develop and apply product evaluation techniques globally in order to respond to the industry’s needs to test products abroad. Therefore, in this author’s view the globalization of Sensory Science is happening and will continue to expand in the next decade in five areas: (1) the execution of cross cultural studies, as the companies we work for expand their business and interests into other countries and cultures; (2) trans-national collaboration for the development or improvement of companies’ affiliate/foreign sensory programs; (3) the need for companies to harmonize approaches, methods and references across all their affiliates worldwide; (4) the recognition of a common goal to understand global consumer responses and the need to adapt sensory consumer methods for world-wide use, recognizing different cultures; and ( 5 ) the interaction, exchange of ideas and collaboration among sensory scientists around the world. An in-depth discussion of this important topic is presented in Chap. 2. Sensory Proficiency and Accreditation
Proficiency/accreditation is a very current, pressing issue being addressed by sensory professionals worldwide. The general goal of all proficiency and accreditation programs is to establish guidelines for the certification of sensory laboratories and professionals. Proficiency testing was recently initiated and sensory professionals all over the world are eager to learn about the progress and participate in this effort. Proficiency testing is the use of interlaboratory test comparisons to determine the performance of individual laboratories for specific tests, and is used to monitor the consistency and comparability of a laboratory’s test data with other similar laboratories. Participation in proficiency testing schemes provide laboratories with an objective means of assessing and demonstrating the reliability of their data, and to assess the ability of the laboratory to competently perform tests. Proficiency testing schemes are used by laboratory accreditation bodies as part of the process to assess the ability of laboratories to competently
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
15
perform tests for which accreditation is held. Proficiency testing schemes are well established in certain scientific disciplines. However, proficiency testing schemes that allow laboratories to assess their performance and competence in Sensory Science were not available. The first attempt to address sensory proficiency was initiated in 1999 by PROFISENS, a EU project financed by the European Commission Standards Measurements and Testing SMT. The PROFISENS project was internationally based and included leading laboratories in Sensory Science throughout Europe in the project consortium. Also represented were multinational industries with particular interests in ensuring that the guidelines developed met the needs of industry. Furthermore, the guidelines were evaluated by several external specialists from the USA and Canada, and their comments were incorporated into the final proficiency scheme guidelines that were published. The main output of the PROFISENS project was the publication of a guideline document for conducting proficiency testing in Sensory Science. Published as Guideline No. 35 by Campden & Chorleywood Food Research Association, UK (CCFRA) (the coordinator), the document covers the technical requirements for conducting sensory proficiency tests and the management systems requirements of the proficiency scheme provider (Lyon 2001). Therefore, the document provides an overall summary of how a scheme would operate and the relative responsibilities of individuals or organizations in the planning and conduct of sensory proficiency tests. Other relevant publications of this project are the papers by McEwan er al. (2002a, b) that describe measuring performance panel issues for ranking and profile testing. While the PROFISENS project has come to an end, it has provided the basis for future work in this area. In response to this effort the ASTM El8 committee has formed a task group to address this issue through ASTM International (Chambers 2003). It is anticipated that other countries will respond to this challenging issue as well.
Sensory Science and the Internet In the new millennium all scientific work, business enterprises, and personal endeavors and undertakings will continue revolving around the Internet. It is anticipated that sensory professionals will use the Internet for information gathering and communication purposes, but also to conduct tests. The web helps researchers interact with consumers and panelists in ways barely imaginable over the past decade. Netmeetings continue to give rise to new advances in synchronous interactions with our subjects coordinated and facilitated by intelligent machines. This gives rise to synchronous meetings that allow panels, focus groups, and product evaluators to share their discussions
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
16
over both space and time. Advances in privacy will help in the maintaining of the anonymity of respondents and confidentiality of responses (Stucky 2001). Currently, there are companies that have used the Internet in the area of consumer testing (Kolkebeck 2002) and sensory and descriptive analysis (Curt er al. 2000; Findlay 2002). In the area of consumer testing, consumers are being recruited through the Internet, as well as asked to complete surveys and testing. In the area of descriptive analysis, panels are being trained and asked to evaluate products and completehend their evaluation results through the Internet (Curt et al. 2000). Kolkebeck (2002) reports the following successful uses of the Internet in consumer testing : (1) Recruiting Methods a.
b.
Recruiting agencies contact prospective respondents in their database by email and request that they call the agency to complete the screening procedure; and Recruiting agencies send email notification and URL link to a screening questionnaire to potential respondents in their database.
(2) Interviewing Methods a. b.
c.
Home Use Tests (HUTS): Respondents are either mailed producth or come to a central location to pick up producth. Diariedballots are completed on-line. Central Location Tests (CLTs): Respondents come to testing facilities to participate in a quantitative test to evaluate products that require controlled preparation or to evaluate concepts or prototypes in a secure environment. On-line ballots are completed by the respondent. Multi-Modal Data Collection: Respondents choose to complete questionnaires via telephone or Internet/Web.
Those companies developing these services capitalize on the advantages of the communication via the Internet, allowing: (1) communication between professionals within the organization; (2) direct, day to day, communication with individual consumers through chats, web forms, forums, noteboards, internet communities, and email; (3) evaluation of products by consumers or trained panelists from their home or location, and thus eliminating transportation time and logistics; (4) evaluation of products at different locations (e.g., countries, cities, laboratories);
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
17
immediate data collection; automated, intelligent, real-time reporting and quality checking; collaboration of multi-locations/countrieson the same project, making changes and decisions in real-time; and ability to quickly and easily incorporate sensory information with other information and data sources within the company, allowing the human reaction to the product(s) to be incorporated at all levels of the product lifecycle. There is skepticism in completing testing through the Internet, mainly because it only reaches a limited population (those using the Internet and being computer literate), and prevents the control of testing conditions. However, the use of the Internet will continue to grow in the corning decade in all areas. Therefore, it is expected that Sensory Science will have to participate in this boom and will use the power of the Internet in many application areas.
The Active Role of Sensory Professionals In Industry The role of Sensory Science in industry has changed over the past years. Sensory professionals have taken a more active role in their companies. They now act as consultants within the organization to address business and technical issues, as well as establishing a closer collaboration with many groups within the organization.
Interaction With and Creation of Partnerships With Marketing/ Marketing Research. Sensory Science will grow internally at our companies if we establish stronger partnerships with market/marketing research professionals. These partnerships benefit primarily the company, as better projects are completed through the combination of skills and efforts of the different disciplines. In addition, in the course of completing their work, both sensory and marketers learn from each other. The acceptance of our methods and data by marketlmarketing research professionals should result in more frequent use of sensory techniques/methods in the company’s projects, as well as the involvement of sensory professionals in more important and visible projects within the company. We, as sensory professionals, can become partners with market/marketing research professionals by assisting them in key projects, demonstrating the value of sensory data, and assuring that these data contribute to the overall success of projects. The involvement of the sensory professional in other projects will be more frequently requested if these alliances are formed. The time is over for sensory professionals to complain about how they are regarded within a company, how the sensory groups are left out of important
18
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
planning meetings and projects, and how small sensory budgets are compared to those of market research. Sensory professionals should be assertive, create these partnerships that benefit the company and the individuals, and make themselves visible within the company. Sensory groups that have not accomplished these types of relationships with marketing/market research professionals will need to develop these relationships in the coming decade.
The Sensory Professional: The Internal Sensory Consultant and His/Her Interaction With Other Functions Within a Company. In the next decade, the sensory professional will continue establishing his/her role as a consultant within an organization, and increase his/her visibility and respect. A sensory professional should seek out “clients” within the organization and assure that the services and expertise of a sensory group are well-known and utilized. The visibility of sensory professionals within their organization is essential for ongoing involvement in key technical and business issues, and for management support or internal funding for programs, facilities, equipment and software, training, external support, etc. Visibility is gained by proving the best support to all research, marketing/market research, manufacturing and quality control functions. Therefore, it is in the sensory professional’s best interest to gain this visibility. This is best achieved when the skills and services of the group are well-known by all groups, and sensory tests and research are being effectively used within the organization. Continued Application Of Advanced Statistical Methods Statistics have always been an essential part of sensory testing. All quantitative sensory data should be statistically analyzed to be properly interpreted. Sensory professionals have a good understanding of the basic and some advanced statistical techniques typically used to analyze sensory data. In the coming decade, sensory professionals will continue to learn and apply advanced statistical methods, new statistical techniques and philosophies, and experimental design concepts in sensory studies (Courcoux and Semeneou 1997; Pouplard ef al. 1997; Wilkinson and Yuksel 1997; Brockhoff and Schlich 1998; Kunert 1998; Bi ef al. 2000; Tang ef al. 2000; Best and Rayner 2001a, b; Deppe ef al. 2001; Malundo ef al. 2001). Companies will continue to create links between the sensory and the statistics groups or alternatively hire statisticians to support sensory groups. Companies with adequate statistical support will look into applying more advanced statistical and experimental design concepts into sensory studies. Companies with little or no statistical support will have to incorporate statistics into their program.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
19
New statistical applications in the area of Sensory Science continue to be published and presented at international symposia (e.g., Sensometrics). Statisticians, sensometricians and chemometricians are making great contributions to the field of Sensory Science by developing new techniques to analyze and link sensory data, or applying statistical approaches not known by sensory professionals to the field of Sensory Science (Brockhoff and Schlich 1998; Kunert 1998; Deppe et al. 2001; Best and Rayner 2001a, b; Vigneau et al. 2001; Wakeling et al. 2001). It must be noted, however, that statistics are necessary but they only complement good sensory projects and research. The statistical analysis is only as good as the sensory data used. Emphasis should always be placed on the improvement of sensory methods and the generation of sound sensory data. The application of statistical techniques, simple and complex, is completed after one has made sure that the best sensory data has been generated. Data Collection Systems and Software
In the past decade, many sensory programs have incorporated the use of data collection systems. These systems allow the direct and prompt collection of data, minimizing the manpower thus far used in manual data entry. Over the past years, these systems have also incorporated other features such as experimental design, test design, sample coding and data analysis. As resources become less available within sensory groups, the need for data collection systems increases. Therefore, it is expected that the majority of the sensory programs will acquire a data collection system in the near future. These systems continue to be developed and improved to meet the needs of sensory professionals. A discussion of data collection systems and new developments is discussed in Chap. 25. In addition, software for sensory applications continues to be developed for routine sensory data analysis, panel perfoxmance, and advanced multivariate and mapping techniques. Chapter 24 briefly discusses the most well known software packages used in Sensory Evaluation, emphasizing SAS programming. The Application of Modified Sensory Methods When Resources Are Limited One of the challenges sensory professionals have to confront in the next decade is the development and application of alternate or modified sensory methods as resources (particularly funds and time) become less and less available. Companies will continue to cut back on resources and demand more work from their employees. Thus, sensory professionals will be required to get the sensory testing completed with limited available resources. Therefore, sensory professionals have to develop and incorporate new sensory techniques
20
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
and strategies into projects to be able to reduce the number of tests, resources, and the time needed to complete them. Among the techniques to consider if confronted with such limitations are: more screening of products prior to testing, more informal - but sound - and educated testing, the use of fewer but better trained panelists, the use of outside consultants or contractors for routine project work, the fielding of tests and statistical analysis to outside agencies, the development of shorter more effective reports, etc.
Learning about the Sensory Properties of Products This is an area to which insufficient attention has been paid thus far. The recognition and development of this area will increase in the next decade. All sensory programs at universities and most workshops offered to the sensory community address sensory methodology. Therefore, we are or can become very knowledgeable in methods. This knowledge is critical to be able to design and execute sound sensory tests and interpret the resulting data. However, there is another skill sensory professionals should develop - the deeper learning of the sensory properties of the products with which they work. With this knowledge, which involves having the ability to adequately describe a product’s perceived sensory properties, sensory professionals are able to conduct better research and project management. This skill also enables the practitioner to make better decisions regarding product presentation designs and attributes in consumer questionnaires; design more effective and complete descriptive training programs; monitor panel exercises and programs; better communicate with colleagues about the sensory attributes of the products; and transfer that knowledge to “non-sensory” professionals within the organization. We learn sensory principles at the university, through short courses and publications, but not sensory properties of products. We cannot “learn sensory properties” from books or lectures. We have to actively educate ourselves in this area. We gain this information by participating in descriptive analysis training programs, in sessions with trained descriptive panelists, by working closely with the descriptive panel leader or some of the trained panelists, by collaborating with internal people with experience in the company’s products, or by hiring consultants with knowledge of sensory properties.
Need to Educate Non-sensory Professionals in Sensory Methods and Sensory Properties In order for our field to be accepted and used in its totality in industry, we need to educate non-sensory professionals and users of sensory data (product developers, formulators, managers, marketing/market research professionals) in
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
21
sensory methods and the sensory properties of products they work with. Sensory professionals will focus on this area in the coming decade. On a routine basis sensory professionals should design and conduct seminars within their organizations in order to teach sensory methods, their applications and limitations, and sensory properties of the company’s products. (1) Seminars on sensory methods: These seminars should provide an introduc-
tion of basic principles of the field, as well as illustrate the applications, advantages and limitations of each of the techniques used within a company. Basic data interpretation should also be addressed. In addition, methodology seminars should address issues and questions that non-sensory professionals have within an organization. Some of the topics addressed should be: the variability of sensory data (and its effect on the outcome of tests), designs of consumer and other sensory tests, test replications, forced vs. non-forced choice tests (preference, discrimination tests), etc. These seminars are also helpful in that they facilitate the discussion of sensory methods and issues, and therefore improve the understanding and use of sensory tools by nonsensory professionals. (2) Seminars on sensory properties: These seminars provide the non-sensory professional with a basic understanding of the sensory characteristics of the product categories they work with. These seminars are short and practical. Participants do not become trained panelists, but learn technical and precise descriptive language to describe the sensory properties of the products they work with. These seminars are highly effective for participants. The seminars give the participants tools to better discuss and communicate the sensory properties of products with professions both inside and outside the company.
Sensory Methods for the Evaluation of Non-Food Products Sensory Science was developed for foods (Amerine et al. 1959; Pangborn 1964). Consequently, a significant propohion of today’s sensory methods were developed and perfected in this area. In addition, much of the sensory knowledge and practices has been promoted through the university, and for the most part through the Food Science departments and related programs. Therefore, students learn sensory methods and their applications in foods. As a result, the food and beverage industries - in general - are the most advanced in our field, have the most complete sensory programs, have used sensory techniques for a long time, and apply the most advanced sensory and statistical methods.
22
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
In the coming decade, the sensory programs, and the research and methods used in other industries will continue to evolve. TraditionaL sensory methods developed and used for food will be modified for non-food products (e.g., in the personal, household care, and pharmaceutical industries, as well as in other industries) (Giboreau er al. 2001; Braddon ef af. 2002; Griffiths and Kulke 2002). For instance, the ASTM El8 (committee on sensory testing) subcommittee E18.07 on personal care and household evaluation has several task groups that work on non-foods applications, and publish sensory practices and methods for the evaluation of non-food products (e.g., hard surface cleaning products, shampoo, etc.). Several of the published standards for the evaluation of non-food products include: Standard E1593-94 on assessing the efficacy of air freshener products in reducing sensorily perceived indoor air malodor intensity (ASTM 1994); Standard E1207-87 (2002) on Sensory Evaluation of Axillary Deodorancy (ASTM 2002), Standard E1490-92 (2002) on Descriptive Skinfeel Analysis of Creams and Lotions (ASTM 2002).
REFERENCES AMERINE, M.A., ROESSLER, E.B. and FILIPELLO, F. 1959. Modem sensory methods of evaluating wine. Hilgardia 28, 477. ASTM. 1992. Manual on Descriptive Analysis Testing. MNL 13, R. Hootman, ed. ASTM, West Conshohocken, Penn. ASTM. 1994. Standard E1593-94. Assessing the Efficacy of Air Freshener Products in Reducing Sensorily Perceived Indoor Air Malodor Intensity. ASTM, West Conshohocken, Penn. ASTM. 1997. Relating Consumer, Descriptive, and Laboratory Data to Better Understand Consumer Responses. Manual 30, A. Muiioz, ed. ASTM, West Conshohocken, Penn. ASTM. 2002. Standard E1207-87 (2002). Sensory Evaluation of Axillary Deodorancy. ASTM, West Conshohocken, Penn. ASTM. 2002. Standard E1490-92 (2002). Descriptive Skinfeel Analysis of Creams and Lotions. ASTM, West Conshohocken, Penn. BAXTER, I.A., JACK, F.R. and SCHRODER, M.J.A. 1998. The use of repertory grid method to elicit perceptual data from primary school children. Food Quality and Preference 9(1-2), 73. BECH, A.C., HANSEN, H. and WEINBERG, L. 1997. Application of House of Quality in translation of consumer needs into sensory attributes measurable by descriptive sensory science. Food Quality and Preference 8(5-6), 329-348. BEST, D.J. and RAYNER, J.C.W. 2001a. Application of the Stuart test to sensory evaluation data. Food Quality and Preference ZZ(5-7). 353-357.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
23
BEST, D.J. and RAYNER, J.C.W. 2001b. Nonparametric analysis for trinary sensory data. J. Sensory Studies 16, 249-261. BI, J., TEMPLETON-JANIK, J.M., ENNIS, J.M. and ENNIS, D.M. 2000. Replicated difference and preference tests: how to account for inter-trial variation. Food Quality and Preference 11(4), 269-273. BRADDON, S., JARRE’IT, G.S. and MUfiOZ A.M. 2002.Consumer Testing Methods. In: Skin Moisturization. J. Leyden and A. Rawlings, eds. Marcel Dekker, New York. BRAPIDT, M.A., SKINNER, E.A. and COLEMAN, J.A. 1963. Texture profile method. J. Food Sci. 28,404-409. BROCKHOFF, P.B. and SCHLICH, P. 1998. Handling replications in discrimination tests. Food Quality and Preference 9(5), 303-312. CASEY, M.A. and KRUEGER, R.A. 1994. Focus group interviewing. In: Measurement of Food Preferences, H .J .H . MacFie and D .M .H . Thomson, eds. Blackie Academic & Professional, London. CAUL, J.F. 1957. The profile method of flavor analysis. Advances In Food Research 7(1), 1-40. CHAMBERS, D. 2003. ASTM Task Group on Sensory Proficiency. Personal communication. CHAMBERS, E. and SMITH, E.A. 1991.The use of qualitative research in product research and development. In: Sensory Science Theory and Applications in Foods, H.T. Lawless and B.P. Klein, eds. Marcel Dekker, New York. CLIFF, M.A., O’MAHONY, M., FUKUMOTO, L. and KING, M.C. 2000. Development of a “bipolar” R index. J. Sensory Studies 15(2), 219-229. COURCOUX, P. and SEMENOU, M. 1997.Preference data analysis using a paired comparison model. Food Quality and Preference 8(5-6),353-358. CURT, C., NOGUEIRA, H., TINET, C., HOSSENLOPP, J. and TRYSTRAM, G. 2000.Gustamat: sensory quality control of cured sausage. Innovations in Food Technology 11, 6-52. DEPPE, C., CARFTENTER, R. and JONES, B. 2001. Nested incomplete block designs in sensory testing: Construction strategies 2001.Food Quality and Preference 12(5-7), 281-290. DUDEK, L. and CHILDRENS, S. 1999.Using graphics facilitation tools to tap in wisdom of consumers and customers. ASTM symposium: Translating Consumer Needs into a Strategic Business Plan. Deerfield Beach, Florida. ELMORE, J.R., HEYMANN, H., JOHNSON, J. and HEWETT, J.E. 1999. Preference mapping: Relating acceptance of “creaminess” to a descriptive sensory map of a semi-solid. Food Quality and Preference 10(6), 465-476. ENNIS, D.M. 1993.The power of sensory discrimination methods. J. Sensory Studies 8, 353-370.
24
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
ENNIS, D.M. 1998. Thurstonian scaling for difference tests. IFPress@1(3), 2-3. ENNIS, D.M. and BI, J. 1998. The Beta-Binomial model: Accounting for intertrial variation in replicated difference and preference tests. J. Sensory Studies 13, 389-412. FINDLAY, C. 2002. Computers and the internet in sensory quality control. Food Quality and Preference 13(6), 423-428. GIBOREAU, A., NAVARRO, S., FAYE, P. and DUMORTIER, J. 2001. Sensory evaluation of automotive fabrics: The contribution of categorization tasks and non verbal information to set up a descriptive method of tactile properties. Food Quality and Preference 12(5-7), 31 1-322. GRIFFITHS, P. and KULKE, T. 2002. Clothing movement - Visual sensory evaluation and its correlation to fabric properties. J. Sensory Studies 17, 229-255. HINREINER, E.H. 1956. Organoleptic evaluation by industry panels - the cutting bee. Food Technol. 31(1 l), 62-67. KING, C., HALL, J. and CLIFF, M.A. 2001. A comparison of methods for evaluating the performance of a trained sensory panel. J. Sensory Studies 16, 567-581. KOLKEBECK, N.E. 2002. Internet approaches at J . Reckner Associates (JRA). JRA Press, Montgomery, Penn. KRUEGER, R.A. 1994. Focus Groups: A Practical Guide for Applied Research, 2nd Ed. Sage Publications, Newbury Park, Cal. KUNERT, J. 1998. Sensory experiments as crossover studies. Food Quality and Preference 9(4), 243-254. LYON, D.H. 2001. International Guidelines for Proficiency Testing in Sensory Analysis, Guideline No. 35. CCFRA, Chipping Campden, GL55 6LD. United Kingdom. MALUNDO, T.M.M., SHEWFELT, R.L., WARE, G.O. and BALDWIN, E.A. 2001. An alternative method for relating consumer and descriptive data used to identify critical flavor properties of mango (Mungiferu indicu 15.).J. Sensory Studies 16, 199-214. MEILGAARD, M., CIVILLE, G.C. and CARR, B.T. 1999. Sensory Evaluation Techniques, 3rd Ed. CRC Press, Boca Raton, Florida. McEWAN, J.A. 1996. Preference Mapping For Product Optimization. In: Multivariate Analysis of Data in Sensory Science (T. Naes and E. Risvik, eds.) Elsevier Applied Science, New York. McEWAN, J.A. 1999. Comparison of sensory panels: A ring trial. J. Sensory Studies 14, 161. McEWAN, J.A., HUNTER, E.A., VAN GERMERT, L.J. and LEA, P. 2002a. Proficiency testing for sensory profile panels: measuring panel performance. Food Quality and Preference 13, 181-190.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
25
McEWAN, J.A., HEINIO, R., HUNTER, E.A. and LEA, P. 2002b. Proficiency testing for sensory ranking panels: measuring panel performance. Food Quality and Preference 14(3), 247-256. MOSKOWITZ, H.R. 1983. Product Testing and Sensory Evaluation of Food: Marketing and R&D Approaches. Food and Nutrition Press, Trumbull, Conn. MUAOZ, A.M. and BLEIBAUM, R.N. 2001. Fundamental Descriptive Analysis Techniques. Exploration of their Origins, Differences and Controversies. Workshop presented at “2001: A Sense Odyssey”, 4th Pangborn Sensory Science Symposium, Dijon, France. MUAOZ, A.M. and CIVILLE, G.V. 1992. Spectrum Descriptive Analysis Method. In: ASTM Manual Series MNL 13. Manual on Descriptive Analysis Testing. ASTM, West Conshohocken. Penn. MUROZ, A.M. and EVERITT, M. 2003. Non-traditonal consumer research methods. Workshop presented at the “2003: A Sensory Revolution”, 5th Pangborn Sensory Science Symposium, Boston. O’MAHONY, M. 1979. Short cut signal detection measures for sensory science. J. Food Science 44( l), 302-303. PANGBORN, R.M. 1964. Sensory evaluation of foods: A look backward and forward. Food Technol. 18(9), 63-67. PERRY, B. 1998. Seeing your customers in a whole new life. J. Quality and Participation 21(6), 38-43. PERYAM, D.R. and PILGRIM, F.J. 1957. Hedonic scale method of measuring food preferences. Food Technol. 11, 9-14. POUPLARD, N., QANNARI, E.M. and SIMON, S. 1997. Use of Ridits to analyze categorical data in preference studies. Food Quality and Preference 8(5-6), 419-422. QANNARI, E.M. and MEYNERS, M. 2001. Identifying assessor differences in weighting the underlying sensory dimensions. J. Sensory Studies 16, 505-516. RESURRECCION, A.V.A. 1998. Consumer Sensory Testing for Product Development. Aspen Publishers, Gaithersburg, MD. ROUSSEAU, B. 2001. The beta-strategy: An alternative and powerful cognitive strategy when performing sensory discrimination tests. J. Sensory Studies 16, 301-319. ROUSSET, S. and MARTIN, J.F. 2001. An effective hedonic analysis tool: Weakhtrong points. J. Sensory Studies 16(6), 643-661. ROUSSEAU, B. and O’MAHONY, M. 2001. Investigation of the dual-pair method as a possible alternative to the triangle and same-different tests. J. Sensory Studies 16, 161-178. SCHLICH, P. 1994. GRAPES: A method and a SAS program for graphical representations of assessor performance. J. Sensory Studies 9, 157.
26
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
STAMPANONI, C.R. 1994. The use of standardized flavor languages and quantitative flavor profiling technique for flavored dairy products. J. Sensory Studies 9, 383-400. STEPHERD, R., FARLEIGH, C.A. and WHARFT, S.G. 1991. Effect of quality consumed on measures of liking for alt concentrations in soup. J. Sensory Studies 6, 227-238. STONE, H., SIDEL, J., OLIVER, S., WOOLSEY, A. and SINGLETON, R. C. 1974. Sensory evaluation by quantitative descriptive analysis. Food Technol. 28(11), 24, 26, 29, 32, 34. STONE, H. and SIDEL, J.L. 1993. Sensory Evaluation Practices. Academic Press, New York. STONE, H. and SIDEL, J.L. 1995. Strategic applications for sensory evaluation in a global market. Food Technol. 49(2), 80-88. STUCKY, G. 2001. The Future of Human-Centric Technology to Help Us Do More by Doing Less. Workshop 9: Instrumentation for Sensory Data Collection for the New Millennium. Workshop presented at “2001: A Sense Odyssey”, 4Ih Pangborn Sensory Science Symposium, Dijon, France. SWAN, J., MCINNIS, B.C. and TRAWICK, F. 1996. Ethnography as a method for broadening sales force research: Promise and potential. J. Personal Selling and Sales Management 16(2), 57-64. TANG, C., HEYMANN, H. and HSIEH, F.H. 2000. Alternatives to data averaging of consumer preference data. Food Quality and Preference 11(12), 99-104. URBICK, B. 2003. Empathography - Partnering with your consumer. In: Nontraditonal consumer research methods. Workshop presented at the “2003: A Sensory Revolution”, 5th Pangborn Sensory Science Symposium, Boston. VIGNEAU, E., QANNARI, E.M., PUNTER, P.H. and KNOOPS, P. 2001. Segmentation of a panel of consumers using clustering of variables around latent directions of preference. Food Quality and Preference I2(5-7), 359-363. WAKELING, I.N., HASTED, A. and BUCK, D. 2001. Cyclic presentation order designs for consumer research. Food Quality and Preference 12(1), 39-46. WILKINSON, C. and YUKSEL, D. 1997. Using artificial networks to develop prediction models for sensory-instrumentalrelationships: an overview. Food Quality and Preference 8(5-6). 439. WOODLAND, C.L. 2003. Ethnographic and observational research. In: Nontraditonal consumer research methods. Workshop presented at the “2003: A Sensory Revolution”, 5th Pangborn Sensory Science Symposium, Boston.
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
27
MAXIM0 C. GACULA, JR. Before we can provide a prediction of the role of Sensory Science or sensory evaluation in the next decade, we must first establish that Sensory Science is accepted by academia as a scientific discipline, supported by fundamental theories and used in practice with acceptable results. Is Sensory Science a mature science on which we can rely? What is meant by mature? Webster’s definition states “to become fully developed or ripe; having completed natural growth and development” as one of the definitions. Are the methods and principles we use today tested and verified through the so-called scientific method? If it is, then Sensory Science is mature. Fishken (1987) stated that our field has matured to the level where it is known to exist by many and is viewed with both warm acceptance and skepticism. It is hoped that in 10 years hence Sensory Science will be fully matured and accepted without skepticism as a scientific discipline. However, it is not the end when a science is mature. I consider the science of sensory as a continual process of learning and implementation. It is in the implementation process that Sensory Science gains respect, recognition, and acceptance by academia, consumer product industries and its corporate environments. Dr. Moskowitz and Ms. Muiioz have discussed the trends, needs, globalization of Sensory Science, among others and most importantly the relation between sensory evaluation and marketing research which has been a “traditional separation, ” but the nature of such separation has changed in the last five years or so. The viewpoints expounded by Moskowitz and Muiioz are relevant and substantive for sensory practice to be fruitful and should be addressed without political influence from the department umbrella, as Moskowitz indicated. Sensory and marketing research grew out of a history of competition, not cooperation. From my perspective, this is changing and more so in the next decade. “Sensory professional,” “sensory analyst,” “sensory scientist” - the naming has not been fully defined and established. All these titles are appropriate and the choice should be based on context. Sensory scientist or sensory researcher title appears appropriate for scientific meetings, resumes, reference to specific areas of sensory, etc. In research one is always dealing with the scientific method. Perhaps in social conversation and when referring to sensory as a whole, sensory professional would be a logical title. Moskowitz’s and Mufioz’s viewpoints on sensory education are well-taken and will be seen in the next decade. It will be a giant step if we can use the consumer to rate sensory intensity as stated by Muiioz and Moskowitz. We have to be assured that the consumer has a uniform understanding of the attribute to be evaluated and secondly, the problem by a consumer of using hedonic
28
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
judgment instead of intensity. However, research in the psychology of acceptability indicates that this might not be true (Booth ef al. 1983; Booth and Conner 1990). This is one situation where sensory evaluation and marketing research can collaborate to find a solution to the problem or put the question to rest. Ms. Muiioz’s viewpoints on sensory globalization are indeed timely and is happening now and will continue. Most of the global sensory studies are in descriptive analysis (Rajalakshmi ef al. 1987; Byme ef al. 1999; Rohm ef al. 1994), which in fact uses the descriptive methods developed in the USA. Examples of global consumer studies are those reported by Laing ef al. (1994) and Dransfield ef af. (2000). On accreditation, I feel that laboratory accreditation would have a future and perhaps can be realized in the next two decades. However, based on my observations with the American Statistical Association, I cannot foresee that proficiency accreditation will happen for the sensory professional in the near term. Ms. Muiloz’s viewpoint on the use of Internet in sensory evaluation and product testing will undoubtedly be the case in a few years, if not now, and particularly within a company on an intranet basis, using company employees. There are companies that today use the Internet on a regular basis to recruit panelists. On the topic of advanced statistics, the use of methods that handle serious multicollinearity in the data will increase; it is known that sensory data are highly correlated that often gives misleading results. A statistical method frequently used in Sensory Science is stepwise regression; in some results, the variables selected do not make sense in relation to the experimental variables because of multicollinearity. Because of correlation, it does not necessarily mean that variables not selected are not important. Many books and published papers have discussed the use of principal component regression to solve the problem of multicollinearity (Draper and Smith 1981; Chatterjee and Price 1991;Jackson 1991; Popper ef al. 1997). Others have approached the problem by the use of ridge regression (Neter ef al. 1996; Houshmand and Javaheri 1998). Sensory scientists in Scandinavian and European countries have used extensively the partial least-squares regression in modeling sensory responses. Another advanced method is preference mapping which is gaining popularity in sensory testing work (Greenhoff and MacFie 1994; Moskowitz 2002; Santa Cruz ef al. 2002). In the next decade, we will see increased use of these advanced regression techniques for sensory prediction work. The use of multivariate methods for hypothesis testing has not been implemented in Sensory Science because of its complexity. However, in studying the relationships of independent variables (products, treatments, etc.) and dependent variables (sensory attributes, etc.), the multivariate methods have
THE ROLE OF SENSORY SCIENCE IN THE COMING DECADE
29
been fully implemented in Sensory Science, such as factor analysis, principal component analysis, among others. Sensory professionals are aware of these applications and the edited book by Naes and Risvik (1996) is a recommended reading material. Because of multicollinearity of sensory data, technically speaking, the testing of treatment differences must be done using a multivariate test. Due to its complexity in both the statistics and software availability the univariate test method is used instead, by analyzing the sensory attribute separately. That is, if we have 15 attributes there will be 15 univariate analyses of variance. The univariate test method ignores the intercorrelations existing between sensory attributes. However, if the intercorrelations are negligible (not statistically significant), the univariate test will be acceptable. If it is not negligible, but the variance-covariance matrix is uniform (correlations among the variables are similar) the univariate test would be acceptable which is the common assumption used today in hypothesis testing of sensory and consumer data. To further advance the role of Sensory Science in the next decade, education is needed and extensive research in data analysis using actual sensory and consumer data to study the characteristics of the variance-covariance matrix in relation to hypothesis testing.
REFERENCES BOOTH, D. and CONNER, M. 1990. Characterisation and measurement of influences on food acceptability by analysis of choice differences: theory and practice. Food Quality and Preference 2, 275-285. BOOTH, D., THOMPSON, A. and SHAHEDIAN, B. 1983. A robust, brief measure of an individual’s most preferred level of salt in an ordinary foodstuff. Appetite 4, 301-3 12. BYRNE, D.V., BAK, L.S., BREDIE, W.L.P, BERTELSEN, G. and MARTENS, M. 1999. Development of a sensory vocabulary for warmed-over-flavor: Part I: In porcine meat. J . Sensory Studies 14, 47-65. CHATTERJEE, S. and PRICE, B. 1991. Regression Analysis by Example. John Wiley & Sons, New York. DRANSFIELD, E. ef al. 2000. Home placement testing of lamb conducted in six countries. J. Sensory Studies 15, 421-436. DRAPER, N. and SMITH, H. 1981. Applied Regression Analysis. John Wiley & Sons, New York. FISHKEN, D. 1987. Commercial sensory research - on achieving maturation. J. Sensory Studies 2, 69-73.
30
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
GREENHOFF, K. and MACFIE, H. 1994. Preference mapping in practice. In: Measurement of Food Preferences, Chapter 6, MacFie and Thomson, eds. Blackie Academic & Professional, London. HOUSHMAND, A. and JAVAHERI, A. 1998. Multivariate ridge residual charts. Quality Engineering 10, 617-624. JACKSON, E. 1991. A User's Guide to Principal Components. John Wiley & Sons, New York. LAING, D.G., PRESCOTT, J., BELL, G.A., GILLMORE, R., ALLEN, S. and BEST, D.J. 1994. Responses of Japanese and Australians to sweetness in the context of different foods. J. Sensory Studies 9, 131-155. MOSKOWITZ, H.R. 2002. Mapping in product testing and sensory science: A well lit path or a dark statistical labyrinth? J. Sensory Studies 17, 207-213. NAES, T. and RISVIK, E., eds. 1996. Multivariate Analysis of Data in Sensory Science. Elsevier, Amsterdam. NETER, J., KUTNER, M., NACHTSHEIM, C. and WASSERMAN, W. 1996. Applied Linear Statistical Models. Irwin, Chicago. POPPER, R., HEYMANN, H. and ROSSI, F. 1997. Three multivariate approaches to relating consumer to descriptive data. In:Relating Consumer, Descriptive, and Laboratory Data, Chapter 5 , A. Muiioz, ed. ASTM Manual 30, West Conshohocken, Penn. RAJALAKSHMI, D., DHANARAJ, S.,CHAND, N. and GOVINDARAJAN, V.S. 1987. Descriptive quality analysis of mutton. J. Sensory Studies 2, 93-1 18.
ROHM, H., KOVAC, A. and KNEIFEL, W. 1994. Effects of starter cultures on sensory properties of set-style yoghurt determined by quantitative descriptive analysis. J. Sensory Studies 9, 171-186. SANTA CRUZ, M.J., MARTINEZ' M.C. and HOUGH, G. 2002. Descriptive analysis, consumer clusters and preference mapping of commercial mayonnaise in Argentina. J. Sensory Studies 17, 309-326.
CHAPTER 2 INTERNATIONAL SENSORY SCIENCE HOWARD R. MOSKOWITZ With the growing interest in globalization, sensory scientists have been forced to turn their attention from local issues to international issues. The operational issues involve test design and execution, data analysis, how to report results, and how to implement results at the local level.
Lack of Sophistication - Its Impact on Test Design Owing to the fact that Sensory Science began in earnest in the United States, many novice practitioners are not aware that around the world and especially in developing countries the level of knowledge about Sensory Science is fairly low. Happily, however, with increasing education in Sensory Science worldwide and with the development of sensory networks on the Internet the low level of knowledge is rising, especially among the younger practitioners and the up-and-coming students. A great deal of the problem is due to the lack of an infrastructure for Sensory Science. There are few laboratories, tests must be done out in the field by untrained interviewers, and the quality of data is often lower than one desires. Test execution issues, such as rotation, re-screening of panelists, additional information about the panelists, etc., are often not up to the standards that have been accepted as de rigueur by the more sophisticated practitioners. Despite the lack of sophistication, it is not altogether clear that these data provided by untrained or less well-trained practitioners are as bad as a critic might think. Indeed there appears to be little analysis in the literature of the degree to which sophistication in sensory methods generates higher quality data. One might speculate about the emotional and invidious causes of this criticism, but that would be an unproductive exercise and a fruitless conjecture. The cooperative, multi-laboratory studies run for different products by different research groups show a great deal of variability across laboratories (Profisens 1999) in countries that have well-established sensory research groups. Such variability is accepted by practitioners as reflecting simply the “way things are across panelists and laboratories. ” Yet, such laboratory-to-laboratory variability might be roundly criticized were the data to come from less trained practitioners in developing countries. The point of this argument is that there is no clear correlation between the traininghophistication of the researcher, the up-to-date aspects of the laboratory, and the quality of the data that emerge from the experiment. With the exception of clear flaws in design such as lack of rotation 31
32
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
of products, poor screening or poor product preparation, it appears that sophistication in laboratory procedures may not add much to the data themselves. We encounter echoes of this sophistication/quality debate when we deal with the physical layout of the sensory test facility.
Scale Differences and Issues in International Research Beyond methodology, one of the key areas is whether consumers in different parts of the world react similarly to foods. At the very simplest level this could deal with the use of scales - e.g., do panelists in different countries use the same scales in similar ways? Researchers working across cultures know that the same scale number may mean different things. This cultural difference can become problematic, especially if the research objective is to identify the degree to which panelists in the different countries like or dislike the same food. Panelists living in a country or culture which values politeness and social calmness above all tend to assign high numbers to product acceptability (e.g., Mexico, Philippines). The ratings may yield false positives - viz., that a product is acceptable, when in reality the product is not acceptable. Panelists in a country or culture that tends to assign low numbers to the liking of products (e.g., Sweden, Holland) may yield false negatives - viz., that a product is not acceptable, when in reality the product is acceptable. Practitioners attempt to eliminate this intercultural difference by a variety of stratagems, of greater or lesser ingenuity. One approach eliminates scaling altogether, and relies on paired comparison tests, which conveys little information because both products may be unacceptable and one would never know. Another stratagem uses rules of thumb (e.g., a transformation of the ratings from panelists of various cultures into a common scale, with the nature of the transform a function of the particular culture). Such pust-hoc efforts to adjust the raw data are acceptable, and in the opinion of this author better than the ill-fated and perhaps confusing attempts to use different scales and attributes in a country, depending upon one’s perception of the evaluative abilities of panelists in that particular country. Parenthetically, none of these issues stands by itself alone in splendid isolation - we will encounter the same issues in dealing with adults versus children.
Do Attributes and Scales Translate Across Languages, or Across People And if Not, Then Is There Any Hope?
-
Consumers in different cultures have different languages. Beyond the language differences, however, may lurk more profound differences in the way that the consumers look at the world. A half century ago the linguist B.L. Whorf (1956) described the ability of the Eskimo to differentiate attributes of a culturally relevant stimulus - snow. Whereas the typical American perceives only few gradations in snow, the Eskimo perceives many more. Over the
INTERNATIONAL SENSORY SCIENCE
33
Eskimo’s experience, the gradations in snow have meaning for the daily life, whereas for the typical American gradations in the quality of snow mean relatively little. Cross-cultural studies of descriptive analysis show differences among people in their ability to describe the sensory characteristics of food. A study by the European Sensory Network on coffees shows differences in the descriptive profiles assigned by panelists in the various countries to the same coffee (1996). Indeed, person-to-person differences in the descriptive profiles of the same product has promoted the use of statistical methods to capture these individual differences (e.g., procrustes analysis; Williams et al. 1988). Given this massive variation across people and across experience levels, how then can sensory scientists hope to deal with the cross-cultural differences? The problem is both practical and philosophical. In many ways the problem is similar to that faced by experimental psychologists early in the century who did not believe that the human judge could really scale sensory magnitude. These psychologists let the subject match the test stimulus to one of a set of reference stimuli, varying in physical concentration. All statements about sensory magnitude were then expressed in terms of matching physical concentrations. Sensory magnitudes were not averaged across judges - rather the concentrations that matched a given stimulus (obtained across the panel) were averaged to generate a single matching number reflecting the consensus. Psychologists have names for the rules developed in view of these differences - idiographic (rules developed for an individual) versus nomothetic (rules developed for a population, where all members are assumed to behave reasonably similarly). Does this averaging process work? Even across people there are those who do not (or at least did not) believe in averaging, but accepted the different sensory worlds in which we live. In the 1940s, developers of the Arthur D. Little Inc. Flavor Profile did not permit the averaging of sensory magnitudes and the development of a sensory quality profile representing the mean across people (Caul 1957). Rather, they instituted a discussion of the sensory profile among the different panelists, and accepted only a final consensus profile after the panelists resolved their differences. We see from the early approaches to flavor description an emerging recognition that we may live in different sensory worlds. The solution involves discussion and consensus, a more fuzzy approach than averaging differences, either across people or across cultures. Research today is far more quantitative than ever before. One of the inevitable results of quantification is the desire for summary statistics, especially averages. There is an increasing demand to develop a statistical summary of the attribute profile. This demand, when not properly channeled, can create averages of the same attribute across different cultures where the individuals in the different cultures mean entirely different things by the attribute. The solution to
34
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
the international problem is not easy. It may reside in one or more of the following three activities: (1) Describe all stimuli in terms of reference standards, following the approach espoused by Schutz (1964) for odor description. (2) Ignore the individual differences, and simply average the same terms across countries. (3) Develop a system to translate sensory profiles from one country to a reference sensory profile, e.g., by the method of “reverse engineering,” so that each country’s sensory profile is mapped to a common set of terms. This third solution enables panelists in different countries to use entirely different terms, but the profiles then must be mapped to a common profile, whose numbers can be averaged across panelists. This third solution is difficult, but may eventually be surmounted given the advances in modeling, optimization, and reverse engineering (Moskowitz 1999). Sensory Preference Segmentation and International Sensory Research Individual differences abound in Sensory Science. These differences were pointed out during the first third of the twentieth century by early researchers in taste (Engel 1928), reaffirmed by psychophysicists in the middle part of the century (Ekman and Akesson 1964; Pangborn 1970), and continue to appear today. Up to 20 years ago these individual differences were treated as a secondorder irritant, and perhaps as something that could be resolved by statistics behind the scenes. These statistics were averages to identify the mean, or central tendency, and hypothesis testing to determine whether or not the variation among products exceeded the random variation within a product, e.g., through analysis of variance. As sensory scientists become increasingly adept at multicountry research it should come as no surprise that they continue to find these individual differences to recur. This time, however, the individual differences were more important, and not simply disturbing second order effects that represented noise in an otherwise noise-free picture of the world. The individual differences were signals from nature that something was going on, but what was that underlying “something” which manifested itself in the annoying variability across people? During the past 20 years or so, the concept of preference segmentation has emerged as a more fruitful way by which to understand individual differences and the tremendous variation among cultures. Preference segmentation assumes that there exists in the population fundamental groups of consumers showing similar sensory preferences. There are a limited number of these groups. These preference segments can be likened to fundamental colors (red, blue, yellow), from whose mixture all colors emerge. In a similar fashion, these preference
INTERNATIONAL SENSORY SCIENCE
35
segments exist in all countries. Differences across country in preference patterns are assumed to relate to the differential proportion of these segments. That is, in one country Segment A may predominate, whereas in another country Segment B may predominate, and so forth. The key differences today versus 30 years ago are the appreciation of these individual differences and the practical next steps taken in light of these differences. The current applications revolve around the creation of new products to appeal to these segments. For example, if the manufacturer knows that there exist two key segments in a juice product, then it makes more sense for the manufacturer to create products targeted to these two segments rather than attempting to create a juice product that appeals only modestly to both segments simultaneously. Separate, targeted development will create two high scoring products that have a greater chance for market success. Whether or not these fundamental segments really exist or whether they simply represent a convenient analytical tool by which to summarize individual differences remains for further work. There are clear preference segments for coffee (Moskowitz 1985), for juice (Moskowitz and Krieger 1998), for meat (Moskowitz and Barash 2000). for fragrance (Moskowitz 1986), etc. The segments emerge from simple algorithms presented previously (Moskowitz el al. 1985). The segmentation method generates curves showing different dynamics of the relation between sensory attribute level and liking. Figure 2.1 shows how the amount of particulates drives liking in juice for various countries (left panel), and for two sensory segments that span these countries (right panel). The segmentation method has been also used for concept work as well, and shows that there exist basic preference segments for communication. Interestingly, the sensory preference segments based upon the sensory characteristics of products do not necessarily match the concept communication segments based upon responses to different concepts (Moskowitz 1996).
Research And Business Opportunities Afforded By Global Sensory Segmentation At first blush the existence of global sensory segments appears to be an interesting research topic, and relevant for quite a number of specific product categories. What may be more interesting, however, is the possibility for knowledge and business building that the segmentation affords. From the viewpoint of knowledge development, there are studies of specific product categories showing the existence of such sensory segments in different products. The published scientific literature neither confirms nor denies the possibility that there may be a limited number of such sensory preference segments, transcending product categories. That is, if there are high-impact and low-impact seekers in a product (e.g., in pasta sauce), then do these sensory preference segments
36
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
also emerge for another product category (e.g., carbonated beverage)? Furthermore, do individuals falling into the high-impact segment for pasta sauce also fall into the high-impact segment for carbonated beverages, or does a person's segment membership vary by product category? To the degree that the researcher can identify regularities in a single individual's membership in sensory segments across different product categories, the researcher will have uncovered a new way to classify individuals that has both scientific and business import.
...
-
. . .....
m
.
.
.
, "
. .
. 1
.
. .
. .
1
, .
. .
, (
,
,
1
Amount of Particuiates FIG. 2.1. HOW THE AMOUNT OF PARTICULATES (PIECES) IN JUICE DRIVE OVERALL LIKING The left panel shows the relation for three European countries. The right panel shows the relation for two sensory segments - high impact (H) and low impact (L). [Data from Moskowitz and Krieger 19981.
REFERENCES CAUL, J.F. 1957. The profile method of flavor analysis, Advances In Food Research, 1-40. EKMAN, G. and AKESSON, C.A. 1964. Saltiness, Sweetness and Preference. A Study of Quantitative Relations in Individual Subjects. Report 177, Psychology Laboratories, University of Stockholm. ENGEL, R. 1928. Experimentelle Untersuchungen Uber die Abhangigheit der Lust und Unlust Von der Reizstarke beim Geschmacksinn. Pfluegers Archiv fur die Gesamte Physiologie 64, 1-36.
INTERNATIONAL SENSORY SCIENCE
37
EUROPEAN SENSORY NETWORK, 1996. A European Sensory and Consumer Study: A Case Study on Coffee. Published by the European Sensory Network. Available from Campden and Chorleywood Food Research Association, Chipping Campden, England. MOSKOWITZ, H.R. 1985. New Directions In Product Testing And Sensory Evaluation Of Foods. Food and Nutrition Press, Trumbull, Conn. MOSKOWITZ, H.R. 1986. Sensory segmentation of fragrance preferences. J. The Society Of Cosmetic Chemistry 37, 233-247. MOSKOWITZ, H.R. 1996. Segmenting consumers world-wide: An application of multiple media conjoint methods. Proceedings of the 49th ESOMAR Congress, Istanbul, 535-552. MOSKOWITZ, H.R. 1999. Inter-relating Data Sets for Product Development: The Reverse Engineering Approach. Food Quality and Preference 11, 105-1 19. MOSKOWITZ, H.R. and BARASH, J. 2000. Sensory Segmentation - Using All Attributes Vs Using Specific Sensory Attributes: A Methodological Note. Unpublished Manuscript. MOSKOWITZ, H.R., JACOBS, B.E. and LAZAR, N. 1985. Product response segmentation and the analysis of individual differences in liking. J. Food Quality 8, 168-191. MOSKOWITZ, H.R. and KRIEGER, B. 1998. International Product Optimization: A Case History. Food Quality and Preference 9, 443-454. PANGBORN, R.M. 1970. Individual variations in affective responses to taste stimuli. Psychonomic Science 21, 125- 128. PROFISENS, 1999. Profisens Newsletter #2. Campden and Chorleywood Food Research Association, Chipping Camden, England. SCHUTZ, H.G. 1964. A Matching Standards Method for Characterizing Odor Quality. Annals of the New York Academy of Sciences, 116, 517-526. WHORF, B. L. 1956. Language, Thought and Reality, J.B. Carroll, ed. M.I.T. Press, Cambridge, Mass. WILLIAMS, A.A., ROGERS, C.A. and COLLINS, A.J. 1988. Relating chemical/physical and sensory data in food acceptance studies. Food Quality and Preference 1. 25-3 1.
ALEJANDRA M. m O Z Sensory professionals, who in the past worked locally and developed themselves and their groups only in their country, now have an opportunity to be involved in the international developments of the field and their companies. As a result, there has been a greater involvement of Sensory Science in the international arena in the last decade (Stone and Side1 1995; Karahadian 1995),
38
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
because of five trends: (1) transnational collaboration: the need to assist international affiliates in the development of sensory programs, the development and application of new methods, the completion of training programs and the execution of local internal consumer projects, respectively; (2) execution of Cross Cultural Consumer Studies: to address the need to develop and apply product evaluation techniques globally in order to respond to the industry’s needs for testing products abroad (Wimberley 1991); (3) the need to understand global consumer responses, their differences and similarities (Rozin 1982); (4) the need to achieve the harmonization of methods and techniques globally; and the extensive collaboration taking place among sensory professionals around the world. A brief review of these trends follows. Transnational Collaboration Transnational companies have always been involved in cross-country collaborations. However, this collaboration has increased in the past years because of industry’s drive to develop existing categories in international markets, to introduce their products in these different markets, etc. The interaction among professionals in transnational companies occurs at two levels: the development, testing, and marketing of the company’s product internationally, and the improvement and/or establishment of technology and methodology at international locations/affiliates. The sensory professional working for such companies becomes involved at both levels. The sensory professional participates in the development, testing, and marketing of the company’s product internationally by his/her involvement in the design and execution of cross cultural consumer tests. In these projects, the sensory professional works either with the local affiliate or with vendors as described above. Sensory professionals also have an important role in the improvement/ development of programs at the company’s international locations/affiliates. Foreign sensory colleagues may not have courses or consultants in their country to help develop their technology and methodology. The sensory professionals from developed countries may be asked to assist in the development/implementation of a sensory program in other countries. They then have the opportunity to set up full sensory programs, train staff and establish components of a sensory program (descriptive, consumer, etc.) which will provide sensory evaluation support in that country. In addition, sensory professionals in developed countries are often regarded as consultants by company affiliates and are used to assist in specific training, testing and sensory consultation conducted abroad.
INTERNATIONAL SENSORY SCIENCE
39
Cross Cultural Sensory Consumer Studies As the companies for whom we work expand their business and interests into other countries (Wimberley 1991), sensory professionals have to be involved in the execution of cross cultural consumer studies (McEwan 1998; Janto ef al. 1998). This activity involves the close collaboration with colleagues and professionals from these countries, who are unfamiliar with those countries and cultures. To complete these cross cultural consumer studies, sensory professionals may follow one of three strategies:
Complete the study (studies) themselves, and work with the foreign company’s affiliate in the project. The sensory professional usually takes care of the test design, whereas the local affiliate most often takes care of the execution of the test, and the adaptation of the test to local conditions. This is the best form of collaboration, since the project is conducted inhouse, involves a company’s resources, allows exchange of ideas and learning, and promotes the effective execution of the testlproject. Complete the study (studies) themselves and work with a local vendor in the project. The sensory professional has to take care of most of the details of the test and work closely with the vendor to assure the proper execution of the test. Unless there has been a previous collaboration, the sensory professional needs to be involved in all details of the test, including sample shipment and tracking, sample acquisition and screening, shipment/ acquisition of materials, translation and pilot testing of the questionnaire, progress of consumer recruitment, pilot test, data collection, review of data, data analysis, etc. It behooves the sensory professional, (particularly if there has not been previous collaboration with that vendor) to travel to the test site in order to oversee the test execution. When testing is conducted with a new vendor the first time, the sensory professional has to invest a considerable amount of his/her time in the study. Once a relationship has been established with a vendor and there is confidence in the quality of the work, ensuing projects can be completed without the close involvement of the sensory professional. Hire an international consulting firm or vendor that can be involved in the details of the test execution without the close involvement of the sensory professional. This option works well when the sensory professional does not have extensive experience in cross cultural consumer studies, does not have the resources to invest in the administration or monitoring of the test, or when more than one country/culture is tested. The consulting firm or
40
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
international vendor should be experienced in cross cultural consumer research and be able to locate or have collaboration with local vendor(s) in the countries of interest. Six of the challenges sensory professionals face in cross cultural consumer studies are listed below: (1) The design of a test for another culture unfamiliar to the researcher. This involves the knowledge of cultural and etiquette differences, as well as customs and cultural nuances (Rohner 1984). Since each culture is unique, the administration of such tests may involve the potential modification of methods and protocols used in our countries to adapt them to the different cultures (Whiting 1968).
(2) The design of a questionnaire used for another culture, which involves the use of the appropriate attributes (translation or selection of the appropriate terms), scales and directions. This is the most critical aspect of the design of the cross cultural consumer test, since it determines the quality of the data obtained. It is imperative that the sensory professional work with someone from that country/culture in this effort. Attributes may not have a direct translation in that language. Different attributedwords need to be discussed and assessed to select the most appropriate. In addition, modified scales may have to be used, in order to adapt them to the culture (e.g., shorter scales, fewer anchors, different end and midpoint anchors). It is imperative that the actual questionnaire be translated back to the original language and pilot tested in order to ensure that the questionnaire properly addresses all issues of interest.
(3) The acquisition and screening of local products. The sensory professional needs to screen all products obtained in other countries. This screening can be conducted relatively easily when at the test country. If not in the country, the sensory professional has to request samples to be shipped for screening prior to testing. (4) The production, acquisition and shipping of products to the test country. This activity needs to address formula differences, product uniformity, logistics of shipping, customs, local transportation and product storage. ( 5 ) The recruitment of consumers, which may be complicated in some countries
due to the infrastructure, and the vagaries of local customs.
INTERNATIONAL SENSORY SCIENCE
41
(6) The execution of the test, which involves the use of the specially designed questionnaire, test protocol and logistics. Currently the ASTM El8 task group E18.03.06 is working on a manual addressing methods and issues involved in cross cultural consumer research (ASTM 2003). Details of some of the issues discussed in this section are covered in the manual. In addition, for certain specific cultures, the manual documents general information on that country and culture, local consumer testing approaches, and special issues. Generally speaking, sensory professionals should welcome the opportunity to be involved in cross cultural consumer studies. It provides visibility within the organization, the chance to interact with different functions within the organization (Marketing, Marketing Research, Product Development, Packaging, QC, Legal, etc.), to be involved in technical and business decisions regarding the company’s international involvement, and to interact with international colleagues in the design and execution of the projects. Global Consumer Responses With its increasingly global view, the field of Sensory Science is involved in the study of consumer responses worldwide. This involvement is occurring at two levels. Industry. Transnational companies that develop and market products worldwide are interested in the understanding of the consumer wants and needs across cultures (Vijver and Poortinga 1982; Guendelman and Abrams 1995; Moskowitz and Krieger 1998; Nielsen ef al. 1998). The following questions are asked for a given product category. Are there any common consumer wants and needs across cultures? What are the common consumer likes and dislikes? Do consumers from different cultures use the same terms to describe benefits, wants and needs? What are the terms that differ? Which cultures like the same product/formulae? How does a product/formulae have to be changed to adapt it to local conditions? Transnational companies conduct worldwide studies in order to address these important issues and to create a data-base for the improvement and development of products worldwide. Sensory professionals have an opportunity
42
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
to participate in these studies by offering their expertise in test design and administration, and data analysis.
Research. Sensory professionals are not only interested in understanding cross cultural consumer differences and similarities in products but also in methodology. How should consumer methodology be modified across different cultures (Berry 1979; Whiting 1968; Ye et al. 1998), if at all? Questions in this area include: How should the standard hedonic scales be modified for different cultures? Why? Which diagnostidintensity scales should be used for different cultures? Can diagnostidintensity questions be asked for different cultures? How appropriate is the JAR (just about right) scale for other cultures? How should it be structured? What kind of information is obtained? What is the best way to present stimuli/samples? Are there any unique issues involved for some cultures? Research in this area is needed to fully understand these issues. Answers to these questionshssues are needed and the dissemination of such information is occurring at an increasing rate with the publication of papers that address cross-cultural consumer research studies (Sobal 1998; Prescott 1998; Ye et al. 1998; Moskowitz and Krieger 1998; Nielsen 1998). More interest in this area will be generated as the globalization of methods continues.
Harmonization of Methods Frequently, the affiliates in an international company develop and practice different sensory and consumer testing approaches. The sensorykonsumer science group in one country may be testing products following a very different approach, compared to other groups worldwide. Additionally, local groups tend to support the methods used in their countryhesearch facility, and may be reluctant to consider the benefits of other techniques used by other international company affiliates. When some of the affiliates support and use different methodology, several problems may arise, such as: the inability to compare test results across countries/cultures, added difficulty in the interpretation and use of research or study findings by all international affiliates, friction in the planning and execution of global studies because of the different beliefs and methods used across groups, and
INTERNATIONAL SENSORY SCIENCE
43
friction among international groups in the efforts to harmonize test methods and techniques. Therefore, it is recommended that a common philosophy be selected, and that methods across international affiliates be harmonized. In many cases, this may not be an easy task. Often, groups cannot reach agreements in this area, if completely different approaches and philosophies are followed. Consultants or academicians are often involved in this task to facilitate the dialogue among groups and achieve: the unbiased assessment of the advantages and limitations of the different approaches, the selection of the most suitable methodology for that international company, and the harmonization of methods and techniques across international groups.
Many international corporations are organizing sensory/consumer science international meetings to review the company’s resources, methods and approaches, and to discus topics of interests. Oftentimes this is the ideal setting to review and harmonize approaches.
International Collaboration The interaction, exchange of ideas and collaboration among sensory scientists around the world has been occurring for the past two decades, and will grow as the interest in international research and issues continues. This interaction and collaboration takes place in several areas: the design, execution and publication of sensory (analytical and consumer studies), research studies (Sobal 1998; Prescott 1998; Ye ef al. 1998; Moskowitz and Krieger 1998; Nielsen 1998), the design of workshops and seminars involving sensory professionals from different countries, and the planning of and the attendance to all the international sensory (and/or food and ingredients) seminars, symposia and meetings (Pangborn Sensory Science Symposia, IS0 and ASTM International meetings, Sensometrics meeting, World Congresses of Food Science and Technology, International Congress of Meat Science and Technology, AOAC International Meeting and Exposition, IDF World Dairy Congress). Even though there continues to be local sensory courses and meetings in each country, the main symposia, meetings and seminars in Sensory Science are truly international events. In these events speakers and attendees are represented from all over the world, allowing the learning and exchange of ideas among sensory researchers worldwide. Examples of these international events include the Pangborn Sensory Science Symposium, the Sensometrics meeting, and the
44
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Iberoamerican Sensory Symposium (SENSIBER organized by RIEPSA - Red Iberomericana de Evaluaci6n de Propiedades Sensoriales de 10s Alimentos). REFERENCES ASTM. 2003. Cross Cultural Consumer Research Manual, A. Muiioz and S. King, eds. In preparation. ASTM, West Conshohocken, Penn. BERRY, J. W. 1979. Research In Multicultural Societies: Implications For Cross-Cultural Methods. J. Cross Cultural Psychology 10(4), 415-434. GUENDELMAN, S. and ABRAMS, B. 1995. Dietary intake among MexicanAmerican women: Generational differences and a comparison with White non-Hispanic women. American Journal of Public Health 83, 20-25. JANTO, M., PIPATSATTAYANUWONG, S., KRUK, M.W., HOU, C. and MCDANIEL, M.R. 1998. Developing noodles from 135 wheat varieties for the Far East market: Sensory perspective. Food Quality and Preference 9(6), 403-412.
KARAHADIAN, C. 1995. Impact of global markets on sensory testing programs. Food Technology 9(2), 77-78. McEWAN, J. 1998. Harmonizing Sensory Evaluation Internationally. Food Technology 52(4), 52-56. MOSKOWITZ, H. and KRIEGER, B. 1998. International product optimization: A case history. Food Quality and Preference 9(6), 443-454. NIELSEN, N.A., BECH-LARSEN, T. and GRUNERT, K.G. 1998. Consumer purchase motives and product perceptions: A laddering study on vegetable oil in three countries. Food Quality and Preferences 9(6), 455-466. PRESCOTT, J. 1998. Comparison of taste perceptions and preferences of Japanese and Australian consumers: overview and implications for crosscultural sensory research. Food Quality and Preference 9(6), 393-402. ROHNER, R.P. 1984. Toward a conception of culture for cross-cultural psychology. J. Cross-cultural Psychology 15(2), 111-138. ROZIN, P. and CINES, B.M. 1982. Ethnic differences in coffee use and attitudes to coffee. Ecology of Food and Nutrition 12, 79-88. SOBAL, J. 1998. Cultural comparison research designs in food, eating and nutrition. Food Quality and Preference 9(6), 385-392. STONE H. and SIDEL J. 1995. Strategic applications for sensory evaluation in a global market. Food Technology 49(2), 80-88. VIJVER, F. and POORTINA, Y.H. 1982. Cross-cultural generalizations and universality. J. Cross-Cultural Psychology 13(4), 387-408. WHITING, J.W.M. 1968. Methods and problems in cross-cultural research. In: Handbook of Social Psychology, G. Lindsey and E. Aronson, eds., Chapter 17. Addison-Wesley, Reading, Mass.
INTERNATIONAL SENSORY SCIENCE
45
WIMBERLEY, D. 1991. Transnational corporate investment and food consumption in the third world: a cross national analysis. Rural Sociology 56(3), 406-43 1. YE, L.L., KIM, K.O., CHOMPREEDA, P.,RIMKEEREE, H . , YAU, N.J.N. and LUNDAHL, D.S. 1998. Comparison in use of the 9-point Hedonic scale between Americans, Chinese, Koreans, and Thai. Food Quality and Preference 9(6), 413-420.
MAXIM0 C. GACULA, JR. In Chap. 1, it was noted that Sensory Science will become global both in theory and applications. The lack of sophistication stated by Moskowitz in that chapter should disappear at the end of the decade. It is predicted that the level of sophistication will follow a linear curve and then plateau (Fig. 2.2). This prediction is based on the assumption that publication of sensory work in a scientific journal authored by research scientists from other countries is a good indicator of sensory globalization. The plot in Fig. 2.2 shows that about 50% of the articles published in 1999 were multi-natic.; 1. From my perspective, this assumption is most likely true. We have witn1;ssed in the past that published scientific information generally follows its industrial application. Foreign articles (non-USA) published in the Journal of Sensory Studies have come from England, UK, Spain, Argentina, Canada, Italy, France, Australia, New Zealand, Taiwan, Philippines, India, and others; indeed an evidence of sensory globalization. However, it should be noted as indicated by Moskowitz the problem of translation of sensory theory and practices to other countries still remains. From my viewpoint, sensory intensity measures can be directly translated to other cultures, but not hedonic measures; even within a population, there is segmentation in hedonic expression. Moskowitz stated the problem of scaling differences by different cultures. Again, it should not be a problem for intensity measures, especially in the presence of control/reference standard. The key problem in transnational research lies in the hedonic scale (like/dislike). Note that there is no wrong answer for hedonic responses. As such it should be applicable only to a particular country or culture and this should be a guiding principle in sensory globalization. Because of this, we cannot develop a robust product in the spirit of Total Quality that will perform effectively in other countries. Furthermore, we can no longer directly compare hedonic averages from country to country, although we may use a transformed hedonic response to compare results from different countries.
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
46
FIG. 2.2. PERCENTAGE OF FOREIGN ARTICLES PUBLISHED IN THE JOURNAL OF SENSORY STUDIES BETWEEN 1986 AND 1999
One transformation of hedonic responses uses deviation of panelist scores from the grand mean. The expression is:
where Di is the transformed score expressed as a deviation from the grand mean, Yi is the individual panelist score, and M is the grand mean. By this transformation, we remove the individual differences in the way the panelist used the scale. One can further transform the score by dividing the above formula by the standard deviation of the respective population (country, locations within a country),
D,, =
(Yijk
- M.jk)/ S,,
i = 1, 2, j =1, 2, k =1, 2,
..., nth panelist ..., cth country ..., Ith location
with mean of Dijk= 0,being a normalized value. The second formula is more powerful because it further standardizes the score by adjusting it with the variability within country and location. The
INTERNATIONAL SENSORY SCIENCE
47
statistical analysis uses the Di or D,, as the observations for comparing hedonic responses among products or stimuli. The disadvantage of transformation is that we lose the directness that emerges from seeing actual average in relation to the points on the rating scale. However, the scaling of differences among products with the transformed scale will be more reliable. If we want to retain the original scale, then there is a statistical procedure used extensively in statistical genetics, i.e, animal breeding. This is the so-called method of least-squares (Harvey 1960; Damon and Harvey 1987). Basically, the known effects are modeled and estimated. The estimated effects called the leastsquares constant can be used to adjust the observations for country and location effects. Suppose we have the model,
Y,,
=
M
+ Pi + C, + h + E,,
where
Yij, = the observed hedonic score of the ith product, jth country, and kth test location, M = overall mean across products, countries, and test locations, Pi = effect of the ith product, C, = effect of the jth country, = effect of the kth test locations within countries, E,, = random error. The least-squares constant derived from the above model, can be used to adjust the hedonic score Y,, due to country and location. The adjustment formula is Adjusted Y,,
= Y,,
- Cj - & = Y,,
- (Cj
+ L,J
Here, Cj = least-squares constant for the jth country and h = least-squares constant for the kth location. The adjusted Yv, is now in its original rating scale form but adjusted for country and test location effects. As before with D,, the adjusted Y,, is used as the observations in the statistical analysis for product comparisons. The statistical model is now reduced to,
Yij = M
+ Pi + E,
i = 1, 2, j = 1, 2,
..., kth products ..., nth panelists
and results in one-way analysis of variance for comparing products. The above methods, particularly the adjusted Y,,, have not been fully explored for use in Sensory Science and product testing. At the present time
48
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
with readily available computing system, the various adjustment procedures given above can be easily studied and implemented. Ms. Muiioz’s detailed presentation of methods, problems, and questions should provide information/guidance in the search and development of world sensory principles. Only when these topics are adequately answered that acceptable principles can be developed and used with confidence. It is suggested that companies contemplating international Sensory Science and product testing should consult Muiioz’s viewpoints as guide in making appropriate choices. REFERENCES *DAMON JR., R. and HARVEY, W. 1987. Experimental Design, ANOVA, and Regression. Harper and Row, New York. HARVEY, W. 1960. Least-squares analysis of data with unequal subclass numbers. USDA, ARS 20-8.
* MCG acknowledges his learning of least-squares analysis from Dr. Richard Damon Jr., his mentor in his graduate school days.
CHAPTER 3 SENSORY MYTHOLOGY HOWARD R. MOSKOWITZ Sensory Science evolved into a discipline of “what to do” before it developed a corpus of information with intellectual content. As an unfortunate consequence, Sensory Science comes to its professionals and students alike replete with, or even perhaps burdened with mythology, beliefs, arguments about what is the correct procedure, what is questionable, and of course what is absolutely wrong, etc. A lot of the mythology has never really been recorded but is vehemently reiterated at meetings, especially by the older generation of practitioners. Furthermore, much of what is believed never has actually appeared in the scientific literature, or has never been substantiated by data. At one level these are amusing myths. At another level they are dicta that have hindered the intellectual development of the field to the extent it could have developed. Herewith follow four choice myths. They delight the critic, perplex the novice, reaffirm the dogmatist, and madden the iconoclast. They persist.
Myth #1 - The Consumer Cannot Evaluate More Than Two Products Without Losing Semitivity It is not clear where or how this sensory myth arose, because everyday experience and the science of psychophysics certainly show that the typical consumer can and does discriminate quite easily among a set of similar products (see Marks 1974). The scientific literature in psychophysics and Sensory Science certainly cannot have given rise to this myth because panelists in both fields have been shown to validly rate the sensory magnitude of many different stimuli under relatively short time frames, and without extensive training. Studies involving compound taste stimuli, e.g., pairwise and higher order mixtures (Moskowitz 1971; Moskowitz and Klannan 1975; Moskowitz ef al. 1978), odorants (Berglund ef al. 1971) and foods (Moskowitz 1977) show clearly that panelists can and do track the physical magnitude of the stimulus through their rating of intensity. The myth possibly may have come from studies where the panelist task was to discriminate between pairs of stimuli, rather than to rate these stimuli on a scale. With N stimuli there are N(N-1)/2 pairs to assess. When N is small (e.g., 4), then this task of implicit comparison produces a manageable set of pairs. For example, with N=4 there are 6 combinations of 2 items each, or 12 items to be tasted. That is a lot, but still manageable. When N is large, then the number of 49
50
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
pairs of stimuli increases rapidly, making the task infeasible. When N is large (e.g., lo), this produces an unmanageable set of pairs (for N=lO there are 45 pairs or 90 items to be tasted). Asking the panelist to rate the items, one at a time rather than to compare the items results in a more manageable task. Another source for this myth is the use of off-hand comments offered in corporate kitchens, by the participants in “product cuttings” or “tastings, ” “showings,” or whatever the corporate term is for an R&D presentation. A cutting involves the informal evaluation of a number of products, usually prototypes but often competitors. The cutting does not demand scientific rigor. Rather, in the corporation the project team sits around or more often stands around the kitchen counter in the laboratory, opening the samples, inspecting them, and then tasting them. A cutting may appear to begin in an orderly fashion, with the sensory scientist laying out the different samples in a specified order, e.g., to show specific sensory gradations among the products. The sensory scientist then suggests an order of evaluation, and a set of criteria on which to evaluate. The cutting may involve simply the experience of the product, or may be somewhat more formal, with rating sheets. What starts out orderly quickly degenerates, especially when the cutting comprises technical participants along with marketers. The order evolves to chaos as different individuals in the cutting try a product, then another product, and finally return to the first product in order to better understand the differences among the samples. The chaos leads to comments by the participants that they don’t remember the product that they just tasted, that they feel that they are losing their sensitivity, and that they don’t remember much about the first product in the set. These complaints should come as no surprise since the participants in the cutting do not or cannot wait between samples, have to be reminded to rinse between samples, and try vainly to keep all of the sensory information in memory. The cutting becomes a “blooming, buzzing confusion,” in the apt, appropriate words of William James. As a consequence they feel that they cannot cope with this sensory overload and complain that they cannot do the task. The knowledgeable researcher attending a cutting, aware of these problems, often changes the procedure so that the panelist writes down the ratings. In this way the researcher more closely simulates what happens in an actual test. Occasionally the corporate participants in the cutting feel uncomfortable with this level of control but they never appear to complain that under this regimen that they have lost their sensitivity.
Myth #2 - Good Sensory Science is Best Done Under Rigidly Controlled Conditions, Where Panelists are Isolated From Each Other Sixty years ago few facilities featured “state of the art” equipment. Then, at some point, it was decided by persons today unknown that the proper
SENSORY MYTHOLOGY
51
evaluation of food could only be done in isolated booths, where panelists could not see each other. A lot of these booths, well-isolated, equipped with the proper lighting, with spittoons, etc., began to appear in the 1960s and 1970s. Researchers in Sensory Science took public pride in these physical facilities because the facilities offered the best in environmental control. Now it is true that the studies should be controlled for the best results. It is also necessary that the panelists should have a place to expectorate the food if they are not to swallow an unduly large amount of the test stimulus. For odor/flavor/fragrance work it is also important to evacuate the local environment, continually replacing the odorized air with fresh air. Finally, it is important to control the ambient light. This will help to simulate indoor or outdoor conditions, or to mask the product color without blindfolding the panelist. What is mythological, and patently untrue, however, is that the booths must be white, must be isolated, and that the best Sensory Science only emerges in this environment. Perhaps the isolation booth is acceptable for a 15- or 20minute test, where the panelist evaluates a few products. In many of the author’s studies, a panelist is recruited for three hours, during which time the panelist may evaluate 10 or 15 products. In such test conditions it is vital to provide an environment that is both controlled so that panelists do not speak to each other, nor see what each other has written. It is necessary to make the environment ‘livable’ so that panelists can enjoy the experience, not dread the isolation. One way to accomplish this dual objective creates a different testing space comprising tables and computers for data acquisition, arranged so that panelists can see each other. This arrangement makes it hard for them to talk to each other, and impossible for them to see what the other panelists have answered on paper or on the computer. This physical arrangement has already been developed, and works by spacing the panelist “work tables” at angles to each other, so that there is no feeling of isolation, but yet there is control.
Myth #3 - Only Experts Can Validly Assess the Sensory Characteristics of Foods, and as a Corollary the Consumer’s Sole Task Should Be To Rate Degree of Liking This is a particularly pernicious and widely held myth, albeit a myth that has no substantiation in the scientific literature. We can trace this myth back to a couple of sources, some in the academic research community, some in the business practitioner community. Some of the origins are based on scientific data, others in the desire to perpetuate a specific practice for possibly less than noble reasons. Academic research, especially in psychophysics, and tracing back more than a century ago to Fechner, began with the assumption that people could not
52
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
validly act as measuring instruments for sensory intensity (Fechner 1860). This is the so-called “direct approach,” which was rejected for more than threequarters of a century in favor of indirect measurement,,, Indirect measurement presents the panelists with two stimuli and determines the degree to which these two stimuli are confused with each other, or the degree to which, in a population, one stimulus is preferred to another. The analysis then takes the confusion or preference data, processes the variability, and estimates scale values associated with the stimuli, with the property that the more two products are confused (or the more that they are equally preferred) the closer these two stimuli lie on the underlying scale. Fechner himself, the founder of psychophysics, believed that panelists could not validly judge intensity, and instead relied upon adding together units of “discrimination” or just noticeable differences (JND’s) in order to erect the psychophysical scale of magnitude. L.L. Thurstone (1927) developed a set of mathematic transformations to deal with this type of confusion data, expanding the approach of indirect measurement even further. Beliefs about the limitation of a panelist to attend to multiple attributes of the stimulus also helped to propagate the myth. The psychophysicist did not make any pronouncements about the ability of panelists to rate intensity, and indeed the entire foundation of direct scaling is based upon the assumption that panelists can and do judge intensity in a reproducible fashion that can be shown to exhibit properties of a valid scale. Typically, academic researchers involved in direct scaling instructed panelists to rate only one particular aspect of the stimulus, e.g., the loudness of the sound. Rarely in psychophysics laboratories of 40 to 50 years ago did the researcher instruct the panelist to rate multiple attributes of the same stimulus, in the same session, at the same time. S.S. Stevens, the founder of modem day psychophysics, held a firm, publicly stated conviction that panelists could not easily shift from attribute to attribute in an evaluation task. Consequently the prudent researcher should have the panelist concentrate only on one particular attribute (Stevens 1968). In early scaling work on sweetness and pleasantness of sugars and artificial sweeteners, Moskowitz (1971) and Moskowitz and Klarman (1975) set up the study so that panelists participated in two sessions. In one session the panelist would rate the perceived sweetness of the sugar, and in the other session the panelist would rate liking. Psychophysicists working with taste stimuli that provoke multiple qualities (sweet, salty, sour, bitter; Bartoshuk 1975) would break out of this stereotyped, limiting paradigm, and encourage the panelists to directly scale the degree of each quality in the taste stimulus. These panelists were relatively untrained, but appeared to experience no problem shifting their attention to the different qualities of the taste stimulus. The author himself eventually broke out of the shackles of the uni-attribute scaling when the results from Bartoshuk’s studies were shown to be reliable and useful.
SENSORY MYTHOLOGY
53
The business end of Sensory Science and taste also contributed to this myth. The 1950s - 1970s saw a resurgent interest in the descriptive analysis of sensory characteristics. It was with some of these systems that the myth began that consumers could not validly assess the sensory attributes of products, despite mounting evidence from the scientific literature. The Flavor Profile (Cairncross and Sjostrom 1950), the QDA (Stone and Side1 1986) and the Spectrum (Meilgaard et al. 1987) methods all entailed extensive training. The training was critical for panelists to understand the meaning of specific, hard-to-understand attributes, and to agree upon the ostensive meaning of these attributes through the use of reference standards. All was well and good at that point, since indeed many attributes are unusual, and not clear without explanation. Problems arose when the science of descriptive analysis turned into the very profitable business of descriptive analysis. At this point a great deal of the scientific inquiry was squelched, and met with blanket statements about the inability of the consumer to validly scale the perceived intensity of sensory attributes. Whether or not experts really perform better never seems to have been established in the literature. Nor, in fact, has there been any clear formulation of the criteria on which the experts are supposed to perform better. Are the experts more sensitive to the same stimulus differences? Do they have a better vocabulary? Are they more consistent? Comparisons of consumers and experts on many attributes suggest that when both groups are asked to scale a common set of stimuli their ratings correlate with each other, as long as the consumers understand the meaning of the attribute. Examples were published twenty years ago in texture (Moskowitz er al. 1979) and more recently in flavor (Moskowitz 1996). Discussions about this topic now and again appear on the Internet, in the Sensory E-Groups hosted by Yahoo. The different points of view, proffered by academics and practitioners alike, can be seen by looking at the archives of the Sensory E-Groups for the years 2001 and 2002, respectively.
Myth #4 - Statistics Are the Essence of Good Sensory Research (or ... “If You Don’t Know the Latest Statistical Fad, You Really Should Not Call Yourself a Professional”) This is a potentially damaging myth, partly because the consequence of abandoning statistics will probably plunge Sensory Science right back into the dark ages. Yet, the myth has to be addressed, if only because over the past 30 years statistical knowledge has often been equated with professional competence in Sensory Science. That is, a person who was not familiar with the latest, au courant statistical methods (whether these be from mapping, modeling, signal detection theory, inferential statistics) was also thought not to beau coumnt with the latest sensory thinking.
54
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Although this author is a big fan of statistics, especially the new statistics for data exploration and data representation (Moskowitz 1994), all too often practitioners in the field have used arcane statistics in order to amass power and prestige. Arcane statistical treatments of data, challenging the researcher to pull out as much variability as possible in analysis of variance using statistical modeling and multi-dimensional representation of data, often cloud the subject being analyzed. All too often good solid thinking is sacrificed in the name of the newest statistical procedure, as if the practitioner cannot think through the problem without the esoteric approaches. Yet, let the reader attend a meeting of sensory researchers and listen to papers, and the reader will also come to realize that a lot of the statistical analysis hides perfectly simple, often prosaic thinking, or worse, no thinking at all. Having the latest multidimensional scaling tools at one’s fingertips does not necessarily mean that the data are amenable to this treatment, or that nature will yield up her secrets if the techniques are applied to the particular data set. One unfortunate and probably unanticipated outcome may be that the worship of statistical tools and new era statistical methods may paralyze the process of critically thinking through the problem, rather than aiding the process of obtaining valuable insight.
The Comfort of Myth Why these myths? Why do sensory scientists continue to accept mythology about consumer performance and the “right way of doing things”? One of the reasons may be that myths comfort, give structure to an unstructured, frightening world. If the sensory scientist is not well-educated, as has been the case for so long, then myths ground the analyst. They give a comforting directive about what to do. They reduce the uncertainty by providing a false set of requirements. The sensory scientist, caught up in accepting mythology, need not question, need not think, and need not worry. Myth prescribes behavior, and in that behavior the novice sensory scientist feels that he is doing the “right thing. Furthermore, myth creates a community. It can become lonely when one questions and strikes out on one’s own. A community of collegial professionals, working with the same mythology, enables the novice to enter the brotherhood (or sisterhood). Myth thus becomes the cost of entry and a key to membership in the “fraternity.“ By subscribing to the myths of Sensory Science anyone can become a full member, because the analyst is simply adopting the mores of the desired group.
SENSORY MYTHOLOGY
55
REFERENCES BARTOSHUK, L.M. 1975. Taste mixtures: Is mixture suppression related to compression? Physiology and Behavior 24, 3 10-325. BERGLUND, B., BERGLUND, U.. EKMAN, G. and ENGEN, T. 1971. Individual psychophysical functions for 28 odorants. Perception and Psychophysics 9, 379-384. CAIRNCROSS, S.E. and SJOSTROM, L.B. 1950. Flavor Profiles - A New Approach to Flavor Problems. Food Technol. 4, 308-3 11. FECHNER, G.T. 1860. Elemente der Psychophysik. Breitkopf und Hartel, Leipzig. MARKS, L.E. 1974. Sensory Processes: The New Psychophysics. Academic Press, San Diego. MEILGAARD, M., CIVILLE, G.V. and CARR, B.T. 1987. Sensory Evaluation Techniques. CRC Press, Boca Raton, Florida. MOSKOWITZ, H.R. 1971. The sweetness and pleasantness of sugars. Amer. J. Psychol. 84, 387-405. MOSKOWITZ, H.R. 1973. Sweetness Additivity. J. Experimental Psychol. 99, 89-98.
MOSKOWITZ, H.R. 1977. Sensory measurement: The rational assessment of private sensory experience. Master Brewer’s Association of America, Technical Journal 24, 111-119. MOSKOWITZ, H.R. 1994. Product testing 2: Modeling versus mapping and their integration. J. Sensory Studies 9, 323-336. MOSKOWITZ, H.R. 1996. Experts versus Consumers. J. Sensory Studies 1 2 , 19-38.
MOSKOWITZ, H.R., KAPSALIS, J.G., CARDELLO, A.V., FISHKEN, D., MALLER, 0. and SEGARS, R.A. 1979. Determining relationships among objective, expert, and consumer measures of texture. Food Technol. 33, Oct. 84-88. MOSKOWITZ, H.R. and KLARMAN, L. 1975. The tastes of artificial sweeteners and their mixtures. Chemical Senses and Flavor 2, 41 1-421. MOSKOWITZ, H.R.,WOLFE, K. and BECK, C. 1978. Sweetness and acceptance optimization in cola flavored beverages using a combination of artificial sweeteners. J. Food Quality 2, 17-26. STEVENS, S.S. 1968. Personal communication. STONE, H. and SIDEL, J.L.H. 1985. Sensory Evaluation Practices. John Wiley & Sons, New York. THURSTONE, L.L. 1927. A Law of Comparative Judgment. Psychological Rev. 34, 273-286.
56
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
ALEJANDRA M. m O Z
Sensoryprofessionals learn the fundamentals of Sensory Science, the “do’s” and “don’ts”through sensory courses/workshops and books. Others, trained “on the job,” learn the sensory techniques practiced by their companies through senior colleagues and documented procedures, The general belief is that all sensory techniques and methods are robust, supported by research, and thus should be followed. We accept them at face value because they were taught to us either by professors, consultants, experienced sensory professionals, or books. Alternatively we accept them because these techniques are documented, established and practiced by our companies. As young professionals we never challenge these practices. With experience, we sensory professionals start either to examine the origin and basis of some of our practices, question certain procedures, and most importantly, separate the beliefs/myths/recommendations from the researched fundamentals of our field. We, as experienced sensory professionals should take a careful look at some of our practices and ask: To what degree are the techniques we practice fully researched? If there is limited research or documentation on these practices, then certain questions, discussions, modifications, and further research on these practices should be welcomed. Which techniques or practices are therefore “myths”? Only a few professionals have addressed this topic (Pangborn 1979; Chambers et al. 1993). We, the authors of this book, wanted to include this chapter to share our views on the myths we believe exist in the field. Hopefully, the sensory community can build on the questions and issues we ask or challenge in this chapter, reflect on or refute some of these practices, encourage discussion, broaden the application of these techniques, or motivate research. The results can only be positive for the growth of our field. We have selected a few sensory topics, practices or rules to examine in this chapter. We call these beliefs or practices “myths.” Some of these techniques are documented in books, but many only represent the opinions and recommendations of senior sensory professionals in the field (Moskowitz 1983, 1985; Stone and Side1 1993; Lawless and Heymann 1998; Meilgaard e? al. 1999). This author considers that it is legitimate to change or modify these practices, if they are myths. In addition, we have to face reality and understand that currently, we rarely have the ideal circumstances and all needed resources to complete the “ideal” tests. Budget issues or political situations often force us to modify our practices. We should feel comfortable in modifying some of these practices, especially if they are myths. In addition, this author believes that sometimes, providing a partial but sound answer or information is better than providing no answer at all. Conclusions will be drawn by the test requester or management, with or without our tests or recommendations. We should be open to changing our techniques, as long as we do not compromise our reputation and
SENSORY MYTHOLOGY
51
do not break the “unbreakable” rules. Through our expertise we can provide and report information with the proper perspective, and point out possible disadvantages, and most importantly the risks involved. Awarenessknowledge of the published literature, experience, and good judgment are required to separate the “unbreakable” rules and fundamentals of the field from the myths. Hopefully this chapter and the views from these three authors can help less experienced professionals make the distinction. In addition, we hope that this chapter can be useful to those experienced professionals who share our views.
Myth: Sensory/consumer Scientists Should Not Conduct a Test That Is Not Formal, Quantitative andlor Published This is a double edge sword, yet an important issue to discuss. We sensory professionals must challenge our test requestors when they approach us with test requests that have flaws, e.g., the participation of panelists in discrimination and hedonickonsumer tests simultaneously; the completion of discrimination tests with few participants; the selection of Type I or I1 risk levels based on the desired outcome; the use of qualitative data from one focus group with few participants and provide recommendations for the launching of a new product or for other important decisions based on such results, etc. Some professionals spend a considerable amount of their time explaining to the test requestors the unreliability of those practices and the risks involved. Obviously, professionals who are constantly faced with this scenario do not wish to modify the “formal” and accepted sensory and consumer practices, and conduct less formal tests. The recommendation against modifying formal quantitative tests is a myth. We can and should modify our practices and conduct less formal tests, when appropriate. Who determines if the modification of any of the “formal” and sound sensory techniques is acceptable? What is the risk of making a modification to one of our practices and fostering ensuing inadequate test requests? How “informal” and “qualitative” can a test be before it becomes a flawed test? Sensory professionals should ask themselves these questions. (1) Does the requested “less formal” method or practice violate well founded sensorykonsumer methods, principles and ”rules”? (2) What are the risks involved in conducting the “less formal” test? (3) How will the information be used? (4) How will the test requester obtain his/her answer otherwise?
58
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
If the requested test or practice clearly violates the principles of a given method and/or the risks are high, then the sensory professional should not agree to the modified practice. The generated data will be invalid and only lead to risky decisions. The sensory professional will loose credibility and be blamed for unsound results and decisions. Conversely, the sensory professional should assist the test requester if riskier decisions would be made due to the biased opinions and the use of incorrect practices by these researchers. For example, although not ideal and certainly not a “formal” test, the benchtop or qualitative evaluation of a set of products by a small group of trained panelists (e.g., 3 4) is better than the same evaluation completed by one or two of the researchers/product developers. These researchers are not only untrained, but have biases due to their knowledge of the formulation or processing of the products. Similarly, it is best to conduct a focus group session with naive consumers to collect qualitative and preliminary consumer reactions, rather than making decisions based on the preference responses of the same one or two biased researchers, or their family members. Experienced sensory professionals are able to modify methods and practices without compromising the data’s integrity and help the test requestor. This information will be more valuable and less risky than the one obtained exclusively by the test requester. In addition, the experienced professionalscan shed insights and use hisher expertise to position, interpret and report the information and minimize misunderstandings and risky decisions.
Myth: Test Parameters or Methods Should Not Be Modified if They Are Commonly Used or Well-accepted in the Company Arguments that endorse this belief include.
(1) “The company’s methods in place are the best methods and do not need to be modified.” (2) “The methods were established by a senior sensory professional or consultant and they should not be changed.” (3) “Test requestors will be confused if the methods are changed.” (4) “Modifications may compromise the reputation of the group. ” (5) “Notime is available to research and modify methods, and familiarize users with the new techniques.” The belief that methods and test parameters should not be modified is a myth. Sensory professionals should always be investigating new or alternate methods, and assessing how test parameters should be modified for different projects/objectives.
SENSORY MYTHOLOGY
59
Below are only a few examples of test parameters that very seldom are modified by some companies. This list is not inclusive. The topics are only meant to illustrate the point raised by this author. Hopefully, these examples can elicit the assessment and the discussion among sensory professionals of these and other internal practices that can and should be modified, when applicable. 1. Only One P Value Should Be Used in Hypothesis Testing. The “standard” probability value (P)value used by most companies or laboratories in hypothesis testing is P 5 0.05. Many sensory professionals use it blindly in all hypothesis testing. Most sensory practitioners have been asked by test requestors to explain the meaning of this P value, or the reasons why other values are not used in statistical tests. When approached with this question, many sensory professionals support the “magic” 0.05 value indicating that this significance level is commonly used in industry, that it has been traditionally used within the company, or that it represents a small enough number to minimize the risks incurred in the decision making process. The use and support of only one probability value in hypothesis testing is a myth. Practitioners should understand the meaning of this parameter (P),and know the origin of commonly used or recommended values to be able to fully explain its meaning, and to feel comfortable in considering and using other probability levels for different projects/objectives. Sensory professionals should be familiar with the origin of the “commonly used P = 0.05” level, Type I and Type I1 errors, and the meaning of this P value to be able to explain its use to test requesters and decide on its value for different tests. First, everyone must know that there is nothing “magical” about the “0.05” value. Anecdotal narratives give an account of how the 0.05 level was chosenhsed arbitrarily and became the norm. This happened because of the difficulty of calculating P values when Fisher and others published early books for “significance” (Chambers 2002). Secondly, practitioners must understand and use the concepts of Type I and I1 errors and the probability of committing those errors (alpha and beta). Thus, practitioners should know that it is often necessary to consider these two probability values (aand p) in designing tests and analyzing data. It is essential to know the test situations when one probability value (e.g., p) needs to be set, and let the other one (e.g., a) float. Finally, and most importantly, researchers should know that different projects may need different risk levels, thus P values to address different objectives. For example, it may be necessary to set a very low risk level for Type I error (a), such as 1% or 0.1% (P = 0.01 or 0.001) in certain projects where the risk of committing Type I error should be minimized. Alternatively, there are projects where the P value (a)may be set much higher such as P = 0.20, or when it is secondary in importance (since Type I1 is the most important error to control).
60
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Very few sensory/consumer insights groups use different P values for different projects. One of the reasons given by professionals is that test requestors may be confused when they obtain test results with different P values. This author believes that perhaps these professionals avoid explaining these statistical concepts to the test requestors because they feel uncomfortable with these concepts. Sensory professionals who understand the meaning of these statistical concepts can adapt these parameters to different projects and test objectives, and comfortably explain these concepts and the reasons for the modifications to test requestors.
2. The Same Scale Should Be Used in All Attribute/Descriptive (or Consumer Tests). Many sensory professionals believe that the same scale should be used in all attribute/descriptive or consumer tests. For example, it is believed that only the 9-point hedonic scale (if that is the scale of choice) should be used in all consumer tests, or that only a 100-point scale (if this is the scale of choice) should be used in all attribute or descriptive tests. Sensory professionals should use different scales, if appropriate or more beneficial for different applications. For example, it is appropriate to use different hedonic scales for special consumer populations (e.g., children, lower income consumers, etc.). It is also appropriate to use a 50-point intensity scale for selected attribute tests, instead of, for example, a 100-point scale used in descriptive tests. It is legitimate to use different scales if they are more beneficial to the new test/application. However, one should be aware, that it is best to use the same scale type within the same test to avoid panelist or consumer confusion. In addition, one should be sensitive to the importance of building a database or comparing results to or merging them with historical data. In this case, the use of a different scale is more detrimental since it may be impossible to merge the data. Sometimes, even if the test objective justifies it, it may not be appropriate to use a different scale. 3. Only One Type of Discrimination Test Should Be Used. Often sensory/consumer insights groups only use one type of discrimination test. Some companies prefer to use triangle tests, whereas others exclusively use duo-trio, or another type of discrimination test. Sensory professionals should know the benefits of each of these tests and apply a different test if dictated by the new test parameters or needs; e.g., when testing a fatiguing product, if new/different information is needed (e.g., degree of difference), etc. There is a plethora of traditional discrimination tests (e.g., simple difference tests, duo trio, triangle, A not A, etc.) (Stone and Side1 1993; Lawless and Heymann 1998), as well as non-traditional and new discrimination test theories and methods, especially those based on signal detection theory, Thurstonian scaling, R-index a (0’
SENSORY MYTHOLOGY
61
Mahony 1979; Ennis 1993, 1998; Cliff ef al. 2000; Rousseau 2001; Rousseau and O’Mahony 2001) that should be explored and applied, when appropriate.
Myth: Descriptive Panel Data Need To Be Quantitative To Be Valid Most of the descriptive analysis tests currently completed by sensory professionals are quantitative (Keane 1992; Stone 1992; Muiioz and Civille 1992; Muiioz et al. 1992). Sound descriptive analysis places emphasis on both the qualitative and the quantitative component, as described in Chap. 18 and 20. In addition, due to the quantitative nature of descriptive analysis tests, their data are used to make important business decisions, e.g., in product maintenance, product launching, optimization and improvement, quality control programs, etc. Therefore, some professionals consider that descriptive data are only valid if they are quantitative and supported by statistics. This is a myth. Descriptive analysis should be regarded as a valuable method for providing both qualitative and quantitative information. We err in overlooking the fact that the two components are independent. Thus it is acceptable to focus on or only use one of the two components. The focus on the quantitative component is accepted by all sensory professionals. Time intensity (T-I) measures focus on the quantitative descriptive element (Lee and Pangborn 1986). One or a few of the descriptive attributes are selected to concentrate on the quantitative component (the evaluation of intensity over time). The qualitative/attribute component in T-I measures is not the focal point. Similarly, less focus can be given to the quantitative descriptive component. In fact, the original Profile method (Caul 1957; Keane 1992), a well-respected descriptive method, does place paramount importance on the qualitative component. Why shouldn’t we sensory professionals place importance only on the descriptive qualitative component, when necessary? There are several scenarios in the R&D environment, where this practice is desirable and sometimes the only way to proceed in using a descriptive panel, such as: (1) the screening of a large amount of samples (2) the need for a quick turn around of descriptive information (3) the exclusive need of qualitative information since the quantitative data may not be reported, used or understood (e.g., in management presentations, use of the data by non-sensory professionals, etc.) It is legitimate to work with the panel in these and other scenarios, focusing only on the qualitative descriptive component. In these examples, no individual quantitative data are obtained. Instead, the panel generates descriptors and may work as a group in order to reach a consensus. Therefore, either when the above
62
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
scenarios can be anticipated, or when the case arises, a quantitative panel needs to be oriented into generating qualitative information and reaching consensus judgments. Individual data may be collected on a regular basis, but the panel is then trained to only generate qualitative information, discuss it and reach consensus judgments.
Myth: Descriptive Evaluations Need To Be Replicated To Be Valid Sound descriptive evaluations are replicated. Replication provides many advantages, such as increased statistical power, ability to test more than one batch or formulation, ability to check panelists’ performance, etc. Whenever possible, tests should be replicated. However, are tests invalid without a replication? Perhaps, depending on the type of panel and descriptive approach used. QDA@(Quantitative Descriptive Analysis) panels that use unstructured line scales and no intensity references generate highly variable data. QDA data should be considered invalid when only one evaluation is completed (e.g., no replication). Stone and Side1 (1993) report that from an empirical point of view, about four trials appears optimal for QDA@tests. Therefore, the need to replicate QDA evaluations is not a myth, it is a necessity. The scenario is different in Profile, and modified Profile evaluations. These panels are highly technical, follow extensive training programs, and use intensity or quantitative references (refer to Chap. 19). These panels, when well-trained, generate data with considerably lower variability, especially when intensity references are used. Replications are also desirable for Profile and Modified Profile panels, but not essential. In this case, the requirement for replication is a myth. If replications cannot be accommodated, the data are nonetheless still valid.
Myth: Sensory Professionals Should Not Try (e.g., Taste, Apply, Smell) Products Before Designing and Planning a Test This recommendation is based on the belief that analysts become “biased” if they become familiar with the sensory properties of test products. This author believes that the exposure to and the discussion of test products does not present a bias, unless the analyst is a panelist. Sensory/consumer scientists should become familiar with the test products in order to gain information on the products and the sensory properties, as well as to decide on the best test design and product presentation scheme in both analytical/sensory and consumer tests. In analytical tests, the sensory practitioner should be familiar with the products’ sensory characteristics to help make decisions on the products to test, their presentation, their special preparation and serving conditions, the needed references for a panel, the testing sequence, etc. In designing consumer tests, sensory/consumer scientists need to inspect the products to make decisions on
SENSORY MYTHOLOGY
63
the test design, the products to test, the sample preparation and serving strategies, the questionnaire structure, etc. Therefore, analysts are encouraged to become as familiar with the products as possible before designing any sensory and consumer tests.
Myth: Sensory Scientists Should Include All Samples in the Test Sample Set Some sensory professionals believe that all products given by the test requester should be tested. Some of these sensory professionals will include all products without inspecting them, if they believe that exposure to the samples may be biasing. This point was discussed above, and this author refuted this belief/myth. Other professionals include all samples because it is a “common” company practice, no time is available for this screening, or simply because the project “requires” that all products be tested. Sometimes the latter is necessary for highly visible or political projects. In those cases, all products are tested regardless of their similarity or recommendations against their testing. Except for the “political” projects described, hopefully professionals can make the time to accommodate the product screening, or they can challenge the “common” company practice against inspecting products, in light of the many advantages that exist in reviewing the products before designing a test. Who should inspect the products to make the decisions discussed above? This author recommends that a team of professionals complete these product reviews. The selection of the most appropriate team members depends on the company and the specific test objective. Mostly, a project team includes the sensory professional, the product developer/chemist, the market researcher, the marketing professional, etc. Each participant’s expertise and contribution is valuable in this review and in making decisions on products. In these product reviews, the sensory properties and other technical and business criteria are taken into consideration in the decision making process. Occasionally, the team may be formed only by sensory professionals and possibly trained panelists. This is particularly true if decisions are based exclusively on sensory properties.
Myth: Sensory Booths Are Required To Conduct Valid Sensory Tests Booths are always desirable (Stone and Side1 1993; Lawless and Heymann 1998). They give privacy and foster concentration for panelists. When a laboratory is being built and the resources are available, booths should be built. There are, however, some occasions when this is not possible, including when space is limited (e.g., in manufacturing facilities for QCIsensory measures), or resources are unavailable. Occasionally, evaluations are not conducted in booths if the test is being run by a contractor/agency in a facility lacking booths (e.g., a focus group room, a church or hall).
64
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Are tests invalid if booths are not available? Should tests only be conducted if there are booths available? A test can certainly be conducted without booths and be valid. Some precautions should be considered depending on the type of test being conducted. If a descriptive test is conducted and the panelists have been properly trained, then the evaluations can be conducted without booths. Very well-trained panelists learn to concentrate on the products and their evaluation, and can, to a certain extent, disregard distractions in the room. In addition, panelists prefer to quietly evaluate products, since concentration is necessary to conduct sound evaluations. Therefore, panelists themselves are not the cause of distractions. Semi-trained panelists and consumers are more likely affected by environmental distractions, thus their evaluations benefit from the use of booths. When booths are not available for tests involving semi-trained panelists or consumers, it is recommended to conduct an orientation prior to the test. The benefits of having participants concentrate and quietly complete the evaluation to foster concentration should be explained. In sufficiently large rooms without booths, it is recommended that ample space be allowed between panelists to promote independent evaluations. Portable booths or separators can also be used in these circumstances.
Myth: “X” Number of Panelists or Consumers Need To Participate in the Test There are common numbers of participants that are recommended for sensory tests. We have “learned” that we should use 100’’ consumers and “ 10 or 15” trained panelists in descriptive tests (ASTM 1992; Meilgaard et al. 1999). These numbers are accepted without questioning the rationale behind these recommendations. In addition, some professionals think that using fewer participants makes a test invalid. This is a myth. Sensory professionals have become more aware of the calculations that can be used to compute the number of panelists needed in the test, based on data parameters and some statistical criteria (e.g., the magnitude of the difference to be detected, the required alpha and beta levels, the known data variability) (Gacula and Singh 1984; Kraemer and Thiemann 1987; Gacula 1993). Whenever possible, sensory professionals should complete these calculations to determine the sample size needed, instead of using the above “common” recommendations as guidelines. There are also other issues to consider in determining the required sample size, regardless of the outcome of the sample size calculations. For example, what happens if only six panelists are available in a descriptive test? Are all panelists used if available (e.g., 16)? How many consumers are recruited for a
SENSORY MYTHOLOGY
65
test if the number/outcome of the calculation indicates that only 40 participants are needed in a test? For descriptive and attribute tests one should consider the level of training in making the final sample size determination. This parameter is in fact considered in the statistical calculation, since the standard deviation value, a measure of panel variability, is used. In general, the better trained the panel, the smaller the number of panelists needed. In other words, panelists’ variability decreases as the training level increases. Therefore, how small of a sample size is appropriate in descriptive tests? In general, a small number of panelists is adequate if they are extremely well-trained. Chambers et al. (1981) found that a panel of three highly trained, experienced individuals performed at least as reliably and discriminated among products as well as a group of eight lesstrained individuals. Those results suggested that the use of well-trained individuals could reduce the number of panelists necessary for sensory testing. Conversely, all panelists in the pool should not be used in all tests. A large pool of trained panelists is needed to be able to choose panelists for a test, to allow for panelists’ unavailability, attrition, etc. However, the whole panel pool should not be used regularly. For consumer tests, this statistical calculation also provides the sensorykonsumer scientist with the sample size needed. This number indicates the required number of participants needed to meet the set statistical criteria (a and 0) given the known variability. Frequently, the final number of participants will differ from the recommended sample size provided by this calculation. For example, despite being supported by the calculation’s outcome, the validity of consumer data may be questioned if a small number of recruited consumers participated. Therefore, the consumer sample size may be larger than the one provided by the calculation. Conversely, on occasion, the number of recruited consumers will be lower than the recommended number provided by the calculation, because of costs. These are cases where the calculated required sample size is used as a guideline, but the final sample size is determined by other factors. It is recommended that the required number of participants be calculated, even if fewer consumers will be recruited. The sensory professional can then use this information in the data interpretation and reporting of results. For example, in the case where fewer consumers than the minimum required are recruited, the sensory professional can warn the test requester of the risks involved, especially if no product differences were found. A Type I error may have been committed, i.e., the test failed to detect/declare product differences due to the smaller sample size.
66
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Myth: Consumers Should Never Evaluate Attributes, Since This Practice Affects Their Hedonic Measures Some sensory/consumer scientists believe that consumers are biased when they are asked product attributes. Therefore, these professionals only include overall liking questions in their questionnaires and thus do not collect any product information from consumers. These sensorykonsumer scientists rely on experimental design or descriptive analysis to obtain product guidance. There has not been enough research completed to determine whether or not consumers are biased when they are asked product attributes (Husson et al. 2001). Thus the belief that consumer responses are affected by including attribute questions in a questionnaire is a myth. This is an important subject and Chap. 10 presents the authors’ opinions on the topic. Myth: Consumers Cannot Rate Products Unless Fully Anchored Scales Are used There is the belief among some sensory professionals that consumers have difficulties rating product attributes and working with scales. Thus, they are convinced that only fully anchored scales should be used in consumer tests, since these are the scales consumers understand. Studies have reported the successful use of other scales besides the fully anchored among consumers (Rohm and Raaber 1991; Hough el al. 1992). Thus believing that consumers can only understand and use fully structured scales is a myth. Consumers are capable of using any sound scale provided they understand it. This author recornmends that during a short orientation conducted prior to the consumer test, the scale(s) used in the questionnaire be shown to the consumers and their main characteristics be explained. Examples should be given to the consumers to demonstrate the scale properties and their use. Additionally, consumers should be given the opportunity to ask questions, if the use of the scales is unclear. In this author’s experience, consumers can easily use scales that are not fully structured. Consumers do not have problems using these scales, as long as the scales are sound, and have properly chosen end anchors and possibly a midpoint (if applicable). This author considers that sensory professionals who are adamant about the use of fully anchored scales introduce a problem to the test, which is to find the appropriate anchors for each scale category. It is very difficult to find words/anchors that ensure equidistance among all scale categories for all attributes. Even if a sensory professional successfully develops a sound fully structured scale for a given attribute, problems may arise when the scale is translated into other languages. It is this author’s experience that flawed scales .
SENSORY MYTHOLOGY
67
are invariably developed when they are forced to list all anchors. This is particularly true for intensity scales. Sensory professionals who only used fully structured scales wish to avoid consumer confusion with scaling. However, these professionals commit a greater error, when structuring flawed scales with inappropriate anchors, since consumers may be more confused with these scales. In addition, unsound data may be collected. This author encourages professionals with this philosophy to acknowledge that their belief is a myth, and that more serious problems may be encountered when forcing anchors to scales.
Myth: The Best Scale To Use Is the 9-point Hedonic Scale. After All a Considerable Amount of Research Was Conducted When it Was Developed There are sensory/consumer scientists who exclusively use the 9-point scale and are reluctant to consider the use of other hedonic scales. It is well-known that the 9-point hedonic scale is one of the few scales that has been fully researched (Peryam and Pilgrim 1957). It is a sound scale and, if appropriate, sensorykonsumer scientists should use it. However, sensory professionals should be open to using other hedonic scales that have been used in consumer tests (Lawless 1977; Rohm and Raaber 1991; Hough et al. 1992). Among them are unstructured line scales or category scales containing only 3 anchors: the 2 end and mid-point anchors. The advantage of these scales is that they can be used with five or seven categories, because they only list the end anchors (and possibly a mid-point).
Myth: The Order of Sample Presentation Should Always Be Balanced or Randomized Balancing or randomizing the order of sample presentation is a good sensory practice. It ensures that all samples are given equal opportunity to be presented in all positions throughout the design (Cochran and Cox 1957; Gacula and Singh 1984). In addition, this practice allows sensory professionals to study order effects (Gacula et al. 1986; Gacula 1993; Gacula er al. 1999). Furthermore, special presentation designs and schemes should be used for specific applications (Wakeling et al. 2001). This practice should be followed most of the time when there is no drastically fatiguing or unusual products in the set. In this case, it may be best not to randomize or balance the order of presentation. The above recommendation may surprise some readers as it goes against the well-established and well-known practice of randomizing or balancing. Just to clarify, this author acknowledges the appropriateness of balancing and randomizing the order of presentation and endorses it in most cases, as explained above. However, there are occasions when randomizing or balancing
68
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
the order of presentation may incorporate problems in the evaluation. What happens when there is a-priori knowledge of a product’s fatiguing effects or unusual1y/extremely different characteristics and their potential effect on the evaluation? The detrimental effects or introduction of psychological errors (e.g., convergence, contrast) in the evaluation could be anticipated (Stone and Side1 1993). When this happens due to one of the samples in the test, a different sample presentation strategy may be most appropriate than balancing or randomizing. The best strategy may be to disregard that unique/unusual sample in the randomization or balancing scheme (i.e., all other samples are randomized or balanced), and to present the differenthnique sample last in the set. It should be stressed that the above is recommended when there is only one unique sample in the set. When all, or the majority of the samples have unique characteristics (e.g., extreme grittiness) or are fatiguing (e.g., mints, chili pepper, hot sauces, etc.) all samples need to be randomized or balanced. The sensory/consumer scientist should introduce other test control practices to ensure the integrity of the test (e.g., monadic evaluations, appropriate selection of the rinsing agent, sufficiently long rest periods, etc.).
Myth: Sensory Consumer Studies Should Only Address Sensory Properties We sensory professionals have been adamant about including only liking and sensory related attributes (e.g., attribute hedonics, diagnosticdintensities) in our consumer questionnaires, We teach young professionals to concentrate on sensory and product related questions and avoid image, branding, purchase intent, and other similar questions. It is important to explore the rationale behind this recommendation. Is this a legitimate recommendation or a myth? There are a few research studies that have investigated the effect of these questions on consumer responses (Martin 1990; Shepherd ef al. 1991; Bower and Turner 2001). More research is needed to conclude on the effect of such questions on consumer performance and on the integrity of the data. This author believes that this recommendation is founded on political issues and risks. Sensory/consumer insights groups are qualified to address these non-sensory questions, such as purchase intent, brand preference, etc. However, political issues and potential risks should be assessed, as explained below.
1. Delineation of Boundaries/Turf. Chapter 4 discusses the interaction and occasional conflicts that may exist between the Market Research and the Sensory/Consumer Insights groups. In that chapter this author indicates that the conflicts may be the result of overlapping roles, and the lack of understanding or delineation of the different roles/responsibilities. In an attempt to avoid these conflicts, many groups delineate the research responsibilitiesmoundariesfor each group (Carter and Riskey 1990). In some companies, the boundaries for a
SENSORY MYTHOLOGY
69
sensory group are set around sensory analytical/laboratory tests; e.g., sensory groups do not conduct any consumer tests. In other companies, the boundaries are set by the research issues investigated, thus the questions addressed in consumer tests. In this case, sensory groups are restricted to investigating only product/design issues, whereas market research deals with non-sensory, business and marketing issues. Therefore, in this case the sensory group only addresses product-related questions (e.g., attribute hedonics and diagnostics) to help product developers/formulators address sensory defects and issues. Conversely, the Market Research groups build on the information gathered by the sensory group, and collect other information related to purchase intent, price, sales projection, etc. Consequently, these are attributes included in Market Research consumer questionnaires. The above scenarios are not followed as rigidly in every company. Market Research groups may include sensory/product properties questions in their questionnaires, in the same way that some sensory/consumer science groups may address non-sensory issues. Technically, sensory/consumer insights groups are qualified to address these non-sensory questions, such as purchase intent, brand preference, etc. If the effect of such questions on the integrity of the sensory data is suspected, sensory professionals should ask these questions at the end of the test, once all sensory product information has been obtained. Regardless, practitioners should be cautious with the representativeness of the consumer population used and risks in asking these non-sensory questions, as discussed below. 2. Lack of Representativeness and Risks. A more important issue from this author’s perspective is the risk assessment when non-sensory questions are addressed in consumer tests by a sensory/consumer insights group. As mentioned above, from the technical perspective sensory groups are able and capable of collecting non-sensory responses. However, the representativeness of the consumer population used should be assessed to determine the value and projection of those data. Sensory/consumer insights groups should cautiously report the non-sensory data, when the participants were not representative of the population of interest (e.g., if the test was only local and the project requires a national representation), or if the sample size is too small. Non-sensory questions deal with business and marketing issues. Important business decisions are made based on this information, such as branding, price determination, sales projection, and the gathering of marketing/advertising ideas. Therefore, it may be risky to use the data collected by a sensory/consumer insights group if a small and local consumer population was used.
70
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
REFERENCES ASTM. 1992.Manual on Descriptive Analysis Testing. MNL 13, R. Hootman, ed. ASTM, West Conshohocken, Penn. BOWER, J.A. and TURNER, L. 2001.Effect of liking, brand name and price on purchase intention for branded, own label and economy line crisp snack foods. J. Sensory Studies 16, 95. CARTER, K. and RISKEY, D. 1990. The roles of sensory research and marketing research in bringing a product to market. Food Technol. 44( 1 l), 160, 162. CAUL, J.F. 1957.The Profile Method of Flavor Analysis. Advances In Food Res., 7(1), 1-40. COCHRAN, W.G. and COX, G.M. 1957.Experimental Designs. John Wiley & Sons, New York. CHAMBERS, E. IV. 2002. Opinion on setting the critical P level.
[email protected] CHAMBERS, E. IV., BOWERS, J.A. and DAYTON, A.D. 1981. Statistical designs and panel training/experience for sensory science. J . Food Science 46, 1902-1906. CHAMBERS, E. IV. and SETSER, C.S.1993.Myths and monsters of sensory methodology. Presented at “Advances in Sensory Food Science”, Rose Marie Pangborn Memorial Symposium, Jarvenpaa, Finland. CLIFF, M.A., O’MAHONY, M., FUKUMOTO, L. and KING, M.C. 2000. Development of a “bipolar” R index. J. Sensory Studies 15(2), 219- 229. ENNIS, D.M. 1993. The power of sensory discrimination methods. J. Sensory Studies 8, 353-370. ENNIS, D.M. 1998. Thurstonian scaling for difference tests. IFPressO 1(3), 2-3. GACULA, JR., M.C. 1993. Design and Analysis of Sensory Optimization. Food & Nutrition Press, Trumbull, Conn. GACULA, JR., M.C. and SINGH, J. 1984. Statistical Methods in Food and Consumer Research. Academic Press, San Diego. GACULA, JR., M.C., WASHAM 11, W.W., BEARD, S.A. and HEINZE, J.E. 1986.Estimates of carry-over effects in two-product home usage consumer tests. J. Sensory Studies 1, 47-53. GACULA, JR., M., DAVIS, I., HARDY, D. and LEIPHART, W. 1999. Carry-over effects in sensory evaluation: Case studies. In: Proceedings of the Fifteenth Annual Meeting of the International Society of Psychophysics, pp. 142-147, P.R.Killeen and W.R. Uttal, eds. Tempe, AZ. HOUGH, G., BRATCHELL, N. and WAKELING, I. 1992. Consumer preference of dulce de leche among students in the United Kingdom. J. Sensory Studies 7, 1 19-132.
SENSORY MYTHOLOGY
71
HUSSON, F., LE DIEN, S. and PAGES, J. 2001. Which value can be granted to sensory profiles given by consumers? Methodology and results. Food Quality and Preference 12, (5-7), 291-296. KEANE, P. 1992. The Flavor Profile. In: ASTM Manual series MNL 13. Manual on descriptive analysis testing. ASTM, West Conshohocken, Penn. KRAEMER, H.C. and THIEMANN, S. 1987. How Many Subjects?: Statistical Power Analysis in Research. Sage Publications, Newbury Park, CA. LAWLESS, H.T. 1977. The pleasantness of mixtures in taste and olfaction. Sensory Processes 1, 227-237. LAWLESS, H.T. and HEYMANN, H. 1998. Sensory Evaluation of Food. Chapman & Hall, New York. LEE, W.E. and PANGBORN, R.M. 1986. Time Intensity: The temporal aspects of sensory perception. Food Technol. 40(11), 71-82. MARTIN, D. 1990. The impact of branding and marketing on perceptions of sensory qualities. Food Science Technology, Today: Proceedings 4( I), 44-49. MEILGAARD, M., CIVILLE, G.C. and CARR, B.T. 1999. Sensory Evaluation Techniques, 3rd Ed. CRC Press, Boca Raton, Fla. MOSKOWITZ, H.R. 1983. Product Testing and Sensory Evaluation of Food: Marketing and R&D Approaches. Food & Nutrition Press, Trumbull, COM. MOSKOWITZ, H.R. 1985. New Directions In Product Testing And Sensory Evaluation Of Foods. Food & Nutrition Press, Trumbull, COM. MUROZ, A.M. and CIVILLE, G.V. 1992. Spectrum Descriptive Analysis Method. In: ASTM Manual Series MNL 13. Manual on Descriptive Analysis Testing. ASTM, West Conshohocken, Penn. MUROZ, A.M., SZCZESNIAK, A.S., EINSTEIN, M.A. and SCHWARTZ, N.O. 1992. The Texture Profile. In: ASTM Manual Series MNL 13. Manual on Descriptive Analysis Testing. ASTM, West Conshohocken, PeM . O'MAHONY, M. 1979. Short-cut signal detection measures for sensory science. J. Food Science 4( l), 302-303. PANGBORN, R.M. 1979. Physiological and psychological misadventure in sensory measurement, or The crocodiles are coming. In: Sensory Evaluation Methods for Practicing Food Technologists, IFT Short Course, Institute of Food Technologists, Chicago, IL. PERYAM, D.R. and PILGRIM, F.J. 1957. Hedonic scale method of measuring food preferences. Food Technol. ZZ, 9-14. ROHM, H. and RAABER, S. 1991. Hedonic spreadability optima of selected edible fats. J. Sensory Studies 6, 81-88.
72
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
ROUSSEAU, B. 2001. The beta-strategy: An alternative and powerful cognitive strategy when performing sensory discrimination tests, J. Sensory Studies 16, 301-319. ROUSSEAU, B. and O’MAHONY, M. 2001. Investigation of the dual-pair method as a possible alternative to the triangle and same-different tests. J. Sensory Studies 16, 161-178. SHEPHERD, R., SPARKS, P., BELLIER, S. and RAATS, M.M. 1991. The effects of information on sensory ratings and preferences: The importance of attitudes. Food Quality and Preference 3, 147-155. STONE, H. 1992. Quantitative Descriptive Analysis (QDA). In: ASTM Manual Series MNL 13. Manual on Descriptive Analysis Testing. ASTM, West Conshohocken, Penn. STONE, H. and SIDEL, J.L. 1993. Sensory Evaluation Practices. Academic Press, New York. WAKELING, I.N., HASTED, A. and BUCK, D. 2001. Cyclic presentation order designs for consumer research. Food Quality and Preference 12(1), 39-46. MAXIM0 C. GACULA, JR. Sensory myth is a subject that has been in the sensory closets for the last two decades or so. Sensory scientists often used both traditional practices and unsubstantiated rules of thumb when applying sensory methods to various situations. There is nothing wrong with this approach of mixing procedures if the combination results in new scientific standard operating procedures. If the uncritical mixing of methods and rules of thumb remains in the closet, then it will be destructive to the advancement of Sensory Science, and the myths will continue to be silently propagated. The myths in Sensory Science were first brought into the open by Rose Marie Pangborn in 1979 and most recently by Chambers and Setser (1993). It is recommended that sensory professionals both in the academia and industry should revisit these publications and perhaps update those practices and beliefs with scientific confirmation. Then we do not have to ask ourselves - are they myths or reality? In this chapter, Dr. Moskowitz gave four myths, provided scenarios where they probably came from, and gave scientific basis to disprove the myths. Consumers can evaluate more than two samples as indicated by Moskowitz. One objective of giving only two samples per evaluation is to be able to estimate carry-over effects, and not that the consumer cannot evaluate more than two samples. If more than two samples are evaluated, then it is advisable to provide a “control” or “reference” sample in the set to prevent the so-called “wandering scores.” When the number of samples is large, say 12, consumers can still
SENSORY MYTHOLOGY
13
discriminate but the samples are usually given in the form of a balanced incomplete block design presentation for two reasons: convenience to the panelists and logistic reason in the preparation and administration of the consumer test, respectively. For highly flavored or spiced products, the number of samples per presentation would likely be two, again to provide estimates of carry-over effects and possibly re-analysis of the data if carry-over effects are large. Nothing much can be said of myth #2 which deals with “state of the art” laboratory. Although, no studies can be cited, it is a practice that good Sensory Science requires good laboratory and environmental conditions. Experience and common sense come into play and can be considered a “scientific” confirmation. The third myth is basically covered in Chap. 7. From a statistical viewpoint, we use a consumer panel of appropriate sample size (see Chap. 14) to rate degree of liking to provide good representation of the population. Using expert panels, whether based on training or experience, would not be a good representative sample of the population. The fourth myth is surprising and deserves a second look. The role of statistics in Sensory Science is secondary to the competence of the sensory professional. Statistics provide information whether the results of a study are due to experimental treatments and not due to chance variation. Statistical analysis provides fundamental information to be used in the correct interpretation of results of the research study. Interpretation should consider both the experimental aspects and data analysis findings. The simplest statistical method that can provide adequate results is always the best choice, and the result of this choice is generally easy for the statistical client to comprehend. Muiioz cited several myths in detail, which would be a good reference for sensory professionals when making decisions for a particular research situations. In general, the writer’s views on some of these myths are as follows: Modifications of techniques, making shortcuts, etc., should be based on experience, internal research data if available, and knowledge of the product. Of course, it will be great if scientific evidence exists. The choice of P-value (Type I error) is primarily based on two points: acceptable risk and repeatability of results. The tradition of using P si 0.05 which is used in the scientific world is based on these two points. How repeatable would be the result of a study if we set P=0.20? Because the repeatability would be lower, the result of the study is often referred to as “directional.” In drug clinical trials, the P-value is set at higher levels, P S 0.01, because of human risk and the need for high repeatability of experimental results.
74
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Another factor that is often not mentioned is the fulfillment of the statistical assumptions of the test statistics, i.e., normality, equal variance, independence. These assumptions affect the choice of P value. As a protection for unsatisfied assumptions, we aim at using higher P-value (higher level of significance). The purpose of replication is to estimate residual or pure error. Test of significance of treatment or product effects is based on residual error. In the strict sense, without estimate of residual error test of significance cannot be done, hence replication is important. Furthermore, without replication the interaction of panel and products cannot be estimated. Interaction is an important part of evaluating judges’ performance. Replication also permits the estimation of panel repeatability. In the case of research guidance panel and consumer tests, where the sample size N is large and replication is impractical to do, the residual error is compounded with panelist effect. Because of large N, the compounded residual error would be an acceptable estimate of residual error. It is worthwhile to mention the myths that Chambers and Setser (1993) reported and they provided a very good review of literature regarding the myths that sensory scientists should review and decide for themselves whether it is a myth or a reality. All descriptive panels require extensive training. Consensus descriptive methods give different results than methods employing independent judgments. One scale type is better than another type. Children require simple measurement scales to understand the tasks. At least 8 to 10 panelists are necessary to obtain valid descriptive data. Discrimination among samples requires at least 7 to 9 scale categories. Color codes bias consumer studies. Sample quantity influences degree of liking. It is hoped that in the next decade, real myths will be discarded and more sensory research activities will be based on validated standard operating procedures. This can only be achieved if myths and beliefs are openly discussed and in print. Sensory professionals should not take the issue for granted.
SENSORY MYTHOLOGY
15
REFERENCES CHAMBERS, E. IV. and SETSER, C.S. 1993. Myths and monsters of sensory methodology. Presented at “Advances in Sensory Food Science,” Rose Marie Pangborn Memorial Symposium, Jarvenpaa, Finland. PANGBORN, R.M.1979. Physiological and psychological misadventure in sensory measurement, or the crocodiles are coming. In: Sensory Evaluation Methods for Practicing Food Technologists, IFT Short Course, Institute of Food Technologists, Chicago, IL.
CHAPTER 4 CONTRASTING R&D, SENSORY SCIENCE, AND MARKETING RESEARCH APPROACHES HOWARD R. MOSKOWITZ During the past decade Sensory Science has experienced a crisis of identity in its application. Both sensory scientists working in R&D and market researchers working in the marketing department, or in their own stand-alone department, deal with consumers. As a consequence, marketing and Sensory Science often compete internally to obtain consumer data, and to be seen as the primary source of such data for marketing decisions. Both groups fight for recognition, budget, responsibility, and ultimately the individuals compete against each other for professional growth and opportunities.
How Sensory Science Got into the Consumer Test Business Forty years ago sensory scientists were content to run expert panels, and in some forward-looking companies the sensory scientist also ran the in-house consumer panel. Whereas there would be no conflict between sensory scientists and market researchers on the “expert panels,” all too often there would be severe conflicts in the case of consumer data. The in-house consumer panelists were not exactly ndive consumers chosen to represent the ultimate consumer response, as is the case for market researchers. Rather, the in-house consumer panel was designed as an early stage mirror of what an uninstructed population might say later on. Cost and convenience drove the use of this in-house population. Panelists were cheap to recruit or at least the cost of recruiting them and using them never appeared on the balance sheet, and they were immediately available at the R&D center. The in-house consumer panel thus achieved a level of acceptance based more upon practical considerations of budget and convenience than upon its actual contribution to the business. This happy state of affairs changed subtly over the years. It soon became evident under scrutiny that the in-house consumer panels actually cost a lot of money, that they did not represent the target consumer population, and that the panelists would test relatively few products without becoming bored. That system would break down as the demands on it grew. A sensory professional might be able to recruit panelists at the R&D center to do two tests a day, but could clearly could not scale the “production” up to larger base sizes, with more products, in more geographical locations. In the meanwhile, R&D was reluctant to surrender to marketing research the newly found importance in the corporation attached to providing such early stage sensory data.
78
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
A compromise solution consisted of hiring external panelists, the so-called church groups or affinity groups. These external panelists were not rigorously screened as market researchers might do, but rather they belonged to a group such as a club. The sensory scientist in charge of the testing program would contract with the external organization to screen panelists for consumption of specific items, such as yogurts, snacks, meats, and the like. The researcher would then pay the organization a sizable lump sum (in relative terms, e.g., $1,OOO) for 50 panelists to show up and participate for a two-hour test session. Panelists would then show up, evaluate the product, fill out the questionnaire, and a classification questionnaire. The entire approach was simple, costeffective, allowed the sensory scientist a wider latitude in the panelists used, and got the sensory scientist into the consumer testing business. Typically the panelists would be local residents, living within driving distance of the technical center, but the actual evaluations would be done near the panelist's homes (e.g., at a local church, from which came the expression "church panels"). These church panelists represented the first skirmish between sensory scientists now venturing outside the confines of the R&D walls, and consumer market researchers with the responsibility to test consumers. The final step in the evolution of R&D Sensory Science into consumer researchers occurred when Sensory Science was given a larger budget for tests. The budget typically did not match that given to market researchers to execute similar consumer product research. One possible explanation is that the sensory scientist typically positioned the service as an in-house service, which never appeared on the budget line. This strength would later become a weakness. This foray into consumer testing generated some unexpected consequences. One consequence was that the sensory scientist evolved into a research supplier. Typically, the sensory scientist, a well-educated, technically-oriented professional, usually designed the study and analyzed the study himself, using a field service to recruit the panelists and to execute the actual testing. The second consequence was that Sensory Science began to compete with consumer researchers who specialized in the business of consumer data acquisition. No longer content to do local tests, and fortified with an independent budget, the sensory scientist wanted to travel across the U.S.and other countries, testing consumers from different markets. Sensory Science finally found its foothold in the consumer testing business.
Turf Battles Other
- W h y Sensory Science and Market Research Fought Each
In corporations there are always battles to protect one's "turf. Early stage consumer research constitutes one of these turf issues. Whereas during the 1960s and 1970s sensory scientists had confined themselves to internal panels, in the
CONTRASTING R&D,SENSORY SCIENCE, AND MARKETING RESEARCH
79
mind of the market researcher by the time 1980 rolled around Sensory Science was beginning to encroach on the market researcher’s territory. It was becoming clearer to the market researcher that the early stage “product tests” were in for some strong competition by a more quantitatively oriented, scientifically driven group of researchers - the sensory scientists. Up to then, market researchers pretty well enjoyed a monopoly position. They were slowly losing it. Market researchers doing consumer evaluations, e.g., so-called product tests, would issue long but not very actionable reports, detailing the performance of products on a check list of attributes, and perhaps a small analysis trying to identify what the product developer should do. It should be noted that many of these “inactionable” reports were written by contract suppliers, many who simply did not understand anything about the product, and rather manipulated symbols, reporting the results in a automata-like fashion. Enjoying a temporary monopoly, market researchers often failed to attend to the needs of their ultimate client, the product developer. Desiring a professional appearing product, the market researcher issued long, pedantic tomes, with tables, statistical tests, and precious little profound insight. However, the lack of insight was balanced by marketingoriented language, which said little, but with a lot of words. In more than one meeting, and after hearing the results of the report with its presentation of verbal information without product knowledge, this author (HRM) was wont to exclaim a line from Shakespeare’s Romeo as follows: “They jest at scars that never felt a wound. Within a few years battle royals broke out in various companies as market research on the one hand and sensory scientists on the other secured opposing positions, and accused each other of not serving the ultimate client. That client was hard to identify. Market researchers claimed that they were doing their job successfully because their reports were “marketing-oriented” (read this as being filled with marketing jargon). Market researchers claimed that the marketers could not possibly understand the underlying statistics and the scientific aspects of the sensory scientist’s work, which work they felt should be relegated to the inside of the technical laboratory and not at all made public. Sensory scientists countered by stating that the market research reports, often written by an external agency doing and analyzing the work, were filled with simplistic tabulations, and superficial insights. Sensory scientists felt that the market research reports embodied a profound lack of understanding of the research problem, and were written by individuals who were manipulating verbal symbols. The fact that a market research analyst could take a table of information about several products and comment on the numbers was, to the sensory scientist irrelevant, since the market research analyst often had no real idea about the specific topic that was being studied. For instance, if the test was to determine the sensory impacts of various treatments, then the market research analyst might blithely write about the effects of these treatments in a cold, ”
80
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
detached manner. The analyst might, never have any idea what these treatments were, why they were done, and where these treatments fit into the process of product design, development, and distribution in the marketplace, respectively. Before the early 1990s corporate department silos of marketing and R&D effectively divided sensory scientists and market researchers. The groups usually reported to different vice-presidents, had different budgets, were pitted against each other as part of corporate power struggles, and were never forced to work together. However, a house divided against itself cannot stand. The same applied to consumer research. During the past ten years marketing research and Sensory Science have come to respect each other more, and to work together, sometimes being forced to cooperate by disgruntled management who had no idea what the aforementioned battle royals were all about. Management recognized the need to get coherent, early stage data that would be valid, representative, etc. Management recognized in many cases that by giving the sensory scientist larger budgets but forcing them to work with market research, the ultimate product (useful data) would better serve the corporate needs. The famous English writer and wit, Samuel Johnson, was undoubtedly correct when he pithily remarked that “nothing so focuses a man’s mind as the prospect of being hung in a fortnight. ” Such focus applies today to the sensory scientist and the marketing researcher alike. It is too early to tell whether these battles are finished. As we start this new decade we see some rapprochement. There is yet a cold peace between market researchers and sensory scientists, rather than a warm relationship. Perhaps that will change.
W h y Market Researchers Advance More Rapidly than Sensory Scientists Let’s look at the sensory scientist, the reward structure, and how the sensory scientist progresses through the corporation. As noted above, the sensory scientist typically positions himself as the low cost supplier. When a sensory scientist begins a project it is usually with a constrained budget. The sensory scientist is all-too-often looked upon as a clerical-type individual who can get tests done relatively efficiently and inexpensively. The sensory scientist is rewarded for efficient use of time, and often required to do his or her own setup, recruiting, data analysis and reporting. Indeed many sensory scientists pride themselves on this capability of being the lost cost data supplier, if not necessarily at the end of the career certainly just after they begin their employment. The management reinforcement given to the sensory scientist is seductive. When an in-house sensory researcher does a major project “solo, ” he is often praised. Such praise motivates, especially young researchers, who then believe that they can do almost anything that outside researchers can do. To some extent they are right, since the in-house sensory researcher is educated,
CONTRASTING R&D, SENSORY SCIENCE, AND MARKETING RESEARCH
81
familiar with statistical computer programs for data analysis, and can act fairly expeditiously as a general contractor for a research project. Over time, however, the sensory research continues to be publicly praised for coming in under budget. Praise for new ideas is less forthcoming ... perhaps because budgets are easy to measure, budget constraints are the first things to impose in a tight year, and a positive bottom line, heroically achieved through one’s own labor is easy to see and to reward. In recent years some of the negative aspects of achievement and the relegation to a “maintenance” organization have been lifted from the sensory researcher by the availability of small budgets with which to do field work such as panelist recruitment, data acquisition, etc. Nonetheless, for the most part and despite corporate promises, the sensory scientist continues to be looked upon as the low cost data provider. To some degree the sensory researcher has brought this upon himself, because he has fallen into the trap of believing that saving money is better than coming up with critical answers. Many in-house sensory scientists, unable to compete on an intellectual or servicekapabilities platform with outside research specialists, take the position that they should be used because they are less expensive. Furthermore, because many sensory scientists are at the bottom of the research ladder, they do not go to meetings, are not fertilized by new ideas, and have little or no budget to explore ideas. They are trapped by their own efficiency. Things are getting better, but it may take a new generation of researchers, with a grander vision, to overcome the “death spiral” of low cost as a raison d’Ctre in the corporation. The market research industry differs from the sensory research business. Typically, the in-house researcher is assigned a budget that can be used to contract with outside researchers who actually do the work. Consequently, it pays for the market researcher to minimize the cost of data acquisition but also maximize the intellectual power of analysis. The astute, forward-thinking market researcher can use this budget to hire the best brains in the industry, or at least the best brains that can be afforded within the limited budget. In contrast, the sensory scientist is hired to be the brains. Any attempt to hire additional people to analyze the data is seen as the sensory scientist’s shortcoming, and is duly punished, either overtly or covertly. Given these corporate reward and punishment schemes, it should come as no wonder that the novice sensory scientist and the novice market researcher should turn out so different, or that the market researcher enjoys a somewhat faster track to the higher echelons in the corporation. Sensory scientists are rewarded for doing more of what they are doing; market researchers are rewarded with new responsibilities, and often move out of the research field altogether as they obtain a broader business perspective from their successful projects. Furthermore, market researchers develop networks of smart outside consultants, because they interact with these consultants on a project basis.
82
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Sensory scientists, with rare exception, do not contract out to full service research consultants who bring out new ideas. Sensory scientists typically contract with field services for data collection. They do not get new analysis ideas for these meetings - other than valuable ideas about efficiencies and cost savings.
R&D Sensory Science Versus Market Research Specifics in Actual Research Studies
- How They Deal with
(1) Attributes in the Questionnaire. Sensory scientists differ from marketing researchers in the attributes they select for tests, the rationale for the selection, and the interpretation of the attributes. Sensory scientists generally work with product developers. In the Sensory Science literature one rarely comes across a “laundry list” of attributes. Most of the attributes are straightforward, easy to understand, and assess the non-evaluative characteristics of products. For example, if the sensory scientist works with chocolate candy, then the sensory attributes will refer to the appearance, aroma, tastehexture, of the chocolate part of the candy, and perhaps if the candy is filled, to the filling part. The attributes are usually quite well-thought out. The sensory scientist will also ask questions about liking. Typically the questionnaire stops there. The attributes are manageable, limited in scope, typically can be referenced against known physical standards of identity for the attribute (even if those standards are not used in training), and can be easily understood by the product developer. One gets the impression from reading sensory scientists reports that the data are “cut and dry,” that the ambiguity in the meaning of the attributes has been reduced as far as possible, and that there is a minimal number of attributes, sufficient to answer the problem. Sensory researchers are clearly proud of their ability to tighten up their questionnaire, and are reluctant to put the panelist through an agonizing interview. To a great extent the look and feel of the sensory scientist’s questionnaire comes from the narrow focus that the researcher has - viz., to provide feedback to the product developer. Finally, a determining factor in the way that sensory scientists create questionnaires and use attributes come from the reality that the sensory scientist sits in the R&D facility, knows the internal “client,” and is responsible for the validity and utility of the data. Having to see one’s clients day after day focuses the sensory scientist’s mind on the minimal amount of valid information that one needs to answer the R&D client’s questions. More data than needed could end up creating unnecessary problems. Less data than needed could end up creating an experiment that did not work. Sensory scientists quickly learn to optimize the nature of the questionnaire so that it does the job, but parsimoniously and efficiently. We can contrast this tendency to minimize with the conventional questionnaire used by marketing research. Marketing researchers are also beholden to
CONTRASTING R&D, SENSORY SCIENCE, AND MARKETING RESEARCH
83
other corporate constituencies such as marketing and advertising. Although part of the questionnaire solicits panelist responses to the product (e.g., liking, amount of, etc.) a lot of what the marketer wants to discover involves the “image” of the product. These image attributes can vary from questions about when the product should be used, to questions about the “personality” of the product (e.g., brand personality), to other descriptive attributes, to fit to concept, etc. Market researchers are not scientists, unlike many sensory researchers. Market researchers often lack the discipline to know what they are looking for when they set up the study, and feel that it is always safer to include more questions rather than fewer. Furthermore, market researchers responding to the different disciplines are pulled in many different directions. It is easier for them to give into the disparate requests than to fight their constituents, saying no to one or another request. Finally, marketing researchers often contract out the fielding to an external research agency, and don’t have to worry that the questionnaire is long, repetitive, and provides little relevant data. As long as the test is conducted “validly” so that the right panelists are selected, the panelists properly complete the questionnaire, the market researcher often remains unconcerned and uninvolved. The end result of the questionnaire comprises a set of tabulations of products and an extensive report card that is handed over to another department. (2) Criteria To Select Panelists. Sensory scientists often fuss about screening panelists to participate. Sensory screening may comprise threshold tests, ability to scale intensities, or tests of the ability to name common food flavors in a solution or name a common texture when blindfolded. Marketing researchers also screen panelists, but their screening simply determines whether or not the panelist was actually contacted, and whether or not the particular panelist belonged in the sample. Many market researchers dealing with product testing for the first time are overwhelmed by the attention paid to panelist performance, including selection and monitoring, discrimination testing and the like. Whereas market researchers are less stringent than sensory scientists in their choice of panelists, it is not clear who is right. Indeed, discrimination testing of panelists does not necessarily lead to better panelist performance on a scaling task. In a paper written more than 20 years ago, Moskowitz et al. (1980) showed that panelists who passed a double-triangle discrimination screening performed as well, but not better, than did other panelists on a scaling task. The scaling task required the panelists to rate the perceived sweetness of a set of beverages varying in the amount of sweetener. That is, just because a panelist performs well on the discrimination task does not mean that the panelist will perform any better when the task is to rate the perceived magnitude of the stimulus on the same attribute.
84
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
(3) Scales. Sensory scientists tend to be more particular about the scales that they use. For example, when it comes to the different types of liking scales it is the sensory scientist who worries about whether or not the liking scale should be balanced, comprising equal number of scale points for likes and dislikes, or unbalanced comprising perhaps more scale points devoted to liking than to disliking. Market researchers are less concerned about scaling issues, and the proper treatment of scale values. It is not that the market researcher is disinterested in scales as much as the market researcher is more interested in the actual interpretation of the end results - e.g., is the product acceptable or not? Furthermore, most market researchers compute percentage of respondents who assign a specific scale value (e.g., 4 and 5 on an anchored five-point purchase intent scale). Thus, market researchers are accustomed to looking at percentage data, not at metric data. With percentage data many of the scaling issues become less relevant. This focus on the different properties of scales, metric versus percentage, becomes critically important when the research task is to identify aspects of the product that need improvement. Market researchers will report the percent of panelists who feel a product has too much or too little of a specific attribute. Sensory scientists, in contrast, who must work with the product developer, will report the magnitude of over-delivery or under-delivery of an attribute. Product developers need information regarding the magnitude of change they should make to the product, nor information regarding the proportion of people who feel that the product needs a change in a specific direction. Marketing research information simply indicates a problem, but does not prescribe the solution. Part of the indifference of market researchers to the scaling issue comes from their intellectual heritage. Many of today’s market researchers come from educational backgrounds in the social science, rather than from the physical sciences, or food science. The issue of scaling in social science is not as critical as the issue of scaling in psychology. Psychologists seek the best possible scales in order to measure perception, and use external criteria of validity to calibrate heir scales. For instance, a sweetness scale should have values proportional to the concentration of a sweetener. Sociologists and others in the softer social sciences do not have these measures of external validity, and so the “proper” scale or the “right” scale is not typically an issue. This indifference to the “right scale” transfers to their practice of market research. The bottom line is that as long as the scale discriminates and is amenable to statistical treatment, the scale is acceptable to the marketing researcher, especially if the scale possesses face validity. Face validity simply means that the scale appears to measure what it is claimed to measure. One of the interesting and personally relevant aspects of this difference between sensory scientists and marketing research in attitudes to scaling comes from the author’s experience with magnitude estimation (Stevens 1975).
CONTRASTING R&D, SENSORY SCIENCE, AND MARKETING RESEARCH
85
Magnitude estimation refers to a class of scaling procedures wherein panelists assign numbers so that the ratio of the numbers matches the ratio of perceptions. Magnitude estimation is widely used in experimental psychology, especially by psychophysicists interested in the relation between stimulus magnitude and perceived sensory intensity. When introducing magnitude estimation to the business community the author discovered two radically different attitudes. Sensory scientists fought long and hard against the scale, more on emotional grounds than on rational grounds. To the sensory scientist it appeared that by accepting magnitude estimation as a scaling method they were giving in to research methods that were imported from other fields. There was little in the way of analysis of the scaling data in order to determine whether, in fact, magnitude estimation performed well in an applied setting. In contrast, market researchers were also skeptical, but not on the basis of scaling issues. Marketing researchers more willingly accepted that the scale lived up to its publicity, and accepted the literature from psychophysics, which, in fact, the sensory scientists refused to accept. To marketing researchers the key issue was whether the procedure could be implemented in a field test, with untrained panelists, with interviews administered by unsophisticated interviewers. Another concerned the discrimination power. Would the discrimination power suffice for the business issue to be answered? Marketing researchers asked more pragmatic, less emotional-laden questions. (4) Base Size. Marketing researchers are schooled in large samples of panelists, with relatively little information from each panelist (especially in product testing). Marketing researchers often feel comfortable only when the panel size exceeds 100 or more, and feel uncomfortable making decisions with smaller panel sizes. Part of this discomfort with small sample sizes comes from the feeling that with a base size of 100 few critics can complain about sampling error. Also, with a base size of 100 consumers the market researcher can “cut” the data in different ways to look at many subgroups in the population (e.g., product users, product non-users, older vs younger panelists, etc.). With base sizes exceeding 300-400 panelists, the market researcher can look at many other subgroups of panelists in the population. To the typical market researcher it is well worth limiting the scope of the project to one-three samples, in order to afford this large base size. The actual data shows that researchers may not need the very large base sizes recommended by market researchers. In fact, the sensory scientists may have been right all along - beyond 30-50 panelists the data stabilize, and the decisions made with the base size of 50 often parallel those made with larger base sizes. The author published one article on base size (Moskowitz 1997), showing that with base sizes of 50 one can obtain results similar to the results obtained with hundreds of panelists. Indeed, in a conjoint measurement task for
86
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
concept development the author again demonstrated that the results with 40-50 panelists match those obtained with 420 panelists. The study involves the reaction of consumers to test concepts, and the estimation of the “utilities” or persuasive powers of the individual elements in those concepts (Moskowitz 2000). An example of this stability appears in Fig. 4.1.
1
t
........
0.7
..................
0.5 0.4
I
0
100 Base Size In Sub Sample
FIG. 4.1. SIMPLE CORRELATIONS BETWEEN THE UTILITIES OF THE ELEMENTS IN A SUB-SAMPLE (OF VARIOUS SIZES). AND THE UTILITY OF THE FULL SAMPLE OF 420 RESPONSES Five sub-samples for each base size were pulled. In some cases the correlations were very close for a given base size so that the points overlap.
The issue of base size can, like so many other controversies, be traced to differences in intellectual heritage. As noted before, market researchers trace their heritage to public opinion polling. Many market researchers simply want to know whether or not a product is or is not acceptable. Thus the market researchers opt for large base sizes because the large base size reduces the sampling error around the mean. In contrast, the sensory scientist wants to develop quantitative relations between stimuli and subjective responses. The relation can be developed with data from even one panelist. The large base size stabilizes the average, cancels the “noise” in the system, and allows the relation to come through more clearly.
CONTRASTING R&D, SENSORY SCIENCE, AND MARKETING RESEARCH
87
(5) The Impact of Off-Theshelf Computer Software on the Fight for Control. It should come as no surprise that in a corporation there is the fight for control over the processes of “primary” data acquisition, viz., from consumers. As the resources shrink, and as the food industry becomes ever more competitive, sensory scientists and market researchers often fight viciously with each other for the opportunity to control high visibility projects. These projects include category appraisal and product optimization, where the consumer input is critical for strategic guidance and for new corporate initiatives. Not surprisingly, the fight for control is often spurred on by the availability of software, such as that used in experimental design and brand mapping. R&D sensory scientists, market researchers, and market research suppliers (also known as “vendors”) are all emboldened by the availability of technology that could help them maintain their jobs and their statushcome. This fighting is expected to continue and intensify over the next decade as the food industry becomes ever more competitive, and as the opportunities for advancement dry up. In contrast, in other industries, such as telecommunications we do not see this type of hostile competitive behavior between the laboratory-based scientists and the market researchers, perhaps because the beckoning opportunities are so enormous that it makes little sense to compete in order to hold on to one’s territory. There is more to be gained in going towards a big future. Such a cooperative future does not appear to be the case in the food industry, at least for the next few years.
REFERENCES MOSKOWITZ, H.R. 1997. Base size in product testing: a psychophysical viewpoint and analysis. Food Quality and Preference 8, 247-256. MOSKOWITZ, H.R., JACOBS, B. and FIRTLE, N. 1980. Discrimination testing and product decisions. J. Marketing Res. 17, 84-90. STEVENS, S.S. 1975. Psychophysics, An Introduction To Its Perceptual, Neural, And Social Prospects, John Wiley & Sons, New York. ALEJANDRA M. m 0 Z
The discussion of the roles of sensory and market research professionals has always been a controversial topic. In the past, all companies experienced this conflict between the two groups of professionals. However, there have been some changes in the past decade. In some companies actual partnerships exist between the two groups in regular project work. In those cases, both functions understand the value of each group’s work and collaborate in projects without friction. In other companies, however, the conflicts and rivalries continue. Why
88
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
does this conflict exist in many companies? Why has it been possible for some companies to create an amiable working relationship between both groups? These conflicts exist when professionals believe that there is an overlap of work and responsibilities. Each group thus believes that the other party trespasses their working boundaries, and thus invades their professional space. Specifically, sensory/consumer scientists and marketing research professionals both work with consumers, the same source of information. Differences, conflict and even anger arise when one group believes that the other group is addressing the same issues. This closeness of mission, source of raw materials, and methods inevitably creates turf conflicts. Rivalries will inevitably continue as long as there is no clear understanding and public delineation of the expertise and responsibilities appropriate to each group. Tension will persist as long as there is no respect for each other’s work. Tension will persist as long as professionals in each group fail to acknowledge, willingly or unwillingly, the values of the work done by the other group, and its importance both to the scientific and to the business communities, respectively. In a provocative and insightful paper, Carter and Riskey (1990) discussed some of their views on the competitiveness vs. cooperation of both groups. These authors indicted that neither group can be successful without the success of the other. Both groups should cooperate, and clearly understand and work within the purview of their accountabilities. The marketing research accountability is the consumer target because the objective is to find and reach the consumers to whom the product is most appealing. The sensory evaluation accountability is the product target because the objective is to determine when a company has the best product for the consumer target. Market research and sensory consumer research rivalries often occur when both groups run guidance tests with consumers. This aspect should not even be an issue if the accountabilities of each group are examined. As stated by Carter and Riskey (1990), sensory research should be responsible for the bulk of the product testing, given this group’s accountabilities. Product tests are a small piece of the market/marketing research accountability, which usually sum up to only 35 % of a marketing research department’s efforts. The remaining 65 % should be devoted to market tracking (30%),advertising, copy and promotion research (20%),and idea screening and concept testing (15%). It is vital to recognize the true differences between studies run by the sensory scientist versus those run by the market researcher. Both professionals use similar tools, but the objectives differ. In most cases, the consumer tests from both groups should differ in objectives, philosophy, methodology used, number of samples, type of recruitment, questionnaire design, data analysis and uses of data. If in fact market researcher and sensory consumer tests are so different, then it makes sense that both groups should work together to complement their results, as discussed below.
CONTRASTING R&D, SENSORY SCIENCE, AND MARKETING RESEARCH
89
Stage of Development Market research and sensory professionals should work together in the same project at different stages in order to meet different objectives. Tests run by the two should then complement each other; i.e., one test should not be considered to be the substitute for the other. In most cases, sensory research guidance consumer tests might well be conducted first in order to obtain preliminary sensory information. This sensory information should be used by product developers in order to improve products. Once all the sensory product issues have been addressed and the final samples made ready for national testing, the project should be handed over to market research for further testing. Ideally, this sequence should apply to many of the research projects. There are some exceptions discussed at the end of this section. As Carter and Riskey (1990) indicate, a new product development process could be visualized as a chain of interrelated phases, with sensory research and marketing research cooperating and complementing, rather than competing.
Objectives The objectives of the two groups should differ, reflecting their different business goals. Sensory scientists who execute consumer tests at the preliminary stages of a project ought to adopt a research guidance perspective. Sensory consumer research guidance tests should focus on and be limited to aspects of the products’ sensory properties and integrity. Thus for the most part, sensory consumer tests deal with the assessment of liking/preference and sensory attributes. Given this viewpoint, therefore, sensory-based consumer tests are best utilized at the project’s preliminary stages to obtain product information for product guidance, or to screen products. Market research tests are best conducted after the sensory consumer test data have been analyzed and acted upon. Sensory consumer research guidance test results should be used to screen and/or improve products. Market research test results should be used in order to further understand the product’s sensory attributes uncovered by the sensory research, to address selected sensory issues, but mainly to address non-sensory aspects such as purchase intent, market potential, etc. It can be said that market research tests collect information that can be classified as “active” responses. Not only do market researchers measure liking attributes but they also measure other, more decision-oriented attributes, such as purchase intent, brand comparison, etc. Another aspect which differentiates sensory and market research tests is the perspective or framework of the research conducted by each group. Sensory scientists conduct these tests with a research perspective. The tests are usually conducted by sensory groups. The tests are geared to gather information or to build a database for specific research or quality control applications. Some of
90
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
these applications include the study of consumer/descriptive/instrumentaldata relations, or the study of relations between consumer perceptions versus ingredient concentrations or sensory attributes. Given the foregoing distinctions in objectives and perspectives, these additional differences appear to hold between consumer sensory and market research tests.
Project Stages. Most sensory consumer tests are usually conducted at the project preliminary stages, market research tests at latedfinal stages. Type of Products. Sensory consumer tests may involve more prototypes and products than do market research tests. Market research tests may include improved, final prototypes and competitor’s products. Number of Samples. Sensory consumer tests may include many samples/prototypes, many of which are optimized. Market research tests often examine fewer improved samples. It is unusual for a market research test to include unimproved alternatives, although many market researchers do work at the basic sensory level in some of their projects. These early-stage projects are the exception for market researchers, not the norm. Participants. Sensory consumer tests may be conducted with employees or naive consumers. A limited number of subjects participate (50-200). Consumers are often recruited based on product usage and on a limited number of other screening criteria. Market research tests are virtually always conducted with naive, unpracticed consumers. The number of consumers recruited may be large (100-SOO).Market researchers often impose more stringent recruitment criteria, such as product usage, income, members in household, lifestyle, attitudes and other criteria. Test Venue. Sensory consumer tests usually occur in only one or two markets. Market research tests may occur in more markets, because the goal is to represent the full range of the consumers. It is in the test venue, and in the nature of the participants that one sees the difference between market research and Sensory Science studies of the same product. Questionnaires. As emphasized above, the objectives of the sensory scientist and the market researcher differ from each other. Therefore, the difference in objectives manifests itself in the structure of the questionnaire. For example, the sensory consumer tests may be confined to ratings of liking, preference and attribute diagnostics. The market research questionnaires may be
CONTRASTING R&D. SENSORY SCIENCE, AND MARKETING RESEARCH
91
much longer because the market researcher incorporates many more attributes, such as use, image, purchase intent, brand comparison, etc.
Data Analysis. The data analysis done by sensory professionals may be more extensive than the analysis done by market researchers. The sensory professional often applies a larger number of statistical analyses, including simple inferential statistics, analysis of variance, correlations, and modeling. The majority of market researchers come to the data from the point of view of describing the results. Many, albeit not all, sensory scientists approach the data with a deeper interest in significance of differences, relations between variables, etc. Expense. Because of the larger number of marketshest locations and number of consumers used, most market research tests are more expensive than sensory consumer tests. The foregoing differences in the Sensory Science versus market research scenarios and sequence of tests apply to most routine research projects. The role of both groups can be clearly delineated in the way described above. These distinctions between the tests run by the sensorykonsumer insights groups versus those run by the market researchers are not as clearly defined for some projects, particularly the advanced research projects, such as product optimizations, category reviews, and studies that address consumer understanding. These projects involve a large number of consumers, a large number of products, should be conducted with naive consumers, ideally need to be conducted in one or more test locations/markets, and are expensive. Traditionally, these tests have been conducted by market researchers, mainly because of the high costs of such tests, and the need to combine the marketing and the technical perspectives in the analysis and interpretation. Market research groups with larger budgets can easily fund these projects, and work with outside vendors. However, more and more sensory/consumer insights groups are getting involved in these projects. Ideally, these complex projects should be undertaken by both groups in collaboration, allowing each group to contribute its own unique expertise. This partnership can ensure optimal results, provided that the turf issue does not destroy the collaboration. More and more companies are building strong partnerships between sensory and market research groups. These companies should represent a model of business-oriented research for those organizations still dealing with the conflict between both groups. A solution is possible. Sensory professionals should strive to clarify the type and value of consumer sensory research guidance tests, and foster the interaction between the sensory and market research groups.
92
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
REFERENCES CARTER, K. and RISKEY, D. 1990. The roles of sensory research and marketing research in bringing a product to market. Food Technol. 44( 1l), 160, 162.
MAXIM0 C. GACULA, JR. The subject of this chapter is well-known to both Sensory Science and marketing research departments, the problems and issues of which need no further introduction. Moskowitz and Muiloz detailed the issues and probable solutions for understanding and integration of functions between sensory and marketing research departments. From the author's (MCG) perspective, two factors should be emphasized in the next decade. (1) Management education of the roles of Sensory Science and marketing research in the various stages of product development. If management is not convinced of these roles, then the problems will continue to exist and fester. The different consumer product industries operate in a variety of different ways. Thus the roles should be defined with the ultimate goal of producing a winner, consistent with the way the specific company operates. (2) The Sensory Science department is more effective in supporting company Research and Development than supporting Marketing Research. In this supporting role, emphasis should be given to cost and risk, and to the problem solving capabilities of sensory evaluation department. It would be impractical and costly to conduct marketing research tests with consumers, when the stimuli comprise 16 prototypes (2 x 2 x 2 x 2 factorial) involving four ingredients. It would be difficult for marketing research to solve problems dealing with product defects. The recent paper by Van Trijp and Schifferstein (1995) is excellent reading material for the management (Item 1 above). From this paper, MCG expanded and modified the content of a table in this paper. The modified table is shown in Table 4.1. Some of these contrasts are also mentioned by Moskowitz and MMoz. Perhaps, one of the hotly debated issues is the item on Criterion: Internal vs. External Validity. One of the reasons for this issue is that one often must extend internal results of a study to achieve external validity. Experience shows that some Research Guidance Panel results are externally validated and some are not, especially for the newly introduced product. Thus, test results of
CONTRASTING R&D. SENSORY SCIENCE, AND MARKETING RESEARCH
93
this criterion cannot be generalized and one should stay within the bounds of this criterion.
Item Primary focus
R&D Sensory Science Approach Focus on product and production processes; sensory properties of products; sensory optimization.
Marketing Research Approach Consumer behavior; matching expectations;packaging; label; advertising and positioning; confirmation; purchase intent; perceived quality; demographics. Internal validity; results within External validity; results can the confine of R&D pending be generalized to target popurelease to large-scaleconsumer lation. test. Trained or expert for Descrip- Naive consumer; panelists tive Analysis; in-house and/or representative of the target consumer Research Guidance population; importance of sample size; location of test. test. Core attributes of product both Augmentedproduct to enhance physical and sensory aspects; packaging, brand name, price, R&D prototypes; reformulate advertising and distribution of if sensory defects are found generic to enhance durability, before release to marketing utility, and convenience; R&D consumer test. screened prototypes used. Specialized terminology; Consumer terminology; Focus “Word Meaning” study to Group. understand consumerterminology. Strictly controlled under R&D Moderately controlled or environments; use of intensity product use conditions; use of scales; use of hedonic for hedonic. JAR scales, and Research Guidance Panel Test purchase intent. (Internal Validity).
I Product
Terminology
Test methods
I
I
One item in Table 4.1 that needs further discussion is Terminology. The sensory scientist is constantly faced with the choice of attributes to be used in Research Guidance Panel tests. Is the meaning of the attribute understood in the same way by the different consumers in the study? Aside from the Focus Group, a quantitative method known as Word Meaning Analysis reported by Jones and Thurstone (1955) is useful to answer this question. This method quantifies the meaning of a word in order to understand perception of products or stimuli
94
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
during evaluation. Word Meaning Analysis is extremely useful in understanding consumer terminology - a key to a successful sensory evaluation program, and in questionnaire development as discussed in Chap. 11. Gacula and Washam (1986) applied this method to scaling word anchor for off-flavor as applied to shelf-life study. Table 4.2 shows the results of a Word Meaning Study for the word “mildness.” What does mildness means to the consumer? Of the 109 words and phrases used in the study, those particular wordslphrases that describe both ends of the scale appear in this table. The rating scale was an unstructured scale six inches in length where 0 = not mild and 6 = extremely mild. From Table 4.2, the words “harsh” to “gritty” can be used to describe a “not mild” perception, and “conditions skin” to “baby-soft” can be used to describe the extremely mild perception. An important marketing application of this result would be in advertising and in claim substantiation. As indicated by Moskowitz in Chap. 5 , understanding of the meaning of the word contributes to the validity of the data.
WON
TABLE 4.2. MEANING ANALYSIS OF THE WORD “MILDNESS” WordlPhrase 1 Mean score I Harsh 0.59
I
Bums Rough Irritated Itches Scaly Wrinkled Brittle Sandy Gritty
0.67 0.71 0.71 0.71 0.73 0.76 0.77 0.77 0.80
Scale: O=not mild, 6=extremely mild; Sample size N=150.
CONTRASTING R&D, SENSORY SCIENCE, AND M.4RKETING RESEARCH
95
There are other items not covered in Table 4.1 such as scaling issues, which are dealt with in Chap. 9, and many other issues encountered in practice by sensory scientists. It is hoped that this chapter will continually enhance serious and honest dialogue between Sensory Science and Marketing Research Departments. The detailed discussions by Moskowitz and Muiioz should clarify the existing issues, so that they can be seriously addressed and resolved in the next decade or so.
REFERENCES GACULA, JR., M.C. and WASHAM 11, R.W. 1986. Scaling word anchors for measuring off flavor. J. Food Quality 9, 57-65. JONES, L.V. and THURSTONE, L.L. 1955. The psychophysics of semantics: A Experimental investigation. J. Appl. Psychol. 39, 31-36. VAN TRIJP, H.C.M. and SCHIFFERSTEIN, H.N.J. 1995. Sensory science in marketing practice: Comparison and integration. J. Sensory Studies ZO, 127- 147.
CHAPTER 5 VALIDITY AND RELIABILITY IN SENSORY SCIENCE HOWARD R. MOSKOWITZ One of the key tenets of research is that when the researcher performs the same action he should obtain the same results. This is known as reliability, or reproducibility. Another key tenet in research is that the research should accurately reflect what it purports to measure. This is known as validity. Validity is simply that the research process truly measures what it says it measures. Reliability does not mean validity. These two very-important concepts in science are altogether different, yet they are linked in the minds of researchers. Reliability at the gross level is fairly easy to achieve after aggregating data across panelists. Care must be taken when running the study that the same steps are followed, especially if these steps influence the results. In most laboratories the practitioners are taught about the obvious factors that can influence reproducibility. Some of these factors are the selection of panelists, the correct preparation of stimulus materials, the correct explanation of the scale and attributes, the correct sampling of product, the randomization of the product to avoid systematic bias, and the like. At the individual level matters may become more complex. Averages across many people smooth and reduce disturbing secondary influences that affect reliability. On an individual level reliability may not be as clear, and may be much more difficult to establish, compared to the reliability at the group or aggregate level. Indeed, at the individual-level data, much more data may be needed from a single point in order to demonstrate reliability. The need for the additional data comes from the fact that at the group level the many data points from different people cancel out the noise, allowing the basic relation to emerge. At the individual level typically there are no such massive numbers of data points to allow error variability to cancel itself out. Validity is a much more nebulous concept, and harder to demonstrate. What does it mean to say that a sensory test is “valid”? For example, assume that the panelist is instructed to rate degree of liking. How does one establish that the rating for liking for a variety of products is really valid? What does validity of the liking scale mean? At the easiest level one can interrogate the panelist in order to determine whether or not the panelist understands the meaning of the attribute. If the panelist does not understand or cannot define the attribute, then perhaps we might be somewhat worried that the liking scale data are not valid, because the panelist doesn’t seem to understand the terms. But what happens if
98
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
the panelist understands the meaning of the term liking? What does the liking rating mean? Does it mean that the panelist will choose the higher liked product over the lower liked product all the time? Does it mean that the panelist will distribute the selection of products in some way proportional to the relative liking ratings assigned to two or more products? Does it mean that a higher liked product will sell more in the market? Does it mean that the higher liked product will generate fewer complaints? Or does it mean that the higher liked product will be rated as having more of other characteristics such as “quality.” Rarely do sensory scientists have to think about the validity of their measures, perhaps because they are not in contact with the final marketing measures. Sensory scientists are always on guard to demonstrate the reliability of their measures. Indeed, the first check of “validity” that a marketer makes is to determine whether the data are “reliable”; viz., did the same answer emerge this time as last time. Yet, one of the key aspects is overlooked - do liking ratings predict future behavior such as market performance? The relation of liking to sales is clearly an important area, and an aspect that, if established, also establishes the validity of the liking scale. There are a variety of topics falling under the general rubric of validity.
Face Validity - the attribute scale appears to measure what it says it measures. For instance, when it comes to liking, the rating scale dealing with liking should require the panelist to rate liking or something that appears to relate to liking such as purchase intent or quality. A scale that asks another attribute, such as novelty, would not possess the face validity necessary for someone to believe that the scale is really dealing with likes and dislikes. The scale is simply not face-valid. In truth the “novelty” scale might perfectly well predict degree of liking, but no one would accept data because on the surface the relation between novelty and liking simply does not appear to have validity at all. Construct Validity - the attribute being measured really captures the essence of what is being studied. In simpler terms, if the attribute is “liking,” then does the liking scale really capture the construct of product acceptability”? This is a particularly vexing question, because in Sensory Science it is easy to ask the panelists many questions, but really hard to know what is meant by many of the attributes. For descriptive panel work construct validity is simpler - the researcher uses reference standards, and defines the attribute in terms of the reference standard. That is, the attribute is defined in terms of the sensory characteristic present in the reference standard. The scale value is the magnitude of the sensory perception, which can be compared to the magnitude of the attribute present in the reference standard. It may well be that the reason for the popularity of descriptive analysis early in the growth of modem Sensory Science
VALIDITY AND RELIABILITY IN SENSORY SCIENCE
99
is that descriptive analysis enjoys both face validity and construct validity, whereas other scaling tools (e.g., liking ratings) possess no such construct validity. It is appealing to research scientists in R&D, ignorant of the psychophysics literature, to point at a set of reference standards and claim that the descriptive analysis is based upon such objective, concrete standards.
Predictive Validity - the attribute scale predicts other behaviors such as performance of the product in other tests of different types, e.g., performance of the product in the marketplace, etc. Predictive validity is probably the most important type of validity for sensory scientists. Corporations keep sensory scientists on staff because, presumably, the data provided by these analysts predicts performance in other tests. These data thus inform early development, putting that development on the right business track. To the degree that the sensory scientist provides data that predicts performance in other tests, which in turn predict market performance, the sensory scientist will be perceived as providing valid data. To the degree that the sensory scientists provides data that bears no obvious relation to later results, the sensory scientist will be perceived as providing irrelevant, or even worse invalid data. Unfortunately, it is quite difficult for the sensory researcher to provide solid data that has great predictive validity, especially since the researcher works with relatively small groups of panelists, and tests a large number of products, with each product rated on many scales. It is difficult to tie this sensory-oriented data directly to market performance. Thus the predictive validity for sensory research no longer becomes the relation to market performance, but rather the perception of the other corporate members (e.g., marketing, general management) that the sensory researcher provides valid data to guide development. Predictive validity for sensory research truly becomes a matter of perception, not reality. In the End
- Is Validity Really Just a Matter of Opinion?
S.S. Stevens at Harvard University was fond of stating the “in the end validity is a matter of opinion” (Stevens 1966).As startling, confrontational, and dismissive as this assertion may sound, it has merit. Validity and reliability, two frequently used words in the corporate environment, obey different “rules of the game. ” Reliability is easy to demonstrate. Various methods can generate a statistical index that shows the reproducibility of the data. Whether the data are “correct” or “incorrect” is not a problem. Reliability is primarily a statistical concept; methods to achieve reliability are primarily methodological. There is no appeal to truth. Indeed, if the researcher makes the same fundamental mistake again and again the researcher is doing things reliably, albeit incorrectly.
100
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
In contrast validity is more complex. At its simplest level validity invokes the relation between the data that one collects in the current study and other data that are assumed to be correct. Predictive validity is a good example of this type of relation. Validity is established if one can use the current data to predict performance on another criterion test. At a more complicated level validity requires that one truly understand the meaning of the data that one collects, so that the questions asked in fact relate to some underlying “truth. Many sensory scientists can acquire data to demonstrate predictive validity. Few sensory scientists can acquire data to demonstrate construct validity because it may be hard even to formulate the proper criterion of validity, and in turn devise the proper operational tests to confirm or to disconfirm validity.
REFERENCE STEVENS, S.S. 1966. Personal communication.
MAXIM0 C. GACULA, JR. In this chapter, Dr. Moskowitz expressed his ideas on the validity and reliability of rating scales, in particular the liking scale, as used in sensory evaluation of products. As far as I know, no published work is available on this subject. It is a challenge since there is no wrong response for hedonics. Moskowitz formalized three types of validity in Sensory Science: face validity, construct validity, and predictive validity. First, let us consult Webster’s dictionary definition of validity: one definition is state of being “supported by objective truth or generally accepted authority.” For reliability, it is the state of being “suitable or fit to be relied on.” In validation studies of test methods, reliability is defined as a measure of the degree to which a test can be performed reproducibly within and among laboratories over time (National Institute of Environmental Health Sciences 1997). This definition can easily be adapted to Sensory Science. I agree with Moskowitz that reliability does not mean validity. The sensory scale and method used may be valid for such application, but it is possible that the results are not reliable. That is, the results may be precisehepeatable but is not accurate for the intended purpose. However, how do we measure accuracy in Sensory Science? The closest measurement of accuracy would be a reference standard in descriptive analysis. Without a standard or reference point, accuracy cannot be measured. From the definition, reliability would have two components: repeatability (within laboratory or within test variability) and reproduci-
VALIDITY AND RELIABILITY IN SENSORY SCIENCE
101
bility (between laboratories or between test variability). These components are simple to calculate and one can refer to ASTM (1990, 1992) publications. Some of Moskowitz’s statements on validity of a sensory test to rate degree of liking are open for discussion. If a sensory test is an accepted standard procedure, then by definition it is a valid test. Perhaps, it is the sensory attribute asked in the questionnaire that is invalid or inappropriate. Is there analytical or instrumental data that can validate degree of liking? Using predictability of results as a measure of liking validity is another issue of great interest to sensory professionals. There is no wrong answer for hedonic questions (like/dislike) which contributes to reluctance of predictive validity criterion. Thus predictive validity and construct validity may not apply for hedonics. In practice, however, the norms about a product or product category are used as a measure of validity. Hence one can make statements about face validity and predictive validity.
REFERENCES ASTM. 1990. Standard Practice for Use of the Terms Precision and Bias in ASTM Test Methods. American Society for Testing and Materials, Publication E177-90a, West Conshohocken, Penn. ASTM. 1992. Standard Practice for Conducting an Interlaboratory Study to Determine The Precision of a Test method. American Society for Testing and Materials, Publication E691-92, West Conshohocken, Penn. National Institute of Environmental Health Sciences. 1997. Validation and Regulatory Acceptance of Toxicological Test Methods: A Report of the ICCVAM. NIH Publication No. 97-3981. Research Triangle Park, NC.
CHAPTER 6 THE INTERFACE BETWEEN PSYCHOPHYSICS AND SENSORY SCIENCE: METHODS VERSUS REAL KNOWLEDGE HOWARD R. MOSKOWITZ Throughout its history, Sensory Science has enjoyed a profitable, occasionally symbiotic relation with psychophysics, that specialty of experimental psychology linking physical stimulus and subjective sensory perception. The reason for this close relation is quite simple - Sensory Science studies the consumer response to specific stimuli. The only difference is that the sensory scientist works with consumer products, whereas the psychophysicist has the luxury of working with consumer products, with model systems, or with consumer products that have been altered to exhibit interesting properties, albeit not necessarily commercial ones. Sensory Science and psychophysics share many aspects.
Are Sensory Methods the Same as Psychophysical Methods? The intertwining of Sensory Science and psychophysics begs the question whether or not the methods used by sensory scientists can be classified as variations in psychophysical methods. One simple answer is yes. Psychophysical methods ask the panelist to act as a measuring instrument. Examples of the measurement may be assessing whether or not two stimuli match each other; assessing the subjective magnitude of a sensory impression or a feeling about a stimulus, etc. The key differences are probably the subject matter and the point of view. Traditional or classical psychophysics deals with the properties and performance of the sensory system. The stimuli tend to be simple, pure, easy-tocontrol, although in the early days of psychophysics the stimuli often were complex, everyday things that were “ecologically valid.” The stimuli in psychophysics are often incidental, and simply chosen on the basis of convenience and ability to control. In contrast, the stimuli in sensory evaluation are the major concerns. The stimuli tested by sensory scientists are complex, food-related, and relevant for everyday life. The subject or panelist is simply a means for a bioassay of the stimulus. The actual functioning of the sensory system is not of particular interest to the sensory scientist, other than contributing to understanding how to run a better test and how to understand the response to the stimulus.
103
104
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
Convergent Evolution Histories
-
Similar Methods But Different Intellectual
Despite the similarities between Sensory Science and psychophysics, the two disciplines enjoy radically different intellectual histories. Experimental psychology has a long and distinguished history, beginning with Fechner and Wundt in the 1800s and evolving for nearly a century and a half. A lot of experimental psychology in general , and psychophysics in particular was done with a scientific world-view in mind. This world-view looked for invariance or general, unchanging rules of perception. Thus, a lot of the early procedures developed by psychophysics were created to discover these general rules assumed to lurk within reach of the researcher. If the data could be encompassed by an equation then the data were even of more interest. Psychophysics is thus permeated with the search for organizing principles and "laws." Many of its methods, such as the cumulation of just noticeable differences to erect a psychological scale of magnitude, may seem archaic by today's sophisticated thinking (Fechner 1860). As a consequence of these attempts to understand the fundamental basis of perception, psychophysicists eventually created a corpus of knowledge now part of the public, refereed scientific literature. To a great extent the research reported by these scientists accumulated into a body of knowledge about perception functioning. The research is substantive - dealing with the topic of perception. Undergraduates and graduate students alike were to become familiar with the findings of these experiments. The actual procedures by which these findings were made were to become secondary, of interest in the experimental psychology laboratory, but not of particular interest to others with a basic interest in substantive matters. The education of students concentrated on the interconnections among these findings insofar as those data shed light on the way we perceive stimuli. We can contrast the foregoing with the development of Sensory Science. For many years Sensory Science comprised a potpourri of methods with relatively little content beyond the momentary application for which the method was used. Indeed, even the methods themselves were not quite well understood. They seem to be crafted half out of science, half out of convenience, with many methods having relatively little background in scientific theory. There was little science in the early methods. The focus was on measurement, without theory, in order to help make decisions, or in many cases to discover some physical correlate of a private subjective experience. Looking backwards today, we can see that the history of Sensory Science is the history of a set of test methods that found their use as adjuncts to more substantive research, especially in food science and chemistry. The objective of chemical research was to synthesize new molecules having interesting properties
METHODS VERSUS REAL KNOWLEDGE
105
- with the side issue being the taste or smell quality of the molecule and the threshold of taste (at which point the taste or smell was either just barely discernable, or the quality was just barely distinguishable). The objective of food science research was to understand the physical properties of food, and only secondarily to understand the sensory properties of those same foods, and the interrelation of the sensory and the objective domains. To be fair, in those early days Sensory Science was not considered a profession by itself. Many researchers felt that just about anyone with a sensory system in order could describe and scale the sensory properties of the food. Many of the practitioners were not professionally educated. Many of the reports in the early food science and cosmetic literature give the impression that the Sensory Science data were collected in an informal, almost haphazard way, comprising principally a description of the product characteristics, and little else. Just the words “taste testing” should suffice to indicate the relatively low esteem in which the field was held. With practitioners known affectionately as “taste testers” in the kitchen, it is no wonder that the field failed to develop. It was simply not sufficiently respected - no matter how much we try to deny this poor heritage. The Rapprochement
- 1970s and Later
Psychophysics and Sensory Science began to approach each other in the late 1960s and early 1970s. as a consequence of the appearance on the scene of many experimental psychologists, and the growing interest of psychologists in the chemical senses. The late 1960s witnessed the disappearance of job opportunities in academic psychology, and the inevitable migration of experimental psychologists into other areas where they could earn a living. Furthermore, in the 1960s, the chemical senses were the stepchildren of sensory researchers who had concentrated on the higher senses of vision and audition. Taste and smell were largely ignored, except perhaps by a few researchers (most notably Lloyd Beidler at Florida State University and Carl Pfaffmann at Brown University). By 1970, however, these forward-looking scientists produced a cadre of well-educated, scientifically grounded, students and post-doctoral fellows. Many of the students did their research in physiology, but a number became psychophysicists. The early 1970s saw the introduction of psychophysical methods to Sensory Science (e.g., magnitude estimation; Moskowitz and Side1 1971), and the participation of experimental psychologists in food science meetings (e.g., the Institute of Food Technologists). Experimental psychologists had typically attended these meetings, but it was only in the early 1970s that psychologists became highly visible. At that time it seemed natural for psychophysicists to
106
VIEWPOINTS AND CONTROVERSIES IN SENSORY SCIENCE
interact with food scientists and sensory scientists, especially for research tasks involving the study of the sensory responses to food. Part of the accommodation of psychophysics with Sensory Science came from the impetus provided by the U.S.Army, first at the Quartermaster Corps in Chicago, and later at the U.S.Army Natick Laboratories, in Natick (MA). The U.S.Army had always been interested in the acceptance of food, since food affects nutrition and morale. It was important for the army to understand what foods were liked and what foods were disliked. As part of its ongoing research program the army began to fund extensive food research programs, including within those programs the study of food acceptance on the one hand, and psychophysics of taste and smell on the other. Dr. Harry Jacobs in particular deserves mention and praise for the vision to hire a group of then young, newly minted psychophysicists working in the chemical senses. This cadre of young researchers, including the author, and two others, Linda Bartoshuk and Herbert Meisleman, was to become part of the Department of Defense food research program. Jacobs’ vision was to create a world-class organization of sensory researchers concentrating on taste, smell, and food preferences. Sensory scientists outside of experimental psychology, however, were both welcoming and rejecting. They welcomed interest and implicit professional validation by the psychophysicists, for as mentioned above the sensory scientist traditionally was viewed as a clerical individual who simply ran tests. Sensory scientists rejected what they considered to be novel ideas promoted by the psychophysicists, such as magnitude estimation scaling, because these were new, untested, and uncomfortable. Sensory scientists were more comfortable with procedure and method, rather than with substance and a corpus of knowledge. It would be 15 years, until the middlellate 1980s, before sensory scientists would truly welcome psychophysical thinking into the field, perhaps because by then a large number of psychophysicists had already become active.
REFERENCES FECHNER, G.T. 1860. Elemente der Psychophysik. Breitkopf und Hartel, Leipzig, Germany. MOSKOWITZ, H.R. and SIDEL, J.L. 1971. Magnitude and hedonic scales of food acceptability. J. Food Sci. 36, 677-680.
MAXIM0 C. GACULA, JR. This chapter deals with historical scenarios of the role of psychophysics in Sensory Science. For students and sensory scientists just starting a career in
METHODS VERSUS REAL KNOWLEDGE
107
Sensory Science, Moskowitz’s review is worth reading for I believe this subject is of great importance to Sensory Science. Sensory Science or sensory evaluation is an interdisciplinary field, the most important being food science, chemistry, psychology, statistics, physiology, and the subject matter areas of applications, i.e., dairy, cosmetics, foods, beverages, flavors and fragrances, wines, textiles and materials. As a result, leaders of today have varied educational training from various fields that contribute strongly to the development of Sensory Science. Moskowitz mentioned the U.S. Army Quartermaster Corps in Chicago that showed interest in food acceptance studies accommodating psychophysics and Sensory Science. It is worth mentioning that it was at the U.S. Army Quartermaster Corps that David Peryam, in collaboration with famous psychophysicists L.V. Jones and L.L. Thurstone, developed the 9-point hedonic scale of like/dislike (Peryam and Girardot 1952; Jones el al. 1955). By the 1980s, the role of statistics in Sensory Science was made clearly evident by the publication of books by statisticians and experimental psychologists (Gacula and Singh 1984; O’Mahony 1986). Also in the 1980s the knowledge that we learned from the interface of psychophysics, statistics, and Sensory Science led to the birth of two journals - Journal ofsensory Studies published by Food & Nutrition Press, and Food Quality and Preference published by Elsevier Science Ltd. The interfaces among the various fields will continue