Modeling Complex Systems
Volume 52 of the Nebraska Symposium on Motivation
University of Nebraska Press Lincoln and L...
47 downloads
1203 Views
2MB Size
Report
This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
Report copyright / DMCA form
Modeling Complex Systems
Volume 52 of the Nebraska Symposium on Motivation
University of Nebraska Press Lincoln and London
Volume 52 of the Nebraska Symposium on Motivation Richard A. Dienstbier Bill Shuart Will Spaulding Jeffrey Poland
Modeling Complex Systems Series Editor Volume Editors
Presenters Bill Shuart
Madonna Rehabilitation Hospital
Will Spaulding
University of Nebraska–Lincoln
Jeffrey Poland
Rhode Island School of Design / Brown University
Richard W. J. Neufeld
University of Western Ontario
Wolfgang Tschacher
University of Bern
Zeno Kupper
University of Bern
Susanne P. Lajoie
McGill University
Mark A. Musen
Stanford University
Eduardo Salas
University of Central Florida
Kevin C. Stagl
University of Central Florida
C. Shawn Burke
University of Central Florida
Gerald F. Goodwin
U.S. Army Research Institute
Michael J. Mahoney
University of North Texas
Modeling Complex Systems is Volume 52 in the series CURRENT THEORY AND RESEARCH IN MOTIVATION © 2007 by the University of Nebraska Press All rights reserved Manufactured in the United States of America International Standard Book Number ISBN: 978-0-8032-1387-6 (Clothbound)
The Library of Congress has cataloged this serial publication as follows: Nebraska Symposium on Motivation. Nebraska Symposium on Motivation. [Papers] v. [1]–1953– Lincoln, University of Nebraska Press. v. illus., diagrs. 22cm. annual. Vol. 1 issued by the symposium under its earlier name: Current Theory and Research in Motivation. Symposia sponsored by the Dept. of Psychology of the University of Nebraska. 1. Motivation (Psychology) BF683.N4 159.4082 53-11655 Library of Congress
Preface
The volume editors for this 52nd volume of the Nebraska Symposium on Motivation are Bill Shuart, Will Spaulding, and Jeffrey Poland. The volume editors coordinated the symposium that led to this volume, including selecting and inviting the contributors and coordinating all aspects of editing. My thanks to our contributors for excellent presentations and chapters. This symposium series is supported by funds provided by the chancellor of the University of Nebraska–Lincoln, Harvey Perlman, and by funds donated in memory of Professor Harry K. Wolfe to the University of Nebraska Foundation by the late Professor Cora L. Friedline. We are extremely grateful for the chancellor’s generous support of the symposium series and for the University of Nebraska Foundation’s support via the Friedline bequest. This symposium volume, like those in the recent past, is dedicated to the memory of Professor Wolfe, who brought psychology to the University of Nebraska. Richard A. Dienstbier Series Editor
Contents Bill Shuart, Will Spaulding, and Jeffrey Poland
Introduction
Richard W. J. Neufeld
Composition and Uses of Formal Clinical Cognitive Science
Wolfgang Tschacher and Zeno Kupper
A Dynamics-Oriented Approach to Psychopathology
123
Susanne P. Lajoie
Developing Computer-Based Learning Environments Based on Complex Performance Models
145
Mark A. Musen
Technology for Building Intelligent Systems: From Psychology to Engineering
185
Eduardo Salas, Kevin C. Stagl, C. Shawn Burke, and Gerald F. Goodwin
Fostering Team Effectiveness in Organizations: Toward an Integrative Theoretical Framework
245
Michael J. Mahoney
Constructive Complexity and Human Change Processes
ix
1 85
Editors’ Postscript: Modeling Complex Processes in a Rehabilitation Application
275
287
Contributors
293
Subject Index
307
Author Index
Introduction Bill Shuart, Will Spaulding, and Jeffrey Poland Madonna Rehabilitation Hospital; University of Nebraska–Lincoln; Rhode Island School of Design / Brown University Capturing the complexity of human behavior has been a recurring theme in the Nebraska Symposium on Motivation: We expect behavior to be patterned or integrated, and to make biological sense; and so patterning and biological utility are what we see. And of course what we see is actually there—behavior in general is not chaotic; it is organized. (Nissen, 1954, p. 314) When fundamental psychologists do make excursions into the human motivational world . . . it is rare that they survey the requirements for theory or pre-theory by intensive descriptive analysis of behavior related to such motives as produced by concrete human beings. More remote still is the chance that anyone will select for illustration, let alone analysis, behavior or experience relevant to man in his most characteristically human performances: man as he creates or loves or plays or responds to the aesthetic surfaces of the human and natural environment. Such matters are threateningly complex. (Koch, 1956, pp. 64–65) I have tried, first, to show that it is possible to formulate a meaningful theory of complex motivation by analyzing the
x modeling complex systems sorts of variables involved, together with their interactions. I have sought, second, to show that we possess, now, many sound and useful concepts and techniques to translate these complexities into productive experimental research. I suppose the moral is: be not afraid of complexity. If motivation is indeed complex, then let us find the means to cope with it. (Vinacke, 1962, pp. 42–43) Through the representation of a few very simple psychological concepts, in a rudimentary mathematical way, a good deal of complexity can be generated. . . . Let us now proceed to generate complexity from simplicity. (Burke, 1966, pp. 49–50) Although disorder may be experienced and expressed in highly patterned processes of human activity, it is diverse, individually unique, and systemic; we shall advance in our attempts at conceptualization and classification only as we are willing to embrace the limits of symbol systems to capture human uniqueness and the ultimate ineffability of complex system dynamics. (Mahoney, in this volume, pp. 265–266) The contributions to this volume of the Symposium describe contemporary approaches to the modeling of complex psychological and behavioral processes, ranging from molecular to molar phenomena. Although the contributions reflect a range of theoretical and epistemic perspectives, they all explicitly or implicitly incorporate complex frameworks of dynamic, system-like relations involving perception, learning, concept formation, emotion, motivation, intention, behavior, and the social context in which behavior occurs. One special feature of all the contributions from this particularly distinguished group of theorist-practitioners is an emphasis on practical applications of the conceptual frameworks in which they work. This reflects an important idea in the zeitgeist of the contemporary scientific community, that of translational research. Translational research is a process of translating the principles and truths that emerge from basic science into practical applications. The complexity of the processes captured in the contributors’ models enhances the models’ applicability to the complexities of clinical practice, industry, and education. To consolidate the relevance of application
xi Introduction and translational research, this volume ends with a volume editors’ postscript, describing a practical model for the complex processes of rehabilitation, as manifest in rehabilitation services currently evolving in Nebraska. Translational research demands, not just practical application, but continuity with theory and basic science. This converges with the historic role of the Nebraska Symposium as a prominent (and now the oldest sustained) forum for psychological theory. All the contributions in this volume emphasize the theoretical basis of application and the necessity of logical and conceptual continuity in understanding complex processes. In the first contribution Richard W. J. Neufeld discusses the advantages of formal mathematical theory for illuminating relations between variables as they interact in experimental science. He applies these advantages to the clinical practice of assessing cognitive impairments. Decrying a continuing overreliance in much psychological research on statistical analyses associated with Fisher and Pearson, Dr. Neufeld asserts that formal mathematical modeling of cognitive processes will, ultimately, lead to greater theoretical clarity about normal and abnormal cognition and better clinical-assessment techniques. It is noteworthy that, while the tradition of mathematical modeling in psychology has a long and honored past, the increasing availability of powerful computational tools (e.g., computers and analytic software) supports the kind of sophisticated modeling in the hospital or clinic that was impractical in earlier decades. At a more general level, Dr. Neufeld characterizes his approach as a novel form of construct validity, one based on the inherent mathematical properties of the cognitive processes he studies. In this sense his contribution is a sophisticated exemplar of the use of complex modeling to achieve traditional theoretical goals of experimental and clinical psychology, as articulated by such historical figures as Lee Cronbach and Paul Meehl. In the next contribution, Wolfgang Tschacher and Zeno Kupper provide a synthesis of dynamic systems theory and current cognitive science. Inspired by the historic role of Gestalt psychology in the evolution of cognitive science, their discussion invites us into the heart of psychology’s theoretical legacy. Drs. Tschacher and Kupper then apply their perspective and methods to the complex realm of psychopathology. They present data sets and analyses from recent
xii modeling complex systems research with people diagnosed with schizophrenia and demonstrate the importance of tracking individuals with multiple measurements over time in order to detect oscillations or trajectories in rehabilitation and recovery that would be missed in the typical cross-sectional approach. Using a time-series analysis, they identify unique patterns or dimensions of intrasubject characteristics that have complex but meaningful interrelations. Returning to theoretical principles, they show how complex, dynamic formulations can be translated into useful clinical instruments and methods. Finally, in a tribute to the Nebraska Symposium’s historic focus, their contribution culminates with a characterization of motivation as identical to the ongoing action of complex human cognitive processes operating to order and simplify a complex world. A second exemplar of complex modeling to achieve traditional goals is provided by Suzanne P. Lajoie. Dr. Lajoie uses theoretically grounded performance modeling in the development of computerbased “intelligent” tutoring systems designed to help learners master the complexities of real-world endeavors. Learning how experts go about problem solving and decision making through “cognitivetask analysis” is an important aspect in the process of developing an effective tutoring system. Dr. Lajoie highlights the importance of discerning experts’ relevant “dimensions of expertise” (e.g., self-monitoring), as expressed in a specific context, in developing effective models. She also emphasizes the importance of other variables, e.g., emotional, motivational, and social, and she describes strategies for determining what to model, whom or what should serve as the model, and how to model the content and/or process. She then translates these principles into design considerations for effective educational technology. The next contribution extends application of complex modeling from education to knowledge management. Mark A. Musen discusses past and current efforts to develop computer applications to support decision making and data representation in health care. Dr. Musen’s theory base is not psychology or neuroscience but artificial intelligence. His technology is the technology of computer engineering. Nevertheless, he envisions a future role for psychology in the development of artificially intelligent systems to manage our already enormous and rapidly expanding knowledge base. It is noteworthy in this regard that psychology has drawn from engi-
xiii Introduction neering as much as vice versa, from radar-inspired signal detection models of perception to band-filter models of attention to computer models of executive cognition. Herbert Simon, in his 1994 Nebraska Symposium on Motivation contribution, cited artificial intelligence as a promising model for human cognition. The impact of complex models for knowledge management may be in psychology’s future rather than its past. In the next contribution, Eduardo Salas, Kevin C. Stagl, C. Shawn Burke, and Gerald F. Goodwin scrutinize complex processes associated with small groups of people brought together for common purposes. They advance “the science of teams” by providing a detailed review of representative models of team performance in organizations and other naturalistic settings generated over the past quarter century. In their review, Drs. Salas, Stagl, Burke, and Goodwin find the invocation of input-process-output (ipo) models, consonant with the “general systems” framework that has influenced many areas in the social sciences during the past several decades, to be a key commonality among these models. There is greater diversity among models with respect to emphasis on internal team processes versus greater attention to the influence of external, contextual factors. The authors conclude that both influences are important and that, consequently, more sophisticated modeling techniques are needed to successfully deal with the resulting dynamic complexity, particularly in naturalistic settings. Drs. Salas, Stagl, Burke, and Goodwin then turn to a description and elaboration of a new and unique multilevel integrative framework for understanding team functioning. This new model is distinctive in the importance that it attaches to individual team members’ cognition as an important moderating variable as well as group decision making, shared mental models, and external factors. Michael J. Mahoney’s contribution is a nuanced interlacing of several kinds of “models,” including verbal metaphor, narrative, photography, and poetry. Dr. Mahoney discuses various perspectives on “complexity” theory and its precursors in philosophy and science, including current theoretical frameworks such as dynamic systems theory, complexity studies, and chaos theory, placing them in the context of the history of ideas. He describes and elaborates on constructivism, an integrative framework and family of theories. Dr. Mahoney’s contribution includes two appendices. The first provides
xiv modeling complex systems a synopsis of important aspects of human change from the perspective of constructivism. The second provides rich and provocative perspectives for incorporation in the practice of counseling, psychotherapy, coaching, and other educational pursuits.
Complexity, Systems, and the Nebraska Symposium on Motivation: A Brief History of Ideas The perspectives reflected in this volume are exemplars of an evolving set of conceptual frameworks that influenced thinking in many areas of science during the second half of the 20th century. These frameworks are most generally associated with general systems theory, and addressing complexity is one of their key common features. Having recently celebrated a half century of the Nebraska Symposium on Motivation, as this volume’s editors we saw a useful purpose in reviewing the more than 300 individual contributions that constitute the previous volumes, to identify ideas that anticipate or shape the approaches to complexity that we find in contemporary work. We found a richness of such ideas, so many that only a few can be highlighted here. The remainder of our introduction to this volume is a review of five especially resonant contributions from volumes past: Heider (1960), Walker (1964), Leeper (1965), Newcomb (1953), and Barker (1960). We selected contributions that, in addition to showing the nascent ideas about complexity and systems theory discussed in this volume’s contributions, have clear relevance to practical application and translational research and especially to our own particular interests in physical medicine and psychiatric rehabilitation. One common characteristic of systems theories is an organizational scheme that orders specific mechanisms and processes according to their respective complexity. Two terms from classic learning theory, molar and molecular, serve to define the poles of these schemes. Processes and mechanisms are molar rather than molecular to the degree that they represent the integrated interaction of multiple components. Psychology itself reflects this type of ordering, ranging as it does from theories of neuronal activity to neuropsychology to the psychology of social cognition and interpersonal behavior. The historical Nebraska Symposium contributions reviewed here follow
xv Introduction a molecular to molar rather than a chronological sequence. Interestingly, contributions from common theoretical perspectives can differ with respect to the molecular-molar dimension. Heider (1960) and Barker (1960) integrate classic Gestalt principles with subsequent theories, but Heider addresses comparatively molecular expressions of key processes, while Barker is at the other end of the continuum, addressing “spontaneous” organizational processes at the level of a human community. Other contributions to be reviewed address system organizational processes at the cognitive level (Walker, 1964), the emotional level (Leeper, 1965), and at the social/interpersonal level (Newcomb, 1953). We have included extended excerpts from the original contributions, in an effort to preserve the style and tone of the original presentation. Also, we hope to provide enough of the language in sufficient detail for readers to draw their own conclusions about the relation of the historic ideas to those of the present volume. However, these passages cannot fully convey the logic or the eloquence of the source materials. The reader is encouraged to consult the full chapters in areas of particular interest.
Fritz Heider (1960) Many Symposium contributions have included Gestalt psychology frameworks offering concepts and models that resonate with contemporary perspectives (e.g., self-organizing systems) that, in many cases, evolved from earlier, traditional Gestalt investigators. An exemplary illustration is Fritz Heider’s “The Gestalt theory of motivation” (1960). Heider’s work has been more influential on certain theorists than the relative paucity of scientific citations would indicate. George S. Klein, then editor of the journal Psychological Issues (itself representative of the rise of interest in ego functioning in the psychoanalytic literature the 1940s and 1950s), provides a brief preface to a set of selected papers published as Fritz Heider’s monograph On Perception, Event Structure, and the Psychological Environment (1959). In addition to describing Heider’s unique viewpoint, Klein’s comments highlight important aspects of the view of rehabilitation and the notion of participation as an important goal of rehabilitation (World Health Organization, 2001). The
xvi modeling complex systems ideas presented have direct relevance to current models of rehabilitation and crucial aspects of participation and quality of life, each intimately associated with the behavior settings available to the individual, the quality of his or her social networks, and other variables that will be discussed in the final section of this introduction. According to Klein (1959): “Fritz Heider’s work . . . has had over the years a significant, if relatively unobtrusive, impact on some of the most important theorists of our time, notably Kurt Koffka, Kurt Lewin, and Egon Brunswik. More recently, Heider’s influence has been detectable in perception theory, for example, in the work of James Gibson. Still, his writings cannot be called ‘popular’” (p. v). Klein continues: Heider’s emphasis on the “macrophysics” of things (in contrast to the reductionist emphasis on microphysics), the important distinction he develops between those parts of the environment which mediate (“medium”) and those which are mediated (“thing”), his analysis of how we may distinguish behavioral events attributable to the structure of the environment and those attributable to the structure of the perceptual system—all of these merit close study. . . . Throughout the papers the composition of a “unit”— whether spatial, temporal, or causal—is of central importance to Heider’s distinction between “thing” and “medium.” The defining properties of a “unit,” therefore, come in for extended and penetrating analysis. . . . Heider has made [an attempt] to penetrate the essential nature of the concept of structure. The general macrostructures which he describes may apply to their subjective counterparts in ego organization. . . . A unique feature of Heider’s approach is his attempt to fathom environmental structure not from the response side— from the inside outward, as it were, as is common in psychological theories—but from the outside inward, that is, by specifying the architectural rules of the extrapersonal world of physical object and event units. The result, then, is an extraordinarily fresh confrontation of the external structures which are assumed but never specified in psychoanalytic notions of reality testing and adaptation. (p. vii)
xvii Introduction In his Symposium contribution Heider provides an overview of four “thought models or schemata” characterizing the Gestalt tradition at the time. Heider terms the initial model the classic Gestalt theory. The model is based on the work of investigators such as Wertheimer, Köhler, and Koffka. Describing this model, Heider highlights a number of aspects of this perspective that bring to mind such concepts as patterning and perceptual organizing processes that seem quite consistent with concepts used today. Heider begins by emphasizing the Gestalt concept of good figure, advanced by Wertheimer, who applied it to visual processing: This principle states that the perceived figure tends to be as good as the stimulus pattern will allow, or as Koffka says: “Psychological organization will always be as ‘good’ as the prevailing conditions allow. In this definition, ‘good’ is undefined. It embraces such properties as regularity, symmetry, simplicity and others. . . .” For instance, slight irregularities in the shape of visual forms are usually not noticed. Kohler gives the following example: Faces of people usually appear to us symmetrical, in spite of the fact that they are rarely objectively symmetrical. We may notice this irregularity in another person’s face when we look at his mirror image; but ordinarily we don’t see it. Kohler has called attention to the fact that a tendency towards simplicity can also be observed in physical systems, as, for instance, Ernst Mach has pointed out. Kohler gives many examples in his book on Physical Gestalten [1924]. . . . Let us recapitulate: Wertheimer observed the tendency toward good form with percepts; Kohler then related this observation to a similar tendency found in physical systems. Of course the same tendency is then assumed to rule the process in the physiological brain field. Since isomorphism is assumed, all this fits very well together. The thought model is one of a complex process with many part events which interact in such a way that a certain endstate is reached, an end-state which is in some way distinguished, and which has characteristics the other possible states do not have; as long as this end-state is not reached something will happen. On the other hand, when it is reached, the process attains an equilibrium and nothing more will happen.
xviii modeling complex systems Furthermore, the end-state will come about regardless of what the beginning state of the system is: thus one can talk about a tendency, which implies direction, a reaching of the same endstate by different routes. (Heider, 1960, pp. 145–146) Heider follows his discussion of Köhler’s ideas with a perspective from Kurt Koffka: It is not surprising that Gestalt psychologists have applied this same thought model to behavior. For instance, Koffka does so in his book on The Growth of the Mind, which first appeared in 1921. I should mention that Koffka uses the term “closure” for the distinguished end-state, a closed figure being a better figure than an open one. Tendency to closure is therefore only another name for tendency toward simplicity, or goodness of figure. This is what Koffka says (Koffka, 1925, p. 103): . . . The characteristics of closure . . . belong not merely to the phenomena themselves, but likewise to the behavior taken as a whole, including all reactions made to the environment. Instinctive activity then becomes an objective mode of behavior analogous to such phenomena as rhythm, melody, and figure. . . . He [Köhler] calls the state toward which the processes in the organism are directed a “standard state.” It has to be distinguished from the state of equilibrium (Kohler, 1938, p. 325), and he describes it as follows (Kohler, 1938, p. 303): The essential characteristic of regulation is an invariance of direction. Whatever initial configuration may obtain in those systems when we begin to observe them—if we observe long enough their inner displacements or transformations will always be found to bring them nearer to a standard status. The word “standard” points here to the fact that the final status is independent of the initial configuration. . . . Essentially . . . the thought model of a system tending towards a standard state is applied to directed action, and this model had its origin in the principle of good figure. However, . . . when we try to find out how it is carried out, we see that
xix Introduction two steps are necessary for the transition from the phenomena of the visual field to action. First, we have to take into account not merely perceptual appearances but a space in which behavior occurs; and secondly, we have to consider the objective environment, and the way the organism effects changes in it. . . . Thus we have to substitute for the visual field what Koffka called the behavioral field and Lewin the life space. This behavioral field is conceived of as having similarities with the visual field. It also is a system containing a great number of part processes which interact, it exhibits forces and tensions, and tends to arrange itself in such a way that a distinguished end-state is reached. This distinguished end-state, in some way comparable to the simple figure, is the state of the person who has reached the goal in his life space. Now, this life space or behavioral field is a concept which involves many difficulties and unsuspected depths and snares. . . . I can only say that in a first approximation, which, however, is not entirely correct, one can conceive of it as representing the environment of the person as the person himself experiences it—and it is in some way related to the brain field, to physical processes going on in the brain. The Gestalt psychologist would characterize this relation as one of isomorphism, i.e., of structural similarity. This is the first step we have to accept when we apply the principle of good form to activity: namely, the step from perceptual to behavioral field. The second step requires a more extensive consideration. So far we have only considered processes which are “inside” the organism in some way, which are “encapsulated,” as Brunswik says. How is it possible that they produce effects outside the organism, in his physical environment? We assume that this behavioral field changes in the direction of a distinguished state, maybe a state of minimal tension, i.e., the state of the person being at the goal. But . . . we have to understand how the tension in the behavioral field makes the person reach the goal in reality. (Heider, 1960, pp. 147–149) He later continues: In action, not only a part of the organism, but the whole organism is involved. . . . The idea of the feedback or circular process
xx modeling complex systems can be applied also in this case: as long as the person has not yet reached the goal, there is a tension in the behavioral field; this tension is communicated to the executive system, which changes the relation between organism and objective environment in such a way that the goal is reached; via perception this objective state is communicated to the behavioral field; and thus the tension in this field is removed. I have used the term “feedback” to characterize this process. However, one has to keep in mind that this circular process is not a simple feedback process. What distinguishes the circular process of Gestalt theory from simple feedback is the interpolation of the behavioral field with its tendency towards a distinguished state [emphasis added]. (p. 150) Heider goes on to describe two models advanced by Kurt Lewin—the person model and the environment model, together constituting what Heider terms Lewin’s spatialized psychology. He notes the move from the perceptual sphere to the behavioral realm in Koffka’s work and what Lewin terms the life space. Heider’s discussion of Lewin’s concepts is thought provoking, and the reader is encouraged to review those concepts in the source material. Heider then offers a relatively brief summary of his own recent theorizing, describing what he calls his balance theory, which he feels answers some questions left inadequately treated by the classic Gestalt theories he has summarized: This theory of balance deals mainly with configurations consisting of a number of entities between which exist certain relations. The entities can be persons—the own person or other persons—and other entities, as for instance, things, situations, or groups. The relations considered are mainly of two sorts: on the one hand attitudes of liking or disliking, and on the other hand unit relations of belonging. The main idea is that certain of these configurations are preferred, and that, if circumstances allow, they will be realized by the person either in such a mental reorganization as wishful thinking, or in an actual change through action. . . . In recent times a number of theories have been proposed which are similar to the one just outlined. I remind you, for instance, of Newcomb’s (1953) discussion of processes of com-
xxi Introduction munication [see below]. . . . These conceptions, symmetry, consonance, balance, and simplicity, are, of course, implied in that idea with which Gestalt theory started and which always was central to it, namely, the idea of a ‘good’ figure. We therefore have returned to the model we considered first. This model implies a number of different entities with certain properties and standing in certain relations, which make up a constellation of factors tending toward a standard state. The properties of these configurations which determine their meaning and their fate are whole-qualities. Consonance or simplicity of the structure cannot be derived from the properties of the parts . . . If we study the p-o-x system1 which is composed of the own person (p), another person (o), and an impersonal entity (x), then we find that the state of balance depends on the attitudes of p toward o or x. That is, the attitudes toward the parts of the configuration, and the relation of these attitudes to each other enter as significant factors, and determine the attitude toward the whole configuration. . . . Thus, we are able to specify more exactly the conditions of goal selection, at least in some cases. The goal is not taken to be an unanalyzed entity which in some way acquired valence, but is derived from the properties of the structure [emphasis added]. . . . [The] difference between Lewinian theory and balance theory [is] in regard to the role structure plays. In Lewin’s environment model . . . structure is not intimately connected with the conditions of tendencies, nor with their effects. Structure helps us to derive the direction toward means from direction toward goal; but it does not help us to derive the direction to the goal. . . . . . . Thus we see that in these [Lewin’s] models the dynamic factors are not very closely linked with structure. Neither do the properties of the structure imply forces, nor do the forces affect the structure in a specifiable way. In the balance model the dynamic factors are intimately connected with the structure. The dynamic factors arise out of definable structural characteristics and the forces toward the standard state tend to change the structure in definite directions.
xxii modeling complex systems . . . [Unlike Lewin’s models], in the balance model structure in a state of equilibrium is definably different from one in a state of disequilibrium, and all the parts of the structure are relevant to this difference, not only the relation between two parts, person and goal. (Heider, 1960, pp. 167–170)
Edward L. Walker (1964) Edward Walker’s contribution to the 1964 Symposium, entitled “Psychological complexity as a basis for a theory of motivation and choice,” is generally congruent with Heider’s (1960) views, though the terminology employed by these scholars and the associated research traditions from which they come are quite different. Walker (1964) provides a concrete example of model building as well as an interesting perspective on the concept of complexity and mechanisms that contribute to the organization and self-regulation of behavior at the level of the organism. Also, as with Heider’s view, mechanisms of perception, cognition, learning, adaptation, and motivation are all seen as quite interdependent and quite closely related to environmental stimulus context. Walker states at the outset: This paper is an attempt to state what I believe to be the most basic questions of behavior theory, to elaborate the concept of psychological complexity as a potentially unifying concept, and to test its clarifying contributions with respect to some critical problems of behavior theory. The three basic questions of behavior theory are . . . 1. What is the mechanism that terminates an event? 2. What are the determinants of the next event? 3. What is the fate of an event after it is terminated? (Walker, 1964, pp. 48–49) He follows precedent in setting the temporal length of a psychological event at 0.5 seconds. Then he asks: When an event is terminated, what are the determinants of the next event? A great many subareas of psychology are devoted to an effort to discover and quantify the determinants of choice behavior. . . . “Habit,” “motive,” “subjective probability,” “util-
xxiii Introduction ity,” “set,” “attitude,” and “trait,” along with many other concepts in psychology, are reducible to names of intervening variables or theoretical constructs, each related to different sets of operations, but all, ultimately, determiners of choice behavior. It will be the argument of this paper that the concept of psychological complexity can be used to account for the termination of psychological events, and the choice of the next event over a wide range of traditional concepts of determiners of choice. Thus, the concept of psychological complexity can be useful in answering the first two of the three basic questions. Psychological complexity can also be used to account for many of the phenomena associated with the trace of a past event, but this third basic question or problem is beyond the scope of the present paper. (pp. 51–52) Under the subheading “Psychological Complexity Theory,” Walker asserts: The major distinction that must be made is between “stimulus complexity” on the one hand and “psychological complexity” on the other. The first is a characteristic of the external stimulus, more or less independent of the individual organism. Psychological complexity is a characteristic of the event itself, the organism’s response. Psychological complexity and neural process complexity will be assumed to be completely isomorphic. (Walker, 1964, pp. 52–53) In the context of a basic definition of terms, he turns to an elaboration of his concept of psychological complexity: Psychological complexity is a characteristic of the event itself and is thus a characteristic of the interaction of the organism with the distal stimulus when the event in question is initiated by a stimulus. Thus it is possible for two organisms to react with equal psychological complexity to stimuli with very different distal stimulus complexity values. The same organism may also react with different degrees of psychological complexity at different times to the same stimulus. (pp. 54–55) Walker offers a brief description of the (assumed) underlying nervous system basis of the experience of optimal complexity, under the heading “Neural Net or Neural Process Complexity”:
xxiv modeling complex systems Underlying any psychological event, is, of course, a pattern of neural events. Such events are spatially three dimensional and occur over a finite period of time, a fourth dimension. It is assumed that variation can occur in the relative complexities of two neural processes. We shall refer to the relative complexity of a four-dimensional neural process as the relative complexity of the relevant neural net. Furthermore, we shall assume a complete isomorphism between neural net complexity and psychological complexity (Walker, 1964, p. 55). He offers as relative characteristics of simple versus complex neural net in terms of the four dimensions noted above: “simple” nets consist of processes that are relatively “small,” “short,” “focal,” and “central” (i.e., origin within the central nervous system); “complex” nets are relatively “large,” “long,” “diffuse,” and “peripheral.” Having offered a neurologically oriented substrate, Walker turns to the concept of psychological complexity itself. Under the heading “Optimal Complexity,” he asserts: The key concept of the theory I am attempting to fabricate is the concept of optimal complexity. The simplest and most straight forward psychological definition of optimal complexity is the following: Optimal complexity is that degree of psychological complexity the organism will seek to maintain. If a psychological event is more complex than the optimum, the organism will behave in such a manner as to reduce the complexity of the event. If a psychological event is less complex than the optimum, then the organism will behave in such a manner as to increase the complexity of the event. Optimal complexity can be bracketed by other values of psychological complexity. In perception, an input level far above optimum produces “mental dazzle.” A lower limit is a level of complexity that is below the threshold of consciousness. In motor activity, psychological complexity far above optimum results in discoordinated tetany, and there is a lower value which constitutes the threshold for action. The optimum is a “normal” percept or a smoothly coordinated movement. . . . The sequence is inevitable and the fall in neural net complexity is an automatic result of observable and fairly well understood neurophysiological characteristics. Since neural net
xxv Introduction complexity and psychological complexity are assumed to be isomorphic, psychological complexity may be said to rise and fall as well. With a sufficiently complex stimulus, psychological complexity will rise to and exceed the threshold of consciousness, will rise to and exceed optimal complexity, will fall below optimal complexity, will then drop below the threshold of consciousness automatically, and will usually be followed by another psychological event. [The reader] will recall that the first of the three basic questions of behavior theory was: What is the mechanism which terminates an event? The answer is: Whether the stimulus for an event is continued or not, a psychological event undergoes a sharp and automatic drop in complexity during a period of approximately one-half second after its initiation. (Walker, 1964, pp. 56–58) With respect to repeated activation of an event, he asserts: Repeated activation of a neural net will result in a progressive decrease in the psychological complexity of the event involved. (p. 59) With respect to the second major question (What are the determinants of the choice of the next event?), he continues: The principle of optimal complexity incorporates the dynamism that the organism will seek such a level. The termination of one event occasioned by the automatic reduction in its psychological complexity below the optimum level, literally forces choice of that event among available next events which will be nearest optimum. Therefore: Among available alternatives, an organism will choose as a next event that activity which is nearest optimal psychological complexity. It is assumed as a working hypothesis that many of the major determinants of choice behavior such as reinforcement, habit, motivation, curiosity and other collative2 variables, subjective probability and utility, and others ultimately can be reduced to a single concept—psychological complexity. (p. 60)
xxvi modeling complex systems Walker offers a brief recapitulation: The theory can be stated in an abbreviated form. During the course of a psychological event that has a duration of approximately 500 [msec], the psychological complexity of the event rises abruptly and falls more slowly. The automatic reduction in the psychological complexity of an event insures that it will drop promptly below the optimum to be replaced by that one of the available alternative events which is nearest optimum. The psychological complexity of alternative behaviors or events will be a function of four variables. They are: (1) the stimulus complexity of the initiation stimulus; (2) the time since this particular event has occurred previously; (3) the number of times that event had occurred before; (4) the arousal properties of the stimulus or event. (Walker, 1964, p. 60) Walker addresses the issue of what behavior(s) might be expected when no near-optimum event is present. In the case of all available alternatives below optimum, an individual might commonly respond in one or more ways (slightly adapting Walker’s text): 1. Search the environment or his own repertory for more complex events; 2. Find a more complex stimulus in the environment to which he had not attended previously, or he might fall to daydreaming; 3. React by locomoting, getting up and moving about; 4. Seek arousing stimuli; 5. Seek to differentiate previously unexplored potential complexity in his environment or in old thought sequences and problems. All of these devices would serve to increase the complexity level of the sequences of events which are occurring. All would serve to move the sequence nearer an optimal level of complexity. (Walker, 1964, p. 61) At the other extreme: Situations in which the psychological complexity levels are above optimum are usually situations in which the sensory inputs into the nervous system are providing more information than the organism can process. This may result when the exter-
xxvii Introduction nal environment is too complex, when the problem one is working [on] is beyond immediate solution, or when the motivational or emotional system is in a highly aroused state. (pp. 61–62) In such circumstances, he notes common reactions: 1. The organism may shift attention or narrow attention to a limited portion of the stimulus input; 2. If the overload is of external origin, the organism may locomote to a less complex circumstance; 3. If either are difficult or impossible, the organism may attend repeatedly to the same stimulus in an effort, usually successful, to produce a reduction in the psychological complexity of the situation through repeated activation of the relevant event; 4. An associated result of repeated activation is to organize a very complex stimulus into a smaller number of “chunks.” (p. 62) Walker’s contribution concludes with a survey and critique of relevant research and theoretical distinctions to provide support for and elucidation of the conceptual framework adduced therein. He buttresses his concept by applying it to existing experimental data that are not easily explainable by any other existing theory. For example, he applies his theory of optimal psychological complexity to the often-observed (but less frequently reported) decremental variations in “conditioned responses” following “learning” experiments that have been taken by many to be unexplainable anomalies. After noting a few such “anomalous” observations: For the sake of the argument I am certain to get, let me take the position that the appropriate “learning” curve shape in running studies, conditioning studies, and selective learning studies, is one that rises and falls to zero or to a steady level below the maximum performance. The curve that rises to a steady maximum and remains there indefinitely is likely to be rare. The reason that we see few “learning” curves of the postulated type is that most experimenters know in advance what a learning curve is supposed to look like. As a result of this knowledge, they stop training when the “asymptote” is reached, or, if they obtain a curve which does not fit their conception of what one should look like, they find a great many other ways to respond
xxviii modeling complex systems . . . other than to publish their sin against respectability. They throw away their data. They restructure the apparatus. They change the parameters of the study. They change the design. This process is known as the establishment of experimental(er) control. Sooner or later they manage a situation in which they obtain the “right” answer. I can attest that this process is carried out in good faith and under the assumption that in so doing, one is behaving like a sound, rigorous, and careful experimentalist. I can attest to this because I am one of the sinners. Thus psychological complexity theory handles the usual learning curve, extinction, and the drop in performance that often occurs under continued reinforcement. It predicts that most experimental situations will produce a drop in performance if training is continued. (Walker, 1964, pp. 85–86) In later comments concerning Walker’s presentation, his fellow presenter, Frank Logan, in addition to suggesting caveats to the former’s views, concludes with an important observation: There are several features of Walker’s approach with which I am in strong agreement. A language that avoids the artificial separation of stimuli and responses more nearly captures the unified, interdependent inseparability of psychological events. It is also becoming increasingly recognized that the fundamental behavioral operation of an organism is selection or choice. . . . Walker’s attempt to develop a system that can deal with behavior dynamically, i.e., continuously over time, is perhaps the critical feature necessary to achieve a general integration. And, by whatever means, visualizing such disparate concepts as habit, motivation, and decision-making in terms of a single construct certainly is one we should applaud. (Logan, 1964, p. 98)
Robert Ward Leeper (1965) Robert Leeper’s contribution, “Some needed developments in the motivational theory of emotions” (1965), is focused on urging greater attention to understanding emotions as motivational factors, rather than “lower,” simply “energizing” or “arousing” factors that are then guided by “higher-order” functions (e.g., perception and/
xxix Introduction or cognition). In fact, Leeper highlights the ultimately inseparability of processes of perception, motivation, and emotion: Still earlier, David Krech (1949, 1950a, 1950b, 1951), in his usual impassioned style, had reasoned that it is unrealistic to conceive of psychological phenomena in terms of separate processes of perception, motivation and learning. Instead, he urged, we ought merely to conceive of “Dynamic Systems.” These, he said, are so definitely organic unities that no single aspect of such a system can be changed without changing the other aspects as well—we have been dealing in myths in believing that we could vary some one of these aspects while keeping the other aspects constant. Though proposing a less drastic statement on this point, E. C. Tolman (1932, 1948) had been suggesting some perceptual factors in motivation in his view that motivation is partly a matter of reward expectations and punishment expectations. Kurt Lewin similarly had been discussing many problems of motivation in terms of factors in the organism’s “psychological environment.” . . . In my own previous writing, my original paper on a motivational theory of emotion (1948) was extended to some extent into the perceptual-motivational theory which has been elaborated in the present paper. . . . One odd fact about these various earlier discussions of a perceptual or conceptual interpretation of motivation is that their authors have made practically no references to the related ideas of the other papers. This is the more surprising in view of the fact that most of this group are more or less closely related to one another both personally and as regards their general theoretical outlooks and interests. It seems, therefore, as though each of these persons had to grope to the concept on his own, even though possibly helped in ways that he did not recognize by his predecessors or colleagues. I make this suggestion with somewhat more confidence because I remember that, in my own case, when I first read Krech’s papers on “Dynamic Systems,” they did not make much sense for me. . . . And, peculiarly, it took me a long time to recognize that Lewin’s ideas might be thought of as a perceptual theory of emotion. . . . Maybe this sort of thing will continue to be the case. If a perceptual theory of motivation is to become more common,
xxx modeling complex systems perhaps each psychologist will have to figure it out for himself. (Leeper, 1965, pp. 111–112) Leeper summarizes some major themes: The suggestion that comes from a number of sources, therefore, is, first of all, that emotions are motives, and then, second, that emotional processes, along with all other motives, are perceptual or representational processes. The suggestion that comes is that emotions and other motives do not exist or operate in any less complex sense than this. . . . Even though perceptual habits are hard to change in some cases . . . it seems that all perceptual habits can be modified by learning and that sometimes such modifications can occur suddenly and dramatically. If emotional habits are perceptual habits, these same possibilities should exist for them. (pp. 113, 115)
Theodore Newcomb (1953) Theodore Newcomb’s contribution, to the very first volume of the Symposium, was “Motivation in social behavior” (1953). Newcomb makes clear that he does not believe that a psychology of motivation in social situations should be fundamentally different or discrepant from a general psychology of motivation. Rather, it should be subsumed by a broader model of motivation that describes human motivation in any situation. However, he also notes that the breadth of such an overarching model would not lend itself to making predictions or heighten understanding of specific processes or variables within a particular subdomain of psychology in general (e.g., individual behavior in a learning situation; behavior in a social situation): A general theory, whether of motivation or of evolution of species, is never specific enough to predict within a specific area those details in which we are often most interested. Indeed, it is from the relatively limited theories that the relatively inclusive theories must in the long run emerge. (Newcomb, 1953, p. 139) The relevance of his contribution to the topic of self-organized systems is seen in his analysis of the dynamics or organization of communicative behavior in an interpersonal context.
xxxi Introduction Newcomb goes on to define terms and delimit his focus to communicative behavior between individuals: The properties of objects may be studied either objectively or phenomenally—preferably in both ways—but in any case, they are studied not as things-in-themselves, but as related to persons. Thus the characteristic way in which social psychologists study motivation is in terms of person-object relationships (the term “object” includes other persons, of course). Since, as we have all learned in recent years, motivational phenomena are intimately interlinked with perceptual phenomena, it is often necessary to distinguish two aspects of person-object relationships, which may be labeled the cathetic and the cognitive. Often, however, one does not need to make this distinction, while still bearing in mind that both aspects are involved, and in such instances the term “orientation” is a useful one. The term is similar to the concept of “attitude,” except that it connotes “existing directedness” and not merely a predisposition or a readiness. Orientations are known, of course, only as they are inferred from observable behavior. Insofar as such behavior involves reciprocal stimulation and response (or anticipations thereof) it is traditionally referred to as “interaction.” But one cannot observe interaction-in-general; one must observe discriminable units of behavior. I propose, therefore, to use as such an interaction unit the communicative act, defined as any observable behavior by which information, consisting of discriminative stimuli, is transmitted from a human source to a human recipient. For present purposes, it is assumed that the discriminative stimuli have an object as referent. Thus in the simplest possible communicative act, one person (A) transmits information to another person (B) about something (X). Human social behavior is thus to be studied in terms of the conditions and consequences of varying communicative acts. And problems of motivation in social behavior are to be studied in terms of orientations toward the two kinds of objects necessarily involved in communicative acts—i.e., persons as recipients of transmitted information and objects (including persons) as referents of transmitted information. The relationship between orientations and communicative acts, as we shall see, is a
xxxii modeling complex systems circular one, so that it will be necessary to consider each of them, in turn, as varying with the other [emphasis added]. (Newcomb, 1953, pp. 140–141) Following a second section summarizing relevant findings concerning group membership, orientations, and communication, Newcomb moves to a section titled “Communicative Behavior as Varying with Orientation toward Persons and toward Objects.” In this section he explicates the systemic relations between communicative acts and the orientations of individuals in a communication setting: I can hardly imagine anything that would surprise you less than to hear that communicative acts are learned in ways that seem to have something to do with rewards and punishments. I shall stop, however, only to indicate in the most general kind of way what seems to be the nature of the learning conditions of communicative behavior. These conditions have to do with what I have already referred to as the individual’s necessity for co-orientation—i.e., relating himself simultaneously both to objects and to persons as actually or potentially related to those objects. . . . We may start with the assumption that orientations both toward persons as potential co-communicators and toward other objects have adaptive value; not to be oriented to them would mean to have no cognitive content regarding them and to have no “hypotheses” (in the Postman-Bruner sense) as to their potentialities for reward or punishment. The further assumption that co-orientation has adaptive value stems from what I believe to be the fact that neither kind of orientation occurs singly and independently of the other, in connection with communicative acts. First, the orientation of any communicator, A, toward B, a potential recipient of his communication, rarely, if ever, occurs in an objectless vacuum. . . . Secondly, and conversely, the orientation of the communicator, A, toward almost any conceivable X rarely, if ever, occurs in the total absence of an orientation toward B, the potential recipient of his communication. (“Autistic” verbalization, of the kind Piaget reports in young children, would, of course, represent an exception . . .). The very fact that B is a potential recipient requires some kind of orientation toward him. . . . Al-
xxxiii Introduction most invariably, moreover, there is included in this orientation toward B some assumption—however accurate or inaccurate— about B’s orientation toward the object of communication. From this elaboration of what is perhaps only too obvious, I want to deduce a single point—that there is a necessary interdependence between co-orientation (which itself involves an interdependence of orientations) and communicative acts. . . . Since, according to these assumptions, there are relationships of interdependence among several distinguishable orientations, it is convenient to regard them as together constituting a system. For some purposes the system is best treated as an objective one—i.e., a model employed by the observer. The elements in this system are, minimally, A, B and X (a source, a recipient and an object of communication); the interdependent orientations among them are A’s toward B and toward X, and B’s toward A and toward X. . . . The implications of this model are: (1) that while at any given moment the system may be conceived of as being “at rest,” it is characterized not by the absence but by the balance of forces; and (2) that a change in any part of the system may lead to changes in any of the others. I shall make one further set of assumptions about the system. . . . These assumptions are that (under the stated conditions) communication tends to result in increased similarity, or congruence, of A’s and B’s orientations toward X, and that, as a result of learning, communicative acts are instigated by the anticipation of increased similarity or congruence (or, alternatively, by the threat of decreased similarity or congruence). (Newcomb, 1953, pp. 147–149) After positing adaptive advantages of his concept of congruence, he goes on to articulate an important aspect of his “A-B-X” system, which he considers a “strain toward congruence” (p. 149). The systemic perspective of Newcomb’s contribution and his initial observations of the relation between explanations/models at the level of subareas of psychology concludes with a view to the future: I should like to suggest (with a good deal of tentativeness) that something along the lines of the framework of co-orientation which I have roughly sketched out may find a place in
xxxiv modeling complex systems general motivation theory. Many, among the higher forms of animal life, at least, are capable of plural orientation, and the actual direction of behavior at any given moment often cannot be accounted for in terms of any single object-orientation, others being held experimentally or hypothetically constant. . . . I suspect that the study of social behavior can provide evidence, in ways other behavior cannot, of how behavior directedness varies with multiple orientations. If so, an adequate theory of motivated social behavior will have contributed something to a general theory. Last, and far from least, an adequate general theory would take fuller account than it does today of self-orientation. . . . Here, as in the case of other concepts of peculiar relevance to social motivation, it is my belief that more extrapolations from a general theory will not suffice. Theorists from McDougall and Freud to Murphy and Rogers have properly accorded to the self a central place; though not always, in my judgment, have all of them seen that place in its full social context. Not only are self-orientations part and parcel of other-orientations, I would insist; they are inextricable from the eternal triangle of self, other persons, and the common environment. A general theory of motivation, when it is mature enough to include these interdependent orientations, will have borrowed from a theory of motivation in social behavior, as well as helping to establish it. (Newcomb, 1953, p. 159)
Roger Barker (1960) Roger Barker’s contribution, “Ecology and motivation” (1960), includes an account of alteration of individual state(s) as a function of external, higher-order patterns or change. Like Heider and Newcomb, Barker underscores the necessity of taking individual and environment into account as a unit in any thorough analysis of behavior, and, hence, his contribution advances themes consistent with the conceptual frameworks advanced at the 2004 Symposium. Barker’s conceptual framework is like that of Heider (1960) and Kurt Lewin’s concepts of field and life space (Lewin, 1938). This provides an intellectual context in which to consider the importance of taking both in-
xxxv Introduction dividual and environment into account. At a practical level, this resonates with major themes in rehabilitation, for example, the World Health Organization’s recent emphasis on the construct participation as the ultimate aim of rehabilitation efforts (see World Health Organization, 2001). This construct is of importance because it underscores the importance of including assessment and modification of an environment, in addition to clinical treatment, as a vital part of the rehabilitation process. Barker outlines features of his concept of psychological ecology, including the central concept of behavior settings, which provides an important window on our understanding of a range of psychological phenomena as a “system” and is, at times, a very useful unit of analysis for psychology. The relevance of Barker’s concepts for the issues addressed in the present volume is that, like Newcomb (1953), Barker describes a framework that explicitly relates systems concepts to adaptive processes at the social/community level. Barker begins by incorporating from the work of Egon Brunswik an emphasis on the critical importance of including in accounts of perception and behavior the environment in which an individual acts and perceives. In Barker’s words: Brunswik (1955) described psychological schools and theories in terms of their positions upon a macro-unit he considered to be the true vein of psychological ore. This vein extends from the environment to the environment; namely, from distal objects in the ecological environment, through proximal stimuli at the receptor surfaces of a person, through the person’s peripheral receptor mechanisms, through his central processes, and through his peripheral effector systems, to his proximal reactions, or means behavior; and it finally terminates in the focus of the total unit: the person’s achievement with respect to the nonpsychological world of things. The three major sectors of this unit are . . . (1) the ecological sector of objects and physical stimuli (preperceptual), (2) the organism or intrapersonal sector, and (3) the behavioral sector which occurs, again, in the ecological environment. (Barker, 1960, p. 1) Barker, along with Brunswik, regards the entire span of the E-E (environment-environment) unit as the fundamental unit of analysis with respect to psychology; it is “the basic psychological entity.”
xxxvi modeling complex systems He takes issue with some of Brunswik’s conclusions, advancing the hope that taking the entire E-E span into account can lead to more than a probabilistic framework for psychological explanations: I hold the hope that a more detailed, conceptual, and explanatory account of the whole course of events can be achieved, particularly at the junction point between the ecological and the intrapersonal sectors of the unit, and especially with respect to motivation. This, in fact, is the theme of my paper. (Barker, 1960, p. 3) The E-E unit, then, is to be taken as the ultimate unit of analysis; one obvious way to understand this unit is as a multisectored system. As can be seen in the material reproduced below, one theme that recurs in other examples of systems approaches is that of the close relation between the processes of change, perception, and motivation. A second major theme is the influence of changes or properties in one part of the system on the qualitative status of other parts of the system, a defining aspect of all exemplars of models informed by general systems theory. Finally, the interaction of sectors of the E-E unit is considered with respect to emergent social aspects in Barker’s system: For a psychology defined in terms of E-E units, the usual considerations of motivation are not adequate. These considerations almost always make personal motives the whole story of the energetics of behavior, and place them within the organism. But a unit is a unit; it is indivisible. When it is a psychological unit, the environment, the organism, and the behavior are all involved, and energetics must occur in all of the parts. Either the E-E unit is false, or motivation theory is too limited. (Barker, 1960, p. 4) Barker goes on to lay the groundwork for discussion of his theory of behavior settings by introducing some concepts that provide the context for his central theses. In a later section he provides further elucidation of the relation between the “entity” and the “environment” elements of his model: Ecology is concerned with relations between entity and environment. But before this statement has any useful meaning,
xxxvii Introduction entity and environment must be defined. . . . Where does each entity end and its environment begin? . . . . . . To clarify this problem, it is necessary to revert to the levels of phenomena in science. . . . I have emphasized that the essential distinction between levels is this: The laws, the explanations, which have been devised to account for occurrences on one level are inadequate to explain occurrences on a different level, yet the levels are coupled systems. Another distinction that is crucial for the definition of environment is that between inside and outside. Every entity has a discriminable boundary; what is within the boundary constitutes the entity’s inside, and what is without constitutes its outside. . . . The environment of an entity is made up of those parts of the outside regions with which the entity is coupled by laws on a different level from those which govern the entity itself. . . . Here, for ecological problems, is the basis for delimiting an entity from its environment. The test is this: As we move from any discriminable thing to more remote, surrounding parts, a point is reached at which the governing laws, so far as we know them, become incommensurate, yet the linkage remains. This point marks the boundary of the entity and the beginning of the environment. (Barker, 1960, pp. 7–8) Barker asserts the desirability of taking the entire E-E continuum as the crucial unit of analysis, rather than abstracting only elements of it for psychological examination. He offers the study of psychological principles of learning as an example: The field of learning is interesting in this connection. Learning is usually interpreted as the process, par excellence, by which the environment influences the organism and its behavior. This is the predominant way, almost the only way, a culture is presumed to shape the personality and behavior of the individuals born into it. The facts of learning demonstrate, however, as almost all learning theory recognizes, that even here the organism is the locus of driving forces without which learning does not occur. Indeed, within the context of learning it is, paradoxically, the behaving organism that endows the environment with behavior-controlling properties; the guiding and coercing powers of the environment have been shown to
xxxviii modeling complex systems depend upon what activities the organism has previously had with it, and these depend more upon the organism than upon the environment. Indeed, learning studies have demonstrated that almost every discriminable part of the ecological environment can be coupled with almost every kind of behavior. This is important information; it defines the range of an organism’s power to transform its connections with the ecological environment, and it implies that parts of the environment are almost equipotential. . . . It will be clear now where ecology enters the environment-environment unit, which Brunswik took as the realm of psychology. Psychological ecology deals with the relations between the nonpsychological sectors of this unit, governed by the laws of geometry, chemistry, economics, etc., and the intrapersonal and the behavior sectors, governed by psychological laws. (Barker, 1960, pp. 11–12) He then attempts to formulate an account of how these incommensurable system elements might be related (or, at least, an approach to a satisfactory understanding) by exploring earlier ideas of Fritz Heider’s. Barker makes a gradual transition to his concept of behavior settings. Because these ideas are readily available to the interested reader, a detailed presentation will not be offered here. However, one would highlight a particularly important element of his concepts concerning behavior settings: Barker highlights how behavior settings are regions in a community that offer certain opportunities and, along with these, require certain responsibilities. Furthermore, there is a relation between the peopling of these settings and both the number of responsibilities and the adequacy of performance that can be expected to occur. This relation between the demands of a given behavior setting and the impact on the behavior and life of the individuals populating these settings seems very compatible with more recent concepts. Implications for the analysis of complex settings and behavior are evident. Barker continues, in a section entitled “Theory of Behavior Settings”: Field studies in which I and my associates have been engaged, of the behavior of children in their natural habitats,
xxxix Introduction have brought us to the hypothesis that under certain precisely defined and frequently occurring conditions, people stand in the relationship of media to behavior settings; and that under certain other less common conditions, people stand in the relationship of things to behavior settings, imposing certain absolute constraints on them. This hypothesis brings some order into data upon American-English differences in the behavior of children and adults, into data upon differences in the behavior of individuals in settings of different sizes, and into data concerning the behavioral consequences of physical disability. The wide ramifications of these simple ideas suggest that they may have a basic significance for psychology, and particularly for the psychology of motivation. . . . It is first necessary to describe behavior settings. When a mother writes, “There is a baseball game in progress on the playground across the street,” she does not refer to any individual’s behavior, but to the behavior of children en masse. The same is true of a newspaper item which reports, “The annual fete held in the St. Ambrose Church garden was a great success.” These are behavior settings. They are highly visible behavior phenomena; laymen mention them in conversation and in writing as frequently as they do individual persons. . . . Here are . . . [some] behavior settings: Streets and sidewalks Kane’s Grocery Clifford’s Drug Store Gwyn Café Pearl Café Midwest State Bank Of special relevance in the present connection, however, are the following characteristics of settings: 1. Behavior settings involve ongoing patterns of extraindividual behavior whose identity and functioning are independent of the participation of particular persons. 2. A behavior setting has a circumjacent soma of physical objects: of walls, doors, fences, chairs, dishes, typewriters, ad infinitum, arranged in a characteristic spatial pattern, at a particular temporal and physical locus.
xl modeling complex systems 3. Behavior settings are homeostatic systems; they normally persist, often for years, at a relatively stable, characteristic level. . . . A behavior setting is a behavior entity, but its laws of operation are not the laws of individual psychology . . . Most of what we know about behavior settings is simple description, with any conceptualizations being not far removed from the surface appearance of settings. However, this is enough to make a beginning in tracing the connections along the Brunswikian unit which has its origins in this part of the ecological environment. For our purposes, the self-regulatory characteristic of behavior settings is crucial and must be considered further; it is this, indeed, which gives behavior settings, under certain conditions, the position of things which impose their own patterns on the people within them, who have the position of media. Behavior settings exhibit a stability-within-change, a persisting functional level which is due to a balance of many influences. Some of these issue from the larger community, some are intrinsic to the setting itself, and some originate within the individuals who populate the setting . . . . . . Forces operate in every setting. These multiple balanced forces assure that the level of a setting is more stable than most of its parts or conditions singly. One frequently occurring means of balancing the forces and maintaining the homeostatic level of a behavior setting is compensating for a deficiency in the number or docility of the parts of the medium by an increase in the amount of energy applied to each of them, and vice versa. When the media of a setting, the machinery, the tools, or the workmen, for example, are in short supply, those available have to work longer and/or “harder.” (Barker, 1960, pp. 15–21) In the last section of his contribution, Barker discusses “People: Media of Behavior Settings”: Six features of the relationship between people and behavior settings must now be mentioned. 1. People are part of the inside manifold of behavior settings.
xli Introduction 2. Of all the attributes of settings, people are the sine qua non. . . . 3. Each quasi-stationary level of a setting has its optimal population requirements. . . . 4. Of all the equipment and paraphernalia of a setting, people are among the most immediately malleable and adjustable. 5. Different behavior settings on the same level of functioning, and therefore with the same optimal population requirements, actually differ greatly in population. . . . 6. These five features of the relation between people and behavior settings emphasize the position of people as the media of behavior settings. This is true. However, there is one important exception. When the number of people in a setting, its population, falls below the minimal number required by its homeostatic level, the setting will be modified. (Barker, 1960, pp. 21–22) He concludes: Behavior settings with less than optimal people for their homeostatic levels are self-disciplining settings. The opportunities within them are matched by the obligations they contain. . . . We sometimes call them self-discipline. In reality they are controls built into the structure and the dynamics of the setting, into the ecological environment. . . . I would like to close with two remarks: (1) Brunswik’s environment-environment unit appears to be subject to more than empirical probabilistic laws, and (2) the ecological environment appears to be, especially, the seat of motivating influences. (pp. 48–49) Barker’s contribution—as is his body of scholarly work in general—is novel and interesting and would seem to have continuing applications today. In particular, the growing acknowledgment that community reintegration and quality of life are vitally important ends of rehabilitation efforts and that rehabilitation cannot really be considered a successful endeavor unless an individual is supported to the point of maximal participation in the life of the community, with the greatest degree of independence possible, leads inevitably to the recognition that there must be a satisfactory awareness of the
xlii modeling complex systems environment—the behavior settings and social/interpersonal environment to which an individual will be returning—before an optimal rehabilitation treatment plan can be developed and delivered. Barker’s (and his students’) techniques for identifying and cataloging community venues can serve as a guide in expanding rehabilitation practice to include such analyses. In this regard, in addition to Barker’s work and the models of Brunswik and Heider (already referenced), additional useful resources include Gibson (1979) and Wicker (1984).
Notes The editors would like to acknowledge and express a special thanks to Mr. Joe Brown for his superlative work as copy editor of this volume of the Nebraska Symposium on Motivation. Mr. Brown’s consistently resourceful and creative suggestions concerning the substance, organization, and presentation of chapter materials contributed immeasurably to the clarity and coherence of the final product. As will be evident, the conceptual breadth of material and diversity of perspectives reflected in this volume are considerable. Mr. Brown’s timely and precise questions and observations, clear and patient counsel, and unflagging good humor throughout were notably catalytic in successfully bringing the 52nd edition of the symposium together in its present form. All volume editors should be so fortunate! 1. Compare Theodore Newcomb’s “A-B-X” model, discussed below. 2. Variables such as curiosity, novelty, and stimulus change, stimulus aspects sometimes thought to provoke increased engagement, interest, and/or increase arousal.
References Barker, R. (1960). Ecology and motivation. In M. R. Jones (Ed.), Nebraska symposium on motivation (Vol. 8, pp. 1–49). Lincoln: University of Nebraska Press. Brunswik, E. (1955). The conceptual framework of psychology. In International encyclopedia of unified science (Vol. 1, Pt. 2, pp. 656–750). Chicago: University of Chicago Press. Burke, C. J. (1966). Linear models for Pavlovian conditioning. In D. Levine (Ed.), Nebraska symposium on motivation (Vol. 14, pp. 49–66). Lincoln: University of Nebraska Press. Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin.
xliii Introduction Heider, F. (1959). On perception, event structure, and the psychological environment. Psychological Issues, 1(3), 1–123. ———. (1960). The Gestalt theory of motivation. In M. R. Jones (Ed.), Nebraska symposium on motivation (Vol. 8, pp. 145–172). Lincoln: University of Nebraska Press. Klein, G. S. (1959). A note to the reader. Psychological Issues, 1(3), v–vii. Koch, S. (1956). Behavior as “intrinsically” regulated: Work notes towards a pre-theory of phenomena called “motivational.” In M. R. Jones (Ed.), Nebraska symposium on motivation (Vol. 4, pp. 42–87). Lincoln: University of Nebraska Press. Koffka, K. (1925). The growth of the mind. New York: Harcourt, Brace. (Original work published 1921) Köhler, W. (1924). Die physischen Gestalten in Ruhe und im stationären Zustand: Eine naturphilosophische Untersuchung von Wolfgang Köhler. Erlangen: Philosophische Akademie. Köhler, W. (1938). The place of value in a world of facts. New York: Liveright. Krech, D. (1949). Notes toward a psychological theory. Journal of Personality, 18, 66–87. Krech, D. (1950a). Dynamic systems as open neurological systems. Psychological Review, 57, 345–361. Krech, D. (1950b). Dynamic systems, psychological fields, and hypothetical constructs. Psychological Review, 57, 283–290. Krech, D. (1951). Cognition and motivation in psychological theory. In W. Dennis et al. (Eds.), Current trends in psychological theory (pp. 111–139). Pittsburgh: University of Pittsburgh Press. Leeper, R. W. (1948). A motivational theory of motivation to replace “emotion as disorganized response.” Psychological Review, 55, 5–21. Leeper, R. W. (1965). Some needed developments in the motivational theory of emotions. In D. Levine (Ed.), Nebraska symposium on motivation (Vol. 13, pp. 25–122). Lincoln: University of Nebraska Press. Lewin, K. (1938). The conceptual representation and the measurement of psychological forces (Contributions to Psychological Theory, Vol. 1, No. 4, Serial No. 4). Durham nc: Duke University Press. Logan, F. (1964). Comments on Edward L. Walker’s paper. In D. Levine (Ed.), Nebraska symposium on motivation (Vol. 12, pp. 96–98). Lincoln: University of Nebraska Press. Newcomb, T. (1953). Motivation in social behavior. In M. Jones (Ed.), Current theory and research in motivation (Nebraska Symposium on Motivation, Vol. 1, pp. 139–161). Lincoln: University of Nebraska Press. Nissen, H. W. (1954). The nature of the drive as innate determinant of behavioral organization. In M. R. Jones (Ed.), Nebraska symposium on motivation (Vol. 2, pp. 281–321). Lincoln: University of Nebraska Press. Simon, H. A. (1994). The bottleneck of attention: Connecting thought with motivation. In W. D. Spaulding (Ed.), Integrative view of motivation, cognition, and emotion (Nebraska Symposium on Motivation, Vol. 41, 1–21). Lincoln: University of Nebraska Press.
xliv modeling complex systems Tolman, E. C. (1932). Purposive behavior in animals and men. New York: Century. Tolman, E. C. (1948). Cognitive maps in rats and men. Psychological Review, 55, 189–208. Vinacke, W. E. (1962). Motivation as a complex problem. In M. R. Jones (Ed.), Nebraska symposium on motivation (Vol. 10, pp. 1–46). Lincoln: University of Nebraska Press. Walker, E. L. (1964). Psychological complexity as a basis for a theory of motivation and choice. In D. Levine (Ed.), Nebraska symposium on motivation (Vol. 12, pp. 47–95). Lincoln: University of Nebraska Press. Wicker, A. W. (1984). An introduction to ecological psychology. Cambridge: Cambridge University Press. World Health Organization. (2001). International classification of functioning, disability and health. Geneva.
Composition and Uses of Formal Clinical Cognitive Science Richard W. J. Neufeld University of Western Ontario
“In every special doctrine of nature only so much science proper can be found as there is [applied] mathematics in it.” So wrote Immanuel Kant about the status of natural philosophy, as he saw it in 1786 (Kant, 1970, p. 470). This declamation seemingly reflected a certain frustration not unlike that possibly experienced almost two centuries earlier by Francis Bacon, who decried “the distemper of learning,” which occurs “when men study words and not matter” (Bacon, 1937, 200 (bk. 1)). These quotes are extracted from commentaries on activity done in the name of science by their authors’ contemporaries— activity possibly characterized by considerable redundancy of effort to resolve the day’s purportedly key issues, contentious debate devoid of clear resolution, a lack of precise place keeping regarding the status of important segments of “the body of knowledge,” and an absence of salient direction for potentially profitable future thrusts of investigation. More contemporary, and emanating from within our discipline, Paul Meehl (1978) bemoaned the slow progress of “soft psychology” (which presumably included psychological clinical science). He indicted the dominant research paradigm (Kuhn, 1962), of which a prominent modus operandi was, and for that matter remains, Fisherian- and Pearsonian-based statistical methods. Theoretical predic-
2 modeling complex systems tions were derided as somewhat anemic, typically embracing simply the presence of nonzero relations among ad hoc measured variables; as nature is said to abhor an absence of association, so-called support rested on statistical power, whereby the ever-popular anova and related tables of results were, in effect, summary statements of such power (cf. Cohen, 1988, pp. 16, 17; Steiger & Fouladi, 1997). Meehl noted that “theories,” at least in fields of soft psychology, typically fell by the wayside, not because they were toppled by uncorroborated risky predictions, but because the discipline became inured to them and their proponents grew weary of marketing them. It might, nevertheless, be added that their proponents need not worry because it is well-known that old theoretical ideas frequently reemerge in different guises and with modernized labels (Staddon, 1991). (Most readers will have their favorite accounts of such instances from their particular fields of expertise.) I would contend that the foregoing lamentation retains considerable currency when it comes to contemporary psychological clinical science. This observation provides much in the way of motivation for the developments presented here. It is maintained that the implementation of formal theory in psychological clinical science can go far to redress current quagmires and accelerate progress. Emphasis of course is on the field with which I am most familiar, clinical cognitive science. However, the merits of formal theory disclosed in that domain of investigation are, arguably, general, providing additional incentive for the particular sphere of application. To begin, a clear delineation of what does and what does not constitute formal theory is presented. Benefits and selected (practical) liabilities are described. Following on that is an exemplary case in point from the domain of clinical cognitive science. Novel developments include proposals for monitoring cognitive aspects of an individual’s response to treatment over time and, likewise, dynamic assessment of treatment-program efficacy with respect to cognitive functioning. Some surprising noteworthy spin-offs from excursions into formal modeling, spin-offs that impinge directly on prominent issues in this area of study, are expounded on. One such by-product emanates from a personal “labor of love,” entailing the appropriation of stochastic modeling to the study of cognitive efficiency as it relates to schizophrenia, to psychological stress, and to their combination. It constitutes a new form of construct validity, using
3 Formal Clinical Cognitive Science mathematical heuristics. Another bears on an issue that I have engaged more or less since its appearance in the literature, namely, the so-called psychometric-artifact problem in the study of differential cognitive deficit. The problem is translated into simple but comprehensive measure-theoretic terms, revealing the shortcomings of typical efforts at redress. From there formal theory is shown to recast the entire issue in its own terms and in so doing render it as more or less obsolete.
Demarcations of Formal Theory Described here are the features of formal theoretical systems that for all practical purposes distinguish them from nonformal and quasiformal systems. Drawn on is the rigorous, still-cogent taxonomy of logical-deductive systems in science provided by R. B. Braithwaite (1968). The most prominent type of theoretical system in psychological clinical science, Braithwaite’s mixed deductive system, can profitably be used as a point of departure in explicating the nature and role of formal theoretical systems. Mixed deductive systems consist of formal and nonformal subsystems. A survey of contemporary issues of American Psychological Association clinical-science journals (e.g., the Journal of Abnormal Psychology, the Journal of Consulting and Clinical Psychology), and any number of psychiatry research journals, reveals the following predominant structure. Within the nonformal subsystem, predictions of empirical observations are dictated by syllogistic verbal reasoning, possibly accompanied by visual aids and most certainly by antedating empirical findings. There is, however, no particular governance by a set of rules constraining the format by which the verbal arguments are posed or the way in which one statement follows from another (e.g., mathematical derivation, computer language, or symbolic logic). The sequence of qualitative arguments culminates on transition to prediction(s) of results, or at least guiding question(s), credited with motivating the investigation at hand (further elaboration of informal and other systems, in selected domains of applied psychological science, is presented in Neufeld, 1989). Summarily speaking, the study is then executed and results obtained. It is at this point that the formal subsystem makes its entry. Mea-
4 modeling complex systems sures of dependent variables, guided, if not “prescribed” as such, by the nonformal theoretical apparatus (see, e.g., McFall & Townsend, 1998; Meehl, 1978), provide the data array submitted to statistical analysis, expedited by associated software. Statistical treatment is part and parcel of a formal subsystem because its constituent operations rest on closed-form formulas that, by and large, emerge from theorem-proof continuity (nowadays increasingly accompanied by numerical simulation). Note that so-called qualitative research methodology replaces this formal data-analytic arm of the logical-deductive system with nonformal, verbal operations. In this way, the entire logical-deductive enterprise is rendered informal. Conversely, formal theoretical approaches replace nonformal reasoning in the above mixed deductive design with a formal logical-deductive subsystem, thus creating an entirely formal logicaldeductive structure. Whereas the typical statistical apparatus (often elegant in its own right and with a virtual industry of software support) is substantively generic—its application transcending theoretical-content domains—formal theoretical models are content specific. For example, Doob (1953) has described one such type of theoretical formulation, a stochastic model, as a “mathematical abstraction of an empirical process, whose development is governed by probabilistic laws” (p. v). Whereas statistical computations constitute mathematical methods for assessing arrays of values rendered by empirical investigations, formal theoretical models are concerned with processes that make the data what they are (although, as will be demonstrated below, formal theories are far from mute about ways of analyzing the data whose genesis they address). In other words, in the explanatory chain of events, such models weigh in with quantitative constraints ab initio. The nature of authentically formal theory can be thrown into sharper relief by considering procedures that may appear to qualify as the former, pending closer scrutiny. Integrative and evaluative reviews, for example, potentially useful in their own right to be sure, are a case in point. Apart from a rare application of synthesizing quantitative models of possible agents of surveyed outcomes, verbal schemata are, as a rule, restatements of what is already known (e.g., McFall, Townsend, & Viken, 1995). Formal theory can also be distinguished from prominent higherlevel statistical methods, including “structural-equation causal mod-
5 Formal Clinical Cognitive Science eling” (sem; e.g., Kline, 1988; Tomarken & Baker, 2003; cf. MacCallum & Ashby, 1986), taxometric procedures (Meehl & Golden, 1982; Ruscio & Ruscio, 2004; Waller & Meehl, 1998), and hierarchical linear modeling (Bryk & Raudenbush, 1992; see Piasecki, Jorenby, Smith, Fiore, & Baker, 2003). With respect to sem, the subject of prediction comprises its parameters,1 for all intents and purposes meaning the path coefficients of conjectured relations among the posited latent variables. (It is surmised that criterion values for contemporary indexes of overall statistical fit, a sort of overarching prediction, have been met.) Note that, ordinarily, the hypothesized structure of interlatent-variable linkage and the relative magnitudes and/or signs of its associated path coefficients themselves are posited nonformally. In a similar vein, confirmatory factor analysis forecasts factor loadings and coefficients expressing interfactor relations, including those involving higher-order factors. Concern is with an empirical covariance structure, but one whose features are defined according to antedating empirical observations, or nonformal argumentation, rather than derivations spawned by specific axioms, definitions, and assumptions. The chief subject of prediction for taxometric methods, in turn, is certain configurations of data summaries (calculated via methods prominently known as Maxcov, Mambac, Maxslope, Maxeig, and L-mode) indicative of dichotomous versus continuous latent distributions of target variables (e.g., specific symptoms or syndromes). Selected parameters, such as base rates of a taxon (a discrete group with the symptom, genetic endowment, or other target characteristic), can be estimated. Once more, however, the data configuration corresponding to the conjectured distribution is not in and of itself the product of formal-system reasoning. By these characteristics, taxometric methods and sem fall into the category of statistical analysis and, in that way, constitute the formal subsystem of a mixed deductive system (elaborated on in Neufeld, 1989). Suffice it to say that similar observations attend typical applications of hierarchical linear modeling. Formal theoretical systems as well entail parameter estimation and testing for goodness of fit between predictions and observations. Their parameters, however, are substantively significant, as imbued by their explanatory roles in the theoretical model in which they participate (Braithwaite, 1968; exemplified below). Moreover, their
6 modeling complex systems variation generates selective changes in empirical data sui generis to the localized problem (e.g., Link, 1982; Townsend & Wenger, 2004a, 2004b). This treatment contrasts an essentially generic interpretation of parameter values, or other model properties, across even vastly divergent content areas and a focus on highly similar aspects of data (e.g., empirical covariance structures). I will return momentarily to the nonformal system widely known as qualitative research methodology because of its growing popularity, especially in the social sciences. Qualitative research increasingly has been touted as a legitimate, even superior, alternative to systems of science implanted with formal methods. Nonformal strategies give the appearance of flexibility in dealing with concepts and measures whose implementation may strain formal systems. The former, however, accommodate such challenges handily, not because they somehow transcend the explanatory merits of formal systems, but because they simply sidestep the constraints on precision of expression demanded by formal systems or subsystems (Staddon, 1984). As such, despite their purported checks and balances (e.g., Miles & Huberman, 1994), they are vulnerable to the onslaught of frailties in reasoning and inefficiencies accompanying dependence on essentially verbal contentions, defects that formal procedures are designed to confront (Hintzman, 1991; Kline, 1985). Indeed, the history of science makes it clear that systematic retreat from decidedly formal inferential methods inevitably detracts from progress (e.g., Braithwaite, 1968; Kline, 1985).
Assets of Formal Theory explanatory insights A major advantage bequeathed by formal developments is the unique insight afforded into the studied phenomena. Interplay of critical variables is disclosed by inspecting the structure of derived predictions and the steps to obtaining them. Examples in the hard sciences of course abound. Consider, for instance, a notable case in point, Newton’s universal law of gravity: m1m2/r2. The law defines the force of attraction between two particles, with masses m1 and m2, separated by distance r. The constant varies only with the units of
7 Formal Clinical Cognitive Science measurement. The actual physical mechanism of gravitational pull may be enigmatic, but the mathematical definition is not. Moreover, to be taken seriously, any proposed physical mechanism would have to comply with this mathematical statement. The function of each term, and of the law itself, in turn, is decipherable from the nature of the formal assertion and from the way in which the law serves in broader theoretical contexts. Similarly, something of the nature and function of Einstein’s limiting constant, the speed of light, can be appreciated contextually by considering its operation in a formal deductive system. Such exposition, for example, discloses that any meaningfulness of a larger value rests on a solution to the imaginary number (1)½. In psychological clinical science, elucidation of obtained data configurations can be bolstered by stipulating relations between observed and inferred variables in terms analogous to the above. As opposed to ad hoc interpretation, statistical interactions, for one, can be understood from formal depiction of the psychological processes under study and associated scales of measurement (e.g., Busemeyer, 1980). An illustrative instance entails the stochastic dynamic modeling (see, e.g., McFall et al., 1995) of the effects of stress (ambient noise) on cognitive efficiency (Weinstein, 1974). One such model expresses the expected (mean) latency for proofreading lines of prose (e.g., Glass & Singer, 1972). The expression is mr/(k 1) (Neufeld, 1996, 2002). In this formula, r conveys stress-related impairment of performance speed (r goes up with increasing stress, elevating the mean, reflecting diminished speed), k is an increasing function of task-relevant competence (associated here with practice), and m indicates task load, quantified as the mean number of processed stimulus elements (chunks of letters scanned per line of prose). The expected latency for a given level of stress, and amount of practice, for the summary task load m can, thus, be predicted as a function of substantively significant parameters. The expression also discloses the fabric of interplay between stress and practice, making for their “interaction”: the effects of stress can be mitigated by practice, practice becomes more important as stress goes up, and the effects of this interplay on performance latency are “scaled” according to the prevailing task load m. In fact, the form of the stress-practice interaction is one of “superadditivity” of the interaction’s second-order difference: [(mean latency under higher stress and lower practice) (mean latency under
8 modeling complex systems lower stress and lower practice)] [(mean latency under higher stress higher practice) (mean latency under lower stress and higher practice)] > 0 (Townsend, 1984). Note that each of the above parameters is also entrenched in its own quantitative infrastructure, endowing it, accordingly, with further analytic and substantive meaning (Evans, Hastings, & Peacock, 2000; elaborated on below). Beyond their revelatory function, closed-form, analytic expressions can also serve the practical cause of computational economy. It is enticing to depend on numerical simulations as surrogates for analytic derivations, given contemporary computational technology. Analytic derivations, however, not only enhance understanding, according to their detailed structures, but can also reduce computational steps, ease computer memory demands, and increase speed when simulations are inevitable. Partly for this reason, theorists in longer-established sciences will opt to take analytic solutions to the limit, before invoking numerical algorithms.2
self-diagnostic, self-indicting properties Desiderata of useful theory are Popperian bold conjecture and falsifiability. In Bayesian terms, bold conjecture is tantamount to a predicted observation being negligible, apart from viability of the proposed theory. In like fashion, distinct falsifiability is identified with an essentially zero probability of the tendered theory being defensible on failure of its specified prediction. It is readily shown that, in the first instance, the probability of the theory being tenable, given that the predicted evidence occurs, approaches 1.0 and, in the second instance, the probability of the evidence, given the theory, also approaches 1.0 (Neufeld, Carter, Boksman, Jetté, & Vollick, 2002). Predictions emanating from strong theory stand to be formidably precise. A weak meteorological forecast, for example, predicts rain in the Northwest during November. At the opposite extreme, a strong prediction stipulates the precise amount to fall within a given time period in a specific location (Meehl, 1978). Formal theory arguably makes for desirably strong prediction, including that located in psychological clinical science (Neufeld et al., 2002). This is why formal theories die while nonformal theories seemingly defy all laws of natural selection (Staddon, 1991).3
9 Formal Clinical Cognitive Science Formal theories provide specific predictions that can compete directly in terms of differential conformity to observed values. Predictions set in quantitative terms, in turn, expedite quantitative expressions of their relative superiority (e.g., tests for goodness of fit and comparative goodness of fit). In addition, however, models can prescribe their own qualitative signatures of validity. The latter entail the contour of data across gradations of independent variables and their combinations (e.g., superadditivity of means, as discussed above; Neufeld & Williamson, 1996). Such patterns can, moreover, be mutually exclusive, in that, even with very weak assumptions, competing models cannot produce each other’s configurations (e.g., Townsend & Wenger, 2004a; cf. “empirical equivalence,” e.g., Townsend, 1990). If formal models mandate their own diagnostics, they necessarily ease the problem of empirical measurement. In fact, formal deductive systems stand the selection of measures on its head. As with longer-established sciences (e.g., physics examples, as discussed above), theory is potentially strong enough to mandate certain empirical ramifications. Displaced, therefore, is the often ad hoc process of selecting off-the-shelf measures, conjecturally connected to dependent variables (McFall et al., 1995; Meehl, 1978). Owing to the precision of the formal deductive system, theory and measurement become intertwined. Assessment of the generated measures, for the usual statistical properties of fallible estimates (e.g., bias, maximumlikelihood status), to be sure remains applicable (e.g., Riefer & Batchelder, 1988; Townsend & Wenger, 2004a). Nevertheless, those properties apply to indexes substantively tied to the theory at hand. Individual differences in model expression can be accommodated within the context of model diagnostics, especially befitting clinical science and assessment. Included is variation in the structure of cognitive transactions (e.g., serial processing, variations on parallel processing, and selected combinations of these structures; Townsend & Fific, 2004). Variation in model properties, notably parameter values, across individuals can also be profitably accommodated through Bayesian techniques (Batchelder, 1998; Chechile, 1998; Neufeld et al., 2002). Not least among the endowments of formal theory is its inherent challenge to preferred interpretations of addressed phenomena. Explicitness of expression helps make salient current boundaries of
10 modeling complex systems knowledge—flaws and limitations in extant formulations. In particular, empirical equivalence, on current measures, of nonetheless opposing positions is disclosed. However, so too are alternatives that can break the encountered experimental-mimicking logjams (Casti, 1989; Townsend, 1990).
absorption of theory-exogenous variance With formal logical-deductive systems, random empirical variance can be explained by the theory itself. Quantitative theory, in other words, encompasses apparent observational indeterminacy, instead of relegating it to “error” or “noise variance” (cf. anova linear model, e.g., Kirk, 1994; “local independence,” Bollen, 2002). An additional classification of theoretical systems, cogent apropos this avowed asset, is that of Busemeyer and Townsend (1993; depicted in Table 1). Systems are categorized as dynamic versus static and as stochastic versus deterministic. First, static stochastic models (in the lower-left quadrant) predict frequencies of response values (e.g., categories, ratings, and so on), if not the times for producing them. An example is Tversky’s elimination-by-aspects model of preference and choice (Tversky, 1972a, 1972b; see Batsell, Polking, Cramer, & Miller, 2003). Comparative frequencies of choosing items from those available are considered to follow a multinomial distribution (e.g., Evans et al., 2000). Accordingly, probabilities of selection are the main focus. The probabilities are governed by parameters of the elimination-by-aspects model, which are subjective utilities of the item attributes (e.g., the likelihood of winning a lottery vs. its payoff; Rappaport, 1983; for applications in stress-and-coping research, cf. Kukde & Neufeld, 1994; Morrison, Neufeld, & Lefebvre, 1988). Note that an earmark of stochastic models is their prediction of probabilities, or distributional frequencies of events, versus predictions of an all-or-none nature. Turning to the upper-right quadrant, we see that deterministic dynamic theory is exemplified most notably by nonlinear dynamic systems models, popularly known as chaos theory (e.g., Gregson & Pressing, 2000; Koçak, 1989). To illustrate, variables such as psychological stress and coping can be depicted as being in constant flux, reciprocally influencing and being influenced by one another. The
11 Formal Clinical Cognitive Science Table 1. Schema of Theoretical Systems, with Selected Examples
Deterministic
Stochastic
Static
Dynamic
Verbal theory; Nondynamic flow diagrams
Deterministic nonlinear dynamic systems (“chaos-theoretic systems”)
Some decision-and-choice models (e.g., selected subjective-utility models)
Dynamic extensions of decision-and-choice models; classic stochastic models; nonlinear dynamic-systems models, with a stochastic element
Note: Adapted from Busemeyer & Townsend (1993).
system is represented by differential equations, each indicating the momentary change in a variable. The changes themselves are defined in these equations essentially by the variable’s own extant state and those of the other variables making up the network (Neufeld, 1999b). Stochastic dynamic theories are exemplified by time-related extensions of decision-and-choice models. The elimination-by-aspects model (discussed above), for example, has been reformulated by Marley and his colleagues (e.g., Marley, 1989; Marley & Colonius, 1992) so as to add temporal predictions about selection responses to the original model’s predicted frequencies of selection from among the competing items. Busemeyer and Townsend (1993; also Roe, Busemeyer, & Townsend, 2001) have presented an empirically compelling model of decision and choice, providing for speed of choice, type of choice, and their interconnections. Variability of expressed preferences and their latencies are, once again, accommodated, in that the crux of prediction involves frequency distributions. Stochastic dynamic models represent possibly the most widely used version of formal theory in psychology. Generally speaking, they depict probability distributions of events as a function of time (see, e.g., Johnson, Kotz, & Balakrishnan, 1994, 1995; Luce, 1986; Townsend & Ashby, 1983). Part of the model fabric, then, is variability of event latencies across occasions of observation (e.g., experimental trials). The provision for variability is graphically illustrated by considering the model-prescribed variance of time taken to complete a relatively simple cognitive process.
12 modeling complex systems The process comprises k stages, each stage having a specified frequency distribution, as a function of time. Each stage is executed at the rate of v stages per unit of time (whereby the mean stagewise completion is 1/v time units). Such a process may correspond to the encoding of k stimulus features (e.g., curves, lines, and intersections of an alphanumeric item) into a cognitive format facilitating further processing, such as selected manipulations involving the item in short-term memory (e.g., Sternberg, 1975). By the present model, known as the Erlang distribution (Evans et al., 2000), the mean time across trials for process completion is k/v. The across-trial variance of completion, in turn, is k/v2. Note that this statement of dispersion is squarely embedded in the substantively significant parameters of the theoretical model of process completion. Further provision for stochastic properties is available by allowing for individual differences in the values of the parameters k and v. This extension (a mixture model) “acknowledges” interparticipant variation in the above variance and related model expressions (e.g., Neufeld et al., 2002). Latency variance for a given value of k and v maps onto the familiar within-participant variance in (m)anova, and variation across participants in k and v maps onto between-participant variance (see, e.g., Parzen, 1962, p. 200; also “A Stochastic-Modeling Translation of the Statistical-Property Issue” below). Other contemporary exemplars of dynamic stochastic models include selected extensions of multidimensional scaling (see, e.g., Schiffman, Reynolds, & Young, 1981). These extensions quantitatively relate categorizations, or ratings of multidimensional stimuli, to their cognitive-process underpinnings, where the variable of time plays a central role (e.g., Carter & Neufeld, 1999, in press; Nosofsky, 1992; Takane & Sergent, 1983). Before leaving this subsection, it should be noted that nonlinear systems theory can, in principle, be augmented to incorporate a stochastic component. A specifically random element can be added to the otherwise deterministic differential equations describing intervariable influences across time (e.g., Brown & Holmes, 2001; Huber, Braun, & Krieg, 1999). This interlaced stochastic thread perturbs the momentary change in each variable and the consequent influence of those changes on the coupled network of variables. Interestingly, the temporal trajectories of such a “stochasticized” system can deviate dramatically from those of its strictly deterministic counterpart.
13 Formal Clinical Cognitive Science Suffice it to say that, overall, unaccounted-for variance in observed values may never be eliminated (cf. Gilden, 2001). However, such “model-exogenous variance” stands to be substantially diminished with increasing comprehensiveness of theory construction.
aesthetic appeal P. A. M. Dirac, a Nobel laureate in physics, once declared: “It is more important for our equations to be beautiful than to have them fit the experiment” (quoted in Freedman, 1993). Given the historical success of beautiful equations, their apparent failure was held to be a temporary aberration. Perhaps, in their presented form, the equations were an inadequate approximation of empirical events. Or, possibly, the experimental observations themselves were flawed. Either of these shortcomings could be redressed. Beautiful equations were intrinsically self-vindicating, and the rest was detail. At the very least, if equations were to stand up to empirical challenge, they must spring forth from among the ranks of the beautiful, whereas equations that are not beautiful are inevitably doomed to experimental defeat (cf. Smolin, 2006). Formal theory thus potentiates the scientific merit of equational elegance. There is no inherent reason why psychological clinical science should be barred from this asset, which is, arguably, a proprietorship of formal developments. What, then, makes an equation aesthetically appealing? One criterion is succinctness. The simplicity of beautiful formal expressions belies their profundity, which becomes apparent when their copious and far-reaching implications are unveiled (Polkinghorne, 2003). One example, emanating from the field of nonlinear dynamics, is Mandelbrot’s formal representation of fractals. Although the representation is parsimonious, a feature of its constituent variables is that they take on a multitude of intriguing trajectories. The proliferation of exotic patterns has been widely disseminated, thanks to modern computer-graphics technology (e.g., Gleick, 1988; Townsend, 1994). A more modest example is available from the Erlang distribution of cognitive-process completion (described above). Here, the probability of completing the stated process by a given time interval, t, is
14 modeling complex systems (k’ – 1)! – (k’, vt). (k’ – 1)!
(1)
Note that one can safely bypass the definition of each term in the equation and its equivalents (below) and still appreciate the pithiness of this expression. The somewhat involved operations, summarily contained above, include j 1 – vt x k’–1 e –x dx/(k’ – 1)! = j=k’ (vt)/j! e–vt. 00
00
(2)
These formulas, in turn, can be used to create visual aids that facilitate insight into the interplay of model parameters (for a treatise on theory-related intuitions afforded by visual imagery, see Clark & Paivio, 1989). Three-dimensional response surfaces convey variation in the present probability across alternate combinations of k, v, and the time window, t. Two examples are provided in Figure 1, for values of k ranging from 1 to 10 and values of v ranging from 0.01 to 3.0. The lower response surface is constructed for t = 4 and the upper one for t = 7. This figure presents but two instances of a virtually infinite number of possible graphic portrayals of the formally stated process. This is why, if a picture is worth a thousand words, a formula is worth a thousand pictures.
liberating qualities Formal logical-deductive systems are constrained by observationally and quantitatively principled initial assumptions, definitions, and axioms.4 Building on this foundation, rigorous derivations render deductions about events of principal interest. In this way, precisely framed empirical implications can, in effect, be evaluated for their potential importance, in advance of actual empirical testing. Fruits of these labors, then, include, not only the resulting insights, but also a potential increase in the overall economy of inquiry. Important questions can be posed before launching out empirically. Will the forecasted yield of information justify the associated investment? Is that which may be found actually worth finding? Does the theory posit results that, if corroborated, could significantly affect explanation, measurement, and, indeed, future predictions? The point to be made is that the theorist is emancipated to safely
15 Formal Clinical Cognitive Science
Figure 1. Probability of completing k stages in four time units (lower surface) and seven time units (upper surface) with each stage transacted at rate v (see Equation [2]; k ranges from 1 to 10, and v ranges from .01 to 3.0.
wade into the staked out substantive territory, with the above and related issues in hand, because her deliberations are constrained mathematically. These constraints represent an antidote to the hazards of armchair philosophy and psychology’s ensuing reaction against exploration free of constant empirical vigilance (cf. instrumentalist vs. realist distinctions in scientific theorizing; e.g., Casti, 1989). As for the empirical enterprise, formal theory can increase the latitude of investigation in clinical science. It can do so by incorporating abnormalities associated with psychopathology into hypothesis formation and testing. Such possibilities are exemplified in the cognitive-science application presented below. In the enterprise of clinical science, certain hypotheses regarding pathognomonic disturbances may defy often-used methodological options, and formal theory can supply essential alternatives. To elaborate, one tack to take when testing hypotheses about cognitive debilities, for example, involves attempting to duplicate performance deviations in normals using experimental manipulations that are designed to mimic their etiology in patients. Formal theory can complement this strategy and, moreover, pick up where it leaves off. The approach is to modify quantitative mod-
16 modeling complex systems els of performance in ways implied by the hypothesized agent of deviation and then to evaluate the accuracy of the resulting predictions (elaborated on below). Such methodological endowments come into play especially where tendered sources of disturbance are beyond the reach of direct manipulations. Selected agents of dysfunction, although model hospitable, may be fundamentally alien to normal functioning or demand unethical extremes of experimental induction.
barriers: attitudes, aptitudes, and investigator role Ideally, formal theory at minimum should be a ready-to-hand arrow in an investigator’s hypothesis-development quiver. It is recognized, however, that there are certain practical barriers to this ideal. One such barrier quite simply involves prevailing attitudes toward formal theory. Mathematical models are regarded with suspicion in some circles unless their implications are accompanied by readily appreciated parallels. In clinical science, such parallels often take the form of behavioral neurological mechanisms that clearly align with the mathematical developments.5 Interestingly, this position is counter to that of longer-established disciplines, where accepted mathematical necessity predates identification of a corresponding physical mechanism (e.g., Newton’s universal law of gravity, discussed above). One price paid for suspended belief in quantitative formulations is the forfeiture of potential unification of coexisting explanatory systems and new angles on synthesizing current evidence (e.g., Herrnstein, 1979). Another practical impediment concerns formal theory’s demands for hands-on tasking by someone closely involved with the subject matter. This requirement contrasts with practices where assignments can be delegated to an associate or a research assistant (as might be done, e.g., in data entry or statistical analysis). Formal modeling, furthermore, being customized to the immediate theoretical problem, is not a matter of output from routinely applied software. This is not to say, of course, that advances in computational power and computer-algebra programs such as maple and mathematica do not substantially aid the theorist’s job.
17 Formal Clinical Cognitive Science On balance, it can be said that such hurdles to formal theorizing may be daunting at first blush. Current practices, however, need not be abandoned while cultivating the formal alternative as an increasingly friendly ally. Eliminating the present hurdles can reap the substantial dividends on outlay in time and labor that have been enumerated above.
Application to Clinical Cognitive Science: The Case of Stimulus-Encoding Dysfunction in Schizophrenia This section leads off with a presentation of the philosophical blueprint guiding the present application. Its exposition culminates in the appropriation of group-level inferences about cognitive functioning to the individual participant. This appropriation is mediated by the use of Bayesian-based procedures. Their promised value launches an exposition of the parent Bayesian framework dominating the current development. Positioning of stochastic models of cognitive performance within this framework is pinpointed. Aided by the present instantiation, entailing selected stimulusencoding dysfunction in schizophrenia, potential payoffs of the approach are expounded. They include (a) precision in estimating performance-model parameters for the individual; (b) customization of the process model’s performance-latency distribution to the individual; (c) monitoring changes in cognitive functioning with the progression of treatment, at both the individual and the group levels; (d) importing the informational infrastructure endowed by the model’s cognitive-science roots; (e) complementing neuroanatomical regions of interest with times of interest, thus contributing to contemporary technology for measuring evoked neurophysiological responses; and (f) facilitating links of cognitive-performance indexes with clinically significant quantitative formulations on stress and coping.
philosophical orientation Associations among cognitive science, clinical cognitive science, and applications to individuals for clinical assessment or other purposes
18 modeling complex systems
Figure 2. Transitions from basic cognitive science among normals to cognitive assessment among patients.
are depicted in Figure 2. Its arrows denote a smooth, if not seamless, transition among these investigative domains. In the first instance, a model of cognitive performance addressed to the targeted territory of mentation is chosen. Deliberations include viability of the experimental paradigm and relevance of its response parameters. Addressed cognitive faculties, for example, may be those identified with visual, memory, and collateral processes (e.g., stimulus encoding and response mechanisms); the paradigm may take the form of a conventional visual- or memory-search task (Sternberg, 1975; Townsend & Ashby, 1983); and response parameters may include performance latency and/or accuracy.6 Several candidate models may present themselves. Selection from among contenders is based on congruence between the model’s features (e.g., its parameters or other properties) and concepts indigenous to the substantive research question (e.g., cognitive capacity, processing architecture [serial, parallel, or hybrid], efficiency of capacity allocation, and so on). Extant models may require elaboration or modification, befitting the currently driving issues. It may even be necessary to develop a model ab initio (see “Barriers: Attitudes, Aptitudes, and Investigator Role” above), depending on points of contact between the available armamentarium and the clinical-science queries that are pressing. The formal account of cognitive processing is then adjusted so as to accommodate performance deviations of disordered individuals. Alterations can be directed toward the architectural structure of the modeled processing system and/or toward model parameters.
19 Formal Clinical Cognitive Science Architectural structure refers to the arrangement of constituent processes involved in task transaction. To illustrate, in ascertaining and registering the existence of a presented alphanumeric item in a memorized set of items, component processes composed of encoding, memory-search, and response operations may be conducted serially, in parallel, or in some combination of the two. Structure refers as well to the arrangement of constituent stages (subprocesses) of the said processes (e.g., in the case of encoding subprocesses, parallel vs. serial input of the physical item features for template matching to those of the memorized item set; Townsend, 1984; Townsend & Ashby, 1983). Parameters refers to variables characterizing the processes, such as their size (operationalized as the number of subprocesses making up the process) and capacity (operationalized as the speed with which these subprocesses are transacted)—the parameters denoted above as k’ and v, respectively. For the sake of parsimony, the normal model is minimally perturbed, pending realization of the target configuration. Necessitated adjustments purportedly indicate disorder-affected functions, and those remaining intact signify functions that are spared. In general, processing architecture tends be preserved; however, the same cannot be said for the values of model parameters (Neufeld et al., 2002; Neufeld, Vollick, et al., in press; Townsend, Fific, & Neufeld, in press). It is apparent from the foregoing that the models most closely aligned with the present purposes are those that are stochastic and dynamic (see “Absorption of Theory-Exogenous Variance” above). By certain extensions of their stochastic element, beyond that attending response parameters per se, these models become poised to accommodate unique aspects of individual performance. Specifically, mixture models are fashioned to incorporate unequal values of performance-model parameters across units of observation—in this case, members of diagnostic groups (Batchelder, 1998; Berger, 1985; cf. Busemeyer & Stout, 2002). The distribution of individual parameter values becomes, in effect, a “prior distribution,” in Bayesian statistical terms. Through the implementation of Bayes’s theorem (discussed below), performance-model parameter estimates, as well as performance-latency distributions, stand to be individualized with considerable precision. Analogous to the procedure followed in a medical-laboratory scenario, where a modest blood specimen is
20 modeling complex systems referred to the broader body of hematological knowledge, a modest cognitive-performance sample is now embellished with information conferred by the prior distribution of parameter values emanating from the participant’s group. Note that, with the introduction of Bayesian-prior distributions of parameter values, deviation-accommodating adjustments no longer take place directly at the level of the task-performance process model. In the case of mixture models, there is, instead, movement of the deviant group’s Bayesian-prior distribution of parameter values. In this way, effects of disorder are registered as features of the prior, and, inasmuch as what has been altered is a distribution, provision for individual differences in the expression of these effects is retained. The arrows in Figure 2 are unidirectional, conveying the thrust of the current argument. There is, nevertheless, reciprocity among the above investigative domains. Successful capturing of deviant performance among clinical samples speaks to model robustness; those that readily accommodate performance extremes are preferred to those that are strained or fail in this regard (Neufeld, 1982; Neufeld & Mothersill, 1980). This widening of application represents a unique opportunity for generalization testing (Busemeyer & Wang, 2000) and, thus, potentially reciprocates benefits back to basic cognitive science. Nor are the layers of investigation mutually exclusive (see the leftmost column of Figure 2). Successful titration of stochastic models can lead to parallel manipulations at the connectionist level of analysis, whose own success or failure adjudges theory robustness (Carter & Neufeld, in press; Roe et al., 2001). Neurophysiological levels of investigation also stand to benefit. As described above, performance-model parameters (e.g., k, v) can be customized to individuals by amalgamating each one’s performance sample with the parameter-distribution prior, ascertained for the associated diagnostic group. With the individual estimates in hand, parametrically homogeneous subgroups can be formed. The resultant specification of cognitive-process-latency distributions (e.g., that of cognitively encoding a presented item into a task-facilitative format) can, in principle, be used to establish the likely epoch of occurrence of the process for the constructed group (e.g., Neufeld et al., 2002, elaborated on below). When it comes to measuring evoked neurophysiological responses (as in fmri and erp), estimated “time
21 Formal Clinical Cognitive Science windows of interest” may, thus, be prescribed, complementing neuroanatomical regions of interest, in calibrating the space-time coordinates of measurement.
group and individual differences in the encoding process: bayes’s theorem in the current context Recall that Bayes’s theorem states: Pr(A|B) = [Pr(A)Pr(B|A)]/Pr(B),
(3)
where A and B are events; Pr(A) is the prior probability of A, or the probability of A preceding consideration of B; Pr(B|A) is the conditional probability of B, given A; and Pr(B) is the unconditional probability of B. As in the present context, A is often a hypothesized event, and B refers to experimental observation. This statement appears simple enough, until its wide-reaching ramifications are unraveled. The parsimony of expression that, nevertheless, belies its profundity obviously qualifies this theorem as one of statistics’s aesthetically exquisite equations. Perhaps a more familiar general expression of Bayes’s theorem is Pr(Ai|B) = [Pr(Ai)Pr(B|Ai)]/[iPr(Ai)Pr(B|Ai)],
(4)
where Ai is one of a set of hypothesized events, Ai. In its present implementation, Ai’ becomes a parameter value of a test-performance process model, and B becomes a participant’s performance sample comprising N empirical latencies {t1, t2, . . . , tN},7 or {*} for short. The latencies refer to stimulus encoding because cognitive translation of presented items into a format that facilitates collateral functions (e.g., search for a matching memory-held item) tends to be elongated in schizophrenia (Neufeld et al., 2002). The following formula adapts these equations to the present setting of application and, in so doing, provides a comprehensive backdrop for explicating the potential assets enumerated at the beginning of this section: w(|{*}) =
G
({Pr(g|{*})}[w(|{*}, g)]). g=1
(5)
22 modeling complex systems In this equation, [w( |{*}) is the probability, or probability density (in the case of discrete and continuous parameters, respectively), of the parameter value , given the set of empirical latencies {*}; Pr(g|{*}) is the probability that the participant belongs to diagnostic group g, given {*}; and w( |{*}, g) is the probability (density) of , given {*} as well as the prior distribution of for group g. As stated above, it is through variation in the prior distributions of that group-related performance deviations become registered in Equation (5). It is the presence of cognition-relevant parameters
in this equation, moreover, that takes Equations (3) and (4) beyond a theoretically barren actuarial status to substantive significance. The precise role played by the group-specific priors in Equation (5) is pinpointed in its expansion (presented in Appendix A). Note that the equation is partitioned by elongated braces { } and elongated square brackets [ ] according to the respective terms bearing on the main developments (outlined below).
experimental paradigm and process of interest What then corresponds to in the present application? The answer requires consideration of the cognitive task on which the model parameters bear and whose performance supplies the latency sample {t1, t2, . . . , tN}. A variant of a memory-search paradigm (Sternberg, 1975) eliciting performance deviations among schizophrenic patients is described (Highgate-Maynard & Neufeld, 1986). The latter are representative of deviations occurring with other memory-search and related paradigms. Encoding of presented items is identified as the source of observed abnormalities in performance latency, which composes the subject of prediction. Pertinent developments in quantitative cognitive science are exerted to discern responsible parameters. The theoretical design of the encoding process is delineated. Its model parameters are deemed to vary randomly across participants, with their distribution being perturbed according to group membership. The several potential benefits of this Bayesian layout, enumerated above, are then detailed. The study reported in Highgate-Maynard and Neufeld (1986) extended typical memory-search methodology by incorporating meth-
23 Formal Clinical Cognitive Science ods emanating from Paivio’s dual-coding theory (Paivio, 1971, 1986). Individuals with schizophrenia and controls indicated “as quickly and accurately as possible” whether or not the real-life size—“overall volume”—of a presented item (the probe item was either an object or an animal) was similar to that of a member of a previously memorized set of items (the memory set; “fixed-set procedure”). Memory-set size, ranging from 1 through 4, varied randomly across trials. Presence versus absence of the probe’s size properties in a member of the memory set (positive vs. negative trials) was similarly scrambled. Half the participants in each group were presented with similarly sized drawings of probe items, whereas the other half were presented with names. Encoding demands were, accordingly, deemed to be greater in the latter instance because the initial verbal presentation of the probe would require referral to the imagery system for access to the demanded spatial-size properties (Paivio, 1986; for an examination of dual-coding and related predictions among schizophrenia participants, see George & Neufeld, 1984). Scanning memory-held items for the presence of the probe’s size properties was considered to be comparatively taxing. It required comparison of the probe and memory-held items’ overall volume, as set against subjective criteria of similarity in this property (Hockley & Murdock, 1987; Wright, 1977). Size attributes of items in the memory set were spaced such that the means of their normative-size ratings (Paivio, 1975) were at least 2 standard deviations of their Thurstonian discriminal-difference size dispersions apart (practically, at least 2 standard deviations of the distribution of difference scores between their normative-size ratings; Highgate-Maynard & Neufeld, 1986). Responses were designated as correct or incorrect on the basis of whether or not they conformed to the following criteria for positive and negative trials. Negative trials, whose correct response was a “no” button press, meant that the probe item’s size did not resemble that of a memory-set item. Here, the probe item’s mean real-life size rating was at least 1 standard deviation of the Thurstonian discriminal-difference dispersion from the normative mean rating of each item in the memory set. Positive trials, whose correct response was a “yes” button press, were those where the mean of the probe item, and that of a memory-set member, were, for all intents and purposes, identical. Practice trials, ensuring familiarity with task requirements and the nature of correct responding, were similar in number for each group.
24 modeling complex systems Further specifics, including those surrounding provision for potentially confounding clinical and demographic variables and ascertainment of the viability of the paradigm for each diagnostic group of participants (e.g., applicability of normed item properties to each one), are detailed in Highgate-Maynard and Neufeld (1986) and summarized in Neufeld et al. (2002). Considering the current emphasis on latency, namely, estimated encoding durations for correct responses, it should be emphasized that error rates were comparable across groups and did not contribute to latency in any confounding way. Finally, trimming from the examined latency data those times estimated for processes residual to the one of current focus—namely, encoding—is detailed in Neufeld et al. (2002; see also Neufeld, Vollick, & Highgate, 1993). Specific processes thought to be tapped by this task, then, include, first, the cognitive translation of the probe item into a format abetting comparisons with the memory set or the memory set’s relevant properties; second, the comparisons proper; and third, response processes. Results from Highgate-Maynard and Neufeld’s (1986) study represent a case in point of delayed completion of the encoding process among schizophrenia participants, amid integrity of remaining processes. Individuals with schizophrenia taking part in this study included paranoid and nonparanoid subgroups. Comparison groups involved nonschizophrenic psychiatric controls as well as nonpatient controls. The present developments are expedited by focusing on the paranoid-schizophrenia participants and the nonpatient controls. The clinical significance of this delineation has been described in Nicholson and Neufeld (1993); paranoid subgroups have also tended to be more elongated in probe-item encoding than nonparanoids. Convergent support for this form of deficit, evinced on the present and related paradigms, has been presented in other sources (Neufeld, 1991; Neufeld et al., 2002; Neufeld, Vollick, et al., in press; Neufeld & Williamson, 1996). Convergent support for the modeled composition of the deficit (elaborated on below) arises from investigations of divergent paradigms and forms of analysis. These include studies analyzing expressly the architectures and parameters of item encoding (Vollick, 1994; Vollick & Neufeld, 2004), studies combining memory-trace theory and multidimensional scaling in assessing deviant similarity judgments (Carter & Neufeld, 1999), and neuroconnectionist assays of temporal and substantive aspects of item categorization (Carter & Neufeld, in press). Finally, potential significance
25 Formal Clinical Cognitive Science as a source of symptomatology, notably thought-form disorder (delusions and thematic hallucinations), has been discussed in other sources (Neufeld et al., 1993; Neufeld & Williamson, 1996).
parameter estimation at the diagnosticgroup level of analysis Equation (5) above is relatively complex (see the expansion in Appendix A), but it comprehensively allows for the possibility that we may not know the group of origin for the individual supplying the current cognitive-performance sample. Thus, we first evaluate the probabilities of group membership, given the performance sample {Pr(g|{*})}, and then cipher the groupwise posterior probability (density) of , conditional on group membership [w( |{*}, g)]. This provision is brought into play (see below) when we wish to use performance samples taken over time to profile an individual’s progress in terms of proximity to variously symptomatic groups (cf. Nicholson & Neufeld, 1993). It comes into play as well when attempting to evaluate dynamic aspects of treatment-regimen efficacy in terms of estimated temporal changes in group density. Meanwhile, we may know perfectly well the group to which the present individual belongs. Our concern is, therefore, strictly with the expression [w( |{*}, g)]. We may isolate on the latter by setting Pr(g) = 1.0, where g is the relevant group. This constraint reduces the parent equation, Equation (5), to the target expression and spotlights its associated computations (consider remnants left by cancellation of terms, in the expanded version of Equation (5) presented in Appendix A, when Pr(g) is set equal to 1.0).
process-latency model The process-latency model has already been alluded to in the earlier discussion of the nature of stochastic dynamic models (see, e.g., “Absorption of Theory-Exogenous Variance”). It consists of the Erlang distribution, which is invoked to portray the stimulus-encoding process. The encoding process is highlighted because, of the several processes putatively involved in task transaction in toto, it is one that is diagnostic of group-performance differences. The rationale
26 modeling complex systems
Figure 3. Erlang distribution, with various pairs of its parameters.
for the adoption of the Erlang and other distributions used here and the qualifying considerations surrounding the present applications have been detailed in Neufeld et al. (2002). The model postulates k stages of encoding (e.g., constituent operations of covertly accessing size properties of the probe item). The stages proceed at the rate v per unit of time (seconds, in this instantiation). In the deterministic case, the process would invariably terminate after an interval of k/v. Ambient trial-to-trial influences naturally infiltrate processing time and perturb this pristine expression. These influences are summarized according to the probability density of process completion at time t: f(t) = (vt)k1/(k 1)! vevt,
(6)
which renders a mean latency of k/v and a variance across trials of k/v2.
27 Formal Clinical Cognitive Science The values of parameters k and v are not invariant, but posited to vary across group members. Thus, the present mixture model provides for individual differences according to the group’s Bayesianprior distribution of parameter values that randomly enter into the above process-latency model. Figure 3 displays the f(t) for four combinations of parameter values, for four hypothetical individuals.
parameter-value mixing distributions It is now apparent that two parameters, k and v, are involved in the process-latency model. Equation (5) may be readily extended to accommodate the present as representing this pair of parameter values (Neufeld et al., 2002). I consider the distribution of each, in turn. The parameter v is held to be gamma distributed, its gamma distribution having the parameters r and k. Its probability-density function, proportional to the relative frequency of its population occurrence, is (7) (rv)k1/(k)rerv. Note that is the gamma function, which is a continuous-variable analogue to the factorial; where k is an integer, (k) is (k 1)!. The parameter r tenably expresses stress-induced impairment in processing speed. In contrast, k arguably conveys the speed-augmenting effects of task-related competence or performance skill (Neufeld, 1994, 1996). As v formally conveys “processing capacity” (e.g., Townsend & Ashby, 1978; cf. Wenger & Townsend, 2000), its distribution is identified with the taskwise capacity pool, and r and k correspond to influences on this pool of stress and performer competence. Construct validity for the mixing-distribution parameter interpretations, particularly that of k, is examined under “Construct Validity of Distribution Parameters: Analytic Considerations” below. Introduced is a new format of construct validity endowed by the parameters’ formal moorings (cf. Haynes, 2001). Sufficient for the purposes at hand is the observation that the distribution of v parsimoniously is regarded as common across diagnostic groups and conditions of encoding load (supporting analyses are enumerated in Neufeld & Williamson, 1996; Vollick & Neufeld, 2004). In the case of schizophrenia, therefore, processing capacity is
28 modeling complex systems
Figure 4. Gamma distribution of v.
spared; its distribution parameters remain unaltered. The estimates of r and k, obtained essentially through fitting theoretical to empirical moments (e.g., Townsend, 1984), were 0.03735 and 2.5044, respectively. Note that, in order to circumvent certain interpretative hurdles apropos the present purposes, incorrect responses were excluded, as were positive trials (Neufeld & Gardner, 1990; Neufeld et al., 1993). The common distribution of v is presented in Figure 4. Unlike the distribution of v, that of k varies with diagnostic group and encoding-load condition. Specifically, this distribution is shifted upward in a similar fashion, with elevation in the encoding load, and with paranoid-schizophrenia diagnostic status. In this sense, these factors represent exogenous and endogenous sources of encoding-load increase, respectively. The distribution of k is considered to be Poisson (Evans et al., 2000). The single parameter of this distribution is designated m. Its mean—the modeled average value of k—is moved to the right by a constant amount for each source, as is its variance. This perturbation of the mixing distribution for k therefore signifies an additive
29 Formal Clinical Cognitive Science increase in encoding subprocesses attributable to each factor of the diagnostic groups by encoding-load layout. The Poisson “intensity parameter,” m, is taken to indicate tendency toward encoding-subprocess recruitment on engagement of the probe item. The mean and variance of the Poisson distribution, then, are both m. The distribution’s base value for the nonpatient controls, under the low-encoding-load condition, is denoted m. The base value is increased by the amount h for each group under the higher-encoding-load, verbal-probe format and by the amount g with paranoidschizophrenia diagnostic status under both higher and lower encoding demands. Reference to the binomial distribution’s counterpart to m allows a more concrete understanding of this parameter. This counterpart, denoted np, approximates m as follows. The quantity n indicates the pool of encoding subprocesses potentially transacting the encoding process for any participant. The term p, in turn, portrays the probability of a latent subprocess being marshaled to the encoding operation. The value of n is m + h + g + x, where x is merely some very large number. That of p approximates m/n, where the base value of m, for controls under low-encoding demands, is m, to which is added h and/or g, depending on whether exogenous (encoding condition) and/or endogenous (paranoid schizophrenia) related increases in propensity toward greater subprocesses are present. The term n is tantamount to a dormant “subprocess pool,” and p may be viewed as a “disinhibition” term. Clearly, m increases with each term. The present interpretation designates p as the source of variation in m (Neufeld et al., 2002). In keeping with this stance, as n approaches the limiting value of infinity and np approaches the limiting value of m, the Poisson and binomial distributions converge. It is the value m = np that governs the probability of a specific value of k. This probability is Pr(k; m) = mk/k!em.
(8)
The estimated value of m was .00001, that of h was 19.7390, and that of g was 70.0. The value of m suggests that the controls required hardly any processing to encode the rudimentary limned drawings of the probe items. Plots (smoothed) of the Pr(k; m) for the present values of m are plotted in Figure 5. The general structure of the mixture-distribution model is sum-
30 modeling complex systems
Figure 5. Poisson distribution of k (smoothed) for differing values of m.
marized in Figure 6. The gamma and Poisson mixing distributions of v and k, respectively, correspond to those displayed in Figures 4 and 5 above. The Erlang distribution of t, on which v and k bear in the individual case (exemplified in Figure 3 above), is the mixture’s “base distribution.” With this structure in hand, estimation of the base distribution’s parameters for an individual can, in principle, be substantially sharpened; all that is needed is a modest sample of the participant’s own process latencies {*}.
individualized parameter estimation With appropriate application of [w( |{*}, g)] to the case of {v, k}, estimation of these parameters stands to become substantially more precise (computational formulas are presented in Neufeld et al., 2002). To illustrate the point, representative performance samples from each diagnostic group, under each condition of encoding load, are brought into play. In each instance, a sample was extracted from
31 Formal Clinical Cognitive Science
Figure 6. Design of mixture model.
one of the 10 participants in each of the four factorial combinations (2 diagnostic groups 2 encoding-load conditions). Each sample size was four, one for each memory-set size, under negative trials. Adjusting these latencies to highlight the encoding process has been described in Neufeld et al. (2002). The sets of trimmed values are presented near the top of Table 2. A graphic example of tailoring a parameter distribution to the individual is exemplified for a tentative case. Specifically, consider the performance sample supplied by the control participant under the low-encoding condition {1.037, . . .}. Although unlikely according to Table 3, this sample still could have been produced by a member of the paranoid-schizophrenia group, under the low encoding load. If so, the customized distribution of k would have moved markedly to the left, relative to the prior distribution aligned with the paranoid schizophrenia/low encoding load combination. This relocation reflects the joint probability of comparatively lower latencies making up this encoding-process performance sample. The Bayesian posterior distribution of k (smoothed) is presented in Figure 7, alongside the prior distribution corresponding to m = 70.00001. Note as well the increased precision of estimation, indicated by the diminished width of the posterior distribution. In fact, the standard deviation of this posterior distribution of k is 1.8110, whereas that of the prior is 8.36. Similar observations attend the individualized estimation of v.
.32930(10-7) Pr{*}→
Control: High encoding loadc Low encoding loadd
b
Parameters of prior distributions: r = .03735, k = 2.5044; m = 89.73901. Parameters of prior distributions: r = .03735, k = 2.5044; m = 70.00001. c Parameters of prior distributions: r = .03735, k = 2.5044; m = 19.73901. d Parameters of prior distributions: r = .03735, k = 2.5044; m = .00001.
a
.17176(10-12) .999776(10-11)
High Encoding Load {3.476, 7.150, 9.00, 4.238}
Paranoid schizophrenia: High encoding loada Low encoding loadb
Classification
.00083 .1486(10-12)
.00684 .00737
Low Encoding Load {2.177, 3.184, 2.411, 2.498}
Paranoid Schizophrenia
.00002 .80080(10-12)
.54107(10-11) .70547(10-9)
High Encoding Load {1.137, 3.204, 1.371, 2.207}
.75783(10-13) .65324(10-12)
.29397(10-40) .23614(10-32)
Low Encoding Load {1.037, 0.554, 0.191, 6.390}
Control
Representative Individual-Participant-Latency Sets
Table 2. Unconditional Joint Densities of Encoding-Latency Performance Samples under Alternate Bayesian Priors
.99987 Pr{g} → 0
Control: High encoding loadd Low encoding loade .027 .23972(10-11)
.022 .9511
Low Encoding Load {2.177, 3.184, 2.411, 2.498}
.99993 .200186(10-12)
.27083(10-7) .00007
High Encoding Load {1.137, 3.204, 1.371, 2.207}
.188326 .81167
.730536(10-29) .23473(10-20)
Low Encoding Load {1.037, .554, .191, 6.390}
Control
Base rates for group membership = .05 for paranoid schizophrenia/high encoding load, .20 for paranoid schizophrenia/low encoding load, .5 for nonpatient controls/high encoding load, and .25 for nonpatient controls/low encoding load. b Parameters of prior distributions: r = .03735, k = 2.5044; m = 89.73901. c Parameters of prior distributions: r = .03735, k = 2.5044; m = 70.00001. d Parameters of prior distributions: r = .03735, k = 2.5044; m = 19.73901. e Parameters of prior distributions: r = .03735, k = 2.5044; m = .00001.
a
.52528(10-6) .00012
High Encoding Load {3.476, 7.150, 9.00, 4.238}
Paranoid schizophrenia: High encoding loadb Low encoding loadc
Classificationa
Paranoid Schizophrenia
Representative Individual-Participant-Latency Sets
Table 3. Posterior Probability of Group Membership, Given Representative Individual Latency Sets
34 modeling complex systems
Figure 7. Posterior distribution of k, Pr(k|{1.037, .554, .191, 6.39}; m = 70.00001), and prior distribution of k, Pr(k; m = 70.00001).
individualized latency distributions These slenderized posterior parameter-mixing distributions can be used to create posterior latency distributions f(t|{*}; g). The customizing effects of a performance sample can be appreciated by contrasting f(t|{*}; g) with those of the alternate mixture distributions f(t|g), sans reference to the performance sample {*}. The selected performance sample is that for the paranoid-schizophrenia low-encoding condition {2.177, . . .}. Figures 8 and 9 show the posterior latency distributions constrained by {*}, and Figures 10 and 11 give their unconstrained mixture-distribution counterparts. Observe that, in Figure 10, the distribution for m = 0.00001 is, essentially, not visible because the stochastic mechanisms involved result in its hugging the y axis.
posterior probability of group membership I now consider the case where a performance sample has been obtained from an individual and is to be used to evaluate that per-
35 Formal Clinical Cognitive Science
Figure 8. Posterior latency distributions f(t|{2.177, 3.184, 2.411, 2.498}; g).
son’s “proximity” to variously symptomatic groups. This scenario may apply to treatment evaluation over time: Is the individual being edged closer to normal functioning, as assessed by methods rooted in contemporary cognitive science? Estimates are available in terms of the posterior probability of a representative of the target group—a group with less or no symptom severity—generating the sample, in contrast to a member of a symptomatic or more severely symptomatic group. In effect, what is being asked is: In Bayesian terms, what are the compatibilities of the obtained process-latency specimen with each group’s pair of prior parameter distributions? The expression of Equation (5) above enclosed in elongated braces { } is now brought forth. Allowing that the performance is sampled at selected points in time, it is assumed that the representativeness of each symptom group along the way is known. In other words, transitions in prevalence of the candidate groups are, ostensibly, monitored so that base rates for a testee’s group membership, Pr(g), g = 1, 2, . . . , G, are available. It is assumed as well that the mixing distributions for these
36 modeling complex systems
Figure 9. Posterior latency distributions f(t|{2.177, 3.184, 2.411, 2.498}; g).
groups, established at the outset, remain valid or, if they do not, that new priors have been formulated for the ensuing points of performance sampling. In the present application, the assumption of initial-prior stability is invoked. Finally, the present computations imply that the G classifications are mutually exclusive and exhaustive. The classificatory system is, therefore, regarded as comprehensive. This feature underwrites the intended description of the presenting individual, which, in fact, is a finite, discrete posterior-probability mixture. The adopted approach entails an “odds-ratio evaluation strategy”—an odds-ratio evaluation strategy for assessing the appropriateness for the current performance sample {*} of the G respective priors. It is deemed to facilitate the flow of the present developments; other Bayesian strategies, with unique statistical merits, are, nevertheless, available (Karabatsos, 2006). In contrast to the scenario painted above, it is possible that diagnostic-group base rates are, indeed, not available for the designated time points. Instead of monitoring an individual’s progress by profiling his or her likelihoods of belonging to symptom groups of known base rates, the primary issue may entail the base rates themselves.
37 Formal Clinical Cognitive Science
Figure 10. Mixture-model latency distribution f(t|g).
Here, the focal problem may be one of evaluating the collective effectiveness of treatment by ascertaining movement in size of symptom-group membership. A question of this nature can, once more, be broached through the elongated-braced expression { } of Equation (5) above. This second case is taken up in its turn below. To expedite the exposition, the present classifications formed by factorially combining diagnostic status and encoding-load condition are appropriated. These combinations again provide the Bayesian mixing-distribution priors of k and v as well as the representative performance samples listed in Table 2 above. We conveniently allow for a progressive decrease in symptomatology with movement across groups formed from combinations of paranoid-schizophrenia status/high encoding demands, to paranoidschizophrenia status/low encoding demands, through nonpatient status/high encoding demands, to finally nonpatient status/low encoding demands. Apropos the encoding manipulation as a surrogate for symptom
38 modeling complex systems
Figure 11. Mixture-model latency distribution f(t|g).
severity, to be sure, responding to increased encoding demands with an increased number of encoding stages is hardly indicative of disorder. It nevertheless conveys an escalation in recruited subprocesses, as a stand-in for the elevated number that may well go along with increased symptomatology (Nicholson & Neufeld, 1993). In all events, this pretense for expedience is inconsequential to the ensuing line of argument and in no way detracts from its analytic points. We posit a scenario where encoding-latency samples have been obtained from four participants, as arrayed in the first row of data in Table 2 above. The values have been obtained, say, at a time of interest specified by the treatment regimen. We wish to estimate probabilities of symptom-group membership for each participant, given the obtained performance data. These groupwise posterior probabilities are endowed by the prior parameter-mixing distributions aligned with the candidate groups. To proceed, it is necessary to know the values of the uncondi-
39 Formal Clinical Cognitive Science tional joint probability density of each latency sample with respect to each group ucd({*}|g). The ucd({*}|g) is the joint density of the obtained sample of latencies, given group g, all values of v and k considered. The numbers assumed by ucd({*}|g) will change with g because the parameter-mixing distributions are group specific. The values of ujd({*}|g) for the current performance samples are presented in Table 2 above. Base rates assigned to the respective groups Pr(g), proceeding from the left to the right of Table 2 (from paranoid schizophrenia/high encoding load to nonpatient controls/low encoding load), are 0.05, 0.20, 0.5, and 0.25. The posterior probabilities of group membership are entered in Table 3 above. Each individual is profiled in terms of distance from the respective groups, enumerated as the Bayesian posterior probability of group membership Pr(g|{*}). Not surprisingly, the highest values tend to be aligned with the groups from which the samples originated. The sole exception occurs for the sample from the paranoid schizophrenia/high encoding load combination. This result is attributable to both ucd({*}|g) and Pr(g) being highest in connection with the nonpatient controls/high encoding load amalgam. The point of the exercise, however, mandates that the clinical scientist/practitioner is blind as to the actual origins of the latency samples. Table entries can, then, provide pivotal information regarding participant status, as conveyed by the Bayesian expansion of the present mixture model. Allowing that all individuals were members of the same group at the outset, clearly the far-right column presents the most encouraging profile and the second-from-the-left column the least so. As intimated above, such multivariate profiles can be charted across successive times of interest. The resulting individual configurations of treatment (non)response, at least as quantified by focal cognitive functioning, may, in turn, be statistically mediated to psychometric and other predictors.
maximum-likelihood estimation of symptom-group base rates In the first case presented above, base rates for the variously symptomatic groups were known, and the desired information consisted of the alternate likelihoods of the individual’s membership, given his
40 modeling complex systems or her specimen of process latencies. In the present case, we entertain a sample of individuals who have been allocated to one or another group on the basis of presenting symptomatology at the selected time of interest. However, the present case differs from the first case in that the base rates are now unknown, and it is this information that we seek. These densities of enclaves with differing symptomatology may be useful in assessing treatment efficacy across the designated times of interest. It may be argued that the desired course of action is simply to directly examine the array of diagnostic assignments that have been made at the selected times. It may be prohibitive, however, to diagnostically interview (or assess by some other means, such as psychometric) a large enough sample to ensure reasonable fidelity of estimates (see, e.g., Batchelder, 1998; Luke & Homan, 1998). If so, it seems desirable to bring to bear our available bank of information on cognitive functioning. In importing this information, we may settle, not only for a modest sample of individuals whose classifications are updated, but also for a modest performance sample from each. The required sampling may, feasibly, be tacked onto sessions hosting symptom assessment at the successive times of interest. The strategy for estimation is straightforward enough. It consists of constructing a likelihood function for the updated participant assignments and then maximizing the function with respect to Pr(g), g = 1, 2, . . . , G. The likelihood function is made up of the joint probability of the updated participant categorizations. This joint probability comes down to the product of the posterior probabilities of those categorizations, given the latency samples {*} linked to the categorized individuals. The procedure constitutes a somewhat unusual but valid combination of maximum-likelihood estimation of a meta-Bayesian parameter (see Appendix A). The likelihood function and related computational details of maximum-likelihood estimation of Pr(g), g = 1, 2, . . . , G, are presented in Appendix B. The instantiation of this application once again makes use of entries in Table 2 above. For reasons of mathematical tractability, and in the interests of illustrative neatness, only three of the four data sets listed in this table are considered. The set corresponding to the nonpatient controls/high encoding load is excluded, deleting the third row and third column of ujd({*}|g) values in the table. However, in
41 Formal Clinical Cognitive Science practice, such a restriction is not necessary, as described momentarily. The maximum-likelihood estimates of Pr(g) were obtained by solving for each value using closed-form solutions to two simultaneous equations (two, rather than three, as the base-rate probabilities sum to 1.0; see Appendix B). It was found that increasing G beyond 3 became infeasible, even with the assistance of a computer-algebra program. In larger-scale applications, however, where G > 3 and/ or the number of diagnostically updated participants is somewhat larger, one may resort to a numerical-search algorithm (e.g., matlab Optimization Toolbox), rather than pristine closed-form solutions, to estimate the respective values of Pr(g). For the present purposes, the three sets of performance samples in the provisionally reduced Table 2 now represent those putatively obtained at the period of updated individual classification. It is, moreover, sufficient to allow each individual to have been assigned to the group adjacent to the displayed performance sample. In other words, three individuals have been classified, one to each group. Furthermore, the classified individuals have putatively supplied the very process-latency samples atop the columns of their respective groups. With these arrangements in place, base-rate estimates of the three groups, proceeding from left to right, become 0.6748, 0.0852, and 0.2399. The most symptomatic category thus remains in the majority at this time of evaluation, and those who are moderately symptomatic are sparsest. Nevertheless, the least symptomatic category is reasonably well represented, with an estimated relative frequency of nearly 0.25. It is tempting to insert these base rates into the expression enclosed by { } in Equation (5) above and, in turn, to evaluate the posterior probabilities of membership in the respective groups, given the associated performance samples {*}—as was done in the first case presented above. Note, however, that this exercise is nothing more than instructive, regarding the involvement of ujd({*}|g) and Pr(g) in arriving at the values of Pr(g|{*}). The latter, again proceeding from left to right in Table 2, are 0.119786, 0.119736, and 1.00. The first amount resembles the second because the comparatively low ujd({*}|g) connected with the paranoid schizophrenia/high encoding load group for the individual so assigned is offset by that group’s
42 modeling complex systems having the highest value for Pr(g). The value of 1.00 for the nonpatient controls/low encoding load assignment evinces the fact that the ujd({*}|g) associated with this specific group exceeds the next highest value by a factor of .2766325061(1021).
qualifying assumptions The above estimates of Pr(g) assume that the parameter-mixing distributions initially prescribed for the symptom-based classifications extend to the time of estimation. This assumption is intrinsically bound up with stability of conditions under which the current sample of task performance is obtained. The assumption is also yoked to continuation of the initial classificatory criteria leading to participant allocation. These requirements come down to retention of their earlier values by parameters of the mixing distributions r, k, and m, continuing tenability of the distributions themselves, and transference of the previous meaning of g in the presently estimated Pr(g). Dislodgement of the established priors from their host symptom groups may occur because of a shift in the nature of task performance, owing, for instance, to practice effects. Potential redress may require the substitution of different task items, analogous to using parallel forms of psychometric tests. To guard steadfastness of the G categories, symptom criteria for designations need, by and large, to be consistent. It is additionally assumed that differential dropout across the G groups and other sources of distortion in their representativeness are prevented. Finally, the computations once again imply that the G classifications are mutually exclusive and exhaustive. In other words, transitions in symptomatology eventuate in one or the other of the G classes addressed at the outset. It is evident from these developments that tenability of the proposed analytic strategies makes for new and potentially useful avenues for formulating clinically significant information. Available are inferences about the status of specific patients, as conveyed by cognitive-functioning aspects of symptomatology. Available as well are broader inferences about treatment efficacy. Furthermore, assumptional constraints are relatively salient. Finally, the developments remain entrenched in a formal cognitive-process model.
43 Formal Clinical Cognitive Science
when events are processes: potential contributions to fmri Recent years have seen an explosion of advances in fmri technology (e.g., Frackowiak et al., 2004; Huettel, Song, & McCarthy, 2004; Reiman, Lane, Van Petten, & Bendettini, 2000). Clinical cognitive scientists have capitalized on these successes, mapping deviations in neuronal-activation patterns corresponding to symptom-significant mentation (e.g., Boksman et al., 2005; Lanius et al., 2004). Note that, in documenting neuronal-activation concomitants, the ultimate subject of interest is not that of external-stimulus events per se. Rather, it is the cognitive processes that are instigated by these events and that parallel the activation profiles that are, thus, set in motion (cf. Friston, Harrison, & Penny, 2003; although not emphasized here, similar considerations attend other measures of neurophysiological functioning, such as magnetoencephalography, or “meg”; see, e.g., Fokas & Marinakis, 2006). Considerable dynamic modeling of the blood-oxygen-level-dependent (bold) response, the kernel of mri measurement, has been put forth (e.g., Aguirre, Zarahn, & D’Esposito, 1998; Boynton, Engel, Glover, & Heeger, 1996). Similarly impressive advances in the statistical treatment of fmri signals have taken place. Quantitative cognitive science is, meanwhile, poised to complement these developments. Implicated are stochastic dynamic models, as follows. Consider the stochastic dynamic trajectories presented in Figure 9 above. The areas under these curves are proportional to relative frequencies of process completion. They can be integrated into posterior cumulative probability functions F(t|{*}) whose values for the respective curves in Figure 9 are shown in Figure 12. The amounts displayed in Figure 12 may, in principle, be consulted to synchronize times of interest in bold-response measurement, on the one hand, with probability of target-process occurrence, on the other. In moving from right to left in Figure 12, for example, the probability of process expiry decreases; however, the time window for measurement does as well. The interplay of such considerations now has a formal backdrop against which to estimate times of interest, complementing regions of interest, in calibrating mri measurement. Moreover, imputation of cognitive functions now stands to be anchored in a verisimilitudinous performance model, avoiding the often-encoun-
44 modeling complex systems
Figure 12. Cumulative probability distributions corresponding to probability densities of Figure 12 above.
tered circular reference to the very neurocircuitry whose functional significance is under study. The trajectories in these figures have been constructed for an individual performance sample/prior distribution combination. They could, however, be extended to accommodate subsets of individuals whose sets of performance samples are similar and to whom the same priors apply. The resulting amalgams should render subsets with relatively homogeneous parameter profiles (see Figure 7 above), along with associated latency trajectories. Aggregation across participants is often necessary to attenuate noise of mri signals or for selected statistical treatment. Amalgamation of parametrically homogeneous participants guards against an amalgam of systematic individual differences in the expression of cognitive functions under study.
multiple processes Typically, even the simplest cognitive task recruits multiple stochastic processes (Smith, 1995; Townsend, 1984). Separability of the respective processes then comes into play. The processes may occur
45 Formal Clinical Cognitive Science in parallel, meaning that they commence simultaneously. Their finishing times are, nevertheless, staggered, according to their respective stochastic distributions (Townsend & Nozawa, 1995; Wenger & Townsend, 2000). Let the probability-distribution function for one of a pair of processes be F1(t) and that for the second be F2(t). It is stated here without elaboration that the greatest likelihood of the second process surviving, with the first having elapsed, is defined by max([1 F2(t)] [1 F1(t)]) = max(F1(t) F2(t)). Measurement epochs addressed to the second process would be synchronized accordingly. The processes may, instead, proceed serially. Let the probabilitydensity function of the initial one be f1(t). Then the greatest likelihood that it has been accomplished, while the second has not yet elapsed, occurs at the modal value of f1(t), or max(f1(t)).
cognitive debility and stress susceptibility The adaptive significance of cognitive functions may be appreciated by deciphering how processing operations interface with environmental exigencies. Consideration of cognitive psychopathology invites the following extension: examination of quantitatively dissected cognitive debilities in relation to likewise quantified environmental pressures on which they bear. As applied to stress negotiation, the above approach implies, among other analyses, delineating information-processing requirements for selecting advantageous, threat-minimizing options when stressor situations are multifaceted. This endeavor is potentiated through the application of mathematical combinatorics, and auxiliary procedures, to environmental prototypes. Products of the analysis include the specification of (a) cognitive costs, in the form of information-processing demands; (b) stress-reducing benefits, in the form of minimization of threat (e.g., physical danger/discomfort; social sanction); and (c) sources of vulnerability stemming from information-processing frailties. The synthesis should, ultimately, provide a more precise picture of compromised negotiation of environmental demands, harboring implications for prediction and intervention. A prominent form of coping with stress, alluded to above, is labeled decisional control (Averill, 1973; cf. Lees & Neufeld, 1999). This
46 modeling complex systems type of coping basically takes the form of situating oneself in a multifaceted stressing context so as to engage the situation’s most innocuous option. Dissection of decisional control, through the application of mathematical combinatorics and related methods to the essential structure of this form of coping, discloses it to be a prototypical expression of selection and choice (Morrison et al., 1988; Neufeld, 1999b). Unveiled, in turn, are its demands on cognition, including option-cue encoding, visual and memory search, and response processes. Unveiled alongside is the undermining potential of debilities in the required cognitive functions, including those comprising retarded completion of encoding processes (Neufeld, 1991, 1999a; Nicholson & Neufeld, 1992). A factor potentially exacerbating the above risk is the toll taken on encoding speed by stress itself (Neufeld & McCarty, 1994; Neufeld, Townsend, & Jetté, in press). Apropos the formal depiction of encoding, this effect translates into a general reduction in the parameter v of the base distribution of latencies (Figure 3 above). Recall that a stress-induced movement of the distribution of v to the left is identified with an increase in its mixing-distribution parameter r (Figure 4 above; Neufeld, 1994; Neufeld & Carter, 2000).
Construct Validity of Distribution Parameters: Analytic Considerations Construct validity is a form of psychometric validity entailing a corpus of evidence brought to bear on the espoused interpretation of a measure. Haynes and O’Brien (2000) have summarily stated that it “comprises the evidence and rationales indicating the degree to which data from an assessment instrument measures the targeted construct; includes all evidence bearing on the measure, and includes all types of validity” (p. 75). In line with this definition, construct validity for the purported psychological meaning of scores from a test, an inventory, or some other mode of assessment emphasizes the measurement tool’s portfolio of empirical correlates (Campbell & Fiske, 1959; Cronbach & Meehl, 1955; Embretson, 1983; for a mathematical critique of selected data-analytic strategies for adducing psychometric construct validity, see Neufeld & Gardner, 1990). An overriding principle governing evidence for a measure’s
47 Formal Clinical Cognitive Science construct validity is that the measure act in accordance with theory (Wiggins, 1973, p. 406). In the present treatment, “measures” consist of model parameters. Construct validity for their imputed meaning, in turn, emanates from their mathematical properties, which are part and parcel of the stochastic dynamic models in which they participate. The light thrown on the nature of parameters by the mathematical properties they possess arguably embodies a new form of construct validity (cf. Cronbach & Meehl, 1955). The parameters of the appropriated process-latency model included v and k. Their interpretations stemmed from the assumed structure of the encoding process, as translated into a corresponding distribution of latencies. Distributions of the above parameters, in turn, have their own parameters, r and k, in the case of a gammadistributed v, and m, in the case of a Poisson-distributed k. Because they pertain to the mixing distributions for v and k, the parameters r, k, and m are a step removed from the empirical touchstones of an individual’s latency data. Accordingly, called for is support for the constructs that they purportedly express, arguably from a commensurate level of analysis. Recall that the parameter m was aligned with “encoding load” and conveyed exogenous (task demands) and endogenous (paranoid schizophrenia) sources of increase. Its binomial-based dissection cast a certain light on the potential composition of this parameter (cf. “construct representation,” Embretson, 1983). The parameter r was identified with stress effects on processing speed. Its increase moves the stage-dispatching capacity parameter v to the left. Finally, the parameter k ostensibly corresponds to process-transaction competence, and its increase shifts the distribution of v to the right. The parameter k is endowed with additional mathematical properties that effectively illustrate the type of construct validity imbued by analytic derivations. The behavioral significance of these properties hinges on the concept of maintenance of cognitive performance, over and against its breakdown, as follows. Within the present analytic context, integrity, versus collapsing, of performance requires that the value of k exceed a certain threshold, paralleling a critical level of performer skill. In contrast, increasing r and m prolongs performance times, but, in this case, as opposed to that of k, actual failure of the processing system is not precipitated when a finite range of values is violated.
48 modeling complex systems The current formal expression of performance breakdown takes the form of certain latency-distribution moments acquiring infinite values: more succinctly, E(Tn) = , where n is the order of the computed moment. Behaviorally, the result signifies that the population of trials occurring under the prevailing value of k includes a critical mass of extremely long, or essentially outstanding, completions (in effect, noncompletions). Consequently, the integral
f(t)t dt = E(T ) 00
n
n
0
does not converge (for further technical exposition, see the first section of Appendix C). The first four moments of a stochastic distribution (n = 1, 2, 3, 4) are somewhat familiar, comprising or being involved in its mean, variance, skewness, and kurtosis. In model evaluation, empirical moments beyond the second are seldom sampled because of instability. The present theoretical deliberations, however, operate in the realm of population properties, bypassing issues of sampling and measurement weaknesses. The order of the moment n can, therefore, be driven to whatever amount is prescribed by the governing theoretical analysis, which, in this case, concerns consequences of variation in the processing system’s constituent parameters. At the same time, such theoretical explorations retain a bona fide bearing on the interpretation of the parameter values, as fallibly estimated from empirical data. Observe that this approach to discerning the nature of a theoretical system’s parameters has much precedent in fields ranging from mathematical ecology, to economics, to astrophysics. The above integral indicates how values of t and the order of the moment n act in concert to affect E(Tn). As n increases, its exponentiation of t correspondingly magnifies the consequences of elongated latencies for the computed moment, including its transition to infinity (Appendix C). Apropos the model parameter k, strengthening process-performance skill should influence the distribution of t downward, resulting in E(Tn) being bounded to an even greater extent by finite values. That is to say, it should enable E(Tn) to withstand heightened values of n before transmogrifying to infinity. In effect, k acts to diminish densities f(t) for higher latencies, including extremes, through its shifting the distribution of the process-completion rates, v, upward. Indeed, the threshold value of k
49 Formal Clinical Cognitive Science issuing in bounded moments is defined precisely in terms of n (see both below and Appendix C). Insufficient k implies that appreciable densities of v, f(v), are perilously close to v = 0, generating the critical magnitudes of f(t) at acutely high ranges. The above support for the construct validity of k as a capacityaffecting competence parameter is robust, as assayed from multiple analytic standpoints. It transcends process-latency base distributions with diverse characteristics; its interpretation is enhanced by pertinent Bayesian extensions; its effects are modified in expected ways by formally defined efficiency of capacity application by the operative base distribution; its effects align with those of related parameters from similar mixing distributions; and it is evinced in familiar base-distribution statistical properties. Finally, its effects are distinguishable from those of parameters to which a different meaning is ascribed, notably, r, the avowed index of stress effects on processing capacity. These variations on analytic support are dealt with in succession. Their largely verbal descriptions are presented below, with technical justifications allocated to the several sections of Appendix C.
critical values of k : convergence from multiple base distributions Finite moments of mixture-model latencies require that k exceed the order of the moment, n, for diverse process-latency base distributions. The current selection of base distributions is prominent in the stochastic-modeling literature and expresses alternate structures of a processing system. The descriptions of these base distributions are available in various sources (e.g., Evans et al., 2000; Johnson et al., 1994, 1995; Ross, 1996); presentation here is restricted to theoretical analysis of the espoused substantive significance of k. Note that the present treatment, although theoretical, is malleable with respect to empirical application. Almost any empirical process-latency distribution can be well approximated by creating a finite probability mixture of one or more base distributions (defensibly expressing the relative percentage of trials best characterized by the respective base distributions; e.g., Townsend & Fific, 2004). Importantly, results of the present analyses regarding moment finiteness are preserved with such a mixture.
k stages fixed, each with constant rate v
k stages random, v constant across stages
Compound Poisson
Distinguishing Features
Erlang
Base Distribution
-M
(rv) k – 1rerv , (k)
r2m(2(k – 1) + m) (k – 1)2(k – 2)
mr ; (k – 1)
Var (T) =
E(T) =
and m is the parameter of the Poisson distribution of k. For example,
f(v) =
i
v , (v + )
T
f(v)[(em(M i ( – 1))-e |v]dv,
MT ( ) =
00
0
where MT ( ) =
(– 1) ndn MT ( )/d n| = 0 ,
rn (k + n – 1)!(k – n) (k – 1)!(k)
k>n
a
k = n1
00 (1 – e –m) = 00
r k (k + n – 1)! ln(r + t) (k)(k – 1)!
nth Moment
] t= 0
t= 00
= 00
Comments
continued
E(T n|k) = 00, hence E(T n) = 00, also by results for the general gamma distribution below
E(T n|k) = 00, by results for the Erlang distribution above
For the exponential distribution, k = 1.0
Table 4. Process-Latency Base Distributions and Their Moments with a Gamma-Distributed “Capacity” (Intensity) Parameter, v
-e-M
a
Rate for the ith stage is civ, where ci = (k– (i+1)); i = 1, 2, . . . , k
Single stage; rate is continuous functions of time
Pure death general gamma process with linear death rate
Weibull
k
Ckcin!r –n (k – n) , (k)
k
–1
k i
n
n
– n) () r n!(k (k)i
cj
ci
rn (n/ + 1)(k – n) , (k) where > 0
i=1
(– 1) i+1
j=i –
Cik = j=1 1–
k
( )
where ci is a scalar of v for the ith stage, ci > 0; the rate thus in effect for stage i is civ; and
i=1
k
k
k i
k
i+1
00 , as (k – n) = (0)
i=1
n+1
ln(r + it) () ir n (k)i ]
= (– 1) , 00 = 00
i=1
(– 1) i+1
00 , as (k – n) = (0)
t= 0
t= 00
Expression of moment infinity as (0) or ln(00) merely rests on integration with respect to t first or v first, respectively.
Stagewise rate transition
General gamma
52 modeling complex systems The above relation between k and n occurs for the Erlang distribution (Figure 3 above), with a fixed-stage parameter k. A specific case is the single-stage exponential distribution, where k = 1.0. This relation includes as well the extension to k as a Poisson-distributed random parameter, otherwise known as the compound Poisson distribution (e.g., Feller, 1966; Ross, 1996). Together with the mixture on v, the latter distribution makes up the dual-parameter mixture model depicted in Figure 6 above. In the present context of base distributions whose parameter v is gamma distributed, the compound Poisson distribution is considered simply to be a base distribution whose Erlang stage parameter, k, is Poisson premixed. The rate parameter, v, is constant for each stage in both the Erlang and the compound Poisson distributions. The above relation between k and n, however, transcends base distributions with a static rate parameter. It extends to those with rate transitions across stages, known as the general gamma distribution (McGill & Gibbon, 1965). A notable version of the general gamma is a pure death system with a linear death rate, which is a parametric version of an independent parallel-processing model with unlimited capacity (see Townsend, 1990; Wenger & Townsend, 2000). This model has figured prominently in selected theorizing about the architecture of human information-processing mechanisms (see, e.g., Townsend & Ashby, 1983, pp. 80–95). Another well-known and frequently used distribution to which the present relation applies is one with a single stage of process completion but with a rate that changes continuously with time (Weibull distribution). The selection of base distributions, and their distinguishing properties, to which the relation between k and n applies is summarized in Table 4 (further details are briefly presented in the second section of Appendix C, additional elaboration being available in Neufeld, 1994). Also listed are the moments for k > n and k = n. Apropos the latter, note that, if the nth-order moment is unavailable (infinite), as in the case of n = k, so are moments of order exceeding n (for k as an integer, see, e.g., Harris, 1966, p. 102; where k is not an integer and k < n, the function (k n) appearing in the moment’s expression takes on a succession of negative, infinite, and positive values as k n decreases from 0, whereby moments about the origin become meaningless. At the heart of the matter is the attestation to k as a process-
53 Formal Clinical Cognitive Science transacting competence parameter, according to invariance of its infinity-avoiding values across base distributions of heterogeneous makeup. Robustness of this nature bears a certain resemblance to empirical convergent validity, which entails agreement among divergent methods of measuring the same trait (Haynes, 2001).
bayesian extension Additional light can be thrown on the proffered interpretation of k by dissecting its properties within a Bayesian context. Insight is afforded according to the give-and-take between k and both empirical performance samples and collateral parameters. A poignant exemplar involves the Erlangk,v distribution whose rate parameter, v, is gamma mixed. The current Bayesian extension once more incorporates a set of process latencies {t1, t2, . . . , tN} = {*}, and the nature of latency-distribution moments again occupies center stage. The fixed-parameter status of k streamlines the present exploration without curtailing the generality of available inferences. Findings tenably apply to classes of individuals sufficiently homogeneous regarding k that this simplification is a reasonable approximation of the quantitative goings-on. The required moment expression, so conditionalized on k, can be immediately extracted from derivation (A.10) of Neufeld et al. (2002). It appears as follows: N
n
E(T |{*}, k) =
[r + ti ]n(Nk + k – n)(k + n – 1)! i=1
(Nk + k)(k – 1)!
.
(9)
This expression affords a certain perspective on the posited interpretation of k from the standpoint of rudimentary classic psychometric theory surrounding performance-sample size or test length. The excursion into the psychometric analogy is followed once more by observations on the viability of the proposed interpretation of k. Isolating first on the term (Nk + k n), an infinite value of E(Tn|{*}; k) is avoided if Nk + k exceeds n. In this case, it is possible to have k = n without E(Tn|{*}; k) = if and only if Nk > n k, allowing, of course, that the present ti < , i = 1, 2, . . . , N. A value of k = n signifies that a finite E(Tn|{*}; k) does not characterize all members of the class of individuals to whom the current value of k applies.
54 modeling complex systems The specific member at hand is, nevertheless, characterized by a latency moment bounded by finite values. The psychometric analogy seemingly throws light on this conclusion as follows. Within this analogy, the stage parameter, k, corresponds to the number of parallel items composing a psychometric test. Second, N corresponds to the number of independent test administrations. The collective item sample is, therefore, Nk. With a sufficiently large empirical sample of finite latencies, combined with the extant value of k, a finite value of E(Tn|{*}; k) is assured for the testee at hand. The argument can be carried further as follows. Consider that the Bayesian posterior moment E(Tn|{*}; k) can, in principle, be partitioned according to a probability mixture of two partial expectations, (E(Tn|{*}; k) = ) and (1 )(E(Tn|{*}; k) < ), where is the mixing parameter, 0 1.0. A sufficiently large performance sample of finite process-completion latencies, in concert with k, in effect renders equal to 0. Conversely, a value of Nk such that Nk + k = n fails to nullify the viability of the partial expectation E(Tn|{*}; k) = , 0 < 1.0, and an infinite moment ensues for the present individual. Bringing the above formulation to bear on convergent support for k as a process-transaction competence parameter, the following inference from Equation (9) is apparent. A performance sample size that is inadequate to ensure stability of finite latency values for the person at hand can be offset by a sufficiently large value of k for the class of individuals to which the present performer belongs, specifically, k > n Nk. Inspection of Equation (9) reveals further interplay between k and N and between k and k, both informative as to the nature of k. Allowing Nk + k > n, consider the following ratio, extracted from Equation (9): 1 (Nk + k – n) . = (Nk + k) (Nk + k – 1)(Nk + k – 2) . . . (Nk + k – n)
E(Tn|{*}; k) evidently decreases as N and k increase, other things remaining constant. This result stems from the participant’s performance-based maximum-likelihood estimate of v, mle(v) being Nk . N
t i=1 N
i
Clearly, mle(v) increases with N, ti , along with k remaining coni=1
55 Formal Clinical Cognitive Science stant. Likewise, the estimated process-completion capacity of the current participant is raised in a parallel fashion with elevation in k (Equation (A.6) of Neufeld et al. 2002), as should be the case, considering the imputed meaning of k as a capacity-enhancing competence parameter. Finally, Equation (9) discloses that the interplay between k and k is comparatively complex. Computer computations indicate that changes in E(Tn|{*}; k) with elevation in k can be nonmonotone, decreasing and then increasing. The decrease is understandable in light of the influence of k on mle(v), considered above. Note, however, that, as k goes up, so does the process magnitude, with respect to the number of stages involved. Evidently, effects of the latter ultimately surpass those on mle(v), eventuating in a movement upward of the Bayesian posterior moment. Apropos the current thrust regarding k, such eventual elevation can, interestingly, be replaced with continuing decline if k is made increasingly large. This result again should be observed if k represents a competence parameter, whose influence can override that of a progressive increase in task load k on E(Tn|{*}; k).
interplay with capacity utilization Unlike the Erlang or general gamma distributions, but similar to the Weibull distribution (discussed above), the nonhomogeneous Poisson distribution specifies a continuous change in processing rate with time. This dynamic rate is vt1, 0. If > 1, the rate continuously increases; if < 1, there is a continuous decline in rate, reflecting, say, a fatigue effect. The parameter is, therefore, designated a capacity-application efficiency parameter. Metaphorically, it signifies the exploitation of capacity dealt to the processing system by the “capacity-resource pool” (gammar,k-distributed v). It is apparent that the Weibull distribution can be obtained from the nonhomogeneous Poisson by setting k = 1 and taking v to the power of . Releasing these constraints in the study of k, however, affords certain insights stemming from the relation of its effects to those of . As the rate parameter of the Erlang distribution is now replaced with vt1, f(t|v) = ((vt–1)t) k–1 –1
(k – 1)!
vt–1e–(vt )t.
56 modeling complex systems The coefficient provides for
0 f (t|v)dt = 1.0. 00
Consequently,
E(T n ) = 0
00
=
0
00
(rv) k–1 –rv (vt) k–1vt–1e –vt tn re dt dv (k) (k – 1)!
rn/ (k – n/ )(k + n/ ) . (k – 1)!(k)
On inspecting the structure of this moment, it is apparent that the burden placed on k for retention of finite values is now alleviated, or, indeed, intensified (for > 1.0 and < 1.0, respectively), by a factor of 1/. Observe in passing that stress effects on moment magnitude are also modified according to in the term rn/. Similar to the escape of E(Tn) from finite values if k = n/, E(Tn) breaches finite bounds if = n/k. In this way, performer competence as conveyed by k and capacity-application efficiency as conveyed by reciprocate with respect to moment retention of finite values. A complementary angle on the relation of k to capacity utilization, , is afforded by a rigorous and robust index of “process-completion potential,” as articulated in contemporary cognitive science (Townsend & Ashby, 1983; Wenger & Townsend, 2000 with respect to the clinical-science implementations, see Neufeld, Townsend, & Jetté, in press). This index is aligned with E(Tn); it consists of 1n(F (t)), where F (t) is the process-latency distribution’s survivor function, or the complement of the cumulative probability-distribution function, 1 F(t) (see the first section of Appendix C; also Figure 12 above and related text). The current interpretation of k implies effects on 1n(F (t)) that should closely resemble or mimic those of . The parameters k and should also play off one another in maintaining specific levels of 1n(F (t)). These associations are apparent in Figure 13, which plots the above index of process-completion potential as a function of k and for selected values of r, k, and t (formulas underlying Figure 13 are presented in the third section of Appendix C). The parameter k, then, behaves as it should as a capacity-supply competence index, as set against as a capacity-application efficiency index. It does so with respect to both E(Tn) and the allied expression of process-completion potential ln (F (t)).
57 Formal Clinical Cognitive Science
Figure 13. Values of process-completion potential 1n(F (t)) for the nonhomogeneous Poisson distribution, with rate parameter vt1 and v gammar,k distributed, for k varying from 1 to 3 and varying from 1 to 5, r = .03735, k = 18, t = 2.25.
convergence with allied mixingdistribution parameters The above developments surrounding construct validity for k specify that performer competence is a key contributor to capacity resources bearing on process transaction and that this shape parameter of gamma-distributed v is an index of such performer skill. There is nothing about this formulation that excludes other capacity mixing-distribution parameters from assuming a role like that of k. The shape parameter of related mixing distributions could, tenably, express performer competence, with properties like those of k. In other words, k need not have a corner on conveying performer ability; indeed, parameters that take on a similar role in other distributions and affect performance indicators in a similar fashion to k indicate that the derived analytic properties are not idiosyncratic to a gamma mixing distribution. The concept of capacity-infusing competence should transcend the shape parameter k of the gamma distribution as a particular quantitative instantiation. This version of analytic construct validity again is analogous to empirical convergent validity, where a trait evinces parallel values across divergent methods of measurement (e.g., Haynes, 2001).
58 modeling complex systems Table 5. Moments of Weibull and Erlang Process-Latency Base Distributions, with Capacity Parameters Either WeibullV, or Gammar,k Distributed. Base Distribution Mixing Distribution
Weibull
Gamma
Weibull; v Is Randomly Mixed
Weibull; v Is Randomly Mixed
Erlang; v Is Randomly Mixed
Vn (n/ + 1)(1 – n/B) Vn/ (n/ + 1), (1 – n/B)) Vn (k + n)(1 – n/ B) (k – 1)! rn (n/ + 1)(k – n) (k)
rn/ (n/ + 1)(k – n / ) (k)
rn (k + n – 1)!(k – n) (k – 1)!(k)
A notable example whose distributed variate, like gamma’s, ranges from 0 to , with intensity parameter v and shape parameter , is the Weibull distribution, described above. As the Weibull now serves as a mixing distribution, these parameters are designated V and B, respectively. The second section of Appendix C shows that, whether they are mixing or base distributions, the gamma and Weibull are nested in the generalized gamma distribution (additionally allowing k of the generalized gamma to assume the status of k as a continuous variable). An exhaustive analysis of the two distributions’ effects seems unnecessary. Sufficient to make the point are definitions of moment finiteness in relation to k and B. Selected process-latency base distributions now include the Erlang and the Weibull itself. In the latter case, the intensity (capacity) parameter v alone and, then, v exponentiated by , v, constitute the gamma- or Weibull-mixed random variate. The respective moments are presented in Table 5. Isolating on the far-right-hand gamma function, (x), in each case, maintaining moments within finite bounds evidently requires identical values of k and B from gamma and Weibull mixing distributions, respectively. Convergently, then, these equivalent thresholds of k and B add to the constellation of analytic properties endorsing the construct validity of k. Finally, similar observations attend the discrete-variable analogue of the mixture involving the Erlang base whose parameter v is gammar,k distributed. In contrast to the Erlang base distribution, whose functions are those of continuous time t, the Pascal distribu-
59 Formal Clinical Cognitive Science tion defines the probability of completing a process comprising k stages on the jth trial, j = k, k + 1, . . . . Its parameters are k and p, where p denotes the probability of successful stage completion on a trial (Patil & Joshi, 1968). The parameter p is, thus, the discrete-variable analogue of stage-completion capacity and, in that way, maps onto v of the Erlang distribution. The Pascal-gamma mixture defines p as eu, where u is gamma distributed, with parameters r and k. Clearly, the directions in which r and k affect the distribution of the base processes’ capacity parameter are now reversed, suggesting that moment finiteness may depend on critical values of r. Accordingly, the mean and variance of process-completion trials, for example, escape finite bounds if r = 1, and the variance does so if r = 2.
summary statistics of prototypical performance samples The final aspect of analytic construct validity considered here pertains to statistical summaries of latency distributions for representative individuals, as related to k for the class to which these participants belong (for discussions of empirical estimates of classcomposing homogeneity, see, e.g., Carter, Neufeld, & Benn, 1998; Neufeld & McCarty, 1994). The analysis affords another glimpse of k as indicative of the performance-ability level required to contain the statistical summaries of performance within finite bounds. Each formally prescribed hypothetical participant is representative, inasmuch as the amount appropriated by the capacity parameter v of his or her Erlang distribution generates the mean or expected value of the summary statistic for the represented class. The first summary statistic is the mean process latency, which is k/v. With v being gammar,k distributed, the grand mean taken across all participants is kr/(k 1). The result shows that the value of v for an individual whose own mean latency equals that of the grand mean is, necessarily, (k 1)/r, which is the modal value of the gammar,k distribution. Similar observations apply to the individual whose standard deviation in latency equals the expected standard deviation, or k½r/(k 1). Finite values of these summary statistics demand that k > 1.0.
60 modeling complex systems In like fashion, v for an individual whose variance in process latencies is equal to that of the expected value—the average variance—is ((k 1)(k 2))<1/2>/r. The result follows because the latency variance, given v, is k/v2 and the expected or mean variance is kr2/ ((k 1)(k 2)). (Note that the theoretically prescribed value of v for the expected standard deviation and that for the expected variance are not identical, as E((SD(T|v))2) = E(Var(T|v)) (E(SD(T|v)))2.) Here, finite values of the summary statistic require that k > 2.
complementing empirical support The above exposition of the analytic side of construct validity should dovetail with empirical support in its varied forms (enumerated in Haynes & O’Brien, 2000). A tactic of choice, when it comes to formal-model parameters, involves selective sensitivity to experimental manipulations or to variation in pertinent organismic, participant variables. Concrete illustrations from the literature include those addressed to the understanding of parameters symbolizing determinants of retroactive interference with traces of memorized items (Chechile, 1987). They address, as well, parameters linked to the detection and retention of informational sources (Riefer, Knapp, Batchelder, Bamber, & Manifold, 2002). As for the present parameters, k has been released as a free parameter to express variations in cognitive (visual-scanning) performance across groups differing in stress proneness (Hamilton, 1980). Model predictions of empirical performance configurations failed to compete with those where r was, instead, freed to vary with stress susceptibility (Neufeld & Carter, 2000). In other instances (Neufeld, 2002), variation in k effectively expressed effects of practice, unlike a competing parameter considered to indicate the number of stimulus features to be processed during task trials (Weinstein, 1974).
in summary The method of illustration was used to motivate and exposit engagement with analytic aspects of construct validity as it related to interpretation of model parameters. Focus centered on support for
61 Formal Clinical Cognitive Science espoused meaning of a parameter bearing on the capacity-resource pool of a cognitive process (e.g., stimulus encoding). The capacityresource pool was operationalized as a stochastic distribution of a process-model parameter conveying speed of process transaction. Construct validity of the imputed substantive significance of the capacity-affecting parameter, k, in turn, took the form of its mathematically derived analytic properties. The stochastic distribution of capacity values was gamma, with parameters r and k. Increasing values of these parameters shifted the capacity distribution downward and upward, respectively. The shape parameter, k, was tendered as an indicator of process-completion skill or competence. Evidence constellated for the posited interpretation of k included substantively meaningful properties transcending specific processlatency (base) distributions. Contrasting structures of base-distribution models were employed, tenably standing for diverse types of cognitive-task operations. Bayesian extensions lent additional support to educed inferences. Consequences of varying k interfaced with the status of other processing-system parameters in ways to be expected with the interpretation accorded k. Convergent support was also endowed by alternate-distribution parameters, whose effects on task performance should resemble those of k, given that they occupy a similar mathematically prescribed role. Next, performance of hypothetical participants, whose distributions of process latencies typified those of their embedding class, were inspected for workings of k. Performance properties (summary-statistic functions of k) of these idealized participants again conformed to the claimed substantive significance of this parameter. Finally, the compatibility of analytic results with empirical support for construct validity was described.
Stochastic Modeling and the Psychometric-Artifact Issue in the Study of Differential Cognitive Deficit Stochastic dynamic modeling of cognitive performance can speak to certain long-standing measure-theoretic predicaments accompanying the study of differential cognitive deficit in schizophrenia and
62 modeling complex systems other disorders (Carter & Neufeld, 1999; Neufeld et al., 2002). At the forefront is the “psychometric-artifact problem,” which states that the apparent separation between pathological and control groups on a given measure conflates differences on the addressed cognitive faculty with the measure’s psychometric properties. A measure can, therefore, spuriously indicate greater deficit on the faculty it putatively taps because it possesses greater psychometric precision than measures directed to other faculties (Chapman & Chapman, 1973, 2001). Advocated redress of the problem has entailed prematching measures’ psychometric properties using a standardization group composed of nonpatients who vary widely on the faculties being examined. Matching should, purportedly, incorporate variance in the measures’ observed scores and in their respective reliabilities. In addition, simplicity of factorial structure is recommended (Strauss, 2001; cf. Neufeld, 1984; Neufeld & Broga, 1981). The issue and its endorsed solution continue to elicit considerable adherence (e.g., Brenner, Wilt, Lysaker, Koyfman, & O’Donnell, 2003). The proposed solution of psychometric-property matching has also received substantial challenge, and alternatives have been articulated (Carbotte, 1978; Knight & Silverstein, 2001; Neufeld, 1984, 1989; Neufeld & Broga, 1977, 1981; Neufeld et al., 2002). The issue is dissected here by translating it into simple but arguably sufficient measure-theoretic terms and then evaluating effects of typical psychometric-adjustment practices. Boiled down to essentials, the argument has, for some three decades, been more or less as follows. More psychometrically precise measures will have more statistical power for detecting control/ pathological-group separation and, thus, be differentially favored over psychometrically inferior measures in indicating statistically significant deficit or disproportionate deficit (expressed as an interaction with corresponding groupwise simple main effects). Comparative effect-size estimates should, of course, conform to the above intermeasure differences in statistical properties, other values (notably, sample size) being equal. Note that, for two groups, statistical power for detecting a difference on a selected measure is an increasing function of the squared noncentrality parameter n(1/4d2), where d refers to Cohen’s (1988) d, or the standardized population-group difference in means (1 2)/ . In this expression, is the common within-group standard devia-
63 Formal Clinical Cognitive Science tion, and n is the common group sample size. The expression 1/4(1 2)2 conveys between-group effects and is, tenably, composed of some amalgam, first, of those that are unique to group membership and constant among its members (corresponding to taxonic variables in Meehl & Golden, 1982), denoted here as , and, second, of those that represent between-group inequalities with respect to latent variables that also generate true-score variance across participants, within groups . The net contribution to the numerator of 1/4d2 from the latter source is denoted c, where the scalar c increases as sources of between-group separation on the measure overlap with those of within-group, interparticipant variation, 0 c 1.0. The expression 1/4(1 2)2 can, thus, be replaced with c + . Finally, duly replacing 2 with + e, where the term e represents measurement-error variance, makes 1/4d2 itself become (c + )/( + e).
(10)
Although not essential, for mathematical tractability and the purpose of illustration, it is assumed that none of c,, e, and are functions of one another. Turning to the issue of psychometric adjustment using standardization-group data, it is apparent from Equation (10) that the nub of between-group inequality, c and , is bypassed; within-standardization-group measure reliability is equal to /( + e), and observedscore variance is equal to + e. Interestingly, by Equation (10), where all between-group variance is conveyed by , > 0, and c = 0, 1/4d2 can, evidently, be increased with reduction in . That is to say, the measure becomes less group discriminating as its standardization-group psychometric precision goes up. In fact, the effects of reducing are unveiled by differentiating (10) with respect to , the result being (ce )/( + e)2. Clearly, increasing —and, along the way, increasing measure reliability, /( + e)—has adverse effects on power if ce < and favorable effects if ce > . Thus, the consequences for d2 of varying are complex, and, in fact, unknowable from standardization-group variance, because the latter is mute about the structure of group differences composed of c and . Of course, decreasing e invariably increases reliability as well as d2, as would be expected, and as is obvious from Equation (10). But c and remain unknown, leaving psychometric matching to grope blindly when it comes to amounts by which e
64 modeling complex systems should be altered (say, through increased accuracy of instrumentation or preaggregating measurements; see, e.g., Neufeld & Gardner, 1990). The upshot is that equalizing a pair of measures on and e has no problem whatsoever in leaving them grossly unequal in their group-discriminating power.8 Empirical examples instantiating the theoretical dissociation between control/pathological-group discriminability and classic psychometric properties have been amply documented elsewhere (Knight & Silverstein, 2001; Neufeld, 1984, 1989; Neufeld & Broga, 1981). These instantiations need not be recapitulated here. More productively, it is shown that Equation (10) can be superposed over and against a stochastic-modeling formulation. The conversion metamorphoses the equation and arguably leaves behind as vestigial the statistical-property issue.
a stochastic-modeling translation of the statistical-property issue The terms of Equation (10) can be mapped onto substantive stochastic-modeling expressions. Those of the dual-parameter mixture model are invoked in the present instance, but the resulting observations transcend the immediate case. Each translated term potentially becomes a model prediction of correspondingly partitioned data. Statistical power considerations now pertain to rejection of a nontrivial competing model (cf. Cohen, 1988, chap. 7, pp. 16–17). More generally, ushered in is the substantial methodology of model selection. Included are procedures for evaluating the empirical fit, and the comparative fit, of model predictions that go beyond conventional goodness-of-fit statistical-significance tests (e.g., Myung, Forster, & Browne, 2000; Wagenmakers & Waldorp, 2006). Along with accessing advances in model testing and refinement, the translation of Equation (10) breathes content into its otherwise substantively desiccated terms. The term e in Equation (10) signifies “psychometric measurement error,” taking the form of random variation in participants’ empirical values across observational trials. The current mixture model, in turn, quantifies participantwise intertrial variance in latencies as the expected or mean conditional variance, given k and v:
65 Formal Clinical Cognitive Science E(Var(T|k ∩ v)m
1,2
,r,k
).
Here, m1,2 signifies that the expected variance is taken across both control and pathological groups, which, for simplicity and in keeping with the design depicted in Figure 6 above, differ only with respect to m. The actual amount prescribed by the mixture model is (r2m1,2)/((k – 1)(k – 2)).
(11)
The model counterpart of is the variance in the conditional mean or expected latency, given k and v: Var(E(T|k ∩ v)m
1,2
,r,k
)=
m1,2r 2(k – 1 + m 1,2) . (k – 1)2(k – 2)
(12)
Both the expected conditional variance and the variance in the conditional expectations (discussed above) provide for within-group random variation in v and k among participants. Model analogues of c and cast k as Poissonm mixed and fixed parameter, respectively. In the first case, k is randomly distributed across participants within groups. The distributions themselves are separated according to the values of m1,2. For example, m1 may be m of Figure 6, and m2 may be m + g. The differences in m1 and m2 are, thus, affiliated with c of Equation (10) above. The scaled value of , c, therefore has a model representation as the following function of the between-group difference in means:
( (
(m r)
(m r)
) )
2
1 2 1/4 (k –1) – (k –1) .
(13a)
The analogous value for k as fixed within groups is (k1r)
(k2r)
2
1/4 (k –1) (k –1) . –
(13b)
Equations (11)–(13a)/(13b) together embody twelve model predictions of empirical terms. The data of each diagnostic group, under each experimental condition (encoding load, of Figure 6), can be assembled into the expected conditional variance, variance in conditional expectations, and group mean. Parameter estimates, obtained, for example, through moment-fitting procedures, are five in number according to the prevailing model design. It is apparent that each parameter is called on simultaneously to participate in empirical values whose sources range from within-participant variation to intergroup separation. Among other considerations, severity of model
66 modeling complex systems testing increases with the ratio of empirical observations to parameter-set size and the heterogeneity of conditions to which the model applies. Inferential validity regarding proposed dysfunction, then, ultimately rests on the rigor of the model diagnostics that are exerted. Predictions desirably include qualitative properties of empirical configurations. For example, the present model prescribes additive effects on means of diagnostic groups and experimental conditions, which is tantamount to a predicted second-order difference (see above) being equal to 0 (e.g., Neufeld et al., 1993; Neufeld & Williamson, 1996). Augmenting significance tests for goodness of fit involving predicted distribution moments (crafted from Equations (11)–(13)) can also be constructed (Neufeld, Vollick, et al., in press). Further tests are available from distribution properties, which, in the case of dynamic stochastic modeling, are functions of time t (García Pérez, 1994, 2000; Van Zandt, 2000). These properties flow from the very design spawning the above distributional moments (e.g., density functions, illustrated in Figures 10 and 11 above). Moreover, Bayesian extensions stand to further proliferate model predictions. Posterior density and distribution functions, given an individual sample of latencies (e.g., Figures 8–9 and 12 above), once more are engineered by the stochastically modeled system giving rise to Bayesian-posterior distributional moments themselves (illustrated in Neufeld et al., 2002).
Concluding Comments Placing clinical cognitive science on a decidedly formal platform can unearth productive routes of study and reveal otherwise hidden substantive nuances. Brokering the clinical ramifications of contemporary cognitive science makes for a potentially seamless transition between these two domains of investigation. Overarching model designs can be constructed so as to mediate group-level findings to individual differences in their expression among constituent members. Developments self-disclose implications for evaluation of the cognitive side of treatment-program efficacy, and progress of an individual’s own response to treatment, with respect to cognitive functioning. Also disclosed are assumptive underpinnings of the ad-
67 Formal Clinical Cognitive Science umbrated assessment technology, along with lingering ambiguities awaiting resolution. Formal clinical cognitive science uniquely convenes a quantitative infrastructure for assessing construct validity of meaning assigned to its parameters and, potentially, other properties. It also engages measurement and statistical challenges to inferences about cognitive dysfunction. The current offering at minimum represents a beachhead from which, it is to be hoped, a stronghold of formal clinical cognitive science and assessment methodology may be consolidated.
Appendix A: Bayesian Platform for the Current Developments Expansion of {Pr(g|{*})} and [w( |{*}, g)] of Equation (5) results in the following expression: G G ] { }[ ( 1/[ g=1 Pr(g) ujd({*}|g)] Pr(g) ujd({*}|g) w(|g) cjd({*}|)/ ujd({*}|g) ).
g=1
In this expression, Pr(g) is the current base rate of group g, corresponding to the relative frequency of members of g in the participant sample at large; ujd({*}|g) is the unconditional joint density of the obtained latency data set, given group g, meaning the combined probability density of {t1, t2, . . . , tN}, given group g, all values of
considered; w( |g) is the probability (density) of , given group g; and cjd({*}| ) is the conditional joint density of the obtained latency data set, given the parameter value . Note that the above expansion reveals two sets of Bayesian priors. One comprises the groupwise mixing distribution of . The other comprises the discrete, finite mixing probabilities of the groupwise priors being operative, corresponding to the base rates Pr(g). The latter is a “meta-prior” of this “compound Bayesian formulation.” Note as well that the densities of , including that of any specific value , are determined by the group at hand’s prior distribution of . Where becomes a set of parameters (e.g., v and k; see the text), each with its own independent group-related mixing distribution, one or another member of the set may be considered separately. Separate consideration occurs, for example, when constructing a posterior parameter-mixing distribution, following the acquisition of a
68 modeling complex systems performance sample {*}, as exemplified in Figure 7 above. Computations entail aggregating over values of the set-aside parameter(s) according to its (their) group-prescribed prior probabilities (densities) while addressing specific values of the parameter that has been singled out (“marginals”), also according to its group-specified prior probabilities (densities). Computational details undergirding the present developments have been presented in Neufeld et al. (2002).
Appendix B: Estimation of Base Rates of Symptom Severities The joint probability of an array of J classifications with respect to G groups, by Equation (5) and observations in Appendix A, is J
J
G
Pr(g|{*}) j = Pr(g) ujd({*}|g) j / Pr(g) ujd({*}|g) j .
j=1 j=1 g=1
(B.1)
This product can be show to be a reduction of the joint multinomial probability of the J observed classifications under the model Pr(g|{*}), each probability being an expression of the multinomial likelihood of classification j (see, e.g., García Pérez, 1994; Riefer & Batchelder, 1988). Maximum-likelihood estimates of the Pr(g), g = 1, 2, . . . , G 1 G–1 (recalling that Pr(G 1) = 1 – Pr(g) ), are obtained by differentiatg=1 ing (B.1) with respect to each term in question, setting each derivative to 0, and simultaneously solving the G 1 equations in the G 1 unknowns. A numerical-search algorithm will be required to replace the analytic solutions as computations become unwieldy with increasing J and/or G. Note that Equation (B.1) beguilingly invites a 2 test for empirical goodness of fit of the prevailing model of Pr(g|{*}). Specifically, 2 ln(B.1), which here can be shown to equal 2 ln(B.1)/1.0, is tantamount to 2 ln(multinomial-likelihood ratio), an expression that stands to be distributed as 2 with its associated degrees of freedom (cf. Carter & Neufeld, 1999). In fact, this expression is dubiously distributed as 2df=J(G1) in the present case because the current data array suffers from the problem of “extreme sparseness of cell-wise observations” (see Delucchi, 1993; Tollenaar & Mooijaart, 2003).
69 Formal Clinical Cognitive Science
Appendix C: Finite Values of Distribution Moments values of distribution moments The nth moment of a distribution of latencies t, including those of the mixtures discussed in the text, will be infinite if its integral does not converge:
0 f (t) tn dt = 00 . 00
Equivalently,
(– 1) nE(T n) = dm/d n MT ( )| = 0 = 00 .
Here, MT( ) is the moment-generating function
0 f (t) e– tdt, 00
whose nth derivative with respect to encounters a singularity at
= 0. E(Tn) can also be written as – n 0 (1 – F(t))tn–1dt = n 0 F (t)tn–1dt, 00
00
where F(t) is the cumulative probability-distribution function (see Figure 12 above and related text) and 1 F(t) = F (t) is the survivor function. This version of E(Tn) relates distribution moments, and their availability as finite values, to “process-completion potential.” The latter is defined as – 0 f(t)/F(t)dt, (C.1) where f(t)/F (t) is the hazard function H(t), indicating the conditional rate of process completion at time t, given noncompletion by – t. Because F (t) = exp( – 0 (H(t)dt), (C.1) is readily seen to be simply 1n(F (t)) (see the discourses of Townsend & Ashby, 1983; Wenger & Townsend, 2000). This expression of process-completion potential, and its association with E(Tn), is called on in developments presented in the text under “Interplay with Capacity Utilization” and the third section of Appendix C below. t
t
moments of selected base distributions mixed on a gamma-distributed “capacity” (intensity) parameter Mixture-model latency distributions considered in this section are composed of alternate process-latency base distributions whose “ca-
70 modeling complex systems pacity” (distributional intensity or scale) parameters are randomly distributed according to a gamma distribution whose own intensity or scale parameter is denoted r and whose shape parameter is denoted k. Moments are computed for the case where k > n, n being the order of the moment, and where k = n. Three of the base distributions, the exponential, Erlang, and Weibull, are nested in the generalized gamma distribution, whose probability-density function is
(vt va)k1/((k))v exp((vt va)).
(C.2)
The probability-density function for the Erlang distribution is obtained from (C.2) by setting equal to 1.0 and a equal to 0. The density function for the Weibull distribution results when k = 1.0 and a = 0. The exponential distribution, in turn, is nested in both the Erlang and the Weibull distributions, as its density function is derived from (C.2) when k = = 1.0 and a = 0. Loosely speaking, each base distribution has a conjugate prior, in that both prior and base entail exponentials, making for mathematical tractability (see, e.g., Geddes & Scott, 1989). The probability-density function of mixture-model latencies f(t) for the Erlang base distribution, with its capacity (also rate) parameter v being distributed as gammar,k, is Then f(t)tndt = E(T n)
(
rktk–1 (k + k) . (k)(k – 1)! (r + t) k + k
rn (k + n – 1)!(k – n) (k)(k – 1)!
=
r k (k + n – 1)! ln(r + t) (k)(k – 1)!
]
< 00 ,
if k > n,
= 00
if k = n,
t= 00
t= 0
,
The next base distribution is the compound Poisson (e.g., Feller, 1966; Ross, 1996), of which the special case at hand is composed of an Erlang distribution whose stage (distributional-shape) parameter k is Poisson distributed with parameter m (see Figures 5 and 6, as well as Equation (8), above and the related text). The Erlang rate parameter of this base distribution, in turn, is gamma distributed, with parameters r and k. A concise method of obtaining the moments of this second-order mixture capitalizes on its moment-generating function
71 Formal Clinical Cognitive Science MT( ); the nth-order derivative of the latter, evaluated at = 0 and scaled by (1)n, yields the nth-order moment (for an especially lucid and still current exposition of the moment-generating function, see Kenny & Keeping, 1951). Proceeding accordingly, MT ( ) = 0 f (v)(MT ( )|v)dv 00
=
k= k e –m (MT ( )|k ∩ v)dv 0 m 0 f (v) k= k!
=
e –m (MTk ( ) – e –m )|v dv 0 m 0 f (v) k= k!
=
0 f (v) [(e m(M () – 1) – e –m|v]dv,
00
00
[
00
k= 00
]
k
1
00
T1
where MT ( ) is the moment-generating function for each of the i k-stage intercompletion times, or v/(v + ) for the Erlang distribution with rate parameter v. As the k intercompletion times are identically and independently distributed for a given value of v, MT ( )|(k ∩ v = M kT( )|v . Note that 1
Thus,
MT ( )|(k = 0 ) = 0.
MT ( ) =
(rv) k–1 –rv+m(v/(v+ )–1) re dv – e –m , (k)
0
00
E(T ) = (– 1) d MT ( )/d | = 0 . and The nth-order moment of this second-order compound Poisson distribution will be infinite if k = n, as follows: n
n n
E(T n) =
k= 00
n
k
m k! e–m E(T n|k)|
k=n
k= 0
k= k = m e –m. 00 – e –m. 00| k= 0 k! 00
k= n
(by results for the Erlang base distribution, presented above) = eme –m. 00 – e –m. 00| = 00 (1 – e –m)| k= n
k= n
= 00| . k= n
By similar reasoning, E(Tn) = |k=n also for the general gamma base distribution (discussed below). Turning to the general gamma base distribution, unlike that of the Erlang, the rate parameter is stage specific. In the present implementation, the rate for stage i is civ, ci > 0, i = 1, 2, . . . , k. For this distribution,
72 modeling complex systems MT ( ) = 0 f(v)MT ( )|vdv 00
= 0
00
(rv) k–1 –rv k Cik civ re dv, i=1 c v + (k) i
where Cik is defined in Table 4 of the text:
E(T n) = (– 1) nd n/d nMT ( )| = 0 k
= Cikci n! rn i=1
(k – n). (k)
For the special case, where ci = (k (i 1)), the density function f(t) can be computed, from developments supplied by Morrison (1979), as i k
i=1
(– 1)
+1
(ki ) r ik . k
(r + it) k + 1
From here, it is a simple matter to obtain E(T n) = 0 f(t) tn dt 00
=
(
()
k (k – n) (– 1) i + 1 k rn n! i (k)i n i=1
()
k ir kn! ln(r + it) (– 1) i + 1 k i (k)i n + 1 i=1
]
< 00 ,
if k > n
= 00
if k = n.
t= 00
t= 0
The probability-density function for the Weibull distribution is
v(vt)1 exp((vt)), whereby E(Tn|v) = (n/ + 1)/vn. E(Tn), in turn, is readily available as n (n/ + 1) (k – n) , 0 f(v)E(T n|v)dv = r 00
(k)
which again is severed from finite values if k = n.
formulas underlying figure
13
For the nonhomogeneous Poisson process, with dynamic rate vt1, v having been gammar,k distributed,
73 Formal Clinical Cognitive Science f(t) =
and
r k(k + k)t k– 1 , (k – 1 )!(k) (t + r ) k+ k
k– 1 – F(t) = j= 0
(j + k )rktj . j! (k)(t + r ) j + k
The hazard function H(T) = f(t)/F (t) enters into the index of process-completion potential as follows: 0 H(t)dt. Happily, this integral is available as 1n(F (t)), especially considering the possibility of complex f(t) and F (t), such as those above (see the first section of Appendix C). t
Notes Sources of support for this research include operating grants from the Social Sciences and Humanities Research Council of Canada and the Workplace Safety and Insurance Board and operating grants and a New Emerging Teams grant from the Canadian Institutes of Health Research. Appreciation is expressed to the University College of the Fraser Valley, the Department of Psychology, University of British Columbia, Kenneth D. Craig, sabbaticant host, and to Ruth and Douglas Barr, private citizens, for providing facilities during the writing of this manuscript. 1. A parameter is a variable in a mathematical expression whose values can change without altering the structure of the expression in which it is embedded (cf. Borowski & Borwein, 1989, p. 435). 2. Consider, as a representative example, numerical vs. symbolic integration, a special case being numerical solutions to differential equations composing nonlinear dynamic (“chaos-theoretic”) systems, as contrasted with desired (but most often intractable) explicit solutions of the “initialvalue problem” (Koçak, 1989). 3. Formal statements foster place keeping regarding the current state of progress in the problem area. They make clear what has been formulated, whether new formal proposals differ, and, if so, in what respects. Blind alleys are flagged and promising leads discerned. The place of precedent is usually more fuzzy in the case of verbal statements. Even if they seem to rediscover preexisting ideas, subsequent proposals almost always escape indictment for ignoring antecedents and, if taken to task, usually appeal to allegedly important nuances of difference. 4. These explicit starting points can always be challenged, precisely because they are explicit. Informal theories escape because they are not forced to lay bare their assumptive moorings before commencing (cf. Bandura, 1984; Staddon, 1984). 5. Neuroconnectionist modeling, entailing computer simulations of task-transacting activations among neuronal units or unit modules (Rum-
74 modeling complex systems melhart, McClelland, & pdp Research Group, 1987), arguably has received a warmer welcome (including in the field of clinical cognitive science) because of its face validity as a “brain metaphor” (notwithstanding certain challenges to biological plausibility) and because of commercial software expediting the use of simulation algorithms virtually since their introduction (McClelland, Rummelhart, & pdp Research Group, 1986; cf. Carter & Neufeld, in press). 6. Added to considerations of response properties of interest are those of their distributional properties (e.g., moments of performance latencies, including means, and intertrial variances, illustrated above; distribution functions, as exemplified in Equation (2) above; and similar properties). The concept of target levels of inference, or levels of analysis, and associated boundaries of inference are underscored. Model properties and response parameters entailing task-performance latency, e.g., are deemed to express dynamic properties of operations occurring at other strata, including the algorithmic (neuroconnectionist) and the implementational (neurophysiological; Busemeyer & Townsend, 1993, pp. 443–445; Marr, 1982). The interstrata associations are isomorphic in the same way that a computer-machine language and a computer-programming language are coextensions of one another. Targeting one or the other stratum then becomes a matter of the nature of the focal problem. 7. The performance sample is represented as a set of observations, as opposed to either an ordered set or a response vector. The observations are deemed to be independent, and algebraic operations to which they are subjected do not depend on their ordering. 8. Although compelling in other respects to be sure, methodology developing from item-response theory (irt) can be shown not to resolve the above dilemma, either in its own right or via irt-informed measure composition (see, e.g., Santor & Ramsay, 1998).
References Aguirre, G. K., Zarahn, E., & D’Esposito, M. (1998). The variability of human, bold hemodynamic responses. Neuroimage, 8, 360–369. Averill, J. R. (1973). Personal control over aversive stimuli and its relationship to stress. Psychological Bulletin, 80, 286–303. Bacon, F. (1937). The Advancement of Learning. In Richard Foster Jones (Ed.), Essays, Advancement of Learning, New Atlantis, and Other Pieces (pp. 169– 235). New York: Odyssey. (Original work published 1605) Bandura, A. (1984). Representing personal determinants in causal structures. Psychological Review, 91, 508–511. Batchelder, W. H. (1998). Multinomial processing tree models and psychological assessment. Psychological Assessment, 10, 331–344. Batsell, R. R., Polking, J. C., Cramer, R. D., & Miller, C. M. (2003). Useful
75 Formal Clinical Cognitive Science mathematical relationships embedded in Tversky’s elimination by aspects model. Journal of Mathematical Psychology, 47, 538–544. Berger, J. O. (1985). Statistical decision theory and Bayesian analysis (2nd ed.). New York: Springer. Boksman, K., Théberge, J., Williamson, P., Drost, D., Malla, A., Densmore, M., Takhar, J., Pavlovsky, W., Menon, R., & Neufeld, R. W. J. (2005). A 4.0 Tesla fmri study of brain connectivity during word fluency in first episode schizophrenia. Schizophrenia Research, 75, 247–263. Bollen, K. A. (2002). Latent variables in psychology and the social sciences. Annual Review of Psychology, 53, 605–634. Borowski, E. J., & Borwein, J. M. (1989). Dictionary of Mathematics. New York: HarperCollins. Boynton, G. M., Engel, S. A., Glover, G. H., & Heeger, D. H. (1996). Linear systems analysis of fmri in human v1. Journal of Neuroscience, 16, 4207– 4221. Braithwaite, R. B. (1968). Scientific explanation. London: Cambridge University Press. Brenner, C. A., Wilt, A., Lysaker, P. H., Koyfman, A., & O’Donnell, B. F. (2003). Psychometrically matched visual-processing tasks in schizophrenia spectrum disorders. Journal of Abnormal Psychology, 112, 28–37. Brown, E., & Holmes, P. (2001). Modeling a simple choice task: Stochastic dynamics of mutually inhibitory neural groups. Stochastics and Dynamics, 1, 1–33. Bryk, A., & Raudenbush, S. W. (1992). Hierarchical linear models for social and behavioral research: Applications and data analysis methods. Newbury Park ca: Sage. Busemeyer, J. R. (1980). Importance of measurement theory, error theory, and experimental design for testing the significance of interactions. Psychological Bulletin, 88, 237–244. Busemeyer, J. R., & Stout, J. C. (2002). A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. Psychological Assessment, 14, 253–262. Busemeyer, J. R., & Townsend, J. T. (1993). Decision field theory: A dynamiccognitive approach to decision making in an uncertain environment. Psychological Review, 100, 432–459. Busemeyer, J. R., & Wang, Y. (2000). Model comparisons and model selections based on generalization test methodology. Journal of Mathematical Psychology, 44, 171–189. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105. Carbotte, R. M. (1978). Converging operations or matched control tasks? Journal of Psychiatric Research, 14, 313–316. Carter, J. R., & Neufeld, R. W. J. (1999). Cognitive processing of multidimensional stimuli in schizophrenia: Formal modeling of judgment speed and content. Journal of Abnormal Psychology, 108, 633–654.
76 modeling complex systems Carter, J. R., & Neufeld, R. W. J. (in press). Cognitive processing of facial affect: Neuro-connectionist modeling of deviations in schizophrenia. Journal of Abnormal Psychology. Carter, J. R., Neufeld, R. W. J., & Benn, K. D. (1998). Application of process models in assessment psychology: Potential assets and challenges. Psychological Assessment, 10, 279–298. Casti, J. L. (1989). Alternate realities: Mathematical models of nature and man. New York: Wiley, 1989. Chapman, L. J., & Chapman, J. P. (1973). Problems in the measurement of cognitive deficit. Psychological Bulletin, 79, 380–385. Chapman, L. J., & Chapman, J. P. (2001). Commentary on two articles concerning generalized and specific cognitive deficits. Journal of Abnormal Psychology, 110, 31–39. Chechile, R. A. (1987). Trace susceptibility theory. Journal of Experimental Psychology, 116, 203–222. Chechile, R. A. (1998). A new method for estimating model parameters for multinomial data. Journal of Mathematical Psychology, 42, 432–471. Clark, J. M., & Paivio, A. (1989). Observational and theoretical terms in psychology: A cognitive perspective on scientific language. American Psychologist, 44, 500–512. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale nj: Erlbaum. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. Delucchi, K. L. (1993). On the use and misuse of chi-square. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Statistical issues (pp. 295–320). Hillsdale nj: Erlbaum. Doob, J. L. (1953). Stochastic processes. New York: Wiley. Embretson, W. S. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179–197. Evans, M., Hastings, N., & Peacock, B. (2000). Statistical distributions (3rd ed.). New York: Wiley. Feller, W. (1966). An introduction to probability theory and its applications (Vol. 2). New York: Wiley. Fokas, A. S., & Marinakis, V. (2006). The mathematics of the imaging techniques of meg, ct, pet and spect. International Journal of Bifurcation and Chaos, 16, 1671–1687. Frackowiak, R. S. J., Friston, K. J., Frith, C. D., Dolan, R. J., Price, C. J., Zeki, S., Ashburner, J., & Penny, W. (Eds.). (2004). Human brain function (2nd ed.). San Diego: Academic. Freedman, D. Z. (1993, November). Some beautiful equations of mathematical physics. Dirac Lecture, International Centre for Theoretical Physics, Trieste. Friston, K., Harrison, L., & Penny, W. (2003). Dynamic causal modeling. Neuroimage, 19, 1273–1302. García Pérez, M. A. (1994). Parameter estimation and goodness-of-fit test-
77 Formal Clinical Cognitive Science ing in multinomial models. British Journal of Mathematical and Statistical Psychology, 47, 247–282. García Pérez, M. A. (2000). Exact finite-sample significance and confidence regions for goodness-of-fit statistics in one-way multinomials. British Journal of Mathematical and Statistical Psychology, 53, 193–207. Geddes, K. O., & Scott, T. I. (1989). Recipes for classes of definite integrals involving exponentials and logarithms. In E. Kaltofen & S. M. Watt (Eds.), Computers and mathematics (pp. 192–201). New York: Springer. George, L., & Neufeld, R. W. J. (1984). Imagery and verbal aspects of schizophrenic informational-performance. British Journal of Clinical Psychology, 23, 9–18. Gilden, D. L. (2001). Cognitive emission of 1/f noise. Psychological Review, 108, 33–56. Glass, D. C., & Singer, J. E. (1972). Urban stress. New York: Academic. Gleick, J. (1988). Chaos: Making a new science. New York: Penguin. Gregson, R. G., & Pressing, J. (2000). Dynamic modelling. In J. T. Cacioppo, L. G. Tassinary, & G. Berntson (Eds.), Handbook of psychophysiology (Vol. 42, pp. 924–948). New York: Cambridge University Press. Hamilton, V. (1980). An information processing analysis of environmental stress and life crises. In I. G. Sarason & C. D. Spielberger (Eds.), Stress and anxiety (Vol. 7, pp. 13–30). Washington dc: Hemisphere. Harris, B. (1966). Theory of probability. Reading ma: Addison-Wesley. Haynes, S. N. (2001). Clinical applications of analogue behavioral observation: Dimensions of psychometric evaluation. Psychological Assessment, 13, 73–85. Haynes, S. N., & O’Brien, W. O. (2000). Principles of behavioral assessment: A functional approach to psychological assessment. New York: Plenum/ Klewer. Herrnstein, R. J. (1979). Derivatives of matching. Psychological Review, 86, 486–495. Highgate-Maynard, S., & Neufeld, R. W. J. (1986). Schizophrenic memorysearch performance involving nonverbal stimulus properties. Journal of Abnormal Psychology, 95, 67–73. Hintzman, D. L. (1991). Why are formal models useful in psychology? In W. E. Hockley & S. Lewandowsky (Eds.), Relating theory and data: Essays on human memory in honor of Bennet B. Murdoch (pp. 39–56). Hillsdale nj: Erlbaum. Hockley, W. E., & Murdock, B. B., Jr. (1987). A decision model for accuracy and response latency in recognition memory. Psychological Review, 94, 341–358. Huber, M. T., Braun, H. A., & Krieg, J. C. (1999). Consequences of deterministic and random dynamics for the course of affective disorders. Biological Psychiatry, 46, 256–262. Huettel, S. A., Song, A. W., & McCarthy, G. (2004). Functional magnetic resonance imaging. Sunderland ma: Sinauer. Johnson, N. L., Kotz, S., & Balakrishnan, N. (1994). Continuous univariate distributions (2nd ed., Vol. 1). New York: Wiley.
78 modeling complex systems Johnson, N. L., Kotz, S., & Balakrishnan, N. (1995). Continuous univariate distributions (2nd ed., Vol. 2). New York: Wiley. Kant, I. (1970). Metaphysical foundations of natural science (J. Ellington, Trans.). Indianapolis: Bobbs-Merrill. Karabatsos, G. (2006). Bayesian nonparametric model selection and model testing. Journal of Mathematical Psychology, 50(2), 123–148. Kenny, J. F., & Keeping, E. S. (1951). Mathematics of statistics (2nd ed.). New York: Van Nostrand. Kirk, R. E. (1994). Experimental design: Procedures for the behavioral sciences (3rd ed). Monterey ca: Brooks/Cole. Kline, M. (1985). Mathematics and the search for knowledge. Oxford: Oxford University Press. Kline, R. B. (1988). Structural equation modeling. New York: Guilford. Knight, R. A., & Silverstein, S. M. (2001). A process-oriented approach for averting confounds resulting from general performance deficiencies in schizophrenia. Journal of Abnormal Psychology, 110, 15–30. Koçak, H. (1989). Differential and difference equations through computer experiments (2nd ed., pp. 39–56). New York: Springer; Hillsdale nj: Erlbaum. Kuhn, T. S. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press. Kukde, M. P., & Neufeld, R. W. J. (1994). Facial electromyographic measures distinguish covert coping from stress response to stimulus threat. Personality and Individual Differences, 16, 211–228. Lanius, R. A., Williamson, P. C., Densmore, M., Boksman, K., Neufeld, R. W. J., Gati, J. S., & Menon, R. S. (2004). The nature of traumatic memories: A 4-t fmri functional connectivity analysis. American Journal of Psychiatry, 161, 36–44. Lees, M. C., & Neufeld, R. W. J. (1999). Decision-theoretic aspects of stress arousal and coping propensity. Journal of Personality and Social Psychology, 77, 185–208. Link, S. W. (1982). Correcting response measures for guessing and partial information. Psychological Bulletin, 92, 469–486. Luce, R. D. (1986). Response times: Their role in inferring elementary mental organization. New York: Oxford University Press. Luke, D. A., & Homan, S. M. (1998). Time and change: Using survival analysis in clinical assessment and treatment evaluation. Psychological Assessment, 10, 360–378. MacCallum, R., & Ashby, F. G. (1986). Relationships between linear systems theory and covariance structure modeling. Journal of Mathematical Psychology, 30, 1–27. Marley, A. A. J. (1989). A random utility family that includes many of the “classical” models and has closed form choice probabilities and choice reaction times. British Journal of Mathematical and Statistical Psychology, 42, 13–36. Marley, A. A. J., & Colonius, H. (1992). The “horse race” random utility model for choice probabilities and reaction times, and its competing risks interpretation. Journal of Mathematical Psychology, 36, 1–20.
79 Formal Clinical Cognitive Science Marr, D. (1982). Vision. San Francisco: Freeman. McClelland, J., Rummelhart, D. E., & pdp Research Group. (1986). Parallel distributed processing: Explorations in the microstructure of cognition: Vol. 1. Foundations. Cambridge ma: mit Press. McFall, R. M., & Townsend, J. T. (1998). Foundations of psychological assessment: Implications for cognitive assessment in clinical science. Psychological Assessment, 10, 316–330. McFall, R. M., Townsend, J. T., & Viken, R. J. (1995). Diathesis stress model or “just so” story? Behavioral and Brain Sciences, 18, 565–566. McGill, W. J., & Gibbon, J. (1965). The general-gamma distribution and reaction times. Journal of Mathematical Psychology, 2, 1–18. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–843. Meehl, P. E., & Golden, R. R. (1982). Taxometric methods. In P. C. Kendall & J. N. Butcher (Eds.), Handbook of research methods in clinical psychology (pp. 127–181). New York: Wiley. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis. California: Sage. Morrison, D. G. (1979). An individual differences pure extinction process. Journal of Mathematical Psychology, 19, 307–315. Morrison, M. S., Neufeld, R. W. J., & Lefebvre, L. A. (1988). The economy of probabilistic stress: Interplay of controlling activity and threat reduction. British Journal of Mathematical and Statistical Psychology, 41, 155–177. Myung, I. J., Forster, M. R., & Browne, M. W. (Eds.). (2000). Special issue on model selection. Journal of Mathematical Psychology, 44(1). Neufeld, R. W. J. (1982). On decisional processes instigated by threat: Some possible implications for stress-related deviance. In R. W. J. Neufeld (Ed.), Psychological stress and psychopathology (pp. 240–270). New York: McGrawHill. Neufeld, R. W. J. (1984). Re: The incorrect application of traditional test discriminating power formulations to diagnostic-group studies. Journal of Nervous and Mental Disease, 172, 373–374. Neufeld, R. W. J. (1989). Methodological aspects of laboratory studies of stress. In R. W. J. Neufeld (Ed.), Advances in the investigation of psychological stress (pp. 71–132). New York: Wiley. Neufeld, R. W. J. (1991). Memory in paranoid schizophrenia. In P. Magaro (Ed.), The cognitive bases of mental disorders (Annual review of psychopathology, Vol. 1, pp. 231–261). Newbury Park ca: Sage. Neufeld, R. W. J. (1994). Theoretical stress and stress-proneness effects on information processing in light of mathematical models of stochastic processes (Research Bulletin No. 720). London: University of Western Ontario, Department of Psychology. Neufeld, R. W. J. (1996). Stochastic models of information processing under stress (Research Bulletin No. 734). London: University of Western Ontario, Department of Psychology.
80 modeling complex systems Neufeld, R. W. J. (1999a). Dynamic differentials of stress and coping. Psychological Review, 106, 385–397. Neufeld, R. W. J. (1999b, July). Quantitative schemata of decisional stress-control. Paper presented at the 32nd annual meeting of the Society for Mathematical Psychology, Santa Cruz. Neufeld, R. W. J. (2002, June). Stochastic modelling of stress effects on proofreading. Paper presented at the annual Summer Inter-Disciplinary Conference on Cognitive Science, Squamish bc. Neufeld, R. W. J., & Broga, M. I. (1977). Fallacy of the reliability-discriminability principle in research on differential cognitive deficit (Research Bulletin No. 360. London: University of Western Ontario, Department of Psychology. Neufeld, R. W. J., & Broga, M. I. (1981). Evaluation of information-sequential aspects of schizophrenic performance, 2: Methodological considerations. Journal of Nervous and Mental Disease, 169, 569–579. Neufeld, R. W. J., & Carter, J. R. (2000). Formally deciphering effects of stress on cognitive performance. Paper presented at the 33rd annual meeting of the Society for Mathematical Psychology, Queen’s University, Kingston on. Neufeld, R. W. J., Carter, J. R., Boksman, K., Jetté, J., & Vollick, D. (2002). Application of stochastic modelling to group and individual differences in cognitive functioning. Psychological Assessment, 14, 279–298. Neufeld, R. W. J., & Gardner, R. C. (1990). Data aggregation in evaluating psychological constructs: Multivariate and logical-deductive considerations. Journal of Mathematical Psychology, 34, 276–296. Neufeld, R. W. J., & McCarty, T. (1994). A formal analysis of stressor and stress-proneness effects on basic information processing. British Journal of Mathematical and Statistical Psychology, 47, 193–226. Neufeld, R. W. J., & Mothersill, K. (1980). Stress as an irritant of psychopathology. In I. Sarason & C. D. Spielberger (Eds.), Stress and anxiety (Vol. 8, pp. 31–56). New York: Hemisphere. Neufeld, R. W. J., Townsend, J. T., & Jetté, J. (in press). Quantitative response time technology for measuring cognitive-processing capacity in clinical studies. In R. W. J. Neufeld (Ed.), Advances in clinical cognitive science: Formal modeling and assessment of processes and symptoms. Washington dc: American Psychological Association. Neufeld, R. W. J., Vollick, D., Carter, J. R., Boksman, K., Levy, L., George, L., & Jetté, J. (in press). A mathematical process account of group and individual differences in memory-search facilitative stimulus encoding, with application to schizophrenia. In R. W. J. Neufeld (Ed.), Advances in clinical cognitive science: Formal modeling and assessment of processes and symptoms. Washington dc: American Psychological Association. Neufeld, R. W. J., Vollick, D., & Highgate, S. (1993). Stochastic modelling of stimulus encoding and memory search in paranoid schizophrenia: Clinical and theoretical implications. In R. L. Cromwell & R. C. Snyder (Eds.), Schizophrenia: Origins, processes, treatment, and outcome: The Second Kansas Series in Clinical Psychology (pp. 176–196). Oxford: Oxford University Press.
81 Formal Clinical Cognitive Science Neufeld, R. W. J., & Williamson, P. (1996). Neuropsychological correlates of positive symptoms: Delusions and hallucinations. In C. Pantelis, H. E. Nelson, & T. R. E. Barnes (Eds.), Schizophrenia: A neuropsychological perspective (pp. 205–235). London: Wiley. Nicholson, I. R., & Neufeld, R. W. J. (1992). A dynamic vulnerability perspective on stress and schizophrenia. American Journal of Orthopsychiatry, 62, 117–130. Nicholson, I. R., & Neufeld, R. W. J. (1993). Classification of the schizophrenias according to symptomatology: A two-factor model. Journal of Abnormal Psychology, 102, 259–270. Nosofsky, R. M. (1992). Similarity scaling and cognitive process models. Annual Review of Psychology, 43, 25–33. Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart & Winston. Paivio, A. (1975). Perceptual comparisons through the mind’s eye. Memory and Cognition, 3, 635–647. Paivio, A. (1986). Mental representations: A dual coding approach. New York: Oxford University Press. Parzen, E. (1962). Stochastic processes. San Francisco: Holden-Day. Patil, G. G., & Joshi, S. W. (1968). A dictionary and bibliography of discrete distributions. New York: Hafner. Piasecki, T. M., Jorenby, D. E., Smith, S. S., Fiore, M. C., & Baker, T. B. (2003). Smoking withdrawal dynamics: 1. Abstinence distress in lapsers and abstainers. Journal of Abnormal Psychology, 112, 3–13. Polkinghorne, J. (2003). The friendship of science and religion (Plenary Lecture: Veritas Forum). London: University of Western Ontario. Rappaport, A. (1983). Mathematical models in the social and behavioral sciences. New York: Wiley. Reiman, E. M., Lane, R. D., Van Petten, C., & Bandettini, P. A. (2000). Positron emission tomography and functional magnetic resonance imaging. In J. T. Cacioppo, L. G. Tassinary, & G. G. Bernston (Eds.), Handbook of psychophysiology (2nd ed., pp. 85–118). New York: Cambridge University Press. Riefer, D. M., & Batchelder, W. H. (1988). Multinomial modeling and the measurement of cognitive processes. Psychological Review, 95, 318–339. Riefer, D. M., Knapp, B., Batchelder, W. H., Bamber, D., & Manifold, V. (2002). Psychological Assessment, 14, 184–201. Roe, R. M., Busemeyer, J. R., & Townsend, J. T. (2001). Multialternative decision field theory: A dynamic connectionist model of decision making. Psychological Review, 108, 370–392. Ross, S. M. (1996). Stochastic processes (2nd ed.). New York: Wiley. Rumelhart, D., McClelland, J., & pdp Research Group. (1987). Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 2). Cambridge ma: mit Press. Ruscio, J., & Ruscio, A. M. (2004). A conceptual and methodological checklist for conducting a taxometric investigation. Behavior Therapy, 35, 403–447. Santor, D. A., & Ramsay, J. O. (1998). Progress in the technology of measure-
82 modeling complex systems ment: Applications of item response models. Psychological Assessment, 10, 345–359. Schiffman, S. S., Reynolds, M. L., & Young, F. W. (1981). Introduction to multidimensional scaling: Theory, methods and applications. New York: Academic. Smith, P. L. (1995). Psychophysically principled models of visual simple reaction time. Psychological Review, 102, 567–593. Smolin, L. (2006). The trouble with physics: The rise of string theory, the fall of a science, and what comes next. Boston: Houghton Mifflin. Staddon, J. E. R. (1984). Social learning theory and the dynamics of interaction. Psychological Review, 91, 502–507. Staddon, J. E. R. (1991). “The distemper of learning . . .”: A review of S. B. Klein and R. R. Mowrer (Eds.) Contemporary learning theories: Instrumental conditioning theory and the impact of biological constraints on learning. Contemporary Psychology, 36, 506–507. Steiger, J. H., & Fouladi, R. T. (1997). Noncentrality interval estimation and the evaluation of statistical models. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 221–257). Mahwah nj: Erlbaum. Sternberg, S. (1975). Memory scanning: New findings and current controversies. Quarterly Journal of Experimental Psychology, 27, 1–32. Strauss, M. E. (2001). Methodology for identifying specific psychological deficits: Introduction to the special section. Journal of Abnormal Psychology, 110, 4–5. Takane, Y., & Sergent, J. (1983). Multidimensional scaling models for reaction times and same-different judgments. Psychometrika, 48, 393–423. Tollenaar, N., & Mooijaart, A. (2003). Type I errors and power of the parametric bootstrap goodness-of-fit test: Full and limited information. British Journal of Mathematical and Statistical Psychology, 56, 271–288. Tomarken, A. J., & Baker, A. J. (2003). Introduction to the special section on structural equation modeling. Journal of Abnormal Psychology, 112, 523– 525. Townsend, J. T. (1984). Uncovering mental processes with factorial experiments. Journal of Mathematical Psychology, 28, 363–400. Townsend, J. T. (1990). Serial vs. parallel processing: Sometimes they look like Tweedledum and Tweedledee but they can (and should) be distinguished. Psychological Science, 1, 46–54. Townsend, J. T. (1994). A visual approach to nonlinear dynamics: Just cartoons or a serious pedagogical device? [Review of A visual introduction to dynamical systems theory for psychology, by Frederick David Abraham]. American Journal of Psychology, 107, 117–123. Townsend, J. T., & Ashby, F. G. (1978). Methods of modeling capacity in simple processing systems. In J. Castellan & F. Restle (Eds.), Cognitive theory (Vol. 3, 200–239). Hillsdale nj: Erlbaum. Townsend, J. T., & Ashby, F. G. (1983). Stochastic modelling of elementary psychological processes. Cambridge: Cambridge University Press. Townsend, J. T., & Fific, M. (2004). Parallel versus serial processing and indi-
83 Formal Clinical Cognitive Science vidual differences in high-speed search in human memory. Perception and Psychophysics, 66(6), 953–962. Townsend, J. T., Fific, M., & Neufeld, R. W. J. (in press). Assessment of mental architecture in clinical/cognitive research. In T. A. Treat, A. Kraut, & T. Baker (Eds.), Psychological Clinical Science: Recent Advances in Theory and Practice. Hillsdale nj: Erlbaum. Townsend, J. T., & Nozawa, G. (1995). Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories. Journal of Mathematical Psychology, 39, 321–359. Townsend, J. T., & Wenger, M. J. (2004a). The serial-parallel dilemma: A case study in a linkage of theory and method. Psychonomic Bulletin and Review, 11(3), 391–418. Townsend, J. T., & Wenger, M. J. (2004b). A theory of interactive parallel processing: New capacity measures and predictions for a response time inequality series. Psychological Review, 111, 1003–1035. Tversky, A. (1972a). Choice by elimination. Journal of Mathematical Psychology, 9, 341–367. Tversky, A. (1972b). Elimination by aspects: A theory of choice. Psychological Review, 79, 289–299. Van Zandt, T. (2000). How to fit a response time distribution. Psychonomic Bulletin and Review, 7, 424–465. Vollick, D. N. (1994). Stochastic models of encoding-latency means and variances in paranoid schizophrenia. Unpublished doctoral dissertation, University of Western Ontario, Faculty of Graduate Studies. Vollick, D. N., & Neufeld, R. W. J. (2004). Stochastic modelling of encodinglatency means and variances in paranoid schizophrenia. Manuscript in preparation. Wagenmakers, E., & Waldorp, L. (Eds.). (2006). Special issue on model selection: Theoretical developments and applications. Journal of Mathematical Psychology, 50(2). Waller, N. G., & Meehl, P. E. (1998). Multivariate taxometric procedures: Distinguishing types from continua. Newbury Park ca: Sage. Weinstein, N. D. (1974). Effect of noise on intellectual performance. Journal of Applied Psychology, 59, 548–554. Wenger, M. J., & Townsend, J. T. (2000). Basic response time tools for studying general processing capacity in attention, perception, and cognition. Journal of General Psychology, 127, 67–99. Wiggins, J. S. (1973). Personality and prediction: Principles of personality assessment. Reading ma: Addison-Wesley. Wright, B. D. (1977). Solving measurement problems with the Rasch model. Journal of Educational Measurement, 14, 97–116.
A Dynamics-Oriented Approach to Psychopathology Wolfgang Tschacher and Zeno Kupper University of Bern
Theoretical Framework: Optimality in Self-Organizing Systems Psychopathology addresses disorders of the psyche. Researchers in this field explore maladaptive cognition, emotion, and action, thereby starting from a number of different perspectives; such perspectives are usually given by the scientific disciplines from which such exploration was initiated: • Psychology focuses on cognitive and behavioral models of psychopathology. • Biology focuses on genetics and on neuronal processes associated with psychological dysfunction. • Pharmacology studies chemical compounds that act on the neuronal substrate. • Sociology identifies social and societal factors that are associated with the disorders in individuals. Thus, psychopathology is a genuinely interdisciplinary field, and practitioners in this field (traditionally, psychiatrists) commonly apply a range of quite different instruments and interventions when they, for instance, combine psychotherapy with neuroleptic medication in a milieu-oriented ward of a psychiatric hospital.
86 modeling complex systems The perspective for psychopathology that we wish to put forward in this chapter is in itself interdisciplinary—of its two ingredients, one is dynamic systems theory, the other cognitive science. In this introductory section, we will outline our theoretical guidelines and suggest how the two main ingredients of our approach—cognitive science and dynamic systems theory—may be combined. We will argue that cognitive acts can be viewed as coherent patterns emerging spontaneously in a complex cognitive system. Pattern formation via self-organization is the cornerstone of this approach to psychopathology. Motivational processes are, consequently, defined as those forces or gradients that “drive” the complex cognitive system. It is with respect to such motivational gradients that cognition is more or less “optimal.” Cognitive science is a field to which neuroscientists, psychologists and psychiatrists, philosophers of mind, workers in artificial intelligence (ai), and many others contribute. This field has gained momentum in the last decades especially because of advances in brain research (e.g., the use of brain-imaging techniques and the profound implications of those techniques for psychiatry) and because of the perennial questions of consciousness that have been receiving increased attention recently (Carter, 2002). Cognitive science is, thus, a natural foundation from which psychopathological states of cognitive functioning may be regarded. Among the current approaches in cognitive science, the distinction between the computationalist perspective and the dynamic approach has been debated intensely. The computationalist perspective in cognitive science elaborates on the theory of information processing and continues the tradition of “classic ai,” which is based on the physical-symbol-systems premise (Newell & Simon, 1972). According to this premise, the mind is regarded as a physically implemented symbol system. Consequently, mental processes are identical to symbol processing, which can, in principle, be simulated using digital computers. The major part of today’s cognitive psychology, as well as the cognitive-behavioral therapies currently in use in psychiatry and clinical psychology, is derived from computationalist theory. The dynamic approach to cognitive science (e.g., Clark, 1997; Pfeifer & Scheier, 1999; Tschacher & Dauwalder, 1999, 2003) has challenged this idea of cognition as computation. Bridging assumptions of dynamic systems approaches to cog-
87 Approach to Psychopathology nition have been identified: “offline” reasoning is continuous with “online” motor-control strategies in the sense that abstract cognition may be decoupled from behavior in an actual environment but still work with the same principles (Mechsner, Kerzel, Knoblich, & Prinz, 2001). There is agreement in the dynamics community that cognitive patterns are not provided by programs, as in the computationalist perspective, but are emergent properties of the complex brain/mind system. Thus, the colloquial distinction between software and hardware makes sense only with respect to computers, not with respect to naturally occurring cognition. By these assumptions cognitive science and dynamic systems theory have joined forces to formulate a non-Cartesian theory of cognition. Emergent properties are modeled in the mathematical framework of self-organization theory (Haken, 1983, 1996; Kelso, 1995; Nicolis & Prigogine, 1977), the core part of the theory of complex systems. Self-organization theory (synergetics) deals with systems composed of several or many components. By means of their interaction, these components can produce new qualitative features on macroscopic scales; such features are often directly observable as patterns. In other words, the emergence of new qualities is studied. The main question is whether there are general principles that govern the behavior of complex systems when qualitative changes occur. These situations are probably of particular interest. And it has, in fact, been shown that a large number of systems are accessible to unifying mathematical and conceptual approaches. Synergetics starts from the observation that the behavior of many systems is strongly determined by environmental conditions. These conditions may be divided into constant conditions or constraints (e.g., those constants of a physical environment that confine behavioral systems) and further environmental conditions that “energize” or “drive” the systems (e.g., free energy in physical systems, task affordances in psychological systems). In the mathematical approach these latter environmental conditions are taken care of by control parameters. In many cases control parameters have the form of externally applied gradients. The general strategy of synergetics is as follows: It sets out from a state of a system that is already known under a certain control-parameter value. When one or several control parameters are changed, the system may become unstable. Then it may tend to leave its state and develop a new structure or behavior.
88 modeling complex systems
Figure 1. Bistable Gestalt array (Rubin, 1921). Either two (black) faces or a (white) vase is recognized (for details, see the text).
Synergetics shows that the behavior of the system close to instability points is described and determined by order parameters. According to synergetics, the—in general few—order parameters determine the behavior of the many individual components. This implies an enormous information compression because it suffices to describe the order parameters instead of all the components. On the other hand, the individual components react on the order parameters and, in this way, even generate the order parameters. Thus, the relation between order parameters and components is based on circular causality. Quite often order parameters show very simple behavior, for instance, bi or multistability; that is, a system can acquire different states under the same external conditions. An example of visual perception is shown in Figure 1, Rubin’s (1921) well-known vase-face Gestalt, a bistable Gestalt array. In this figure two order parameters compete with each other: perception of the pattern face(s) or perception of the pattern vase. Both order parameters organize the components (the black-and-white details of the display) in a specific fashion. Perception of these patterns is mutually exclusive—it is impossible to perceive both at the same time. What are viewed as noses in the domain of one pattern become merely background as soon as a vase is perceived. Under neutral circumstances, transitions between the patterns occur frequently; such Gestalt flips are analogous to phase transitions in dynamic systems theory. Moreover, control parameters such as task affordances can
89 Approach to Psychopathology
1 "chaos" 2 "order"
"chaos"
3
"chaos"
"order"
4 "order"
Figure 2. Sequence of Gestalt-like written words (left column, cells 1–4) that give rise to the perception of either chaos or order. Right column, depiction of respective potential landscape (for details, see the text). After Tschacher (1997).
modulate the emergence of perceived patterns. If, for example, Figure 1 is presented in a series of similar displays together with the instruction to determine the gender of faces in the pictures, the vase pattern is hardly ever perceived. A further essential property of pattern formation via self-organization can be illustrated with the help of Figure 2. Words of a somewhat ambiguous quality are presented (see the left column of Figure 2); in cell 1 the word chaos is quite reliably identified. Here again, the percept chaos emerges as the order parameter, the qualitative pattern recognized instantaneously in the stimulus of cell 1. The stability of the percept chaos resulting from this stimulus is represented by the potential sink depicted in Figure 2 (see the right column next to cell 1). The state of the system, symbolized by the black circle, rests in the minimum of a potential landscape (the “attractor” of the system). The stimulus is, then, altered gradually in the sequence of cells 2, 3, and 4. Most viewers, however, still read chaos in cell 2 and cell 3 (the system remains in the respective attractor of the potential land-
90 modeling complex systems scape), a phase transition occurring only in cell 4. Here, the attracting capacity of the Gestalt chaos has given way to the Gestalt order, a phase transition has taken place, and the state of the system has been qualitatively changed. In this way the stability of emergent patterns can be explored: a Gestalt may, and often does, remain unchanged in spite of alterations of the actual stimulus. Self-organized patterns have attractor-like dynamic properties. Interestingly, when the stimulus sequence is reversed in experiments with several subjects, it is found that the timing of the phase transition may depend on sequence. When the state of the system is started from order (see cell 4; the circle dwells in the potential minimum on the right-hand side) and passes through cells 3 and 2, the phase transition occurs in cell 1 instead of cell 4. This phenomenon of delayed phase transitions depending on past sequences is called hysteresis. Hysteresis is usually viewed as a hallmark of nonlinearity in system dynamics. In the present context, hysteresis is an additional fingerprint of attractors governing the perceptual system. In summary, we have shown that Gestalt perception may be analogous to pattern-formation processes described in the framework of dynamic systems theory. We claim that these are pivotal processes found throughout cognition and action. As we cannot go into more detail here, it must suffice to point to some active fields of research where pattern formation is at the center of investigations. In the movement sciences, for instance, cognitive coordination and movement coordination are modeled along such lines (Kelso, 2003). In neuroscience, synchrony in transient aggregates of neurons in the cortex is seen as the hallmark of the self-organization of cell assemblies (Miltner, Braun, Arnold, Witte, & Taub, 1999; Singer & Gray, 1995; Varela, 1995). In clinical psychology and psychiatry, therapeutic strategies have been developed on the background of dynamic systems concepts, for example, in psychotherapy research (Grawe, 2004; Mahoney, 1991) and in theoretical psychiatry (Ciompi, 1997). Patterns of the mind emerge from the complex mind/brain system via self-organization processes—this general premise puts great emphasis on the connectivity among the components as well as on the driving of systems by environmental-control parameters. We will briefly explore both topics in the rest of this section.
91 Approach to Psychopathology
connectivity There are two general strategies employed to investigate neurocognitive systems with respect to their interaction and self-organization, top-down and bottom-up. The top-down strategy begins with observable (“macroscopic”) phenomena, such as the perception of Gestalts and the fingerprints of phase transitions introduced above. The bottom-up approach first identifies components of a system and then bases the pattern emerging from the system on a description of the components. In focusing on the connectivity of systems components, we would adopt a bottom-up approach. We have argued that the synergy (i.e., the working together) of many components leads to the emergence of macroscopic patterns. The comparable term coined by the Gestalt-psychological tradition is nonsummativity. The Gestaltist holistic position claimed that aggregates are not identical with the sum of their components (e.g., Köhler, 1920). With this core tenet of Gestalt theory, psychology departed from associationist psychology—whereas associationism stated that properties of aggregates can be derived from the properties of their components, Gestalt psychology insisted on aggregates possessing qualities that are absent at the level of components. Therefore, the historical roots of contemporary emergentism and of complexity theory lie in Gestalt theory. The crucial point about the bottom-up approach is that we must clarify the nature of the components. What, however, are the components of (neuro)cognition? Defining an elementary cognitive act is notoriously a nontrivial task in phenomenological psychology, by which one can easily be lead into the shallow waters of introspectionism. Attempts to define the components of behavior in a cognitivebehavioral fashion, for example, as conditioned stimulus-response associations, have remained rather hypothetical. In a biopsychological framework, however, the task appears much easier—the activity of a single neuronal cell in the brain is a good candidate for a component because it is well defined and, at least in principle, observable. Ensembles of neurons are formed in concordance with Hebb’s law: “Cells that fire together wire together.” The research program of connectionism is, thus, based on the connectivity of single cells. Connectionist models are good examples of emergent complex systems (e.g., Haken, 1987).
92 modeling complex systems Several issues in psychopathology have recently been approached with a focus on connectivity. Schizophrenia, for instance, can be seen as a misconnection disorder characterized by altered interactions among brain regions. The cognitive-dysmetria hypothesis (Andreasen, Paradiso, & O’Leary, 1998) predicts that the circuitry between areas of the (especially frontal) cortex, the thalamus, and the cerebellum is unbalanced in schizophrenia spectrum disorder. A related approach views the ion channels of glutamatergic synapses as responsible for the “loosening of associations” that Bleuler (1911) identified as the core symptom of spectrum disorders. Here, the emphasis is again on changed neuronal connectivity, which may result in a host of cognitive impairments, for example, Gestalt perception changes (Phillips & Silverstein, 2003) and decreased “binding” capabilities (Garcia-Toro, Blanco, Gonzalez, & Salva, 2001).
control parameters In this section, we introduced the synergetic theory of pattern formation. In addition to the connectivity of many components in a complex system, we pointed out that the driving of the system by control parameters constitutes a necessary condition for self-organization to occur. Such energetic driving of cognitive systems is traditionally termed motivation. In the previous two perception examples (Figures 1 and 2 above), task affordances and attention/vigilance determined what was being perceived. In the absence of motivation, or in situations with competitive motivational parameters, some order parameters may never be generated, even if they appear obvious to unbiased observers. This has been demonstrated, for example, in experiments on inattentional blindness (Simons & Chabris, 1999) where observers were found to be functionally and consciously blind to certain items in a visual scene when their attention was focused on an alternative task, even if this task was performed using the same visual stimulus material. Most psychopathological states, in addition to the obvious affective disorders, are associated with specific motivational and affective deficits or excesses. The prototypical courses of schizophrenia, for example, often have fluctuating levels of negative symptoms, such
93 Approach to Psychopathology as flat affect and emotional withdrawal (see the next section). Thus, it is to be expected that the motivational driving of the cognitive system in such patients may undergo marked changes during the course of the illness. We conclude the theoretical introduction to this chapter by mentioning the interaction of (cognitive) pattern formation and (motivational) control parameters. So far we have concentrated on the “control side” of the system-environment coupling, that is, how control parameters affect the generation of patterns. Yet this reflects only one side of the coin of interaction: it is self-evident that the patterns, in turn, exert an influence back on the control parameters. As we have claimed above and discussed elsewhere (Tschacher & Haken, in press), motivation interacts with cognition in a manner analogous to the driving of complex systems by gradients of free energy (also called exergy in ecology; Schneider & Kay, 1994). In such systems, emergent patterns are consistently found to present the most efficient ways to reduce the gradients that caused their emergence in the first place. We argued that, when applied to cognitive systems, this principle of efficiency or “optimality” in reducing environmental gradients was a key to understanding intentionality in cognition. In this theoretical section we have sketched a formal systems model for psychopathology. We think that this may turn out to be an encompassing “big picture,” from a natural science perspective, of how cognition works. Admittedly, however, this big picture must be filled out with empirical findings and scrutinized for its predictive value. In the remainder of this chapter, we will examine the evidence that has been accumulated and put forward ideas about how one might proceed in this line of research on psychopathology.
Empirical Research in Psychopathology: From Description to Testing Dynamic Hypotheses Understanding phenomena by observing change is a common and often successful path to scientific insight. In the following, explorative studies of the dynamics of psychopathology are presented. These studies used various approaches to the dynamics of psychopathology. The study questions and corresponding methodological
94 modeling complex systems approaches can be summarized under three levels of analysis. On a first level of analysis, the study questions relate to “how things change in time.” The results on this level are descriptions of longitudinal developments, called trajectories in the language of dynamic systems theory. This type of analysis is mainly descriptive. A second level of analysis investigates “how things interact in time.” In other words, the interrelation of the systems’ variables is analyzed. Systematic interrelations result in stable patterns of a system, that is, attractors. Finally, a third level of analysis is related to the emergence of patterns—nonlinearity, degrees of order, and pattern formation. It is important to note that these different levels of analysis are complementary rather than mutually exclusive. Both descriptive and more refined analytic approaches are necessary to illuminate self-organizing systems.
level of analysis 1 : trajectories and attractors What is commonly termed psychopathological impairment is in most, if not all, instances more than a trait of a person. Constant changes in symptoms have, instead, been described as a hallmark of mental disorders (Wittchen, Lieb, Pfister, & Schuster, 2000). On a descriptive level, the resulting longitudinal patterns have for a long time been important categories. As an example, “insidious” versus “acute” onset of disorders has been related to different prognoses of schizophrenic disorders (Wiersma, Nienhuis, Slooff, & Giel, 1998). By definition, “chronic” forms of mental disorders show considerable temporal stability of psychopathological impairments. Nevertheless, even in chronic mental disorders, several typical temporal patterns of psychopathology can be distinguished (Kupper, 1999). Systems theory provides mathematical models for the evolution of mental disorders (Globus & Arpaia, 1994; Kupper, 1999; Tschacher, 1997). From this perspective, temporal evolutions are termed trajectories. Except for the case of purely stochastic dynamics, trajectories can be traced back to underlying attractors that describe the influence of forces that act on the evolution of the process variables (Figure 3). Examples of prototypical dynamics are trajectories that tend to a stable constant state. The corresponding attractors are
95 Approach to Psychopathology Prototypical
Dynamics and
Attractors
Dynamics Convergent
Time
Cyclic
Time
Chaotic
Time
Attractors Point
0-dimensional
Limit Cycle
1-dimensional
Chaotic
>2-dimensional
Figure 3. Prototypical dynamics and attractors.
called points attractors. Another prototypical dynamics is characterized by oscillations: limit cycle attractors. Finally, unpredictable yet nonrandom fluctuations are produced by certain nonlinear dynamics that have been discovered only recently (Rössler, 1976). In such a way psychopathological systems may be classified as exemplars from a “zoo” of prototypical attractors arising from various linear and nonlinear dynamics. Psychopathology in acute schizophrenia, for example, is often characterized by dramatic and repeated changes in symptoms. To date, however, research on the dimensions of psychopathology in schizophrenia has been mainly cross-sectional in nature (Peralta & Cuesta, 2001). Correspondingly, whereas the cross-sectional structure of schizophrenic symptoms has been studied extensively, little is known about the development of symptoms during acute episodes. In a study of symptom trajectories, 46 schizophrenia spectrum patients (18 females; mean age 24.7 years) were examined daily during an average treatment period of 104 days (Kupper & Tschacher, 2002). A novel time-series approach was used to identify initial phases of response and other descriptive features of the trajectories. Figure 4 shows the symptom processes of four exemplary pa-
96 modeling complex systems
Figure 4. Symptom trajectories of psychotic episodes.
tients. Each process consisted of three trajectories, termed psychoticity, excitement, and withdrawal, depicting the positive symptoms, anxiety and tension, and negative symptoms together with depression observed in patients. The time-series method used in this study allowed the identification of “dynamic factors,” consisting of trends, levels, and durations of these trajectories that were assessed in two periods of treatment, the initial improvement phase and the ensuing stabilization phase. These factors summarized the temporal structure of symptom evolution throughout the psychotic episodes. Five such dynamic factors were found: (1) overall level of positive symptoms, (2) duration of nonspecific response, (3) slope of response in all symptom domains, (4) enduring negative symptoms, and (5) duration of response regarding psychoticity. Compared to patients with an acute schizophrenia-like psychotic disorder, schizophrenia and schizoaffective disorder patients ranked higher on factor 4 (enduring negative symptoms). They tended toward a lower level of positive symptoms and showed a less prominent response to treatment. The examination of a subsample of 19 patients with relapse indicated a
97 Approach to Psychopathology prolonged duration of initial treatment response regarding psychoticity. These results supported the validity of this approach for the description of symptom trajectories. In this study the symptom change throughout psychotic episodes showed distinct temporal features. Compared to a merely cross-sectional view, this approach provided a dynamic analysis of the dimensions of schizophrenic psychopathology. Therefore, it was possible to separate the stable and the variable components of psychopathology in the patients. The trajectories of psychopathology found suggested that, whereas levels of symptoms are, in fact, often independent cross-sectionally, their change within a given patient was often strongly interrelated. Moreover, these results suggested that the different aspects of psychopathology might be related to some single, common process. In schizophrenia meaningful temporal patterns in psychopathology are not restricted to acute phases of the disorder. In a study of rehabilitation (Kupper & Hoffmann, 2000), courses of psychosocial functioning during intensive vocational rehabilitation of schizophrenia patients were examined. Although considerable research has been undertaken on psychosocial treatment and rehabilitation of patients with chronic schizophrenia, few studies have examined individual courses by means of repeated and frequent observations. A more dynamic view of rehabilitation was thought to disclose patterns of response useful for both understanding and treating symptoms and disabilities associated with chronic schizophrenia. In this exploratory study time series of 35 schizophrenia outpatients participating in a vocational rehabilitation program were examined by a novel quantitative approach by which dynamic patterns were identified. Time-series regression was applied on weekly behavioral ratings of psychosocial functioning, provided by the nurses’ observation scale (nosie). The mean, trend, and variability of each trajectory were calculated. Cluster analysis revealed five groups of trajectories: (1) stable at a high level, (2) fluctuating at a middle level, (3) middlelevel functioning, tending toward a slight descent, (4) steep descent of functioning, and (5) unstable at a low level of functioning. Examples from groups 1 and 4 are shown in Figure 5. The five groups of patients with different trajectories varied at intake with respect to psychopathology, cognitive dysfunction, and measures of self-concept, locus of control, and coping. At program termination pronounced differences were found among the groups
98 modeling complex systems
Figure 5. Psychosocial functioning in two vocational rehabilitation courses of schizophrenia patients.
in vocational reintegration. The different trajectories can, thus, be understood as typical pathways linking patient characteristics to rehabilitation outcome. This study exemplified that a broader use of dynamic designs can substantially clarify the variety of reactions of patients to psychosocial interventions. From a systems-theory point of view, these trajectories arose from patients’ characteristics interacting with environmental constraints that were induced by the introduction of intensive rehabilitation with increased levels of stress. The task affordances related to the rehabilitation environment acted as gradients (i.e., environmental-control parameters), leading to a potential destabilization of the system. This resulted in a transfer either to a higher level of functioning or to a deterioration in functioning. Similar patterns are known from other forms of psychological intervention. As an example, it is observed that psychotherapy can initially amplify the differences among clients. It should be noted that, generally, these few examples showed that the descriptive level of “how things change” in time provides information that is complementary to traditional research approaches. Cross-sectional analysis cannot explain this rich source of variation. On the grounds of dynamic systems theory, we may suppose that the diverse courses described here have resulted from attractors, the driving forces of longitudinal evolutions of psychopathology. The time-series methods used in the studies discussed above allowed the description and clustering of such evolutions but gave no indications as to the attractors and patterns underlying them. For this type of exploration additional methods must be applied, methods that
99 Approach to Psychopathology provide a closer look at the mechanisms of change leading to observable dynamics.
level of analysis 2 : the interrelation of system variables On this level the temporal interrelations of components of a system are analyzed. The interrelations among different components are expected to reveal information about underlying mechanisms that themselves are not directly observable, neither in cross section nor in longitudinal monitoring. Thus, the goal of these analyses was to model mechanisms that are supposed to fuel the courses described in the previous section. This notion can be tested empirically on symptom courses by utilizing methods of dynamic systems research, such as time-series analysis. In a study of psychotic episodes (Tschacher & Kupper, 2002), the symptom courses of 84 schizophrenia spectrum patients (mean age: 24.4 years; mean previous admissions: 1.3; 64% males) of a community-based acute ward were examined to identify dynamic patterns of symptoms and to investigate the relations between these patterns and treatment outcome. The symptoms were monitored by regular daily staff ratings using a scale composed of three factors: psychoticity, excitement, and withdrawal. Examples of such data are shown in Figure 4 above. Patients showed moderate to high symptomatic improvement documented by effect-size measures ranging from .65 to .92. Each of the 84 symptom trajectories was analyzed by time-series methods using the vector autoregression (var) approach (Lütkepohl, 1993). var models the day-to-day interrelations between symptom factors on the basis of the data of a single course (for an example, see Figure 6). In Figure 6 the arrow starting from withdrawal at day t 1, pointing toward excitement at day t, expresses a positive association between these two variables with a weight of .44 (the T-value of 2.94 is significant at the 1% level). This var parameter may be labeled withdrawal → excitement. In other words, in this patient high withdrawal one day entailed increased excitement on the following day. The horizontal arrow in Figure 6 (withdrawal → withdrawal) indicates positive autocorrelation of withdrawal; that is, increased withdrawal on any one day predicts increased withdrawal the following day.
100 modeling complex systems
Figure 6. Individual time-series model of a patient (see the text). * p < .05; ** p < .01.
Multiple and stepwise regression analyses were then performed on the basis of the parameters of var models of all 84 patients. Two var parameters were found to be associated significantly with favorable outcome in this sample: withdrawal → reduction of psychoticity as well as excitement → increase of withdrawal. These findings were interpreted as indicating how patients cope with psychotic episodes. It may be assumed that this illuminated mechanisms that drove the symptom evolutions in this sample. These findings must, however, be regarded as preliminary assumptions, as hypotheses about the underlying attractors of the symptom dynamics. As a further step in a consecutive unpublished study, we combined this analysis of schizophrenia courses with a comprehensive assessment of neuropsychological functioning and psychopathology (Spaulding et al., 1999). In the Schizophrenia Process Study, symptom courses of 114 schizophrenia spectrum patients were observed using daily ratings of psychopathology (mean duration of observation: 88 days). A 10-item scale for daily symptom assessment was applied (Today’s Evaluation of Psychopathology, or tep). The rating scale was composed of three factors: positive symptoms, negative symptoms, and anxiety-depression. The courses were analyzed by time-series methods using var to model the day-to-day interrelations between symptom factors. Comprehensive neuropsychologi-
101 Approach to Psychopathology cal assessments were performed at the beginning and at the end of the observed courses. Associations between the day-to-day patterns of symptoms, neurocognition, and outcome were calculated. Preliminary results (Kupper, Tschacher, & Hoffmann, 2004) revealed specific relations between longitudinal symptom patterns and both outcome and neurocognition. The interrelations between positive and negative symptoms were associated with outcome. If positive symptoms entailed negative symptoms, outcome tended to be unfavorable. In cross-sectional studies different symptom domains as well as symptoms and neurocognition are often found to be independent. The results of this study, again, suggested that the various symptom domains as well as symptoms and neurocognition are, in fact, associated if longitudinal patterns of symptoms in individual patients are examined. In a study of crisis intervention (Tschacher & Jacobshagen, 2002), the remediation processes after psychosocial crises were modeled. We included patients with diagnoses such as adjustment disorder and an affective disorder who were often hospitalized with a status of suicidal behavior or ideation. The focus of this study was on “cognitive orientation” (“outward” events centered vs. “inward” centered). A sample of 38 inpatients who were assigned to treatment in a crisis-intervention unit was monitored in order to study the interrelations of process variables. The process data consisted of patients’ self-ratings of the variables mood, tension, and cognitive orientation, which were assessed three times a day throughout hospitalization (on average, over 22.6 days). Again, var models of the process data were computed to describe the prototypical dynamic patterns of the sample and explore process-outcome associations. Outcome of crisis-intervention treatment was evaluated by pre/postquestionnaires. On a first level of analysis, the expected linear trends were found pointing to an improvement of mood, a reduction of tension, and an increase of outward cognitive orientation. Time-series modeling (level of analysis 2) showed that, on average, outward cognitive orientation entailed improved mood (see Figure 7). The time-series models predicted the treatment effect, notably the outcome domain reduction of social anxiety, yet were unrelated to the domain of symptom reduction. From the results it was concluded that crisis intervention should focus on having patients increasingly engage in outward cognitive orientation, that is, reduce the levels
102 modeling complex systems
Whole Sample (N=38) t-1 MOOD
t .74**
.34*
TENSION .97**
COGNITIVE ORIENTATION
.90***
Figure 7. Interrelations among system variables in crisis intervention. * p < .05; ** p < .01; *** p < .001.
of self-focused attention. This therapeutic approach should support stabilizing mood, reducing anxiety, and activating the resources of patients. Similarly, “driving forces” of change were extracted from psychotherapy courses (Tschacher, Baur, & Grawe, 2000). A sample of 91 courses of dyadic psychotherapy using different treatment modalities was analyzed in order to study session-by-session dynamics. The presented problems generally belonged to the spectrum of neurotic disorders, the largest diagnostic groups being adjustment disorders, anxiety and phobic disorders, eating disorders, and relationship problems. The process data consisted of therapists’ and patients’ session reports. Therapy outcome was evaluated by pre/ postquestionnaires and direct measures of change. After data reduction by principal-component analysis, linear time-series models of the resulting factors were computed to describe the prototypical dynamic patterns of the sample and of the modality subsamples (cognitive-behavioral, client-centered, schema-theoretical cognitive psychotherapy). It was found that the factor patient’s sense of selfefficacy/morale governed the observed dynamics of the sample, whereas the therapeutic-bond factors did have less of an effect on the dynamics (Figure 8). The dynamic patterns of client-centered therapies differed from other modalities. The dynamics-outcome findings showed that direct measures of change were associated with a spe-
103 Approach to Psychopathology
Figure 8. Interrelations among process factors in psychotherapy. * p < .05; ** p < .01.
cific process pattern in which the patient’s sense of self-efficacy was, in turn, supported by other process factors. This time-series approach was also utilized to uncover psychopathological changes and side effects related to different substances employed in psychopharmacology. Clinical observations and recent findings suggested different acceptance of morphine and heroin by intravenous drug users in opiate-maintenance programs. Such programs are conducted nationwide in Switzerland. In a psychopharmacological study (Tschacher, Haemmig, & Jacobshagen, 2003), we postulated that this different acceptance may be caused by differences in the perceived effects of these drugs, especially how desired and adverse effects of both drugs interacted. Thus, we assumed different mechanisms of pharmacological action underlying the manifest effects. We measured the desired and adverse effects of high doses of injected morphine and heroin in patients included in the program. The interrelations between both types of effects were determined to test the hypothesis of a differential mechanism of action. Thirty-three patients (5 females, 28 males; mean duration of previous street heroin use 10.7 years, mean age 30.1 years) were randomly allocated double-blind to the substance groups. The average daily dose per participant in the heroin condition (n = 17) was 491 mg, in the morphine condition (n = 16) 597 mg. The observation period lasted 3 weeks; an average of 70 injec-
104 modeling complex systems tions was received. After each injection of either substance, various aspects of drug effects were recorded systematically. Ratings were summarized into the factors euphoria and adverse effects. Time-series models were computed for each participant on the basis of the factor scores, using the var format described above. A highly significant difference between the substances was found in the interrelation between euphoria and adverse effects. Adverse effects of heroin preceded higher euphoria, whereas adverse effects of morphine preceded subsequent lower euphoria. Additionally, the finding of a generally higher level of adverse effects in morphine was replicated. These results pointed to different mechanisms of action of the two opioids when the perceived drug effects are evaluated in a field setting. This may explain the better acceptance of heroin in opiate-assisted treatment of intravenous drug patients. In addition to the results concerning the studied sample, we proposed the method as a promising pharmacological tool for the comparison of substance groups other than opioids. In general, this second level of analysis allowed for the identification of interrelations among process variables of many different origins and in various time frames. The monitoring units may be fixed (e.g., daily ratings), natural (e.g., at each injection of a substance), or a combination of both (e.g., at each psychotherapy session). The interrelations of systems variables can be studied under naturalistic conditions, giving this approach high heuristic value and ecological validity. We view such interrelations as core attributes of dynamic systems that give rise to the patterns and attractors described above. Some premises for the application of level of analysis 2 methods must be regarded, notably, that the approach assumes stationarity of the processes. For this reason we used several techniques in the aforementioned empirical studies to ensure stationarity, for example, detrending of courses prior to modeling. On a next level of analysis, transitions in order and pattern formation were analyzed. As described in the introductory section of this chapter, such transformations of systems leading to the formation of new patterns are a striking feature of self-organizing systems. The next section therefore presents studies of nonlinearity and pattern formation in psychopathology.
105 Approach to Psychopathology
level of analysis 3 : nonlinearity and pattern formation In this section we will address some of the more specific predictions of the dynamic systems perspective proposed in the first section. If the notion of pattern formation by self-organizing dynamics is true, and if phase transitions between stable patterns occur, the following fingerprint phenomena should be expected. First, as soon as self-organization structures a complex system, an increase of order (to be defined below) should be observable. Second, one may determine whether systems evolve in a nonlinear manner by detecting signs of chaotic dynamics and, more generally, nonlinearity. Third, one may explore the stability attributes of self-organized patterns and how they are linked with psychopathological symptoms. Order and Disorder in Complex Systems We studied the hypothesis of pattern formation in a variety of data sets in clinical psychology as well as in acute and rehabilitative psychiatry. A systematic study was performed in the field of psychotherapy (Tschacher, Scheier, & Grawe, 1998). In this study 28 courses of dyadic psychotherapy (10 behavioral, 3 client centered, 9 heuristic, 6 schema oriented; 40–90 weekly sessions) were investigated. The hypothesis of order increase by pattern formation rested on our conceptualization of the therapeutic alliance as a complex psychological system that is embedded in an environment of various driving parameters. Using the method of therapy-session reports, all individual sessions of each therapy were assessed by the therapist (a 14-item questionnaire with items such as: “I have the impression that the client came up with what really bothers him/her”) and likewise by the client (a 19-item questionnaire with items such as: “Today I felt comfortable with the therapist”). For each therapy course, data on 33 variables per weekly session were collected. The multiple time series generated by this monitoring procedure served as the foundation of order analysis. Landsberg order was used as described in Banerjee, Sibbald, and Maze (1990; see Shiner, Davison, & Landsberg, 1999). This measure estimates the degree of order in a multivariate data set by calculating the ratio of the actual entropy, normalized by the potential entropy, both computed on the basis of the variance-covariance matrix of the p t window (p =
106 modeling complex systems items of session reports, t = session number). One minus this ratio then provides the measure of order. We computed this measure for the 20 first and the 20 last consecutive sessions using the 33 items recorded in therapy-session reports. Results clearly supported the hypothesis of a significant increase of order during the course of psychotherapy in a comparison of first versus last sessions of each therapy course. This finding was corroborated using an extended data set of a later study (Tschacher et al., 2000). In a second step of this study we addressed a question that follows naturally from this finding: Is there a connection between order and therapy outcome? The general impression achieved by the outcome study was unequivocal: Order of the therapy system as well as increase of order were related to positive outcome of therapy. We monitored 41 outcome measures, 20 of which were correlated with Landsberg order in a statistically significant way. These associations pointed to order and order formation as being functional for good treatment results. Improvement of the self-image of patients and a decrease in social anxiety were linked with both order and increase of order. Psychopathology of the psychotherapy patients was found to be connected to increase of order. Order was also computed to investigate the course of schizophrenia in acute treatment (Kupper, Tschacher, & Hoffmann, 1997) and to study rehabilitation processes in psychiatry. In these data the assessment of order was based on daily symptom ratings using the instruments introduced above and on weekly evaluations of progress in a psychiatric vocational rehabilitation program (Kupper, 1999). In the study of acute treatment we analyzed psychopathology courses of 21 patients (mean age 24 years, 10 of 21 female) during a psychotic episode. Daily ratings of psychopathology were performed. As in the study reported in Tschacher et al. (1998), order and order formation were calculated using the measure Landsberg order. The results of this study showed that order and order formation correlated negatively with the overall level of psychopathology and with the final level of psychopathology at discharge of patients. Order generally increased throughout the treatment of psychotic episodes. In the vocational rehabilitation data (Kupper, 1999), order and order formation in courses of 30 participants (mean age 27 years, 10 of 30 female) with schizophrenic disorders were explored. The same methodological approach to order formation as in the previous study was
107 Approach to Psychopathology Table 1. Summary of Order and Order-Formation Results from Studies of the Treatment and Rehabilitation of Schizophrenia Patients Vocational Rehabilitation
Acute Treatment
Initial phase: no correlation
Initial phase: more negative symptoms and depression (outcome) Middle phase: less confusion and tension (outcome) Final phase: no correlation
Correlates of order (r approximately 0.4–0.7)
Middle phase: positive outcome (level of integration)
Ordering effect present
No
Correlates of ordering
Positive outcome (level of integration)
Yes Initial-middle: less overall tension, fear, and ambivalence Initial-final: less negative symptoms and depression
used. This program for vocational rehabilitation included vocational training, social skills training, family interventions, job placement, and support by job coaches. The assessments were weekly ratings of behavioral and emotional indicators of functioning, from both participants’ and supervisors’ perspectives. The primary outcome was level of vocational reintegration after the conclusion of the program. The results showed that order and order formation were again related to a positive outcome, here regarding vocational reintegration. No general increase of order was found. Overall, the majority of results in these data were consistent with what we labeled order effect (level of Landsberg order correlating to favorable outcome) and ordering effect (increase of Landsberg order correlating to favorable outcome; see Table 1). Moreover, meaningful differences between studies are evident from Table 1. Acute treatment seems to consist in a transition from a disordered acute state to a more stable state toward the end of treatment. Rehabilitation programs with their higher demands, however, appear to start from a stable entry point. The increased stress induced by these demands does not allow a general ordering effect but leads instead to largely varying developments among patients. Generally,
108 modeling complex systems it can be hypothesized that, in these studies order reflected the stability of the mental system of the patients. Therefore, the tacit undertone of the word disorder (meaning mental illness) seems justified, even when we define order in the strict mathematical sense. Fingerprints of Nonlinearity and Chaos One of the hypotheses that have been derived from dynamic systems theory is that seemingly random temporal behavior may be generated by relatively simple deterministic nonlinear systems. Chaos theory, a branch of systems theory, has pointed out how such systems may provide both stability (attractor-driven dynamics) and innovation (sensitivity to environmental changes). It was, therefore, suggested that nonlinear systems might provide explanations for the often unpredictable trajectories of psychopathological disorders, especially schizophrenia (Ciompi, 1997). The review of Paulus and Braff (2003) lists the recent dynamic approaches used to investigate the temporal architecture and the disease process underlying schizophrenia. In a study of daily ratings of psychopathology in 14 schizophrenia spectrum patients where observations were possible for extended periods of time (between 200 and 760 consecutive days), we modeled the attributes of the disease process (Tschacher, Scheier, & Hashimoto, 1997). To do this, we first estimated the forecastability of the time series of each individual patient. Then we applied a series of bootstrap tests that implemented a hierarchy of potential process attributes, such as “random,” “linearly autocorrelated stochastic process,” and “linear stochastic process with identical power spectrum.” Finally, the actual forecastability of the observations was compared to the forecastabilities of the bootstrap time series. Whenever significant differences occur, we may conclude that the dynamics of the observed time series was not sufficiently explained by the process attributes, thereby pointing to nonlinearly generated dynamics of the observed data. The analysis suggested that 8 of 14 schizophrenia patients presented nonlinear dynamics. These investigations were compatible with the hypothesis that schizophrenia may be characterized by chaotic evolutions. Yet direct proof of deterministic chaos in relatively short empirical time series is unattainable, therefore, one cannot assess the chaoticity of the schizophrenia courses we studied. Visual inspection of forecasting accuracies showed, however, that the decay of predictability typical of deterministic chaos was present in the larger
109 Approach to Psychopathology part of the sample. Together with the rejection of alternative hypotheses (especially linearly correlated stochasticity), this allows that chaotic processes may underlie psychopathology in schizophrenia. We think that the chaos hypothesis of schizophrenia and other diseases (e.g., depression; Pezard et al., 1996) must be treated with considerable caution. Although there is some evidence from a variety of data sources, both behavioral and neurophysiological, the prerequisites for the generally very sophisticated dynamic methods are seldom realized in psychopathology data. Existence of chaos may well remain undetected because of the constant fluctuations found in any environment outside a physicist’s laboratory. In addition to chaos representing a quite ephemeral quality of (some) nonlinear systems, it is probably not their most important property. We already introduced pattern formation as a functionally valuable and, at the same time, ubiquitous phenomenon and will concentrate on fingerprints of cognitive patterns and their stability in the following. Stability of Cognitive Patterns in Schizophrenia Perceptual and cognitive patterns are characteristically changed during psychotic experience. The tradition of Gestalt psychiatry (Conrad, 1958; Matussek, 1952) views the evolution of schizophrenia by a succession of stages: everyday cognitive patterns may be impaired prior to the outbreak of psychosis (derealization as Gestalt loss) and may then be resurrected in a bizarre way (delusions and hallucinations as malfunctional Gestalt re-formation). These phenomenological studies thus pointed to a variety of alterations in Gestalt perception and cognition indicating that both disorganization and delusional hyperorganization should be found. A number of empirical studies have, consequently, focused on the changes in (predominantly perceptual) organization in schizophrenia spectrum disorder (Uhlhaas & Silverstein, 2005). Cognitive psychology views Gestalt-like processes as essential during preattentional stages of parallel stimulus processing; in these early stages stimulus features are grouped and “bound together.” The large majority of these studies suggested that perceptual organization is dysfunctional in schizophrenia. These changes in perceptual organization may reflect a more encompassing impairment in the coordination and binding of spatial and temporal information and of information originating from different sensory modalities (Phil-
110 modeling complex systems lips & Silverstein, 2003). Interestingly, Gestalt dysfunction does not necessarily go hand in hand with patients showing decreased task performance. Place and Gilmore (1980) and others found that schizophrenia patients did not present a generalized deficit when compared to controls; in fact they were, for example, more accurate than controls in counting tasks where grouping of stimuli did not support performance. Research has shown that alterations of perceptual organization differ between subgroups of patients and, especially, correlate with symptomatology. A number of clinical symptoms were linked with Gestalt perception. In their review Uhlhaas and Silverstein (2005) cited evidence for a correlation of Gestalt dysfunctions with cognitive disorganization as well as with both positive and negative symptoms. In a recent study of Gestalt perception (Tschacher, Dubouloz, Meier, & Junghan, in press), we investigated several apparent motion paradigms. We included 32 schizophrenia patients (66% dayclinic patients, 34% inpatients; 81% males; mean age 27.3 years) and 32 control subjects matched for age, sex, and education. Clinical symptomatology of the patients was measured by the Positive and Negative Symptom Scale (panss). Although well in need of treatment, most patients were not acutely symptomatic, receiving average panss scores below 3 (“low symptoms”). For all computations we used the factorization of the panss according to Lindenmayer, Grochowski, and Hyman (1995), which consists of the five factors positive, negative, excitement, cognitive (disorganization), and depression. Nevertheless, this schizophrenia group had reaction times markedly decreased compared to controls. The mean reaction time was increased by 1.7 standard deviations in patients, pointing to their generalized impairment of cognitive functioning. Circular Apparent Motion (cam) The frames displayed in Figure 9 were presented alternately for 500 ms each. Generally, Gestalts in the shape of movement illusions result. The impression is always either that of a wandering of the dots in a clockwise or counterclockwise circular direction, or that of a rapid oscillation of the two apparent motions. Thus, the stimulus presentation is inherently multistable (Kruse, Stadler, Pavlekovic, & Gheorghiu, 1992) because the same display can give rise to different illusions in the same person under
111 Approach to Psychopathology
Figure 9. Display shown to test circular apparent motion (cam). The left- and the right-hand panels are shown alternately for 500 ms each, producing the motion perception.
identical circumstances. The perceived durations of respective Gestalts were suggested as a measure of cognitive stability (Kruse & Stadler, 1995). In the present sample, multiple regression showed that durations of Gestalt perceptions were significantly linked to the panss factors. Especially the negative symptom factor was associated with prolonged durations. Yet there was no difference between the patient and control groups. Stroboscopic Apparent Motion (sam) Corresponding to the previous task, the frames displayed in Figure 10 were presented alternately for 500 ms each. Two qualitatively different Gestalt illusions are generated, vertical apparent motion (vsam) or horizontal apparent motion (hsam) of the dots. In the case of vsam, dot A is perceived as moving down to dot D and B as moving up to C. In the case of hsam, the perception is of A and B moving to C and D, respectively. The Gestalt impression depends on the horizontal distance d. The smaller is d, the more likely hsam is seen. With d gradually reduced from a maximum value to 0 and then increased again, flip events are enforced (initially, vsam transiting to hsam, then the reverse, hsam giving way to vsam). We monitored the timing of these flip events by having subjects press a button when a flip occurred. The asymmetry of the timing of the initial and the reversed flip events (i.e., the hysteresis effect) is a hallmark of phase transitions between stable attractors, as was seen above. Haken (1996) discussed the size of the hysteresis effect as a prominent measure of Gestalt stability.
112 modeling complex systems
Figure 10. Display shown to test stroboscopic apparent motion (sam). The left- and the right-hand panels are presented alternately for 500 ms each.
Again, no group effect was observed in our data. In other words, Gestalt stability measured by the hysteresis effect did not generally deviate in patients. The timing of the initial Gestalt flip (vsam to hsam) was, however, strongly linked with symptomatology. The five panss factors explained 48% of the variance in this variable in a whole model test. The negative and the cognitive (disorganization) factors both delayed the initial Gestalt flips, whereas positive symptoms accelerated the occurrence of flip events. Motion-Induced Blindness (mib) The following phenomenon was described recently by Bonneh, Cooperman, and Sagi (2001): Subjects are instructed to observe the middle of a display such as that depicted in Figure 11. The display contains three stationary dots colored bright yellow and a grid of dimly illuminated blue crosses. The grid is rotated slowly. The phenomenon that most observers perceive is “apparent blindness”—one or all of the yellow dots subjectively disappear from the visual field for a period of time, sometimes for several seconds. The subjects are asked to press a key whenever, and for the duration that, apparent blindness occurs. It was our premise that this task is, in fact, a Gestalt phenomenon in the sense of figureground rivalry. The blue grid may acquire the function of figure after some time has elapsed, with the result that the yellows dots are put in the background. This exchange of figure and ground may entail the subjective perception of subjects becoming blind to the yellow dots. The mib phenomenon is similar to inattentional blindness as investigated by Simons and Chabris (1999). The variable of interest in this paradigm was the number of mib
113 Approach to Psychopathology
Figure 11. Screen display (schematic) for motion-induced blindness (mib).
phenomena perceived by each participant during a 3-min period. There was a tendency in the patients’ group toward fewer mib counts (29.3, vs. 42.1 in the control group), yet this difference did not reach the significance level. In multiple regression analysis of the patients group, however, we found a strong association of number of mib phenomena with symptomatology. The five panss factors explained 49% of the variance in this variable. The positive and the excitement factors were both related to increased numbers of mib phenomena (Tschacher, Schuler, & Junghan, 2006). Intersensory Binding The final task of the Gestalt test battery addressed temporal binding of different sensory modalities (here, auditory and visual) into a coherent perceived pattern. We used a program developed by Scheier, Lewkowicz, and Shimojo (2003). Two disks are presented moving from either sides of the screen toward the opposing sides, following the same trajectory (Figure 12). When the disks approach one another in the middle of the screen, they are perceived either as “bouncing” off each other or as “streaming” through one another at the moment they overlap visually. Similar
114 modeling complex systems
Figure 12. Screen display (schematic) for the intersensory binding task. Two disks wander from the sides of the screen toward one another; at the time of their “collision” and visual overlap, a click sound is given. Which causal relation is attributed to this scenario, bouncing or streaming?
displays have been investigated in studies of apparent causality by Michotte (1954). In addition to the optical stimuli, an acoustic-click stimulus is presented with varying temporal latency relative to the time of disk overlap. The observer is instructed to indicate which of the two possible events (bouncing or streaming) was perceived. We report here the findings regarding the probability of bouncing versus streaming perceptions (Tschacher & Kupper, 2006). There was a tendency toward patients having fewer bouncing perceptions. In the patient group, a strong relation was found between symptoms and preferred causal attributions. The positive factor and the cognitive (disorganization) factor of the panss were strongly linked with increased probability of bouncing perceptions. As a whole, the Gestalt test battery showed few general group differences between patients and matched controls. This may be attributed in part to the low symptom burden in the patient group. Within the patient group, however, the panss ratings suggested that specific associations exist between psychopathology and Gestalt perception. Psychopathology has opposing effects on perception, effects that can explain the weak significance of group comparisons. More specifically, we found that positive symptoms were linked with Gestalt instability and faster production of Gestalt perceptions, negative symptoms and the cognitive disorganization factor with persistence of Gestalts. Hysteresis, however, was unaffected by psychopathology. Additionally, apparent causality depended on symptoms. Attri-
115 Approach to Psychopathology bution of causality (the “bounce” perception) was a marker of positive and disorganization symptoms.
Discussion A common finding in research on mental disorders is that the level of psychopathology usually varies in each individual case in the course of time. Such fluctuations have frequently been perceived as a problem for the validity and reliability of quantitative research, even more so as some psychopathological phenomena are inherently unstable or show unpredictable and erratic dynamics. With the theoretical and empirical approach presented here, such dynamics poses not so much a scientific problem as an opportunity for a novel approach to modeling. In this, a long-standing call for longitudinal studies is met. The dynamics-oriented approach views change as primary, especially in complex open systems. Structure and stability are, consequently, seen as the secondary results of dynamic processes that lead to the emergence of attractors. In the second section of this chapter, we have demonstrated the validity and feasibility of this approach. We have quantified and described the trajectories and processes ubiquitously found in various fields of practice; the resulting attractors and patterns have been detailed; some of the specific hypotheses of the dynamic approach have been tested in the data sets. The main results were these: Studies show a variety of dynamic patterns in courses of psychopathology concerning psychiatric rehabilitation and acute treatment of psychoses. For a wide range of settings and problems we applied methods by which the trajectories could be translated into condensed models, especially var models, that are capable of capturing the essence of the change processes. We proposed that these models reflect the attractors underlying the observed dynamics. We concluded that these models were psychologically meaningful because the attractors were related to outcome and/or patient characteristics. The final part of the second section addressed some of the core assumptions of dynamic systems theory applied to fields of psychology, particularly order formation, nonlinearity, and the stability of Gestalt-like attractors. On the basis of the empirical evidence we may claim that the search for fingerprints of nonlinear dynamics has been successful.
116 modeling complex systems The data again suggested that the phenomena of nonlinearity, such as order and stability of patterns, are associated with markers of psychopathology and clinical outcome. From these applications of the dynamic approach can be drawn a series of implications for psychiatry and psychology, especially as regards the fields of therapy, diagnosis, and the theory of cognitive science.
therapy We expect that time-series methods can elucidate mechanisms of action in practice fields of psychiatry and psychology, such as rehabilitation and psychotherapy. The kind of longitudinal assessment that we proposed stands in contrast to the established cross-sectional approach; this has significant clinical implications. The most important benefit lies with the possible identification of change mechanisms in therapeutic settings. As time-series methods enable the modeling of single systems, the effective mechanisms can be assessed directly in the respective fields of practice and in natural clinical situations with uncompromised ecological validity. The aggregation of many single systems, as demonstrated repeatedly in the previous section, allows the distinguishing of favorable from unfavorable patterns. New methods of online control and the adaptation of interventions in the context of quality control may, thus, come within reach as soon as favorable patterns are reliably identified. It is, nevertheless, necessary to be aware of the limitations of dynamic methods, limitations that are brought about by the demands of time-series methodology. These demands are the large number of sequential measurements necessary for modeling; during the necessary observation period the underlying causal mechanisms must remain unaltered (the premise of stationarity). Another caveat must also be kept in mind: var models give an account of sequential interrelations among the process variables that may likely, but need not necessarily, reflect causal mechanisms. Time-series models are so-called Granger-causal models—as in all correlational models, the relation could be affected by unknown third variables that have not been monitored. Therefore, dynamic approaches should go hand in hand with classic experimental therapy research wherever possible. When these limitations
117 Approach to Psychopathology are taken into account, the dynamic approach has proved fruitful in process-outcome research, with a vast potential for further studies of therapeutic applications.
diagnosis Categorical diagnosis and the dynamic view of psychopathology follow conflicting concepts of disorder. For example, the concept of dynamic diseases (cf. Bélair, Glass, an der Heiden, & Milton, 1995; Emrich & Hohenschutz, 1992) deviates from the common structural concept in that (some) diseases are viewed as emergent states and attractors. This is in line with what was found above. Yet the dynamics-oriented approach holds further implications for psychiatric diagnoses, implications that have as yet received little attention. Current dsm-style diagnostics is based on set theory; for example, to diagnose borderline personality disorder, five of nine criteria must be fulfilled. The definition of concepts in terms of a list of criteria, however, is a computationalist notion that cognitive science, especially dynamic cognitive science, has largely abandoned. Categorization along the lines of prototype theory (Rosch & Lloyd, 1978) has clear advantages and, in addition, would be more compatible with the approach favored in this chapter. We propose that psychiatric diagnosis must be reformed at its very basis by considering what is known about psychological categorization.
theory Our final remarks, however, go beyond psychopathology: How can we address cognition in general on the basis of the dynamic view? Arguments for a novel view of cognition, one that treats cognition as an emergent property of the mind, have accumulated in the recent past (e.g., Tschacher & Dauwalder, 2003). As we said in the introductory section, this understanding of cognition deviates from the computationalist approach of cognitive psychology, where cognition is an abstract semantic structure running on neuronal hardware, much as a computer program would run on silicon chips. Dynamics-oriented theory is more encompassing in several respects. First, this theory is
118 modeling complex systems in accordance with transdisciplinary systems theories in the natural sciences that study and predict self-organization phenomena. This unitary approach has advantages with respect to the dissemination of both methods and phenomenological findings across disciplines. Second, in the dynamic framework, information processing and cognition is never separable from emotion and motivation. The exploration of cognition by abstracting from its very driving forces is increasingly viewed as unfeasible in psychology and neuroscience. This integrated view of cognition in context (embodied cognition) is a principal attribute of our model. Third, dynamic systems theory deals with complexity. We have demonstrated that, in cognitive science, two separate sources of complexity must be addressed. On the one hand, cognitive systems themselves are always complex, as only complex systems can, via a self-organizational process, produce adaptive pattern formation. On the other hand, cognitive systems always deal with a complex world, a world that enforces and affords complexity reduction. Continuous simplification is, therefore, of the utmost survival value. The main demand on cognition is just this—simplifying the world by the extraction of significant patterns on the basis of motivation.
References Andreasen, N. C., Paradiso, S., & O’Leary, D. S. (1998). “Cognitive dysmetria” as an integrative theory of schizophrenia: A dysfunction in corticalsubcortical-cerebellar circuitry? Schizophrenia Bulletin, 24, 203–218. Banerjee, S., Sibbald, P. R., & Maze, J. (1990). Quantifying the dynamics of order and organization in biological systems. Journal of Theoretical Biology, 143, 91–111. Bélair, J., Glass, L., an der Heiden, U., & Milton, J. (Eds.). (1995). Dynamical disease. Woodbury ny: American Institute of Physics Press. Bleuler, E. (1911). Dementia Praecox oder die Gruppe der Schizophrenien. Leipzig: Deuticke. Bonneh, Y. S., Cooperman, A., & Sagi, D. (2001). Motion-induced blindness in normal observers. Nature, 411, 798–801. Carter, R. (2002). Consciousness. London: Weidenfeld & Nicolson. Ciompi, L. (1997). Die emotionalen Grundlagen des Denkens: Entwurf einer fraktalen Affektlogik. Göttingen: Vandenhoeck & Ruprecht. Clark, A. (1997). Being there: Putting brain, body, and world together again. Cambridge ma: mit Press. Conrad, K. (1958). Die beginnende Schizophrenie. Stuttgart: Thieme.
119 Approach to Psychopathology Emrich, H., & Hohenschutz, C. (1992). Psychiatric disorders: Are they “dynamical diseases”? In W. Tschacher, G. Schiepek, & E. J. Brunner (Eds.), Self-organization and clinical psychology (pp. 204–212). Berlin: Springer. Garcia-Toro, M., Blanco, C., Gonzalez, A., & Salva, J. (2001). Psychopathology and the binding problem. Medical Hypotheses, 57(6), 718–723. Globus, G. G., & Arpaia, J. P. (1994). Psychiatry and the new dynamics. Biological Psychiatry, 35, 352–364. Grawe, K. (2004). Psychological therapy. Seattle: Hogrefe & Huber. Haken, H. (1983). Synergetics: An introduction. Berlin: Springer. Haken, H. (1987). Synergetic computers for pattern recognition and associative memory. In H. Haken (Ed.), Computational systems—natural and artificial: Proceedings of the International Symposium on Synergetics at Schloss Elmau, Bavaria, May 4–9, 1987 (pp. 2–23). Berlin: Springer. Haken, H. (1996). Principles of brain functioning: A synergetic approach to brain activity, behavior, and cognition. Berlin: Springer. Kelso, J. A. S. (1995). Dynamic patterns: The self-organization of brain and behavior. Cambridge ma: mit Press. Kelso, J. A. S. (2003). Cognitive coordination dynamics. In W. Tschacher & J.-P. Dauwalder (Eds.), The dynamical systems approach to cognition (pp. 45–70). Singapore: World Scientific. Köhler, W. (1920). Die physischen Gestalten in Ruhe und in stationärem Zustand. Braunschweig: Vieweg. Kruse, P., & Stadler, M. (Eds.). (1995). Ambiguity in mind and nature. Berlin: Springer. Kruse, P., Stadler, M., Pavlekovic, B., & Gheorghiu, V. (1992). Instability and cognitive order formation: Self-organization principles, psychological experiments, and psychotherapeutic interventions. In W. Tschacher, G. Schiepek, & E. J. Brunner (Eds.), Self-organization and clinical psychology (pp. 102–117). Berlin: Springer. Kupper, Z. (1999). Dynamische Modelle für chronische psychische Störungen. Lengerich: Pabst Science. Kupper, Z., & Hoffmann, H. (2000). Course patterns of psychosocial functioning in schizophrenia patients attending a vocational rehabilitation program. Schizophrenia Bulletin, 26(3), 681–698. Kupper, Z., & Tschacher, W. (2002). Symptom trajectories in psychotic episodes. Comprehensive Psychiatry, 43(4), 311–318. Kupper, Z., Tschacher, W., & Hoffmann, H. (1997, March). Correlates of order and ordering in the time course of schizophrenia. Poster presented at the Joint Conference on Complex Systems in Psychology/6. Herbstakademie, Gstaad. Kupper, Z., Tschacher, W., & Hoffmann, H. (2004). Longitudinal symptom patterns in psychotic episodes are related to neurocognition and outcome. Schizophrenia Research, 67(1, Suppl.), 272. Lindenmayer, J.-P., Grochowski, S., & Hyman, R. B. (1995). Five factor model of schizophrenia: Replication across samples. Schizophrenia Research, 14, 229–234.
120 modeling complex systems Lütkepohl, H. (1993). Introduction to multiple time series analyses. Berlin: Springer. Mahoney, M. J. (1991). Human change processes: The scientific foundations of psychotherapy. Chicago: Basic. Matussek, P. (1952). Untersuchungen über die Wahrnehmung: 1. Mitteilung. Archive für Psychiatrie und Zeitschrift für Neurologie, 180, 279–319. Mechsner, F., Kerzel, D., Knoblich, G., & Prinz, W. (2001). Perceptual basis of bimanual coordination. Nature, 414, 69–73. Michotte, A. (1954). Gesammelte Werke. Bern: Huber. Miltner, W., Braun, C., Arnold, M., Witte, H., & Taub, E. (1999). Coherence of gamma-band eeg activity as a basis for associative learning. Nature, 397, 434–436. Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs nj: Prentice-Hall. Nicolis, G., & Prigogine, I. (1977). Self-organization in non-equilibrium systems. New York: Wiley. Paulus, M. P., & Braff, D. L. (2003). Chaos and schizophrenia: Does the method fit the madness? Biological Psychiatry, 53, 3–11. Peralta, V., & Cuesta, M. J. (2001). How many and which are the psychopathological dimensions in schizophrenia? Issues influencing their ascertainment. Schizophrenia Research, 49(3), 269–285. Pezard, L., Nandrino, J.-L., Renault, B., Massioui, F. E., Allilaire, J.-F., Varela, F. J., & Martinerie, J. (1996). Depression as a dynamical disease. Biological Psychiatry, 39, 991–999. Pfeifer, R., & Scheier, C. (1999). Understanding intelligence. Cambridge ma: mit Press. Phillips, W. A., & Silverstein, S. M. (2003). Convergence of biological and psychological perspectives on cognitive coordination in schizophrenia. Behavioral and Brain Sciences, 26, 65–138. Place, E. J., & Gilmore, G. C. (1980). Perceptual organization in schizophrenia. Journal of Abnormal Psychology, 89, 409–418. Rosch, E., & Lloyd, B. B. (Eds.). (1978). Cognition and categorization. Hillsdale nj: Erlbaum. Rössler, O. E. (1976). An equation for continuous chaos. Physics Letters, 57a, 397–398. Rubin, E. (1921). Visuell wahrgenommene Figuren. Copenhagen: Gyldendalske. Scheier, C., Lewkowicz, D. J., & Shimojo, S. (2003). Sound induces perceptual reorganization of an ambiguous motion display in human infants. Developmental Science, 6, 233–244. Schneider, E. D., & Kay, J. J. (1994). Life as a manifestation of the second law of thermodynamics. Mathematical and Computer Modelling, 19, 25–48. Shiner, J. S., Davison, M., & Landsberg, P. T. (1999). On measures for order and its relation to complexity. In W. Tschacher & J.-P. Dauwalder (Eds.), Dynamics, synergetics, autonomous agents: Nonlinear systems approaches to cognitive psychology and cognitive science (pp. 49–63). Singapore: World Scientific.
121 Approach to Psychopathology Simons, D. J., & Chabris, C. F. (1999). Gorillas in our midst: Sustained inattentional blindness for dynamic events. Perception, 28, 1059–1074. Singer, W., & Gray, C. M. (1995). Visual feature integration and the temporal correlation hypothesis. Annual Review of Neuroscience, 18, 555–586. Spaulding, W. D., Fleming, S. K., Reed, D., Sullivan, M., Storzbach, D., & Lam, M. A. F. (1999). Cognitive functioning in schizophrenia: Implications for psychiatric rehabilitation. Schizophrenia Bulletin, 25, 275–289. Tschacher, W. (1997). Prozessgestalten—die Anwendung der Selbstorganisationstheorie und der Theorie dynamischer Systeme auf Probleme der Psychologie. Göttingen: Hogrefe. Tschacher, W., Baur, N., & Grawe, K. (2000). Temporal interaction of process variables in psychotherapy. Psychotherapy Research, 10, 296–309. Tschacher, W., & Dauwalder, J.-P. (Eds.). (1999). Dynamics, synergetics, autonomous agents: Nonlinear systems approaches to cognitive psychology and cognitive science. Singapore: World Scientific. Tschacher, W., & Dauwalder, J.-P. (Eds.). (2003). The dynamical systems approach to cognition. Singapore: World Scientific. Tschacher, W., Dubouloz, P., Meier, R., & Junghan, U. (in press). Altered perception of apparent motion in schizophrenia spectrum disorder. Psychiatry Research. Tschacher, W., Haemmig, R., & Jacobshagen, N. (2003). Time series modeling of heroin and morphine drug action. Psychopharmacology, 165, 188–193. Tschacher, W., & Haken, H. (in press). Intentionality in non-equilibrium systems? The functional aspects of self-organized pattern formation. New Ideas in Psychology. Tschacher, W., & Jacobshagen, N. (2002). Analysis of crisis intervention processes. Crisis, 23, 59–67. Tschacher, W., & Kupper, Z. (2002). Time series models of symptoms in schizophrenia. Psychiatry Research, 113, 127–137. Tschacher, W., & Kupper, Z. (2006). Perception of causality in schizophrenia spectrum disorder. Schizophrenia Bulletin, 32, S106–S112. Tschacher, W., Scheier, C., & Grawe, K. (1998). Order and pattern formation in psychotherapy. Nonlinear Dynamics, Psychology and Life Sciences, 2, 195–215. Tschacher, W., Scheier, C., & Hashimoto, Y. (1997). Dynamical analysis of schizophrenia courses. Biological Psychiatry, 41, 428–437. Tschacher, W., Schuler, D., & Junghan, U. (2006). Reduced perception of the motion-induced blindness illusion in schizophrenia. Schizophrenia Research, 81, 261–267. Uhlhaas, P. J., & Silverstein, S. M. (2005). Perceptual organization in schizophrenia spectrum disorders: Empirical research and theoretical implications. Psychological Bulletin, 131, 618–632. Varela, F. J. (1995). Resonant cell assemblies: A new approach to cognitive function and neuronal synchrony. Biological Research, 28, 81–95. Wiersma, D., Nienhuis, F. J., Slooff, C. J., & Giel, R. (1998). Natural course
122 modeling complex systems of schizophrenic disorders: A 15-year follow-up of a Dutch incidence cohort. Schizophrenia Bulletin, 24, 75–85. Wittchen, H. U., Lieb, R., Pfister, H., & Schuster, P. (2000). The waxing and waning of mental disorders: Evaluating the stability of syndromes of mental disorders in the population. Comprehensive Psychiatry, 41, 122–132.
Developing ComputerBased Learning Environments Based on Complex Performance Models Susanne P. Lajoie McGill University
A universal theme in my research, regardless of the population or the subject material studied, is the importance of modeling performance. The word model can be defined in many ways. My use of the term is close to that of the online Merriam-Webster dictionary, which refers to a model as being something set or held before one for guidance or imitation. Interestingly enough, from a psychological perspective, modeling has been defined in a similar manner. Bandura (1977) defined it in terms of how learning can be facilitated by observing others perform the task in question. The benefit of modeling would be that learners do not always have to learn from their own mistakes but can sometimes learn by observing others do a task efficiently and then incorporating the ideas thereby obtained. The relevance to learning of such modeling is that learners practice deliberately rather than indiscriminately (Ericsson, 2006). Even though there is some truth to the notion that practice makes perfect, we also know that practicing the piano for 10 years does not make one a concert pianist. Expertise can be developed when practice is sufficiently deliberate with feedback regarding performance. There are still three key questions regarding modeling. The first one is what to model, the second who or what does the modeling,
124 modeling complex systems and the third how to model effectively. Some answers to these questions are presented, followed by examples from my own research that will help contextualize the arguments made in this chapter.
What to Model In learning and performance contexts it is often the cognitive processes involved in problem solving that need to be modeled. Studies of expertise and proficiency have helped in the identification of such processes in specific contexts and have also led to the discovery of commonalities in such components across expertise theories (Alexander, 2003; Chi, Glaser, & Farr, 1988; Ericsson, 2002; Glaser, Lesgold, & Lajoie, 1987; Lajoie, 2003). The groundwork for examining expert/ novice differences was summarized in Chi et al. (1988). Many of the principles of expertise discovered then, and the methodologies for studying expert/novice differences, are used today. The assumption is that identifying dimensions of expertise can lead to improvements in instruction that will, ultimately, result in helping learners become more competent. Instructional improvements are based on modeling these dimensions of expertise. For instance, self-monitoring and metacognition are key elements of expertise; however, we need to identify what experts monitor in a specific context before we can model these processes for novices. The domain knowledge, the structure of the knowledge, and the strategies that lead to effective problem solutions can all be modeled for the learner, but it is not simply observing things that leads to learning but, rather, using such knowledge and interacting with it with specific feedback. Studies of expertise have been criticized for being too coldly cognitive (Alexander, 2003). Although the mind, body, spirit connection—where affect and emotions are considered to go hand in hand with the mind (James, 1890)—has long been recognized, we are still struggling as a community to see how these elements interact. Lepper (1988) reintroduced the connection when he called for the intersection of cognition and motivation theories, comparing cognitive psychology to the Tin Man in The Wizard of Oz (Baum, 1969), who wanted a heart, and motivation theory to the Scarecrow, who wanted a brain. It seems that the cognitive scientists are often considered “heartless” in the sense that they focus on the mind and how people
125 Developing Learning Environments learn. However, learning theories are increasingly more inclusive in that cognition, motivation, and the social context in which learning takes place are considered as interconnected (Anderson, Greeno, Reder, & Simon, 2000; Cordova & Lepper, 1996; Mayer, 1997). Mahoney (in this volume) describes lifelong learning from the perspective of embodied cognition, where higher learning and cognition are linked to emotion. Examining learning processes as they occur within “situations” or meaningful contexts goes hand in hand with personal interests when considering what is meaningful. Learning situations in the real world are often social in nature, and team members are part of the situation. Salas, Stagl, Burke, and Goodwin (in this volume) speak to this issue with reference to developing expert teams in natural settings. Their chapter addresses the notion of distributed expertise, which is important in real-world settings. The intersections of learning, motivation, and social situations are becoming elements of research design (Cobb, Confrey, diSessa, Lehrer, & Schauble, 2003). Alexander has edited a special issue on the topic of expertise in the journal Educational Researcher (Vol. 32, No. 8) that points to how researchers study expertise today, pointing toward a shift to a more inclusive theoretical model that parallels the discussion in the editors’ introduction to this volume of the confluence of social, cognitive, and motivational theories in interesting combinations that lead us to a better understanding of human performance (see esp. Alexander, 2003). New models must consider the interleaving of such principles in specific contexts.
modeling competence across the curriculum The National Academy of Science report by Pellegrino, Chudowsky, and Glaser (2001) provides insight with regard to what to model across the K–12 curriculum. Pellegrino et al. report on a large body of scientific knowledge about the processes of thinking and learning and the development of competence in specific curriculum areas. Examining competency or proficiency within a specific context is the first step in elaborating a model of thinking that can help the less competent become more proficient in a specific domain. Pellegrino et al. support a curriculum-instruction assessment triad based on
126 modeling complex systems principles about learning and knowing that can assist learners along a learning trajectory within a specific field. They report that effective learning environments are learner centered and, hence, that instruction must provide scaffolding for solving meaningful problems and supporting learning and understanding. Again, we cannot scaffold learning unless we understand the learning process; only then can we model these processes for novice performers. The same principles would apply in complex learning situations in the real world (see Lajoie, 2003). The implications for teaching and the design of instruction and assessment (Pellegrino, 2002) are clearly based on identifying what students know and what they need to know and having them reflect on the processes. Studies of expertise have provided the foundation for developing models of what students need to know with respect to complex performance across domains. Such studies supported the design of methodologies used today to support our understanding of verbal data (see Chi, 1997; Ericsson & Simon, 1993), which are central to documenting problem-solving activity. Cognitive task analysis (cta) is still an appropriate means of discovering what experts know with regard to their problem-solving plans, actions, and mental models (Lesgold, Lajoie, Logan, & Eggan, 1990). In fact, cta is an excellent mechanism for documenting an effective problem space that reflects a more inclusive analysis of how individuals who differ in their performance skills go about solving problems. Two examples from complex decision-making activities in the real world, avionics troubleshooting and clinical diagnostic reasoning, reveal that experts can differ in their solution strategies and steps but be guided by common underlying mental models to the correct solution. Analyses of avionics troubleshooters revealed no ideal solution paths and demonstrated that experts solve similar problems differently (Lesgold et al., 1990). However, similarities were found in the underlying mental models that guided their problem solving. Similarly, a cta of the clinical decision making of surgical nurses revealed that expert nurses reached similar decisions, albeit by different routes, demonstrating that there are many paths to solving problems (Lajoie, Azevedo, & Fleiszer, 1998). Differences were observed in hypothesis generation, planning of medical interventions, actions performed, results of evidence gathering, interpretation of the results, heuristics, and overall solution paths.
127 Developing Learning Environments Documenting such problem spaces gives clear guidance for how we might tutor individuals in their problem-solving decisionmaking strategies. Assessment must consider learning at a higher level of abstraction and a wider effective problem space in which assessment of learners takes place (Lajoie, 2003). Developing computer-based learning environments (cbles) and intelligent tutoring systems on the basis of cta can validate performance models by demonstrating that learning does occur in the predicted manner and that providing feedback based on such performance models can lead to greater proficiency in trainees. Such an approach was employed in the avionics troubleshooting example mentioned above. The cta led to the development of a cble, “Sherlock,” that provided a practice environment allowing first-term airmen to become proficient troubleshooters (Lesgold, Lajoie, Bunzo, & Eggan, 1992). The tutor teaches troubleshooting procedures for dealing with problems associated with an f-15 manual avionics test station. A study was conducted evaluating Sherlock’s effectiveness using 32 trainees from two separate air force bases (Nichols, Pokorny, Jones, Gott, & Alley, 1992). Pre and posttutor assessment was done using verbal troubleshooting techniques as well as a paper-andpencil test. Two groups of subjects per air force base were tested: (1) subjects receiving 20 hours of instruction on Sherlock and (2) a control group receiving on-the-job training over the same period of time. Statistical analyses indicated that there were no differences between the treatment and the control groups on the pretest (means = 56.9 and 53.4, respectively). However, on the verbal posttest as well as on the paper-and-pencil test, the treatment group (mean = 79.0) performed significantly better than the control group (mean = 58.9) and equivalently to experienced technicians having several years of on-the-job experience (mean = 82.2). That is, the average gain score for the group using Sherlock was equivalent to almost 4 years of experience. All this is to say that identifying robust performance models in complex domains can lead to effective instruction for those less proficient in problem-solving performance (Shute, Lajoie, & Gluck, 2000). Hence, knowing what to model can lead to better performance. Similarly, sicun, a computer tutor for nurses working in a surgical intensive-care unit (sicu), was designed on the basis of the cta described by Lajoie et al. (1998). The analysis led to the design of
128 modeling complex systems a system that encourages self-monitoring of decision-making processes. Nurses who worked with sicun were required to post their goals before conducting patient assessments and then specify outcomes of their assessments. For example, if their goal was to check the patient’s circulatory system for adequate blood supply to the heart, they might check pulse rate as well as skin (for swelling, edema, coloration, capillary refill, and temperature). Prior to their moving on to a new goal or body system, the tutor would prompt them about the results of their assessment. Hence, plans, goals, actions, and outcomes were all built into the system, with decision trees designed to encourage self-monitoring and comparison to expert problem solvers at various phases of problem solving. A full-scale evaluation of this tutor was not conducted, but the subjects tested became more planful in their patient assessments. The discussion presented above has described how decisions can be made about what to model to learners. The issue of deciding who or what does the modeling is another matter entirely, one that can lead to choices about how to successfully model.
Who or What Does the Modeling? Discussions of cognitive performance models, how complete they are, and who and what should do the modeling abound (Derry & Lajoie, 1993; Lajoie, 2000). What and whom you choose to model complicate these questions. The increasingly integrated models of learning, social processes, and motivation will further challenge us in answering these questions. A simple answer to the “who or what models?” question is that both human beings and computers can model, tutor, or coach individuals and groups of learners. However, the issue of computers as modelers is more contentious than that of human tutors. Members of the artificial intelligence (ai) and education community continue to struggle with the question of performance models. This struggle seems to parallel changing conceptions of learning theories as well as the difficulties associated with methodologies used to instantiate such theories. Learning theories today are described in the context of knowledge construction through realistic tasks and situations, whereas in the past they were described
129 Developing Learning Environments in the context of contained, well-defined laboratory tasks that had solutions. Well-defined tasks are easier to model than some of the ill-defined real-world tasks being modeled today. In moving toward more complex problem-solving tasks, even the most seasoned ai experts have moved away from the modeling camp, Elliott Soloway (1990), for example, suggesting that extracting expert models in more ill-defined problems takes too much time and involves less certainty that all the possible solutions patterns can be captured with computer models. Instead of living with incomplete computer models, Soloway moved away from computer models to human models involving teachers and peers serving as guides on the side. It is somewhat paradoxical that we do not question whether human coaches, teachers, and tutors have all the possible models in their heads, but, when we build computer tutors, we are not content without robust testable models. Musen (in this volume) describes how intelligent databases and expert systems can serve as vehicles for expertise but that domain ontologies that reflect problem solving in a domain are becoming increasingly more important in assisting learners. Rather than debating whether human or computer coaches are better at modeling, it might be better to consider the two in tandem than to replace one with the other. Computers can serve as cognitive tools that can amplify, extend, and enhance learning (Jonassen, 1996; Jonassen & Reeves, 1996; Pea, 1985; Salomon, Perkins, & Globerson, 1991). They can do so by providing a mechanism for learners to generate and test hypotheses in complex problem-solving situations (de Jong & van Joolingen, 1998). Furthermore, such tools can be designed to provide information through multiple modalities, thus ensuring opportunities for multiple representations of knowledge (Kozma, Russell, Jones, Marx, & Davis, 1996; Mayer & Moreno, 2002). In addition, given the identification and use of complex student models, cbles can be designed to provide scaffolding that is in the form of diagnostic feedback embedded in the learning situation to be offered when assistance is needed (Lajoie, Faremo, & Wiseman, 2001; Lajoie & Lesgold, 1992; Mislevy, Steinberg, Breyer, Almond, & Johnson, 2002). If such sophisticated models are not available, computers can still be used as cognitive tools and used in conjunction with human coaches and peers to scaffold the process (Palincsar & Herrenkohl, 2002).
130 modeling complex systems
How to Model? Just as theories of expertise have guided my decisions about what to model, other frameworks have led me in deciding modeling performance itself. The cognitive-apprenticeship (Collins, Brown, & Newman, 1989) and communities-of-learning (Brown, 1994; Brown, Ellery, & Campione, 1998; Palinscar & Herrenkohl, 2002) frameworks lead the way in terms of linking cognitive science and pedagogy. The cognitive-apprenticeship model (Brown, Collins, & Duguid, 1989; Collins, Brown, & Newman, 1989; Gott, 1989; Lave & Wenger, 1991; Williams, 1992) provides a template for connecting abstract and real-world knowledge by creating forms of pedagogy that are based on a model of learners, the task, and the situation in which learning occurs. When considering a traditional apprenticeship setting, such as apprenticing to become a chef, we think of novices learning from a head chef by observing and modeling physical skills. For example, an apprentice chef observes and learns from the head chef and usually starts with easier tasks, cleaning and preparing vegetables, rather than planning menus and meals for heads of state. The novice, in this example, is supported by the expert chef, who provides coaching in, for example, the correct cutting procedures, and whose active intervention gradually fades into the background when the novice demonstrates that he or she can perform the task independently. A cognitive apprenticeship is more difficult to construct since cognitive rather than physical processes are being modeled for the learner. The literature on expertise reveals that experts are not always able to articulate their problem-solving strategies or their thinking processes since those things are highly routinized or automated (Anderson, 1983). Hence, as described above, methods for externalizing these decision-making strategies must be used in order to build a model of complex performance prior to modeling for novice learners. There are four aspects of the pedagogical model, namely, content, methods, sequence, and sociology. I have described methods for documenting the content knowledge earlier in this chapter. The pedagogical methods employed by this framework involve modeling expertise and coaching learners with feedback in a manner that supports differences in knowledge acquisition. Coaches scaffold knowledge by providing the right amount of support to learners while they are performing a task. Not everyone needs the
131 Developing Learning Environments same amount of help or scaffolding. Once students demonstrate that they can do something on their own, the scaffolding is gradually removed since the goal is for students to become independent learners and problem solvers. The methods include opportunities for articulation, reflection, and exploration. Learners articulate what they know either through performances or through communication of some sort. Reflection can consist of self-assessments, and it can include comparisons of student processes with more proficient models of performance. Exploration and active problem solving in meaningful contexts are key features of the model. The sequence of instruction takes the complexity of the content material into account, ensuring that students are challenged with meaningful tasks but not overwhelmed by information that they are not ready for. Hence, students participate in the global or overall task by performing smaller components of the overall task prior to engaging in the specific local skills from the start. In this way they are still participating in producing a final product and developing a conceptual model of how the overall task is performed rather than working in isolation. The sociology of such real-world tasks usually occurs in small groups or teams of people working together. Once again, head chefs have a team of sous chefs who help in the overall preparation of a banquet. Similarly, with tasks requiring cognitive skills, the work can be distributed among a team of individuals working toward a common goal. Learning in this way must take the sociology of the group into consideration. Learning theories and pedagogical models alike are considering issues of shared cognition more carefully. We see similar considerations with training situations in the real world (Cannon-Bowers & Salas, 2001). In both in- and out-of-school learning situations, communities of learning (col; Brown, 1994; Brown et al., 1998) and communities of practice (cop; Barab & Duffy, 2000; Wenger, 1999), respectively, are being described, created, and empirically studied. The col model engages students in meaningful research activities, each student in the community playing a role as the community progresses toward the goal of learning. The cop model is employed in real-world situations, allowing students of such professions as medicine and law to work together to solve cases. The social sharing of information in this approach is essential to the final outcome of the task. Similarities exist between these models and the cognitive-ap-
132 modeling complex systems prenticeship framework discussed above. Both approaches include in their descriptions reference to the sociology of the environment or the notion of community. Both suggest ways of making schooled learning more meaningful as a way of easing the transition between school and practice. Both use models of scaffolding that are based on the assumption that multiple zones of proximal development (Vygotsky, 1978) exist within the group and, hence, that feedback must adapt to those developmental zones. Both approaches use the models of expertise within their design of effective instruction. The col approach is unique in the types of participant structures that it provides as examples of modeling, turn taking, and role-playing to serve as new ways of sharing expertise and constructing learning within a community. So far I have described ways of discovering what to model, who or what can do the modeling, and how to model cognitive processes. The remainder of this chapter will contextualize these ideas with examples from my own research.
What to Model: Differences in Diagnostic Reasoning My research-and-development efforts aim at integrating instruction and assessment in contexts that reflect real-world situations. In the area of high school science there has been a call for instruction that provides more meaningful, more challenging, and richer learning experiences, experiences that foster the development of reasoning abilities that can apply to real-world practice (Johnson & Lawson, 1998; Metz, 1995, 1997). In this regard I developed “BioWorld,” a cble that serves as a platform for evoking evidence of knowledge and capturing complex performance as high school students develop scientific-reasoning skills in the context of problem solving about patient cases (Lajoie, Greer, Munsie, Wilkie, Guerrera, & Aleong, 1995; Lajoie, Lavigne, Guerrera, & Munsie, 2001). BioWorld serves to instruct, model proficiency, and assess knowledge. Students learn about diseases associated with the body systems they are studying. Patient cases are presented in the context of hospital simulations, and students work collaboratively to collect evidence to confirm or refute hypotheses. Patient cases were developed with the help of experts, and a cta established robust models of such ill-structured problems.
133 Developing Learning Environments
Figure 1: The current BioWorld interface: case history screen.
In determining what to model, we asked medical experts to solve the patient cases designed for BioWorld, in an attempt to get a robust expert model of problem solving for each case. By identifying what experts know, it is possible to develop assessment genres for examining transitions in learning in novice performers. Expert problem-solving traces were monitored and collected dynamically, as were verbal protocols. These data determined the unique profiles of experts in terms of plans, strategies, and actions within BioWorld demonstrating different clusters of competencies that served to establish benchmarks of performance (Lajoie et al., 1995). Figure 1 presents an annotated screen shot of the BioWorld interface. The patient case is presented and evidence from this case can be collected and stored in the evidence table. Hypotheses can be selected and changed throughout the problem-solving activity, as can one’s beliefs about said hypotheses. For instance, you might select cirrhosis as a hypothesis, but your confidence that it is a correct hypothesis might be weak. Results have shown that learners’ confidence levels increase as they acquire more knowledge (Lajoie, La-
134 modeling complex systems
Figure 2. Ordering diagnostic tests.
vigne, et al., 2001). Interestingly enough, similar findings are found in clinical psychology, where treatment outcomes are related to increases in clients’ self-efficacy (Tschacher & Kupper, in this volume). Confidence and knowledge building are intertwined. BioWorld also presents an online library where factual information is provided, as is a patient chart, allowing learners to practice ordering diagnostic tests. Consultation is also provided online. As experts solve patients’ cases, they select relevant evidence from the patients’ medical histories, collect pertinent information in an online medical library, perform diagnostic tests pertinent to the hypothesis (see Figure 2), use systematic plans and actions throughout problem solving, and make final arguments based on evidence (see Figure 3). Records of expert competency clusters are established and used to monitor novice students electronically in terms of the proportion of overlap of their actions with each predetermined cluster. Instructional feedback was based on the dynamic assessment of actions throughout problem solving. Students also learn to self-assess by comparing their reasoning with that of an expert (as shown in Figure 3). With practice, students became more systematic in their
135 Developing Learning Environments
Figure 3. Expert evidence as a reflection device for self-assessing final argument.
reasoning and more strategic about evidence collection and hypothesis testing, indicating that instruction based on dynamic assessment can lead to transitions in learning (for evidence of these claims, see Lajoie, Lavigne, et al., 2001). Decisions regarding what to model led to design decisions regarding the types of cognitive tools that BioWorld provides to learners. In essence the evidence palette provides a mechanism for learners to monitor what they thought was important to the solution process. They can reflect on their own thinking and also compare their solutions with an expert’s path at the completion of the problem. Rather than modeling a sequence of problem-solving processes, BioWorld highlights relevant information in the decision-making process. The consult button was designed to model expertise in the form of feedback. The success of BioWorld with high school students has led us to consider ways to reinvent this cble for medical students. In order to better understand developing expertise, Faremo (2004) examines how medical students and residents solve medical cases, compared
136 modeling complex systems to experts. Her analysis of the cognitive processes involved in diagnostic reasoning represents the knowledge levels and qualitative differences in argumentation and reasoning patterns in this medical cohort. Through verbal-protocol analyses she was able to capture a picture of emerging expertise as individuals reason through cases. Her coding schemes are based on the plans, evidence identification, and factual and procedural knowledge specific to a task. As an example, Figure 4 presents a representation of how a medical student’s problem-solving trace compared to that of a resident and expert in diagnosing a patient with celiacs. The patient case took the form of a narrative that presents a 27-year-old male with a 2-year history of intermittent diarrhea, weight loss, and anxiety. Celiacs is a chronic intestinal malabsorption disorder caused by intolerance to gluten. It presents in a variety of ways, and some direct clues (diarrhea, abdominal discomfort, and distention) may be present. Iron deficiency is found in affected adults, and there can be (1) low albumin, calcium, potassium, and sodium and (2) elevated alkaline phosphotase and prothrombin time. The disorder is diagnosed by means of symptoms, lab studies, and X-rays (antigliadin antibodies are the gold standard test for detection). Figure 4 demonstrates the relation between the plans or goals experts had, the types of data they collected and reviewed, and the hypotheses they generated in the context of reasoning about this case. It also shows that the students identified some of the same information as relevant, but did not engage in the same systematic planning and evidence evaluation, as experts. This type of in-depth analysis of diagnostic reasoning across cohorts can eventually lead to robust models of problem solving that can extend the use of BioWorld to higher-education classrooms and complete the picture of emerging expertise in this domain.
Who or What to Model: Human and Computer Coaches in Medical School Medical tutorials present a naturalistic mechanism for studying apprenticeship. We studied human tutors in medicine to develop a model of the medical tutorial situation for studying clinical problem-solving tasks (Lajoie, Wiseman, & Faremo, 2000). As with any apprenticeship there are strengths and weaknesses. The strength of
Figure 4. Expert model with student overlay for the case of a celiac.
138 modeling complex systems the setting is that realistic patient cases are seen and handled. The weakness of the natural apprenticeship is that what you see is what you get. In other words, there is no standardization of curriculum or guarantee that all students will see the types of patient cases that will build on their existing knowledge. We were interested in documenting the types of diagnostic feedback that human tutors gave to students as well as describing the learning context. In doing so our attempt was to develop a cognitive-apprenticeship model for diagnostic feedback that might be built into a cble. What we discovered was that a col approach was common in these tutoring sessions, whereby small groups of individuals shared the problem and distributed their learning through shared representations, articulation, and reflection, with a human tutor scaffolding as needed. Two lessons were learned from this setting. The first lesson was that contextualized and diagnostic feedback could be studied in these settings and that elements of scaffolding and gradual removal, articulation and reflection, were, in fact, all part of the tutorial process. Hence, an argument could be made that the pedagogical methods of the cognitive-apprenticeship model were used and could be documented. The second lesson was that this environment had to consider the sociology of the group and the roles of each member if it was to be an authentic tutorial.
How to Model: The Social Context We are in the process of using the above findings in the construction of better tools for medical tutorials. As we move the BioWorld cble into a medical setting, we have designed the “CaseBuilder” (see Lajoie, Faremo, & Wiseman, 2001) for instructors’ use in building their curriculum of cases in areas that they want their students to have more knowledge about. The elements of the CaseBuilder will provide the instructor with tools to build in links to library and test information. The library becomes more complex with medical populations, and more complex studies of the link between knowledge representation and decision making in the context of information-access systems are needed (Nakamura & Lajoie, 2003). More important, not only do the instructors build the case, but they can also add feedback at key locations where they anticipate instruc-
139 Developing Learning Environments tional moments for their students. They can also run the case with students to see whether they need to revise it for better instruction and assessment purposes. Incorporating the social context into performance modeling is more difficult. Medical students learn from experienced practitioners and teachers (experts) and other students and residents (intermediates) during their training. Students attend lectures, participate in problem-based groups, observe others, and participate in discussions about hospital patients. We are currently looking at ways to build a more distributed model of learning for this population in the context of problem-based learning situations. Lu and Lajoie (2003) describe three types of cognitive tools that will be considered in this situation: visualization tools, to make knowledge representations more visible to the teams involved; knowledge-building tools, to help people add on to existing knowledge in specific ways; and management tools, to facilitate the structuring and tracking of information between small groups. On a clinical teaching ward, there are experts in many different content areas collaborating hierarchically to work on a given case. These experts also continuously interact within a hierarchy of novice to intermediate learners (medical students, interns, and residents). We are still researching ways of designing tools that will facilitate these exchanges in a somewhat controlled setting, allowing individuals to share knowledge collaboratively.
Conclusion By asking and answering a set of questions, I have attempted to address the intersection between performance modeling and the design of cbles. These questions are: What do we chose to model? Who or what should we model? How do we model complex decision making? Theory-based arguments were provided in response to each question. The literature on expertise and competency was discussed in the context of the empirical findings from this literature as well as the methodological tools that were offered from that literature. In essence, selecting what to model must be specific to the domain and problem tasks in question. Better-informed models of competency can provide transparent trajectories for learning in such domains.
140 modeling complex systems Decisions regarding who or what should do the modeling are based on guiding learning paradigms. For instance, social constructivists may prefer that modeling occur in groups, with more expert peers assisting the learning process. Cognitive constructivists may agree that models provided in a cble can extend learning effectively when individuals interactively engage in the problem-solving activity. Not all modeling is done through explicit coaching, whether the tutor be human or computer. The design of cbles with cognitive tools can support learning by constraining problem solving through support of the overall learning process. In answering the how-to-model question, the cognitive-apprenticeship, col, and cop approaches were described, approaches that support specific pedagogical methods in order to promote learning through effective models. Subsequent to these discussions, examples from science and medicine were presented to demonstrate how such approaches guide the design of instruction and assessment in complex learning situations. There are still unanswered questions. As modeling moves beyond the individual learner and includes a small group of learners, the complexity of assessment is increased. Although it is widely recognized that real-world learning often takes place in small groups, it is difficult to develop both individual and group models of performance when deciding appropriate levels of feedback to move the problem-solving process forward. New ways of supporting differences will need to be developed, and new ways of sharing and documenting the group process will need to parallel authentic practice.
Note Research reported in this chapter was made possible through funding provided by the following granting agencies: the Canadian Social Sciences and Humanities Research Council; the Quebec Ministry of Industry, Commerce, Science and Technology; Valorisation Recherche Quebec; Office of Educational Research and Improvement. Many graduate students (former and current) have contributed to the work that is reported here. Special thanks to Arshad Ahmad, Roger Azevedo, Gloria Berdugo, Janet Blatter, Andrew Chiarella, Lucy Cumyn, Sonia Faremo, Genevieve Gauthier, Claudia Guerrera, Nancy Lavigne, Susan Lu, Carlos Nakamura, Thomas Patrick, and Jeffrey Wiseman.
141 Developing Learning Environments
References Alexander, P. A. (2003). The development of expertise: The journey from acclimation to proficiency. Educational Researcher, 32(8), 10–14. Anderson, J. R. (1983). The architecture of cognition. Cambridge ma: Harvard University Press. Anderson, J. R., Greeno, J. G., Reder, L., & Simon, H. A. (2000). Perspectives on learning, thinking and activity. Educational Researcher, 29(4), 11–13. Bandura, A. (1977). Social learning theory. Englewood Cliffs nj: PrenticeHall. Barab, S. A., & Duffy, T. M. (2000). From practice fields to communities of practice. In D. H. Jonassen & S. M. Land (Eds.), Theoretical foundations of learning environments (pp. 25–55). Mahwah nj: Erlbaum. Baum, F. L. (1969). The wizard of Oz. Chicago: Children’s Press. (Original work published 1900) Brown, A. L. (1994). The advancement of learning. Educational Researcher, 2(8), 4–12. Brown, A. L., Ellery, S., & Campione, J. C. (1998). Creating zones of proximal development electronically. In J. G. Greeno & S. Goldman (Eds.), Thinking practices: A symposium in mathematics and science education (pp. 341–367). Hillsdale nj: Erlbaum. Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42. Cannon-Bowers, J. A., & Salas, E. (2001). Reflections on shared cognition. Journal of Organizational Behavior, 22(2), 195–202. Chi, M. T. H. (1997). Quantifying qualitative analyses of verbal data: A practical guide. Journal for the Learning Sciences, 6(3), 271–316. Chi, M. T. H., Glaser, R., & Farr, M. J. (1988). Introduction to M. T. H. Chi, R. Glaser, & M. J. Farr (Eds.), The nature of expertise (pp. xv–xxvi). Hillsdale nj: Erlbaum. Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–13. Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive apprenticeship: Teaching the craft of reading, writing, and mathematics. In L. B. Resnick (Ed.), Knowing, learning, and instruction: Essays in honor of Robert Glaser (pp. 453–494). Hillsdale nj: Erlbaum. Cordova, D. I., & Lepper, M. R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88(4), 715–730. de Jong, T., & van Joolingen, W. R. (1998). Scientific discovery learning with computer simulations of conceptual domains. Review of Educational Research, 68(2), 179–201. Derry, S. J., & Lajoie, S. P. (1993). A middle camp for (un)intelligent computing. In S. P. Lajoie & S. J. Derry (Eds.), Computers as cognitive tools (pp.1– 11). Hillsdale nj: Erlbaum. Ericsson, K. A. (2002). Attaining excellence through deliberate practice: In-
142 modeling complex systems sights from the study of expert performance. In M. Ferrari (Ed.), The pursuit of excellence in education (pp. 21–55). Hillsdale nj: Erlbaum. Ericsson, K. A. (2006). The influence of experience and deliberate practice on the development of superior expert performance. In K. A. Ericsson, N. Charness, P. J. Feltovich, & Robert R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 223–241). Cambridge: Cambridge University Press. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (Rev. ed.). Cambridge ma: mit Press. Faremo, S. (2004). Examining medical problem solving in a computer-based learning environment. Unpublished doctoral dissertation, McGill University, Montreal. Glaser, R., Lesgold, A., & Lajoie, S. (1987). Toward a cognitive theory for the measurement of achievement. In R. R. Ronning, J. Glover, J. C. Conoley, & J. C. Witt (Eds.), The influence of cognitive psychology on testing (Vol. 3, pp. 41–85). Hillsdale nj: Erlbaum. Gott, S. P. (1989). Apprenticeship instruction for real world cognitive tasks. Review of Research in Education, 15, 97–169. James, W. (1890). The principles of psychology. New York: Henry Holt. Johnson, M. A., & Lawson, A. E. (1998). What are the relative effects of reasoning ability and prior knowledge on biology achievement in expository and inquiry classes? Journal of Research in Science Teaching, 35(1), 89–103. Jonassen, D. H. (1996). Computers in the classroom: Mindtools for critical thinking. Columbus oh: Prentice-Hall. Jonassen, D. H., & Reeves, T. C. (1996). Learning with technology: Using computers as cognitive tools. In D. H. Jonassen (Ed.), Handbook of research for educational communications and technology (pp. 693–719). New York: Macmillan. Kozma, R. B., Russell, J., Jones, T., Marx, N., & Davis, J. (1996). The use of multiple, linked representations to facilitate science understanding. In S. Vosniadou, E. De Corte, R. Glaser, & H. Mandl (Eds.), International perspectives on the design of technology-supported learning environments (pp. 41–60). Hillsdale nj: Erlbaum. Lajoie, S. P. (2000). Breaking camp to find new summits. In S. P. Lajoie (Ed.), Computers as cognitive tools: Vol. 2. No more walls (pp. xv–xxxii). Mahwah nj: Erlbaum. Lajoie, S. P. (2003). Transitions and trajectories for studies of expertise. Educational Researcher, 32(8), 21–25. Lajoie, S. P., Azevedo, R., & Fleiszer, D. (1998). Cognitive tools for assessment and learning in a high information flow environment. Journal of Educational Computing Research, 18(3), 205–235. Lajoie, S. P., Faremo, S., & Wiseman, J. (2001). Tutoring strategies for effective instruction in internal medicine. International Journal of Artificial Intelligence and Education, 12(3), 293–309. Lajoie, S. P., Greer, J. E., Munsie, S. D., Wilkie, T. V., Guerrera, C., & Aleong, P. (1995). Establishing an argumentation environment to foster scientific
143 Developing Learning Environments reasoning with Bio-World. In D. Jonassen & G. McCalla (Eds.), Proceedings of the International Conference on Computers in Education (pp. 89–96). Charlottesville va: aace. Lajoie, S. P., Lavigne, N. C., Guerrera, C., & Munsie, S. D. (2001). Constructing knowledge in the context of BioWorld. Instructional Science, 29(2), 155–186. Lajoie, S. P., & Lesgold, A. (1992). Apprenticeship training in the workplace: A computer-coached practice environment as a new form of apprenticeship. In M. Farr & J. Psotka (Eds.), Intelligent instruction by computer: Theory and practice (pp. 15–36). New York: Taylor & Francis. Lajoie, S. P., Wiseman, J., & Faremo, S. (2000, June). Tutoring strategies for effective instruction in internal medicine. Paper presented at the International Conference on Intelligent Tutoring Systems, Montreal. Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. New York: Cambridge University Press. Lepper, M. R. (1988). Motivational considerations in the study of instruction. Cognition and Instruction, 5(4), 289–309. Lesgold, A., Lajoie, S. P., Bunzo, M., & Eggan, G. (1992). sherlock: A coached practice environment for an electronics troubleshooting job. In J. H. Larkin & R. W. Chabay (Eds.), Computer assisted instruction and intelligent tutoring systems: Shared goals and complementary approaches (pp. 201–238). Hillsdale nj: Erlbaum. Lesgold, A., Lajoie, S. P., Logan, D., & Eggan, G. M. (1990). Cognitive task analysis approaches to testing. In N. Frederiksen, R. Glaser, A. Lesgold, & M. Shafto (Eds.), Diagnostic monitoring of skill and knowledge acquisition (pp. 325–350). Hillsdale nj: Erlbaum. Lu, J., & Lajoie, S. P. (2003). Fostering medical problem solving in a collaborative Web-based learning environment. In Y. S. Chee, N. Law, K. Lee, & D. Suthers (Eds.), Proceedings of the International Conference on Computers in Education (pp. 337–340). Charlottesville va: aace. Mayer, R. E. (1997). Learners as information processors: Legacies and limitations of educational psychology’s second metaphor. Educational Psychologist, 31(3/4), 151–161. Mayer, R. E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction, 12(1), 107–119. Metz, K. E. (1995). Reassessment of developmental constraints on children’s science instruction. Review of Educational Research, 65(2), 93–127. Metz, K. E. (1997). On the complex relation between cognitive developmental research and children’s science curricula. Review of Educational Research, 67(1), 151–163. Mislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G., & Johnson, L. (2002). Making sense of data from complex assessment. Applied Measurement in Education, 15(4), 363–389. Nakamura, C., & Lajoie, S. P. (2003, June). Informational and instructional content in digital learning environments. Paper presented at the Educational Media Conference, Honolulu hi.
144 modeling complex systems Nichols, P., Pokorny, R., Jones, G., Gott, S. P., & Alley, W. E. (1992). Evaluation of an avionics troubleshooting tutoring system (Tech. Rep.). Brooks City tx: Brooks Air Force Base, Human Resources Directorate, Armstrong Laboratory. Manuscript in preparation. Palincsar, A. S., & Herrenkohl, L. (2002). Designing collaborative learning contexts. Theory into Practice, 41(1), 26–32. Pea, R. D. (1985). Beyond amplification: Using the computer to reorganize mental functioning. Educational Psychologist, 20(4), 167–182. Pellegrino, J. (2002, February). Understanding how students learn and inferring what they know: Implications for the design of curriculum, instruction and assessment. Paper presented at the annual National Science Foundation K– 12 Math, Science, and Curriculum Implementation Projects Conference, Reston va. Pellegrino, J., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The Science and Design of Educational Assessment. Washington dc: National Academy Press. Salomon, G., Perkins, D. N., & Globerson, T. (1991). Partners in cognition: Extending human intelligence with intelligent technologies. Educational Researcher, 20(3), 2–9. Shute, V. J., Lajoie, S. P., & Gluck, K. (2000). Individual and group approaches to training. In S. Tobias & H. O’Neill (Eds.), Handbook on training (pp. 171–207). Washington dc: American Psychological Association. Soloway, E. (1990, July). Interactive learning environments. Paper presented at the nato Advanced Studies Institute, Calgary. Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Cambridge ma: Harvard University Press. Wenger, E. (1999). Communities of practice: Learning, meaning, and identity. New York: Cambridge University Press. Williams, S. M. (1992). Putting case-based instruction into context: Examples from legal and medical education. Journal for the Learning Sciences, 2(4), 367–427.
Technology for Building Intelligent Systems: From Psychology to Engineering Mark A. Musen Stanford University
The Vision of Artificial Intelligence People in industrialized societies are surrounded by computer systems that demonstrate intelligent behaviors (Stefik, 1995; Winston & Prendergast, 1986). They help us prepare our tax returns. They help us navigate our cars. They evaluate our applications for credit. We take it for granted that human knowledge can somehow be embedded in computer systems and that computer systems can help people solve knowledge-intensive tasks—or can solve such tasks completely autonomously. For better or for worse, we live in “the age of the smart machine” (Zuboff, 1988). The formulation, communication, and application of knowledge are fundamental aspects of being human. All people share a basic motivation to share knowledge within their social groups and to codify knowledge so that others can take advantage of it. From ancient peoples who first tracked the stars in the night sky to contemporary industrial workers who wish to clarify best practices for their organizations, there is an undeniable drive to elucidate and to share information. It is no wonder that computers and their associated technologies—the most powerful communication vehicles that have yet to be invented—provide the infrastructure for much of our attempt to manage knowledge in modern society (Liebowitz, 1999).
146 modeling complex systems Because computers have been mass-produced for only a few decades, it is not surprising that the field of artificial intelligence (ai) is relatively young. What is surprising is that, nearly as soon as computers became available for general research, investigators began to study how computers might be programmed to do intelligent things. The 1950s saw the birth of quite sophisticated programs for playing checkers, for proving mathematical theorems, and for processing natural language. By 1956 there was sufficient interest in the challenge of getting computers to demonstrate intelligent behavior that John McCarthy and several colleagues convened a two-month meeting of workers in computer science, psychology, philosophy, and economics at Dartmouth College to study a new field that McCarthy dubbed artificial intelligence. In the original proposal for the Dartmouth conference, McCarthy, Minsky, Rochester, & Shannon (1955) declared: “The study is to proceed on the basis of the conjecture that every aspect of learning or any other feature of intelligence can in principle be so precisely described that a machine can be made to simulate it. An attempt will be made to find how to make machines use language, form abstractions and concepts, solve kinds of problems now reserved for humans, and improve themselves.” This grand vision for ai has been achieved, to date, only in science fiction. Enormous progress has been made on components of this montage of capabilities, but no computer system can be viewed as generally artificially intelligent. Some programs can analyze or generate natural language. Others can form abstractions from primitive data. Some can solve problems typically reserved for humans. For a host of reasons, no one has created ai in the composite sense. The computer programs that help us prepare our taxes and that offer driving directions are extremely useful, nevertheless, and represent a class of computer programs that have been enormously successful in our society. We refer to such programs as intelligent systems. This chapter traces some of the history of intelligent systems, outlining the obstacles that developers have overcome, and suggesting methods by which such systems can be built and maintained. The emphasis is on the representation of human knowledge in computers and on the primitive building blocks that make such representations possible. The story begins with a close alignment between developers of intelligent systems and scholars of cognitive psychology. It ends, however, with a perspective that construes the devel-
147 Building Intelligent Systems opment of intelligent systems more as software engineering than as applied psychology. By not attempting to replicate human cognition but instead attempting to take advantage of what is known about the construction of good software systems, developers now can build computer programs that are extremely useful, reliable, maintainable, and—many would say—intelligent. Our goals, however, must be more focused than those of the participants in the 1956 Dartmouth conference. We must recognize that the computer systems that will be most useful to society are not necessarily those that might replicate human cognition but rather those that allow us to store, communicate, and apply human knowledge in specific contexts when it is needed. The elucidation of the methods that are needed to enable system builders to create such software artifacts can be just as exciting as the elucidation of human cognition itself. I find it particularly helpful to look at the evolution of thought regarding knowledge-based systems in a historical context. The broad picture of how developers of intelligent computer programs have viewed the role of psychology in their craft over the years tells a very interesting story. This is a book chapter, however, not a book, and, therefore, I have to be selective in what I say. The reader should be aware that the need to streamline the presentation requires that I simplify (and sometimes oversimplify) parts of the story.
The Rise of Rule-Based Systems When most computer scientists think of intelligent computer programs, they usually think of computer programs that reason using large sets of rules. Enthusiasm for rule-based systems started in the 1960s, when Ed Feigenbaum, Carl Djerassi, and Joshua Lederberg teamed up at Stanford University to create dendral, a program that could interpret mass-spectroscopy data from the chemical laboratory (Lederberg, Sutherland, Buchanan, Feigenbaum, & Lindsay, 1980). By the 1970s, Ted Shortliffe and Bruce Buchanan had built mycin, a program that could diagnose causes of infectious diseases and recommend treatment as well as physicians could (Buchanan & Shortliffe, 1984). By the end of the 1970s, there were scores of wellknown expert systems that used rule-based programming and the explicit representation of domain-specific knowledge to solve a variety
148 modeling complex systems of difficult tasks in application areas that ranged from medicine to geology to computer-hardware configuration. The notion of rulebased programming became so popular that the terms rule-based system and expert system began to be used nearly interchangeably; if a computer behaved intelligently, there was an assumption that the program was using rules. (In this chapter, I avoid the term expert system, which is now becoming dated. I use the terms intelligent system and knowledge-based system as synonyms that refer to any computer system that encodes domain-specific knowledge for the purpose of driving problem solving, regardless of whether it uses rules.) Rule-based systems encode domain knowledge in an intuitive if-then formalism. In the mycin system, for example, there were hundreds of rules such as the following: Rule 124 if: 1) The site of the culture is throat, and 2) The identity of the organism is Streptococcus then: There is strongly suggestive evidence that the subtype of the organism is not Group D Although the rules were actually written in a dialect of the lisp programming language, the computer could translate them into understandable English. The mycin system used the rules to reason about descriptions of patients entered into the program (Figure 1). A user of mycin presumed that the patient to be described had either bacteremia (bacteria in the blood) or meningitis. At the time of the user’s interaction with mycin, the patient ostensibly was ill, but it was not clear what the source of the infection was. The program would analyze the case description, asking questions of the user to gather all the relevant data, and then determine (1) the organism or organisms most likely causing the patient’s infection and (2) the antibiotics that should be administered for optimal treatment (Buchanan & Shortliffe, 1984). A program known as an inference engine interpreted the rules in mycin and allowed one rule to invoke other rules in order to reach the program’s final conclusions. For example, when evaluating Rule 124 (given above), the mycin inference engine would examine the first clause of the rule and ask: “Is the site of the culture the throat?”
149 Building Intelligent Systems
Figure 1. A trace of a user’s dialog with the mycin system. The program posed questions to the user, allowing the entry of information regarding a patient to be treated for presumptive bacteremia or meningitis. Each question seeks information necessary to determine the truth value of one of the program’s many production rules.
If the site from which the culture under consideration was taken was not the throat, then the rule would fail, and further evaluation of Rule 124 would not take place. If, however, the site of the culture was, indeed, the throat, then the mycin inference engine would consider the second clause of the rule and ask: “Is the identity of the organism under consideration Streptococcus?” If the organism was not streptococcus, then the rule would fail. If the organism was, indeed, streptococcus, however, then the rule would succeed, and mycin would conclude that the subtype of the streptococcus is not Group D. What if the identity of the organism under consideration were not known one way or the other? The mycin inference engine would examine the rule base to see whether there were any rules that had not yet fired that would allow the system to conclude whether the identity of the organism was streptococcus. If there were such rules, mycin would suspend its evaluation of Rule 124 and go on to evaluate those other rules; once it was known whether the identify of the organism was streptococcus, the mycin inference engine would return to Rule 124 to determine whether the second clause was true
150 modeling complex systems or false. If the second clause evaluated true, then the system would conclude that the subtype is not Group D. mycin’s inference engine thus used the hundreds of rules in the knowledge base to evaluate the case at hand and to generate recommendations for the user. Starting with an overarching goal rule (basically: “if you know what are the likely organisms causing the infection then recommend treatment”), the inference engine would invoke rule after rule recursively to conclude everything it could about the case at hand so that the program could then determine the appropriate course of action. This style of computer programming is known as a production system. Each production rule in the system has a left-hand side (a condition) and a right-hand side (a conclusion). An inference engine such as the one in mycin starts with the goal rule and determines whether the condition predicating the rule is true. If so, then the rule “produces” its conclusion; if not, then the inference engine considers the truth value of other rules that can “produce” as their conclusion the condition of the rule currently under consideration. Examination of these rules may cause yet other rules to be invoked. The procedure stops when the truth value of the goal rule becomes known. The wonderful thing about the mycin inference engine was that it was a simple procedure. The inference engine contained no knowledge of infectious diseases or their treatment. It was designed only to invoke rules to follow chains of inference; all the domain-specific knowledge was encoded strictly in the rules. Thus, it was a relatively straightforward matter to apply mycin-style inference engines to an entirely different rule base—allowing the system to evaluate cases and make recommendations in new application areas far afield from medicine. The idea of rule-based systems caught on like wildfire. It was extremely appealing to view knowledge bases as collections of rules. The rules were viewed as modular “chunks” of knowledge that developers could drop into an expanding knowledge base as new capabilities were defined. Rules were viewed as independent of one another and not subject to interaction effects as a knowledge base grew. Most important, workers in ai at the time believed that mycin-style rules had verisimilitude with components of actual human problem solving.
151 Building Intelligent Systems
Figure 2. A cryptarithmetic problem. Newell and Simon (1972) asked subjects to replace each letter consistently with a digit in order to create a mathematically correct formula.
Rule-Based Systems as Cognitive Models The surge of interest in rule-based systems in the 1970s followed the explosion of interest in cognitive psychology that took root in the 1960s. Although not all ai researchers believed that the goal of automating intelligence would, ultimately, require a deeper understanding of psychology, many computer scientists were greatly inspired by investigation to developer comprehensive models of human information processing. Perhaps most influential to workers on ai was the research that Newell and Simon (1972) had done to study human problem solving. Newell and Simon studied how people solve cryptarithmetic puzzles (Figure 2), prove theorems in logic, and select moves in chess. They presented subjects with well-defined problems to solve and carefully recorded and analyzed statements made by their subjects as they “thought out loud” about the problems that they were given. They used the term protocol analysis to define the manner in which they carefully recorded the stimuli to which their subjects seemed to attend, the goals to which the subjects seemed to be responding, and the actions that the subjects considered when confronted with a task to address (Ericsson & Simon, 1993). (Developers of intelligent systems have borrowed heavily from this same methodology when attempting to elicit the knowledge relevant for building electronic knowledge bases.) Newell and Simon’s (1972) empirical analysis of protocols from scores of laboratory experiments encouraged them to adopt an information-processing perspective on cognition, viewing human problem solving as a process in symbolic reasoning. They described problem solving as the serial processing of symbols transferred from long-term memory to short-term memory in response to external
152 modeling complex systems and internal stimuli. They saw in their data a common problem-solving procedure that looked as if subjects were performing rule-based reasoning. They intentionally were guarded when they claimed to “confess to a strong premonition that the actual organization of human programs closely resembles the production system organization” (p. 803), but there was an obvious attractiveness to this conjecture. Human problem solving suddenly could be understood in terms of production systems (Young, 2001)—as the simple application of rule-based reasoning, using mechanisms that had been well studied by computer scientists and philosophers for decades. For the ai community, this work had a rather unguarded implication: human knowledge must surely be encoded as production rules, and the builders of intelligent systems can construct their electronic knowledge bases by finding out what those rules are. By the end of the 1970s, it was commonplace for developers of intelligent systems to view the problem of building electronic knowledge bases as one of eliciting rules from experts. More important, there was widespread belief that the rules in the knowledge base had correlates in representations in the head of the expert who served as the informant. Building an intelligent system was seen as a problem in the “transfer of expertise,” where the goal was to get the rules out of the expert’s brain and into the computer. Pioneers in the field, such as Feigenbaum (1984), frequently used a metaphor in which system builders were said to “mine” the knowledge of human experts, capturing “golden nuggets” of expertise that could be added to a growing knowledge base, one rule at a time. The prevailing view was that the rules in the computer system were precisely the same rules that the experts used to solve real-world problems. By definition, every knowledge-based system became a cognitive model. Granted, there were some vocal naysayers at the time. Dreyfus (1981), for example, pointed to the qualitative transformation of problem-solving abilities that seems to take place as novices become experts and argued that the tacit nature of much professional knowledge makes it impossible for computers ever to reason like human experts. The ai community paid some attention to these concerns, but the apparent success of mycin and a host of other rule-based systems seemed too compelling to ignore. There was face validity to the claim that human expertise could be packaged within a com-
153 Building Intelligent Systems puter, and Newell and Simon’s suggestion that simple production systems could form the basis of human cognition seemed to be playing out—at least in silico.
The ai Boom and the ai Winter mycin never was asked to diagnose a real patient. Rule-based systems for playing chess routinely—and quickly—lost to human grand masters. But the boom was beginning by the early 1980s. Companies such as Digital Equipment Corporation with great fanfare installed rule-based systems to help configure the complex backplanes of their minicomputers (McDermott, 1982). Schlumberger touted the benefits of employing rule-based systems to assist in drilling for oil. A system called “Prospector” was credited with the discovery of a new deposit of molybdenum ore (Duda & Shortliffe, 1983). American industry became obsessed with the idea of mining human expertise and putting it in a box, building machines to perform the complex cognitive problem solving previously believed to be the realm of only highly trained people (Winston & Prendergast, 1986). The U.S. military, which had funded much of the work in ai, had visions of autonomous robots fighting battles in which there were no human casualties. New professional organizations, such as the American Association for Artificial Intelligence and the International Association of Knowledge Engineers, sprung up, as did new companies that built special-purpose computers finely tuned to run special-purpose programming languages such as lisp. There were new companies selling programs to help developers edit and debug rules. These companies offered inference engines that grew in their capabilities (and in their complexity) to perform increasingly sophisticated reasoning. Indeed, the inference engines often became so complicated that yet other companies were founded to advise customers what new hardware and software to buy and how to use their purchases most effectively. A new “knowledge industry” had been born, and the excitement was like nothing that computer scientists has seen previously. When the International Joint Conference on Artificial Intelligence convened in Los Angeles in 1985, the city had not seen such crowds since the 1984 summer Olympic games. Companies with names
154 modeling complex systems such as Intellicorp, Teknowledge, and Symbolics were busily busing hundreds of conventioneers—including bright-eyed graduate students who had no money at all to spend—to exclusive locations in Beverly Hills, offering abundant free food and a chance to see the companies’ products in action. Scruffy-looking researchers who had agreed to give tutorials on basic aspects of rule-based systems were stunned, not only by the numbers of attendees cramming into their lecture halls, but also by the unprecedented per capita honoraria that they received, allowing at least one to brag about buying a new sports car as a result! The word on the street was that human intelligence could be mined and put into machines. By 1988, ai had become a $1 billion industry in the United States. Within a few years, however, the expert-systems industry would be largely gone. The expectation that knowledge-engineering groups would be springing up in every cranny of the corporate world was wildly optimistic. It proved much more difficult to encode and to maintain electronic knowledge bases than most ai practitioners had ever imagined. As we shall see in the next section, building intelligent systems is an enterprise that is extraordinarily more complicated than simply mining nuggets of knowledge. Rule-based systems, nevertheless, still remain essential commodities and are woven into the fabric of modern society. Such systems continue to review our applications for commercial credit, to determine the appropriateness of requested medical procedures, to audit our income tax returns, to interpret our electrocardiograms and other medical tests, to assist in industrial manufacturing, even to control the environment of the buildings in which we work. We have learned, however, that the knowledge needed to drive such systems does not exist as sets of production rules waiting to be plucked from the heads of human experts and dumped into computer programs.
The Breakdown of the “Transfer” Metaphor When the early developers of knowledge-based systems spoke of the transfer of expertise from humans to machines, they saw the construction of intelligent systems as a problem in relocating knowledge. They spoke of the parallels between transferring knowledge—
155 Building Intelligent Systems generally in the form of production rules—from human experts to computer programs and transferring knowledge from computer programs to naive users. Knowledge was a commodity, a substance, and the goal was to get it from one place to another. The view of knowledge-based development as the transfer of expertise hindered the now-obvious recognition that building electronic knowledge bases is a creative and inventive activity. When developers interact with application specialists to build knowledgebased systems, the developers form mental models of how the experts solve problems; the experts, of course, have mental models of their own that attempt to capture their professional problem-solving behavior. In the course of building the system, both the developers and the experts continually revise their respective mental models. Although the developers and the experts may have very different mental models at the outset of their collaboration, the models eventually converge. This convergence is possible (1) because the development process forces all parties to commit their mental models to a fixed, publicly examinable form—typically the emerging knowledge base—and (2) because the frequent consideration of examples and test cases forces the system builders to assess, corroborate, and revise their respective models (Regoczei & Plantinga, 1987). By the 1990s developers of knowledge-based systems began to realize that the nuggets of knowledge were not always there for the mining. Builders of intelligent systems began to accept that the application experts, whose professional acumen was to be encoded as a knowledge base, often have no preexisting mental model of how they do their work. Often, the experts cannot begin to verbalize how they actually go about solving problems. Dreyfus (1981) and others had been warning about these difficulties all along, but suddenly the warnings were beginning to be take root. The problem of building knowledge-based systems was no longer seen as one of transferring expertise; much of the expertise often had to be invented in the first place. At the core of the matter is the automatization of professional behavior. Human cognitive skills appear to be acquired in at least three generally distinct stages of learning (Fitts, 1964; Johnson, 1983). Although different authors have used different terms to describe the three phases, there is concurrence regarding the qualitative changes that occur in the way in which people seem to retrieve information during problem solving. Initially, there is the cognitive stage, during
156 modeling complex systems which an individual identifies the actions that are appropriate in particular circumstances, either as a result of direct instruction or from observation of other people. In this stage, the learner often verbally rehearses information needed for execution of the skill. Next comes the associative phase of learning, in which the relations noted during the cognitive stage are practiced and verbal mediation begins to disappear. With repetition and feedback, the person begins to apply the actions accurately in a fluent and efficient manner. Then, in the final autonomous stage, the learner compiles the relations from repeated practice to the point where he or she can perform them without conscious awareness. Suddenly, the person performs the actions appropriately, proficiently, and effortlessly—without thinking. The knowledge has become tacit (Fodor, 1968). There is substantial evidence that, as humans become experienced in an application area and repeatedly apply their know-how to specific tasks, their knowledge becomes compiled and, thus, inaccessible to their consciousness. Experts lose awareness of what they know. The knowledge that experts acquired as novices may be retrievable in a declarative form, yet the skills that these professionals actually practice are procedural in nature (Anderson, 1987). The inability of experts to verbalize these compiled associations is well accepted (Lyons, 1986; Nisbett & Wilson, 1977). The consequence is that the special knowledge that we would most like to incorporate into our intelligent systems is often that knowledge about which experts are least able to talk. Johnson (1983) has identified this phenomenon as the paradox of expertise. The problem for builders of intelligent systems is that, when professionals are asked to report on their compiled expertise, they often volunteer plausible answers that may well be incorrect. In experimental situations, subjects have been shown to be frequently (1) unaware of the existence of a stimulus or cue influencing a response, (2) unaware that a response has been affected by a stimulus, and (3) unaware that a cognitive response has even occurred. Instead, subjects give verbal reports of their cognition based on prior causal theories from their nontacit memory (Nisbett & Wilson, 1977). Furthermore, because Western culture mistakenly teaches us that accurate introspection somehow should be possible (Lyons, 1986), people freely explain and rationalize their compiled behaviors without recognizing that these explanations are frequently incorrect.
157 Building Intelligent Systems Developers of knowledge-based systems are, thus, not mining preexisting nuggets of knowledge. They are creating de novo theories of professional problem-solving behavior and representing those theories in terms of electronic knowledge bases. The developers serve the important function of detecting gaps in the articulated knowledge of their informants and helping them fill in those gaps by defining plausible sequences of actions that can achieve the necessary goals. The intelligent systems that result from this work may not achieve the same level of nuanced performance associated with the procedures actually used by domain experts. The underlying knowledge bases can, nevertheless, be observed, extended, and easily disseminated to other people in need of advice. It is simply incorrect to view an electronic knowledge base as an embodiment of actual professional knowledge; knowledge bases instead represent only models of surface-level behaviors—models that attempt to approximate, but that do not reproduce, the actual problem-solving steps used by humans (Clancey, 1989).
Further Assaults on Knowledge Bases as Cognitive Models At the time of the Dartmouth conference in 1956, there had been a conviction that the secret to creating ai was rooted in a deeper understanding of human psychology. By the time the ai community had declared that “winter” had settled in at the end of the 1980s, however, the relation between psychology and knowledge-based systems seemed increasingly disconnected. A major salvo came from the situated-action community (Suchman, 1987; Clancey, 1997). Psychologists who were studying human problem solving not only reaffirmed that much professional behavior involves knowledge that is completely tacit but also noted that the stimuli that drive problem solving in the first place are often environmental and difficult to isolate. Intelligence increasingly was seen as a holistic interaction involving the problem solver with the environment. As such, intelligence could never be decontextualized. Knowledge could never be “extracted” and formalized since it could never be decoupled from the situations in which it was applied. The notion of situated action is more a perspective on behavior than it is
158 modeling complex systems a formal psychological theory (Kushmerick, 1996), but it had a jarring effect on the way people viewed the role of representations in cognitive science. The situated-action perspective cast aside Newell and Simon’s hypothesis that human problem solving is fundamentally grounded in the processing of symbols (Newell, 1980). Intelligent behavior was seen instead as the consequence of myriad specific, often-unknowable stimuli in the environment leading to myriad specific actions. There were no preexisting abstract representations in the brain to define general plans of behavior; there were only particular behavioral responses to particular situations. Such responses might require the dynamic creation of a mental representation to guide the agent’s behavior, but there were no prefabricated representations for the abstract problem space (e.g., no production rules) to drive cognition. Although the emergence of the situated-action perspective caused a minor uproar in the cognitive-science community, its effects on the developers of knowledge-based systems were, ultimately, more muted (Menzies & Clancey, 1998). The primary consequence of the “situated” perspective was that virtually no developers of knowledge-based systems claimed that they were creating cognitive models anymore. The emphasis shifted almost completely away from psychology toward the construction of useful pieces of software. This move toward a software-engineering perspective was reinforced by other events in the ai community. Perhaps none was more important than the appearance of computer programs that could, finally, beat grand masters in games of chess. Workers at CarnegieMellon University built Deep Thought (reborn at ibm as Deep Blue) and achieved outstanding game-playing performance. They did so, not by building a computer system that mimicked the cognitive behaviors of human experts, but by capitalizing on things that only computers can do: blazingly fast computation, the execution of multiple computations in parallel on distributed processors, and the ability to use brute force to look ahead many moves to see the consequences of potential actions (Newborn, 2002). Deep Blue ultimately beat Gary Kasparov at his own game, but not because the program was cleverer than Kasparov or because it modeled the thought processes of a better chess player. Deep Blue demonstrated convincingly that knowledge-based systems would be successful when they could
159 Building Intelligent Systems take advantage of the unique abilities of the hardware and software of which they were made. The emphasis was placed squarely on better techniques for systems engineering, rather than on better cognitive modeling.
Knowledge-Based Systems Are Software During the mycin era, most developers of intelligent systems argued strongly that knowledge engineering was not the same thing as software engineering, that knowledge engineers were fundamentally different from software engineers. They maintained vehemently that the building of intelligent computer systems was different from the development of conventional computer programs. Creating intelligent systems involved the representation of large amounts of content knowledge and almost no programming of traditional computer code. There was nothing to flowchart, nothing to compile. The claim was that knowledge engineers needed a skill set that was different from the one required by computer programmers. Some investigators, particularly in Europe, thought otherwise. The kads project (Schreiber et al., 2000), for example, began in the early 1980s to provide a comprehensive methodology for building knowledge-based systems. The kads consortium argued that the construction of knowledge bases and the construction of conventional software share an important element: the need to manage complexity. Psychology was important in the development of intelligent systems—not because of the need to model the cognitive processes of human informants, but because of the need for the system builders themselves to be able to keep track of a huge network of knowledge representations and the relations among them. Just as workers in traditional software engineering were grappling with methods to help computer programmers manage complexity and generate solutions creatively (Brooks, 1987), the kads project strove to create methods allowing knowledge engineers to keep track of elicited knowledge and to identify gaps in the emerging problem-solving solution. kads emphasized the role of predefined, stereotypic patterns of problem solving that could help developers elicit knowledge. The approach also stressed ways of categorizing knowledge into different “layers” of specificity to help structure the emerging knowledge-based
160 modeling complex systems
Figure 3. Stages in the development of intelligent systems. From a conceptual model of system performance, developers create a design model that makes a commitment to an abstract pattern for how the system might be created using software. The design model then drives the implementation, which results in a physical software system that users can run.
system. At its core, kads was a software-engineering methodology for building intelligent systems. For many development groups, kads—and its subsequent refinement, commonkads—transformed the process of knowledge engineering from an informal enterprise of mining nuggets to a stepwise, methodical practice for building complex software systems that manifested intelligent behavior. An essential contribution of the kads project was the view that, like conventional software, intelligent systems need to be developed in stages (Figure 3). Developers should never simply sit down and try to build a large, complex system all at once; instead, they need to approach the design process in a principled manner. The kads project viewed system building as the construction of a set of models and argued that those models should be made explicit and examinable. First developers should build a conceptual model that defines what task the system is to perform in a functional manner: What are the inputs? What are the outputs? How does the nature of the inputs constrain the nature of the outputs? Can the task be decomposed into subtasks, both to simplify the computation and to make the system more cognitively tractable? In the case of mycin, for example, the conceptual model would identify patient data as the input and a set of antibiotics to prescribe as the output. The overall task of determining what presumptive therapy to administer might be decomposed
161 Building Intelligent Systems into two subtasks: (1) identify what classes of organisms most likely were causing the infection and (2) construct a small set of antibiotics that, together, were likely to be effective against the most likely organisms. The conceptual model is just that; it is conceptual. There is no discussion of how the computer might actually perform the tasks required by the finished system. Next comes the creation of a design model. The design model is just that; it is a design. It is not a working piece of computer code but, rather, an outline of how software components might be brought together to implement a working system. A design model for mycin as it was originally implemented might describe how production rules could be used to program the organism-identification task, how a constraint-satisfaction program could be used to determine the minimal set of antibiotics to prescribe, and so on. Just as developers of methodologies for software engineering were arguing that design must precede implementation, the authors of kads and commonkads insisted that builders of intelligent systems needed to articulate a coherent design before they actually began to encode the production rules and write the program components that would form the basis of the executable system (Schreiber et al., 2000). Construction of a design model is facilitated if developers have access to a set of primitives that can serve as building blocks for constructing a design. Those primitives could be the components of expert-system-building shells or abstract algorithms for performing tasks such as constraint satisfaction. I will have much more to say about possible building blocks for the design model in the next section. From the design model would come an implementation. The implementation would be the software artifact with which end users would interact and that actually would provide them with advice. Because any creative task is simplified when it can be decomposed into more tractable elements, ideally there are software components that can serve as building blocks for developing the implementation. When creating conventional software, object-oriented programming often plays an important role in helping developers decompose the implementation task into the construction of cognitively tractable software modules. The kads project initially argued for a “waterfall” model of software development (S