Doing Your MindResearch, comments and musings about active minds.

I have recently read two books by Ellen Langer, Mindfulness and Counterclockwise. The content and moral of both are largely the same – that we are better off in all manner of ways when we are mindful1. The essence of mindfulness is being aware not just what what is (or what appears to be) but also what other possibilities there are. When we are mindful we don’t take things for granted and we don’t just accept the immediate or "obvious" interpretation for what we’re seeing. We notice how variable situations and people’s behaviour really are and we seriously consider a range of considerations as to why this is so.

Much of Langer’s research examines the various impacts of being more or less mindful on a range of things, from how persuaded we might be by a request, how likely we are to make certain kinds of mistakes or how prejudicial our views of others and ourselves might be. The repeated moral is that the interpretations available to us are always greater in number than initially appears, and the implications of choosing one rather than another are not trivial.

Some of the studies involved here are eye-opening ones in which the meaning of a situation dramatically affects people’s minds and bodies (and thus help support the view that the two are really one and the same). Perhaps the most famous is Langer’s "counterclockwise" study (Langer et al., 1990; here’s a documentary segment on it), in which men in their seventies lived and spoke as though it was twenty years earlier (the study was done in 1979, the men on a retreat spoke in the present tense about 1959). Various measures of memory and other psychological functioning improved, as did the mens’ postures, their gait, their sleep patterns and, startlingly, their hearing and eyesight. This study was driven by noticing that elderly people, while often expected just to get worse have, like everyone else, good days and bad days.

In another study, done with the household staff of hotels in New York, Crum & Langer (2007) found that women who were told that their daily activity at work was the equivalent of their daily exercise requirements lost weight, despite the fact that they did not change their diet or engage in any new exercise.

Meaning matters, and paying attention to the situations in which we find ourselves not just as whatever it is presented (work, a regular meal, an effectively scripted social interaction) but as a specific instance with its own quirks, variability and potentials is powerful and empowering mode of thinking.

Langer notes that on being introduced to the ideas of mindfulness people tend to find them intimidating. Surely acting mindfully the whole time would be draining. Keeping an open mind and thinking through numerous possibilities at every turn must be draining. But Langer claims that rather than being exhausting being mindful is in fact invigorating. Given its purely positive characteristics we might ask why mindfulness is so rare. One obvious-looking answer is the that it runs counter to some of the basic values of what we might baldly call "modern Western society", and in particular to consumerism.

Consumer living is mindless living. We buy whatever it is we want or need, use it and discard its remains. Products are refined and specialised to suit a very particular niche and are not used outside of the particular context for which they are designed (and "fit for purpose"). Products in consumer culture resist reinterpretation, inviting only one mode of thinking. What is more, once the use for which they were designed is complete they don’t just cease to be useful for what they were intended, they cease to be useful for anything and become garbage, excreta.

Precisely what makes consumer products attractive is that they remove the need for thinking things through. Problems can be solved and needs met not through effort or consideration, but off the shelf. The ease of it is inviting, habit-forming and directly contrasting with a mindful attitude. We love mindlessness.

There’s a missing step between Langer’s work and modern life. It’s a step that is rather important but very poorly understood, and it has to do with the developmental of skills.

Part and parcel of the development of skill is the automatisation of activities. As we become better at something we pay less attention to the details of it. While there are several ways in which this phenomenon is described in computational terms (usually to do with the compilation of production schemata) we don’t really know much about how it happens, or precisely what is going on. Typical wisdom goes along lines that having to pay less attention to something frees up our limited mental resources (whatever they might be) to focus on other things, and forms habits which can act as the foundation of ever more rich and interesting activities.

To complicate matters a bit, skill development is neither accidental, nor often incidental. We learn skills by deliberately attempting to achieve an end, practising to get better at it, and even unconscious perceptual learning is typically structured by goal-relevant aspects of the situation in which we’re acting (Watanabe, Nanez & Sasaki, 2001). Our motivations, our goals, structure our learning of skills and the formation of habits. For one of the most significant figures in tihe psychology expertise, K. Anders Ericsson (e.g. Ericsson & Charness, 1994; Ericsson, 2006; and my personal favourite Ericsson, 2003), the only thing standing between a person and any standard of performance you choose to highlight is their willingness to put in the effort to practice2. But the motivation to learn, that willingness to put in the effort, which seems to me to be precisely what stands between the typical mindless pleb such as myself and a more satisfying life as a mindful citizen. Ericsson is classically criticised for not addressing the issue in any satisfactory way (this complaint shows up in basic Cognitive Psychology textbooks, e.g. Eysenck & Keane, 2010), and Langer doesn’t really touch on it either.

I suspect the first place that psychologists would take us trying to address this rather basic concern (which is to say, it’s the first place that comes to my mind) is to the literature on self-regulation and mental control. But that seems to me too glib and to miss precisely those motivational aspects of the issue. Self-regulation and mental control are rather abstract, cognitive, phenomena. Laziness is in the bones, and passion is in the gut. We need an fully embodied thinking on motivation and skill acquisition that we don’t have right now.

1 It is worth noting that Langer distinguishes between mindfulness as she describes it and as it is often described within the context of Eastern meditative traditions. Mindful practice in Buddhism and other ways of living tend to be entwined in moral practice – mindfulness aids in the arising of good or right actions. Langer makes no such moral claims.

2 Ericsson does acknowledge a very few cases in which biological or innate factors can constrain the level of performance attained, where height or body-scale can be shown to have an impact.

Crum, A. J., & Langer, E. J. (2007). Mind-Set Matters: Exercise and the Placebo Effect. Psychological Science, 18(2), 165-171.

Ericsson, K. A. (2003). The search for general abilities and basic capacities: Theoretical implications from the modifiability and complexity of mechanisms mediating expert performance. In R. J. Sternberg & E. L. Grigorenko (Eds.), The psychology of abilities, competencies, and expertise. (pp. 93-125). Cambridge: Cambridge University Press.

Ericsson, K. A. (2006). The Influence of experience and deliberate practice on the development of superior expert performance. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance. (pp. 683-703). Cambridge: Cambridge University Press.

Ericsson, K. A., & Charness, N. (1994). Expert performance: Its structure and acquisition. American Psychologist, 49(8), 725-747.

Eysenck, M. J. & K. M. K. (2010). Cognitive Psychology: A Student’s Handbook. Hove: Psychology Press.

Langer, E. (1993). Mindfullness. Reading Mass: Addison-Wesley.

Langer, E. (2010). Counterclockwise. London: Hodder & Stoughton.

Langer, E. J., Chanowitz, B., Palmerino, M., Jacobs, S., Rhodes, M., & Thayer, P. (1990). Nonsequential development and aging. In C. N. Alexander & E. J. Langer (Eds.), Higher stages of human development: Perspectives on adult growth. (pp. 114-136). New York, NY US: Oxford University Press.

Watanabe, T., Nanez, J. E., & Sasaki, Y. (2001). Perceptual learning without perception. Nature, 413(6858), 844-848.

It can be difficult at the best of times to make my non-academic friends believe that conferences are not simply junkets in which a bunch of academics get together, have a few beers and put our feet up. This is compounded somewhat when the meeting in question is an euCognition network meeting being held in Palma de Mallorca.

The meeting was an interesting one, though, with a number of useful talks on the theme of multisensory integration. Now, on this issue I take my lead more from William James than anyone else, and that is that most of the research gets the question backwards:

Most books start with sensations and proceed synthetically, constructing each higher stage from the one below it. But this is abandoning the empirical method of investigation. No one ever had a simple sensation by itself. Consciousness, from our natal day, is a teeming multiplicity of objects and relations, and what we call single sensations are results of discriminative attention, pushed often to a very high degree.

(James, 1890/1950, p.224)

The most interesting talk from my point of view was that of Jeroen Smeets, in which he examined a host of research indicating a surprising apparent lack of integration of knowledge or ability based around the same perceptual modality. It would appear, if his interpretation of the research is accurate, that we have quite separate capacities for understanding speed, position, distance and so on, rather than a single integrated representation of space (either of the peripersonal or extended variety).

This fits perfectly with a point of view in which capacities for perception are deeply interconnected with particular forms of goal-directed action, and run rather counter to ideas about the development of abstract and generic representations of space, an idea that I’ve written about and which I got to talk about briefly at the meeting.

The general idea that modes of perception are structured more by goal-directed actions than by simple physiological bases. The simple physiological explanation for separate modalities seemed to be more or less assumed by most of  those presenting on the topic of integration, but the questions after my talk were more intrigued than offended. Where criticisms were made they were bang on  – the kind of dynamic account of modalities that I’ve argued for depends utterly on an unexplicated understanding of the idea of “skill” – a topic I’ve been working on for a while now and one I think must be top of the priority list of a good number of people working in the more active conceptions cognition.

0 Embodied reading

Marek to Random idea  

Even people (such as myself) who wholeheartedly embrace the adoption of devices such as the iPad and Kindle tend to find something more satisfying, or just easier, about reading from paper. Reading blogs on the topic recently from the likes of Jonah Lehrer and David Dobbs I got to wondering what the difference might really be.

Lehrer points out that editting in particular just seems more comfortable, more straightforward, when working with a printout. He suggests that perhaps it has something to do with the vagaries of ink and paper. The less reliable nature of them somehow making things more engaging, becoming a little more engrossing precisely because it’s a little more challenging than the slick digital polish of a high definition monitor. He refers to some neuropsychological studies suggesting that different areas of the brain are involved in difficult and complex reading. I’m doubtful that the ease of screen reading has much to do with it, given that analysts seemed to agree that one of the big things preventing the up-take of reading on electronic devices until relatively recently was that their screens didn’t have high enough resolutions. Sure, issues of backlighting and so on are also part of the problem, but if the more-challenging=more-engaging hypothesis were to hold then something should have become more intriguing about electronic reading precisely because resolutions had been poor.

Dobbs suggests it has to do with potential distractions, and there’s something surely right about that. When we read text on paper we aren’t aware that a quick swipe of the fingers will check our mail for us, or that an encyclopaedia entry on that topic is just a button push or two away. Paper commits us to reading, and I am a firm believer in the idea that commitment is fundamental to the structure of our consciousness (it’s the firm place to stand from which we can get work done – I wrote a bit on this idea in my D.Phil. thesis).

But I wonder if another key aspect is also playing a role. In the online discussions on the topic people often mention the feel of the paper under their fingers, the smell of books and the comfort of sitting with the heft of a paperback in their hands. The experience of bodily interacting with our material is important to us, and I wonder if it isn’t important not just because it makes us feel comfortable, but because it’s part and parcel of the reading process itself.

In February I was at a meeting of the euCognition research network in which developmental psychologist Linda Smith gave a keynote. In it she described work she’d done with a number of colleagues in which they studied the development of visual attention in children (there’s a nice example of their work in this pdf). It won’t come as a surprise to anyone to hear that they found toddlers to be highly distractable. What is a little more interesting is that their work appears to indicate that children partially overcome their distractability by picking objects up – what is in their hands keeps their attention better. In a fairly literal sense, children pay attention with their hands (the object occupies more of their visual field, it is brought into their field of action so that they are doing more than just passively looking at it).

The researchers claim that this kind of interaction is crucial to the development of stable patterns of attention and learning how to focus on particular objects, and therefore learn about them. I wonder if we have any reason to suspect that we give up that habit. Sure, we become less dependent on actually holding things to keep our minds on them, but when a situation offers us opportunities to structure our cognitive activity, we do tend to take them. Holding a book in our hands offers us feedback on how far we are through the text, our thumbs provide anchors with which we can be aware of our progress and help to keep our place on a page. When editting with printout and red pen the nib of the pen literally acts as a pointer for us. Those vagaries of ink and paper (mostly very subtle if there at all) offer more cognitive ease than cognitive challenge, giving us something particular rather than generic to interact with.

The iPad and Kindle offer many of these quirks though, thumb-placement, movability in front of your eyes, and so on that make their reading experiences much more natural for our practised habits. I’ll miss books, and I’ll certainly always need full shelves (preferably on every wall) for a house to be a home, but now our electronic reading is as almost as bodily satisfying as page-reading, there’s only one way things are going to go.

What is it about good workmanship that leaves us more fulfilled? Whether as the one producing or the one appreciating the quality of the work, there is something more to be said for work that is the product of commitment, discipline and care, rather than that of someone going through the motions. Work done for the sake of doing work well is deeply satisfying, sating the soul. It motivates itself, disciplines itself and is deeply rooted in the specific realities, the details and quirks of the materials and context rather than the abstract ideals of “best practice” or preordained, check-list style procedures. Richard Sennett dwells on these themes in The Craftsman. The book is a meditation on skill, expertise and quality of work through an exploration of their facets and context, historical and modern.

An avowed pragmatist philosopher, he eschews the arid abstraction of a conceptual analysis in favour of a richer, textured examination of these ideas embedded in an often historical narrative. He lays out the topic of interest through a contrast of Soviet-era construction work – frequently shoddy products of people who were treated little better than prison work-gangs – with modern open source computer programmers, who give work-years of their spare time voluntarily in order to produce quality software for the enjoyment of producing something genuinely worthwhile. It is this distinction that occupies Sennett – between work done for its own sake and work done for the sake of getting it out of the way, the one organic, situated and committed, the other mechanical, abstract and care-less (and thus so often careless).

Sennett examines the facets of the urge to quality from a number of different angles – from the historical relationship between masters and apprentices (by which hands-on practice the inarticulable habits of the master could be passed along), the broader relationship between craftsmen, their guilds and society, and then into the particulars of the skilful activity itself, so rich in narrative and detail as it tends to be.

Continually present in the work is Sennett’s appreciation of the transformation of experience that the development of skill entails. Finding adequate means of describing and expressing the changes in consciousness that craftsmanship involves is a daunting task, and there are times when Sennett’s discussion doesn’t quite achieve what he is aiming for. Nevertheless, his fundamental understanding of the experience of learning, of teaching and of expertise suffuses the book. His discussion of the callused hands of the medieval goldsmith I found particularly compelling, as he described the ways in which those hands with their hard-earned hardened skill would probe and squeeze the crumbled ore in the process of assaying, and whose sense of touch was (surprisingly, ironically) improved by the toughened skin because of the rich, interwoven set of activities in which it had developed.

His discussion of good teaching shows a similar sensitivity, noting how the abstract presentation of best practice is meaningless without being grounded in the realities of the student’s own experience, both the experience they to date and the (particular, bodily, visceral) experience they will have in the process of interacting with their materials.

It is this not just individual but personal nature of expertise that shines through most clearly in Sennett’s explorations. Skill is not something generic, but is particular to the expert, and exists in the relationship between then and their work – both the process and the product. Craftsmanship is not a haughty imposition of form on material. Rather, it is a process of negotiation, in which the artisan must come to a personal knowledge, a partnership, with her materials. This cultivation of relationships is just one of the reasons that expertise requires practice, which is never just rote repetition. Practice allows the development of the student’s own expertise, a re-discovery and re-invention of the wisdom and knowledge of the teacher. A piece of stone for a mason is not perceived abstractly, but is understood in its flaws and strengths, its points of weakness and texture. These details are worked with by the expert craftsman. Materials offer opportunities and obstacles, they carry with them the story of their own past as well as of the (never shapeless) potential future which must be appreciated for the crafting to be successful. Sennett notes the personal relationship with materials typically extends to anthropomorphism – bricks can be honest, cloth obstinate, a musical instrument soulful. This fostering of relationships extends to the artisan’s own body, particularly the hands, to which Sennett devotes an entire chapter.

The hands, being the primary means by which a work uses tools and instruments, by which they explore materials, effect changes and conduct the business of creation, are the crucible in which the experience of the craft is so often distilled. The hands are organs of perception as much as of action, and in writing in such terms Sennett’s pragmatism touches on enactive ways of thinking much as the works of James and Dewey so often do.

Discussion of morality is conspicuously absent for most of the book, introduced at the end in the expectation that the value of work, of creation and craft is more clearly and simply illustrated without the explicit pronouncements and exhortations to place them at the centre of our conceptions of an ethical life. Sennett’s suggestion rings clearly in his discussions of apprenticeship and teaching, in his analysis of the personal, committed relationships that exist between craftsman and society, craftsman and materials and amongst experts within and between domains.

Perhaps it is my own crass leanings that make me think Sennett’s “show, don’t tell” approach could have been a little more powerful had he succumbed to some more direct explication of his argument, perhaps in acknowledgement of the characteristics of the literary medium.

Alongside this minor complaint, I would place a slightly more significant one, and that is Sennett’s lack of interest in the spread of individual differences in expertise – not just in capability, but in motivation to become skilled in the first place. He urges us to acknowledge the value of individual effort, but holds back from the complex mire of questions surrounding what distinguishes the development of expertise, the motivation to practice, to learn, to improve, that is immediately apparent to any teacher or parent. Certainly, I believe that the social and cultural context of activity plays a much greater role than many might care to admit, but genuinely individual differences should never lapse entirely from our attention. Hidden in the morass of complexity there is an understanding of what is quite so seductive about the easy life – despite its being so less satisfying. Why is the cheap, the simple, the disposable, so tempting? I would have hoped a full exploration of expertise might give us some hint, to show us the strengths and weaknesses of the phenomenon. And perhaps the answer is as simple as, practice is effortful, and we all have a tendency to laziness, but there’s something a little too trite about such a response. I feel Sennett had an opportunity to get into the question in some depth, but missed it.

Ultimately, The Craftsman is a worthy book, and one that forms the first part of a proposed trilogy by Sennett in which his goal is nothing short of the exploration of the varieties of valued human experience, and lacking a foil or other scaffold it feels a little bit like that – a foundation rather than an edifice. There is still some important lessons to be learned from his warm and respectful exploration of expertise.

Last night the Leviathan Political Cabaret came to Limerick (to Dolan’s Warehouse, to be precise). Leviathan is a project to take political discussion out of the constraining domain of the radio or television studio and encourage people who might not normally take part in such discussions to get involved.

The topic for debate last night was “Can education save Ireland?”. The passion in the discussion. and the number of people there (even if they were mostly teachers), was good to see. Unfortunately though, I found myself unimpressed by the kind of points made, particularly by the panelists. Though the MC David McWilliams did his best to get people to be practical and specific with their suggestions, for the main the conversation was rather high level and heavily dosed with cliché and platitude. The majority, but certainly not all of it, wasn’t much more than a lunchtime bitching session at work.

Nevertheless, even such lunchtime bitching was good to see in a more open and public forum.

One definite bright light came out of the event though, and that is my (long overdue, I suspect) introduction to the Northside Learning Hub. This has been talked about at work a bit in passing, but I was never able to quite understand what it was. It turns out that’s because it’s something new.

The learning hub is a community project that offers opportunities for people of all ages from the surrounding area to engage with the educational resources (particularly secondary and third level) available. Secondary school students and adults take part in projects in collaboration with third level students and teachers, or local professionals, in the relevant discipline. It appears to be a genuine centre in which a person might explore ideas and skills in concert with a semi-structured educational community – the kind of thing that could or should act as a superb complement to the more rigidly structured forms of education that have become so anathema, but are likely to be very hard to shift.

I say complement here, because while I do think the secondary school system appears to be a bit of a mess at the moment, the kinds of broad sweeping transformation of it into a system that teaches (typically unspecified) “life skills” may be missing something very important about the learning of such skills. It takes practice. And effective practice requires structure and routine. While the shift toward more active forms of problem solving and more practical forms of thinking is certainly laudable, it is generally being made by adults who have a host of bedded-in, taken-for-granted skills that only arise because they are so over-practised, but which certainly don’t come without effort.

I suspect that a more effective form of educational system – one that supports the development of human beings rather than workers or students – will involve some kind of marriage between the structure of the traditional classroom and the more interest-provoked, playful exploration of environments like the Northside Learning Hub.

Myself and my wife went to a concert a couple of weeks ago – it was the annual tour of the National Symphony Orchestra, with a performance that began with a Beethoven symphony (No.2) and finished with Tchaikovsky’s 1812 Overture. That makes for a good night by my standards, despite the fact that we lost a Tchaikovsky violin concerto due to the soloist, Nicola Bennedetti, being ill.

In the silences between movements of the symphony though, I noticed something rather interesting (if not exactly surprising).  People coughed. In fact, they coughed quite a lot. I did a bit myself.

Not exactly what you’d call an earth-shattering observation, but when you bear in mind that people didn’t typically cough during the performance itself, I think it suggests something very interesting about supposedly spontaneous action.

Coughing is something that normally comes upon us. Certainly we can and do cough deliberately, but a lot of the time we just find ourselves needing to cough, or in fact just find ourselves coughing. It’s spontaneous.

Was all the coughing in the silences between movements deliberate? Resisted for the duration of the music, pent up, fought, until with the fading of the last few notes finally given release? Though I’m sure there were some people in the concert hall doing just that, to claim that they all were (or even a majority of them) sounds odd to me.

Coughing, experienced as spontaneous, was at least partly organised by the opportunities available to the concert-goers – the silences between movements were affordances for coughing in a socially acceptable manner. This is suggestive to me that even what appear to be passive experiences, sudden unplanned reactions or other forms of behaviour that appear at first glance to be acontextual might in fact be embedded in the web of skills the person has, and is deploying at any given time (and these will include skills with social or cultural aspects).

I made a similar suggestion to this in my D.Phil. thesis, in response to a point raised by the neuroscientist Jeffrey Gray at a workshop some years ago. Arguing against sensorimotor accounts of perception, he pointed out that some things that we experience are not driven by motor actions, but appear to be just foisted upon us. He gave the example of the need to urinate – not something we typically check with a shuffle of our hips across a seat, for example, or a quick press on our bellies. We simply “become aware”. The chair of the session (my supervisor, Ron Chrisley, if memory serves correctly), asked whether Gray had timed his question deliberately for greatest effect -  late in the discussion of a talk, and the break for lunch was imminent. It was made in jest, but was quite an important point. Why is that we become most aware of the need to pee just at the end of a long session, or at the end of a film at the cinema, for example?

The skill of controlling bladder function, and things like coughing, are not just bodily,  but social skills, and both their learning and their exercise are dependent on social context.

Some interesting ramifications for an enactive take on things, methinks. And also some research possibilities (if we could somehow wire concert hall seats with microphones for sound, and survey concert-goers for their experiences of coughing….)

I’ve just received the off-prints of a paper of mine being published in the Journal of Consciousness Studies on perceptual modalities, and what the enactive approach would have to say about the matter. Basically, I argue that there is a distinction between sensory modalities and perceptual modalities, with the latter being complex and structured not by physiological sensitivities but by skills. As a result, the ways in which we often break down our discussion of experience (into the visual, auditory and tactile components, for example) involves unnatural and problematic distinctions. I think taking this issue seriously gives us the means to argue against any simplistic relegation of the enactive approach to the “lower” forms of cognition (perception and bodily behaviour) while keeping the supposed “higher” forms of cognition (reasoning, decision making, problem solving [what are the differences between these things?]) as the province of more traditional, computational and representational viewpoints.

The paper was written some time ago, and I have since been introduced to (and am still becoming familiar with) ecological psychology and some of its various implications (my reviewers must have been as naive to Gibsonian thinking as I was). Ecological psychology is not really mentioned in the paper (Gibson is noted very briefly, but not in connection to the concept of perceptual modalities), and I now consider this an oversight I would like to correct, which is what this post is about (you might consider it an appendix to the paper itself).

In 1966 J.J. Gibson published The Senses Considered as Perceptual Systems. In that book Gibson argues that we should distinguish the senses, which provide the conscious qualities of experience, and perceptual systems, which enable us to explore and pick up information from the environment. (Note that this is not information as a representational or computational theorist would recognise it – it is action-relevant and specifies the relationship between an agent and its environment.) Perceptual systems are integrated sets of sensors and effectors by which the organism controls its interaction with information in the environment.

Perceptual systems are defined by what they do, rather than the set of sensors and effectors involved in them. Gibson (1966) identifies five perceptual systems (see p.50 of the book for a summary table):

  • The basic orienting system, which is involved with bodily equilibrium and is the means by which we pick up information about orientation to gravity, force and acceleration.
  • The auditory system, which picks up the nature and location of “vibratory events”.
  • The haptic system, allows for a variety of different kinds of exploration associated with the stretching and deformation of tissues, giving access to information about shapes, encounters with objects, solidity or viscosity and contact with the ground.
  • The taste-smell system, which gives information about “nutritive and biochemical values.”
  • The visual system which through ambient light specifies all those aspects of the environment that can affect the structure and dynamics of the optical flowfield.

Perceptual systems are active, rather than passive. They enable exploration rather than simply reception, not just the pickup of information but also the changing or ending of that information pickup on the basis of movement and engagement with the flow of the information.

In his definition of perceptual systems, Gibson thus argued in 1966 for a distinction between sensory modalities and modes of perception in a manner somewhat similar to that in my own recent paper. Gibson suggests that it is the perceptual system that allows us to pick up knowledge from the world, while sensory modalities provide for the conscious qualities of that experience.

How does the ecological approach differ from the enactive?

There is one major difference between the ecological approach to perceptual systems as described above and the enactive approach I put forward in my JCS paper. The ecological psychology literature tends to have an emphasis on the general and the universal. The aim appears to be to describe species-typical behaviours, and generalities based on shared embodiment, body scale and other immediately measurable factors.

This focus on the general, I believe, has lead many researchers to overlook the malleability of such perceptual systems. In examining species-typical behaviour ecological research seems often to take the abilities of people as givens in the normal case – we perceive gaps as steppable over, objects as liftable or sittable on based on the “abilities” of the human being (this is true of a number of authors I’ve read, including the likes of Reed, 1996, and somewhat more surprisingly Chemero, 2009). But the abilities of the human being are never static, and never given. They are earned, over years of development and often over hard years of deliberate practice and study. Cognitive psychologists Craig Speelman and Kim Kirsner in their book Beyond the Learning Curve (2005) do a pretty good job of showing that just about everything human beings do (including things we take for granted such as vocabulary) follows a power law of improvement with practice and disimproves without practice. Abilities are rarely, if ever, static.

The ecological psychologist Harry Heft (1989, 2001) does explicitly examine the issue of changing abilities both in terms of development, but also in terms of skill and other transformations of ability (such as how our perceptions change when we get sick and get better). In doing so, I think Heft largely bridges the gap between the ecological and enactive approaches, and I have to say at this point I’d consider his Ecological Psychology in Context essential reading for anyone (but particularly psychologists) interested in the enactive approach. My paper was an attempt to understand the structure or nature of perceptual modalities in an enactive view, but I think it might equally, in retrospect, be an argument about what perceptual systems might be from the point of view Heft’s intentional theory of affordances.

Chemero, A. (2009). Radical embodied cognitive science. Cambridge, Mass: MIT Press.

Gibson, J. J. (1966). The senses considered as perceptual systems. London: George Allen and Unwin.

Heft, H. (1989). Affordances and the body: an intentional analysis of Gibson’s ecological approach to visual perception. Journal for the Theory of Social Behaviour, 19(1), 1-30.

Heft, H. (2001). Ecological psychology in context. London: Lawrence Erlbaum Associates.

Reed, E. S. (1997). Encountering the world: toward an ecological psychology. Oxford: Oxford University Press. 

Speelman, C., & Kirsner, K. (2005). Beyond the learning curve: the construction of mind. Oxford: Oxford University Press. 

Book Cover

This review is long overdue. It also worked out a little longer than I had initially intended, but here it is nonetheless.

It is disappointingly rare to see a psychologist making a genuine attempt at answering a question that is fundamental to the discipline. As an endeavour, Psychology is fragmented, a complex set of balkanised territories within which researchers tend to maintain a relatively parochial mindset. There are historical and practical reasons for this fact, but the resultant effects on the development of theory are deeply regrettable. Running against such standard practice in Ecological Psychology in Context Harry Heft draws on a rich heritage of theory from William James forward in order to tackle no less a question that the nature of the psychological environment. More impressive than the fact that he attempts such an undertaking in the first place is the level of success he achieves, offering a framework that provides a unified way of considering the environment from the physical to the social and cultural that is continuously grounded in the experience of the individual agent. In doing so, Heft provides the ground for a more coherent Psychology, and I suggest an approach that can provide a solid foundation for an enactive Psychology.

Heft’s aim in the book is in fact two-fold. On the one hand is an historical thesis – that the ecological psychologies of James J. Gibson and Roger Barker are direct descendents of the later work of William James, specifically his radical empiricism. On the other is the broader theoretical consideration of the psychological environment.

The historical thesis is interesting its own right, though is more strongly defended in the case of Gibson than Barker, whose relationship with James’s work seems diluted by the influence of the Gestalt school. While the Gestaltists were a strong influence on Gibson also, in his case a single degree of separation lies between him and James, in the form of his too-overlooked doctoral supervisor, Edwin Holt. Heft spends some time detailing Holt’s life and work in a laudable attempt to raise the profile of a man whose influence on Psychology is deeply felt but largely unheard of (he supervised the doctorates of both J.J. Gibson and Edward Tolman, two individuals who make the cut in most undergraduate degree courses). Heft laments the lack of awareness of Holt’s work, the manner in which he was treated by the academic establishment of his day and the way in which that undoubtedly diminished his contribution.

Through Holt, James’s radical empiricism provided a perspective on the mind, perception and the relationship between an observer and their environment that helped give Gibson the rare and productive insight for which he is remembered. In undergraduate Psychology courses James’s work is often described as occurring in two periods – an early psychological period and a later philosophical one. Interest for psychologists largely culminates in his Principles of Psychology with his subsequent work largely dismissed as James becoming concerned with less practical questions (I remember my first year History of Psychology course being taught in just such a fashion). James’s later work, though, was an attempt to lay a solid foundation for empirical science, one that takes as its ground the only thing of which we have direct awareness – experience.

The origins of all knowledge – entities and their relations – are to be found in immediate experience. James did not begin with perceiver and object as discontinuous entities, but with undifferentiated experience; and relations, including the relation between knower and known, are part of immediate experience. This is his philosophy of radical empiricism.

Heft (2001, p.36)

It is difficult to underestimate the transformative power of this kind of thinking on theory and research in Psychology. It is also difficult to figure out just what those transformations might be. Heft tells us that Holt explicitly sought to outline a Psychology founded in radical empiricism and had much to say on the relation between the organism and their environment, seeing psychology not as locked in the skull but occuring in the interaction between the two. His approach was deeply physiological, and he appears to have maintained a rather passive conception of the psychological subject. While the cycle of the interaction between the animal and its environment was a vital point of concern, Holt saw the cycle as initiated by the impact of a stimulus on the organism – something imposed rather than sought. Gibson keeps his focus on the interaction – the relations between the agent and its environment – but has a more intentional view of that interaction, clearly visible through his concepts of egomotion and affordance. Heft emphasises the importance of the acting agent in Gibson’s theory:

[I]t is “I” who is moving through the environment. This is not a Cartesian experience of the “I”, a disembodied entity that is self-aware as it thinks. This “I” is much more concrete than that. It is the source of action and it can literally be seen by the perceiver. It is “I” as purposive agent.

Heft (2001, p.120)

With an emphasis on the interaction between the agent and their environment Gibson is committed to an unmediate, direct perception of that environment. But this direct perception is not a bald writing of the world into the cognitive system. It is direct but not unconstrained or unshaped by the nature of the perceiver. And so we come to a concept utterly central to ecological theories of perception, affordances. Affordances, which have been almost entirely absent from writings on enactive cognitive science, are tricky.

Gibson describes them as follows:

[A]n affordance is neither an objective property nor a subjective property; or it is both if you like. An affordance cuts across the dichotomy of subjective-objective and helps us to understand is inadequacy. It is equally a fact of the environment and a fact of behavior. It is both physical and psychical, yet neither. An affordance points both ways, to the environment and to the observer.

Gibson (1979, p.129)

He could certainly have a been a little bit more clear, but what is obvious is that he is as dissatisfied with the old dichotomies of subjective and objective as anyone working within the enactive approach, and in search of a practical account of perception that avoids such muddled thinking. Of course, just how affordances should be considered has been problematic since Gibson introduced the term, but given their centrality to an ecological account of the psychological environment Heft gives them plenty of attention and through them develops more fully the second aspect of the book – a general theory of the psychological environment.

Within ecological psychology the environment is described not as a set of facts that are given and universal, but rather as a set of relations in which the psychological subject is embedded – that is, your description of the psychological environment must be made with the person (or agent) at the centre, the world described as a set of relations involving them. This means that the person partly constitutes their environment, and every time the relations between them and the world change, the environment changes. Those changes can thus be evoked equally by alteration in the world or alteration in the individual. The sharp distinction we might like to draw between an agent and their environment isn’t there to made. This undermines other ways of describing psychology that require the kind of distinction between stimulus and response that has characterised behaviourism, the cognitive psychology that replaced it and that was so systematically (if not sufficiently famously) demolished as a firm ground for theory by John Dewey in 1986.

The environment is largely a tangle of affordances, then, but without a more worked out theory of affordances that doesn’t get us very far. Heft obliges in two ways, firstly by detailing a concept of affordances that tames the confusion about them and extends the domain in which we might use the idea, and secondly by then tying them into the behaviour setting theory developed as “ecological psychology” by Roger Barker and his colleagues.

Briefly, Heft points out that affordances, being relations that enable particular forms of action by and agent, are at once dependent on the subject and yet independent of them. Affordances are classically body-scale dependent (something affords my stepping up onto it only if the relation between my leg length and the height of the object is appropriate, for instance). Heft points out that they are also developmentally dependent and, more crucially, skill-dependent. Over developmental time the affordances the same object offers will change (they may also change with my health, for example), but affordances will also change with my capabilities. Written English affords reading for me know, but Cyrillic writing does not. The environment is thus partly determined by the subject, but not entirely so. Even if I have not noticed that a particular object affords me stepping on it, it is still a reliable fact that I could step onto it. It is in this way that affordances ignore the traditional subjective-objective distinction.

The inclusion of skill and the development of an intentional theory of affordances plays an important part in avoiding Heft’s view from being compartmentalised, segregated from theories of “real cognition”. The perception and actions involved here are complex and richly laden with meaning for the psychological subject. That complexity is not added after the fact, but is part and parcel of the direct relationship between subject and world described in affordances.

This more expansive view of affordances is thus ripe for synthesis with Barker’s concept of behaviour settings. Barker’s (1968) theory is not well known, and I could not possibly hope to do justice to it in just a couple of hundred words here, but I will try to highlight the salient relevant points for our present purposes.

Through the 1950s and 1960s, well into the 1970s, Barker and his colleagues conducted a mind-bogglingly comprehensive series of studies of the natural behaviours of the population (initially just the children) of a small rural town in the United States referred to by them as Midwest. What the team were attempting to do was observe real behaviours in their natural contexts, in the hope of gaining a more general insight into the relationship between environment and behaviour. This extensive set of observations was prompted by what Barker refers to as a “negative epiphany” – he realised one day on a long train journey that he was one of the leading experts on frustrated behaviour in children but could say almost nothing about under what conditions children typically got frustrated. He had no baseline data.

He and his colleagues rectified the problem, and in doing so came to some staggering insights concerning the relationships between physical and social contexts (what Barker refers to as “behaviour settings”) and people’s actions. Put simply, different social and physical settings afford certain actions, and tend to inhibit or suppress other forms of action. At church, people “behave church”, in the drug store, people “behave drug store”. Behaviour settings are frequently carefully constructed over long historical periods and designed to organise activities. Barker uses the delightful analogy to standing waves in physics. Some situations have associated “standing behaviours”. The “affordances” in question here are somewhat different to the Gibsonian model. They concern not specific bodily movements but rather molar actions – a classroom affords holding a class, not just standing or sitting in particular orientations. What is more, as a person becomes inducted in the use of behaviour settings then situation roles and associated actions are structured by the setting, to such an extent that the behaviour of the people present is better predicted by their presence in the setting than by any specific learning history of the individual person. A society meeting demands a chairperson, and if the regular chair is not present then the structure of the behaviour setting will produce one, even if that person has never chaired a meeting before. If you want to predict and explain people’s behaviours, their context rather than their individual learning histories are your best guide.

Heft’s theory goes into some depth on behaviour settings. How they should be conceived, what kinds of structures they tend to have, the form and importance of different roles and the relationship with the physical setting, all of which we must ellide here. Our focus is on the generic concept of collection behaviour afforded by a given situation, unfortunately termed by Barker “behaviour-milieu synomorphs”.

Heft points out that in a purely Gibsonian view then behaviour-milieu synomorphs and affordances are quite separate – the former explicitly and only relating the available collective actions of a group, the latter specifically about the behaviours available to the individual. Heft argues that this distinction is too stark, however. When the concepts of skills and social interaction are considered, then affordances are not simply structured by individual action but social norms and practices. To give a simplistic example, a menu in a restaurant affords my ordering particular meals, but only when structured within the wider domain of social and conventional norms. On the other hand, behaviour-milieu synomorphs are defined at the level of collective activities, but this doesn’t give us the kind of traction at the level of individual behaviour that we might like. A restaurant affords enjoying a meal with others, but Barker’s theory does not allow us to characterise the behaviour-milieu synomorphs of a given setting in much more detail than that. We can predict molar behaviours, social roles and likely patterns of action, but the specific predictions of behaviours of individuals is limited.

A more developed science of affordances that explains and runs the range from the individual behavioural affordance to the socially structured (and structuring) behaviour-milieu synomorph would offer us a unified theory of the psychological environment. Such a theory has a lot to offer, and Heft goes on to suggest that a theory (combined with other elements I haven’t discussed here, such as a general theory of tools and artefacts) could form the foundation of a theory of meaning.

Though he does not explicitly engage with the enactive literature, Heft’s extension of ecological psychology, his synthesis of the individual and collective and his grounding it all in James’s radical empiricism (everything begins in experience), he has effectively united the two streams of research. As a source of theoretical tools, developed concepts and an introduction to the extant resources of ecological psychology the book deserves a place on the shelf of any enactivist seriously interested in how the approach can be applied in domains of normal human experience – the area so commonly (and wrongly) considered “higher cognition”, from which enactive theories have to date been barred.

Harry Heft will be a speaker at the Enaction Summer School this year, and I am eagerly looking forward to see the meeting of ecological and enactive.

Barker, R. (1968). Ecological psychology. Stanford: Stanford University Press.

Dewey, J. (1896). The reflex arc concept in Psychology. Psychological review, 3, 357-370.

Gibson, J.J. (1979). The ecological approach to visual perception. Boston: Houghton-Mifflin.

Heft, H. (2001). Ecological Psychology in Context: James Gibson, Roger Barker, and the Legacy of William James’s Radical Empiricism. London: Lawrence Erlbaum Associates.

The second memZurich, home to the 2nd EUCognition II network members' meeting.bers’ meeting of the euCognition II research network took place in Zurich on Friday. The thesis for discussion was:

“Cognition emerges during development in a close interplay of experience, of the social and physical environment and of the neuronal mechanisms of growth. An understanding of cognition cannot be achieved without an understanding of the development of cognition. It is thus a necessity for artificial cognitive systems to take development on board.”

Four plenary talks set up the issues and four parallel workshops followed up on each. As is to be expected, there wasn’t much by way of conclusive resolution, though amongst the engineers and roboticists there remained a tendency to believe that while development might be interesting, we’re probably better off just trying to get the specifications right and building to them, rather than trying to grow cognitive artificial systems. At present, it seems a fair point, as no one at the meeting seemed to be able to come up with a single example of where a developmental process has produced a better model or robot than a more traditionally engineered solution.

That said, there wasn’t much agreement on whether traditionally engineered robots were doing a very good job of being cognitive either, but at least progress is being made.

I often find that conferences or meetings like this one are made worth the effort not for the masses of new information or avalanche of relevant research that comes from them, but by one or two things said that act as a stark reminder or a sudden wake up to an ill-seen problem or way of thinking. So it was with the euCog2 meeting.

Linda Smith gave a talk on toddlers’ visual attention and learning which outlined some lovely work examining the role of hands in vision. In relatively natural table-top play with a parent, children things children pay attention to tend to be grabbed and handled. Their short arms tend to mean that handling something will bring it close to the face and also block out other objects that might distract them. Smith suggested that the hands effectively help stabilise the child’s otherwise very dynamic (read: distractable) attention in a way that supports learning about the objects.

One of the points that really struck me though, and is most relevant to the enactive approach, was something she pointed out in the discussion afterward – babies spend the first four months or so of their lives just sitting there. Reaching things doesn’t really start until the fifth month. Now, there are no doubt all kinds of other motor interactions with the world that matter, but it’s an interesting challenge for (rather than to) dynamic sensorimotor theories. This passivity seems to have been selected for, evolutionarily – if so, what’s it doing?

I also thought David Vernon‘s talk a good one. A genuinely enactive roboticist, I had heard of him (he ran the first incarnation of the euCognition network), but hadn’t actually read his stuff before. He was instrumental in the development of the iCub robot, a robotics platform specifically designed to study cognitive development. In particular, some of the issues he is focused on are those that are normally thrown at the enactive approach as counter-examples – things like imagination, anticipation and hypothetical thinking (counterfactual thinking in general, I suppose). Looking forward to hunting out some of his papers and reading a bit more.

0 Moral affordances

Marek to Concepts,Random idea  

I’ve just finished reading the young adult novel The Knife of Never Letting Go by Patrick Ness, which is a superb if sometimes infuriating read. The details of the plot aren’t too important for our present purposes, but a central component of the book is the protagonist Todd Hewitt’s relationship with the eponymous blade.

Not too long into the story Todd finds himself in a situation in which he has to react to a very threatening and violent situation. The title of the chapter is “The Choices of a Knife”, and the dilemma revolves around the affordances of the blade – how it shapes the relationship between the hero and his adversary.

In the cognitive scientific literature, much is made of the use of tools, and the ways in which they transform the cognitive processes of the tool user – usually extending them, making certain forms of action possible that are impossible or more difficult without. For the main part, though, these possible actions are determined by their physical consequences (Dennett, in Kinds of Minds for example, makes the simple point that a person with a scissors is capable of a different set of actions than a person without). The moral facet of the transformed actions in question are not ordinarily examined.

By titling the chapter “The Choices of a Knife”, Ness specifically focuses on the moral aspects of the tool, and gives us these words from the mouth of the first person narration (pp.83-84):

But a knife ain’t just a thing is it? It’s a choice, it’s something you do. A knife says yes or no, cut or not, die or don’t. A knife takes a decision out of your hand and puts it in the world and it never goes back again.

It is as though the morality is not simply in the person, or their intention, or the act, but partly in the tool itself.

Harry Heft (1989, 2001) has argued that affordances are neither entirely out there in the world, nor entirely a subjective matter of perception, but rather a relation between an agent and its environment that holds regardless of whether it is being paid attention to, intended or taken advantage of at any given time. He extends the concept of affordance beyond its normal physical connotations (e.g. that a chair affords sitting, or a particular surface affords walking) into the social domain (e.g. that a given area may be off-limits and therefore dangerous). Heft touches on but doesn’t explicitly discuss the possibility of moral affordances (he mentions, in Ecological Psychology in Context [2001, p.129], that both James and Gibson touched on the idea of an objective world of values).

I find the possibility of moral affordances and an objective world of morality and value intriguing. How would such an approach transform (if at all) our take on ethics and morality as they stand? Any such description of the moral order would demand that we have a proper account of the construction and maintenance of affordances within social domains though. That’s probably a good while off yet.

Dennett, D. C. (1996). Kinds of minds. London: Weidenfeld & Nicholson.

Heft, H. (1989). Affordances and the Body: An Intentional Analysis of Gibson’s Ecological Approach to Visual Perception. Journal for the Theory of Social Behaviour, 19(1), 1-30. 

Heft, H. (2001). Ecological psychology in context. London: Lawrence Erlbaum Associates.

Ness. P. (2008). The knife of never letting go. London: Walker Books.