Difference between revisions of "Bioaffect:Current events"

Latest revision as of 22:26, 22 April 2011

IAT881: BioAffective Computing & Interactive Media

Spring 2011

Dr. Diane Gromala

Structure of class meetings

In each class meeting, unless otherwise noted, we will have:

topics for discussion & readings, assignments, reports, examples (artifacts) and discussion of methods.

Topics

Topics for discussion will be informed by the assigned readings.

I will assume that everyone has a thorough understanding of the readings (or quizzes may result).

We will discuss each topic by traditional means: discussion and textual responses.

For each reading, one of you will be assigned to address the topic by non-traditional, non-textual means.

This may be a video, performance, prank, interactive artwork, computer application, game, sound,

or any other legal means you come up with.

Assignments

Some assignments will simply be turned in, but most will be addressed in class.

Reports

Reports are presentations of issues assigned to you. Examples are a sensory mode,

a technology, an example (artifact, such as an application or interactive artwork)

and ideas for your project. Most should be no longer than 5 to 7 minutes, with 10-15 minutes of discussion or demos.

Basic suggestions for these reports will be provided, but you are encouraged to be creative and experimental.

For instance, perhaps the person who is assigned to report on the sense of hearing may bring in

things to listen to, things that might modify the way we hear, or design a sonic demo.

Similarly, whomever is assigned, say, the biofeedback technology of GSR might set

up a scenario using the technology, and show videoclips from the Millgram experiment.

Week One January 12: Introductions to affective computing, course requirements and each other.

Readings for next week:

The Emotional Self, Deborah Lupton: Introduction, Chapter 1 & Chapter 3 Media:LuptonReading1.pdf

Affective Computing, Rosalind Picard, Introduction & Chapter 1 Media:LuptonChapter1.pdf

Assignments:

1. Add information about yourself and your interests + ideas you’d like to explore to this wiki, in the Community Portal section.

2. Reports regarding “the senses” assigned.

Reporting requirements: Each of you has chosen a sensory mode. For our next class meeting,

bring a 7 page PowerPoint or KeyNote slide set. Be concise -- the words we see should only

be touchstones that help you recall your recently acquired knowledge.

Slide 1: (large) the name of the sensory mode (small) your name, IAT881: Bioaffective Computing, Spring 2011.

Slide 2: An articulation of how the sensory mode works in physiological terms.

Think about how the sensory mode you are covering might relate to other sensory modes. For instance,

touch requires proximity and presence, but vision does not.

Go beyond general assumptions.

For example, many may assume that vision just requires a set of eyes, but the brain is also crucial.

Viscera is very complex, so whomever has this one should probably focus on the enteric system, or refer to Wilson's reading, below.

We will know if whomever covers taste has done their homework if they tell us that we have taste buds

that recognize 4 (not 5) basic kinds of taste. Images, sound, animations, diagrams and videoclips are

okay, but be sure you include proper citations/attributions in small text.

Slide 3: Historical considerations. For vision, for example, some ancient Greeks believed that our eyes

emitted rays. (Note: this slide may likely have some overlap with the subsequent slide.)

Slide 4: Cultural considerations. How was or is your sensory mode considered in diverse cultures

(evil eye, eyes are the windows to our souls)? What role does your sensory mode have in one or

more cultures? (It is argued that some centuries in Western cultures were dominated by

visual or so-called scopic regimes -- what does that mean?)

Slide 5: Find an exemplary artifact regarding your sensory mode. This might be a painting,

videogame, machine, interactive artwork, musical composition, foley effect, CGI,

piece of grafitti, or so on. Choose your artifact to make a point that interests you.

Slide 6: What existing technologies relate to, simulate or address your sensory mode? Tell us

about them generally and specifically. Are there any sci-fi technologies that are interesting? If so, why?

Slide 7: Brainstorm about one project you'd love to create that directly relates to your sensory mode.

Think outside of the box. Don't be shy.

Suggestions:

a) Conduct Ypres-like research about that sensory mode. For exteroceptive senses, a good place to start is to

refer to Diane Ackerman's book A Natural History of the Senses. For interoceptive senses, a good place to

start is to refer to Drew Leder's The Absent Body. You will be confronted with a seemingly insurmountable

task -- to find and plow through an immense amount of information, and to make sense of it in a concise

but not dumbed-down manner. My advice is to maintain a hard-core, laser-like focus. Find the information

you need in the burning building, grab it, and get the heck out. One aspect of this assignment is for you to

figure out ways to quickly locate the best, most up-to-date knowledge from diverse domains, to determine

who the major players (theorists, scientists) are, what the main issues are, where exemplary works of

art, design, media or computing are, how to digest it all, and how to brainstorm ideas about that sense modality.

These are incredibly important skills.

b) Assume that you will have 30-45 seconds per slide, on average. Your report (slide presentation) will be

followed by a discussion, so use your reporting time in a concise manner. The rest of us will likely

expand upon what you have presented.

c) You can't possibly cover everything, so don't try. You DO want to make an incredibly well-informed

presentation, and you DO want to communicate the most important information. But at many points in

this process, you will have to make important decisions about WHAT is important and WHY it is important.

That's part of the assignment.

d) Often, it is easier to gain an understanding of how something works by looking at examples

of dysfunction, or so-called outliers. An example of this is the work of someone like Oliver Sacks.

e) You are strongly encouraged to enhance our understanding by helping us get our hands dirty as it were.

That means you are encouraged to bring stuff in, have us do things, or otherwise find ways to make

your information come out of the textual box. Remember that you don't have a lot of time, however.

One idea is to augment just ONE slide with something in the material world. For touch, for example,

you might consider bring in things to touch, or a technology that affects the way we experience touch.

f) Have fun. This stuff is really interesting. Seriously.

g) Remember, strategic risk-taking will be rewarded, in heaven, on earth and in class.

Week Two January 19: The Substrate of Sensory Experience: Intero- and Exteroception

Topics for discussion:

• Affective Computing, according to Picard

• Exteroception (Seeing, Tasting, Touching, Hearing, Smelling) and

Interoception (Proprioception, Temperature, Pain, Orientation, Kinesthetic Sense, Visceral Sense)

• Technologies related to affective computing: biofeedback, (and possibly: GPS, accelerometers)

Readings for next week:

1. (re-read Lupton)

2. CHI Paper: Humanities: Feminist HCI: Taking Stock and Outlining an Agenda for Design; doi: 10.1145/1753326.1753521

Media:Feminist_HCI.pdf‎

3. CHI Paper: Scientific: Predicting tie strength with social media; doi: 10.1145/1518701.1518736 (sent via email)

4. Barnes: "The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression" (sent via email) http://journals.cambridge.org/action/displayIssue?iid=7947586

Assignment:

Conduct an “autopsy” of the "Feminist HCI" and the "Predicting tie strength" papers.

For this first assignment, we will examine 2 papers that received best paper awards.

(For the next assignment, papers will come from more obviously different knowledge bases and fields.)

Bring the results of your autopsy in a form that can be easily shared with the rest of your colleagues in class.

The term autopsy: "to see for oneself" (Ancient Greek)

Goal: to uncover reasons why each paper was deemed to be a good paper, and to formulate reasons

for why each paper was recognized as a "best paper" by CHI decision-makers. It is assumed that few

of you are privvy to the internal politics or extenuating circumstances for best paper decision making.

This is loosely based on criteria used for judging academic papers generally, and much of it pertains to non-academic papers as well, so you will doubtless find pragmatic use for this exercise.

Directions for conducting a forensic autopsy (assume you are a SIAT-CSI):

1. Assess overall context: you know that each paper received the best paper distinction from the CHI conference.

Each of you have varying degrees of knowledge about that conference.

1.1 Articulate what you know and what you have discovered about that conference. (Given time constraints, it may be useful to ask

your colleagues and faculty members, to visit CHI's site, and to visit the URLs that lists best paper awards

for the past few years. http://jeffhuang.com/best_paper_awards.html,

http://www.chi2006.org/bestofchi.php, www.chi2007.org/pressroom/0425-best-papers.pdf

1.2 Make an initial assessment about factors that may have played roles in the decision to recognize each paper as "best paper."

2. Identification.

2.1 Who are the authors?

2.2 What factors may be associated with assessing their credibility?

2.3 What is the subject of the paper?

3. The Y-incision:

3.1 Why may this subject be relevant to the CHI community?

3.2 Is the subject innovative, original or one which may have only been rarely addressed before? Does it provide new insights? If yes, articulate your reasons; if no, articulate your reasons.

4. Structural integrity:

4.1 Is each paper technically sound? While you may not be familiar with this field, look for clues anyway.

Is the technology dated (look at the citations)?

Do you see the terminology elsewhere on the CHI site or in a CHI search? If the technology is experimental, does it seem realistic and doable?

(If the authors describe, say, a computer based on DNA soup or on jet-pack technology, or if such technologies are not visible in the citations, the answer is probably no.)

4.2 Is the article structurally sound in terms of readability, structure of argument, grammar and use of images & graphics? Taken together, these should promote comprehension, even if you are not an expert.

5. Assessing major organs:

Does each component make sense or cohere?

Are the claims backed up by appropriate citations? Every claim needs to be supported unless it is "common knowledge."

Is there a component that leaps out at you because it is exceptionally confusing, not backed up, not articulated well, too broad or too specific? Or does it just not seem to fit? Often, even good papers have problems (or "issues") -- usually one glaring issue that needs to be addressed by rewriting and resubmitting. Is there an identifiable weakness? If so, what is it?

If possible, it may be helpful to structure your answers in parallel columns, or on two parallel pages, one per article.

You may use words, phrases or bulleted lists for some of your answers, but use sentences when you need to really explain something in detail.

Remember, you are to read (and re-read) and assess the "Feminism HCI" and the "Predicting Social Tie Strength" articles, NOT the "Simulation of Smiles" article. The more effort you put into this, the better your results will be now and later. Like a new CSI (crime scene investigator), you are expected to use specialized tools and methods -- in this case, to search for information elsewhere. Over time, this becomes a habit, but you will almost never judge a paper simply by reading it, especially when you are in interdisciplinary realms. Knowledge is constantly updated, so even the most prominent specialists habitually make sure that they keep current with knowledge in their field (in some fields like medicine, one needs to regularly accrue continuing education credits and certification), scours journals and databases and generally seeks knowledge for pain and pleasure.

GRADING: I will take your background and current knowledge into account, but I expect everyone to demonstrate that they have made serious efforts. Thus, answers such as "this is crap," and "I disagree with the basic premise," and "I have no idea how to even begin to figure this out" will doom you to the depths of very bad grades.

Like the grading schema you witnessed during the slide presentations, grades in the realm of an A mean that you not only do the assignment, but that you do it exceptionally well and go beyond the instructions. Some of that is sheer insight and being able to make profound connections, while some of it means you've spent hours slogging through information, and/or you demonstrate superior investigative techniques -- like finding experts for advice or sending the authors or editors a friendly email. (Note: busy people will generally not reply to emails unless you provide them with a reason to do so, and make it easy for them to do so. So asking them open-ended questions usually won't elicit a response.) Grades in the B range mean that you have done a good, solid job.

Note: As witnessed in the slide presentations, you may choose a relatively "objective" stance, or you may choose to integrate knowledge you are expert in, or you may choose a position (point of view) that may not be obvious or usual. That is encouraged -- it just has to be relevant and really good. Contrary to popular belief, you CAN follow the assignment specifications AND be creative. And stay within presentation time limits.

Week Three January 26: Biopsychology of Emotion

Guest lecturer: Dr. Steven Barnes, neuroscientist, UBC (sjb@nervouscreation.com)

Discussions:

1. Lupton: Discussion leaders: Veronica & Jay

2. Biopsychological Theories of Emotion: Dr. Steven Barnes Reading: Simulation of Smiles: http://journals.cambridge.org/action/displayIssue?iid=7947586

Please send your autopsy assignments to Dr. Gromala via email. Due: Wed. Jan 26th, 5:30pm. Don't forget to title the email, beginning with BIOAFFECT.

(NOTE: slide presentations from Daniel & Andrea will be forthcoming.)

Week Four: February 2 biofeedback basics & review

Discussions: Review: Lupton & Picard: What counts as "emotion"? Mood? Affect? Temperment? + Barnes' reading

Biofeedback demos: GSR, how to read GSR & EEG biofeedback data (usually expressed as waveforms)

Readings for this week:

Picard, Affective Computing, Chapter 2

NOTE: We will be reading most of Picard's book, so it would be a good idea to plan to read 2 chapters per week (say, during the reading break).

Week Five: February 9

Class Trip: Vancouver Aquarium, SEE THE 4D Show: www.visitvanaqua.org/news/4D

Note: the show runs every 20 minutes or so in the afternoon. www.visitvanaqua.org/visitors/show-descriptions

THE DOORS CLOSE AT 4:45pm, & the LAST SHOW TIME IS at 6:00pm -- be sure to bring your student ID.

Assignment 1: Write a one page paper about the so-called "4D" aspect of the show, roughly in 500 words or so.

Your paper should include a concise description (1 paragraph) of the show, and should be an analytical. Bonus points: add a paragraph of what you WOULD do to create a more affective experience (define), with any technology, real or imagined.

Assignment 2 (self-monitoring prep):

a) Find 3 examples of art or art+science projects that demonstrate an area of self-monitoring (see: quantified self.com, Dunne & Raby or Scofidio & Diller for starters). Write a list and provide URLs or book, article or movie titles where possible. For each, provide a one sentence description of what was monitored, how/what it was mapped to, and what it resulted in. Add a sentence about what you thought was interesting about each one.

b) Explore (20) self-monitoring technologies. At least half MUST be outside of the box of "norm" (i.e., commonly considered self-monitoring technologies like commonly available pedometers, biofeedback). Make a list of at least 20 (you'll hit a wall at 10, but it will open up when you hcange how you think about them). Describe, in a phrase, what the technology measures so that any of your colleagues would understand it if they read it with your verbal explanation. To jog your habits of thinking, refer to MIT's Media Lab, any scientific lab that deals with animals (your list is about self-monitoring technologies, but many analyses of animals apply to humans; don't forget that we are a host and have close links to other species), and Theo Gray's book Mad Science (available at Dr. Shaw's desk).

c) Think about (10) connections between self & world, and how when you self-monitor, you MAY be consciously or not consciously affected by moment-to-moment changes in your not-self context (world). Make a list of 10 aspects of world, from phenomena to places, states, effects or zones. What aspects of your "external" world are you interested in? Things you can't see, like radio, gamma or EMF waves? Bacteria that live on your eyelashes (is that itch from something that is on your skin?). Or, why are some places so seemingly "creepy" that your fine body hairs stand up, while others are not -- is it all in your head? Electromagnetic vibes from earthquake faults? Concentrated pressure systems? Ectoplasm residue from ghosts or jellyfish? Static electricity? Subtle oddities in light and atmosphere? Petro deposits? Insects? Subsonic noise? This part of the assignment is more speculative -- a technology to measure phenomena may not exist. It might be useful to think about specific places and ask why you may respond to them, and think about technologies that may measure phenomena that are not (easily) perceptible.

BOTH ASSIGNMENTS ARE DUE IN EMAIL FORM: February 16 5:00 p.m. (via email), include BIOAFFECT FEB.16 in title of email.

Readings for next week:

Picard's Affective Computing, Part I

Week Six: February 16 READING BREAK

Self-monitoring project: investigate a monitoring technology and design a self-monitoring project.

Readings for next week:

Finish reading Picard's Affective Computing book. Concentrate specially on the technical chapters in Part II.

Assignment for next week:

1. Be prepared to explain what a sigmoid is and why it is important when designing an affective computing system (Rafe's example would do).

Be sure you understand the different wave forms, what they represent (p.157), and what they are measuring and in what units (microvolts, %reflection, % max.expansion,microSiemens).

2. Develop and roughly flesh out ideas for your class project. Each of you will be required to discuss them in class next week.

The more developed the idea, the more useful feedback will be for you. (You can work with a colleague or two. Group size limit is 3 people, unlimited other organisms.)

Week Seven: Feb. 22: Catch-up

Initial project ideas articulated.

Week Eight: March 1:Catch-up continued

First half of class: Assignments discussed; examples of bioaffective art, self-monitoring projects & technologies.

Picard reading part 2

Second half of class: testing technologies & discussing projects as they evolve.

Readings for next week:

Farquhar's, Beyond the Body Proper, Introduction (available online at Google Books - with some pages missing: [1]) Also, PDF: Media:Lock_Farquhar_Intro.pdf: Gromala

Springgay: Fantastical BodyMedia:Fatastical_body_small.pdf Lonnie

Noe: Out of our HeadsMedia:Out_of_our_heads2.pdf D'Arcy

The Body: Orlan: D'Arcy

The Inner Touch: Of Flying Animals (Ch 21) D'Arcy and Jay

The Inner Touch: The Anaesthetic Animal (CH 24) Tyler

(note: the last 4 essays are very short but meaty)

Week Nine: March 8: Beyond the Normative:Disabilities, Synesthesia & (co-)adaption

First half of class: Discussions: readings, bioaffective art & technology examples continued

The Inner Touch: Of Flying Animals (Ch 21) D'Arcy and Jay

Discussions: Humans and their technologies.

Second half of class: MODELLING & CREATING ABSTRACTIONS + Terry will bring in different film/video clips to discuss the rhetoric of his project

Readings for next week:

Psychosomatic: Stress & Neurobiological Kindling: Terry

Week Ten: March 16

Discussions: Psychosomatic: Stress & Neurobiological Kindling: Terry

The Body: Bodies, Disabilities: Terry

Models of emotion, mood, temperament, DGr

Models of temperament, in-class assignment.

Heller-Roazen: The Inner Touch: The Anaesthetic Animal: Tyler

Picard: Part 1: Mark

Picard Part 2: (Ch.5 Affective Signals & Systems) Jay, Veronica, Lonnie, Daniel

The mechanics of detecting and expressing emotions on three levels:

Low-level = direct sensors Mid-level = abstract combinations of sensors high-level pertains to the level of analysis, concepts which power connectionist networks

Readings for next week:

Picard Part 2: (Ch. 6 Rec. & Expressing Affect) Jay, Veronica, Lonnie, Daniel

Week Eleven: March 23: Body Image/Body Schema; Habituation, Healing: Shamanism, CAM

Discussions: Picard Part 2: (Ch. 6 Rec. & Expressing Affect) Jay, Veronica, Lonnie, Daniel

MODELING & SYSTEMS: extreme parameterization or different paradigms (brief history of AI)?

Readings for next week:

Picard Part 2: (Ch. 7) Jay, Veronica, Lonnie, Daniel (Ch.8 Wearables+) Suk Kyoung

Models for affective behaviour: expressing emotions through combining modalities (i.e.: voice, facial, HR, context). It also aims to adaptation to new theories on mixed, blocks or granularity of constructed emotions; a higher step is on predicting what emotional state comes next.

Haraway, Cyborg Manifesto: Terry

The Taboo of Subjectivity Scientific Paradigms: Intro & Chapter 1: Suk Kyoung & Lonnie

(note on this reading: identify the 4 basic approaches)

Week Twelve: Medical Technologies & Affect

Discussions: Haraway, Cyborg Manifesto: Terry

Picard:

Models and learning: the influence of emotion in memory and performance. Backpropagation as the emotional energy being attached to an association, its roots are in Freud’s cathexis to objects.

Scientific Paradigms: Intro & Chapter 1: Suk Kyoung & Lonnie

1. Medical Frontiers: Research re: brain-computer interfaces, drug delivery technologies, genetics, nanotechnology. What do they have to do with affective computing? (biomarkers of affect, defined as the miliseconds of pre-conscious "registering" or response)

2. CAM (Complementary & Alternative Medicine) Varela & Kabat-Zinn (research studies that convinced medical researchers & physicians)

3. CLASS PRESENTATIONS: (be prepared to "map" your project to Picard's model)

Week Thirteen: April 6 Review & Archiving, Wet & Dry

Course Review

5 CLASS PRESENTATIONS

FINAL PROJECT ARCHIVAL INFORMATION TURNED IN, IN CLASS.

Be sure everything is labelled and dated. No label, no grade.

Required Readings for the course

Picard Affective Computing, http://troy.lib.sfu.ca/record=b1876254 (Full text available online) The basis for all discussion, updated research and extensions of her model.

Lupton: The Emotional self : a sociocultural exploration, http://troy.lib.sfu.ca/record=b1904667

Farquhar: Beyond the Body Proper, Introduction (available online at Google Books - with some pages missing: [2]) Also, PDF: Media:Lock_Farquhar_Intro.pdf: Gromala

Noe: Out of our Heads Media:Out_of_our_heads2.pdf D'Arcy (we do not = our brains)

Massumi: Parables for the Virtual: Movement, Affect, Sensation http://troy.lib.sfu.ca/record=b2483710 (Full text available online)

Niedenthal: "The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression" http://journals.cambridge.org/action/displayIssue?iid=7947586 (measurable microexpressions)

Springgay: Fantastical Body Media:Fatastical_body_small.pdf Lonnie

Springgay begins by discussing different approaches to the study of body image. She says that researchers neglect the embodied nature of body image and tend to express body image as a discrete concept that can be examined in separation from lived experiences. In contrast, the author describes body image as an awareness of our own bodies and their relations to gestures, movements, other bodies, objects, and the environment. She also includes the sensations of our own bodily functions in her concept of body image. Springgay's main point is that new models and methods of studying body image that view it as dynamic and shaped through our interactions need to be developed. She believes in a discussion of body image through "pedagogies of excess," and to that end, she offers the idea of the "fantastical body." The fantastical body is full of potential and is made up of processes instead of substances. She describes other views of body image as goal oriented in that they are about "maintaining equilibrium," and in contrast the fantastical body is trying to modify and create. Integral to her theory of pedagogies of excess is the importance of knowing that we are constantly becoming and always incomplete. She draws comparisons between her concept of the fantastical body and Deleuze and Guattari's concept of the Body without Organs. The BwO is described through the metaphor of an embryonic egg which has no boundaries and represents potentiation. In becoming an individual, change is constant and there are various forms which could always have been otherwise.

Wilson: Psychosomatic: Feminism and the Neurological Body, Chapter 2: The Brain in the Gut http://troy.lib.sfu.ca/record=b3617961 (how psychiatric disorders have biomarkers, effect bio)

Suggested Readings for the course: Intero- and Exteroception

The Absent Body, Drew Leder http://troy.lib.sfu.ca/record=b1465856 (autonomic senses, CNS)

A Natural History of the Senses, Diane Ackerman http://troy.lib.sfu.ca/record=b2461966 (basics of each exteroceptive sense, i.e., the 5 senses)

Suggested Readings for the course: Beyond the Norm

The Mind's Eye, Oliver Sacks http://troy.lib.sfu.ca/record=b5664168 (what "outlying" or non-normative conditions can teach us)

Suggested Readings for the course: technologies

Physical Computing: Sensing and Controlling . . . , Tom Igoe and Dan O'Sullivan http://troy.lib.sfu.ca/record=b3872653 (Full text available online)

The Affect Theory Reader, Melissa Gregg & Gregory J. Seigworth, eds. http://troy.lib.sfu.ca/record=b5532632

The Taboo of Subjectivity: Toward . . . B. ALan Wallace http://troy.lib.sfu.ca/record=b2137665 (Full text available online) (how different scientific fields deal with emotions, moods & temperament)

"'Thought Technologies Manual"'

http://www.thoughttechnology.com/pdf/manuals/SA7560%20Rev%203.pdf

Interesting Readings?

10 Most Bizarre Scientific Papers

http://www.oddee.com/item_90683.aspx

ASSIGNED READINGS: BRIEF ANNOTATIONS

Everyone should write a very concise paragraph covering the reading -- somewhere between a dictionary and encyclopedia entry.

If you share a reading with another student, you should collaborate on the entry.

Goal 1: to be a resource for all students in class

Goal 2: for you to inculcate the reading

Goal 3: for you to speak in every class "as" the author(s) assigned to you. I.e., "Author X would say . . . "

example: (Veronika & Jay)

Lupton, The Emotional Self: Jay and Veronica

Lupton asserts that emotions have been historically been viewed as embodied sensations, so they were (and still are) are considered to be the antithesis of reason and rationality (p.3).

Lupton's main aim is to discuss how emotions contribute to our sense of self. In doing so, she covers many divergent theories of emotions.

In the first chapter, she divides knowledge about emotions into 2 major areas:

1. emotions as inherent: humans have a set of basic emotions, even though the expression of them may vary according to culture & history

• emotions are generally viewed as:

genetically inscribed, inherited rather than learned (positivist, essentialist, organismic)

linked to physiological changes, the result of stimuli

instinctive reflexes ranging from uncontrollable to moderately controllable through willpower/self-control

• evolutionary psychologists: the function of emotions for survival & continuation of the human species

• inherent perspectives connect to this idea of emotions being "animalistic" tendencies, implying that emotions should be suppressed for a progressive society.

• Cognitive theorists: the interest is on the interrelationship among bodily response, context & individual recognition/awareness; emotions are viewed as coping mechanisms

• William James: physical responses precede the emotion, interpreted based on judgement of a situation

The citation of Mesquita and Frijda suggests theories which connect an emotion to "preparation for action". They boil emotion down to an evaluation of events, their valence, their controllability, etc. which is a very functional approach to the concept.

 - This area ties directly to the idea of "behavioural ecology", completely lost on this author.
 - Evolutionary adaptations which start for one purpose can become appropriated - discussion is missing here!

The philosophical approach to truth about emotion is practical, but the power of cognitive models to predict is omitted completely from this article.

 - The authors should mention the practicality of cognitive science, for technology, therapy, diagnosis, etc.

2. emotions as sociocultural constructions:

Emotions are phenomena that are shaped, experienced and interpreted through social and cultural practices (p.2).

"Weak thesis" (Kemper): some emotions are universal, some acquired by socialization, & universal emotions can be altered through socializing "agents"

 - When we discussed this in class, most of us agreed that the weak sociocultural approach seemed to be most intuitive.
 - We also discussed how the "weak" vs. "strong" nomenclature is a bit biased; the author is having a hard time presenting a neutral case.

"Strong thesis": emotions are irreducibly sociocultural products, entirely learned and acculturated; purely contextual; intersubjective rather than individual experience

Harre: there is no such thing as an emotion, only multiple ways of acting & feeling in a bodily way; one "does" rather than "has" an emotion; self-assessment plays a role

Cultural anthropologists (Heelas, Lutz): strengthen the sociocultural direction by doing cross-cultural analyses & demonstrating major emotional differences in diff. groups of people

Social historians (Stearns): strengthen the sociocultural direction too, but in this case, longitudinally: demonstrating the dynamics of emotion through different eras (i.e. Victorian domination of grief)

Structuralists (such as Durkheim): examine the bonding nature of rituals "collective effervescence"; social order is not just rational, but underpinned by affective/social ties

Phenomenological Approach: a person's interpretation of bodily sensations are the emotion, NOT behavior or awareness of physiological changes

Picard Affective Computing: Part 1: Applications (+extend): Mark

Picard defines affective computing as: artificial intelligent systems that can detect, evaluate, and process emotions. It is a human-computer interaction that includes 'sensing and reasoning context' that is derived from emotional influences.

In the book, Picard provides examples of how we can implement affective computing in various fields such as learning, social development, entertainment, preventative medicine, and consumer products. A few examples are: embedding emotions in learning, gaming that measures performance using biofeedback, healthcare specifically helping people with autism by providing feedback using their emotional responses, and software applications such as incorporating social human emotions into digital communication. Picard also points out that no application can solely be based on affective computing. It has to be associated with other tools such as the user interface or computer vision.

Issues related to emotion recognition: -how we express emotions has a broad range and the meanings or modalities vary across cultures, gender, and age. Restrictions on accessing emotions is a concern as well for example it depends on the level of neural brain activity and biological configuration. According to Picard, being able to accurately interpret and define this level of complexity is highly unlikely.

-the other difficulty is how we interpret our emotions and the variability that exists amongst individuals. Also our emotional circumstance tends to rapidly change from one state to another and this minimal latency between the shifts will be difficult for a system to interpolate.

Picard Part 1: Potential Concerns (+ Turkle handout): Terry

In Chapter 4 of Affective Computing Picard discusses some of the potential drawbacks to affective computers and how to mitigate or counter these drawbacks. The areas of concern she identifies are expectations in interfaces, privacy, accuracy and objectivity, symmetry in communication, centralized recognition and control, computers acting emotional and responsibility and computer rights. She finishes by addressing issues that designers of affective machines should address:

1. Expectations in interface - computers have the potential to mislead us - we expect human-like intelligence, understanding and actions. But affective machines may be only simulating emotion or may be faking emotions (e.g., empathy). Also at first, computer expression of emotions may be crude - "agents with faces that are distracting, machines with too much vocal inflection, icons that amuse you with their expressive motions for the first week, but annoy you a week later, and so forth."

2. Privacy - affective computers can gain access to our emotional lives, and this data could then find its way into the hands of potential employers, ex- and future lovers, lawyers, insurance companies, etc.

3. Accuracy and Objectivity - humans are not perfect at recognizing emotions, can we expect computers to be any better? We tend to believe computers are objective, but they are programmed by people who have their own biases.

4. Symmetry in communication - we need to be able to see what emotion our computer thinks it senses in us. And what about workplace monitoring? Should a workplace computer be able to report to your boss that you are feeling disaffected or surly?

5. Centralized Recognition and Control - could emotive data be centralized and used by large corporations, governments, hackers, etc.?

6. Computers acting emotionally - should computers be allowed to express all emotions? What about rage? grief? disdain? Would a suicidal affective machine cause harm in its despair?

7. Responsibility - is it always possible for humans to be in control of human-machine systems, especially if the machine has emotions?

8. Computer rights - if a computer has emotions, should it have rights?

9. Design issues - Picard identifies privacy, multiple channels, valence, contagion, awareness, emotional hijacking and emotional range as issues that affective computing designers need to consider. The default, she suggests, could be the human paradigm, but she suggests there are other models that could be used.

"Programmed for Love" (Young, Jan. 14, 2011, The Chronicle Review) presents a different view of the potential downside to affective machines. Though Picard discusses the potential dangers of affective computing, she believes that, on balance, emotional computers would be beneficial for humanity. Her MIT colleague Sherry Turkle, according to this article, does not share this belief. Turkle feels that sociable robots have "seductive and potentially dangerous powers", that they are demeaning and damaging to our collective sense of humanity. “We have invented inspiring and enhancing technologies, and yet we have allowed them to diminish us," she says. She also feels that providing robot companions to the elderly, the lonely, to children is to give up on them. Humans need to take care of each other, not to delegate that role to machines. Whereas Picard's view of the dangers is that they are all addressable, Turkle, according to Young's article, believes the very concept is deeply flawed.

Picard Part 1: Emotions are Physical and Cognitive: Daniel

Picard Part 2: Affective Signals & Systems: Veronica, Jay & Daniel

Picard is going to describe the mechanics of detecting and expressing emotions on three levels. Low-level, mid-level and high-level... this dimension pertains to the level of analysis. Whereas low level are direct sensors, mid-level are abstract combinations of sensors, and high level are concepts which power connectionist networks.

Another dimension is the emotional state of the perciever, this can affect which emotion is interpreted. Bottomup and topdown influence on perception of emotion.

Context is also important, one may have the same emotional physiology in different contexts for different reasons. Emotion is not only bottom-up (from signals to symbols) but also top down.

Bell is a physical metaphor for emotion. Curved response. Successive strikes are cumulative. Different bells respond differently (based on "temperament").

Linear, time-invariant system are easy to understand. Picard suggests that computationally modeling people would depict them as neither. Instead, parameters which change over time and person would be defined to control the basic response curve (sigmoid).

Picard models emotional response as a sigmoid. As events happen the response strengthens but it hits a ceiling. The threshold, gain and ceiling are all dependent on context, personality, mood and other factors. So the sigmoid is the proximal emotional response, while the contextual properties and dimensions of the sigmoid are controlled my mood, among other things.

Context is plausible in the proximal, but long-term moods still remain fairly nebulous. Picard suggests some constant monitor of every event and input may be able to simulate it and affect the sigmoid.

Picard acknowledges that valence and intensity is a simplisitic model. She suggests that multiple parallel sigmoids could represent a wide range of emotional dimensions which may or may not affect eachother.

The sigmoid based system represents response decay, repeated strikes, temperatment, nonlinearity, time-invariance, activation, saturdation, feedback, mood.

Picard then discusses physiological signals and how they correlate to emotion. She is defining a gap between these correlations and models for emotion, and depicts them in a way which implies that it could eventually be filled.

Picard Part 2: Recognizing and Expressing Affect: Veronica, Jay & Daniel

This chapter aims to shed light onto affect recognition (as a pattern recognition problem) and affect expression (as pattern synthesis).

Setting expectation to the capability of recognition of the system is relevant. It'd be satisfying if it can recognized as well as a person; if wearable clothing (physiology) is used the recognition should be higher.

Representation of emotions can be divided into discrete emotions (i.e. basic emotions) or continuous (i.e. arousal-valence). Both models have uses and limitations, and are concise.

Another distinction is universal and person-specific (same physiological response versus difference of emotion defined, elicit, and expressed). Affective computing is first person-specif, and second universal (examining individual data to see common patterns).

Picard highlights the tension between pure or mixed emotions, she uses the metaphors of microwave (pure states alternating) and hot tub (new state from the mix). Picard also notices that when mixing emotions inhibiting can occur (i.e.: lying might inhibit love).

Picard presents low and mid-level models for pattern expression and recognition. The "best" model depends on the task.

Facial expressions: the most visible and easily controlled. Discrete and pure model. Underlying theory is Facial Action Coding System (FACS) by Ekman and colleagues, which relates emotions to muscular movements. A second variant in facial expression is by identifying motion energy. The relationship to temperament is still not investigated.
Vocal intonation: how we say things; cues on what’s important and our affective state. Some aspects considered speech rate, pitch, voice quality. These can be consciously controlled but less than facial expressions. Affect editor is a program to ‘read’ sentences with affect. Recognizing is more difficult, even for people (60% of reliability), recognizing arousal better than valence. Context is very powerful.
Combination of facial and voice seems to be promising since arousal is easier recognized with voice and valence with facial expression. But it’s challenging facial recognition with talking because of the mouth movement.
Physiological patterns: computer monitors multiple signals such as EMG, GSR, BVP, respiration. Deciding which features of the signals to analysis is an art, according to Picard. It is also an open question which combination of signals are the best indicators for affective change.
Models for affective behaviour: expressing emotions through combining modalities (i.e.: voice, facial, HR, context), it also aims to adaptation to new theories on mixed, blocks or granularity of constructed emotions; a higher step is on predicting what emotional state comes next.
Models and learning: the influence of emotion in memory and performance. Backpropagation as the emotional energy being attached to an association, its roots are in Freud’s cathexis to objects.

Picard Part 2: Emotional Synthesis: Veronica, Jay & Daniel

This chapters moves up from low-level signal processing and considers the role of pattern analysis in emotion detection.

Again, as in Chapter 4, Picard suggests we can't directly observe emotions from the outside... Green would argue (part-whole)

Picard looks through a wide range of emotional theories which suggest a few basic emotions, and some theories which suggest "dimensions" of emotion (Arousal (calm vs. excited), Valence (negative vs. positive)).

Picard acknowledges different theories of emotion, but suggests that these models will be useful for representation : even if they turn out to be an oversimplification.

Patternmatching lies in the chasm between individual person-specific emotions and universal patterns.

A key question is whether emotions are mixed or pure. How is a state of multiple emotions represented? This is important as we are not likely to get pure emotions from users of affective computers.

Facial recogntion is a prototypical example of pattern analysis being used to model emotions (ekman, etc.). Another example is the synthesis and recognition of affective vocal intonation. Picard reviews work in both these domains in detail.

Roy and Pentland are studying whether vocal utterances are generally approving vs. disapproving using audio measure (mean frequency, harmonic ratios, etc.) - high accuracy was found.

Given the promise in all this work, a future direction is the combination of face/voice for more conclusive recognition. The McGurk effect shows why this is a powerful process and similar to how humans perform it.

Picard used a series of physio sensors to read emotions over time and found significant predictable patterns for emotions

Hidden Markov Model estimates probability of emotional transition based on observation... what are the probabilities of moving from joy to sadness vs. interest to sadness? Here we're goin up a level in analysis: you could better identify ambiguous physiological state by knowing previous states.

Interesting that Werbos came up with backpropogataion in connectionist networks based on an emotional idea from freud: freud saw emotions flowing back through cause-effect relationships (if waiting in line leads to a packed club which is happiness, then waiting in line gets associated with happiness too... the emotion back-propagates).

Picard Part 2: Affective Wearables (+extend): Suk Kyoung, Mark

Picard’s ‘wearables’ are computational devices worn as an article of clothing or jewelry that are affectively aware of their host and surrounding environment (in a friendly, attentive, or assistive way), are non-invasive, comfortable, and voluntary in their deployment. Affectiveness is described as the identification and reproduction of patterns in biometric data that are interpreted as indicative of human emotional involvement with stimulus and context. Picard reminds us that bad interface design “will not be easy to tolerate with a system that you cannot get up and walk away from.” Picard clarifies that research experiments in Emotion Theory to date have a certain “internal validity” (repeatable results in the lab) but that most cannot claim to have any “external validity”, that is, “validity to real life experience”. Picard refers to one study suggesting that some theorists believe that real-life observation of emotion theory is impossible (Wallbott and Scherer, 1989). It is noted that we are beginning to see the influx of mobile and ubiquitous computing wearable computing in various commercial applications (FedEx deliveries, service industries, utility companies…not to mention the smart phone). Picard suggests that because music is the ‘most socially accepted form of mood manipulation’ that a personal DJ would be one suitable application of affective technology, although the association of the validity of this idea with claims by the MUZAC corporation for effective affective response from shoppers and workers may require further substantiation. The system would monitor biometric data, user choice history and associated context, to build affective profiles of their music preferences and suggest current programming. Potential issues are addressed with acknowledgment that some manual input (key words) are likely to be required, and that contextual pattern recognition (techniques known as collaborative filtering) may be used to improve affective response accuracy. Picard proposes that it may be possible to augment human memory through a combination of technologies of constant surveillance and relational affective patterning, coupling ideas of Steve Mann’s WearCam with affective computing. Eidetic (‘photographic’) memory is linked with emotionally significant events in the theory of “Flashbulb memory” (Brown and Kulik, 1977), and Picard draws from this the idea of ‘affectively indexed’ memory banks, extending Mann’s WearCam to include “not just video imagery, but simultaneously with it, to gather biometric signals”. The suggestion is that a request to remember a moment would initiate an analysis of the “corresponding psychological patterns and context, and analyze these to learn how they can be used to predict things that an individual wants to remember”. However, “computers are currently limited in their ability to recognize image content” (p. 231) or to recognize the wearer’s affective expressions (p. 228).1 It will be necessary to develop algorithms that learn continuously, and that are capable of distinguishing between biometric data, the environment, and the patterns that are observable within and between those interacting worlds. Picard proposes that the best way to do this is by continuous measurement of day to day routines in order to develop a machine that perceives context, and can learn and reason about relationships between that context and the wearer’s situation and affective response. Picard states that the remaining obstacles to this development are “engineering problems, and conducting human studies as opposed to having to overcome any known theoretical limitations” although it seems odd to suggest that the development of a technology that remediates our relationship to memory (reality?) would not lead to emergent and perhaps even unexpected theoretical problems.

Of particular interest: The privacy and value of personal data become increasingly at issue with affective wearable recording/networking devices. Picard points out the obvious, but under acknowledged, problem of ownership of data, its manipulation, commodification and exploitation, but seems to hold (unfounded?) hope that ‘secure systems’ will be developed2. Biometric-based encryption is suggested as a ‘new intriguing possibility’, but this seems to be a deceptive slide into a cart and horse problem. Biometric data is complex and ever changing, and context is possibly infinite. A categorical system that is, by design, constrained by quantitative limits may lead to universalization and normatization, and this will become even more dangerous if the normatization becomes affective. One is reminded of the dispensing of mood altering Soma in Huxley’s Brave New World. It is interesting that Steve Mann calls his video version of a heads-up reality-overlaid display of information “mediated reality”, expressing more clearly, perhaps, aspects of his research in this field that has led to the concept of Sousveillance and its closely related practice, Inverse surveillance. Picard stresses the idea that affective systems should only be worn voluntarily, but one may wonder if future societal prejudices could place those not wearing them into marginalized conditions of anti-normalization. In an embodied affective world, the media is the machine.

1. for other research in this area, see also "The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression" [3]

2. Picard cites “A Security Architecture for Multi-Agent Matchmaking” (Foner, 1996) for reference to issues involving personal data that is given to networked agents.

Niedenthal: The Simulation of Smiles (Barnes' facial expression): Veronica

Application of embodied cognition to interpret emotions on facial expressions. Mimicry as embodied simulation, useful for human development(i.e. learning by observation) rooted in survival. It also occurs over long periods of time, mimicking nuances of expressions. Areas of the brain engaged and neurotransmitters involved in rewards systems have correlations on facial mimicry.

Springgay: Fantastical Body: D'Arcy

Noe: Out of Our Heads: Lonnie

The central theme of Noe's book is: you are NOT your brain. He writes that in order to understand consciousness we need to look at a larger system, of which the brain is only one element. According to Noe, the reason why we have yet to understand consciousness is that we've been searching for it in the wrong place. Noe's belief is that there is no one thing inside of us that makes us conscious, and that we should take seriously the possibility that the processes that matter for consciousness are themselves boundary crossing. Language, shared practices, tools, places, objects, etc. are the "machinery" of our beings, they make us who we are, so why draw the boundary for consciousness at the skull? Noe conceptualizes beings as extended, dynamic, and "of the world". Noe says that "you can no more explain mind in terms of the cell than you can explain dance in terms of muscle. Brains do not have minds... people do."

Farquhar: Beyond the Body Proper, Introduction: Gromala

In this introduction to a collection of essays, Farquhar notes the immense increase in academic research concerning what some academics call "the materialist turn" (now) which follows "the linguistic turn" (roughly, from WWII to 1990s) in the Humanities. Thus, terms like "the lived body" are used to emphasize the dynamic aspect of "living" bodies that are inescapably interconnected to and continuously affected by physical, material and biological forces (was "nature") as well as social and cultural forces (was "nurture"). Although clearly not a scientist, Farquhar draws upon the "fascinating empirical studies" that enlarge our "vision of human capacities" (p.1).

Of particular interest: Farquar articulates how theorists have challenged the commonsense, "proper," naturalized and normative ideas of a body (as a fixed, skin-bounded, biomechanical container [science] & unit of individuality [humanities/social science]). The focus is on trying to perceive our bodies as dynamic, intersubjective and plural (context matters). To do this, it is often necessary to re-examine habits and "common sense," because what we often take for granted is really the ways particular social/cultural ideas become "naturalized." To more fully understand how social & cultural contexts affect dynamic bodies, refer to the examples of genetics (genetic code vs. genetic predisposition: habits & behavior can "switch on") and especially (historical & cultural comparisons of) medicine.

Check out important ideas of how technologies have changed our operational ideas of bodies: "cyborg" (Haraway) and "posthuman" (humans aren't at the centre of the universe; Hayles & esp. Wolfe), p.3-4.

Massumi: Parables...Movement, Affect, Sensation: Tyler

Like Farquhar, Massumi is not a scientist, but isn't allergic to science. Tho neither goes as far as many in SIAT might hope for, it is important to keep in mind the multiplicities of what it means to be interdisciplinary: from experts who "quote" or use ideas from another field to dual-experts (academics who regularly publish & are recognized in 2 fields, either closely aligned or divergent).

Fleshing out Definitions (re-ordered, and edited down to the highlights):

Affect: "an ability to affect and a susceptibility to be affected. An emotion or feeling is a recognized affect, an identified intensity as reinjected into stimulus-response paths, into action-reaction circuits of infolding and externalization—in short, into subject-object relations. Emotion is a contamination of empirical space by affect, which belongs to the body without an image." Of most importance here, is that for Massumi affect precedes emotion, affects are preconscious, registered changes that lead to cognitive events, such as emotion.

Virtual—"defined as that which is maximally abstract yet real, whose reality is that of potential—pure relationality, the interval of change, the in-itself of transformation." The virtual, the potential, is real, if not actual.

Event—"The time of the event does not belong per se to the body in movement-vision or even to the body without an image. They incur it. It occurs to them. As time-form it belongs to the virtual....the event is superempirical: it is the crystallization, out the far side of quasi corporeality, of already actualized spatial perspectives and emplacements into a time-form from which the passing present is excluded and which, for that very reason, is as future as it is past, looping directly from one to the other. It is the immediate proximity of before and after." The key terms here, I think, are "superempirical" and "actualized". The event occurs, it is not virtual, or a potentiality, it is happening (probably right now).

quasi-corporeality—"the superposition of the sum total of the relative perspectives in which the body has been implicated, as object or subject, plus the passages between them: in other words, as an interlocking of overlaid perspectives that nevertheless remain distinct." The potential connections which one body (or one's body) has made, for Massumi, like Deleuze & Guattari, potential is virtual, and the virtual is real, if not actual.

the body without an image—"an accumulation of relative perspectives and the passages between them, an additive space of utter receptivity retaining and combining past movements, in intensity, extracted from their actual terms. It is less a space in the empirical sense than a gap in space that is also a suspension of the normal unfolding of time." I understand this as the overlaying of affects upon an individual body.

Proprioception-"Proprioceptive memory is where the infolded limits of the body meet the mind's externalized responses and where both rejoin the quasi corporeal and the event. As infolding, the faculty of proprioception operates as a corporeal transformer of tactility into quasi corporeality...[proprioception] can be said to be the mode of perception proper to the spatiality of the body without an image because it opens exclusively onto that space and registers qualities directly and continuously as movement." Tactile sensations of a moving body in (through) space provide a moving, embodied, perspective of an affective body.

Viscerality (interoception): "Visceral sensibility immediately registers excitations gathered by the five "exteroceptive" senses even before they are fully processed by the brain....The immediacy of visceral perception is so radical that it can be said without exaggeration to precede the exteroceptive sense perception. It anticipates the translation of the sight or sound or touch perception into something recognizable associated with an identifiable object...Call that "something recognizable" a quality (or property)...It registers intensity....Viscerality is the perception of suspense. The space into which it jolts the flesh is one of an inability to act or reflect, a spasmodic passivity, so taut a receptivity that the body is paralyzed until it is jolted back into action-reaction by recognition. Call it the space of passion." Pre-cognitive affects pass through the visceral system before cognitively processed in the brain: our gut signals us to flee before we know that we are scared.

Haraway: Cyborg Manifesto: Terry

Taking a feminist standpoint, Haraway proclaims and celebrates the fusion of humanity and technology and in doing so, dismisses those feminists who look to a pre-technology golden age when the "Goddess" was worshipped ("I would rather be a cyborg than a Goddess", she says). Old dichotomies (human/machine, human/god, man/woman) disappear in a postmodern melange -- all is fluid, all is ambiguous. Gender is a construct, as is the body. And following from this, we can rewrite our bodies and our societies. "Biological organisms have become biotic systems, communications devices... there is no fundamental, ontological separation in our formal knowledge of machine and organism, of technical and organic." The machine is not an other, so we neither have to worship it or fear it. Instead, we should use technology to enhance our bodies and our lives. "The machine is us, our processes, an aspect of our embodiment."

Hayles: How We Became Postmodern, Ch.3 (Contesting for the Body of Information: the Macy Conferences on Cybernetics)

Wolfe:

Wolfe combines animal studies with systems theory.

Fraser & Greco: The Body: A Reader: Intro: Tyler

Fraser & Greco: The Body: A Reader: Bodies, Disabilities: Terry

Bodies, Disability and Spaces, by Peter Freund, argues that the concept of disability is fluid. The body cannot be separated from its social or structural environment, and ability/dis-ability depends on the context. A wheelchair is enabling, just as a pair of eyeglasses is enabling, whereas urban built environments are dis-abling for many: "modern landscapes seem to be designed for forty-year-old healthy males driving cars." Disability, Freund says, is a normal, near universal condition and will affect nearly everyone eventually.

Heller-Roazen: The Inner Touch: Awakening... (Ch 7) Suk Kyoung

summary: Marcel Proust, Paul Valéry, Walter Benjamin (from a German text Gesammelte Schriften, which translates in google as ‘Writings’), and briefly, Kafka, are connected in this rapid literary shock of awakening that is stylistically, poetically, and philosophically fascinating.

notes:

.RE-awakening

Having us first awake as giant bugs, Kafka leads off this poetic essay on the transliminal sensation of awakening, which Heller-Roazen next captures in an amazing sensorial passage from Proust, “…in a second, I passed through centuries of civilization, and the image confusedly glimpsed of oil lamps, then of wing-cellar shirts, gradually recomposed the original features of myself.” Proust writes on the moment of awakening, “since I did not know where I was, I did not even understand in the first moment who I was”, and Heller-Roazen observes from Proust that awakening brings forth the “merest sensation of being.” Next, Paul Valéry sees this re-constitution of self, the astonishment with which the end of sleep is sensed, as the shock of alignment of “what was” with “that which is.” Sleep ends in wakening, “the origin of the progressive recomposition of the self that defines the waking state. “ (H-K, p.75) For Valéry, “waking means re-covering” (interesting in terms of Deleuze here) and that psychology is a RE-cognizing of oneself. But Heller-Roazen points out that ‘in order for something to be re-cognized, re-formed, re-trieved, it must have been irrevocably lost as any other condition suggests continuity in some way, but not re-constitution or re-covery.’ For Valéry “Memory is the gift of the return to the same. Its great affair is not the past but the re-present. That is why it returns from the past and never climbs back up to it.” This is Valéry’s autogenesis – the emergence of an unfounded self, a re-formed ‘I’ wherein “One should not say I wake, but There is waking - for the I is the result, the end, the ultimate Q.E.D. …” Valéry’s account is therefore that ‘the self comes to be in awakening and for this reason cannot be said to occasion it’ in other words, sensations arise outside the self. Walter Benjamin then observes that as it is “an implicit presupposition of psychoanalysis that the contrary opposition of sleep and waking has no validity for the empirical forms of human consciousness” then there must be an “infinite variety of concrete states of consciousness, which are conditioned by all possible centers, through all conceivable degrees of being awake." H-K points out that if one admits the existence of degrees of consciousness, then these degrees must extend to both dreams and wakefulness; that we may dream while awake and wake while dreaming. "The coming awakening," Benjamin wrote, "stands in the Troy of the dream like a wooden horse of the Greeks." Heller-Roazen summarizes, ‘one creature stealthily crouched within the dormant imagination of another’… marking a ‘secret chance to awaken’, a gateway to the feeling of existence. 

Heller-Roazen: The Inner Touch: The Unnamed King (CH 14) D'Arcy & Mark The chapter begins by describing the takeover of the Mediterranean by the Arabs and how they translated almost all the Greek writings into Arabic. The hunger for knowledge both from a scientific and social aspect has led many to believe that the "second classical language" should have been Arabic and not Latin. The Arabs did not merely translate the ancient writings but also built upon in their Falsafa (a word in Arabic which translates to Philosophy). The great Arabic philosophers were also very tuned to the human senses. "Sensation" for them is what set animals apart from plants. They went beyond the five senses we are familiar with and developed a system of "internal senses / imaginative faculty" . These senses consisted of imagination, cognition, and memory. These internal senses had a direct connection to our soul. The chapter also describes how the term "common sense" was derived. In the Book of Elements, written by the Arabic philosopher and physician Issac ben Solomon Israeli, he describes it as information received from the corporeal senses (such as sight) is sent to the spiritual senses (imaginative faculty) and the interpretation is considered to be "common sense", deciphering using the external and internal > corporeal & the incorporeal.

In other books written by the great Arabic philosophers, it states that the five senses can be thought of as Servants, each reporting a different kind of information to the Master, the overseer of the human mamlakat : an Arabic and Persian word for kingdom. The Master or Malik (King) rules over these senses (advisors/servants) and holds the power of translation and perception, the key to our soul. And without this "unnamed King" the animal soul would not exist. (Mark Nazemi)

Heller-Roazen: The Inner Touch: Thorns (Ch 19) Suk Kyoung

summary: In this essay, Heller-Roazen describes the linguistic and philosophical foundations of Leibniz’ theory of a continuum of consciousness, passing from the reflective unawareness of Liebniz’ basic soul-particle, the Monad, called perception, to reflexive awareness, called apperception or consciousness. The arousal of consciousness is then the affective response to infinitely small sensations passing a threshold of unease.

notes: Leibniz - Basic unit of universe is Monad, a soul-particle of infinitely small sensation ‘unaccompanied by awareness or reflection’, “a living mirror representing the universe according to its point of view, and above all with respect to its body.” L. argues that ‘small sensations’ (those just at the ‘threshold’ of perception) are the metaphysical elements that form the relationship between the mind and body. Leibniz sees only 3 possible relationships:

1. Descartes. The “thinking thing” that is mind somehow connected to “extended thing” (body): “the influence of one on the other.”

2. Malebranche. Devine mediation. What happens in one is represented in the other by an external mediator (no direct interaction), “occasional causes.”

3. Leibniz. Harmonious independent interaction between body and soul (players in orchestra analogy).

The concomitance of substances constitutes the metaphysical foundation of small perceptions. Therefore, “given the exact and constant harmony between the body and the soul, such corporeal events must employ corresponding affections of the psyche” (p. 194) as any other relationship suggests that there are definable limits on the union of the soul and body, which is untenable with the concept of an incorporeal soul, as there ‘can be no proportion between incorporeal substance and the modification of matter.’ Therefore, nothing that takes place in corporeal substance can be too small to be felt – every change must have a correlate, affective even if imperceptible. Leibniz argues (in the analogy of a dog struck by surprise by its master) that if the soul is “a living mirror representing the universe according to its point of view, and above all with respect to its body” that the movement of the approaching body (presence) is reflected in the body and soul and represented with continuously increasing clarity – a single continuum from pleasure to pain that is incessant. Locke# – discussing the determination of Will, states that the motive for continuing in the same State or Action is the present satisfaction in it; in the motive to change there is always some uneasiness. Therefore, Will is not a property of the greater good but one of a reaction to uneasiness, whether that pain is of the body or ‘disquiet’ in the mind (pain and desire, both states of this uneasiness, are hardly distinguishable). From Locke’s term ‘uneasiness’ Leibniz draws out the meaning of ‘unrest/disquietude’, which suggests more clearly a sense of continuum between pain and desire, a continuum which provokes a perpetual oscillation of an upsetting of balance that results in an attempt to return to a best possible state. ‘Uneasiness’ – unrest, disquietude – is then “the natural state of a substance that represents the created world in its totality, but only indistinctly … the state of the soul perpetually affected by the countless ‘”small perceptions” and “the infinity of affections that form the indistinct background of every conscious perception.” (p. 198) Leibniz builds on Locke’s idea of ‘uneasiness as the spur to action’ to state that it is this multitude of ‘little unconscious points’ that define the ‘happiness of creatures’; without all these ‘thorns of desire’ consciousness would lapse into the insensible and stupid (unchanging might be another useful adjective.) Heller-Roazen reminds us that the distinction between that of which we are aware and that which we are not is itself a ‘thorn’ of philosophy. Between the conscious and the unconscious Leibniz sees only degrees of difference, a continuum from one to the other which he called the ‘Law of Continuity’, meaning that ‘one always passes from the small to the large through the intermediary.’ Therefore, the ‘noticeable’ arises from the ‘unnoticeable’. Leibniz draws from this the idea of a threshold of sensation, which crossed gives rise to an awareness of the sensation and of being aware of noticing. This arousing of consciousness, Leibniz terms “apperception” – distinguished from the ‘reflective’ state of perception. Kant however shifted the content of this term on Western philosophy to become more referent to a ‘unity’ of consciousness: the ‘self consciousness that produces the representation I think’ (thus placing perception and apperception into one field discontinuous from any thing that does not think.) Leibniz however was clear that his meaning is that perception is ‘the inner state of the Monad representing external things’ and apperception is the ‘reflexive knowledge of this inner state of the monad’, and that only apperception is ‘consciousness.’ Leibniz thus maintains an ontological state of “perception” with no awareness but in which there never cease to be “small perceptions of which one is not aware” distinguished from the awareness of “apperception.” This however constitutes a state which the Cartesian philosophers cannot admit; to accept Leibniz’ definition of apperception is to ‘accept its constitutive relation of difference from, not opposition, to “perception”’ – to accept the notion of continuity, that consciousness may include’ lesser beings’, other awareness residing as yet unknown within the ‘noble thing called consciousness.’ In other words, consciousness only intermittently emerges from and always returns to the unconscious. This position however is not popular with Cartesian dualism’s doctrine that ‘only man truly has a soul’ as it leads from the perception of animals by continuity to the souls (arising of consciousness) in beings other than man. Leibniz states he does not understand “why men find it so repugnant to accord the bodies of other organic creatures immaterial imperishable substances.” Leibniz replaces the Cartesian opposition between the “thinking being” and the “extended being” with a threefold hierarchy of substances; three varieties of Monad: Simple monads reflect without awareness, and perceive without apperception. The next distinguishing monad is one in which sensation becomes more distinct and is accompanied by memory (animals), and the next contains the knowledge of eternal and necessary truths, the capacity to reason, and is what is termed ‘consciousness’. At what point Leibniz places his ‘threshold’ of apperception however is unclear - somewhere between the sharp thorns of awareness and the attendant forgetfulness of the passage.

Heller-Roazen: The Inner Touch: Of Flying Creatures... (Ch. 21) Jay

Philosophy uses techniques to separate objects of study (looking at the world as a naive observer, imagining an object floating in space, etc.)

By theoretically propelling a man in the void, we get a new view of context-less self. "What is self without any input / sensation"?

Over time, this approach to thinking about self dissolved.

Late 18th century, a new problem arose (Condillac)... We don't remember our birth ignorance, yet now we know things. How did we learn that we had learned, if we didn't already know what learning was?

Condillac created a work centered around a marble-man whose senses were limited, and asked readers to imagine this being as a thought experiment.

Condillac's experiment led to an original question on body ownership: how does one find out that their body is their own while simultaneously defining that which is not self?

If it is, in fact, a process of discovery, then a "body in space" which receives no sensation or exploration would believe in a "uniformity"; a reality which does not draw this line. The line is drawn by dynamics. Change in sensation.

In Heidegger's terms, knowledge of what is frequently ready-to-hand, and which changes are present-at-hand.

Condillac's conclusion: if the body has a "hand", it will be able to feel, to reach out and touch. If the body is in space, it can still touch itself and discover its body. Touching his chest, the marble statue will realize that there is "self" in both hand and chest.

Touching other objects do not have the same dual response, and thus they are not "I"

The hand can then creep without crossing borders and find the truth of body, crawling from chest to shoulder to elbow etc.

Discovery of self: 1. discovers extension through tactile perception of objects 2. discovers its own extension through tactile perception of its own parts 3. discovers the "body" through realizing the continuity of parts and their relationship to eachother.

Further philosophers adopted this "statue" or "body in space" approach, without knowing its history before Condillac.

Tracy suggested that "resistance" actually placed a meme of self in any contact; even when touching an inanimate object, the resistance implied a "self".

Biran suggested that one's own weight and muscle opposition would provide resistance, even in a vacuum, establishing self/body.

Condillac DID describe a "fundamental feeling", a sense in the absence of all others, but he said that it would not lead to perception of body and parts (he called it "confused").

[interesting, i think eastern philosophers would call it enlightenment... a sense of being without any borders being drawn between entities... "oneness" ?]

Biran would argue with Condillac and Descartes, suggesting that a being which is self-aware must know its body: how could one move a hand to discover when unaware of that hand's existence?

Biran suggested there was an "absolute sensation of existence" - a fundamental sense of self. The inner touch. Criticizes descartes focus on thought with a first principle of being as "subjective existence", implying a body.

Immediate Apperception, he called it. An internal localization of body parts which extends without limit. The discovery of body is an appropriation of that which is present-at-hand.

Still, it's a line in the sand. It's a vague/obscure feeling, as no clear distinction can be made. We all are in space, except we have appropriated a body.

Heller-Roazen: The Inner Touch: The Anaesthetic Animal (CH 24) Tyler Begins with the Aristotelian notion that humans are "sensible creatures". The rest of the chapter delves into various forms of depersonalized states where the individual does not connect to their own senses. One person even suggests that they feel like there is a "barrier" between him and his feelings. The author indicates that these depersonalization disorders are on the rise, and pose a new ethical dilemma that the "sensible creature" that is human may not feel as much as we think we do.

Wilson: Psychosomatic: Brain in the Gut: D'Arcy

Wallace: The Taboo of Subjectivity: Scientific Paradigms: Intro & Chapter 1: Suk Kyoung & Lonnie

B. Alan Wallace, Alan B. The Taboo of Subjectivity: Toward a New Science of Consciousness. Oxford University Press, 2000.

In The Taboo of Subjectivity, B. Alan Wallace (Ph.D. Stanford University, Department of Religious Studies, and Scholar of Tibetan Buddhism) examines the differing positions on human consciousness posited by religious and scientific epistemologies. Wallace begins by pointing out that any direct evidence we have for the existence of consciousness consists of non-scientific, first-person accounts of being conscious: There is no scientific evidence for the existence of consciousness.

The ‘subjective’ therefore, is tied to the notion of ‘free will’, and individual moral responsibility, where the ‘objective’ is the state and belief that all mental behaviour is produced strictly by the brain's response to physical stimuli in accordance with the laws of nature. Yet what is the nature of belief?

Wallace defines subjectivity as referring “to all conscious and unconscious personal influences, including individual consciousness itself, and all personal, individual goals, attitudes, and points of view. As such, each instance of subjectivity is confined to a specific locality in both time and space.” (p. 21)

Wallace distinguishes four elements or dimensions of scientific tradition, ranging generally from unbiased epistemological inquiry to a limiting fundamentalist normatization of thought. These dimensions are:

1. Science per se, a discipline of inquiry holding the notion of the disengaged impartial observer as primary to investigation of any question, one that holds the philosophical tradition of scepticism and rational, ‘informed confidence’ as its ideal viewpoint, and that values verifiability of its observations through empirical feedback.

2. Scientific Realism, which holds that the objects of scientific inquiry are believed to exist objectively, independent of any descriptions or interpretations imputed upon them by any external subjective observer.

3. Scientific Materialism, which Wallace (drawing from work by sociologist Emile Durkheim) argues is a metaphysical stance that has developed from and replaced prior religious dogma, placing the once sacred subjective sensory experience of the world into the realm of the profane and the scientific material world of quantifiable rationality into the realm of the sacred. To do so, subjectivity has been made taboo, in order to protect the sacred.

4. Scientism, the assertion that science is our only source of genuine knowledge about the world, which Wallace attributes to the secular ideological foundations of Auguste Comte’s Positivist sociology. Disbelief in this assertion is treated by its adherents as a sign of ignorance or stupidity, resulting in the marginalization of other (subjective) views. Scientism adopts an absolutist perspective on reality and denies the value of all other avenues of inquiry and knowledge, and is therefore a kind of scientific fundamentalism. Wallace suggest that “advocates of scientism commonly overlook the subjective, human role of choosing which natural phenomena to investigate, the means of investigating them, and the diversity of human interpretations of research data.” (p. 39)

Durkheim posited the notion of mana, a transpersonal, universal force that is central to all religions, its chief representation being the totem, “the means by which an individual is put into relations with this source of energy." Durkheim asserts that the concept of mana is the precursor of the scientific concept of energy. Its essential characteristic is that it is located nowhere definitely yet is everywhere present.

Wallace suggests science's totem is scientific method, "the means by which an individual is put into relations with this source of energy." "With the development of the principle of energy conservation in the nineteenth century, a single and universal concept of energy was conceived, exerting a powerful unifying influence on the sciences."

Wallace defines "dogma" to mean a “coherent, universally applied worldview consisting of a collection of beliefs and attitudes that call for a person's intellectual and emotional allegiance (p.22).” Scientific Materialism then, and it’s Totem, scientific method, the essential theme of Wallace’s argument, is deconstructed into a series of ‘Metaphysical Principles’ that constitute the dogma of this historically recent religiosity:

The Principle of Objectivism: Science deals with empirical facts testable by empirical methods and verifiable by third-person means. However, there are many other empirical facts—most obviously, our own subjective mental events—that are accessible only by first-person means.

The Principle of Monism: Quantifiable, regular laws govern the course of events in the universe uniformly throughout all of space and time.

The Principle of Reductionism: Asserts that macro-phenomena such as the behaviour of human cells are the causal results of micro-phenomena (the behaviour of the elementary particles that constitute the cells).

The Closure Principle: The physical world is "causally closed"—there are no causal influences on physical events besides other physical events.

The Principle of Physicalism: Only physical objects and processes exist; everything that exists is quantifiable.

Wallace ties these metaphysical principles to a ‘marginalization of the mind’ in science (and therefore in culture), noting that ‘the emergence of consciousness during the course of cosmic evolution is attributed solely to the laws of physics, which over the immensity of time give rise to a nearly infinite complexity that is purportedly sufficient to give rise to consciousness.’ Wallace observes that this “explanation" places an enormously heavy burden on the term "complexity", though I am not sure that the terms used by ‘previous’ religions were any less ‘heavy’.

An astute central recurring objection raised by Wallace is that “the central aim of science is to understand and control the objective, physical world; yet the subjective mind, with its powers of observation and reasoning, is, awkwardly, the fundamental instrument of scientific inquiry.” (p. 29)

(SKC)

Wilson, Stress and Neurological Kindling (Terry): Wilson discusses the kindling model for depression, where small stimuli over time can cause physiological changes to the brain that make it easier for depression to occur and to be triggered by non-depressive incidents. Emotional states can affect the physical structure of the brain -- and vice versa. "The induction can take place through a series of small stimuli, none of which at first causes overt symptoms… Illness, once expressed, can become responsive to ever smaller stimuli and, in time, independent of stimuli altogether… Even the early stimuli are translated into anatomical, difficult-to-reverse changes in the brain." The kindling model locates psychopathology directly in somatic encoding: "scars are not, or not only, in cognitive memory… The scar consists of changed anatomy and chemistry in the brain. Some of that brain change is memory: presumably recollected thought and emotion are encoded in ways that bear resemblance to the kindling model." Implicit in Wilson's argument (though not stated) is that if this can happen for depression, why can it not happen for other emotions as well -- happiness, joy, fear, hate, etc.?

Difference between revisions of "Bioaffect:Current events"

Latest revision as of 22:26, 22 April 2011

IAT881: BioAffective Computing & Interactive Media

Navigation menu

Personal tools

Namespaces

Variants

Views

More

Search

Navigation

Tools

@@ Line 4: / Line 4: @@
 Dr. Diane Gromala
+'''Structure of class meetings'''
+In each class meeting, unless otherwise noted, we will have:
+topics for discussion & readings, assignments, reports, examples (artifacts) and discussion of methods.
+''Topics''
+Topics for discussion will be informed by the assigned readings.
+I will assume that everyone has a thorough understanding of the readings (or quizzes may result).
+We will discuss each topic by traditional means: discussion and textual responses.
+For each reading, one of you will be assigned to address the topic by non-traditional, non-textual means.
+This may be a video, performance, prank, interactive artwork, computer application, game, sound,
+or any other legal means you come up with.
+''Assignments''
+Some assignments will simply be turned in, but most will be addressed in class.
+''Reports''
+Reports are presentations of issues assigned to you. Examples are a sensory mode,
+a technology, an example (artifact, such as an application or interactive artwork)
+and ideas for your project. Most should be no longer than 5 to 7 minutes, with 10-15 minutes of discussion or demos.
+Basic suggestions for these reports will be provided, but you are encouraged to be creative and experimental.
+For instance, perhaps the person who is assigned to report on the sense of hearing may bring in
+things to listen to, things that might modify the way we hear, or design a sonic demo.
+Similarly, whomever is assigned, say, the biofeedback technology of GSR might set
+up a scenario using the technology, and show videoclips from the Millgram experiment.
@@ Line 9: / Line 56: @@
 '''Week One January 12:''' Introductions to affective computing, course requirements and each other.
 ''Readings for next week:''
-The Emotional Self, Deborah Lupton: Introduction, Chapter 1 & Chapter 3
-Affective Computing, Rosalind Picard, Introduction & Chapter 1
+''The Emotional Self,'' Deborah Lupton: Introduction, Chapter 1 & Chapter 3
+[[Media:LuptonReading1.pdf]]
+''Affective Computing,'' Rosalind Picard, Introduction & Chapter 1
+[[Media:LuptonChapter1.pdf]]
 ''Assignments:''
-Add information about yourself and your interests + ideas you’d like to explore on class wiki.
-Reports regarding “the senses” assigned. Refer to wiki for reporting requirements.
+. Add information about yourself and your interests + ideas you’d like to explore to this wiki, in the Community Portal section.
+. Reports regarding “the senses” assigned.
+Reporting requirements: Each of you has chosen a sensory mode. For our next class meeting,
+bring a 7 page PowerPoint or KeyNote slide set. Be concise -- the words we see should only
+be touchstones that help you recall your recently acquired knowledge.
+'''Slide 1:''' (large) the name of the sensory mode (small) your name, IAT881: Bioaffective Computing, Spring 2011.
+'''Slide 2:''' An articulation of how the sensory mode works in physiological terms.
+Think about how the sensory mode you are covering might relate to other sensory modes. For instance,
+touch requires proximity and presence, but vision does not.
+Go beyond general assumptions.
+For example, many may assume that vision just requires a set of eyes, but the brain is also crucial.
+Viscera is very complex, so whomever has this one should probably focus on the enteric system, or refer to Wilson's reading, below.
+We will know if whomever covers taste has done their homework if they tell us that we have taste buds
+that recognize 4 (not 5) basic kinds of taste. Images, sound, animations, diagrams and videoclips are
+okay, but be sure you include proper citations/attributions in small text.
+'''Slide 3:''' Historical considerations. For vision, for example, some ancient Greeks believed that our eyes
+emitted rays. (Note: this slide may likely have some overlap with the subsequent slide.)
+'''Slide 4:''' Cultural considerations. How was or is your sensory mode considered in diverse cultures
+(evil eye, eyes are the windows to our souls)? What role does your sensory mode have in one or
+more cultures? (It is argued that some centuries in Western cultures were dominated by
+visual or so-called scopic regimes -- what does that mean?)
+'''Slide 5:''' Find an exemplary artifact regarding your sensory mode. This might be a painting,
+videogame, machine, interactive artwork, musical composition, foley effect, CGI,
+piece of grafitti, or so on. Choose your artifact to make a point that interests you.
+'''Slide 6''': What existing technologies relate to, simulate or address your sensory mode? Tell us
+about them generally and specifically. Are there any sci-fi technologies that are interesting? If so, why?
+'''Slide 7:''' Brainstorm about one project you'd love to create that directly relates to your sensory mode.
+Think outside of the box. Don't be shy.
+Suggestions:
+a) Conduct Ypres-like research about that sensory mode. For exteroceptive senses, a good place to start is to
+refer to Diane Ackerman's book ''A Natural History of the Senses.''  For interoceptive senses, a good place to
+start is to refer to Drew Leder's ''The Absent Body.'' You will be confronted with a seemingly insurmountable
+task -- to find and plow through an immense amount of information, and to make sense of it in a concise
+but not dumbed-down manner. My advice is to maintain a hard-core, laser-like focus. Find the information
+you need in the burning building, grab it, and get the heck out. One aspect of this assignment is for you to
+figure out ways to quickly locate the best, most up-to-date knowledge from diverse domains, to determine
+who the major players (theorists, scientists) are, what the main issues are, where exemplary works of
+art, design, media or computing are, how to digest it all, and how to brainstorm ideas about that sense modality.
+These are incredibly important skills.
+b) Assume that you will have 30-45 seconds per slide, on average. Your report (slide presentation) will be
+followed by a discussion, so use your reporting time in a concise manner. The rest of us will likely
+expand upon what you have presented.
+c) You can't possibly cover everything, so don't try. You DO want to make an incredibly well-informed
+presentation, and you DO want to communicate the most important information. But at many points in
+this process, you will have to make important decisions about WHAT is important and WHY it is important.
+That's part of the assignment.
+d) Often, it is easier to gain an understanding of how something works by looking at examples
+of dysfunction, or so-called outliers. An example of this is the work of someone like Oliver Sacks.
+e) You are strongly encouraged to enhance our understanding by helping us get our hands dirty as it were.
+That means you are encouraged to bring stuff in, have us do things, or otherwise find ways to make
+your information come out of the textual box. Remember that you don't have a lot of time, however.
+One idea is to augment just ONE slide with something in the material world. For touch, for example,
+you might consider bring in things to touch, or a technology that affects the way we experience touch.
+f) Have fun. This stuff is really interesting. Seriously.
+g) Remember, strategic risk-taking will be rewarded, in heaven, on earth and in class.
@@ Line 25: / Line 188: @@
 ''Topics for discussion:''
-Exteroception (Seeing, Tasting, Touching, Hearing, Smelling) and
+• Affective Computing, according to Picard
+• Exteroception (Seeing, Tasting, Touching, Hearing, Smelling) and
 Interoception (Proprioception, Temperature, Pain, Orientation, Kinesthetic Sense, Visceral Sense)
-Technologies related to affective computing: biofeedback, GPS, accelerometers
+• Technologies related to affective computing: biofeedback, (and possibly: GPS, accelerometers)
 ''Readings for next week:''
-Barnes’ reading
+. (re-read Lupton)
-Art or Humanities paper:
-Scientific paper:
+. CHI Paper: Humanities: ''Feminist HCI: Taking Stock and Outlining an Agenda for Design''; doi: 10.1145/1753326.1753521
+[[Media:Feminist_HCI.pdf‎]]
+. CHI Paper: Scientific:  ''Predicting tie strength with social media''; doi: 10.1145/1518701.1518736 (sent via email)
+. Barnes: "The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression" (sent via email)
+http://journals.cambridge.org/action/displayIssue?iid=7947586
 ''Assignment:''
-Conduct an “autopsy” of one Art or Humanities paper and one scientific paper (see readings above).
+Conduct an “autopsy” of the "Feminist HCI" and the "Predicting tie strength" papers.
+For this first assignment, we will examine 2 papers that received best paper awards.
+(For the next assignment, papers will come from more obviously different knowledge bases and fields.)
 Bring the results of your autopsy in a form that can be easily shared with the rest of your colleagues in class.
-Directions for conducting an autopsy:
+The term autopsy:  "to see for oneself" (Ancient Greek)
+Goal: to uncover reasons why each paper was deemed to be a good paper, and to formulate reasons
+for why each paper was recognized as a "best paper" by CHI decision-makers. It is assumed that few
+of you are privvy to the internal politics or extenuating circumstances for best paper decision making.
+'''This is loosely based on criteria used for judging academic papers generally, and much of it pertains to non-academic papers as well, so you will doubtless find pragmatic use for this exercise.'''
+Directions for conducting a forensic autopsy (assume you are a SIAT-CSI):
+'''1. Assess overall context:''' you know that each paper received the best paper distinction from the CHI conference.
+Each of you have varying degrees of knowledge about that conference.
+.1 Articulate what you know and what you have discovered about that conference. (Given time constraints, it may be useful to ask
+your colleagues and faculty members, to visit CHI's site, and to visit the URLs that lists best paper awards
+for the past few years. http://jeffhuang.com/best_paper_awards.html,
+http://www.chi2006.org/bestofchi.php, www.chi2007.org/pressroom/0425-best-papers.pdf
+.2 Make an initial assessment about factors that may have played roles in the decision to recognize each paper as "best paper."
+'''2. Identification.'''
+.1 Who are the authors?
+.2 What factors may be associated with assessing their credibility?
+.3 What is the subject of the paper?
+'''3. The Y-incision''':
+.1 Why may this subject be relevant to the CHI community?
+.2 Is the subject innovative, original or one which may have only been rarely addressed before? Does it provide new insights? If yes, articulate your reasons; if no, articulate your reasons.
+'''4. Structural integrity:'''
+.1 Is each paper technically sound? While you may not be familiar with this field, look for clues anyway.
+Is the technology dated (look at the citations)?
+Do you see the terminology elsewhere on the CHI site or in a CHI search? If the technology is experimental, does it seem realistic and doable?
+(If the authors describe, say, a computer based on DNA soup or on jet-pack technology, or if such technologies are not visible in the citations, the answer is probably no.)
+.2 Is the article structurally sound in terms of readability, structure of argument, grammar and use of images & graphics? Taken together, these should promote comprehension, even if you are not an expert.
+'''5. Assessing major organs:'''
+Does each component make sense or cohere?
+Are the claims backed up by appropriate citations? Every claim needs to be supported unless it is "common knowledge."
+Is there a component that leaps out at you because it is exceptionally confusing, not backed up, not articulated well, too broad or too specific? Or does it just not seem to fit? Often, even good papers have problems (or "issues") -- usually one glaring issue that needs to be addressed by rewriting and resubmitting. Is there an identifiable weakness? If so, what is it?
+If possible, it may be helpful to structure your answers in parallel columns, or on two parallel pages, one per article.
+You may use words, phrases or bulleted lists for some of your answers, but use sentences when you need to really explain something in detail.
+Remember, you are to read (and re-read) and assess the "Feminism HCI" and the "Predicting Social Tie Strength" articles,
+NOT the "Simulation of Smiles" article. The more effort you put into this, the better your results will be now and later.
+Like a new CSI (crime scene investigator), you are expected to use specialized tools and methods -- in this case, to search for information elsewhere. Over time, this becomes a habit, but you will almost never judge a paper simply by reading it, especially when you are in interdisciplinary realms. Knowledge is constantly updated, so even the most prominent specialists habitually make sure that they keep current with knowledge in their field (in some fields like medicine, one needs to regularly accrue continuing education credits and certification), scours journals and databases and generally seeks knowledge for pain and pleasure.
+'''GRADING:''' I will take your background and current knowledge into account, but I expect everyone to '''demonstrate''' that they have made serious efforts. Thus, answers such as "this is crap," and "I disagree with the basic premise," and "I have no idea how to even begin to figure this out" will doom you to the depths of very bad grades.
+Like the grading schema you witnessed during the slide presentations, grades in the realm of an A mean that you not only do the assignment, but that you do it exceptionally well and go beyond the instructions. Some of that is sheer insight and being able to make profound connections, while some of it means you've spent hours slogging through information, and/or you demonstrate superior investigative techniques -- like finding experts for advice or sending the authors or editors a friendly email. (Note: busy people will generally not reply to emails unless you provide them with a reason to do so, and make it easy for them to do so. So asking them open-ended questions usually won't elicit a response.) Grades in the B range mean that you have done a good, solid job.
+Note: As witnessed in the slide presentations, you may choose a relatively "objective" stance, or you may choose to integrate knowledge you are expert in, or you may choose a position (point of view) that may not be obvious or usual. That is encouraged -- it just has to be relevant and really good. Contrary to popular belief, you CAN follow the assignment specifications AND be creative. And stay within presentation time limits.
+----
+'''Week Three January 26:''' Biopsychology of Emotion
+''Guest lecturer:'' Dr. Steven Barnes, neuroscientist, UBC (sjb@nervouscreation.com)
+''Discussions:''
+. Lupton: Discussion leaders: Veronica & Jay
+. '''Biopsychological Theories of Emotion''': Dr. Steven Barnes
+Reading: ''Simulation of Smiles:'' http://journals.cambridge.org/action/displayIssue?iid=7947586
+'''Please send your autopsy assignments to Dr. Gromala via email.''' Due: Wed. Jan 26th, 5:30pm. Don't forget to title the email, beginning with BIOAFFECT.
+(NOTE: slide presentations from Daniel & Andrea will be forthcoming.)
+----
+'''Week Four: February 2''' biofeedback basics & review
+''Discussions:'' Review: Lupton & Picard: What counts as "emotion"? Mood? Affect? Temperment? + Barnes' reading
+Biofeedback demos: GSR, how to read GSR & EEG biofeedback data (usually expressed as waveforms)
+''Readings for this week:''
+Picard, ''Affective Computing,'' Chapter 2
+NOTE: We will be reading most of Picard's book, so it would be a good idea to plan to read 2 chapters per week (say, during the reading break).
+----
+'''Week Five: February 9'''
+''Class Trip:'' Vancouver Aquarium, SEE THE 4D Show: www.visitvanaqua.org/news/4D
+Note: the show runs every 20 minutes or so in the afternoon. www.visitvanaqua.org/visitors/show-descriptions
+'''THE DOORS CLOSE AT 4:45pm, & the LAST SHOW TIME IS at 6:00pm -- be sure to bring your student ID.'''
+''
+''Assignment 1:'' Write a one page paper about the so-called "4D" aspect of the show,'' roughly in 500 words or so.
+Your paper should include a concise description (1 paragraph) of the show, and should be an analytical. Bonus points: add a paragraph of what you WOULD do to create a more affective experience (define), with any technology, real or imagined.
+''Assignment 2 (self-monitoring prep):''
+a) Find 3 examples of art or art+science projects that demonstrate an area of self-monitoring (see: quantified self.com, Dunne & Raby or Scofidio & Diller for starters). Write a list and provide URLs or book, article or movie titles where possible. For each, provide a one sentence description of what was monitored, how/what it was mapped to, and what it resulted in. Add a sentence about what you thought was interesting about each one.
+b) Explore (20) self-monitoring technologies. At least half MUST be outside of the box of "norm" (i.e., commonly considered self-monitoring technologies like commonly available pedometers, biofeedback). Make a list of at least 20 (you'll hit a wall at 10, but it will open up when you hcange how you think about them). Describe, in a phrase, what the technology measures so that any of your colleagues would understand it if they read it with your verbal explanation.
+To jog your habits of thinking, refer to MIT's Media Lab, any scientific lab that deals with animals (your list is about self-monitoring technologies, but many analyses of animals apply to humans; don't forget that we are a host and have close links to other species), and Theo Gray's book ''Mad Science'' (available at Dr. Shaw's desk).
+c) Think about (10) connections between self & world, and how when you self-monitor, you MAY be consciously or not consciously affected by moment-to-moment changes in your not-self context (world). Make a list of 10 aspects of world, from phenomena to places, states, effects or zones.
+What aspects of your "external" world are you interested in? Things you can't see, like radio, gamma or EMF waves? Bacteria that live on your eyelashes (is that itch from something that is on your skin?). Or, why are some places so seemingly "creepy" that your fine body hairs stand up, while others are not -- is it all in your head? Electromagnetic vibes from earthquake faults? Concentrated pressure systems? Ectoplasm residue from ghosts or jellyfish? Static electricity? Subtle oddities in light and atmosphere? Petro deposits? Insects? Subsonic noise? This part of the assignment is more speculative -- a technology to measure phenomena may not exist. It might be useful to think about specific places and ask why you may respond to them, and think about technologies that may measure phenomena that are not (easily) perceptible.
+BOTH ASSIGNMENTS ARE DUE IN EMAIL FORM: February 16 5:00 p.m. (via email), include BIOAFFECT FEB.16 in title of email.
+''Readings for next week:''
+Picard's'' Affective Computing,'' Part I
 ----
-'''Week Three January 26x:''' The Substrates of Perceptual Illusions and Neuroplasticity
-Guest lecturer: Dr. Steven Barnes, nueroscientist & artist, UBC/SFU
+'''Week Six: February 16 READING BREAK'''
+Self-monitoring project: investigate a monitoring technology and design a self-monitoring project.
+''Readings for next week:''
+Finish reading Picard's ''Affective Computing'' book. Concentrate specially on the technical chapters in Part II.
+''Assignment for next week:''
+. Be prepared to explain what a sigmoid is and why it is important when designing an affective computing system (Rafe's example would do).
+Be sure you understand the different wave forms, what they represent (p.157), and what they are measuring and in what units (microvolts, %reflection, % max.expansion,microSiemens).
----
+. Develop and roughly flesh out ideas for your class project. Each of you will be required to discuss them in class next week.
-'''Week One January 12:''' Introductions to affective computing, course requirements and each other.
+The more developed the idea, the more useful feedback will be for you. (You can work with a colleague or two. Group size limit is 3 people, unlimited other organisms.)
+----
+----
+'''Week Seven:''' Feb. 22: Catch-up
+Initial project ideas articulated.
+----
+'''Week Eight:''' March 1:Catch-up continued
+First half of class: Assignments discussed; examples of bioaffective art, self-monitoring projects & technologies.
+Picard reading part 2
+Second half of class: testing technologies & discussing projects as they evolve.
+''Readings for next week:''
+Farquhar's, ''Beyond the Body Proper,'' Introduction (available online at Google Books - with some pages missing: [http://books.google.com/books?id=65_wXDavMoUC&lpg=PP11&ots=ymk91O5ujc&dq=Farquhar%20beyond%20the%20body&lr&pg=PA1#v=onepage&q&f=true])
+Also, PDF:
+[[Media:Lock_Farquhar_Intro.pdf]]: Gromala
+Springgay: Fantastical Body[[Media:Fatastical_body_small.pdf]] Lonnie
+Noe: Out of our Heads[[Media:Out_of_our_heads2.pdf]] D'Arcy
+The Body: Orlan: D'Arcy
+The Inner Touch: Of Flying Animals (Ch 21) D'Arcy and Jay
+The Inner Touch: The Anaesthetic Animal (CH 24) Tyler
+(note: the last 4 essays are very short but meaty)
+----
+'''Week Nine:''' March 8: Beyond the Normative:Disabilities, Synesthesia & (co-)adaption
+''First half of class: Discussions:'' readings, bioaffective art & technology examples continued
+The Inner Touch: Of Flying Animals (Ch 21) D'Arcy and Jay
+''Discussions:'' Humans and their technologies.
+''Second half of class: MODELLING & CREATING ABSTRACTIONS + Terry will bring in different film/video clips to discuss the rhetoric of his project''
+''Readings for next week:''
+Psychosomatic: Stress & Neurobiological Kindling: Terry
+----
+----
+'''Week Ten:''' March 16
+''Discussions:'' Psychosomatic: Stress & Neurobiological Kindling: Terry
+The Body: Bodies, Disabilities: Terry
+Models of emotion, mood, temperament, DGr
+Models of temperament, in-class assignment.
+Heller-Roazen: The Inner Touch: The Anaesthetic Animal: Tyler
+Picard: Part 1: Mark
+Picard Part 2: (Ch.5 Affective Signals & Systems) Jay, Veronica, Lonnie, Daniel
+The mechanics of detecting and expressing emotions on three levels:
+Low-level = direct sensors
+Mid-level = abstract combinations of sensors
+high-level pertains to the level of analysis, concepts which power connectionist networks
+''Readings for next week:''
+Picard Part 2: (Ch. 6 Rec. & Expressing Affect) Jay, Veronica, Lonnie, Daniel
+----
+'''Week Eleven:''' March 23: Body Image/Body Schema; Habituation, Healing: Shamanism, CAM
+''Discussions:'' Picard Part 2: (Ch. 6 Rec. & Expressing Affect) Jay, Veronica, Lonnie, Daniel
+MODELING & SYSTEMS: extreme parameterization or different paradigms (brief history of AI)?
+''Readings for next week:''
+Picard Part 2: (Ch. 7) Jay, Veronica, Lonnie, Daniel (Ch.8 Wearables+) Suk Kyoung
+Models for affective behaviour:  expressing emotions through combining modalities (i.e.: voice, facial, HR, context).
+It also aims to adaptation to new theories on mixed, blocks or granularity of constructed emotions;
+a higher step is on predicting what emotional state comes next.
+Haraway, ''Cyborg Manifesto:'' Terry
+The Taboo of Subjectivity Scientific Paradigms: Intro & Chapter 1: Suk Kyoung & Lonnie
+(note on this reading: identify the 4 basic approaches)
+----
+'''Week Twelve:''' Medical Technologies & Affect
+''Discussions:'' Haraway, ''Cyborg Manifesto:'' Terry
+Picard:
-''Readings for next week:''
+Models and learning: the influence of emotion in memory and performance. Backpropagation as the emotional energy being attached to an association, its roots are in Freud’s cathexis to objects.
-The Emotional Self, Deborah Lupton: Introduction, Chapter 1 & Chapter 3
-Affective Computing, Rosalind Picard, Introduction & Chapter 1
+Scientific Paradigms: Intro & Chapter 1: Suk Kyoung & Lonnie
-''Assignments:''
+. Medical Frontiers: Research re: brain-computer interfaces, drug delivery technologies, genetics, nanotechnology. What do they have to do with affective computing? (biomarkers of affect, defined as the miliseconds of pre-conscious "registering" or response)
-Add information about yourself and your interests + ideas you’d like to explore on class wiki.
+. CAM (Complementary & Alternative Medicine) Varela & Kabat-Zinn (research studies that convinced medical researchers & physicians)
-Reports regarding “the senses” assigned. Refer to wiki for reporting requirements.
+. CLASS PRESENTATIONS: (be prepared to "map" your project to Picard's model)
----
-'''Week Two January 19:''' The Substrate of Sensory Experience: Intero- and Exteroception
-''Topics for discussion:''
+----
-Basics of perceptual illusions and neuroplasticity.
+'''Week Thirteen: April 6''' Review & Archiving, Wet & Dry
-Technologies related to affective computing: mirrors, electrical stimuli, VR
-Readings for next week:
+Course Review
-Affective Computing, Rosalind Picard
-Karon MacLean’s Creature
-Assignment: locate an example of a perceptual illusion: a work of art, design or media (or cultural phenomenon).
+CLASS PRESENTATIONS
-Create a 3 page slideshow: page 1, cite the work & include an image or sound from it; page 2, your analysis;
-page 3, articulate an idea for a work you would want to create, relating to perceptual illusions or neuroplasticity.
+'''FINAL PROJECT ARCHIVAL INFORMATION TURNED IN, IN CLASS.'''
+Be sure everything is labelled and dated. No label, no grade.
+----
 ----
-'''Suggested Readings for the course.'''
+'''Required Readings for the course'''
-Affective Computing, Rosalind Picard
+Picard ''Affective Computing,''
 http://troy.lib.sfu.ca/record=b1876254
 (Full text available online)
+The basis for all discussion, updated research and extensions of her model.
+Lupton: ''The Emotional self : a sociocultural exploration,''
+http://troy.lib.sfu.ca/record=b1904667
-A Natural History of the Senses, Diane Ackerman
+Farquhar: ''Beyond the Body Proper,''
-http://troy.lib.sfu.ca/record=b2461966
+Introduction (available online at Google Books - with some pages missing: [http://books.google.com/books?id=65_wXDavMoUC&lpg=PP11&ots=ymk91O5ujc&dq=Farquhar%20beyond%20the%20body&lr&pg=PA1#v=onepage&q&f=true])
+Also, PDF: [[Media:Lock_Farquhar_Intro.pdf]]: Gromala
-Physical Computing: Sensing and Controlling . . . , Tom Igoe and Dan O'Sullivan
+Noe: ''Out of our Heads'' [[Media:Out_of_our_heads2.pdf]] D'Arcy
-http://troy.lib.sfu.ca/record=b3872653
+(we do not = our brains)
-(Full text available online)
-Parables for the Virtual: Movement, Affect, Sensation, Brian Massumi
+Massumi: ''Parables for the Virtual: Movement, Affect, Sensation''
 http://troy.lib.sfu.ca/record=b2483710
 (Full text available online)
+Niedenthal: "The Simulation of Smiles (SIMS) model:
+Embodied simulation and the meaning of facial expression"
+http://journals.cambridge.org/action/displayIssue?iid=7947586
+(measurable microexpressions)
+Springgay: ''Fantastical Body''
+[[Media:Fatastical_body_small.pdf]] Lonnie
+Springgay begins by discussing different approaches to the study of body image.  She says that researchers neglect the embodied nature of body image and tend to express body image as a discrete concept that can be examined in separation from lived experiences.  In contrast, the author describes body image as an awareness of our own bodies and their relations to gestures, movements, other bodies, objects, and the environment.  She also includes the sensations of our own bodily functions in her concept of body image.
+	Springgay's main point is that new models and methods of studying body image that view it as dynamic and shaped through our interactions need to be developed.  She believes in a discussion of body image through "pedagogies of excess," and to that end, she offers the idea of the "fantastical body."  The fantastical body is full of potential and is made up of processes instead of substances.  She describes other views of body image as goal oriented in that they are about "maintaining equilibrium," and in contrast the fantastical body is trying to modify and create.  Integral to her theory of pedagogies of excess is the importance of knowing that we are constantly becoming and always incomplete.  She draws comparisons between her concept of the fantastical body and Deleuze and Guattari's concept of the Body without Organs.  The BwO is described through the metaphor of an embryonic egg which has no boundaries and represents potentiation.  In becoming an individual, change is constant and there are various forms which could always have been otherwise.
+Wilson: ''Psychosomatic: Feminism and the Neurological Body,''
+Chapter 2: The Brain in the Gut
+http://troy.lib.sfu.ca/record=b3617961
+(how psychiatric disorders have biomarkers, effect bio)
+'''Suggested Readings for the course: Intero- and Exteroception'''
 The Absent Body, Drew Leder
 http://troy.lib.sfu.ca/record=b1465856
+(autonomic senses, CNS)
+A Natural History of the Senses, Diane Ackerman
+http://troy.lib.sfu.ca/record=b2461966
+(basics of each exteroceptive sense, i.e., the 5 senses)
-Psychosomatic: Feminism and the Neurological Body, Elizabeth A. Wilson
+'''Suggested Readings for the course: Beyond the Norm'''
-http://troy.lib.sfu.ca/record=b3617961
+The Mind's Eye, Oliver Sacks
+http://troy.lib.sfu.ca/record=b5664168
+(what "outlying" or non-normative conditions can teach us)
+'''Suggested Readings for the course: technologies'''
+Physical Computing: Sensing and Controlling . . . , Tom Igoe and Dan O'Sullivan
+http://troy.lib.sfu.ca/record=b3872653
 (Full text available online)
@@ Line 120: / Line 606: @@
 http://troy.lib.sfu.ca/record=b2137665
 (Full text available online)
+(how different scientific fields deal with emotions, moods & temperament)
+"'Thought Technologies Manual"'
+http://www.thoughttechnology.com/pdf/manuals/SA7560%20Rev%203.pdf
+'''Interesting Readings?'''
+Most Bizarre Scientific Papers
+http://www.oddee.com/item_90683.aspx
+-----------------
+-----------------
+'''ASSIGNED READINGS: BRIEF ANNOTATIONS'''
+-----
+Everyone should write a very concise paragraph covering the reading -- somewhere between a dictionary and encyclopedia entry.
+If you share a reading with another student, you should collaborate on the entry.
+Goal 1: to be a resource for all students in class
+Goal 2: for you to inculcate the reading
+Goal 3: for you to speak in every class "as" the author(s) assigned to you. I.e., "Author X would say . . . "
+-----
+example: (Veronika & Jay)
+'''Lupton, ''The Emotional Self:'' Jay and Veronica'''
+Lupton asserts that emotions have been historically been viewed as embodied sensations, so they were (and still are) are considered to be the antithesis of reason and rationality (p.3).
+Lupton's main aim is to discuss how emotions contribute to our sense of self. In doing so, she covers many divergent theories of emotions.
+In the first chapter, she divides knowledge about emotions into 2 major areas:
+'''1. emotions as inherent:''' humans have a set of basic emotions, even though the expression of them may vary according to culture & history
+• emotions are generally viewed as:
+genetically inscribed, inherited rather than learned (positivist, essentialist, organismic)
+linked to physiological changes, the result of stimuli
+instinctive reflexes ranging from uncontrollable to moderately controllable through willpower/self-control
+• ''evolutionary psychologists:'' the function of emotions for survival & continuation of the human species
+•'' inherent perspectives'' connect to this idea of emotions being "animalistic" tendencies, implying that emotions should be suppressed for a progressive society.
+• ''Cognitive theorists:'' the interest is on the interrelationship among bodily response, context & individual recognition/awareness; emotions are viewed as coping mechanisms
+• ''William James:'' physical responses ''precede'' the emotion, interpreted based on'' judgement'' of a situation
+The citation of Mesquita and Frijda suggests theories which connect an emotion to "preparation for action".  They boil emotion down to an evaluation of events, their valence, their controllability, etc. which is a very functional approach to the concept.
+  - This area ties directly to the idea of "behavioural ecology", completely lost on this author.
+  - Evolutionary adaptations which start for one purpose can become appropriated - discussion is missing here!
+The philosophical approach to truth about emotion is practical, but the power of cognitive models to predict is omitted completely from this article.
+  - The authors should mention the practicality of cognitive science, for technology, therapy, diagnosis, etc.
+'''2. emotions as sociocultural constructions:'''
+Emotions are phenomena that are shaped, experienced and interpreted through social and cultural practices (p.2).
+"Weak thesis" (Kemper): some emotions are universal, some acquired by socialization, & universal emotions can be altered through socializing "agents"
+  - When we discussed this in class, most of us agreed that the weak sociocultural approach seemed to be most intuitive.
+  - We also discussed how the "weak" vs. "strong" nomenclature is a bit biased; the author is having a hard time presenting a neutral case.
+"Strong thesis": emotions are irreducibly sociocultural products, entirely learned and acculturated; purely contextual; intersubjective rather than individual experience
+''Harre:'' there is no such thing as an emotion, only multiple ways of acting & feeling in a bodily way; one "does" rather than "has" an emotion; self-assessment plays a role
+''Cultural anthropologists'' (Heelas, Lutz): strengthen the sociocultural direction by doing cross-cultural analyses & demonstrating major emotional differences in diff. groups of people
+''Social historians'' (Stearns): strengthen the sociocultural direction too, but in this case, longitudinally: demonstrating the dynamics of emotion through different eras (i.e. Victorian domination of grief)
+''Structuralists'' (such as Durkheim): examine the bonding nature of rituals "collective effervescence"; social order is not just rational, but underpinned by affective/social ties
+''Phenomenological Approach:'' a person's interpretation of bodily sensations ''are'' the emotion, NOT behavior or awareness of physiological changes
+----
+'''Picard'''  ''Affective Computing:'' Part 1: Applications (+extend): Mark
+Picard defines affective computing as: artificial intelligent systems that can detect, evaluate, and process emotions. It is a human-computer interaction that includes 'sensing and reasoning context' that is derived from emotional influences.
+In the book, Picard provides examples of how we can implement affective computing in various fields such as learning, social development, entertainment, preventative medicine, and consumer products. A few examples are: embedding emotions in learning, gaming that measures performance using biofeedback, healthcare specifically helping people with autism by providing feedback using their emotional responses, and software applications such as incorporating social human emotions into digital communication. Picard also points out that no application can solely be based on affective computing. It has to be associated with other tools such as the user interface or computer vision.
+Issues related to emotion recognition:
+	-how we express emotions has a broad range and the meanings or modalities vary across cultures, gender, and age. Restrictions on accessing emotions is a concern as well for example it depends on the level of neural brain activity and biological configuration. According to Picard, being able to accurately interpret and define this level of complexity is highly unlikely.
+	-the other difficulty is how we interpret our emotions and the variability that exists amongst individuals. Also our emotional circumstance tends to rapidly change from one state to another and this minimal latency between the shifts will be difficult for a system to interpolate.
+'''Picard'''  Part 1: Potential Concerns (+ Turkle handout): Terry
+In Chapter 4 of ''Affective Computing'' Picard discusses some of the potential drawbacks to affective computers and how to mitigate or counter these drawbacks. The areas of concern she identifies are expectations in interfaces, privacy, accuracy and objectivity, symmetry in communication, centralized recognition and control, computers acting emotional and responsibility and computer rights. She finishes by addressing issues that designers of affective machines should address:
+. '''Expectations in interface''' - computers have the potential to mislead us - we expect human-like intelligence, understanding and actions. But affective machines may be only simulating emotion or may be faking emotions (e.g., empathy). Also at first, computer expression of emotions may be crude - "agents with faces that are distracting, machines with too much vocal inflection, icons that amuse you with their expressive motions for the first week, but annoy you a week later, and so forth."
+. '''Privacy''' - affective computers can gain access to our emotional lives, and this data could then find its way into the hands of potential employers, ex- and future lovers, lawyers, insurance companies, etc.
+. '''Accuracy and Objectivity''' - humans are not perfect at recognizing emotions, can we expect computers to be any better? We tend to believe computers are objective, but they are programmed by people who have their own biases.
+. '''Symmetry in communication''' - we need to be able to see what emotion our computer thinks it senses in us. And what about workplace monitoring? Should a workplace computer be able to report to your boss that you are feeling disaffected or surly?
+. '''Centralized Recognition and Control''' - could emotive data be centralized and used by large corporations, governments, hackers, etc.?
+. '''Computers acting emotionally''' - should computers be allowed to express all emotions? What about rage? grief? disdain? Would a suicidal affective machine cause harm in its despair?
+. '''Responsibility''' - is it always possible for humans to be in control of human-machine systems, especially if the machine has emotions?
+. '''Computer rights''' - if a computer has emotions, should it have rights?
+. '''Design issues''' - Picard identifies privacy, multiple channels, valence, contagion, awareness, emotional hijacking and emotional range as issues that affective computing designers need to consider. The default, she suggests, could be the human paradigm, but she suggests there are other models that could be used.
+"Programmed for Love" (Young, Jan. 14, 2011, '''The Chronicle Review''') presents a different view of the potential downside to affective machines. Though Picard discusses the potential dangers of affective computing, she believes that, on balance, emotional computers would be beneficial for humanity. Her MIT colleague Sherry Turkle, according to this article, does not share this belief. Turkle feels that sociable robots have "seductive and potentially dangerous powers", that they are demeaning and damaging to our collective sense of humanity.  “We have invented inspiring and enhancing technologies, and yet we have allowed them to diminish us," she says. She also feels that providing robot companions to the elderly, the lonely, to children is to give up on them. Humans need to take care of each other, not to delegate that role to machines. Whereas Picard's view of the dangers is that they are all addressable, Turkle, according to Young's article, believes the very concept is deeply flawed.
+----
+'''Picard''' Part 1: Emotions are Physical and Cognitive: Daniel
+'''Picard''' Part 2: Affective Signals & Systems: Veronica, Jay & Daniel
+Picard is going to describe the mechanics of detecting and expressing emotions on three levels.  Low-level, mid-level and high-level... this dimension pertains to the level of analysis.  Whereas low level are direct sensors, mid-level are abstract combinations of sensors, and high level are concepts which power connectionist networks.
+Another dimension is the emotional state of the perciever, this can affect which emotion is interpreted.  Bottomup and topdown influence on perception of emotion.
+Context is also important, one may have the same emotional physiology in different contexts for different reasons.  Emotion is not only bottom-up (from signals to symbols) but also top down.
+Bell is a physical metaphor for emotion.  Curved response.  Successive strikes are cumulative.  Different bells respond differently (based on "temperament").
+Linear, time-invariant system are easy to understand.  Picard suggests that computationally modeling people would depict them as neither.  Instead, parameters which change over time and person would be defined to control the basic response curve (sigmoid).
+Picard models emotional response as a sigmoid.  As events happen the response strengthens but it hits a ceiling.  The threshold, gain and ceiling are all dependent on context, personality, mood and other factors.  So the sigmoid is the proximal emotional response, while the contextual properties and dimensions of the sigmoid are controlled my mood, among other things.
+Context is plausible in the proximal, but long-term moods still remain fairly nebulous.  Picard suggests some constant monitor of every event and input may be able to simulate it and affect the sigmoid.
+Picard acknowledges that valence and intensity is a simplisitic model.  She suggests that multiple parallel sigmoids could represent a wide range of emotional dimensions which may or may not affect eachother.
+The sigmoid based system represents response decay, repeated strikes, temperatment, nonlinearity, time-invariance, activation, saturdation, feedback, mood.
+Picard then discusses physiological signals and how they correlate to emotion.  She is defining a gap between these correlations and models for emotion, and depicts them in a way which implies that it could eventually be filled.
+'''Picard''' Part 2: Recognizing and Expressing Affect: Veronica, Jay & Daniel
+This chapter aims to shed light onto affect recognition (as a pattern recognition problem) and affect expression (as pattern synthesis).
+Setting expectation to the capability of recognition of the system is relevant. It'd be satisfying if it can recognized as well as a person; if wearable clothing (physiology) is used the recognition should be higher.
+Representation of emotions can be divided into discrete emotions (i.e. basic emotions) or continuous (i.e. arousal-valence). Both models have uses and limitations, and are concise.
+Another distinction is universal and person-specific (same physiological response versus difference of emotion defined, elicit, and expressed). Affective computing is first person-specif, and second universal (examining individual data to see common patterns).
+Picard highlights the tension between pure or mixed emotions, she uses the metaphors of microwave (pure states alternating) and hot tub (new state from the mix). Picard also notices that when mixing emotions inhibiting can occur (i.e.: lying might inhibit love).
+Picard presents low and mid-level models for pattern expression and recognition. The "best" model depends on the task.
+*Facial expressions: the most visible and easily controlled. Discrete and pure model. Underlying theory is Facial Action Coding System (FACS) by Ekman and colleagues, which relates emotions to muscular movements. A second variant in facial expression is by identifying motion energy. The relationship to temperament is still not investigated.
+*Vocal intonation: how we say things; cues on what’s important and our affective state. Some aspects considered speech rate, pitch, voice quality. These can be consciously controlled but less than facial expressions. Affect editor is a program to ‘read’ sentences with affect. Recognizing is more difficult, even for people (60% of reliability), recognizing arousal better than valence. Context is very powerful.
+*Combination of facial and voice seems to be promising since arousal is easier recognized with voice and valence with facial expression.  But it’s challenging facial recognition with talking because of the mouth movement.
+*Physiological patterns: computer monitors multiple signals such as EMG, GSR, BVP, respiration. Deciding which features of the signals to analysis is an art, according to Picard. It is also an open question which combination of signals are the best indicators for affective change.
+*Models for affective behaviour:  expressing emotions through combining modalities (i.e.: voice, facial, HR, context), it also aims to adaptation to new theories on mixed, blocks or granularity of constructed emotions; a higher step is on predicting what emotional state comes next.
+*Models and learning: the influence of emotion in memory and performance. Backpropagation as the emotional energy being attached to an association, its roots are in Freud’s cathexis to objects.
+'''Picard'''  Part 2: Emotional Synthesis: Veronica, Jay & Daniel
+This chapters moves up from low-level signal processing and considers the role of pattern analysis in emotion detection.
+Again, as in Chapter 4, Picard suggests we can't directly observe emotions from the outside... Green would argue (part-whole)
+Picard looks through a wide range of emotional theories which suggest a few basic emotions, and some theories which suggest "dimensions" of emotion (Arousal (calm vs. excited), Valence (negative vs. positive)).
+Picard acknowledges different theories of emotion, but suggests that these models will be useful for representation : even if they turn out to be an oversimplification.
+Patternmatching lies in the chasm between individual person-specific emotions and universal patterns.
+A key question is whether emotions are mixed or pure.  How is a state of multiple emotions represented?  This is important as we are not likely to get pure emotions from users of affective computers.
+Facial recogntion is a prototypical example of pattern analysis being used to model emotions (ekman, etc.).  Another example is the synthesis and recognition of affective vocal intonation.   Picard reviews work in both these domains in detail.
+Roy and Pentland are studying whether vocal utterances are generally approving vs. disapproving using audio measure (mean frequency, harmonic ratios, etc.) - high accuracy was found.
+Given the promise in all this work, a future direction is the combination of face/voice for more conclusive recognition.  The McGurk effect shows why this is a powerful process and similar to how humans perform it.
+Picard used a series of physio sensors to read emotions over time and found significant predictable patterns for emotions
+Hidden Markov Model estimates probability of emotional transition based on observation... what are the probabilities of moving from joy to sadness vs. interest to sadness?  Here we're goin up a level in analysis: you could better identify ambiguous physiological state by knowing previous states.
+Interesting that Werbos came up with backpropogataion in connectionist networks based on an emotional idea from freud: freud saw emotions flowing back through cause-effect relationships (if waiting in line leads to a packed club which is happiness, then waiting in line gets associated with happiness too... the emotion back-propagates).
+'''Picard''' Part 2: Affective Wearables (+extend): Suk Kyoung, Mark
+Picard’s ‘wearables’ are computational devices worn as an article of clothing or jewelry that are affectively aware of their host and surrounding environment  (in a friendly, attentive, or assistive way), are non-invasive, comfortable, and voluntary in their deployment. Affectiveness is described as the identification and reproduction of patterns in biometric data that are interpreted as indicative of human emotional involvement with stimulus and context. Picard reminds us that bad interface design “will not be easy to tolerate with a system that you cannot get up and walk away from.”
+Picard clarifies that research experiments in Emotion Theory to date have a certain “internal validity” (repeatable results in the lab) but that most cannot claim to have any “external validity”, that is, “validity to real life experience”.  Picard refers to one study suggesting that some theorists believe that real-life observation of emotion theory is impossible (Wallbott and Scherer, 1989). It is noted that we are beginning to see the influx of mobile and ubiquitous computing wearable computing in various commercial applications (FedEx deliveries, service industries, utility companies…not to mention the smart phone).
+Picard suggests that because music is the ‘most socially accepted form of mood manipulation’ that a personal DJ would be one suitable application of affective technology, although the association of the validity of this idea with claims by the MUZAC corporation for effective affective response from shoppers and workers may require further substantiation.  The system would monitor biometric data, user choice history and associated context, to build affective profiles of their music preferences and suggest current programming.  Potential issues are addressed with acknowledgment that some manual input (key words) are likely to be required, and that contextual pattern recognition (techniques known as collaborative filtering) may be used to improve affective response accuracy.
+Picard proposes that it may be possible to augment human memory through a combination of technologies of constant surveillance and relational affective patterning, coupling ideas of Steve Mann’s WearCam with affective computing. Eidetic (‘photographic’) memory is linked with emotionally significant events in the theory of “Flashbulb memory” (Brown and Kulik, 1977), and Picard draws from this the idea of ‘affectively indexed’ memory banks, extending Mann’s WearCam to include “not just video imagery, but simultaneously with it, to gather biometric signals”. The suggestion is that a request to remember a moment would initiate an analysis of the “corresponding psychological patterns and context, and analyze these to learn how they can be used to predict things that an individual wants to remember”.  However, “computers are currently limited in their ability to recognize image content” (p. 231) or to recognize the wearer’s affective expressions (p. 228).1
+It will be necessary to develop algorithms that learn continuously, and that are capable of distinguishing between biometric data, the environment, and the patterns that are observable within and between those interacting worlds. Picard proposes that the best way to do this is by continuous measurement of day to day routines in order to develop a machine that perceives context, and can learn and reason about relationships between that context and the wearer’s situation and affective response.
+Picard states that the remaining obstacles to this development are “engineering problems, and conducting human studies as opposed to having to overcome any known theoretical limitations” although it seems odd to suggest that the development of a technology that remediates our relationship to memory (reality?) would not lead to emergent and perhaps even unexpected theoretical problems.
+Of particular interest:
+The privacy and value of personal data become increasingly at issue with affective wearable recording/networking devices. Picard points out the obvious, but under acknowledged, problem of ownership of data, its manipulation, commodification and exploitation, but seems to hold (unfounded?) hope that ‘secure systems’ will be developed2. Biometric-based encryption is suggested as a ‘new intriguing possibility’, but this seems to be a deceptive slide into a cart and horse problem.
+Biometric data is complex and ever changing, and context is possibly infinite. A categorical system that is, by design, constrained by quantitative limits may lead to universalization and normatization, and this will become even more dangerous if the normatization becomes affective. One is reminded of the dispensing of mood altering Soma in Huxley’s ''Brave New World''.
+It is interesting that Steve Mann calls his video version of a heads-up reality-overlaid display of information “mediated reality”, expressing more clearly, perhaps, aspects of his research in this field that has led to the concept of Sousveillance and its closely related practice, Inverse surveillance. Picard stresses the idea that affective systems should only be worn voluntarily, but one may wonder if future societal prejudices could place those not wearing them into marginalized conditions of anti-normalization. In an embodied affective world, the media ''is'' the machine.
+.  for other research in this area, see also "The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression" [http://journals.cambridge.org/action/displayIssue?iid=7947586]
+.  Picard cites “A Security Architecture for Multi-Agent Matchmaking” (Foner, 1996) for reference to issues involving personal data that is given to networked agents.
+----
+'''Niedenthal:''' ''The Simulation of Smiles'' (Barnes' facial expression): Veronica
+Application of embodied cognition to interpret emotions on facial expressions.
+Mimicry as embodied simulation, useful for human development(i.e. learning by observation) rooted in survival. It also occurs over long periods of time, mimicking nuances of expressions.
+Areas of the brain engaged and neurotransmitters involved in rewards systems have correlations on facial mimicry.
+----
+'''Springgay:''' ''Fantastical Body:'' D'Arcy
+----
+'''Noe:''' ''Out of Our Heads:'' Lonnie
+The central theme of Noe's book is: you are NOT your brain.  He writes that in order to  understand consciousness we need to look at a larger system, of which the brain is only one element.    According to Noe, the reason why we have yet to understand consciousness is that we've been searching for it in the wrong place.
+Noe's belief is that there is no one thing inside of us  that makes us conscious, and that we should take seriously the possibility that the processes that matter for consciousness are themselves boundary crossing.  Language, shared practices, tools, places, objects, etc. are the "machinery" of our beings, they make us who we are, so why draw the boundary for consciousness at the skull?  Noe conceptualizes beings as extended, dynamic, and "of the world".
+Noe says that "you can no more explain mind in terms of the cell than you can explain dance in terms of muscle.  Brains do not have minds... people do."
+----
+'''Farquhar:''' ''Beyond the Body Proper,'' Introduction: Gromala
+In this introduction to a collection of essays, Farquhar notes the immense increase in academic research concerning what some academics call "the materialist turn" (now) which follows "the linguistic turn" (roughly, from WWII to 1990s) in the Humanities. Thus, terms like "the lived body" are used to emphasize the dynamic aspect of "living" bodies that are inescapably interconnected to and continuously affected by physical, material and biological forces (was "nature") as well as social and cultural forces (was "nurture").  Although clearly not a scientist, Farquhar draws upon the "fascinating empirical studies" that enlarge our "vision of human capacities" (p.1).
+Of particular interest: Farquar articulates how theorists have challenged the commonsense, "proper," naturalized and normative ideas of a body (as a fixed, skin-bounded, biomechanical container [science] & unit of individuality [humanities/social science]). The focus is on trying to perceive our bodies as dynamic, intersubjective and plural (context matters). To do this, it is often necessary to re-examine habits and "common sense," because what we often take for granted is really the ways particular social/cultural ideas become "naturalized." To more fully understand how social & cultural contexts ''affect'' dynamic bodies, refer to the examples of genetics (genetic code vs. genetic predisposition: habits & behavior can "switch on") and especially (historical & cultural comparisons of) medicine.
+Check out important ideas of how technologies have changed our operational ideas of bodies: "cyborg" (Haraway) and "posthuman" (humans aren't at the centre of the universe; Hayles & esp. Wolfe), p.3-4.
+----
+'''Massumi:''' ''Parables...''Movement, Affect, Sensation: Tyler
+Like Farquhar, Massumi is not a scientist, but isn't allergic to science. Tho neither goes as far as many in SIAT might hope for, it is important to keep in mind the multiplicities of what it means to be interdisciplinary: from experts who "quote" or use ideas from another field to dual-experts (academics who regularly publish & are recognized in 2 fields, either closely aligned or divergent).
+Fleshing out Definitions (re-ordered, and edited down to the highlights):
+Affect: "an ability to affect and a susceptibility to be affected. An emotion or feeling is a recognized affect, an identified intensity as reinjected into stimulus-response paths, into action-reaction circuits of infolding and externalization—in short, into subject-object relations. Emotion is a contamination of empirical space by affect, which belongs to the body without an image." Of most importance here, is that for Massumi affect precedes emotion, affects are preconscious, registered changes that lead to cognitive events, such as emotion.
+Virtual—"defined as that which is maximally abstract yet real, whose reality is that of potential—pure relationality, the interval of change, the in-itself of transformation." The virtual, the potential, is real, if not actual.
+Event—"The time of the event does not belong per se to the body in movement-vision or even to the body without an image. They incur it. It occurs to them. As time-form it belongs to the virtual....the event is superempirical: it is the crystallization, out the far side of quasi corporeality, of already actualized spatial perspectives and emplacements into a time-form from which the passing present is excluded and which, for that very reason, is as future as it is past, looping directly from one to the other. It is the immediate proximity of before and after." The key terms here, I think, are "superempirical" and "actualized". The event occurs, it is not virtual, or a potentiality, it is happening (probably right now).
-The emotional self : a sociocultural exploration, Deborah Lupton
+quasi-corporeality—"the superposition of the sum total of the relative perspectives in which the body has been implicated, as object or subject, plus the passages between them: in other words, as an interlocking of overlaid perspectives that nevertheless remain distinct." The potential connections which one body (or one's body) has made, for Massumi, like Deleuze & Guattari, potential is virtual, and the virtual is real, if not actual.
-http://troy.lib.sfu.ca/record=b1904667
+the body without an image—"an accumulation of relative perspectives and the passages between them, an additive space of utter receptivity retaining and combining past movements, in intensity, extracted from their actual terms. It is less a space in the empirical sense than a gap in space that is also a suspension of the normal unfolding of time." I understand this as the overlaying of affects upon an individual body.
+Proprioception-"Proprioceptive memory is where the infolded limits of the body meet the mind's externalized responses and where both rejoin the quasi corporeal and the event. As infolding, the faculty of proprioception operates as a corporeal transformer of tactility into quasi corporeality...[proprioception] can be said to be the mode of perception proper to the spatiality of the body without an image because it opens exclusively onto that space and registers qualities directly and continuously as movement." Tactile sensations of a moving body in (through) space provide a moving, embodied, perspective of an affective body.
+Viscerality (interoception): "Visceral sensibility immediately registers excitations gathered by the five "exteroceptive" senses even before they are fully processed by the brain....The immediacy of visceral perception is so radical that it can be said without exaggeration to precede the exteroceptive sense perception. It anticipates the translation of the sight or sound or touch perception into something recognizable associated with an identifiable object...Call that "something recognizable" a quality (or property)...It registers intensity....Viscerality is the perception of suspense. The space into which it jolts the flesh is one of an inability to act or reflect, a spasmodic passivity, so taut a receptivity that the body is paralyzed until it is jolted back into action-reaction by recognition. Call it the space of passion." Pre-cognitive affects pass through the visceral system before cognitively processed in the brain: our gut signals us to flee before we know that we are scared.
+----
+'''Haraway:''' ''Cyborg Manifesto:'' Terry
+Taking a feminist standpoint, Haraway proclaims and celebrates the fusion of humanity and technology and in doing so, dismisses those feminists who look to a pre-technology golden age when the "Goddess" was worshipped ("I would rather be a cyborg than a Goddess", she says). Old dichotomies (human/machine, human/god, man/woman) disappear in a postmodern melange -- all is fluid, all is ambiguous. Gender is a construct, as is the body. And following from this, we can rewrite our bodies and our societies. "Biological organisms have become biotic systems, communications devices... there is no fundamental, ontological separation in our formal knowledge of machine and organism, of technical and organic." The machine is not an other, so we neither have to worship it or fear it. Instead, we should use technology to enhance our bodies and our lives. "The machine is us, our processes, an aspect of our embodiment."
+----
+'''Hayles:''' ''How We Became Postmodern,'' Ch.3 (Contesting for the Body of Information: the Macy Conferences on Cybernetics)
+----
+'''Wolfe:'''
+Wolfe combines animal studies with systems theory.
+----
+'''Fraser & Greco:''' ''The Body: A Reader:'' Intro: Tyler
+'''Fraser & Greco:''' ''The Body: A Reader:'' Bodies, Disabilities: Terry
+''Bodies, Disability and Spaces'', by Peter Freund, argues that the concept of disability is fluid. The body cannot be separated from its social or structural environment, and ability/dis-ability depends on the context. A wheelchair is enabling, just as a pair of eyeglasses is enabling, whereas urban built environments are dis-abling for many: "modern landscapes seem to be designed for forty-year-old healthy males driving cars." Disability, Freund says, is a normal, near universal condition and will affect nearly everyone eventually.
+----
+'''Heller-Roazen:''' ''The Inner Touch:''  Awakening... (Ch 7)  Suk Kyoung
+''summary:''
+Marcel Proust, Paul Valéry, Walter Benjamin (from a German text Gesammelte Schriften, which translates in google as ‘Writings’), and briefly, Kafka, are connected in this rapid literary shock of awakening that is stylistically, poetically, and philosophically fascinating.
+''notes:''
+.RE-awakening
+Having us first awake as giant bugs, Kafka leads off this poetic essay on the transliminal sensation of awakening, which Heller-Roazen next captures in an amazing sensorial passage from Proust,
+“…in a second, I passed through centuries of civilization, and the image confusedly glimpsed of oil lamps, then of wing-cellar shirts, gradually recomposed the original features of myself.”
+Proust writes on the moment of awakening, “since I did not know where I was, I did not even understand in the first moment who I was”, and Heller-Roazen observes from Proust that awakening brings forth the “merest sensation of being.”
+Next, Paul Valéry  sees this re-constitution of self, the astonishment with which the end of sleep is sensed, as the shock of alignment of “what was” with “that which is.”  Sleep ends in wakening, “the origin of the progressive recomposition of the self that defines the waking state. “ (H-K, p.75) For Valéry, “waking means re-covering” (interesting in terms of Deleuze here) and that psychology is a RE-cognizing of oneself. But Heller-Roazen points out that ‘in order for something to be re-cognized, re-formed, re-trieved, it must have been irrevocably lost as any other condition suggests continuity in some way, but not re-constitution or re-covery.’ For Valéry “Memory is the gift of the return to the same. Its great affair is not the past but the re-present. That is why it returns from the past and never climbs back up to it.”
+This is Valéry’s autogenesis – the emergence of an unfounded self, a re-formed ‘I’ wherein “One should not say I wake, but There is waking - for the I is the result, the end, the ultimate Q.E.D. …” Valéry’s account is therefore that ‘the self comes to be in awakening and for this reason cannot be said to occasion it’ in other words, sensations arise outside the self.
+Walter Benjamin then observes that as it is “an implicit presupposition of psychoanalysis that the contrary opposition of sleep and waking has no validity for the empirical forms of human consciousness” then there must be an “infinite variety of concrete states of consciousness, which are conditioned by all possible centers, through all conceivable degrees of being awake." H-K points out that if one admits the existence of degrees of consciousness, then these degrees must extend to both dreams and wakefulness; that we may dream while awake and wake while dreaming.
+"The coming awakening," Benjamin wrote, "stands in the Troy of the dream like a wooden horse of the Greeks."  Heller-Roazen summarizes, ‘one creature stealthily crouched within the dormant imagination of another’… marking a ‘secret chance to awaken’, a gateway to the feeling of existence.
+'''Heller-Roazen:''' ''The Inner Touch:''  The Unnamed King (CH 14) D'Arcy & Mark
+The chapter begins by describing the takeover of the Mediterranean by the Arabs and how they translated almost all the Greek writings into Arabic. The hunger for knowledge both from a scientific and social aspect has led many to believe that the "second classical language" should have been Arabic and not Latin. The Arabs did not merely translate the ancient writings but also built upon in their Falsafa (a word in Arabic which translates to Philosophy).  The great Arabic philosophers were also very tuned to the human senses. "Sensation" for them is what set animals apart from plants. They went beyond the five senses we are familiar with and developed a system of "internal senses / imaginative faculty" . These senses consisted of imagination, cognition, and memory. These internal senses had a direct connection to our soul. The chapter also describes how the term "common sense" was derived. In the Book of Elements, written by the Arabic philosopher and physician Issac ben Solomon Israeli, he describes it as information received from the corporeal senses (such as sight) is sent to the spiritual senses (imaginative faculty) and the interpretation is considered to be "common sense", deciphering using the external and internal > corporeal & the incorporeal.
+In other books written by the great Arabic philosophers, it states that the five senses can be thought of as Servants, each reporting a different kind of information to the Master, the overseer of the human mamlakat : an Arabic and Persian word for kingdom. The Master or Malik (King) rules over these senses (advisors/servants) and holds the power of translation and perception, the key to our soul. And without this "unnamed King" the animal soul would not exist.  (Mark Nazemi)
+'''Heller-Roazen:''' ''The Inner Touch:'' Thorns (Ch 19) Suk Kyoung
+''summary:''
+In this essay, Heller-Roazen describes the linguistic and philosophical foundations of Leibniz’ theory of a continuum of consciousness, passing  from the reflective unawareness of Liebniz’ basic soul-particle, the Monad, called perception, to reflexive awareness, called apperception or consciousness.  The arousal of consciousness is then the affective response to infinitely small sensations passing a threshold of unease.
+''notes:''
+Leibniz - Basic unit of universe is Monad, a soul-particle of infinitely small sensation ‘unaccompanied by awareness or reflection’,  “a living mirror representing the universe according to its point of view, and above all with respect to its body.”
+L. argues that ‘small sensations’ (those just at the ‘threshold’ of perception) are the metaphysical elements that form the relationship between the mind and body.  Leibniz sees only 3 possible relationships:
+. Descartes. The “thinking thing” that is mind somehow connected to “extended thing” (body): “the influence of one on the other.”
+. Malebranche. Devine mediation. What happens in one is represented in the other by an external mediator (no direct interaction), “occasional causes.”
+. Leibniz. Harmonious independent interaction between body and soul (players in orchestra analogy).
+The concomitance of substances constitutes the metaphysical foundation of small perceptions.
+Therefore, “given the exact and constant harmony between the body and the soul, such corporeal events must employ corresponding affections of the psyche” (p. 194) as any other relationship suggests that there are definable limits on the union of the soul and body, which is untenable with the concept of an incorporeal soul, as there ‘can be no proportion between incorporeal substance and the modification of matter.’
+Therefore, nothing that takes place in corporeal substance can be too small to be felt – every change must have a correlate, affective even if imperceptible.
+Leibniz argues (in the analogy of a dog struck by surprise by its master) that if the soul is “a living mirror representing the universe according to its point of view, and above all with respect to its body” that the movement of the approaching body (presence) is reflected in the body and soul and represented with continuously increasing clarity – a single continuum from pleasure to pain that is incessant.
+Locke# – discussing the determination of Will, states that the motive for continuing in the same State or Action is the present satisfaction in it; in the motive to change there is always some uneasiness.
+Therefore, Will is not a property of the greater good but one of a reaction to uneasiness, whether that pain is of the body or ‘disquiet’ in the mind (pain and desire, both states of this uneasiness, are hardly distinguishable).
+From Locke’s term ‘uneasiness’  Leibniz draws out the meaning of ‘unrest/disquietude’, which suggests more clearly a sense of continuum between pain and desire, a continuum which provokes a perpetual  oscillation of an upsetting of balance that results in an attempt to return to a best possible state.
+‘Uneasiness’ – unrest, disquietude – is then “the natural state of a substance that represents the created world in its totality, but only indistinctly … the state of the soul perpetually affected by the countless ‘”small perceptions” and “the infinity of affections that form the indistinct background of every conscious perception.” (p. 198)
+Leibniz builds on Locke’s idea of ‘uneasiness as the spur to action’ to state that it is this multitude of ‘little unconscious points’ that define the ‘happiness of creatures’; without all these ‘thorns of desire’ consciousness would lapse into the insensible and stupid (unchanging might be another useful adjective.)
+Heller-Roazen reminds us that the distinction between that of which we are aware and that which we are not is itself a ‘thorn’ of philosophy. Between the conscious and the unconscious Leibniz sees only degrees of difference, a continuum from one to the other which he called the ‘Law of Continuity’, meaning that ‘one always passes from the small to the large through the intermediary.’  Therefore, the ‘noticeable’ arises from the ‘unnoticeable’.
+Leibniz draws from this the idea of a threshold of sensation, which crossed gives rise to an awareness of the sensation and of being aware of noticing. This arousing of consciousness, Leibniz terms “apperception” – distinguished from the ‘reflective’ state of perception.
+Kant however shifted the content of this term on Western philosophy to become more referent to a ‘unity’ of consciousness:  the ‘self consciousness that produces the representation I think’ (thus placing perception and apperception into one field discontinuous from any thing that does not think.)
+Leibniz however was clear that his meaning is that perception is ‘the inner state of the Monad representing external things’ and apperception is the ‘reflexive knowledge of this inner state of the monad’, and that only apperception is ‘consciousness.’ Leibniz thus maintains an ontological state of “perception” with no awareness but in which there never cease to be “small perceptions of which one is not aware” distinguished from the awareness of “apperception.”
+This however constitutes a state which the Cartesian philosophers cannot admit; to accept Leibniz’ definition of apperception is to ‘accept its constitutive relation of difference from, not opposition, to “perception”’ – to accept the notion of continuity, that consciousness may include’ lesser beings’, other awareness residing as yet unknown within the ‘noble thing called consciousness.’ In other words, consciousness only intermittently emerges from and always returns to the unconscious.
+This position however is not popular with Cartesian dualism’s doctrine that ‘only man truly has a soul’ as it leads from the perception of animals by continuity to the souls (arising of consciousness) in beings other than man.  Leibniz states he does not understand “why men find it so repugnant to accord the bodies of other organic creatures immaterial imperishable substances.”
+Leibniz replaces the Cartesian opposition between the “thinking being” and the “extended being” with a threefold hierarchy of substances; three varieties of Monad: Simple monads reflect without awareness, and perceive without apperception. The next distinguishing monad is one in which sensation becomes more distinct and is accompanied by memory (animals), and the next contains the knowledge of eternal and necessary truths, the capacity to reason, and is what is termed ‘consciousness’.
+At what point Leibniz places his ‘threshold’ of apperception however is unclear - somewhere between the sharp thorns of awareness and the attendant forgetfulness of the passage.
+'''Heller-Roazen:''' ''The Inner Touch:''  Of Flying Creatures... (Ch. 21) Jay
+Philosophy uses techniques to separate objects of study (looking at the world as a naive observer, imagining an object floating in space, etc.)
+By theoretically propelling a man in the void, we get a new view of context-less self.  "What is self without any input / sensation"?
+Over time, this approach to thinking about self dissolved.
+Late 18th century, a new problem arose (Condillac)... We don't remember our birth ignorance, yet now we know things.  How did we learn that we had learned, if we didn't already know what learning was?
+Condillac created a work centered around a marble-man whose senses were limited, and asked readers to imagine this being as a thought experiment.
+Condillac's experiment led to an original question on body ownership: how does one find out that their body is their own while simultaneously defining that which is not self?
+If it is, in fact, a process of discovery, then a "body in space" which receives no sensation or exploration would believe in a "uniformity"; a reality which does not draw this line.  The line is drawn by dynamics.  Change in sensation.
+In Heidegger's terms, knowledge of what is frequently ready-to-hand, and which changes are present-at-hand.
+Condillac's conclusion: if the body has a "hand", it will be able to feel, to reach out and touch.  If the body is in space, it can still touch itself and discover its body.  Touching his chest, the marble statue will realize that there is "self" in both hand and chest.
+Touching other objects do not have the same dual response, and thus they are not "I"
+The hand can then creep without crossing borders and find the truth of body, crawling from chest to shoulder to elbow etc.
+Discovery of self:
+. discovers extension through tactile perception of objects
+. discovers its own extension through tactile perception of its own parts
+. discovers the "body" through realizing the continuity of parts and their relationship to eachother.
+Further philosophers adopted this "statue" or "body in space" approach, without knowing its history before Condillac.
+Tracy suggested that "resistance" actually placed a meme of self in any contact; even when touching an inanimate object, the resistance implied a "self".
+Biran suggested that one's own weight and muscle opposition would provide resistance, even in a vacuum, establishing self/body.
+Condillac DID describe a "fundamental feeling", a sense in the absence of all others, but he said that it would not lead to perception of body and parts (he called it "confused").
+[interesting, i think eastern philosophers would call it enlightenment... a sense of being without any borders being drawn between entities... "oneness" ?]
+Biran would argue with Condillac and Descartes, suggesting that a being which is self-aware must know its body: how could one move a hand to discover when unaware of that hand's existence?
+Biran suggested there was an "absolute sensation of existence" - a fundamental sense of self.  The inner touch.  Criticizes descartes focus on thought with a first principle of being as "subjective existence", implying a body.
+Immediate Apperception, he called it.  An internal localization of body parts which extends without limit.  The discovery of body is an appropriation of that which is present-at-hand.
+Still, it's a line in the sand.  It's a vague/obscure feeling, as no clear distinction can be made.  We all are in space, except we have appropriated a body.
+'''Heller-Roazen:''' ''The Inner Touch:''  The Anaesthetic Animal (CH 24) Tyler
+Begins with the Aristotelian notion that humans are "sensible creatures".  The rest of the chapter delves into various forms of depersonalized states where the individual does not connect to their own senses. One person even suggests that they feel like there is a "barrier" between him and his feelings. The author indicates that these depersonalization disorders are on the rise, and pose a new ethical dilemma that the "sensible creature" that is human may not feel as much as we think we do.
+----
+'''Wilson:''' ''Psychosomatic:'' Brain in the Gut: D'Arcy
+----
+'''Wallace:''' ''The Taboo of Subjectivity:'' Scientific Paradigms: Intro & Chapter 1: Suk Kyoung & Lonnie
+B.  Alan Wallace, Alan B. The Taboo of Subjectivity: Toward a New Science of Consciousness.  Oxford University Press, 2000.
+In ''The Taboo of Subjectivity'', B. Alan Wallace (Ph.D. Stanford University, Department of Religious Studies, and Scholar of Tibetan Buddhism) examines the differing positions on human consciousness posited by religious and scientific epistemologies. Wallace begins by pointing out that any direct evidence we have for the existence of consciousness consists of non-scientific, first-person accounts of ''being conscious'': There is no scientific evidence for the existence of consciousness.
+The ‘subjective’ therefore, is tied to the notion of ‘free will’, and individual moral responsibility, where the ‘objective’ is the state and belief that all mental behaviour is produced strictly by the brain's response to physical stimuli in accordance with the laws of nature. Yet what is the nature of belief?
+Wallace defines subjectivity as referring “to all conscious and unconscious personal influences, including individual consciousness itself, and all personal, individual goals, attitudes, and points of view. As such, each instance of subjectivity is confined to a specific locality in both time and space.”  (p. 21)
+Wallace distinguishes four elements or dimensions of scientific tradition, ranging generally from unbiased epistemological inquiry to a limiting fundamentalist normatization of thought. These dimensions are:
+.	''Science per se'', a discipline of inquiry holding the notion of the disengaged impartial observer as primary to investigation of any question, one that holds the philosophical tradition of scepticism and rational, ‘informed confidence’ as its ideal viewpoint, and that values verifiability of its observations through empirical feedback.
+.	''Scientific Realism'', which holds that the objects of scientific inquiry are believed to exist objectively, independent of any descriptions or interpretations imputed upon them by any external subjective observer.
+.	''Scientific Materialism'', which Wallace (drawing from work by sociologist Emile Durkheim) argues is a metaphysical stance that has developed from and replaced prior religious dogma, placing the once sacred subjective sensory experience of the world into the realm of the profane and the scientific material world of quantifiable rationality into the realm of the sacred. To do so, subjectivity has been made taboo, in order to protect the sacred.
+.	''Scientism'', the assertion that science is our ''only'' source of genuine knowledge about the world, which Wallace attributes to the secular ideological foundations of Auguste Comte’s Positivist sociology. Disbelief in this assertion is treated by its adherents as a sign of ignorance or stupidity, resulting in the marginalization of other (subjective) views. Scientism adopts an absolutist perspective on reality and denies the value of all other avenues of inquiry and knowledge, and is therefore a kind of scientific fundamentalism. Wallace suggest that “advocates of scientism commonly overlook the subjective, human role of choosing which natural phenomena to investigate, the means of investigating them, and the diversity of human interpretations of research data.” (p. 39)
+Durkheim posited the notion of ''mana'', a transpersonal, universal force that is central to all religions, its chief representation being the ''totem'', “the means by which an individual is put into relations with this source of energy."  Durkheim asserts that the concept of ''mana'' is the precursor of the scientific concept of energy. Its essential characteristic is that it is located nowhere definitely yet is everywhere present.
+Wallace suggests science's totem is ''scientific method'', "the means by which an individual is put into relations with this source of energy."  "With the development of the principle of energy conservation in the nineteenth century, a single and universal concept of energy was conceived, exerting a powerful unifying influence on the sciences."
+Wallace defines "dogma" to mean a “coherent, universally applied worldview consisting of a collection of beliefs and attitudes that call for a person's intellectual and emotional allegiance (p.22).”  Scientific Materialism then, and it’s Totem, scientific method, the essential theme of Wallace’s argument, is deconstructed into a series of ‘Metaphysical Principles’ that constitute the dogma of this historically recent religiosity:
+The Principle of Objectivism:
+Science deals with empirical facts testable by empirical methods and verifiable by third-person means.
+However, there are many other empirical facts—most obviously, our own subjective mental events—that are accessible only by first-person means.
+The Principle of Monism:
+Quantifiable, regular laws govern the course of events in the universe uniformly throughout all of space and time.
+The Principle of Reductionism:
+Asserts that macro-phenomena such as the behaviour of human cells are the causal results of micro-phenomena (the behaviour of the elementary particles that constitute the cells).
+The Closure Principle:
+The physical world is "causally closed"—there are no causal influences on physical events besides other physical events.
+The Principle of Physicalism:
+Only physical objects and processes exist; everything that exists is quantifiable.
+Wallace ties these metaphysical principles to a ‘marginalization of the mind’ in science (and therefore in culture), noting that ‘the emergence of consciousness during the course of cosmic evolution is attributed solely to the laws of physics, which over the immensity of time give rise to a nearly infinite complexity that is purportedly sufficient to give rise to consciousness.’ Wallace observes that this “explanation" places an enormously heavy burden on the term "complexity", though I am not sure that the terms used by ‘previous’ religions were any less ‘heavy’.
+An astute central recurring objection raised by Wallace is that “the central aim of science is to understand and control the objective, physical world; yet the subjective mind, with its powers of observation and reasoning, is, awkwardly, the fundamental instrument of scientific inquiry.” (p. 29)
+(SKC)
+----
+Wilson, '''Stress and Neurological Kindling''' (Terry): Wilson discusses the kindling model for depression, where small stimuli over time can cause physiological changes to the brain that make it easier for depression to occur and to be triggered by non-depressive incidents. Emotional states can affect the physical structure of the brain -- and vice versa. "The induction can take place through a series of small stimuli, none of which at first causes overt symptoms… Illness, once expressed, can become responsive to ever smaller stimuli and, in time, independent of stimuli altogether… Even the early stimuli are translated into anatomical, difficult-to-reverse changes in the brain." The kindling model locates psychopathology directly in somatic encoding: "scars are not, or not only, in cognitive memory… The scar consists of changed anatomy and chemistry in the brain. Some of that brain change is memory: presumably recollected thought and emotion are encoded in ways that bear resemblance to the kindling model." Implicit in Wilson's argument (though not stated) is that if this can happen for depression, why can it not happen for other emotions as well -- happiness, joy, fear, hate, etc.?
+----