HighTech-ON-Live: games

Showing posts with label games. Show all posts

Sunday, April 22, 2012

Children's Drawings Projected on Buckingham Palace and BBC's Public Big Screens in the UK

Children's self-portraits cover Buckingham Palace (News UK)

Children in the UK were asked to create self-portraits for a special arts project designed to celebrate the Queen's Jubilee. The self-portraits were digitized and transformed to create a media facade that was projected on Buckingham Palace. This example of digital art for public viewing was shared on a number of large screen displays in public spaces around the UK.

This project was part of Face Britain. All children in the UK were invited to submit a self-portrait in an attempt to create the largest on-line gallery of self-portraits in the world.

Below is a video about the media facade:

Photo credit: Face Britain
FACE BRITIAN video:

from Children & the Arts on Vimeo.

RELATED
Below are some examples of how BBC's large displays are used for interactive games in public spaces:

BBC's Big Screen Games in Public Spaces:

Wednesday, March 14, 2012

Future of Gaming Report SlideShare, from PSFK

PSFK"s Future of Gaming Report [Preview]

View text version View more presentations from PSFK

RELATEDPSFK WebsiteGaming for Good - Piers Fawkes, PSFK. 3/10/12

Tuesday, March 13, 2012

IXDA Interaction Awards Winners, 2012: LoopLoop, an interactive music toy app by Stimulant/Sifteo, was best in show!

The Best in Show winner of IXDA's 2012 Interaction Awards was LoopLoop, an interactive music sequencer application for children, created by designers at Stimulant in collaboration with Sifteo.

Stimulant LoopLoop for Sifteo from Stimulant on Vimeo.

RELATED
What are the best examples of interaction design? - Sam McNerney, PSFK, 3/9/12The videos featured in Sam McNerney's post were created by Christian Svanes Kolding for the Interaction Design Association (IXDA) as part of the first annual Interaction Awards in Dublin, Ireland.

IXDA: Interaction Design Asociation
IXDA Interaction Awards
Stimulant Website
LoopLoop For Sifteo Cubes
LoopLoop, an upcoming application produced by Stimulant with the Sifteo SDK
Sifteo Creativity Kit

Saturday, October 22, 2011

Make and Share Your Games Online! Update: Game Creator and the Cartoon Network Website

I came a cross the Cartoon Network's Game Creator website a couple of years ago and thought I'd take a look at how it has grown since my last peek. If you are a kid, educator, or parent, take a look at the updated links below.

As I mentioned in a previous post, some educators might frown upon games and cartoon-related content. The combination of games + cartoons might not be so bad, especially when the activity is something that can be shared in a social context. By participating in the creation of digital games, young people are provided with skills that might just entice them to consider learning more about STEM-related fields. (STEM = Science, Technology, Engineering, and Math)

About Game Creator
According to the website, the Cartoon Network's Game Creator is "an application that gives you the power to create your own action games and share them with the world. It leads you through a simple, six-step process and gives you a set of easy-to-use tools to customize your game however you wish. When you finish building a game, you can send it to Cartoon Network's game gallery for other fans to play and rate. The gallery makes it easy for you to play other people's games, rate them, sort them and even share them with your friends."

Ben 10 Game Creator
Parent Information (Ben 10 Game Creator Website)
Clone Wars Game Creator
Parent Information (Clone Wars Game Creator)
Batman Game Creator
Parent Information (Batman Game Creator)
Game Creator Central

Cartoon Network

Lynn Marentette, Interactive Multimedia Technology, 4/25/10

Ben 10 Alien Force Game Creator from Cartoon Network: Social Game Creation Online for Kids!

Lynn Marentette, Interactive Multimedia Technology, 7/13/09

SOMEWHAT RELATED

MIXIT Video Creator (Cartoon Network)

Cartoon Network International Sites

Flash Classroom Jeopardy Game Maker

10 Truths About Books and What They Have to Do With Video Games
James Paul Gee, 5/15/11
"There are 10 key truths we know about books. They happen to be equally true of other "meaning making technologies" like television and video games. Thus, in these 10 ways, books and video games are the same." -James Paul Gee

Friday, September 16, 2011

MindHabits Online Demo: Useful Serious Game for Social Skills Group Activities

I'd like to share the on-line demo of MindHabit's suite of serious games that I've found useful in my work with teens and young adults who need support in the area of social-emotional skills.

What I like about the online demo is that it adjusts to the player's responses. This feature made it fun to use during the last few social skills groups I facilitated at work, since it could be played by students with a range of cognitive abilities. I had students take turns playing the game using a SMARTboard, and found that all of the students paid attention to what was going on. In my opinion, using the interactive whiteboard supported "off-the-shoulder" learning among the students who were not at the board.

MindGames is available for Windows and Macs, and the full version is just $19.99 and provides 100 game levels. The full version tracks progress and includes four games.

Here's some information from the company's website:
"Based on social intelligence research conducted at McGill University, these stress busting, confidence boosting games use simple, fun-to-play exercises designed to help players develop and maintain a more positive state of mind."
"Based on the principles of social intelligence: Inhibition - uses game mechanics to promote positive habits; Association - connects personal info to positive feedback; Activation - uses personal references"

You are playing the MindHabits Trainer online demo. Your progress will not be logged beyond this session.

Upcoming:

Interview with Guillaume Largillier about Stantum's multi-touch tablet.
Collaboration with Stevens Institute of Technology, focusing on a serious game project to support learning of "on-the-job" social skills for teens and young adults with autism spectrum disorders and related challenges.
More news about large interactive displays, multi-touch, and gesture applications/installations.
Cross-platform/device interactive "TV".
Cathy Davidson's new book: Now You See It: How The Brain Science of Attention Will Transform The Way We Live, Work, and Learn (Viking)

Tuesday, May 31, 2011

Tuesday, May 3, 2011

CHI 2011 Workshop Program and Related Links: UI Technologies and Impact on Educational Pedagogy, Related Child-Computer Interaction Papers and Courses

WORKSHOP PROGRAM
CHI 2011 will be held at the Vancouver Convention Centre in Vancouver. The UI Technologies and Pedagogy workshop will be held on Saturday, May 7th, in the West Building, Level 1, Room 119/120.  PDF versions of the following presentations can be found on the workshop's website.

9:00am – 09:05am Introduction
Edward Tse and Johannes Schöning
9:05am - 10:05am Paper Session I (8 min presentation, 4 min Discussion)
Chair: Yvonne Rogers
Evaluating Pervasive Classrooms
• Son Do-Lenh et al.: Classroom-experience evaluation: An ecological approach to evaluating pervasive technologies in classrooms
• Kathryn Rounding et al.: Evaluating Interfaces with Children
• Dan Morris et al.: Using Machine Learning to Scaffold Artistic Creativity in Education
• Tamara Polajnar et al.: Enabling Picture-based Querying and Learning with the JuSe Interface
• Hamed Alavi et al.: Lantern 2.0: A Pervasive Scripting Tool
•Quincy Brown et al.: Mobile Natives: Unlocking the Potential of Educational Technology
10:15am - 11:00am Coffee Break and Preparation time for short talks
11:00am - 12:10pm Paper Session II (8min presentation, 4min Discussion)
Chair: Max Mühlhäuser
Collaboration in Math: Fears, Myths, and Insights.
• Nicola Yull et al.: Pass the iPad: Comparing collaboration on paper and screen
• Veronika Irvine et al.: Math Education: A Creative Approach
• Group talk: Math and Embodied Agents
a.Kristina Richter et al.: Bridging Diagnosis and Learning for Mathematics Education in Classroom Setting
b.Lisa Anthony et al.: Handwriting Interaction for Math Tutors: Lessons for HCI in Education
c.Andrew Jensen et al.: Using Embodied Pedagogical Agents and Direct Instruction to Augment Learning for Young Children with Special Needs
• Group talk: Dispelling Myths About the Next Generation Classroom
a. Alex Thayer et al.: The Myth of the Paperless School: Replacing Printed Texts with E-readers
b.Sharon Oviatt: Designing Digital Tools for Thinking, Adaptive Learning and Cognitive Evolution
c.Alexandra Dunn et al.: Designing Classroom Technology to Meet the Needs of All
• Group talk: Games, Wearables and Fun Learning.
a.Christiane Moser et al.: Child-Centered Game Development
b.Lizbeth Escobedo et al.: Blue’s Clues: An Augmented Reality Positioning System
c.Si Jung Kim et al.: Wearable Story: A Story Telling Jacket for Young Children to Improve Their Independent Physical and Learning Activities
12:10pm - 1:30pm Lunch
1:30pm - 2:30pm Paper Session III (8 min presentation, 4 min Discussion)
Chair: Richard Beckwith
Tangibles and Tabletops
• Izdihar Jamil et al.: Communication Patterns in Collaborative Peer Learning around Interactive Table
• Aura Pon et al.: Graspable Music and Vuzik: Music Learning and Creativity using an Interactive Surface
• Ahmed Kharrufa et al.: Learning at interactive surfaces and designing for reflection
• Cristina Sylla et al.: TOK – a Tangible Interface for Storytelling
• Group talk: Tables and Tangibles
a.Robert Sheehan: Constructionism, Programming and Touch Interfaces
b.Orit Shaer et al.: Making the Invisible Tangible: Learning Biological Engineering in Kindergarten
c.Sebastien Kubicki: Evaluation of an interactive table with tangible objects: Application with children in a classroom
d.Cristina Emilia Costa et al.: I-Theatre: developing narratives skills in kindergarten children
e.Wooi Boon Goh et al.: Potential Challenges in Collaborative Game Design for Inclusive Settings
2:30pm - 3:00pm Coffee Break
3:00pm - 4:00pm   Breakout Discussion (What are future challenges? Next years workshop?)
4:00pm - 4:45pm   Closing Keynote by Allison Druin: Mining the Imagination from Time Travel to Anti-gravity: The Future of Child-Computer Interaction
"If you’ve ever sat with a child imagining the future of new technologies, you will undoubtedly hear about “anti-gravity machines,” “peace-technologies that work by tickling people,” “backpacks of the future with ice cream makers,” and “time-travel-mobile-phones that when you call someone it takes you back in time.” The question is how can these child-like imagined technologies lead us to real answers for the future?

In my talk I will propose that “data mining” is not enough, that “mining the imagination” is critical to understanding the future. I will describe the “iChild” and the interactive, independent, international, imaginative child we need to consider designing for in the future. If we look for real change, we need to listen to children, not because they know more, but because they can help us question, explore, and push us in true directions for change."

Allison Druin is an Associate Dean for Research in the iSchool at the University of Maryland and is Director of the Human-Computer Interaction Lab. For almost 14 years, she has led an intergenerational research team, where children, ages 7-11 years old partner with an interdisciplinary group of adult researchers to develop new technologies for children. With this team, she has helped to developed new digital library and storytelling tools with such partners as the U.S. National Park Service, Sesame Workshop, Nickelodeon, Nokia, UNICEF, and many others. In 2010, she received with Ben Bederson the SIGCHI Social Impact Award for her work leading the International Children’s Digital Library (www.childrenslibrary.org).
4:45pm - 5:00pm Closing Remarks (All)
7:00pm Optional Workshop Dinner

RELATED CHILD-COMPUTER INTERACTION SESSIONS AT CHI 2011
CHI 2011 will be offering a variety of opportunities for people interested in interaction design and technologies for children. Detailed information regarding the researchers/ presenters can be found on the IDC-SIG News/Events page.

CHI2011 COURSE - Evaluating Children's Interactive Technology
Monday 9th May 2011 - 16:00
Janet C Read - University of Central Lancashire
Panos Markopoulos - Technical University of Eindhoven
CHI2011 COURSE - New Methods for Designing for and with the iChild: Strategies for Today’s Mobile, Social, and Internet Technologies
Thursday 12th May 2011 - 09:00
Allison Druin - University of Maryland
Jerry Fails - Montclair State University
Mona Leigh Gubler - University of Maryland
CHI2011 Paper Session - Engaging Youth Thursday 12th May 2011 - 11:00
Exploratory Evaluations of a Computer Game Supporting Cognitive Behavioural Therapy for Adolescents
In the Mood: Engaging Teenagers in Psychotherapy Using Mobile Phones
Breaking Boundaries: Strategies for Mentoring through Textile Computing Workshops
Brick by Brick: Iterating Interventions to Bridge the Achievement Gap with Virtual Peers
CHI2011 - Other IDC Related Papers
Paper Session: Art, Music and Movement: Monday 9th May 2011
MOGCLASS: Evaluation of a Collaborative System of Mobile Devices for Classroom Music Education of Young Children
MoBoogie: Creative Expression Through Whole Body Musical Interaction
Paper Session: Low-cost ICT4D Tuesday 10th May 2011
Utilizing Multimedia Capabilities of Mobile Phones to Support Teaching in Schools in Rural Panama
Infrastructures for low-cost laptop use in Mexican schools
Paper Session: Storytelling and Perceptual Crossing Wednesday 11th May 2011
ShadowStory: Creative and Collaborative Digital Storytelling Inspired by Cultural Heritage
Paper Session: Learning
Practical, Appropriate, Empirically-Validated Guidelines for Designing Educational Games

CHI2011 Paper Session - Families Tuesday 10th May 2011 - 11:00

Learning Patterns of Pick-ups and Drop-offs to Support Busy Family Coordination

Mediated Parent-Child Contact in Work-Separated Families

Hello, is Grandma there? Let’s Read! StoryVisit: Family Video Chat and Connected E-Books

Family Portals: Connecting Families Through A Multifamily Media Space

If these topics interest you, consider making plans to attend IDC 2011!
IDC 2011: The 10th International Conference on Interaction Design and Children
June 19-23, University of Michigan (My alma mater!)

Tuesday, March 29, 2011

Program- CHI 2011 Child Computer Interaction: 2nd Workshop on UI Technologies and Educational Pedagogy

CHILD COMPUTER INTERACTION: 2ND WORKSHOP ON UI TECHNOLOGIES AND THEIR IMPACT ON EDUCATIONAL PEDAGOGY

May 7, 2011

In conjunction with CHI 2011, Vancouver, Canada

PROGRAM (Draft)

9:00am – 09:05am Introduction

9:05am - 10:05am Paper Session I (8min presentation, 4min Discussion)

Evaluating Pervasive Classrooms

• Son Do-Lenh et al.: Classroom-experience evaluation: An ecological approach to evaluating pervasive technologies in classroom
• Kathryn Rounding et al.: Evaluating Interfaces with Children
• Dan Morris et al.: Using Machine Learning to Scaffold Artistic Creativity in Education
• Tamara Polajnar et al.: Enabling Picture-based Querying and Learning with the JuSe Interface
• Hamed Alavi et al.: Lantern 2.0: A Pervasive Scripting Tool

10:05am - 11:00am Coffee Break and Preparation time for short talks

11:00am - 12:10pmPaper Session II (8min presentation, 4min Discussion)

Collaboration in Math: Fears, Myths, and Insights

• Nicola Yull et al.: Pass the iPad: Comparing collaboration on paper and screen
• Veronika Irvine et al.: Math Education: A Creative Approach

• Group talk: Math and Embodied Agents
a. Kristina Richter et al.: Bridging Diagnosis and Learning for Mathematics Education in Classroom Setting
b. Lisa Anthony et al.: Handwriting Interaction for Math Tutors: Lessons for HCI in Education
c. Andrew Jensen et al.: Using Embodied Pedagogical Agents and Direct Instruction to Augment Learning for Young Children with Special Needs

• Group talk: Dispelling Myths About the Next Generation Classroom
a. Alex Thayer et al.: The Myth of the Paperless School: Replacing Printed Texts with E-readers
b. Sharon Oviatt: Designing Digital Tools for Thinking, Adaptive Learning and Cognitive Evolution
c. Alexandra Dunn et al.: Designing Classroom Technology to Meet the Needs of All

• Group talk: Games, Wearables and Fun Learning.
a. Christiane Moser et al.: Child-Centered Game Development
b. Lizbeth Escobedo et al.: Blue’s Clues: An Augmented Reality Positioning System
c. Si Jung Kim et al.: Wearable Story: A Story Telling Jacket for Young Children to Improve Their Independent Physical and Learning Activities

12:10pm - 1:30pm Lunch

1:30pm - 2:30pm Paper Session (10 min presentation, 5min Discussion)

Tangibles and Tabletops
• Izdihar Jamil et al.: Communication Patterns in Collaborative Peer Learning around Interactive Table
• Aura Pon et al.: Graspable Music and Vuzik: Music Learning and Creativity using an Interactive Surface
• Ahmed Kharrufa et al.: Learning at interactive surfaces and designing for reflection
• Cristina Sylla et al.: TOK – a Tangible Interface for Storytelling

• Group talk: Tables and Tangibles
• a.Robert Sheehan: Constructionism, Programming and Touch Interfaces
• b. Orit Shaer et al.: Making the Invisible Tangible: Learning Biological Engineering in Kindergarten
• c. Sebastien Kubicki: Evaluation of an interactive table with tangible objects: Application with children in a classroom
• d. Cristina Emilia Costa et al.: I-Theatre: developing narratives skills in kindergarten children
• e. Wooi Boon Goh et al.: Potential Challenges in Collaborative Game Design for Inclusive Settings

2:30pm - 3:00pm Coffee Break

3:00pm - 4:00pm Breakout Discussion (What are future challenges? Next years workshop?)

4:00pm - 4:45pm Closing Keynote TBA

4:45pm - 5:00pm Closing Remarks

7:00pm Optional Workshop Dinner

RELATED
Workshop Website
ACM-CHI 2011 Conference Website

Thursday, February 24, 2011

Today I hooked up a Wii to the IWB in the school's therapy room. Next - a Kinect?! (Angels are welcome to help us expand the school's "games" programs for students with special needs)

Today, I hooked up our school's Wii to the newly-installed IWB in the therapy room for the first time, and used it during a session for for a social-skills activity with two students who have autism spectrum disorders. The students helped each other to create their own "Mii" avatars. I had them play the bowling game, and was impressed how this activity elicited social conversation between the students, with minimal effort on my part.

Most of students in the program at Wolfe are in grades 6-12. They have cognitive, language, and motor delays. A good number of the students also have autism spectrum disorders. Some have multiple special needs.

We have found that when our students are provided with interactive activities displayed on the large screen of an IWB, they tend to increase their level of attention to their peers and also communicate more with one-another, as well as with the teachers and staff.

By using an IWB for games at school, we are extending the reach of how this technology can be used with students who have more complex special needs. By providing a means for our students to learn to play positive games, we help them develop important physical, social, and leisure skills that they can use outside the school setting with non-disabled peers and siblings. My hunch is that the games will also help promote cognitive/problem solving skills, too.

NOTE:
The funds to purchase the Wii were donated to our school, but did not cover additional games or accessories. We'd like to purchase Rock Band and Wii Fit. We'd also like to expand our program and purchase an Xbox with a Kinect. An iPad or two would be OK, too : )

If there are any angels out there who'd like to donate funds for our "games" program at Wolfe, please contact me through my Google profile. I will connect you with the appropriate person.

Game designer/developers/researchers/students:
If you are interested in volunteering your efforts to work on a basic cooperative, pro-social game for the Kinect, SMARTTable, or interactive whiteboard, please contact me.

Tuesday, November 16, 2010

Serious Games in the K-16 Classroom: Google Tech Talks Video, via Jonathan Brill

In the following video, Victoria Van Voorhis discusses educational software and the Serious Games in Education movement:

Thanks to Jonathan Brill for the link!

SOMEWHAT RELATED
Below is a presentation I gave at the 2008 Games for Health conference:

Descriptions, stories, and links related to the screen shots of the first slide of the above presentation: (Some of the links may need to be updated.)

The science screen is an interactive 'gizmo' from Explore Learning. Something like this could be incorporated into an educational game. http://www.explorelearning.com

I’m pretty sure that the picture of the ancient building was from the VAST project, described in the article 'Reviving the past: Cultural Heritage meets Virtual Reality' by Anthanasios Gaitatzes, Dimitrious Cristopoulos, and Maria Roussou. (2002, ACM) The Foundation of the Hellenic World was involved with this project. http://www.fhw.gr/fhw/

Maria Roussou has been involved with a variety of interesting immersive projects: http://www.makebelieve.gr/mb/www/profile/index.html

The people from the Institute for Advanced Technologies in the Humanities at the University of Virginia are doing similar work through the Rome Reborn project:
http://www.romereborn.virginia.edu/

Note: I thought that it would be cool to have a game for health that integrated with history, so that students could learn about how people from the past handled health and diseases, and learn how scientists from the past came up with solutions that help us today.

The picture of the dragons on the space station was from a game called 'Relax to Win', created by Phil (gary?) McDarby and the MindGames team when he was at MediaLab Europe, which disbanded in 2005. Here is an article about Relax to Win, from 2002:
http://news.bbc.co.uk/1/hi/sci/tech/1972571.stm
McDarby now works as the creative officer of Vyro Games, which focus on stress management.
Rationale: Stress management games are good for health!
McDarby: http://www.vyro-games.com/company/phil_bio.php
Media Lab Europe and MindGames: http://medialabeurope.org/
Vyro Games: http://ww.vyro-games.com/

The cool geometric image was from a project from the Interactive Media Group, Vienna University of Technology: Educating Spatial Intelligence with Augmented Reality http://www.ims.tuwien.ac.at/research/spatial_abilities/
The project targeted high school geometry students, with a goal of increasing spatial ability and improving transfer of learning. The program is consistent with Universal Design for Learning principles.
I think that some of the applications involved in this application could be useful in games designed for cognitive rehabilitation or habilitation. Related to this project: 'An Application and Framework for Using Augmented Reality in Mathematics and Geometry Education': http://www.ims.tuwien.ac.at/research/construct3d/ and Hannes Kaufmann’s Dissertation: Geometry Education with Augmented Reality: http://www.ims.tuwien.ac.at/media/documents/publications/...

The remainder of the pictures:
The Cloud Game: http://intihuatani.usc.edu/cloud/

The picture with the two people is from Kar2ouche, from Immersive Education. Kar2ouche is a creative role-play, picture making, story-boarding and animation software. It is enabled for use on interactive whiteboards: http://www.immersiveeducation.com/kar2ouche/

Hazmat HotZone is a multi-player simulation game used to train first responder teams: http://www.etc.cmu.edu/projects/hazmat_2005/

The underwater scene is from FreeDive, from FreeDive, that is used as a pain distractor. I also think it could be used for stress reduction for children.
http://www.breakawaygames.com/serious-games/solutions/hea...
The game pad is a DanceDance Revolution pad, used as an 'exergame' in many schools to combat the increase in numbers of students who are overweight or obese.

'Dance Dance Revolution: Healthy for Kids'
http://news.digitaltrends.com/news-article/12201/

The classroom scene is is from a virtual reality application:
Rizzo, A., Bowerly, T., Buckwalter, J., Klimchuk, D., Mitura, R., Parsons, T.D. (2006). A Virtual Reality Scenario for All Seasons: The Virtual Classroom. CNS Spectrums, 11, 1, 35-44. http://vrpsych.ict.usc.edu/

Thursday, November 11, 2010

Interactive Touch-Screen Technology, Participatory Design, and "Getting It", Revisited

I've been planning on updating one of my popular posts, "Interactive Touch-Screen Technology, Participatory Design, and Getting It" for a while.

Here is a compromise - since much still rings true two years since I wrote it, the bulk of this post remains the same. I've updated a few sections with additional video examples of interactive touch-screen applications, good and bad, along with a few links and resources, located at the bottom of the post.

(The missing piece of information? An update about apps for the iPad and similar touch-screen tablets.)

Sit back and enjoy!

http://www.ehomeupgrade.com/wordpress/wp-content/uploads/hp_touchsmart_pc.jpg

http://www.wired.com/images/article/full/2008/08/han_interview_630px.jpg

-Images: HP; Wired

There's been some discussion over the reasons why so many people don't understand touch screen, or "surface" computing, even though research in this area has been going on for years.

As the new owner of the HP TouchSmart, I know that I get it.

The research I've conducted in this area suggests that people will "get-it" only if there is a strong commitment to develop touch-screen "surface" applications through a user-centered, participatory design process. In my view, this should incorporate principles of ethnography, and ensure that usability studies are conducted outside of the lab.

This approach was taken with Intel's Classmate PC. Intel has about 40 ethnographic researchers, and sent many of them to work with students and teachers in classrooms around the world. (A video regarding ethnographic research and the Intel Classmate project can be found near the end of this post.)

http://download.intel.com/pressroom/kits/events/idffall_2008/images/Picture007.jpg

http://www.classmatepc.com/images/advocateImage.jpg

-Images: ClassematePC

Where to start?
K-12 classrooms and media centers. Public libraries. Malls. Hospital lobbies and doctor's offices. Any waiting room. Staff lounges in medical centers, schools, and universities. Community festivities and events. Movie theater lobbies. Museums and other points of interests.

I believe we need to take a "touching is believing" approach.

Here are some thoughts:
When I try to explain my fascination with developing touch-screen interactive multimedia applications, (interactive whiteboards, multi-touch displays and tables, and the like), many of my friends and family members eyes glaze over. This is particularly true for people I know who are forty-ish or over.

Even if you are younger, if you never saw the cool technology demonstrated in the movie Minority Report, or if you have limited experience with video games, or if you haven't came within touching distance of an interactive whiteboard, the concept might be difficult to understand.

The reality?
Even people who have the opportunity to use surface computing technology on large screens do not take full advantage of it. Multi-touch screens are often used as single-touch screens, and interactive whiteboards in classrooms are often serve as expensive projector screens for teacher-controlled PowerPoint presentations.

Most importantly, there are few software developers who understand the surface computing approach, even with the popularity of the iPhone and iPod Touch. Most focus on traditional business-oriented or marketing applications, and have difficulty envisioning scenarios for surface computing. There is a need for a breath of fresh air!

Another factor is that not all people entrusted to market surface or touch screen computing fully understand it.

http://blogs.msdn.com/blogfiles/healthblog/WindowsLiveWriter/MicrosoftHUGWishyouwerehereDay2_82D3/IMG_0550_thumb.jpg

Despite a cool website showing off the goods, Microsoft's Surface multi-touch table has been slow to take off, limiting hope of bringing down the price tag to a price most families or schools could afford. (The picture above depicts an application for the Surface designed for health care professionals, not K-12 science education.)

Although you can't buy a Surface table for your family room, it is possible to buy a TouchSmart. HP's TouchSmart website is engaging and highlights some examples of touch-screen interaction, but most people don't seem to know about it. (Since this post was last written, there are many more touch and multi-touch options available to the public, such as the Dell, the iPad, etc.)

Unfortunately, you wouldn't have a clue that the HP TouchSmart exists browsing the aisles at Circuit City or Best Buy!

When I was shopping for my new TouchSmart, I noticed that from a distance, the TouchSmart looked just like the other larger flat-screen monitors filling up the aisles. The salespeople at both stores were not well-informed about the system. The only reason I knew bout the new TouchSmart was related to my obsession with interactive multimedia touch-screen applications- designing them, developing them, studying them, reading about them, blogging about them.... ; }

More thoughts:

After studying HCI (Human-Computer Interaction), and relating this knowledge to what I know as a psychologist, my hunch is that the "Window Icon Mouse Pointing-device" (WIMP) and keyboard input mind-set is embedded in our brains, to a certain extent. Like driving a car, it is something automatic and expected. This is true for users AND developers. (Update - See The Post WIMP Explorers' Club: Update of the Updates for a review of a discussion among passionate post WIMP folks)

Think about it.

Suppose one day, you were told that you no longer were allowed to control your car by turning on the ignition, steering the wheel, or using your feet to accelerate, slow down, or stop the car! Instead, you needed to learn a new navigation, integration, and control system that involved waving your hands about and perhaps speaking a few commands.

For new drivers who'd never seen a car before, this new system would be user-friendly and intuitive. Perhaps it would be quite easy for 16-year-old kids to wrap their heads around this concept. For most of us, no. Imagine the disasters we would see on our streets and highways!

When we think about how newer technologies are introduced to people, we should keep this in mind.

In my mind, spreading the word about surface computing is not a "if you build it, they will come" phenomenon, like the iPhone. We can't ignore the broader picture.

From my middle-age woman's vantage point, I believe that it is important that the those involved with studying, developing, or marketing surface computing applications realize that many of us simply have no point of reference other than our experiences with ATMs, airline kiosks, supermarket self-serve lanes, and the like. (The video clip at the very end of this post provides a good example of touch-screen technology gone wrong.) -UPDATE: additional videos were added to this post.

Be aware that there are substantial numbers of people who might benefit from surface computing who prefer to avoid the ATMs, airline kiosks, and self-serve grocery shopping.

Realize that the collective experience with technology, in many cases, has not been too pretty. Many people have had such user-unfriendly experiences with productivity applications, forced upon them by their employers, that any interest or desire to explore emerging technologies has been zapped.

My own exposure to interactive "surface" related technology was somewhat accidental.
A few years ago, a huge box was deposited into the room I worked in a couple of days a week as a school psychologist at a middle school. After a week or so, I became curious, and found out that it was a SmartBoard. Until then (2002!), I did not know that interactive whiteboards existed.

The boxed remained unopened in the room for the entire school year, but no worry. I played with the only other SmartBoard in the school, and found a couple at the high school where I also worked. I hunted for all of the applications and interactive websites that I could find, and tried them out. That is when I was hooked. I could see all kinds of possibilities for interactive, engaging subject area learning activities. I could see the SmartBoards potential for music and art classes. With my own eyes, I saw how the SmartBoard engaged students with special needs in counseling activities. (By the way, if you are working with middle school students, PBS Kid's ItsMyLife website activities work great on an interactive whiteboard.)

A few years have passed, and reflecting on all of my fun experiences with interactive whiteboards, with and without students, I now understand that many teachers still have had limited exposure to this technology.

This school year, many teachers are finding themselves teaching in classrooms recently outfitted with interactive whiteboards, scrambling along with educational technology staff development specialists, to figure out how it works best with various groups of students, and what sort of changes need to be made regarding instructional practice.

For the very first time, interactive whiteboards were installed in two classrooms at one of the schools I work at. One of the teachers I know thanked me for telling her about interactive whiteboards and sharing my resources and links.

If I hadn't let her know about this technology, she wouldn't have volunteered to have one installed in her classroom. It has transformed the way she teaches special needs students.

In the few months that she's used the whiteboard, I can see how much it has transformed the way the students learn. They are attentive, more communicative, and engaged. The students don't spend the whole day with the whiteboard - the interactive learning activities are woven into lessons at various times of the day, representing true technology integration.

Now let's see what happens when all-in-one touch-screen PC's are unleashed in our schools!

UPDATE: Take a look at a post I wrote for Innovative Interactivity just after SMART Technologies acquired NextWindow - the post describe in detail how interactive whiteboards are transforming learning and teaching in a program for students with special needs.
SMARTTechnologies Acquires NextWindow: A "smart window" to the world

There are some interesting changes going on at the intersection of HCI and educational technology research. I participated in a workshop at CHI 2010 last April and was impressed by what is going on in this area, around the globe: Next Generation of HCI and Education

Value of ethnographic research:
Ethnographic Research Informed Intel's Classmate PC
"Intel looked closely at how students collaborate and move around in classroom environments. The new tablet feature was implemented so that the device would be more conducive to what Intel calls “micromobility”. Intel wants students to be able to carry around Classmate PCs in much the same way that they currently carry around paper and pencil." -via Putting People First and Ars Technica

The video below is from Intel's YouTube Channel. Information about Intel's approach to ethnographic research in classrooms during the development of the Classroom PC is highlighted. This approach uses participatory design and allows the set of applications developed for the Classmate PC to reflect the needs of local students and teachers. Schools from many different countries were included in this study.

FYI: TOUCH SCREEN DISPLAYS: NEED FOR IMPROVEMENT!

Touch Screen Coke Machine at the Mall: 90 Seconds to get a Coke

User-Unfriendly Interactive Display in the Rain (Ballantyne Village Shopping Center)

User-Unfriendly Information Kiosk Interactive Map

I encountered this puzzling and frustrating interactive directory/map at the Cleveland Clinic. When I went to visit a relative at the hospital a year or so later, the map was no longer there.

BETTER EXAMPLES OF INTERACTIVE SCREENS:

Here are some interesting pictures from lm3labs, which are in my interactive usability hall of fame:

http://catchyoo.typepad.com/photos/uncategorized/2008/06/30/4654.jpg

http://farm3.static.flickr.com/2172/2233673451_6a48db8bff.jpg?v=0

Samsung's new Omnia SDG i900 was re-created in a much larger size, using lm3lab's Ubiq'window touchless technology.For more about lm3labs, including several videoclips, take a look at one of my previous posts: Lm3Labs, Nicolas Leoillot, and Multimedia Interaction

Midwife Toad App on a Microsoft Surface, Discovery Place Science Center

TellTable: Digital Storytelling on the Surface: Microsoft Research, UK

DECEMBER 31, 2009 -Interactive Soda Machine for Fun

The interactive screen on the Coke machine attracted the attention of this young child. He loved spinning the image of the bottle. So did the dad! He said, "I'd like something like this for my home!". I told him about the HP TouchSmart - both the dad and the mom did not know that there were affordable all-in-one touch screens available, but they knew about SMARTboards, because their children's classrooms had them. Note: No one from this family actually purchased a soft drink. I was hoping to time how long it would take them to do so!

Some resources:

Multimedia, Multitouch, Gesture, and Interaction Resources (Mega-list, work in progress)

lm3labs (catchyoo, ubiq'window)

NUITeqNUI Group (See member's links)

Sparkon (See members links and multi-touch projects)

Perceptive Pixel - Jeff Hans

HP TouchSmart PC website, with demo

HP's TouchSmart YouTube videos

(More information and resources can be found by doing a "multitouch" or related search on this blog or The World Is My Interactive Interface.)

If you have plenty of time, take a look at my Post WIMP Explorers' Club YouTube playlist.
"Natural user interfaces, gesture interaction, multi-touch, natural interaction, post WIMP examples and more..."

FYI: I visited the Ballantyne Village shopping center a couple of months ago to follow up on the interactive displays, including the one I tried to use while it was raining. The shopping center changed ownership, and the displays were replaced by the old-fashioned kind, pictured below: