Musings about NUI, Perceptive Pixel and Microsoft, Rapid Creative Prototyping (Lots of video and links) Revised

It just might be the right time for everyone to brush up on 21st century tech skills. iPads and touch-phones are ubiquitous. Touch-enabled interactive whiteboards and displays are in schools and boardrooms.  With Microsoft's Windows 8 and the news that the company recently acquired Jeff Han's company, Perspective Pixel, I think that there will be good support - and more opportunities- for designers and developers interested in moving from GUI to NUI.    


In the video below, from CES 2012, Jeff Han provides a good overview of where things are moving in the future.  We are in a post-WIMP world and there is a lot of catching up to do!

CES 2012  Perceptive Pixel and the Future of Multitouch (IEEE Spectrum YouTube Channel)



During the video clip, Jeff explains how far things have come during the past few years:

 "Five and 1/2 years ago I had to explain to everybody what multi-touch was and meant. And then, frankly, we've seen some great products from folks like Apple, and really have executed so brilliantly, that everyone really sees what a good implementation can be, and have come to expect it.  I also think though, that the explosion of NUI is less about just multi-touch, but an awareness that finally people have that you don't have to use a keyboard and mouse, you can demand something else beside that.  People are now willing to say, "Oh, this is something I can try, you know, touch is something I can try as my friendlier interface"."

Who wouldn't want to interact with a friendlier interface?  Steve Ballmer doesn't curb his enthusiasm about Windows 8 and Perceptive Pixel.  Jeff Han is happy how designs created in Windows 8 scales for use on screens large and small. He explains how Windows 8 can support collaboration. The Story Board application (7:58) on the large touchscreen display looks interesting.

I continue to be frustrated by the poor usability of many web-based and desk-top applications.  I like my iPad, but only because so many dedicated souls have given some thought to the user experience when creating their apps.  I often meet with disappointment when I encounter interactive displays when I'm out and about during the day.  It is 2012, and it seems that there are a lot of application designers and developers who have never read Don Norman's The Design of Everyday Things!

I enjoy making working prototypes and demo apps, but my skill set is stuck in 2008, the last year I took a graduate-level computer course.  I was thinking about taking a class next semester, something hands-on, creative, and also practical, to move me forward. I can only do so much when I'm in the DIY mode alone in my "lab" at home.  I need to explore new tools, alongside like-minded others.  


There ARE many more tools available to designers and developers than there were just four years ago.  Some of them are available online, free, or for a modest fee.  I was inspired by a link posted by my former HCI professor, Celine Latulipe, to her updated webpage devoted to Rapid Prototyping tools. The resources on her website look like a good place to start for people who are interested in creating applications for the "NUI" era.  (Celine has worked many interesting projects that explore how technology can support new and creative interaction, such as Dance.Draw.) Below is her description of her updated HCI resources:

"New HCI resource to share: I have created a few pages on my web site devoted to Rapid Prototyping tools, books, and methods. These pages contain reviews of various digital tools, including 7 different desktop prototyping apps, and including 8 different iPad apps for wireframing/prototyping. I hope it's useful to others. Feel free to share... and please send me comments and suggestions if you find anything inaccurate, or if you think there is stuff that I should be adding. I will be continuing to update this resource." -http://www.celinelatulipe.com (click on the rapid prototyping link at the top)

IDEAS
Below are just a few of my ideas that I'd like to implement in some way. I can't claim ownership to these ideas- they are mash-ups of what comes to me in my dreams, usually after reading scholarly publications from ACM or IEEE, or attending tech conferences. 

• An interactive timeline, (multi-dimensional, multi-modal, multimedia) for off-the-desktop interaction, collaboration, data/info analysis exploration.  It might be useful for medical researchers, historians, genealogists, or people who are into the "history of ideas".  Big Data folks would love it, too. It would handle data from a variety of sources, including sensor networks. It would be beautiful to use.
• A web-based system of delivering seamless interactive, multi-modal, immersive experiences, across devices, displays, and surfaces. The system would support multi-user, collaborative interaction.  The system would provide an option for tangible interaction.
• A visual/auditory display interface that presents network activity, including potential intrusions, malfunctions, or anything that needs immediate attention that would be likely to be missed under present monitoring methods. 
• Interactive video tools for creation, collaboration, storytelling.  (No bad remote controllers needed.)
• A "wearable" that provides new ways for people to express and communicate creatively, through art, music, dance, with wireless capability. (It can interact with wireless sensor networks.)*
• An public health application designed to provide information useful in understanding and sepsis prevention efforts. This application would utilize the timeline concept describe at the top of this list. This concept could also be useful in analyzing other medical puzzles, such as autism.

Most of these ideas could translate nicely to educational settings, and the focus on natural user interaction and multi-modal i/o aligns with the principles of Universal Design for Learning, something that is important to consider, given the number of "at-risk" learners and young people who have disabilities.

I welcome comments from readers who are working on similar projects, or who know of similar projects.  I also encourage graduate students and researchers who are interested in natural user interfaces to and move forward with an off-the-desktop NUI project.  I hope that my efforts can play a part in helping people make the move from GUI to NUI!  



Below are a few videos of some interesting projects, along with a list of a few references and links.

SMALLab (Multi-modal embodied immersive learning)

PUPPET PARADE: Interactive Kinect Puppets(CineKid 2011)



MEDIA FACADES: When Buildings Start to Twitter

HUMANAQUARIUM (CHI 2012)

 

NANOSCIENCE NRC Cambridge (Nokia's Morph project)






 
Examples: YouTube Playlists
POST WIMP EXPLORERS' CLUB
POST-WIMP EXPLORER'S CLUB II

Web Resources
Celine Latulipe's Rapid Prototyping Resources 
Creative Applications
NUI Group: Natural User Interface Group
OpenFrameworks and Interactive Multimedia: Funky Forest Installation for CineKid
SMALLab Learning

Microsoft Research Natural User Interface 

OpenExhibits: Free multi-touch + multiuser software initiative for museums, education, nonprofits, and students.
OpenSense Wiki 
CINEKID 2012 Website 
Multitouch Systems I Have Known and Loved (Bill Buxton)
Windows 8
Perceptive Pixel
Books
Natural User Interfaces in .NET  WPF 4, Surface2, and Kinect (Josh Blake, Manning Publications)
Chapter 1 pdf (Free)
Brave NUI World: Designing Natural User Interfaces for Touch and Gesture (Daniel Wigdor and Dennis Wixon)
Designing Gestural Interfaces (Dan Saffer)
Posts

Microsoft's"Magic Wall" Tech on Windows 8 Laptops and Tablets by Next Year

Bill Snyder, ReadWrite Web, 7/20/12

I noticed some interesting tools on the Chrome web store - I plan to devote a few more posts to NUI tools in the future.

Cute NAO robot performs "Evolution of Dance" and is an active participant in research with young people who have autism spectrum disorders.

I came across a cute video of a NAO robot performing the Evolution of Dance, and as I smiled, I remembered that the robot was used in some research about interventions for young people with autism. 


The technology behind the NAO robot was developed by Aldebaran Robotics, and more details can be found on the company's website, along with the video and links I've provided below. (Aldebaran Robotics is hiring, btw.)


Enjoy the dance performance!

Evolution of Dance by NAO Robot 


DEPCO NAO Robot and Notre Dame Autism Research 



NAO Next: Gen: The New Robot of Aldebaran Robotics



New Robot Helps Autistic Children Interact (UConn) Research with Tim Giffort, CEO of Movia Robotics, and UConn professor Anjana Bhat 


(Above)Bruno Maisonnier of Aldebaran Robots Highlights Therapeutic Uses of the NAO Robot 

RELATED 
Aldebaran Robotics NAO Developer Website Psychologist explores effective treatment options for children with autism disorders 
Susan Guibert, Notre Dame News, 4/16/10 
Robot Speaks the Language of Kids 
Beth Krane, UConn Today, 8/5/10 
Movia Robotics: Systems for Learning, Training, Education and Therapy 
Timothy Gifford and Anjana Bhat on Using Robots to Help Autistic Children 
Rachel Z. Arndt, FastCompany, 4/1/11 
Anjana N. Bhat, University of Connecticut Timothy Gifford 
Social story powerpoint for children with autism who are participate in research at the FUN Lab at Notre Dame (ppt)

CFP for Special Issue of Personal and Ubiquitous Computing on Educational Interfaces, Software, and Technology (EIST)

CFP for Special Issue of Personal and Ubiquitous Computing on Educational Interfaces, Software, and Technology (EIST) 


Overview 
One of the primary goals of teaching is to prepare learners for life in the real world. In this ever-changing world of technologies such as mobile interaction, cloud computing, natural user interfaces, and gestural interfaces like the Nintendo Wii and Microsoft Kinect, people have a greater selection of tools for the task at hand. Given the potential of these new interfaces, software, and technologies as learning tools, as well as the ubiquitous application of interactive technology in formal and informal learning environments, there is a growing need to explore how next-generation technologies will impact education in the future. 


As a community of Human-Computer Interaction (HCI) and educational researchers, we need to theorize and discuss how new technologies should be integrated into the classrooms and homes of the future. In the last three years, three CHI workshops have provided a forum to discuss key issues of this sort, particularly in the context of next-generation education. The aim of this special issue of Personal and Ubiquitous Computing is to summarize the potential design challenges and perspectives on how the community should handle next-generation technologies in the education domain for both teachers and students. 

We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. Topics of interest include but are not limited to: 

• Gestural input, multitouch, large displays 
• Mobile devices, response systems (clickers) 
• Tangible, VR, AR & MR, multimodal interfaces 
• Console gaming, 3D input devices 
• Co-located interaction, presentations 
• Educational pedagogy, learner-centric, child computer interaction 
• Empirical methods, case studies 
• Multi-display interaction 
• Wearable educational media

Important Dates

• Full papers due: November 9, 2012
• Initial reviews to authors: January 18, 2013
• Revised papers due: March 15, 2013
• Final reviews to authors: April 26, 2013
• Final papers due: June 14, 2013

Submission Guidelines

Submissions should be prepared according to the Word template located at the bottom of this page. All manuscripts are subject to peer review. Manuscripts must be submitted as a PDF to the easychair submission system. Submissions should be no more than 8000 words in length.

Guest Editors and Contact Information

• Syed Ishtiaque Ahmed, Cornell University
• Quincy Brown, Bowie State University
• Jochen Huber, Technische Universität Darmstadt
• Si Jung “Jun” Kim, University of Central Florida
• Lynn Marentette, Union County Public Schools, Wolfe School
• Max Mühlhäuser, Technische Universität Darmstadt
• Alexander Thayer, University of Washington 
• Edward Tse, SMART Technologies

Contact: eistjournal2012@easychair.org

Information about the Journal of Personal and Ubiquitous Computing

• Editor-in-Chief: Peter Thomas
• Journal web site
• Facebook page

Ph.D. Student Positions: Intel Collaborative Research Institute on Sustainable Connected Cities

Thanks to Johannes Schöning for sharing information about this opportunity!
This might be of interest to some of my IMT readers:


EngD/PhD Positions within the Intel Collaborative Research Institute on Sustainable Connected Cities (ISCCI) at University College London (UCL) The Department of Computer Science at UCL is inviting applications for up to 6 Research Student Positions (1 EngD of 4 years, and up to 5 PhDs of 3 years), starting September 24th 2012 or January 7th 2013.


With 6.3 billion people expected to dwell in cities by 2050, the aim of the ISCCI is to create and realize a compelling vision of a sustainable future made possible by adaptive technologies that optimize resource efficiency, enable new services and support the quality of life of urban inhabitants. The Institute is located with a rich external ecosystem of companies and researchers both locally and globally investing in this important domain. The ISCCI is led by Prof. Yvonne Rogers at UCL.


We are looking for students willing to pursue a doctoral degree in computer science around the following broad topics:
•       How technology can help recognize, leverage, and support the out-of-sight, hidden or forgotten resources of urban environments, ranging from volunteers to subterranean water systems and other underlying city infrastructures.
•       How communities can encourage sustainable behaviours over time, for example, through meaningful visualizations and feedback about resource usage to individuals and groups.
•       How technology can give us an opportunity to reinvent new ideas of place and identity, considering the diversification & proliferation of new types of communities in cities, with the aim to increase quality of living and lower the barriers for mobility in our future connectedcities.


The applicants should possess a good honours MSc degree (1st Class or 2:1 minimum) in Computer Science, Psychology, Human-Computer-Interaction or related disciplines. Candidates will be expected to work in teams comprising computer scientists, social scientists, and psychologists, so an open attitude towards interdisciplinary research and teamwork is important. Candidates should have interest in at least two of the following research fields (as well as a good command of English) language:
•       Human-Computer-Interaction,
•       Augmented or Mixed Reality,
•       Interactive 3D Computer Graphics,
•       Interaction Design,
•       Perceptual Psychology, and/or
•       Cognitive Sciences.
•       Ethnography•       Data Mining, Machine Learning
•       Crowed Sourced Data
•       Data Visualization, Cartography
•       Geoinformatics
•       Big Data


Fees are fully paid. Salary for the 4-year EngD position is £18,090 tax free p.a., and £15,590 tax free p.a. for the 3-year PhD positions.The closing date for applications is 5pm on 18th July 2012. Interviews will he held on July 26th and 27th. 


The start date is September 24th  2012 (though it can be postponed to January 7th 2013). No part-time option available.Please download the application form http://www.ucl.ac.uk/uclic/phd_studentships/Intel_studentship_application_form/ and email the completed form to Louise Gaynor l.gaynor@ucl.ac.uk as a single PDF document by 5pm on Wed 18th July 2012. Please can you indicate in your application whether you wish to start in Sept 2012 or Jan 2013.

Intel studentship job advert_July 2012.pdf1881K   View   Download

Looking forward to CHI 2012: Child Computer Interaction, Educational Interfaces, Health, Special Needs, and Much More!

I am looking forward to attending the ACM-CHI 2012 conference!


On Saturday and Sunday I'll be at the Educational Interfaces, Software, and Technology (EIST) workshop, which is part of the Child Computer Interaction/HCI and Kids community.  I've selected a few papers/presentations/panels that I hope to attend during the remainder of the conference below.


If you are curious about other topics that will be presented at CHI 2012, take a look at the short video previews on the CHIMadness2012 YouTube channel.  

VocSyl


VocSyl: Designing Visualizations to Facilitate Multisyllabic Speech with Children with Autism and Speech Delay (pdf)
Joshua Hailpern, Andrew Harris, Reed LaBotz, Brianna Birman, Karrie Karahalios, Laura DeThorne, Jim Halle (Social Spaces Research Group, University of Illinois at Urbana Champaign)

Social Scripts
 
Fatima Bourjarwah: Facilitating the Authoring of Multimedia Social Skills Instructional Modules for Adolescents with High-Functioning Autism

Autism and Maths Tutor
Research Showcase - Autism & Maths tutor - CHI 2012 from George Chan on Vimeo.

ShoeSense


Giles Bailly, Joerg Mueller, Michael Rohs, Daniel Wigdor, Sven Kratz
ShoeSense: A New Perspective on Hand Gestures and Wearable Applications


Escobedo, L., Nguyen, D.H., Boyd, L., Hirano, S.H., Rangel, A., Garcia, D., Tentori, M., & Hayes, G.R. (2012). MOSOCO: A Mobile Assistive Tool to Support Children with Autism Practicing Social Skills in Real-Life Situations. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2012). Austin, Texas (May 5-10, 2012). New York: ACM Press. To appear

Design of an Exergaming Station for Children with Cerebral Palsy

(Research team from Queen's University, Canada, Holland Bloorview Kids Rehabilitation Hospital)


Illumishare


Paper: IllumiShare: Sharing Any Surface

Sasa Junuzovic, Kori Inkpen, Tom Blank, Anoop Gupta, Microsoft Research

Panel: Tangible Interfaces for Children: Cognitive, Social & Physical Benefits and Challenges
Shuili Gilutz, Sandra Calvert, Kathleen Kremer, Barbara Chamberline, Geri Gay

Paper: Improving Literacy in Developing Countries Using Speech-Recognition-Supported Games on Mobile Devices 
Anuj Kumar, Pooja Reddy, Anuj Tewari, Rajat Agrawal, Matthew Kam


Tap & Play: And End-User Toolkit for Authoring Interactive Pen and Paper Language Activities (pdf) Ann Marie Piper, Nadir Weibel, James D. Hollan


RELATED
About the CHI Conference (from the CHI 2012 Conference Preview)
"Originally a small conference for psychologists interested in user interface design, the annual CHI conference has grown to include a very diverse participant group (such as interaction designers, computer scientists, engineering psychologists, developers, performing artists and more). It has also grown to deal with larger problems such as the organizational integration of technology and the use of technology in the home rather than only office settings. This year's conference marks 30 years of research, innovation and development in the field of Human-Computer Interaction and is expected to draw more than 2500 professionals from over 40 countries. The experience at CHI 2012 offers innovative opportunities for interacting with future technologies. The following areas represent a small portion of the total conference. For complete information about this year's conference, consult the Advance Program."


"Featuring over 900 works, the CHI conference is the premier worldwide forum for the exchange of information on all aspects of human-computer interaction. Typically the works presented address the concerns of design, engineering, management and user experience professionals. This year's conference also features works that focus on: Digital Arts, Games and Entertainment, Human-Computer Interaction for Kids, Health and Sustainability. Works are presented in several different venues. After two days of intimate pre-conference workshops, the main conference includes panel discussions, courses that provide leading-edge HCI knowledge, paper sessions, case studies, works-in-progress, student competitions (involving design, research and games), interactive demonstrations, special interest groups, and a Tuesday evening video night (popcorn included)." 



SIG-CHI is the Special Interest Group on Computer-Human Interaction, and is part of ACM, the Association for Computing Machinery


Child Computer Interaction/HCI for Kids Chairs:
Janet C Read, University of Central Lancashire, UK
Panos Markopoulos, Eindhoven University of Technology
Allison Druin, University of Maryland


Educational Interfaces, Software, and Technology workshop organizers
CHI 2012 Facebook Page
EIST 2012 Facebook Page


SOMEWHAT RELATED 
The Autism Experience in Ubiquitous Computing (pdf)
Monica Tenority, Ph.D., UZBC, Ensenada, BC


Gillian Hayes:  Assistant Professor in Informatics, School of Information and Computer Sciences; Department of Education, University of California, Irvine.
Social and Technological Action Research (STAR), 

Interactive Technologies for Children with Special NeedsIDC 2012 
(11th International Conference on Interaction Design and Children)

As special themes, IDC 2012 would like to discuss children's needs under the perspectives of "pedagogical aspects in theory and practise" as well as "children from diverse cultural backgrounds".


Grawemeyer, B., Johnson, H., Brosnan, M., Ashwin, E., Benton, L. (2012) Developing an Embodied Pedagogical Agent With and For Young People with Autism Spectrum Disorder. Accepted for presentation at the 11th International Conference on Intelligent Tutoring Systems, ITS 2012.

Digital Media and Learning Conference, March 1-3, San Francisco - wish I could go!

"The Digital Media and Learning Conference is an annual event supported by the MacArthur Foundation and organized by the Digital Media and Learning Research Hub located at the UC Humanities Research Institute, University of California, Irvine. The conference is meant to be an inclusive, international and annual gathering of scholars and practitioners in the field, focused on fostering interdisciplinary and participatory dialog and linking theory, empirical study, policy, and practice. The third annual conference – DML2012 – is organized around the theme “Beyond Educational Technology: Learning Innovations in a Connected World” and will be held between March 1-3, 2012 in San Francisco, California." -DML2012


Digital Media and Learning Conference Website

Keynote and Plenary Panalists

John Seely Brown will be the opening keynote for the conference.

GOOGLE LABS R.I.P.: My favorite thing about Google is GONE!

RIP GOOGLE LABS      : O     : <        :  (        :  {        :  \        :  [      


I visited Google Labs today and this is what I found:

Here are a few articles and posts about this topic:
Google Labs is Closing? That's Unthinkable - Whether or Not It's a Good Idea
Harry McCracken, Technologizer, 7/20/11
Google Labs shuts down, the end of an era
Ray Walters, ExremeTech, 10/14/11
Google's Clearout Sweeps Away Code Search 
Alex Armstrong, I Programmer, 10/16/11
Google takes the axe to Buzz and others, focuses on Google+
Meghan Kelly, SocialBeat 10/14/11
Why is Google Shuttering Google Labs?
John C. Dvorak, PC Magazine, 7/22/11
More Wood Behind Fewer Arrows
The Official Google Blog 7/20/11
Larry Page's Remarks

RELATED
I was able to find some links to Google Code Labs at http://code.google.com/intl/en/labs/

RENCI Update: Combining Gaming and Visualization Technologies to Support Efficient and Effective Decision-Making

        RENCI stands for the Renaissance Computing Institute.  It is a multidisciplinary collaboration between UNC-Chapel Hill, Duke University, and North Carolina State University, with Engagement Sites at UNC Asheville, Duke University, Eastern Carolina University, North Carolina University, UNC Chapel Hill, UNC Charlotte, and the UNC Costal Studies Institute.  
        According to the mission statement, "RENCI develops and deploys advanced technologies to enable research discoveries and practical innovations."  Much of the work of RENCI focuses on large-scale information and data visualization.
        Why is this important?  It provides an effective visual-cognitive means of understanding complex data from a variety of disciplines, and also supports the collaboration of researchers across a variety of disciplines.   It has the potential to support larger-scale decision-making and problem-solving in our technology-dependent, interconnected world.  

Take a few minutes and explore what I've posted below:
       
Press release from RENCI about the interactive dome, pictured below (photo credit: RENCI-UNC Asheville):  "To understand human-induced global changes, there's no place like dome" Nancy Foltz, 10/12/11

RENCI: Gaming the Future
        The video below provides an overview of how innovative interactive visualization tools support decision-making across many disciplines.

RENCI: Unity 3D game engine to support immersive information visualization applications:

RENCI Situation Room Multi-touch Table, UNC-Charlotte:





RELATED

RENCI pioneering the visualization industry with innovative interfaces
Tracy Boyer Clark, Innovative Interactivity (II), 2/8/10
RENCI Visualization Center Update
Lynn Marentette, Interactive Multimedia Technology, 2/9/10
RENCI Tutorial: "Beautiful Code, Compelling Evidence: Functional Programming for Information Visualization and Visual Analytics" (pdf)  J.R. Heard
RENCI: Data to Decisions
Recent Publications from RENCI:

Y. Xin, I. Baldine, A. Mandal, C. Heermann, J. Chase, and A. Yumerefendi. “Embedding Virtual Topologies in Networked Clouds.”The 6th International Conference on Future Internet Technologies (CFI). Seoul, Korean, June 2011 
Y. Xin, I. Baldine, J. Chase, T. Beyene, B. Parkhurst, and A. Chakrabortty. “Virtual Smart Grid Architecture and Control Framework.” 2nd IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm), Brussels, Belgium, Oct. 2011 
X. Ju, H. Zhang, W. Zeng,M. Sridharan, J. Li, A. Arora, R. Ramnath, Y. Xin. “LENS: Resource Specification for Wireless Sensor Network Experimentation Infrastructures. ” The 6th International Workshop on Wireless Network Testbeds, Experimental Evaluation and Characterization (WinTECH), Las Vegas, Nevada, Sep. 2011
RENCI's Facebook Page
Twitter: @RENCI

OPEN SOURCE MULTI-TOUCH SOFTWARE FOR YOUNG PEOPLE WITH AUTISM SPECTRUM DISORDERS- Featured in the WSJ! (Video and links)

Well before the iPad entered the market, researchers such as Dr. Juan Hourcade at the University of Iowa, began to develop multi-touch software to  support young people with autism spectrum disorders and other disabilities.  I've been following this research for a while, and was happy to discover that Dr. Hourcade's work was  recently featured in a recent Wall Street Journal article and video.  


If you are a parent or work with a young person with special needs, you might be interested in learning more about Windows-7 based touch-screen software.  The software shown in the video below, as well as related resources, are available for free on the Open Autism Software website.




RELATED

Article:

Playing on a Tablet as Therapy

Shalini Ramachandran, Wall Street Journal, 7/26/11

Previous Post: Interactive Multi-Touch for Children with Autism Spectrum Disorders:  Research and Apps by Juan Pablo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa 4/26/10

Interaction Design and Children Remixed, CHI 2011

CHI 2011 Child Computer Interaction: 2nd Workshop on UI Technologies and Impact on Educational Pedagogy

Why is this important to me?   

I work with young people with a range of disabilities, including autism, as a school psychologist.  One of my schools is a program that is technology-rich.  Although we don't have iPads, there is a SMARTBoard in every classroom and in other rooms around the school. We have a Wii,  a few multi-touch all-in-one PC's,  and recently received two Dell multi-touch tablet PCs. 

I noticed that Dr. Hourcade is looking for people who'd like to create similar apps for the iPad.  I'd be interested in knowing anyone who might be working on this.  I'd like to help in some way, but I don't have a lot of free time to do this on my own. 

I have a new iPad2, and after playing around with a ton of apps, I was inspired to downloaded XCode4 and think about what I could create. I'm a Mac person at heart, but I learned to program within a Windows environment (C#).    I need a way to maintain my programming skills and gradually learn a few new ones. This sort of project would be useful to me in my "day job", too!

SOMEWHAT RELATED
3D Interactive Heart, by 22Miles, on a Dell Latitude Xt2

Multi-touch Update from Stantum

The people at Stantum have been working hard to improve multi-touch technology, focusing on smaller tablet-sized systems.  Stantum is a company I've been following for several years, from the time it was known as Jazz Mutant.  I have been impressed by Stantum's focus on the needs of people as well as the company's careful attention to important details.


I'm pleased to see that the company has an idea of how its multi-modal technology can support multi-touch in education:   "Ambidexterity and multi-modality are the two pillars of Stantum's core project – making the use of touch-enabled devices more creative and productive. Amongst others, there is one field of application where we truly see a soaring need for ambidexterity and multi-modality – augmented textbooks." -Guillaume Largillier


At the Society for Information Display's Display Week exhibition this past May, Stantum introduced a new palm rejection feature for its Interpolated Voltage Sensitivity technology. This technology provides users with a more natural way to interact with the interface and application content on tablets.   The technology supports Android's multi-touch framework and is also Windows 7 certified.  The palm rejection feature will be a welcome improvement for future multi-touch applications designed for education settings, where it is likely that  more than one hand - or person, might be interacting with content on the screen at the same time.


Below are two videos that provide a glimpse of Stantum's innovations:




Stantum's technology can enable ten simultaneous touches, is highly responsive, and supports high-resolution content. According to a May press release, "Palm rejection is available as an API (application programming interface) to Windows and Android operating systems on x86 and ARM platforms. IVSM touch modules are offered to OEMs through the company’s Qualified Manufacturers Partners, comprising tier-one touch-screen manufacturers with high-volume production capabilities. More information is available at info@stantum.com"


RELATED
Stantum's TouchPoints Newsletter (July 2011)


Stantum Whitepapers:
How to Evaluate Multi-Touch While Standing in a Store (pdf) - a great source of information.
Jim Meador, Pascal Auriel, Gauthier Chastan, Stantum
Specifying and Characterizing Tactile Performances for Multi-touch Panels: Toward a User-Centric Metrology (pdf) - outlines some important points!
Guillaume Largillier, Pascal Joguet, Cyril Recoquillon, Pascal Auriel, Axel Balley, Jim Meador, Julien Olivier, Gauthier Chastan

"Rise and Shine": TED video featuring Simon Lewis and his recovery from a serious brain injury, and how cutting-edge technology helped. (Video includes interesting visuals)

Simon Lewis was in an automobile accident that resulted severe injuries to his body, including a very severe head injury that left him in a coma.  As a result of his experience, he wrote a book, "RISE AND SHINE", covering his journey over 15 years of recovery and regeneration.  In the book, Lewis shares what he learned along the way, and how cutting edge technology and some non-traditional thinking helped him move forward.


Simon Lewis had the opportunity to discuss his journey at a TED partner event in India in December, 2010.   The following video of his talk is about 22 minutes long, but worth taking the time to watch. A variety of visuals are used to illustrate his journey and the research he did along the way. Near the end of the video, Simon Lewis demonstrates some of the technologies that he wears that supports his functioning.


Here is the blurb about the book from the Borders website:

"An impassioned tale of survival and recovery, this inspirational story recounts the author’s horrific car accident, his subsequent coma, and the more than 15 years of cutting-edge treatments and therapies endured during convalescence. With specific details of the rigorous rehabilitation process that ensued, including numerous breakthrough and experimental surgeries, the book also provides practical insight into navigating the treacherous world of insurance and how to differentiate between the often conflicting medical opinions offered. In addition to describing the numerous procedures undergone, the author tells not only of his pain, frustration, and despair, but also of his childlike wonder at the beauty and miracle of creation. A first-person account of sudden, unexpected tragedy and life-affirming courage, this remarkable tale of regeneration imparts lessons both medical and spiritual."


The Rise and Shine website includes many of the graphics used in Simon's video, and is worth taking some time to explore. Some of the graphics are interactive. (Since the website relies on Flash, it won't work if you try to access it using an iPad.)


Comment:  As a school psychologist with additional training in neuropsychology - specifically assessment and intervention for children and teens who have experienced traumatic brain injury (TBI), this topic is important to me.  I'm watching the video a second time, and I plan to read his book.

(Cross-posted on the TechPsych blog.)

The Digging Into Data Challenge and List of Online Data Repositories for Humanities and Social Sciences

I came across the Digging Into Data Challenge website today and thought it might be of interest to IMT readers.  Below is a description of the project, a few related links, and an abbreviated list of links to a wide range of data repositories on the web.  

 ABOUT 

"Welcome to the second round of the Digging into Data Challenge. During the first round, in 2009, nearly 90 international research teams competed in the challenge. Ultimately, eight remarkable projects were awarded grants."

"In 2011, the Digging into Data Challenge has returned for a second round, this time much larger, with sponsorship from eight international research funders, representing Canada, the Netherlands, the United Kingdom, and the United States."

"What is the "challenge" we speak of?  The idea behind the Digging into Data Challenge is to address how "big data" changes the research landscape for the humanities and social sciences. Now that we have massive databases of materials used by scholars in the humanities and social sciences -- ranging from digitized books, newspapers, and music to transactional data like web searches, sensor data or cell phone records -- what new, computationally-based research methods might we apply? As the world becomes increasingly digital, new techniques will be needed to search, analyze, and understand these everyday materials. Digging into Data challenges the research community to help create the new research infrastructure for 21st century scholarship." 

"Applicants will form international teams from at least two of the participating countries.  Winning teams will receive grants from two or more of the funding agencies and, two years later, will be invited to show off their work at a special conference sponsored by the eight funders."

"Let's get digging."

RELATED
Digging into Data Challenge Second Year Request for Proposals
Press Release    Round Two: Digging Into Data Challenge: Social and computational scientist asked to design methods and tools for analyzing large data sets (National Science Foundation)

Times Higher Education, April 28, 2011, "Research intelligence - Let's dig a little deeper"
The New York Times, November 16, 2010, "Digital Keys for Unlocking the Humanities’ Riches"
The Globe and Mail, June 18, 2010, "Supercomputers seek to ‘model humanity’"

Be sure to visit the Digging Into Data Challenge data repository page.  Each repository is annotated in detail and includes links and in some cases, APIs. The page is updated regularly, and at the time of this post, was updated on May 26, 2011. For your convenience, here's the abbreviated version of the Digging Into Data Challenge list of repositories: 

The Archaeology Data Services (ADS)
http://archaeologydataservice.ac.uk/


ARTStor.org
http://www.artstor.org


Biodiversity Heritage Library
http://biodiversitylibrary.org


The Centre for Contemporary Canadian Art Canadian Art Database Project
http://ccca.ca


Chronicling America, Library of Congress, National Digital Newspaper Program
http://loc.gov/chroniclingamerica


Data-PASS
http://www.icpsr.umish.edu/DATAPASS/


Digital Library for Earth System Education (DLESE)
http://www.dlese.org


Early Canadiana Online
http://canadiana.ca


English Broadside Ballad Archive
http://ebba.english.ucsb.edu


Great War Primary Documents Archive
http://www.gwpda.org


Harvard Time Series Center (TSC)
http://timemachine.iic.harvard.edu/search/


HathiTrusthttp://www.hathitrust.org


The History Data Service (HDS)
http://hds.essex.ac.uk


Infochimps.org
http://www.infochimps.com/


Internet Archive
http://www.archive.org


Inter-university Consortium for Political and Social Research
http://icpsr.umich.edu


JISC MediaHub
http://jiscmediahub.ac.uk


JSTOR
http://jstor.org

Marriott LibraryUniversity of Utah
http://ww.lib.utah.edu/portal/site/marriottlibrary/

NASA ADS: Smithsonian/NASA Astrophysics Data System (ADS)
http://adsabs.harvard.edu/index.html

National Archives, London
http://nationalarchives.gov.uk

The National Library of Wales
http://www.llgc.org.uk


National Science Digital Library (NSDL)
http://www.nsdl.org

National Technical Information Service (NTIS)
http://www.ntis.gov/

Nebraska Digital Newspaper Project
http://cdrh.unl.edu/nebnewspapers/

New York Public Library
http://NYPL.org

The New York Times Article Search API
http://developer.nytimes.com/


Opening History
http://imlsdcc.grainger.uiuc.edu/history/

PhilPapers (philosophy)
http://philpapers.org

Project MUSE
http://muse.jhu.edu/

PSLC DataShop (Pittsburg Science of Learning Center)
http://pslcdatashop.web.cmu.edu/

Scholarly Database at the Cyberinfrastructure for Network Science Center, Indiana University
http://sdb.slis.indiana.edu

ScholarSpace at the University of Hawai'i at Manoa
http://scholarspace.manoa.hawaii.edu/community-list

Statistical Accounts of Scotland
http://edina.ac.uk/stat-acc-scot/

University of Florida Digital Library Center
http://www.uflib.ufl.edu/ufdc

University of North Texas
http://digital.library.unt.edu/browse/?browseby=collection

Just a thought....
I'd be interested in learning if any of the researchers involved in the Digging Into Data Challenge plan to work on an interactive, multidimensional, multimedia timeline to support collaborative data sharing and analysis.