TEDTalk: Carlo Ratti, of MIT's SENSEable City Lab - Flying Pixels-Helicopters, Sensors, Actuators, 3D Reconstruction of Movement, an Interactive "Cloud", and more

If you are interested in new interactive technologies, take 15 minutes to watch Carlo Ratti's TEDTalk about the work of MIT's SENSEable City lab:

Carlo Ratti is the director of the MIT SENSEable City Lab. He's a civil engineer and architect interested in sensors, hand-held electronics and the built environments of cities, and how data generated by sensors can be used to create new interactive, artistic environments.


In this March 2011 TED Talk, Ratti discusses how data from passive data sets, such as phone calls, can be harnessed to create visualizations that represent the life and interactions that take place in cities.  These visualizations are made interactive through the use of sensors and human gestures.


RELATED
SENSEABLE Website
Below are some examples of projects of the SENSEable City Lab:
Flyfire "...the Flyfire project sets out to explore the capabilities of this display system by using a large number of self-organizing micro helicopters.  Each helicopter contains small LEDs and acts as a smart pixel.  Through precisely controlled movements, the helicopters perform elaborate and synchronized motions and form an elastic display surface for any desired scenario...The Flyfire canvas can transform itself from one shape to another or morph a two-dimensional photographic image into an articulated shape...." -info from the Flyfire website
The Cloud (+atmos page)



"The CLOUD proposes an entirely new form of observation deck, connecting visitors for both the whole of London and the whole of the world, immersing them in euphoric gusts of weather and digital data.  Each individual footstep on the ascent to the CLOUD participates in a vast collective energy-harvesting effort.  Everyone around the world can contribute to the Cloud-whether by visiting or by sponsoring and LED, helping to keep the London lamp aflame." The CLOUD website
Real Time Rome
Trash|Track
Digital Water Pavillion

Saturday Quick Links: Digital Signage and Digital Out of Home (DOOH), via The Digital Signage Insider, Digital Signage Today, and more

The links:

Walmart and Microsoft Talk Up Digital Signage at the NRF
Bill Gerba, The Digital Signage Insider, 1/14/11
Wirespring


NRF: Walmart unveils ROI data for in-store digital signage campaigns
James Bickers, Digital Signage Today, 1/10/11


"C-Tailing" (Converged Retailing)  - NCR
NRF: Convergent technologies on the retail horizon
Cherrhy Butler, Digital Signage Today, 1/11/11

RELATED
Connecting Your Business to Devices and Customers with Windows Embedded

View more presentations from Microsoft Windows Embedded.
Barb Edson, Sr. Director of Marketing, Windows Embedded

Here are a few resources related to this topic:

4th Workshop on Pervasive Advertising (topics)

The Web Outside: Exploring place-based social media 

(LocaModa blog)

LocaModa's whitepapers

Blogs:

Digital Signage Today

Daily DOOH

The Digital Signage Insider

COMMENT
Designers and developers need to think about off-the-desktop technologies as a new form of the web/internet.  Information architects who understand interactive media/transmedia, cross-display/device, cross-platform, and interaction design within a broader context are sorely needed in this space.  


The presentation below, by Chris Thorne, Lead Information Architect and User Experience Consultant working for the BBC, provides a good overview about this topic:

Ubiquitous IA (Information Architecture): Building for change and web 3.0 

View more presentations from christhorne.
Chris Thorne

Stay tuned!

Over the past months I've been gathering video and photos of my encounters and interactions with digital signage as a consumer/customer/user during my every-day activities such as shopping, traveling, vacationing, and so forth, which will be included in a post or series of posts in the near future.   


I have content related to interaction with various QR tags,  interactive kiosks, interactive displays and TV on a cruise ship, an interactive touch screen at J.C. Penny, and more.  If you are a regular reader of this blog, you know that my interests include user experience of DOOH, interactive displays in public spaces, and so forth.  


Note:  Despite all of the technological innovations in this converging field, issues related to context, usability, and accessibility are not consistently addressed from a broader systems point of view.

Quick Link: InteractiveTV Today website -lots of interesting things are happening in this converging field!

 http://itvt.com

From the "about us" section of the itvt.com website:

"Founded in 1998 by Tracy Swedlow and co-owned by Richard Washbourne, InteractiveTV Today [itvt] is the most widely read and trusted news source on the rapidly emerging medium of multiplatform, broadband interactive television (ITV).

We provide concise, original coverage of industry developments, technologies, content projects, and the people building the business to our readership, which is made up of hundreds of thousands of executives from around the world..."

Transmedia Storytelling, Interactive Multimedia, & Video Content Funded by 27 Million in Grants

Press  Release:  Education Secretary Arne Duncan Announces $27 Million for Three Ready-to-Learn Television Program Grants

Here is information from the release:

U.S. Secretary of Education Arne Duncan today announced three awards totaling $27 million for projects to improve educational opportunities for young learners through innovative technology. Grants will be used to develop and deliver high-quality, age-appropriate, educational content to increase the early literacy and mathematics skills of young children age two through eight years old. The current cycle of awards will provide early learning content through the well-planned and coordinated use of multiple media platforms, commonly known as transmedia storytelling.

"It is critical that we focus our educational improvement efforts on the earliest learners and those most at risk of educational failure, including our children living in poverty,” said U.S. Secretary of Education Arne Duncan. “We know that children of all ages are engaged when given the opportunity to learn with new technologies. These grants will surround young children with a variety of innovative media to equip them with early literacy and numeracy skills to prepare them for success in school."

The five-year grants were awarded to three public telecommunications entities that will offer services across the nation. In addition to programming content, the grantees will provide outreach materials and resources to families, child care providers, preschool and early elementary teachers and others whose work addresses early learning. Each grant includes a strong research component. According to Jacqueline Jones, senior advisor to the Secretary for Early Learning, “These projects represent a critical investment in moving the Department’s early learning agenda forward and ultimately improving outcomes for young learners. We are particularly excited that through accessible media and technologies, these projects will encourage families, caregivers and teachers to interact with and engage young learners in both formal and informal settings.”

"Window to the World Communications (WTTW) will partner with W!ldbrain, an entertainment and animation company, to deliver a multiple-platform, media-based, mathematics curriculum for children that will provide corresponding support materials and digital resources for families, caregivers and teachers. The project will allow children to use multiple entry points to a virtual world of mathematics principles through cell phones, computers, handheld video game systems, television, books and trading cards."

"The Corporation for Public Broadcasting (CPB) and the Public Broadcasting Service (PBS) will deliver transmedia content in literacy and numeracy that is aligned with rigorous academic frameworks and research. Through a multi-level partnership, CPB will develop video, interactive online games (3D-rendered collaborative challenges and immersive games), mobile applications (augmented reality games) and interactive white board applications."

"The Hispanic Information and Telecommunications Network (HITN) will partner with Callaway Arts and Entertainment to develop and evaluate three transmedia properties that will cross multiple platforms using the inherent benefits of each to engage early learners. One such property, Learning Apps Media Partnership (LAMP), focuses on English Language Learners and immerses them in literacy and mathematics curricula that draw on real-life situations and encourage the expression of diverse perspectives where children freely use their native language or dialect."

The following list of grantees, by state, reflects 2010 funding:

 ILLINOIS Window to the World Communications; Chicago; Reese Marcusson, (773) 509-5408 or rmarcusson@wttw.com; $6,623,475

NEW YORK Hispanic Information and Telecommunications Network; New York City; Linda Hernandez, (646) 731- 3601 or lhernandez@hitn.org; $6,000,000

DISTRICT OF COLUMBIA Corporation for Public Broadcasting; Washington, D.C.; Debra Sanchez, (202) 879-9784 or dsanchez@cpg.or; $14,627,354

 
RELATED
Partnership with Calloway Digital Arts and Michael Cohen Group LLC Will Create Educational Media for Reading and Math Targeted at Closing Achievement Gap    PR Newswire 10/18/10 -Excerpt Below:


"Project LAMP targets next-generation learners including children from low-income groups. The content will be largely available as an open educational resource and use a transmedia storytelling approach through books, iPAD/Touch Screen applications, mobile device and phone applications, console and hand held gaming applications, sing along DVDs and CDs, an interactive Website, and television. The USDE, in 2010, expanded the Ready to Learn grant program to include transmedia storytelling."


Project LAMP will leverage the existing characters of Callaway's Miss Spider's Sunny Patch Friends (ages 2-5) and Nova the Robot (ages 5-8).It will also create a third new ELL property produced by HITN. Content in all three properties will align to the 2010 Common Core State Standards in Math and Reading and promote the essential skills defined by the National Early Literacy Panel and the National Mathematics Advisory Panel.  


An essential component of Project LAMP will be the ongoing use of research and evaluation. Dr. Michael Cohen, President of the Michael Cohen Group and one of the co-Principal Investigators of the project said, "As the project activities move forward, we foresee new forms of educational media being developed. As a result, new assessments will be required to provide the producers with useful information on children's learning and comprehension. This is an exciting process for evaluators because research findings will aid in product development, determine if goals are met, and contribute to our general understanding of the role and impact of media in young children's lives." Cohen added, "Our plan is to evaluate the applications at different stages of development by testing with children, teachers, and parents. Research will help ensure that the curricula, design, and narrative are age-appropriate, appealing, and result in student learning." 


The 2010 Ready to Learn grants include outreach monies in addition to program funding. Project LAMP outreach activities will leverage wireless network technology, social media, and community-based organizations to engage children, parents, caregivers, and teachers in New York, Connecticut, and Texas the first year alone. Over the life of the grant, Project LAMP will partner for exchange of ideas, opinions, and results with: 1) persistently low achieving schools, 2) a media production program at an accredited postsecondary institution, and 3) a teacher preparation program at an accredited postsecondary institution focused on early childhood education.
Callaway Digital Arts (CDA)

Journalism in the Age of Data, by Geoff McGhee "...how can traditional narratives be fused with sophisticated, interactive information displays?"

Geoff McGhee is a journalist who specializes in multimedia and information graphics. He currently works at the Bill Lane Center for the Amercan West at Stanford, where he previously spent a year as a John S. Knight Journalism Fellow at the university, studying data visualization.  


In the following video, Journalism in the Age of Data,  McGhee provides an interesting overview of the ways different disciplines are collaborating-and converging- to create visualizations that communicate data and information in effective and meaningful ways. The video is over 50 minutes long, but worth viewing. 

Info from McGhee's Vimeo site:

"Journalists are coping with the rising information flood by borrowing data visualisation techniques from computer scientists, researchers, and artists.  Some newsrooms are already beginning to retool their staffs and systems to prepare for a future in which data becomes a medium.  But how can traditional narratives be fused with sophisticated, interactive information displays? Watch the full version with annotations and links at datajournalism.stanford.edu "

Journalism in the Age of Data from Geoff McGhee on Vimeo.

Virtual Reality Effectively Treats PTSD and Related Disorders: Skip Rizzo's TEDx Talk about promising interdisciplinary work at the Institute for Creative Technologies

-Skip Rizzo, Co-Director of the VRPSYCH Lab at the USC Institute of Creative Technologies (ICT)

Note: Skip's talk begins about 4 minutes into the presentation.


In this TEDx Talk video, Marilyn Flynn, Dean of the University of Southern California's School of Social Work, introduces Skip Rizzo, a research scientist and Co-Director of the VRPSYCH Lab at the USC  Institute of Creative Technologies (ICT).  Skip's research has focused on the use of virtual realty and related technologies for treatment and training purposes.

In this talk,  Skip provides an overview of the interdisciplinary research taking place at the Institute of Creative Technologies (ICT). Skip goes on to explain the urgency of ICT's current work, focusing on the treatment of Post Traumatic Stress Disorder and other problems experienced by people who have sacrificed so much to serve our country in places of wars and conflicts such as Iraq and Afganistan.  Neary one-third of our military personnel are significantly at-risk for developing PTSD or other debilitating conditions that will negatively affect their functioning upon returning home.

Skip goes on to show how the latest VR (Virtual Reality) related technologies and applications combine with with evidence-based intervention and treatment strategies to successfully treat PTSD.  Recent research indicates that 75% of clients treated through 10 sessions of exposure therapy no longer exhibit clinical symptoms of the disorder. Given the numbers of people suffering from PTSD and related disorders, the potential for this treatment method holds promise.

Skip points out that one problem many veterans or their loved ones experience is that they are not aware that effective treatment is available.  Additionally, there are few therapists who are trained in the use of VR as a therapeutic tool.  By working with USC's School of Social Work, this may no longer be the case in the future.  Therapist can learn ways to provide effective evidence-based treatment through interacting with a "virtual human" application that uses an "intelligent" character that simulates the conversational exchanges that are likely to occur during treatment sessions. Additionally, the research behind this effort has resulted in the creation of an on-line system that includes virtual guides that can provide support and guidance to people suffering from PSTD in order to get them to engage in the treatment they require.


Here is information from the Institute of Creative Technologies regarding Skip Rizzo's TEDx USC Talk:
Skip Rizzo's TEDx USC Talk Now Online
"ICT’s Skip Rizzo spoke at this year’s TEDx USC conference and was introduced by Dean Marilyn Flynn of the USC School of Social Work. Video of their talk is now available for viewing on the TEDx Talk’s Channel on YouTube...Of the more than 1.6 million men and women deployed to Iraq and Afghanistan, nearly one-third are expected to return with disabling combat stress disorders that may affect some for a lifetime if left untreated.

Through and unlikely marriage of social work and cutting edge technology, the USC Institute for Creative Technologies and the USC School of Social Work are revolutionizing the training methods for a new generation of mental health professionals, shifting the way clinicians learn to interact with their patients."
  
Introduction: Marilyn Flynn, Dean, USC School of Social Work
Virtual Reality Demonstration: Albert “Skip” Rizzo, Research Scientist, USC Institute for Creative Technologies 

RELATED
USC Institute for Creative Technologies
"The USC Institute for Creative Technologies brings together high-tech tools + classic storytelling to pioneer new ways to teach + to train."
Virtual Reality & Convergence with Game Technology IMT blogpost, 7/2006
Convergence:  Video Games and Virtual Reality for Special Needs: Autism, ADD, Fetal Alcohol Syndrome, Social Skills TechPsych blogpost, 8/2006
(I will revisit this and related topics in future posts.)

Preview of the Official Boxee Video Streaming System: Digital Convergence in Action

In the following video, tech entrepreneur Zach Klein shows his company's official version of Boxee, a set-top box system that provides users a "plug-and-play" opportunity to view Web-based video on their televisions.


The first Boxee Box arrived from the D-Link Factory from Zach Klein on Vimeo.
Note:  Zach Klein is the co-founder of Vimeo.



Web video and content, viewed on a large-screen HD display, in the comfort of a cozy recliner or sofa, is in line with the "Slow Media" movement, as well as the concept behind Google's "YouTube Leanback" application (see links and info below).

Relax.  Share.  Interact.  Chill with your Web.

RELATED
Boxee Website
Boxee Readies Its Set-Top Box Nick Bilton, New York Times, 7/16/10
Boxee debuts Boxee Box, ready to take on Roku Jacob Brody, SocialBeat Venture, 12/7/09
Hands-On With the Boxee Set-Top Box and Remote Brian X. Chen, Wired Gadget Lab, 1/8/10
Designing for Interactive TV:  Boxee Case Study (Method)
Boxee and Digital Convergence Lynn Marentette, Interactive Multimedia Technology, 3/22/09


SOMEWHAT RELATED
Slow Media Manifesto
"The concept “Slow”, as in “Slow Food” and not as in “Slow Down”, is a key for this. Like “Slow Food”, Slow Media are not about fast consumption but about choosing the ingredients mindfully and preparing them in a concentrated manner. Slow Media are welcoming and hospitable. They like to share."
Google YouTube Leanback (Google)
YouTube Leanback offers effortless viewing (Google)
"YouTube Leanback a different way of watching videos on YouTube. Just as its name implies, YouTube Leanback is all about letting you sit back, relax and be entertained. Videos are tailored to autoplay as soon as you get started, in full screen and high definition, so watching YouTube becomes as effortless as watching TV. YouTube Leanback is simple to use, easy to navigate with your keyboard's arrow keys, and is personalized to your unique preferences."
YouTube's 'Leanback' Wants to Friend Your Television Remote Eliot Van Burskirk, Wired  7/8//10


Somewhat Related IMT Posts
All IMT posts referring to remote controls and usability (This will continue to be a problem as our digital streams converge)
Video and Links about Google TV: Another Flavor of Android - "Google TV brings everything you love about the Web to your television".
Designing for TV Screen Interaction:  Interesting IxDA Thread
Digital Convergence & Interactive Television
An Example of Convergence: Interactive TV - uxTV 2008