RENCI Update: Combining Gaming and Visualization Technologies to Support Efficient and Effective Decision-Making

        RENCI stands for the Renaissance Computing Institute.  It is a multidisciplinary collaboration between UNC-Chapel Hill, Duke University, and North Carolina State University, with Engagement Sites at UNC Asheville, Duke University, Eastern Carolina University, North Carolina University, UNC Chapel Hill, UNC Charlotte, and the UNC Costal Studies Institute.  
        According to the mission statement, "RENCI develops and deploys advanced technologies to enable research discoveries and practical innovations."  Much of the work of RENCI focuses on large-scale information and data visualization.
        Why is this important?  It provides an effective visual-cognitive means of understanding complex data from a variety of disciplines, and also supports the collaboration of researchers across a variety of disciplines.   It has the potential to support larger-scale decision-making and problem-solving in our technology-dependent, interconnected world.  

Take a few minutes and explore what I've posted below:
       
Press release from RENCI about the interactive dome, pictured below (photo credit: RENCI-UNC Asheville):  "To understand human-induced global changes, there's no place like dome" Nancy Foltz, 10/12/11

RENCI: Gaming the Future
        The video below provides an overview of how innovative interactive visualization tools support decision-making across many disciplines.

RENCI: Unity 3D game engine to support immersive information visualization applications:

RENCI Situation Room Multi-touch Table, UNC-Charlotte:





RELATED

RENCI pioneering the visualization industry with innovative interfaces
Tracy Boyer Clark, Innovative Interactivity (II), 2/8/10
RENCI Visualization Center Update
Lynn Marentette, Interactive Multimedia Technology, 2/9/10
RENCI Tutorial: "Beautiful Code, Compelling Evidence: Functional Programming for Information Visualization and Visual Analytics" (pdf)  J.R. Heard
RENCI: Data to Decisions
Recent Publications from RENCI:

Y. Xin, I. Baldine, A. Mandal, C. Heermann, J. Chase, and A. Yumerefendi. “Embedding Virtual Topologies in Networked Clouds.”The 6th International Conference on Future Internet Technologies (CFI). Seoul, Korean, June 2011 
Y. Xin, I. Baldine, J. Chase, T. Beyene, B. Parkhurst, and A. Chakrabortty. “Virtual Smart Grid Architecture and Control Framework.” 2nd IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm), Brussels, Belgium, Oct. 2011 
X. Ju, H. Zhang, W. Zeng,M. Sridharan, J. Li, A. Arora, R. Ramnath, Y. Xin. “LENS: Resource Specification for Wireless Sensor Network Experimentation Infrastructures. ” The 6th International Workshop on Wireless Network Testbeds, Experimental Evaluation and Characterization (WinTECH), Las Vegas, Nevada, Sep. 2011
RENCI's Facebook Page
Twitter: @RENCI

GoPro Wearable (extreme) Sports Camera: I Want One! (video)

I'd love to have a GoPro wearable HD camera for creating immersive multimedia content. The only problem is that I'd have to take up extreme sports as a hobby if I wanted to do my own videography. 


Take a look at the promo video from the GoPro website - best viewed in full-screen:


I see great possibilities for interactive, "touchable" multimedia content using video captured in this manner!


If you ever wondered what NYC looks like from the POV of a fast and furious skateboard, take a look at this video, "Skate Through NYC With A GoPro":


Thanks to Nat Torkington for sharing the video and link in Google+!


RELATED
Blog Post: Skate Through NYC with a GoPro
Mareadyphotography Blog

VIDEO GAMES LIVE!- With the Charlotte Symphony Orchestra-An immersive multimedia event.

Video game music is in the background of life in the lives of many people, and might be the "comfort food" music of the younger generations, given the number of hours videos are played homes in the U.S.


VIDEO GAMES LIVE will be performed in conjunction with the Charlotte Symphony Orchestra on Saturday, February 19, 2011, at 7:30 PM at Ovens Auditorium.  I'll be there!


"Video Games Live! is a multimedia concert experience featuring the best music and exclusive synchronized video clips from the most popular games from the beginning of video gaming to the present. Performed with the Charlotte Symphony, the show combines exclusive video footage and music arrangements with synchronized lighting, solo performers, stage show production, special FX, electronic percussionists, and unique interactive segments.

Whether it’s the power and passion of the more recent blockbusters or the excitement of remembering the sentimental classics, it will truly be a special night to remember for the entire family." -Charlotte Symphony Orchestra website



Promo video from VIDEO GAMES LIVE! (Brazil)



RELATED
VIDEO GAMES LIVE website
VIDEO GAMES LIVE tour dates

Information about VIDEO GAMES LIVE from the "About" page of the website:

Video Games Live™ is an immersive concert event featuring music from the most popular video games of all time. Top orchestras and choirs perform along with exclusive video footage and music arrangements, synchronized lighting, solo performers, electronic percussionists, live action and unique interactive segments to create an explosive entertainment experience!


This is a concert event put on by the video game industry to help encourage and support the culture and art that video games have become. Video Games Live™ bridges a gap for entertainment by exposing new generations of music lovers and fans to the symphonic orchestral experience while also providing a completely new and unique experience for families and/or non-gamers. The show is heralded and enjoyed by the entire family. It's the power & emotion of a symphony orchestra mixed with the excitement and energy of a rock concert and the technology and interactivity of a video game all completely synchronized to amazing cutting edge video screen visuals, state-of-the-art lighting and special on-stage interactive segments with the audience.


If you or someone you know is into video games you won't want to miss this highly acclaimed one-of-a-kind concert experience. Or maybe you are looking for something cultural and exciting that the whole family will enjoy? Video Games Live™ is not just a concert, but a celebration of the entire video game industry that people of all ages will adore.


Video Games Live™ is created and produced by industry veteran and world famous video game composer Tommy Tallarico.


Video Games Live™ features the best music and exclusive synchronized video clips from the most popular games from the beginning of video gaming to the present. Game franchises include:


Mario™ 
Zelda™ 
Halo® 
Final Fantasy®
Warcraft®
StarCraft®
Diablo®
Sonic™
Metal Gear Solid®
Kingdom Hearts
Chrono Trigger™
Chrono Cross™
Mega Man™
Myst®
Tron
Castlevania®
Metroid®
Interactive Frogger
Interactive Space Invaders
Interactive Guitar Hero™
Interactive Donkey Kong™
Medal of Honor™
God of War™
BioShock™
Civilization IV
Tomb Raider®
Beyond Good & Evil™
Advent Rising
EverQuest® II
Mass Effect™
Shadow of the Colossus
Silent Hill™
Crysis®
Monkey Island
Earthworm Jim
End of Nations™
Afrika™
Assassin's Creed™ II
Uncharted™ II
Portal™
Lair
Conan
Command & Conquer: Red Alert
Headhunter
Splinter Cell®
Ghost Recon™
Rainbow Six®
Jade Empire
Contra
OutRun
Gears of War
Need For Speed®: Undercover
Harry Potter and the Order of the Phoenix™
Classic Arcade Medley featuring over 20+ games from Pong® to Donkey Kong® including such classics as Dragon's Lair, Tetris, Duck Hunt, Ghosts 'n Goblins, Gauntlet, Punch-Out, OutRun and MANY MORE!"

Planet in Action's 3D Sound in Google Earth: Part of the Interactive, Touchable 3D Picture (and thoughts about how this might play out on interactive whiteboards in education)

I came across a link to Planet in Action's video demonstration of 3D sound in Google Earth, thanks to a post by Nate Torkington in O'Reilly Radar.  WOW!   


The company shows that a 3D sound engine works nicely within the Google Earth environment.  Planet in Action tweaked the Soundmanager2 library from schillmania.com, resulting in a sound3D javascript object that can be used to program geo-located sounds in Google Earth.


The 3D sound concept, in my opinion, will be useful in creating immersive interactive educational experiences, especially if students have access to newer interactive whiteboards with decent sound systems.    


Below is the video from Planet in Action, along with a bit of promotional information:

The video is of a port in San Sabastian, Spain.  The "sound landscape" is realistic, and a range of sounds, from various spots in the scene, can be heard during the exploration.  


"Google Earth is a highly detailed 3D representation of our entire planet.  Rather than just looking at it, why not play on it!  PlanetInAction.com brings you top quality ideas, applications and concepts that will let you experience your planet in a whole new way." -Planet in Action


Thoughts:

My bet is that this concept will play out very well in the future in family rooms outfitted with large displays and decent surround sound systems. 

Why?  No need to explain.  Just take a look at what is going on with 3D TV and film,  3D HD gaming, interactive TV, internet-enabled large HD TVs, Google's "Lean Back" concept, and the "Slow Media" movement.

By the way, Planet in Action's work strikes a chord in me.  One of my HCI team travel planning projects that used Google Earth in the demonstration prototype.  We focused on cruise travel planning, mostly because I had lots of pictures and video clips from my cruise trips vacations and other travels.  I even worked on part of the project while I was ON a cruise ship.  (That was before the economic downturn.)   Below is a video of a cruise ship model that Planet in Action created for a cruise line, for use in Google Earth:

Celebrity Constellation Virtual Fly-by


SOMEWHAT RELATED

As I mentioned in my previous post, "Video Experiments: Sea Life Medley - Extended version with music",  I'm experimenting with some ideas to create interactive educational video clips for future use on higher-resolution interactive whiteboards and other large touch-screen surfaces.   


Part of my motivation stems from an immediate need for "touchable" content for the students I work with who have more significant disabilities, including autism- and of course, my colleagues. All of the classrooms in the program have IWBs- mostly brand-new SMARTBoards - - we also have a SMARTTable that is begging for more content.


As I worked with students using my video clips and a new SMARTboard, I noticed that students have a strong desire to touch what they see on the screen.  If they could stop the video and further explore item of interest, for example, the jellyfish in the above picture, it would be great.  


Imagine putting your hand on the jellyfish, and having the power to explore it as a 3D model! If you are a grad student or researcher who is working on this concept, or something related, please let me know.


Getting back to the 3D landscapes/soundscapes in Google Earth- this is something that I'd like to try at school.  I'm wonder if PlanetinAction allows for touch-screen interaction so that students who are at the SMARTBoard can easily explore the 3D-sound enabled scenes in Google Earth.

3D TV Post, Are we there yet?

Here is the link to my post, part of a series about 3D TV, on the Innovative Interactivity (II) blog:

3D TV: Are we there yet?