Title :
High Resolution Media Streaming for Immersive, Collaborative Environments
Speaker :
Beomjoo Seo
The University of Southern California
Time & Place :
March 14(Tuesday), 2006. 14:30~
Building 301, Room 101, Seoul National University
Abstract:
The vision for our work is the creation of the complete aural and visual ambience that places a person or a group of people in a virtual space where they can experience events occurring at a remote site or communicate naturally regardless of their location. This talk presents our framework to enable distributed, high fidelity, immersive environments for remote group collaborations. We introduce the High-performance Data Recording Architecture (HYDRA) which aims to provide a unified paradigm that integrates multi-channel, high definition live media streaming, recording, retrieval and control in a coherent manner. We elaborate on the technology we have developed for live streaming and our experimental experiences. There are numerous challenges when implementing HD media streaming. We have focused on compressed streams (MPEG-2) with bandwidth requirements that makes them suitable for today’s Internet. The challenges for live and interactive applications include minimizing the end-to-end latency, improving the transmission error resilience, and efficient video rendering at the destination. To this end we have explored both software and hardware decoders, assessing their strengths and weaknesses and determining their applicability. The technology is presented in the context of the following experiments that our group has conducted over the last year.
A recent demonstration towards our goal included the two-way, interactive streaming between Inha University in Korea and USC in Los Angeles. Expanding beyond a single stream in each direction, the first multi-channel HD streaming exhibit was demonstrated at the Fall 2004 Internet2 Member Meeting held at the University of Texas at Austin in September of 2004. Our HYDRA technology was used for the Gala Event of the conference to stream four-channels of live, high definition video capturing the performers of UT Austin’s Miro string quartet and rendering them virtually at a second venue.
We will also give an overview of our on-going experiments that are part of the Distributed Immersive Performance (DIP) project. DIP explores one of the most challenging goals of networked media technology: creating a seamless environment for remote and synchronous musical collaboration. We present initial results from our experiments for determining the effects of latency in auditory feedback on performers’ satisfaction with the ease of creating a tight ensemble, a musical interpretation and adaptation to the conditions. These experiments mark the beginning of our continuing efforts to study systematically the effects of musical interaction over the Internet in a realistic performance setting.
Short Bio of Beomjoo Seo:
He is a Ph.D. candidate of Computer Science Department at the University of Southern California. He received the B.S. (1994) and M.S. (1996) degrees in Computer Engineering from Seoul National University. He worked as a software engineer at LG Electronics from 1996 to 2001. At 2001,
He joined the Data Management Research Laboratory (Adviser: Professor Roger Zimmermann) of Integrated Media Systems Center (IMSC) at USC. His research interests are Distributed Storage Model, Peer-to-Peer Streaming, Data Migration, and Spatial Indexing for Virtual Environments.