Riding the Light: How Dedicated Optical Circuits are Enabling New Science

“ Riding the Light: How Dedicated Optical Circuits are Enabling New Science" Future of Imaging Plenary Session SPIE Optics and Photonics Convention San Diego, CA August 15, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology; Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

Abstract During the last few years, a radical restructuring of optical networks supporting e-Science projects is beginning to occur around the world. U.S. universities are now able to acquire access to private, high bandwidth light pipes (termed "lambdas") through the National LambdaRail, providing direct access to scalable Linux clusters in individual user laboratories. These dedicated connections have a number of significant advantages over shared internet connections, including high bandwidth (10Gbps+), controlled performance (no jitter), lower cost per unit bandwidth, and security. These lambdas enable the Grid program to be completed, in that they add the network elements to the compute and storage elements which can be discovered, reserved, and integrated by the Grid middleware to form global LambdaGrids. I will describe our experience in setting up and using LambdaGrids as part of the NSF- funded OptIPuter (www.optiputer.net) and LOOKING (http://lookingtosea.ucsd.edu/), and Moore Foundation funded CAMERA research projects. These three projects explore how the lambdas enable new capabilities in medical imaging, earth sciences, interactive ocean observatories, and marine microbial metagenomics. A glimpse into future of global e-science was provided by the iGrid2005 workshop held at Calit2 in September 2005. I will review some of the most exciting new uses for lambdas demonstrated there by the two dozen countries participating.

From “Supercomputer–Centric” to “Supernetwork-Centric” Cyberinfrastructure Megabit/s Gigabit/s Terabit/s Network Data Source: Timothy Lance, President, NYSERNet 32x10Gb “Lambdas” 1 GFLOP Cray2 60 TFLOP Altix Bandwidth of NYSERNet Research Network Backbones T1 Optical WAN Research Bandwidth Has Grown Much Faster Than Supercomputer Speed! Computing Speed (GFLOPS)

Challenge: Average Throughput of NASA Data Products to End User is < 50 Mbps Tested October 2005 http://ensight.eos.nasa.gov/Missions/icesat/index.shtml Internet2 Backbone is 10,000 Mbps! Throughput is < 0.5% to End User

National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout Links Two Dozen State and Regional Optical Networks DOE, NSF, & NASA Using NLR San Francisco Pittsburgh Cleveland San Diego Los Angeles Portland Seattle Pensacola Baton Rouge Houston San Antonio Las Cruces / El Paso Phoenix New York City Washington, DC Raleigh Jacksonville Dallas Tulsa Atlanta Kansas City Denver Ogden/ Salt Lake City Boise Albuquerque UC-TeraGrid UIC/NW-Starlight Chicago International Collaborators NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone

High Energy and Nuclear Physics A Terabit/s WAN by 2010! Continuing the Trend: ~1000 Times Bandwidth Growth Per Decade; We are Rapidly Learning to Use Multi-Gbps Networks Dynamically Source: Harvey Newman, Caltech

The OptIPuter--High Resolution Interaction Visualization Over Dedicated Optical Channels to Global Science Data Source: Mark Ellisman, David Lee, Jason Leigh 300 MPixel Image! Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI Partners: SDSC, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST

Scalable Displays Allow Both Global Content and Fine Detail Source: Mark Ellisman, David Lee, Jason Leigh 30 MPixel SunScreen Display Driven by a 20-node Sun Opteron Visualization Cluster

Allows for Interactive Zooming from Cerebellum to Individual Neurons Source: Mark Ellisman, David Lee, Jason Leigh

Calit2 @ UCI Has the Largest Tiled Display Wall--HIPerWall Zeiss Scanning Electron Microscope in Calit2@ UCI Calit2@UCI Apple Tiled Display Wall Driven by 25 Dual-Processor G5s 50 Apple 30” Cinema Displays 200 Million Pixels of Viewing Real Estate! However, SAGE Must be Modified to Run on Mac Walls HDTV Digital Cameras Digital Cinema

What is the OptIPuter? Applications Drivers  Interactive Analysis of Large Data Sets OptIPuter Nodes  Scalable PC Clusters with Graphics Cards IP over Lambda Connectivity  Predictable Backplane Open Source LambdaGrid Middleware  Network is Reservable Data Retrieval and Mining  Lambda Attached Data Servers High Defn. Vis., Collab. SW  High Performance Collaboratory See Nov 2003 Communications of the ACM for Articles on OptIPuter Technologies www.optiputer.net

OptIPuter Software Architecture--a Service-Oriented Architecture Integrating Lambdas Into the Grid GTP XCP UDT LambdaStream CEP RBUDP Globus XIO GRAM GSI Source: Andrew Chien, UCSD DVC Configuration Distributed Virtual Computer (DVC) API DVC Runtime Library Distributed Applications/ Web Services Telescience Vol-a-Tile SAGE JuxtaView Visualization Data Services LambdaRAM DVC Services DVC Core Services DVC Job Scheduling DVC Communication Resource Identify/Acquire Namespace Management Security Management High Speed Communication Storage Services IP Lambdas Discovery and Control PIN/PDC RobuStore

UCSD Campus-Scale Routed OptIPuter with Nodes for Storage, Computation and Visualization

The Optical Core of the UCSD Campus-Scale Testbed -- Evaluating Packet Routing versus Lambda Switching Goals by 2007: >= 50 endpoints at 10 GigE >= 32 Packet switched >= 32 Switched wavelengths >= 300 Connected endpoints Approximately 0.5 TBit/s Arrive at the “Optical” Center of Campus Switching will be a Hybrid Combination of: Packet, Lambda, Circuit -- OOO and Packet Switches Already in Place Funded by NSF MRI Grant Lucent Glimmerglass Force10

Calit2@UCSD Photonics Networking Laboratory: Driving the Future Exponential Growthof Bandwidth Networking “Living Lab” Testbed Core Unconventional Coding High Capacity Networking Bidirectional Architectures Hybrid Signal Processing Interconnected to OptIPuter Access to Real World Network Flows Allows System Tests of New Concepts UCSD Parametric Processing Laboratory UCSD Photonics Shayan Mookherjea Optical devices and optical communication networks, including photonics, lightwave systems and nano-scale optics. Stojan Radic Optical communication networks; all-optical processing; parametric processes in high-confinement fiber and semiconductor devices. Shaya Fainman Nanoscale science and technology; ultrafast photonics and signal processing Joseph Ford Optoelectronic subsystems integration (MEMS, diffractive optics, VLSI); Fiber optic and free-space communications. George Papen Advanced photonic systems including optical communication systems, optical networking, and environmental and atmospheric remote sensing. ECE Testbed Faculty

September 26-30, 2005 Calit2 @ University of California, San Diego California Institute for Telecommunications and Information Technology Global Connections Between University Research Centers at 10Gbps T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y Maxine Brown, Tom DeFanti, Co-Chairs www.igrid2005.org 100Gb of Bandwidth into the Calit2@UCSD Building More than 150Gb GLIF Transoceanic Bandwidth! 450 Attendees, 130 Participating Organizations 20 Countries Driving 49 Demonstrations 1- or 10- Gbps Per Demo i Grid 2005

iGrid2005 Data Flows Multiplied Normal Flows by Five Fold! Data Flows Through the Seattle PacificWave International Switch

iGrid Lambda Digital Cinema Streaming Services: Telepresence Meeting in Calit2 Digital Cinema Auditorium Lays Technical Basis for Global Digital Cinema Sony NTT SGI Keio University President Anzai UCSD Chancellor Fox

iGrid 2005 Kyoto Nijo Castle Source: Toppan Printing Interactive VR Streamed Live from Tokyo to Calit2 Over Dedicated GigE and Projected at 4k Resolution

iGrid Lambda Control Services: Transform Batch to Real-Time Global e-Very Long Baseline Interferometry Goal: Real-Time VLBI Radio Telescope Data Correlation Achieved 512Mb Transfers from USA and Sweden to MIT Results Streamed to iGrid2005 in San Diego Optical Connections Dynamically Managed Using the DRAGON Control Plane and Internet2 HOPI Network Source: Jerry Sobieski, DRAGON

PI Larry Smarr Announced January 17, 2006 $24.5M Over Seven Years

Marine Genome Sequencing Project Measuring the Genetic Diversity of Ocean Microbes Sorcerer II Data Will Double Number of Proteins in GenBank!

Calit2’s Direct Access Core Architecture Will Create Next Generation Metagenomics Server Traditional User Response Request Source: Phil Papadopoulos, SDSC, Calit2 + Web Services Sargasso Sea Data Sorcerer II Expedition (GOS) JGI Community Sequencing Project Moore Marine Microbial Project NASA Goddard Satellite Data Community Microbial Metagenomics Data Flat File Server Farm W E B PORTAL Dedicated Compute Farm (1000 CPUs) TeraGrid: Cyberinfrastructure Backplane (scheduled activities, e.g. all by all comparison) (10000s of CPUs) Web (other service) Local Cluster Local Environment Direct Access Lambda Cnxns Data- Base Farm 10 GigE Fabric

Interactive Visualization of Thermatoga Proteins at Calit2 Source: John Wooley, Jurgen Schulze, Calit2

OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams OptIPortal– Termination Device for the OptIPuter Global Backplane

Calit2 and the Venter Institute Will Combine Telepresence with Remote Interactive Analysis Live Demonstration of 21st Century National-Scale Team Science OptIPuter Visualized Data HDTV Over Lambda 25 Miles Venter Institute

3D Videophones Are Here! The Personal Varrier Autostereo Display Varrier is a Head-Tracked Autostereo Virtual Reality Display 30” LCD Widescreen Display with 2560x1600 Native Resolution A Photographic Film Barrier Screen Affixed to a Glass Panel The Barrier Screen Reduces the Horizontal Resolution To 640 Lines Cameras Track Face with Neural Net to Locate Eyes The Display Eliminates the Need to Wear Special Glasses Source: Daniel Sandin, Thomas DeFanti, Jinghua Ge, Javier Girado, Robert Kooima, Tom Peterka—EVL, UIC

New OptIPuter Driver: Gigabit Fibers on the Ocean Floor -- Controlling Sensors and HDTV Cameras Remotely National Science Foundation Is Planning a New Generation of Ocean Observatories Ocean Research Interactive Observatory Networks (ORION) Fibered Observatories Linked to Land Fiber Infrastructure Laboratory for the Ocean Observatory Knowledge Integration Grid ( LOOKING ) Building a Prototype Based on OptIPuter Technologies Plus Web/Grid Services HDTV Streams Over IP Will be a Major Driver (Funded by NSF ITR- John Delaney, UWash, PI) LOOKING is Driven By NEPTUNE CI Requirements Making Management of Gigabit Flows Routine

Dedicated Fiber Optics Enable Remote Interactive HD Imaging of Deep Sea Vent Source John Delaney & Deborah Kelley, UWash Canadian-U.S. Collaboration

High Definition Video - 2.5 km Below the Ocean Surface

High Definition Still Frame of Hydrothermal Vent Ecology 2.3 Km Deep White Filamentous Bacteria on 'Pill Bug' Outer Carapace Source: John Delaney and Research Channel, U Washington 1 cm.

A Near Future Metagenomics Fiber Optic-Enabled Data Generator Source John Delaney, UWash

Riding the Light: How Dedicated Optical Circuits are Enabling New Science

More Related Content

What's hot

Viewers also liked

Similar to Riding the Light: How Dedicated Optical Circuits are Enabling New Science

More from Larry Smarr

Recently uploaded

Riding the Light: How Dedicated Optical Circuits are Enabling New Science