Karmasphere Studio™
    for Hadoop™




  Shevek, Lead Engineer
Introduced at Hadoop World
Gerster karmasphere studio integrates with
   amazon, hadoop. Push a button to deploy to
   the cloud.
fourbitsdotcom Definitely downloading
    #karmasphere the minute I get back home.
    Thanks@amazon!
benhardy Karmasphere at #hadoopworld looks          “"Wow! Fantastic! Last night I
   cool, & NetBeans supports #Clojure too!       worked through the online tutorials,
gravitymonkey Karmasphere studio for netbeans     and deployed to both the unit test
   to manage hadoop, and in amazon map             environment and to my Amazon
   reduce!                                        account. It was just like deploying
                                                    any Java project to Tomcat or
stuartsierra Karmasphere at #hadoopworld looks
                                                   some other server; all the usual
   cool
                                                    development, debugging and
igrigorik this is AWESOME. karmasphere =          deployment tools were there. You
    netbeans IDE for developing + running MR     guys get my vote for 2009 product
    Hadoop jobs                                              of the year."”


                     Confiden'al

An IDE for Hadoop

•  Develop

•  Debug

•  Deploy

•  Monitor
Karmasphere Studio Capabilities
•  Prototype on the desktop
  –  Get going quickly. No cluster required.

•  Deploy to a private or cloud-based cluster
  –  Deploy job/s easily. Even through firewalls to remote clusters.

•  Debug on the cluster
  –  Visual tools deliver insight into the job during and after the job
     flow.

•  Visualize and manipulate graphically
  –  Clusters, file systems, job configuration, debugging information,
     log files.

•  Monitor and analyze Hadoop job/s in real-
   time
  –  Real-time, workflow view of inputs, outputs and intermediate
     results                       4

Compatibility and Integration
•  Major platforms
  –  Windows; Mac; Linux
•  Major Hadoop
   distributions
  –  Cloudera; Apache;
     Yahoo!
  –  0.18, 0.19 and 0.20
•  Closely integrated with
   Amazon cloud
  –  Elastic MapReduce and
     Amazon S3
           Confiden'al

Creating a Job
Deploying a Job




Confiden'al

Developing Jobs




Confiden'al

Accessing a Cluster
                             Datacenter


User
Accessing a Cluster
                             Datacenter


User
Configuring a Cluster




 Confiden'al

Configuring a File System




   Confiden'al

Monitoring Clusters and Jobs




    Confiden'al

Inspecting Jobs




Confiden'al

Cluster Capacity and Usage




    Confiden'al

Monitoring a Job




Confiden'al

Demo
    Karmasphere Studio for Hadoop
Including support for private and public
  cloud deployment, monitoring and
              debugging.




        Confiden'al

Join the crowd…




Free Beta Available Today
 www.karmasphere.com
Contact Us
•  Technical
  –  shevek@karmasphere.com
•  Business
  –  martinh@karmasphere.com
•  Support
  –  support@karmasphere.com
•  Web
  –  www.karmasphere.com

Karmasphere Studio for Hadoop

  • 1.
    Karmasphere Studio™ for Hadoop™ Shevek, Lead Engineer
  • 2.
    Introduced at HadoopWorld Gerster karmasphere studio integrates with amazon, hadoop. Push a button to deploy to the cloud. fourbitsdotcom Definitely downloading #karmasphere the minute I get back home. Thanks@amazon! benhardy Karmasphere at #hadoopworld looks “"Wow! Fantastic! Last night I cool, & NetBeans supports #Clojure too! worked through the online tutorials, gravitymonkey Karmasphere studio for netbeans and deployed to both the unit test to manage hadoop, and in amazon map environment and to my Amazon reduce! account. It was just like deploying any Java project to Tomcat or stuartsierra Karmasphere at #hadoopworld looks some other server; all the usual cool development, debugging and igrigorik this is AWESOME. karmasphere = deployment tools were there. You netbeans IDE for developing + running MR guys get my vote for 2009 product Hadoop jobs of the year."” Confiden'al

  • 3.
    An IDE forHadoop •  Develop •  Debug •  Deploy •  Monitor
  • 4.
    Karmasphere Studio Capabilities • Prototype on the desktop –  Get going quickly. No cluster required. •  Deploy to a private or cloud-based cluster –  Deploy job/s easily. Even through firewalls to remote clusters. •  Debug on the cluster –  Visual tools deliver insight into the job during and after the job flow. •  Visualize and manipulate graphically –  Clusters, file systems, job configuration, debugging information, log files. •  Monitor and analyze Hadoop job/s in real- time –  Real-time, workflow view of inputs, outputs and intermediate results 4

  • 5.
    Compatibility and Integration • Major platforms –  Windows; Mac; Linux •  Major Hadoop distributions –  Cloudera; Apache; Yahoo! –  0.18, 0.19 and 0.20 •  Closely integrated with Amazon cloud –  Elastic MapReduce and Amazon S3 Confiden'al

  • 6.
  • 7.
  • 8.
  • 9.
    Accessing a Cluster Datacenter User
  • 10.
    Accessing a Cluster Datacenter User
  • 11.
    Configuring a Cluster Confiden'al

  • 12.
    Configuring a FileSystem Confiden'al

  • 13.
    Monitoring Clusters andJobs Confiden'al

  • 14.
  • 15.
    Cluster Capacity andUsage Confiden'al

  • 16.
  • 17.
    Demo Karmasphere Studio for Hadoop Including support for private and public cloud deployment, monitoring and debugging. Confiden'al

  • 18.
    Join the crowd… FreeBeta Available Today www.karmasphere.com
  • 19.
    Contact Us •  Technical –  [email protected] •  Business –  [email protected] •  Support –  [email protected] •  Web –  www.karmasphere.com