Savanna project update Jan 2014

•

0 likes•1,507 views

Sergey Lukjanov

Entertainment & Humor Technology Business

Havana Release Overview
●
●
●
●
●
●

69 blueprints implemented
~150 bugs fixed
880 code commits from 31 people
3000+ code reviews
officially incubated for Icehouse!
more info: https://launchpad.net/savanna/havana

● 0.2 and 0.3 releases
● https://wiki.openstack.org/wiki/Savanna/ReleaseNotes

Havana Highlights
● from PoC to community-backed project
● contributors
○ core: Mirantis, Hortonworks, Red Hat
○ plus: HP, IBM, UnitedStack, Rackspace

● two plugins:
○ Vanilla
○ Hortonworks Data Platform

● clustering
● Elastic Data Processing
● OpenStack Dashboard plugin

Havana Highlights: Clustering
●
●
●
●
●

cluster provisioning
configuration management (templates)
cluster scaling
data nodes anti-affinity
200 nodes in 5 mins

Havana Highlights: EDP
● API to execute MapReduce jobs without exposing
details of underlying infrastructure
○ pluggable data sources: Swift
○ supported job types: jar, Pig, Hive
○ integration with Oozie for workflow management

● user-friendly UI for ad-hoc analytics queries based on
Hive or Pig

Icehouse Overview
● working on i-2 dev milestone now (release next week)
● so far:
○
○
○
○

24 blueprints implemented
~43 fixed
220 code commits from 26 people
1530+ code reviews

● more info: https://launchpad.net/savanna/icehouse

Icehouse Highlights
● new contributors
○ eNovance, Samsung, Intel, EPAM Systems, Zurich
University of Applied Science
● Heat integration for orchestration
● Intel Distribution of Hadoop plugin
● Gating Savanna (async)
○ DevStack integration
○ Tempest tests (base API)
● CLI proof of concept

Icehouse plans
●
●
●
●
●

Heat by default for orchestration
Tempest: scenarios, CLI
v2 API based on Pecan/WSME
complete CLI implementation
guest agents PoC

Q&A

email: slukjanov@mirantis.com
irc: SergeyLukjanov on Freenode

What's hot

The state of the art for OpenStack Data Processing (Hadoop on OpenStack) - At...spinningmatt

Lessons Learned from Building an Enterprise Big Data Platform from the Ground...DataWorks Summit

How to Share State Across Multiple Apache Spark Jobs using Apache Ignite with...Spark Summit

Savanna: Hadoop on OpenStackMirantis

Performance Troubleshooting Using Apache Spark MetricsDatabricks

20150425 experimenting with openstack sahara on dockerWei Ting Chen

OpenStack Trove Day (19 Aug 2014, Cambridge MA) - Saharaspinningmatt

Hadoop and OpenStackDataWorks Summit

Apache Spark Acceleration Using Hardware Resources in the Cloud, Seamlessl wi...Databricks

Using Apache Spark in the Cloud—A Devops Perspective with Telmo OliveiraSpark Summit

Tachyon and Apache Sparkrhatr

Benchmarking sahara based big data as a service solutionsZhidong Yu

Kylin and Druid Presentationargonauts007

MMLSpark: Lessons from Building a SparkML-Compatible Machine Learning Library...Spark Summit

Apache Kylin: Speed Up Cubing with Apache Spark with Luke Han and Shaofeng ShiDatabricks

SSR: Structured Streaming for R and Machine Learningfelixcss

Apache Spark on K8S Best Practice and Performance in the CloudDatabricks

Improved Applications with IPv6: an overviewCisco DevNet

Storage Engine Considerations for Your Apache Spark Applications with Mladen ...Spark Summit

Procella: A fast versatile SQL query engine powering data at YoutubeDataWorks Summit

What's hot (20)

The state of the art for OpenStack Data Processing (Hadoop on OpenStack) - At...

Lessons Learned from Building an Enterprise Big Data Platform from the Ground...

How to Share State Across Multiple Apache Spark Jobs using Apache Ignite with...

Savanna: Hadoop on OpenStack

Performance Troubleshooting Using Apache Spark Metrics

20150425 experimenting with openstack sahara on docker

OpenStack Trove Day (19 Aug 2014, Cambridge MA) - Sahara

Hadoop and OpenStack

Apache Spark Acceleration Using Hardware Resources in the Cloud, Seamlessl wi...

Using Apache Spark in the Cloud—A Devops Perspective with Telmo Oliveira

Tachyon and Apache Spark

Benchmarking sahara based big data as a service solutions

Kylin and Druid Presentation

MMLSpark: Lessons from Building a SparkML-Compatible Machine Learning Library...

Apache Kylin: Speed Up Cubing with Apache Spark with Luke Han and Shaofeng Shi

SSR: Structured Streaming for R and Machine Learning

Apache Spark on K8S Best Practice and Performance in the Cloud

Improved Applications with IPv6: an overview

Storage Engine Considerations for Your Apache Spark Applications with Mladen ...

Procella: A fast versatile SQL query engine powering data at Youtube

Viewers also liked

Twitter StormSergey Lukjanov

Resource Aware Scheduling in Apache StormDataWorks Summit/Hadoop Summit

Realtime Analytics with Storm and HadoopDataWorks Summit

Storm: distributed and fault-tolerant realtime computationnathanmarz

Scaling Apache Storm - Strata + Hadoop World 2014P. Taylor Goetz

Yahoo compares Storm and SparkChicago Hadoop Users Group

Hadoop Summit Europe 2014: Apache Storm ArchitectureP. Taylor Goetz

Apache Storm 0.9 basic training - VerisignMichael Noll

Viewers also liked (8)

Twitter Storm

Resource Aware Scheduling in Apache Storm

Realtime Analytics with Storm and Hadoop

Storm: distributed and fault-tolerant realtime computation

Scaling Apache Storm - Strata + Hadoop World 2014

Yahoo compares Storm and Spark

Hadoop Summit Europe 2014: Apache Storm Architecture

Apache Storm 0.9 basic training - Verisign

Similar to Savanna project update Jan 2014

Sahara Updates - Kilo EditionOpenStack Foundation

Sprint 78ManageIQ

ManetoDB: Key/Value storage, BigData in Open Stack_Сергей Ковалев, Илья СвиридовGeeksLab Odessa

Sahara Updates - Liberty EditionOpenStack Foundation

Deploying OpenNebula in an HPC environmentOpenNebula Project

Deploying OpenNebula in an HPC environmentCSUC - Consorci de Serveis Universitaris de Catalunya

Oracle week Israel - OpenStack Platform - 2013Arthur Berezin

Apache Cassandra Lunch #94: StreamSets and CassandraAnant Corporation

Data Engineer's Lunch #57: StreamSets for Data EngineeringAnant Corporation

Big Trends in Big DataNaresh Chintalcheru

Openstack For Beginnerscpallares

LCA13: LAVA and CI Component ReviewLinaro

Whats new in_juno_meetup_barcelonaJaume Devesa Gomez

State of openstack industry: Why we are doing thisDmitriy Novakovskiy

OpenStack as an InfrastructureRoozbeh Shafiee

Apache Airflow in ProductionRobert Sanders

Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...StampedeCon

Univa and SUSE at SC17: Scaling Machine Learning for SUSE Linux Containers, S...Ian Lumb

Building an open source high performance data analytics platformsupun06

Welcome to icehouseMarcos García

Similar to Savanna project update Jan 2014 (20)

Sahara Updates - Kilo Edition

Sprint 78

ManetoDB: Key/Value storage, BigData in Open Stack_Сергей Ковалев, Илья Свиридов

Sahara Updates - Liberty Edition

Deploying OpenNebula in an HPC environment

Oracle week Israel - OpenStack Platform - 2013

Apache Cassandra Lunch #94: StreamSets and Cassandra

Data Engineer's Lunch #57: StreamSets for Data Engineering

Big Trends in Big Data

Openstack For Beginners

LCA13: LAVA and CI Component Review

Whats new in_juno_meetup_barcelona

State of openstack industry: Why we are doing this

OpenStack as an Infrastructure

Apache Airflow in Production

Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...

Univa and SUSE at SC17: Scaling Machine Learning for SUSE Linux Containers, S...

Building an open source high performance data analytics platform

Welcome to icehouse

Recently uploaded

Call Girls In Moti Bagh (8377877756 )-Genuine Rate Girls Servicedollysharma2066

Amil Baba in Pakistan Kala jadu Expert Amil baba Black magic Specialist in Is...Amil Baba Company

Call Girls Near Taurus Sarovar Portico Hotel New Delhi 9873777170Sonam Pathan

Call Girls Near Delhi Pride Hotel New Delhi 9873777170Sonam Pathan

Hi Class Call Girls In Goa 7028418221 Call Girls In Anjuna Beach Escort ServicesApsara Of India

NO1 WorldWide Amil Baba In Karachi Kala Jadu In Karachi Amil baba In Karachi ...Amil Baba Dawood bangali

定制(UofT毕业证书)加拿大多伦多大学毕业证成绩单原版一比一lvtagr7

Amil Baba in karachi Kala jadu Expert Amil baba Black magic Specialist in Isl...Amil Baba Company

Call Girls Ellis Bridge 7397865700 Independent Call Girlsssuser7cb4ff

Zoom In Game for ice breaking in a trainingRafik ABDI

Taken Pilot Episode Story pitch Documentf4ssvxpz62

FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377087607dollysharma2066

NO1 WorldWide Amil baba in pakistan Amil Baba in Karachi Black Magic Islamaba...Amil baba

Call Girl Contact Number Andheri WhatsApp:+91-9833363713Sonam Pathan

Call Girls SG Highway 7397865700 Ridhima Hire Me Full Nightssuser7cb4ff

Vip Udaipur Call Girls 9602870969 Dabok Airport Udaipur Escorts ServiceApsara Of India

The Fine Line Between Honest and Evil Comics by Salty VixenSalty Vixen Stories & More

Call Girls Sabarmati 7397865700 Ridhima Hire Me Full Nightssuser7cb4ff

Authentic No 1 Amil Baba In Pakistan Authentic No 1 Amil Baba In Karachi No 1...First NO1 World Amil baba in Faisalabad

Udaipur Call Girls 9602870969 Call Girl in Udaipur RajasthanApsara Of India

Recently uploaded (20)

Call Girls In Moti Bagh (8377877756 )-Genuine Rate Girls Service

Amil Baba in Pakistan Kala jadu Expert Amil baba Black magic Specialist in Is...

Call Girls Near Taurus Sarovar Portico Hotel New Delhi 9873777170

Call Girls Near Delhi Pride Hotel New Delhi 9873777170

Hi Class Call Girls In Goa 7028418221 Call Girls In Anjuna Beach Escort Services

NO1 WorldWide Amil Baba In Karachi Kala Jadu In Karachi Amil baba In Karachi ...

定制(UofT毕业证书)加拿大多伦多大学毕业证成绩单原版一比一

Amil Baba in karachi Kala jadu Expert Amil baba Black magic Specialist in Isl...

Call Girls Ellis Bridge 7397865700 Independent Call Girls

Zoom In Game for ice breaking in a training

Taken Pilot Episode Story pitch Document

FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377087607

NO1 WorldWide Amil baba in pakistan Amil Baba in Karachi Black Magic Islamaba...

Call Girl Contact Number Andheri WhatsApp:+91-9833363713

Call Girls SG Highway 7397865700 Ridhima Hire Me Full Night

Vip Udaipur Call Girls 9602870969 Dabok Airport Udaipur Escorts Service

The Fine Line Between Honest and Evil Comics by Salty Vixen

Call Girls Sabarmati 7397865700 Ridhima Hire Me Full Night

Authentic No 1 Amil Baba In Pakistan Authentic No 1 Amil Baba In Karachi No 1...

Udaipur Call Girls 9602870969 Call Girl in Udaipur Rajasthan

Savanna project update Jan 2014

1. OpenStack Data Processing (Savanna) Project Update January 16, 2014 Sergey Lukjanov, Data Processing Program PTL

2. Havana Release Overview ● ● ● ● ● ● 69 blueprints implemented ~150 bugs fixed 880 code commits from 31 people 3000+ code reviews officially incubated for Icehouse! more info: https://launchpad.net/savanna/havana ● 0.2 and 0.3 releases ● https://wiki.openstack.org/wiki/Savanna/ReleaseNotes

3. Havana Highlights ● from PoC to community-backed project ● contributors ○ core: Mirantis, Hortonworks, Red Hat ○ plus: HP, IBM, UnitedStack, Rackspace ● two plugins: ○ Vanilla ○ Hortonworks Data Platform ● clustering ● Elastic Data Processing ● OpenStack Dashboard plugin

4. Havana Highlights: Clustering ● ● ● ● ● cluster provisioning configuration management (templates) cluster scaling data nodes anti-affinity 200 nodes in 5 mins

5. Havana Highlights: EDP ● API to execute MapReduce jobs without exposing details of underlying infrastructure ○ pluggable data sources: Swift ○ supported job types: jar, Pig, Hive ○ integration with Oozie for workflow management ● user-friendly UI for ad-hoc analytics queries based on Hive or Pig

6. Icehouse Overview ● working on i-2 dev milestone now (release next week) ● so far: ○ ○ ○ ○ 24 blueprints implemented ~43 fixed 220 code commits from 26 people 1530+ code reviews ● more info: https://launchpad.net/savanna/icehouse

7. Icehouse Highlights ● new contributors ○ eNovance, Samsung, Intel, EPAM Systems, Zurich University of Applied Science ● Heat integration for orchestration ● Intel Distribution of Hadoop plugin ● Gating Savanna (async) ○ DevStack integration ○ Tempest tests (base API) ● CLI proof of concept

8. Icehouse plans ● ● ● ● ● Heat by default for orchestration Tempest: scenarios, CLI v2 API based on Pecan/WSME complete CLI implementation guest agents PoC

9. Q&A email: slukjanov@mirantis.com irc: SergeyLukjanov on Freenode

Savanna project update Jan 2014

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (8)

Similar to Savanna project update Jan 2014

Similar to Savanna project update Jan 2014 (20)

Recently uploaded

Recently uploaded (20)

Savanna project update Jan 2014