Submit Search
Upload
Metrics that talk on cloud using ganglia
•
Download as ODP, PDF
•
1 like
•
1,761 views
Thomas Alrin
Follow
Perform metering and monitoring on your cloud applications
Read less
Read more
Technology
Report
Share
Report
Share
1 of 37
Download now
Recommended
Карбонаты бария и стронция. Производство и применение.
Карбонаты бария и стронция. Производство и применение.
SolvayRussia
Solvay group presentation
Solvay group presentation
SolvayRussia
Solvay sp wire&cable_applications_rus
Solvay sp wire&cable_applications_rus
SolvayRussia
Credit wise mobile app
Credit wise mobile app
madhuepitychia
Solvay sp oil&gas_applications_rus
Solvay sp oil&gas_applications_rus
SolvayRussia
Like loggly using open source
Like loggly using open source
Thomas Alrin
Monitoring with Ganglia
Monitoring with Ganglia
Fastly
Control your service resources with systemd
Control your service resources with systemd
Marian Marinov
Recommended
Карбонаты бария и стронция. Производство и применение.
Карбонаты бария и стронция. Производство и применение.
SolvayRussia
Solvay group presentation
Solvay group presentation
SolvayRussia
Solvay sp wire&cable_applications_rus
Solvay sp wire&cable_applications_rus
SolvayRussia
Credit wise mobile app
Credit wise mobile app
madhuepitychia
Solvay sp oil&gas_applications_rus
Solvay sp oil&gas_applications_rus
SolvayRussia
Like loggly using open source
Like loggly using open source
Thomas Alrin
Monitoring with Ganglia
Monitoring with Ganglia
Fastly
Control your service resources with systemd
Control your service resources with systemd
Marian Marinov
Open source Cloud Automation Platform
Open source Cloud Automation Platform
Kishore Neelamegam
How to improve gradle build speed
How to improve gradle build speed
Fate Chang
Ganglia Overview-v2
Ganglia Overview-v2
Chris Westin
Monitor PowerKVM using Ganglia, Nagios
Monitor PowerKVM using Ganglia, Nagios
Pradeep Kumar
Monitoring using Prometheus and Grafana
Monitoring using Prometheus and Grafana
Arvind Kumar G.S
Windows server 2012 and group policy
Windows server 2012 and group policy
Ravi Kumar Lanke
Meet Magento Spain 2019 - Our Experience with Magento Cloud
Meet Magento Spain 2019 - Our Experience with Magento Cloud
Lyzun Oleksandr
Metrics with Ganglia
Metrics with Ganglia
Gareth Rushgrove
GWAVACon 2013:GroupWise Windermere - OH
GWAVACon 2013:GroupWise Windermere - OH
GWAVA
GWAVACon 2013: GroupWise Windermere
GWAVACon 2013: GroupWise Windermere
GWAVA
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
Nagios
JCConf 2015 - 輕鬆學google的雲端開發 - Google App Engine入門(下)
JCConf 2015 - 輕鬆學google的雲端開發 - Google App Engine入門(下)
Simon Su
Decrease build time and application size
Decrease build time and application size
Keval Patel
Pyramid Deployment and Maintenance
Pyramid Deployment and Maintenance
Jazkarta, Inc.
OSMC 2018 | Why we recommend PMM to our clients by Matthias Crauwels
OSMC 2018 | Why we recommend PMM to our clients by Matthias Crauwels
NETWAYS
Prometheus and Docker (Docker Galway, November 2015)
Prometheus and Docker (Docker Galway, November 2015)
Brian Brazil
Gradle 3.0: Unleash the Daemon!
Gradle 3.0: Unleash the Daemon!
Eric Wendelin
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Opersys inc.
Prometheus - Intro, CNCF, TSDB,PromQL,Grafana
Prometheus - Intro, CNCF, TSDB,PromQL,Grafana
Sridhar Kumar N
W 0300 codingfor_life-batterylifethatis
W 0300 codingfor_life-batterylifethatis
jicheng687
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
Hervé Boutemy
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dash
narutouzumaki53779
More Related Content
Similar to Metrics that talk on cloud using ganglia
Open source Cloud Automation Platform
Open source Cloud Automation Platform
Kishore Neelamegam
How to improve gradle build speed
How to improve gradle build speed
Fate Chang
Ganglia Overview-v2
Ganglia Overview-v2
Chris Westin
Monitor PowerKVM using Ganglia, Nagios
Monitor PowerKVM using Ganglia, Nagios
Pradeep Kumar
Monitoring using Prometheus and Grafana
Monitoring using Prometheus and Grafana
Arvind Kumar G.S
Windows server 2012 and group policy
Windows server 2012 and group policy
Ravi Kumar Lanke
Meet Magento Spain 2019 - Our Experience with Magento Cloud
Meet Magento Spain 2019 - Our Experience with Magento Cloud
Lyzun Oleksandr
Metrics with Ganglia
Metrics with Ganglia
Gareth Rushgrove
GWAVACon 2013:GroupWise Windermere - OH
GWAVACon 2013:GroupWise Windermere - OH
GWAVA
GWAVACon 2013: GroupWise Windermere
GWAVACon 2013: GroupWise Windermere
GWAVA
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
Nagios
JCConf 2015 - 輕鬆學google的雲端開發 - Google App Engine入門(下)
JCConf 2015 - 輕鬆學google的雲端開發 - Google App Engine入門(下)
Simon Su
Decrease build time and application size
Decrease build time and application size
Keval Patel
Pyramid Deployment and Maintenance
Pyramid Deployment and Maintenance
Jazkarta, Inc.
OSMC 2018 | Why we recommend PMM to our clients by Matthias Crauwels
OSMC 2018 | Why we recommend PMM to our clients by Matthias Crauwels
NETWAYS
Prometheus and Docker (Docker Galway, November 2015)
Prometheus and Docker (Docker Galway, November 2015)
Brian Brazil
Gradle 3.0: Unleash the Daemon!
Gradle 3.0: Unleash the Daemon!
Eric Wendelin
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Opersys inc.
Prometheus - Intro, CNCF, TSDB,PromQL,Grafana
Prometheus - Intro, CNCF, TSDB,PromQL,Grafana
Sridhar Kumar N
W 0300 codingfor_life-batterylifethatis
W 0300 codingfor_life-batterylifethatis
jicheng687
Similar to Metrics that talk on cloud using ganglia
(20)
Open source Cloud Automation Platform
Open source Cloud Automation Platform
How to improve gradle build speed
How to improve gradle build speed
Ganglia Overview-v2
Ganglia Overview-v2
Monitor PowerKVM using Ganglia, Nagios
Monitor PowerKVM using Ganglia, Nagios
Monitoring using Prometheus and Grafana
Monitoring using Prometheus and Grafana
Windows server 2012 and group policy
Windows server 2012 and group policy
Meet Magento Spain 2019 - Our Experience with Magento Cloud
Meet Magento Spain 2019 - Our Experience with Magento Cloud
Metrics with Ganglia
Metrics with Ganglia
GWAVACon 2013:GroupWise Windermere - OH
GWAVACon 2013:GroupWise Windermere - OH
GWAVACon 2013: GroupWise Windermere
GWAVACon 2013: GroupWise Windermere
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
JCConf 2015 - 輕鬆學google的雲端開發 - Google App Engine入門(下)
JCConf 2015 - 輕鬆學google的雲端開發 - Google App Engine入門(下)
Decrease build time and application size
Decrease build time and application size
Pyramid Deployment and Maintenance
Pyramid Deployment and Maintenance
OSMC 2018 | Why we recommend PMM to our clients by Matthias Crauwels
OSMC 2018 | Why we recommend PMM to our clients by Matthias Crauwels
Prometheus and Docker (Docker Galway, November 2015)
Prometheus and Docker (Docker Galway, November 2015)
Gradle 3.0: Unleash the Daemon!
Gradle 3.0: Unleash the Daemon!
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Prometheus - Intro, CNCF, TSDB,PromQL,Grafana
Prometheus - Intro, CNCF, TSDB,PromQL,Grafana
W 0300 codingfor_life-batterylifethatis
W 0300 codingfor_life-batterylifethatis
Recently uploaded
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
Hervé Boutemy
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dash
narutouzumaki53779
2024 April Patch Tuesday
2024 April Patch Tuesday
Ivanti
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Scott Andery
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
HarshalMandlekar2
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
Curtis Poe
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
Manik S Magar
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
LoriGlavin3
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
Nathaniel Shimoni
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
Stephanie Beckett
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
Nicole Novielli
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Pim van der Noll
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
Hiroshi SHIBATA
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
LoriGlavin3
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
Sri Ambati
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
Lars Bell
A Framework for Development in the AI Age
A Framework for Development in the AI Age
Cprime
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
LoriGlavin3
How to write a Business Continuity Plan
How to write a Business Continuity Plan
Databarracks
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
panagenda
Recently uploaded
(20)
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
Visualising and forecasting stocks using Dash
Visualising and forecasting stocks using Dash
2024 April Patch Tuesday
2024 April Patch Tuesday
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
A Framework for Development in the AI Age
A Framework for Development in the AI Age
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
How to write a Business Continuity Plan
How to write a Business Continuity Plan
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
Metrics that talk on cloud using ganglia
1.
Metrics that “talk”
on Cloud using Ganglia How do we monitor performance on Megam Cloud
2.
We'll Cover ● Our Experience
Using Ganglia ● How does it work in our Platform ● Chef cookbooks for metering and setup. ● Dashboard integration © 2012-2013 Megam Systems
3.
What is Ganglia Scalable
distributed monitoring system for high-performance computing systems. Sends information about your cloud instance. Can be used as a live cloud monitor. Can be extended using python plugins © 2012-2013 Megam Systems
4.
What have we
accomplished ? Oh Yeah - <flip to next page> © 2012-2013 Megam Systems
5.
Dash #2 (AngularJs Client) Metrics
API gmon gmon gmetad gmetad gmetad gmon gmon © 2012-2013 Megam Systems
6.
Would you like
to setup one ? Yes you can (or) http://www.megam.co © 2012-2013 Megam Systems
7.
Few facts on
gmetad/gmond gmetad can run standalone or along with gmond. gmetad can be configured to collect metrics of gmond servers of same cluster or different cluster. gmetad stores data at ➔ /var/lib/ganglia/rrds/CLUSTER_NAME/GMOND_SERVER_NAME GMOND_SERVER_NAME can be changed in gmond.conf © 2012-2013 Megam Systems
8.
gmetad is the
metrics collector gmond is the metrics sender Ok. Got it. © 2012-2013 Megam Systems
9.
What is our
setup #1 gmetad : monitor1.megam.co #2 gmetad : montior2.megam.co Several gmonds(Cloud Apps) pumping data to gmetad © 2012-2013 Megam Systems
10.
What are Cloud
Apps Any app for lang := range ProgLanguages { Java Scala Go …. meteor } && DB, Queue © 2012-2013 Megam Systems
11.
Do you need
Graphite No Why ? Needs rrds formatted metric files It copies rrds files from gmetad Twice storage Is this the only soln ? Eager to hear feedback. © 2012-2013 Megam Systems
12.
Let us setup
gmetad 3.3.8-1 Ubuntu(raring) : package is gmetad Ubuntu(saucy) has 3.6.0 sudo apt-get install gmetad sudo apt-get install ganglia-webfrontend (*optional) We used Opscode cookbook to setup => Link © 2012-2013 Megam Systems
13.
Configure gmetad nano /etc/ganglia/gmetad.conf data_source
“megcluster” <gmond1>.megam.co:8649 <gmond2>.megam.co:8649 ➔ The above says “megcluster” collects metrics from <gmond1>.megam.co and <gmond2>.megam.co ➔ Which is like monitoring a Java App in <gmond1>.megam.co (or) ➔ Your favorite App in <gmond2>.megam.co © 2012-2013 Megam Systems
14.
gmetad - start/stop. Start
: sudo gmetad Stop : good old kill ps -ef | grep gmetad sudo kill -9 <pid> © 2012-2013 Megam Systems
15.
Cool gmetad -
monitor1.megam.co is running © 2012-2013 Megam Systems
16.
gmond Install ganglia-monitor-python package
will be installed in a server which is to be monitored. ➔ Package has methods to collect basic metrics(cpu...) using python scripts in /usr/lib/ganglia/ ➔ Extended by enabling additional python scripts at /usr/lib/ganglia/python_modules. ➔ For an exhaustive list : https://github.com/ganglia/gmond_python_modules ➔ © 2012-2013 Megam Systems
17.
Let us setup
gmond 3.3.8-1 Ubuntu(raring) : package is ganglia-monitor-python Ubuntu(saucy) has 3.6.0 sudo apt-get install ganglia-monitor-python We used Opscode cookbook to setup => Link © 2012-2013 Megam Systems
18.
Configure gmond nano /etc/ganglia/gmond.conf globals
{ override_hostname = <gmond1>.megam.co override_ip = 127.0.0.1 } udp_send_channel“megcluster” collects metrics from <gmond1>.megam.co and ➔ The above says { host = monitor1.megam.co <gmond2>.megam.co port = 8649 ttl ➔ 1 = Which is like monitoring a Java App in <gmond1>.megam.co } (or) cluster { nameYour favorite App in <gmond2>.megam.co = "megcluster" ➔ owner = "unspecified" } © 2012-2013 Megam Systems
19.
What did we
configure ? ➔ In the globals we say our monitoring Java App's host name < gmond1>.megam.co ➔ We provide the UDP channel of the gmetad (monitor1.megam.co) ➔ We need to specify the gmetad cluster (megcluster) ➔ cluster attribute groups all gmond to a gmetd <CLUSTER> in our case megcluster. © 2012-2013 Megam Systems
20.
gmond - start/stop. Start
: sudo gmond Stop : good old kill ps -ef | grep gmond sudo kill -9 <pid> © 2012-2013 Megam Systems
21.
Cool gmond -
<gmond1>.megam.co is running & pumping to monitor1.megam.co © 2012-2013 Megam Systems
22.
We customized chef
- cookbooks © 2012-2013 Megam Systems
23.
How do we
use the chef - cookbooks © 2012-2013 Megam Systems
24.
Tweak cookbook for
gmetad https://github.com/indykish/chef-repo/tree/master/cookbo ➔ Attributes default[:ganglia][:cluster_name] = "megcluster" default[:ganglia][:unicast] = true default[:ganglia][:hostname] = “monitoring1.megam.co” © 2012-2013 Megam Systems
25.
Chef Run :
gmetad Run chef : runlist 'recipe[megam_ganglia::gmetad]' © 2012-2013 Megam Systems
26.
Tweak recipes for
gmond For Any App ➔ Default : installs and configures ganglia-monitor-python. It collects the basic meterings like cpu_usage, memory_usage etc. ➔ Nginx : collects nginx status details. ➔ Rabbit : collects rabbbitmq metrics. ➔ Redis : collects redis metrics. ➔ Riak : collects riak metrics. © 2012-2013 Megam Systems
27.
Chef Run :
gmond To monitor an app include_recipe “megam_ganglia” Nginx frontended apps include_recipe “megam_ganglia::nginx” Rabbitmq apps include_recipe “megam_ganglia::rabbit” Riak apps include_recipe “megam_ganglia::riak” Redis apps include_recipe “megam_ganglia::redis” © 2012-2013 Megam Systems
28.
Configure gmond nano /etc/ganglia/gmond.conf globals
{ daemonize = yes setuid = yes user = nobody debug_level = 0 max_udp_msg_len = 1472 mute = no deaf = no host_dmax = 86400 /*secs */ cleanup_threshold = 300 /*secs */ gexec = no send_metadata_interval = 30 override_hostname = "<gmond1>.megam.co" override_ip = 127.0.0.1 } cluster { name = "megcluster" owner = "unspecified" latlong = "unspecified" url = "unspecified" } /* The host section describes attributes of the host, like the location */ host { location = "unspecified" } /* Feel free to specify as many udp_send_channels as you like. Gmond used to only support having a single channel */ udp_send_channel { host = monitoring1.megam.co port = 8649 ttl = 1 } © 2012-2013 Megam Systems
29.
Verifying gmond data Open
up your browser http://gmond1.megam.co:8649 ➔ It will list the metrics of the gmond instance. ➔ Not recommended for prod. © 2012-2013 Megam Systems
30.
Sample gmond data
(for redis server) © 2012-2013 Megam Systems
31.
Checking gmeta data Data
files in the below dir increases – Get metrics data at /var/lib/ganglia/rrds/megamcluster/gmond1.megam.co © 2012-2013 Megam Systems
32.
Sample gmetad data
(for thomas.work.local) © 2012-2013 Megam Systems
33.
Dash Integration in
rails Built on – – We'll cover it detail in a separate slideshare. If you are hungry “Code is the design” :) For questions on this area:rajthilak@megam.co.in © 2012-2013 Megam Systems
34.
References Ganglia Wiki megam chef-repo ©
2012-2013 Megam Systems
35.
Our Organization(Megam Systems) Beta
Launch of Megam Cloud (Polygot PaaS) Our PaaS design => Link Register http://www.megam.co for an invite Twitter : @indykish © 2012-2013 Megam Systems
36.
Screencast illustrating the
Cloud API Servers working live © 2012-2013 Megam Systems
37.
Thank you for watching ©
2012-2013 Megam Systems
Download now