Unattended Apache BigTop installer CD using preseed
1. 無人值守 Apache BigTop 安裝光碟
Unattended Apache BigTop installer CD using preseed
Jazz Yao-Tsung Wang 王耀聰 <jazz@nchc.org.tw>
Co-Founder of Hadoop.TW
Associate Researcher,
National Center for High-performance Computing
2013/11/10
1
2. On 11 Feb 2011, 4$ shared about preseed !
感謝 4$ 大大分享 Debian 6.0 自動化安裝
Source: http://fourdollars.blogspot.tw/2011/02/4-debian-60.html
2
3. Giveaway (1) :
My tiny work on Apache BigTop installer CD
https://github.com/jazzwang/haduzilla
- master branch: for Ubuntu 12.04
- debian branch: for Debian 7.0.2
3
4. ISO files for BigTop 0.6.0~0.7.0
http://sourceforge.net/projects/drbl-hadoop/files/
4
6. Basic Info. of BigTop installer CD
- ID:
user
- Password:
hadoop.TW
- Default installed
Hadoop 2.0
YARN
- Suggest:
Install Hue
- Note:
amd64 only
6
7. Giveaway (2)
How to deal with Big Data ?
Let's talk about
“Big Data
Architecture”.
7
8. Current Status of Big Data …..
Big data is like teenage sex:
everyone talks about it,
nobody really knows how to do it,
everyone thinks everyone else is doing it,
so everyone claims they are doing it ..
– Dan Ariely, Professor at Duke University
and Professor at Center for Advanced Hindsight
8
13. 巨量資料的標準定義
3 Vs of Big Data
Volume 資料數量
(amount of data)
EB
參考來源：
[1] Laney, Douglas. "3D Data Management: Controlling
Data Volume, Velocity and Variety" (6 February 2001)
[2] Gartner Says Solving 'Big Data' Challenge Involves
More Than Just Managing Volumes of Data, June 2011
Structured
結構化資料
Batch ( 批次作業 )
Semi-structured
半結構化資料
PB
Unstructured
非結構化資料
Variety 資料多樣性
(data types, sources)
Realtime ( 即時資料 )
TB
Velocity 資料增加率
(speed of data in/out)
巨量資料的挑戰在於如何管理「數量」、「增加率」與「多樣性」
13
13
14. 處理巨量資料的三類技術 (1)
Data at Rest – MapReduce Framework
e
Volume
e
uc
ed
R
ap
M
Batch
Hadoop
HPCC
Unstructured
Variety
EB
PB
TB
Structured
Petabyte File System
m
ra
F
k
or
w
Realtime
Velocity
14
14
22. Evolution of
Apache Hadoop Ecosystem
Hadoop World 2011: The Hadoop Stack - Then, Now and in the Future
http://www.slideshare.net/slideshow/embed_code/10110006
22
23. Complexity of
Apache Big Data Stack
Hadoop World 2011: The Hadoop Stack - Then, Now and in the Future
http://www.slideshare.net/slideshow/embed_code/10110006
23
24. Complexity of
Apache Big Data Stack
Hadoop World 2011: The Hadoop Stack - Then, Now and in the Future
http://www.slideshare.net/slideshow/embed_code/10110006
24
