簡易檢索 / 詳目顯示
| 研究生： |
陸俊廷 Chun-Ting Lu |
|---|---|
| 論文名稱： |
雲端服務下自動化部署及監控系統之管理架構 Automatic Monitoring and Deployment of Cloud Services |
| 指導教授： |
王尉任
Wei-Jen Wang |
| 口試委員: | |
| 學位類別： |
碩士 Master |
| 系所名稱： |
資訊電機學院 - 資訊工程學系 Department of Computer Science & Information Engineering |
| 論文出版年： | 2013 |
| 畢業學年度： | 101 |
| 語文別： | 中文 |
| 論文頁數： | 54 |
| 中文關鍵詞： | 雲端服務 、Hadoop 、自動化部署 、監控 、Puppet |
| 外文關鍵詞： | cloud services, Hadoop, automatic deployment, monitoring, Puppet |
| 相關次數： | 點閱：17 下載：0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
Hadoop為常見Platform as a Service中常見的雲端工具，並為終端使用者提供運算平台。在大部分情況下，安裝Hadoop集群需要在大量的計算主機安裝不同的軟體資源。傳統的軟體安裝方式，管理者需要在不同的主機下重覆相同的安裝步驟，對於管理者而言是相當沒效率及花費時間的。除此之外，分散於這些主機上的不同軟體其更新的需求也不盡相同。近幾年來，許多部署的工具即為解決此類問題而推出，其一名為Puppet，其不但可解決軟體部署問題同時亦可應用在Hadoop的安裝上。它使用了伺服器驅動的方式部署軟體在不同的計算主機上，換句話說，Puppet主機定期接收到客戶端的部署報告並從其中資訊判斷是否有軟體資源需要更新。儘管其解決了關於軟體部署的複雜性及問題，但仍面臨到關於擴充性的問題，當客戶端規模龐大時，大量的訊息回傳，伺服器的處理效率將會成為服務效率中的瓶頸。為了解決此項問題，我們提出了一自動化的部署工具，它基於Puppet部署Hadoop集群並採取了客戶端驅動的方式避免了上述問題。在部署過程中，我們提出的部署工具首先在伺服器端發送不同的部署條件，接著客戶端定期從伺服器端接收到的訊息判斷何種軟體需要安裝或軟體是否需要更新。當此部署工具與一般部署工具針對在Hadoop的安裝上比較，我們可以發現在大規模的集群下使用此部署工具效率較為優秀，其部署彈性也是較其他工具優秀。
Hadoop is a common cloud tool to build a cloud platform that can be accessed by end-users. In most cases, installation of a Hadoop platform requires installation of different software packages on tens to thousands of computing machines. With a traditional software deployment strategy, the administrators need to repeat similar installation procedures on different computing machines, which is inefficient and time-consuming. In addition, different software components that are distributed among the computing hosts may need to be upgraded. Recently, a popular software deployment tool called Puppet is developed to solve the problem of software deployment, and can apply to Hadoop installation. It uses a server-driven model to install and update various software packages on many computing machines. That is, the Puppet deployment server periodically receives reports from the deployment clients (targets), and computes what software packages are required by what deployment clients. Although it simplifies the problem of software deployment, it still suffers the scalability problem --- the server becomes an obvious performance bottleneck when the number of deployment clients is large. To overcome the problem, we have developed an automatic, client-driven deployment tool for Hadoop based on Puppet. At first, the proposed deployment tool dispatch different installation rules from the deployment server to the client (target) machines. Then, the client periodically checks the server for what versions of software packages are required, and installs software packages if necessary. When compared with similar deployment tools for Hadoop, the proposed deployment tool works better when the number of deployment clients is relatively large.
[1]M. Armbrust, I. Stoica, M. Zaharia, A. Fox, R. Griffith,
A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D.
Patterson, and A. Rabkin, “A view of cloud computing,”
Commun. Acm, vol. 53, no. 4, pp. 50–58, Apr. 2010.
[2]Ian Foster, Yong Zhao, Ioan Raicu, and Shiyong Lu, “Cloud
Computing and Grid Computing 360-Degree Compared,” p.
P.1–P.10, Nov. 2008.
[3]Michael Armbrust, Armando Fox, Rean Griffith, Anthony
D.Joseph, Randy Katz, Andy Konwinski, Gunho Lee, David
Patterson, Ariel Rabkin, Ion Stoica, and Matei Zaharia,
“Above the Clouds: A Berkeley View of Cloud Computing,”
Uc Berkeley Reliab. Adapt. Distrib. Syst. Lab., Feb.
2009.
[4]B. Furht and A. Escalante, “Handbook of Cloud Computing -
Springer,” 2010.
[5]National Institute of Standards and Technology, “The NIST
Definition of Cloud Computing,” 2011.
[6]“Welcome to ApacheTM Hadoop®!” [Online]. Available:
http://hadoop.apache.org/.
[7]Tom White, Hadoop 技術手冊 第二版 Hadoop: The Definitive
Guide, Second Edition. 歐萊禮, 2011.
[8]董西成, Hadoop技術內幕(深入解析MapReduce架構設計與實現原理). 機械
工業, 2013.
[9]“About AWS.” [Online]. Available:
http://aws.amazon.com/about-aws/. [Accessed: 04-Jun-
2013].
[10]“AWS OpsWorks - Flexible Application Management in the
Cloud Using Chef.” [Online]. Available:
http://aws.typepad.com/aws/2013/02/aws-opsworks-
flexible-application-management-in-the-cloud.html.
[11]“AWS Elastic Beanstalk.” [Online]. Available:
http://aws.amazon.com/elasticbeanstalk/.
[12]“Free the cloud with Dell Crowbar,” Dell. [Online].
Available: http://www.dell.com/learn/us/en/555/cloud-
computing/crowbar-software-framework?c=us&l=en&s=biz.
[Accessed: 04-Jun-2013].
[13]Yue-Shan Chang, Wei-Jen Wang, Yu-Sheng Wu, Jun-Ting Lu,
Lee Shu-Teng Chen, and Chilung Wang, “Software
Deployment and Management on a Large-Scale Cloud Data
Center,” 2013 Symp. Cloud Serv. Comput. Natl. Cheng K.
Univ. Taiwan, Mar. 2013.
[14]Itri Today, “The World’s First 『All-in-One』 Cloud
Computing System,” Nov. 2011.
[15]“Preboot Execution Environment (PXE) Specification -
Version 2.1,” Intel Corp., Sep. 1999.
[16]Puppet Labs, “What is Puppet?” [Online]. Available:
https://puppetlabs.com/puppet/what-is-puppet/.
[17]James Turnbull and Jeffrey McCune, Pro Puppet. Apress,
2011.
[18]D. Bode and N. Liu, Puppet Types and Providers. Oreilly
& Associates Inc, 2012.
