跳到主要內容

簡易檢索 / 詳目顯示

回結果列表
研究生： 劉冠吟
Guan-Yin Liu
論文名稱： 建構於JMeter之自動化分散式壓力測試架構
Automatically Distributed Stress Testing Architecture Based On JMeter
指導教授： 鄭永斌
Yung-Pin Cheng
口試委員:
學位類別： 碩士
Master
系所名稱： 資訊電機學院 - 資訊工程學系
Department of Computer Science & Information Engineering
論文出版年： 2015
畢業學年度： 103
語文別： 中文
論文頁數： 55
中文關鍵詞： 壓力測試 、負載測試 、JMeter 、測試自動化 、TaaS
外文關鍵詞： stress testing, load testing, JMeter, testing automation, TaaS
相關次數： 點閱：11  下載：0 
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

    • 軟體開發的過程中，為了確保系統的穩定性，我們常常會使用負載測試(Load Testing)來檢驗此系統是否符合規格書中系統所能承受的負載能力；另外再利用壓力測試(Stress Testing)來測試系統所能負荷的工作量超出負荷後系統是否運作正常。這兩種測試都必須模擬大量同時上線人數(concurrent users)。
    Software Testing Portal為本團隊所開發的TaaS平台，為一種第三方測試服務。平台主要為利用開源測試工具JMeter來執行負載測試/壓力測試，模擬同時上線人數使用待測系統的情形。而本研究為了模擬大量的同時上線使用者，設計一個自動化壓力測試分散式系統架構，使這個TaaS平台需要支援可以自動同時配置與分配多台伺服器給測試人員，模擬負載/壓力測試所需要的大量concurrent users。但不需要考量系統背後的設計架構，與系統所要設定的某些參數等細節。
    在壓力測試過程中，通常會模仿使用者真實使用系統的行為，來找到系統潛在的瓶頸。但是，在對大型系統進行壓力測試時，所要模擬的同時上線人數數量非常龐大，這將會耗費許多測試資源。本研究將提出一個方法，以觀察待測系統資源消耗的方式，經過不斷加重系統的負荷，接著利用統計資源消耗的曲線圖來估計系統可能會使用的系統資源量。期待能用最少的測試設備，來簡單發現系統可能的壓力臨界值，並藉此讓測試團隊找出系統可能會發生瓶頸的原因。

    In order to ensure a software system can survive large number of concurrent users, load testing and stress testing are two major approaches to verify such a non-functional requirement. To test such a non-functional requirement, we need to mimic a large number of concurrent users using stress testing tools.
    In the past, a TaaS (Test as a Service) portal was built to support 3rd party independent testing service. This portal adopt the open source stress testing tool “JMeter” to build a transparent service which support a large number of concurrent users but hide the setup and implementation details from the testers. To simulate numerous concurrent users, this TaaS portal can automatically assign a lot of testing servers to execute load/stress testing at the same time.
    Besides, to find out the scalability problem of a system, emulating a large number of concurrent users that is close to the real scenarios is the ultimate solution. However, this is an expensive approach which may requires a lot of computing resources. In this thesis, we propose an attempt to avoiding such a problem. Instead of simulating the real number of concurrent users, we install different sensors on system under test. Through increasing the workload on system, and inspecting the system’s resource consuming history, we can observe the growth rate of these resource usages to predict what could happen when the expected number of concurrent users are reached.

    第1章、 緒論 1 1-1 研究動機 1 1-2 問題描述 3 1-2-1 模擬大量使用者 3 1-2-2 模擬真實的代價與可能替代方案 4 第2章、 背景與相關研究 5 2-1 TESTING-AS-A-SERVICE(TAAS) 5 2-1-1 TaaS定義 5 2-1-2 傳統測試服務與TaaS的比較 5 2-2 JMETER 7 2-3 負載測試 8 2-3-1 負載測試目的 8 2-3-2 負載測試步驟 9 2-4 壓力測試 9 2-5 D-CLOUD[13] 10 第3章、 SOFTWARE TESTING PORTAL 12 3-1 第三方測試平台 12 3-2 軟體測試工具鍊 13 3-3 雲端測試平台 14 3-4 功能介紹 14 3-4-1 網頁功能測試 14 3-4-2 壓力測試/負載測試 15 3-4-3 迴歸測試(Regression Test)[14] 16 3-5 架構 17 第4章、 分散式壓力測試系統架構 19 4-1 問題 19 4-1-1 手動修改JMeter設定檔 20 4-1-2 管理測試伺服器 23 4-1-3 Remote Testing的限制 23 4-2 分散式壓力測試系統架構設計與實做 23 4-2-1 JMeter remote testing 23 4-2-2 自動分配測試伺服器 24 4-2-3 Distributed Mode與Normal Mode 26 4-2-4 成果 27 第5章、 代價較低的系統瓶頸推估與預測 28 5-1 研究動機 28 5-2 系統瓶頸 29 5-3 模擬真實使用者行為的困難 29 5-4 模擬真實測試環境的代價 30 5-5 低代價的系統瓶頸推估步驟 31 5-6 結論 32 第6章、 研究成果評估 34 6-1 評估案例選擇 34 6-2 評估工具選擇 34 6-3 評估案例一 - MEDIAWIKI 35 6-3-1 實驗環境 35 6-3-2 實驗方法 35 6-3-3 實驗結果 36 6-4 評估案例二 – REDMINE 39 6-4-1 實驗環境 39 6-4-2 實驗方法 40 6-4-3 實驗結果 41 6-5 評估案例結論 43 第7章、 結論與探討 44

    1. Lian, Y., et al. Testing as a Service over Cloud. in Service Oriented System Engineering (SOSE), 2010 Fifth IEEE International Symposium on. 2010.
    2. Selenium. Available from: http://www.seleniumhq.org/.
    3. JMeter. Available from: http://jmeter.apache.org/.
    4. Jenkins. Available from: https://jenkins-ci.org/.
    5. Zhen Ming, J., et al. Automatic identification of load testing problems. in Software Maintenance, 2008. ICSM 2008. IEEE International Conference on. 2008.
    6. Gao, J., et al. Testing as a Service (TaaS) on Clouds. in Service Oriented System Engineering (SOSE), 2013 IEEE 7th International Symposium on. 2013.
    7. Khanna, R. Making the Most of Test Automation as a Service. in Cloud Computing in Emerging Markets (CCEM), 2012 IEEE International Conference on. 2012.
    8. Minzhi, Y., et al. WS-TaaS: A Testing as a Service Platform for Web Service Load Testing. in Parallel and Distributed Systems (ICPADS), 2012 IEEE 18th International Conference on. 2012.
    9. Menasce, D., Load testing of Web sites. Internet Computing, IEEE, 2002. 6(4): p. 70-74.
    10. Xingen, W., Z. Bo, and L. Wei. Model Based Load Testing of Web Applications. in Parallel and Distributed Processing with Applications (ISPA), 2010 International Symposium on. 2010.
    11. Performance vs. load vs. stress testing. Available from: http://agiletesting.blogspot.tw/2005/02/performance-vs-load-vs-stress-testing.html.
    12. 負載測試. Available from: http://baike.baidu.com/view/651437.htm#2.
    13. Banzai, T., et al. D-Cloud: Design of a Software Testing Environment for Reliable Distributed Systems Using Cloud Computing Technology. in Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on. 2010.
    14. Regression Test. Available from: http://en.wikipedia.org/wiki/Regression_testing.
    15. Java Remote Method Invocation. Available from: http://www.oracle.com/technetwork/articles/javaee/index-jsp-136424.html.
    16. JMeter Remote Testing.
    17. Cristiana Amza, E.C., Anupam Chanda, Alan L. Cox, Sameh Elnikety, Elmootazbellah N. Elnozahy, Romer Gil, Julie Marguerite, Karthick Rajamani and Willy Zwaenepoel. Bottleneck Characterization of Dynamic Web Site Benchmarks Available from: http://www.research.ibm.com/acas/projects/01rajamani.pdf.
    18. Manzoor, S. Web applications Performance Symptoms and Bottlenecks Identification. 2012; Available from: http://www.agileload.com/agileload/blog/2012/11/27/web-applications-performance-symptoms-and-bottlenecks-identification.
    19. MediaWiki. Available from: http://www.mediawiki.org/wiki/MediaWiki.
    20. Redmine. Available from: http://www.redmine.org/.

    QR CODE
    :::