Migration of tools and methodologies for performance prediction and efficient HPC on cloud environments: results and conclusion

Authors

  • Ronal Muresano Computer Architecture and Operating System Department (CAOS), Universitat Autònoma de Barcelona, Barcelona, Spain
  • Alvaro Wong Computer Architecture and Operating System Department (CAOS), Universitat Autònoma de Barcelona, Barcelona, Spain
  • Dolores Rexachs del Rosario Computer Architecture and Operating System Department (CAOS), Universitat Autònoma de Barcelona, Barcelona, Spain
  • Emilio Luque Fadón Computer Architecture and Operating System Department (CAOS), Universitat Autònoma de Barcelona, Barcelona, Spain

Keywords:

Performance, PAS2P, Prediction, SPMD, Cloud

Abstract

Progress in the parallel programming field has allowed scientific applications to be developed with more complexity and accuracy. However, such precision requires greater computational power in order to be executed. How- ever, updating the local systems could be considered an expensive decision. For this reason, cloud computing is emerging as a commercial infrastructure that allows us to eliminate maintaining the computing hardware. For this reason, cloud is promising to be a computing alternative to clusters, grids and supercomputing for executing these applications. In this sense, this work is focused on describing the manner of migrating our prediction tool PAS2P (parallel application signature for performance prediction), and how we have to analyze our method for executing SPMD ap- plications efficiently on these cloud environments. In both cases, cloud could be considered a huge challenge due to the environment virtualization and the communication heterogeneities, which can seriously affect the application performance. However, our experimental evaluations make it clear that our prediction tool can predict with an error rate lower than 6,46%, considering that the signature for prediction represents a small portion of the execution time. On the other hand, analyzing the application parameters over the cloud computing allows us to find through an analytical model, which is the ideal number of virtual cores needed to obtain the maximum speedup under a defined efficiency. In this case the error rate was lower that 9% for the application tested.

Downloads

Download data is not yet available.

References

[1] Z. Hill and M. Humphrey, “A quantitative analysis of high performance computing with amazon’s ec2 infrastructure: The death of the local cluster?” in Grid Computing, 2009 10th IEEE/ACM International Conference on, 2009, pp. 26–33.
[2] R. Iosup, S. Ostermann, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, “An early performance analysis of cloud computing services for scientific computing,” Tech. Rep., 2008.
[3] K. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. J. Wasserman, and N. Wright, “Performance analysis of high performance computing applications on the amazon web services cloud,” in Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, 2010, pp. 159–168.
[4] A. Wong, D. Rexachs, and E. Luque, “Pas2p tool, parallel application signature for performance prediction,” in Proceedings of the 10th international conference on Applied Parallel and Scientific Computing- Volume Part I, ser. PARA’10. Berlin, Heidelberg: Springer-Verlag, 2012, pp. 293–302.
[5] R. Muresano, D. Rexachs, and E. Luque, “Methodology for efficient execution of spmd applications on multicore environments,” 10th IEEE/ACM Int Conf on Cluster, Cloud and Grid Comp, CCGrid 2010, Australia, pp. 185–195, 2010.
[6] “A method for scaling spmd applications on multicore clusters,” in In proceeding of: 2012 International Conference on Parallel and Distributed Processing Techniques and Applications. PDPTA, Las Vegas, 2012.
[7] A. Gupta and D. Milojicic, “Evaluation of hpc applications on cloud,” in Proceedings of the 2011 Sixth Open Cirrus Summit, ser. OCS ’11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 22–26.
[8] A. EC2. (2013, May) Amazon ec2 instances. [Online]. Available: http://aws.amazon.com/es/ec2/instance-types
[9] IBM. (2013, April) Ibm smart cloud. [Online]. Available: http://www.ibm.com/cloud-computing/us/en/

Downloads

Published

2018-04-13

How to Cite

Muresano, R., Wong, A., Rexachs del Rosario, D., & Luque Fadón, E. (2018). Migration of tools and methodologies for performance prediction and efficient HPC on cloud environments: results and conclusion. Journal of Computer Science and Technology, 13(03), p. 123–129. Retrieved from https://journal.info.unlp.edu.ar/JCST/article/view/596

Issue

Section

Original Articles

Most read articles by the same author(s)

1 2 > >>