Process tracking for dynamic tuning applications on the grid

Authors

  • Genaro Costa Department of Computer Architecture & Operating Systems, Universitat Autònoma de Barcelona, UAB, Bellaterra, 08193, Barcelona, Spain
  • Anna Morajko Department of Computer Architecture & Operating Systems, Universitat Autònoma de Barcelona, UAB, Bellaterra, 08193, Barcelona, Spain
  • Tomás Margalef Department of Computer Architecture & Operating Systems, Universitat Autònoma de Barcelona, UAB, Bellaterra, 08193, Barcelona, Spain
  • Emilio Luque Fadón Department of Computer Architecture & Operating Systems, Universitat Autònoma de Barcelona, UAB, Bellaterra, 08193, Barcelona, Spain

Keywords:

grid monitoring, dynamic instrumentation, dynamic performance analysis

Abstract

The computational resources need by the scientific community to solve problems is beyond the current available infrastructure. Performance requirements are needed due constant research progress, new problems studies or detail increase of the current ones. Users create new wide distributed systems such as computational Grids to achieve desired performance goals. Grid systems are generally built on top of available computational resources as cluster, parallel machines or storage devices distributed within different organizations and those resources are interconnected by a network. Application tuning on Grid environment is a hard task due system characteristics like multi-cluster job distribution among different local schedulers and dynamic network bandwidth behavior. We had a Monitoring, Analysis and Tuning Environment (MATE) that allows dynamic performance tuning applications within a cluster. Due to the many software layers present on the grid, similar job submission may execute on different places. To tune application jobs, our tool needs to locate and follow the jobs execution within the system. We call this a process tracking problem. This paper presents MATE integration to the Grid and the two process tracking approaches implemented in order to solve the process tracking problem within Grid systems.

Downloads

Download data is not yet available.

References

[1] J. L. Hennessy, D. A. Patterson, and D. A. Patterson, Computer architecture : a quantitative approach, 3rd ed. San Francisco, CA: Morgan Kaufmann Publishers, 2003.
[2] K. Castagnera, D. Cheng, R. Fatoohi, E. Hook, B. Kramer, C. Manning, J. Musch, C. Niggley, W. Saphir, D. Sheppard, M. Smith, I. Stockdale, S. Welch, R. Williams, and D. Yip, "Clustered Workstations and their Potential Role as High Speed Compute Processors," NAS Computational Services, Technical Report 1994.
[3] I. Foster and C. Kesselman, The Grid 2: Blueprint for a New Computing Infrastructure. San Francisco: Morgan Kauffman, 2003.
[4] I. Foster, C. Kesselman, J. M. Nick, and S. Tuecke, "The Physiology of the Grid," pp. 217--249, 2003.
[5] I. T. Foster, C. Kesselman, and S. Tuecke, "The Anatomy of the Grid - Enabling Scalable Virtual Organizations," in International Journal of High Performance Computing. vol. 15, 2001, p. 200.
[6] L. DeRose and D. A. Reed, "SvPablo: A Multi-Language Architecture-Independent Performance Analysis System," in Proceedings of the ICPP 99Japan, 1999, pp. 311-318.
[7] B. P. Miller, M. D. Callaghan, J. M. Cargille, J. K. Hollingsworth, R. B. Irvin, K. L. Karavanic, K. Kunchithapadam, and T. Newhall, "The Paradyn parallel performance measurement tool," Computer, vol. 28, pp. 37--46, 1995.
[8] C. Tapus, I.-H. Chung, and J. K. Hollingsworth, "Active Harmony: Towards Automated Performance Tuning," SC’02, November 2002.
[9] R. L. Ribler, H. Simitci, and D. A. Reed, "The Autopilot performance-directed adaptive control system," Future Gener. Comput. Syst., vol. 18, pp. 175--187, 2001.
[10] R. L. Ribler, J. S. Vetter, H. Simitci, and D. A. Reed, "Autopilot: Adaptive Control of Distributed Applications," in HPDC, 1998, pp. 172-179.
[11] B. Buck and J. K. Hollingsworth, "An API for Runtime Code Patching," Journal of High Performance Computing Applications, 2000.
[12] A. Morajko, "Dynamic Tuning of Parallel/Distributed Applications." vol. Phd: Universitat Autonoma de Barcelona, 2004.
[13] A. Morajko, O. Morajko, T. Margalef, and E. Luque, "MATE : Dynamic Performance Tuning Environment," LNCS, vol. 3149, pp. 98-107, 2004.
[14] A. S. Grimshaw, W. A. Wulf, and C. T. L. Team, "The Legion vision of a worldwide virtual computer," Commun. ACM, vol. 40, pp. 39--45, 1997.
[15] J. Frey, T. Tannenbaum, I. Foster, M. Livny, and S. Tuecke, "Condor-G: A Computation Management Agent for Multi-Institutional Grids," in Cluster Computing, 2002, pp. 237-246.
[16] "Portable Batch System Administrator Guide," Veridian Systems PBS Products Dept. 2672 Bayshore Parkway, Suite 810 Mountain View, CA 94043: Veridian Information Solutions, Inc., 2000.
[17] "Automatic TCP Window Tuning and Applications," in issue of NLANR Packets: http://www.nlanr.net/NLANRPackets/v2.1/autotcpwindowtuning.html.
[18] M. T. Heath, Etheridge, J.A, "Visualizing the performance of parallel programs," IEEE Computer, vol. 28, pp. 21-28, November 1995.
[19] W. E. Nagel, A. Arnold, M. Weber, H. C. Hoppe, and K. Solchenbach, "Vampir: Visualization and Analysis of MPI Resources," Supercomputer, vol. 12, pp. 69-80, 1996.
[20] I. T. Foster, "Globus Toolkit Version 4: Software for Service-Oriented Systems," in NPC, 2005, pp. 2-13.
[21] N. T. Karonis, B. Toonen, and I. Foster, "MPICH-G2: A Grid-enabled implementation of the Message Passing Interface," Journal of Parallel and Distributed Computing, vol. 63, pp. 551--563, May 2003.
[22] K. Czajkowski, D. F. Ferguson, I. Foster, J. Frey, S. Graham, I. Sedukhin, D. Snelling, S. Tuecke, and W. Vambenepe, "The WS-Resource Framework," White Paper, 2005.
[23] K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman, "Grid information services for distributed resource sharing," in High Performance Distributed Computing, 2001. Proceedings. 10th IEEE International Symposium on, 2001, pp. 181--194.
[24] W. Allcock, J. Bresnahan, R. Kettimuthu, and J. Link, "Globus eXtensible Input/Output System (XIO): A Protocol Independent IO System for the Grid," ipdps, p. 179a, 2005.

Downloads

Published

2007-03-01

How to Cite

Costa, G., Morajko, A., Margalef, T., & Luque Fadón, E. (2007). Process tracking for dynamic tuning applications on the grid. Journal of Computer Science and Technology, 7(01), p. 28–33. Retrieved from https://journal.info.unlp.edu.ar/JCST/article/view/799

Issue

Section

Original Articles

Most read articles by the same author(s)

1 2 > >>