CISS: CISS: The Canadian The Canadian Internetworked Scientific Scientific Internetworked Supercomputer Supercomputer Chris Pinchak Pinchak, , Paul Lu Paul Lu , Jonathan Schaeffer, Mark Goldenberg , Jonathan Schaeffer, Mark Goldenberg Chris Dept. of Computing Science Dept. of Computing Science University of Alberta University of Alberta paullu@cs.ualberta.ca paullu@cs.ualberta.ca http://www.cs cs. .ualberta ualberta.ca/~ .ca/~ciss ciss http://www. (for the CISS and Trellis Teams) (for the CISS and Trellis Teams) 1
Thank you to… … Thank you to n Wolfgang Wolfgang J Jä äger ger , , Aiko Huckauf Aiko Huckauf, , Yunjie Xu Yunjie Xu n n Many, many other people Many, many other people… … n n C3.ca, CFI, NSERC, C3.ca, CFI, NSERC, Netera Netera, CANARIE , CANARIE n n Dozens of systems administrators and Dozens of systems administrators and n managers from across Canada managers from across Canada http://www.cs cs. .ualberta ualberta.ca/~ .ca/~ciss ciss/ / http://www. 2
Overview Overview n Motivation Motivation n n CISS-1, November 4, 2002 CISS-1, November 4, 2002 n n CISS-3, August 2003 CISS-3, August 2003 n n Concluding Remarks Concluding Remarks n CISS-2 was completed January 2003 CISS-2 was completed January 2003 CISS-3 is scheduled for August 2003 CISS-3 is scheduled for August 2003 Call for Proposals due May 23, 2003 Call for Proposals due May 23, 2003 (Q&A tonight, Monday, 7 PM, Room: Lac Mégantic) 3
Motivation Motivation Overlay Metacomputer B Overlay Metacomputer A Group HPC Server HPC Centre 1 Dept. HPC HPC Centre 2 4
CISS-1 Participants CISS-1 Participants 5
CISS-1 Resources CISS-1 Resources Site CPUs Site CPUs Site CPUs Site CPUs athlon-cluster@ -cluster@UofA UofA 32 maci-cluster@ -cluster@UofC UofC 176 athlon 32 maci 176 aurora@ aurora@UofA UofA 236 236 mercury@NRC mercury@NRC 48 48 jasper@ jasper@UofA UofA 26 26 minerva minerva@UVIC @UVIC 128 128 bugaboo@SFU bugaboo@SFU 192 192 monolith@Waterloo monolith@Waterloo 16 16 sick kids hospital 96 myri@ @Sherbrooke Sherbrooke 8 sick kids hospital 96 myri 8 deeppurple@ @ SHARCNET 22 p4-cluster@UofA 26 deeppurple 22 p4-cluster@UofA 26 SHARCNET driftwood@UBC 16 stokes@CLUMEQ 248 driftwood@UBC 16 stokes@CLUMEQ 248 gnome@UofS UofS 32 symphony@UNB 2 gnome@ 32 symphony@UNB 2 hammerhead@ SHARCNET 22 white@UofM UofM 22 hammerhead@ 22 white@ 22 SHARCNET herzberg herzberg@Memorial @Memorial 20 20 zodiac@UBC zodiac@UBC 8 8 Total Total 1,376 1,376 6
CISS-1 CISS-1 n November 4, 2002 November 4, 2002 n n At its peak, used 1,376 processors At its peak, used 1,376 processors n …at 20 facilities at 20 facilities … …in 18 administrative domains in 18 administrative domains … …at 16 universities and institutions at 16 universities and institutions … n In 24 hours, CISS-1 computed the equivalent of In 24 hours, CISS-1 computed the equivalent of n 3.5 years worth of computational chemistry 3.5 years worth of computational chemistry …7,593 MOLPRO jobs on November 4 7,593 MOLPRO jobs on November 4 … …over 27,000 jobs in total before and after over 27,000 jobs in total before and after … 7
CISS-1 Application CISS-1 Application n Computational chemistry Computational chemistry n using the MOLPRO using the MOLPRO application application n “ “Embarrassingly parallel Embarrassingly parallel” ” (a (a n good thing!), capacity good thing!), capacity computing computing n Heavy use of temporary Heavy use of temporary n storage storage n Developed by Developed by n Dr. Wolfgang J Jä äger ger and his and his Dr. Wolfgang group in the Dept. of group in the Dept. of Chemistry Chemistry 8
“Major Major” ” CISS-1 Sites CISS-1 Sites “ Site Number Total Mean Site Number Total Mean stokes@CLUMEQ 2162.47 5625:23:44 2:36:05 stokes@CLUMEQ 2162.47 5625:23:44 2:36:05 bugaboo@SFU 1575.22 3984:29:37 2:31:46 bugaboo@SFU 1575.22 3984:29:37 2:31:46 maci-cluster@ -cluster@UofC UofC 1064.61 2919:52:07 2:44:34 maci 1064.61 2919:52:07 2:44:34 aurora@UofA UofA 437.17 4530:30:47 10:21:46 aurora@ 437.17 4530:30:47 10:21:46 CISS is primarily about capacity computing. Capability computing is a different (and important) problem. CISS does support MPI and shared-memory threads. 9
Some Lessons from CISS Some Lessons from CISS n Social problems are harder Social problems are harder n Social problems Social problems n n than technical problems than technical problems n Exclusive access Exclusive access n n Bad technology can make Bad technology can make n n Interference with local Interference with local n social problems worse, but social problems worse, but issues issues good technology can rarely good technology can rarely solve them solve them n Attracting computational Attracting computational n n CISS is well-suited for CISS is well-suited for scientists scientists n capacity computing capacity computing n Technical problems Technical problems n n Many scientific problems are Many scientific problems are n n Compiler differences Compiler differences n too resource-intensive for too resource-intensive for SETI@home-style SETI@home-style n Temporary disk space Temporary disk space n techniques techniques n Data movement Data movement n 10
CISS-3, August 2003 CISS-3, August 2003 n Call for Proposals out now, due May 23 Call for Proposals out now, due May 23 n n During an entire month, we could provide During an entire month, we could provide n 100+ CPU years of total computation 100+ CPU years of total computation n Scientific merit is the main selection Scientific merit is the main selection n criteria criteria We need your help to make CISS-3 a success! We need your help to make CISS-3 a success! 11
Concluding Remarks Concluding Remarks n Trellis infrastructure is scalable Trellis infrastructure is scalable n n 1,376 placeholders in 18 administrative domains 1,376 placeholders in 18 administrative domains n n CPUs, memory, storage, CPUs, memory, storage, software software, , social infrastructure social infrastructure, , n and networking are all important and networking are all important n The focus is on computational science The focus is on computational science n n CISS-1: Computational chemistry CISS-1: Computational chemistry n n CISS-2: Molecular dynamics and physics CISS-2: Molecular dynamics and physics n n CISS-3 (August 2003): Looking for a large, world-class CISS-3 (August 2003): Looking for a large, world-class n application on the order of 100+ CPU-years worth of application on the order of 100+ CPU-years worth of computation computation 12
Claim to Fame Claim to Fame n Jack Van Jack Van Impe Impe n n “ “The Bible Prophecy The Bible Prophecy n Portal of the Internet” ” Portal of the Internet n http://www.jvim.org/ http://www.jvim.org/ n n December 7, 2002 show December 7, 2002 show n (no longer on-line) (no longer on-line) 13
Infamous Infamous 14
Thank you to… … Thank you to n Wolfgang Wolfgang J Jä äger ger , , Aiko Huckauf Aiko Huckauf, , Yunjie Xu Yunjie Xu n n Many, many other people Many, many other people… … n n C3.ca, CFI, NSERC, C3.ca, CFI, NSERC, Netera Netera, CANARIE , CANARIE n n Dozens of systems administrators and Dozens of systems administrators and n managers from across Canada managers from across Canada http://www.cs cs. .ualberta ualberta.ca/~ .ca/~ciss ciss/ / http://www. 15
Recommend
More recommend
