Hardware evaluation and procurement Yannick Perret Hardware evaluation and procurement Hardware: competition, evolution, Evaluation of CPU nodes manufactur- ers. . . for procurement purposes at CC-IN2P3 Hardware: CPU Manufacturers Evaluation Whom for, what Yannick Perret for? CC-IN2P3 Existing benchmarks Centre de Calcul Our benchmarks IN2P3 Hardwares procurements Some results 3T1 22-23 May 2007 Conclusion Yannick Perret Hardware evaluation and procurement
Outline Hardware evaluation and Hardware: competition, evolution, manufacturers. . . procurement 1 Yannick Perret Hardware: CPU Manufacturers Hardware: competition, evolution, Evaluation manufactur- 2 ers. . . Whom for, what for? Hardware: CPU Manufacturers CC-IN2P3 Evaluation Existing benchmarks Whom for, what for? Our benchmarks CC-IN2P3 Existing benchmarks Our benchmarks Hardwares procurements 3 Hardwares procurements Some results Some results 4 Conclusion Conclusion 5 Yannick Perret Hardware evaluation and procurement
Outline Hardware evaluation and Hardware: competition, evolution, manufacturers. . . procurement 1 Yannick Perret Hardware: CPU Manufacturers Hardware: competition, evolution, Evaluation manufactur- 2 ers. . . Whom for, what for? Hardware: CPU Manufacturers CC-IN2P3 Evaluation Existing benchmarks Whom for, what for? Our benchmarks CC-IN2P3 Existing benchmarks Our benchmarks Hardwares procurements 3 Hardwares procurements Some results Some results 4 Conclusion Conclusion 5 Yannick Perret Hardware evaluation and procurement
CPU evolution Hardware evaluation and procurement Yannick Perret An evolving situation Hardware: AMD and Intel produce good *x86 processors competition, ◮ evolution, manufactur- CPU power increases very fast ◮ ers. . . Hardware: CPU number of cores ◮ Manufacturers frequencies ◮ Evaluation Whom for, what Electric needs are decreasing ◮ for? CC-IN2P3 Existing new CPU frequencies (for a given model) ◮ benchmarks Our benchmarks new CPU models each 6 (or few) mounths ◮ Hardwares procurements Situation is not stable, competition exists, models evolve. Some results Conclusion Yannick Perret Hardware evaluation and procurement
Manufacturers / retailers Hardware Known companies: DELL , HP , IBM , NEC , SUN , . . . evaluation and procurement Roughtly the same machines Yannick Perret same processor(s) ◮ Hardware: competition, same motherboard architecture ◮ evolution, manufactur- ers. . . same memory ◮ Hardware: CPU Manufacturers Evaluation With some differences Whom for, what for? disks technology, integrated RAID CC-IN2P3 ◮ Existing benchmarks management ( IPMI , Service processor, . . . ) ◮ Our benchmarks Hardwares quality (air cooling, power supply, . . . ) ◮ procurements support quality Some results ◮ Conclusion integration (rack and/or box) ◮ . . . and the price. . . ◮ Yannick Perret Hardware evaluation and procurement
Manufacturers / retailers Hardware Known companies: DELL , HP , IBM , NEC , SUN , . . . evaluation and procurement Roughtly the same machines Yannick Perret same processor(s) ◮ Hardware: competition, same motherboard architecture ◮ evolution, manufactur- ers. . . same memory ◮ Hardware: CPU Manufacturers Evaluation With some differences Whom for, what for? disks technology, integrated RAID CC-IN2P3 ◮ Existing benchmarks management ( IPMI , Service processor, . . . ) ◮ Our benchmarks Hardwares quality (air cooling, power supply, . . . ) ◮ procurements support quality Some results ◮ Conclusion integration (rack and/or box) ◮ . . . and the price. . . ◮ Yannick Perret Hardware evaluation and procurement
Outline Hardware evaluation and Hardware: competition, evolution, manufacturers. . . procurement 1 Yannick Perret Hardware: CPU Manufacturers Hardware: competition, evolution, Evaluation manufactur- 2 ers. . . Whom for, what for? Hardware: CPU Manufacturers CC-IN2P3 Evaluation Existing benchmarks Whom for, what for? Our benchmarks CC-IN2P3 Existing benchmarks Our benchmarks Hardwares procurements 3 Hardwares procurements Some results Some results 4 Conclusion Conclusion 5 Yannick Perret Hardware evaluation and procurement
Experiments Hardware evaluation and procurement Yannick Perret Hardware: competition, Experiments have various needs evolution, manufactur- pure CPU jobs ◮ ers. . . Hardware: CPU large I/O jobs (disk and/or network) Manufacturers ◮ Evaluation large memory usage ◮ Whom for, what for? CC-IN2P3 a combination of items ◮ Existing benchmarks Our benchmarks We must take all these needs in account Hardwares procurements Some results Conclusion Yannick Perret Hardware evaluation and procurement
CC-IN2P3 needs Hardware evaluation and procurement Yannick Perret CC-IN2P3 has its own needs Hardware: to reach or computing goals ◮ competition, evolution, minimize needed electric power manufactur- ◮ ers. . . minimize heat generation Hardware: CPU ◮ Manufacturers minimize used floor space in the computer room Evaluation ◮ Whom for, what minimize cost! for? ◮ CC-IN2P3 Existing electric supplies cost ◮ benchmarks Our benchmarks network supplies cost ◮ Hardwares electric consumption cost ◮ procurements Some results So. . . to obtain the best at the lowest cost! Conclusion Yannick Perret Hardware evaluation and procurement
Configuration constraints Hardware evaluation and procurement Yannick Perret Hardware: competition, Moreover, some choices imply constraints evolution, manufactur- ers. . . The number of cores implies configuration constraints Hardware: CPU Manufacturers needed amount of memory ◮ Evaluation Whom for, what disk size ◮ for? CC-IN2P3 network bandwidth Existing ◮ benchmarks Our benchmarks Hardwares procurements Some results Conclusion Yannick Perret Hardware evaluation and procurement
Existing benchmarks Hardware evaluation and procurement Yannick Perret CPU and machines manufacturers give benchmarks of CPU Hardware: power and electric consumption ( SPECint and electric competition, consumption) evolution, manufactur- ers. . . This is not usable Hardware: CPU Manufacturers CPU manufacturer benchmarks are more and more ◮ Evaluation Whom for, what irrelevant for? CC-IN2P3 Existing real jobs rarely optimize ressources of a given CPU ◮ benchmarks Our benchmarks maximum electric consumption is not the effective ◮ Hardwares procurements consumption Some results Conclusion Yannick Perret Hardware evaluation and procurement
Our benchmarks Hardware evaluation and procurement Yannick Perret Hardware: competition, Our benchmarks are based on an estimation of real-world jobs evolution, manufactur- CPU medium to intensive treatments ◮ ers. . . Hardware: CPU medium to large memory usage Manufacturers ◮ Evaluation disk and network I/Os ◮ Whom for, what for? CC-IN2P3 Existing In addition electric consumption is measured in various benchmarks Our benchmarks situations Hardwares procurements Some results Conclusion Yannick Perret Hardware evaluation and procurement
Our benchmarks (2) Hardware evaluation and procurement Yannick Perret Measured values Hardware: CPU power is computed as the power ratio of a reference ◮ competition, evolution, machine manufactur- ers. . . power consumption is also computed as the power ratio ◮ Hardware: CPU Manufacturers effective minimal, maximal and average power ◮ Evaluation consumption Whom for, what for? CC-IN2P3 CPU effectiveness is the ratio between the previous values ◮ Existing benchmarks (amount of electric power needed to compute the same Our benchmarks Hardwares amount of treatments) procurements Some results We urge manufacturers to lend us new machines. . . Conclusion Yannick Perret Hardware evaluation and procurement
Outline Hardware evaluation and Hardware: competition, evolution, manufacturers. . . procurement 1 Yannick Perret Hardware: CPU Manufacturers Hardware: competition, evolution, Evaluation manufactur- 2 ers. . . Whom for, what for? Hardware: CPU Manufacturers CC-IN2P3 Evaluation Existing benchmarks Whom for, what for? Our benchmarks CC-IN2P3 Existing benchmarks Our benchmarks Hardwares procurements 3 Hardwares procurements Some results Some results 4 Conclusion Conclusion 5 Yannick Perret Hardware evaluation and procurement
Hardwares procurements Hardware evaluation and procurement For hardware procurement, we give the ratio between measured Yannick Perret and theoretical SPECint values for CPU models. Offers must match the total CPU power needed (with our Hardware: competition, measures), the maintenance requirements and the other evolution, manufactur- constraints (e.g. management) ers. . . Hardware: CPU Manufacturers Then additionnal costs are added to the offer Evaluation cost of the electric consumption for 3 years Whom for, what ◮ for? CC-IN2P3 electric supplies (depend on number of machines and ◮ Existing benchmarks consumption) Our benchmarks Hardwares network supplies (depend on number of racks) procurements ◮ Some results Some other points, as the total required floor space, are not Conclusion directly evaluated. Yannick Perret Hardware evaluation and procurement
Recommend
More recommend
