high performance computing cluster
play

High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute - PowerPoint PPT Presentation

High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute nodes, 560 cores with room to expand All Nodes: Xeon Broadwell CPUs (2.6 GHz) 28 cores per node Infiniband EDR (Infinite Bandwidth) (Enhanced Data


  1. High Performance Computing Cluster 1 1

  2. HPCC Hardware 20 Compute nodes, 560 cores with room to expand – All Nodes: • Xeon Broadwell CPUs (2.6 GHz) • 28 cores per node • Infiniband EDR – (Infinite Bandwidth) (Enhanced Data Rate) (100 Gb/s) – Login Node: 1 • 64 GB DDR4 2400 MHz RAM – (DDR = Double Data Rate) • 4TB local hard drive array – Compute Nodes: 17 • 96 GB DDR4 2400 MHz RAM • 120 GB SATAII SSD (Solid State Drive) – Application Compute Nodes: 3 • 96 GB DDR4 2400 MHz RAM • 4 TB local hard drive + SSD as above – File Server: • 128GB DDR4 2400MHz RAM • 6TB drive array for OS • 55 TB data drive array (accessible to all nodes) • Infiniband EDR 2 2

  3. HPCC Software • OS: – Linux RedHat v7 • Compilers: – GNU Compiler • Program compilers and libraries – Intel Parallel Studio XE 2016 • Latest Intel toolkit for high performance applications • NetCDF, HDF5 – Network Common Data Form • Programming interface to scientific data files – HDF5 • Hierarchical Data Format – used to store image data • WRF-ARW v3.8.1 – Weather model (Atmospheric simulation system) • Scheduler: – TORQUE – Adaptive Computing • Provides control over batch jobs and distributed computing resources • Utopus Applications to be installed – R2 Renewable Generation Forecast Models – Energy Demand Forecast Model – Weather Insights for Environment (WISE) – Transactive Energy Management 3 3

  4. HPCC Analytics • Vermont Weather Analytics Center – Weather Visualization – WISE (Weather InSights Environment) – Demand Forecasting – Renewable Forecasting • OSIsoft Plant Information (PI) – Integrate asset data with maintenance applications – Predictive analysis on Telecom systems • Utilize idle processing time for other opportunities 4 4

  5. Utopus Transition Plan: VELCO Effort Start Date GOAL S Ke y T ask Planne d T ime line Effort End Date  e b 24 th – Ma rc h 10 th : VE L CO Ope ra tio na l • Se r a tiona l Runs): F Infr a str uc tur e ve r Cle a nup (no pla nne d impa c t to Ope r Infra struc ture : De e p T hunde r Re mo ve a ny so urc e fro m DT se rve r, te st / va lida te DT a nd do wnstre a m mo de ls. T r a nsition + De ma nd F o re c a sting + Pre pa re fo r mo ve Re ne wa b le F o re c a sting + file • Se r Shutdown: 13 th Ma r ve r c h : Bring do wn De e p T hunde r se rve r a fte r 0z run; upda te s to VE L CO se rve r • Se r Move : 13 th Ma rc h ve r : 14 th Ma rc h - 19 th Ma rc h: n/ w • VE L CO se r ve r br ing up a t the ne w da ta c e nte r se tup; fire wa ll se tup; IP a ddre ss se tup; Re c o nfig ure the se rve rs • F ir st Run of DT : 20 th Ma r c h* • Se r Re build: 1 st Ma r c h – 8 th Ma rc h: Ne w L Ye llo w Zo ne Infra struc ture : ve r ic e nse s ne e de d fo r a ll s/ w. Opus Opus Infra struc ture + Opus pla tfo rm re b uild Applic a tio ns (SE DA + PL M) • Ye llow Zone Build: 12 th Ma rc h – 20th th Ma r c h : n/ w se tup; fire wa ll se tup; IP a ddre ss se tup  e b – 13 th Ma rc h: Mo ve to te mpo ra ry We e kly tra c k me e ting s; • 2 We e k T a c k me e ting s: 27 th F We e kly T r a c k r a nsition – No tr disc ussio ns a nd R&D spa c e ; Se tup n/ w, da ta c e nte r a c c e ss. Se tup pho ne s a nd c o nfe re nc e line s; Me e ting T r a nsition Se tup e ma il ids a nd la pto ps. Co mple te UI jo ining fo rma litie s • Post T a nsition: 14 th Ma r r c h : We e kly tra c k me e ting s o n sc he dule • We e kly PM Me e ting : As pla nne d; T a run to jo in the te a m to he lp ma na g e the Uto pus ta sks a nd suppo rt L lo yd.  S/ W de ve lo pme nt pla ns fo r • Impa c t on S/ W de ve lopme nt a nd de live r y: 6 st Ma r c h - 10 th Apr il : Alig n a nd T r a c k s/ w e a c h o f the fo ur tra c ks se g me nt a ll IP a nd s/ w pe r UI sta nda rd (re mo ving IBM he a de rs, ma na g ing De live r y lic e nse d s/ w, se tting up a c c e ss to s/ w). Se tup ne w de v-o ps e nviro nme nt with ne w o pe ra ting syste m, ne w s/ w, UI he a de rs e tc . All s/ w de ve lo pme nt pla ns will mo ve b y 5 we e ks.  Se tting up VE L CO h/ w fo r • Sta rt e ffo rt fro m 21 th Ma r c h . Se e de ta ils o n the T ra c k 4 time line VE L CO De e p T hunde r + Infr a str uc tur e do wnstre a m a na lytic s buildout * Utopus and IBM Deep Thunder team will make every effort to complete the task sooner 5 5

Recommend


More recommend