NP04 DAQ Computing Geoff Savage protoDUNE Single Phase (NP04) 21-Aug-2017
NFS NFS rscratch,back home, sw NFS np04-srv-008 np04-srv-007 mounts np04-srv-011 np04-srv-016 np04-srv-009 Board Reader Board Reader Run Control np04-srv-012 np04-srv-017 np04-srv-010 Board Reader Board Reader np04-srv-013 np04-srv-018 Board Reader Board Reader np04-srv-014 np04-srv-019 Board Reader FELIX np04-srv-015 Board Reader 2 21/08/17 Geoff Savage | NP04 DAQ Computing
NFS NFS (rscratch,back) (home, sw) np04-srv-008 np04-srv-007 np04-srv-009 np04-srv-011 np04-srv-016 Run Control Board Reader Board Reader np04-srv-010 np04-srv-012 np04-srv-017 Board Reader Board Reader np04-srv-013 np04-srv-018 Board Reader Board Reader Dell R520 np04-srv-014 np04-srv-019 From 35-Ton Board Reader FELIX 1 Gbit Network Dell R730, New np04-srv-015 2 x 10 Gbit Board Reader Network 3 21/08/17 Geoff Savage | NP04 DAQ Computing
Inventory • Run control, general use – np04-srv-009 and np04-srv-010 • Board readers (Rce, ssp, timing, trigger, …) – np04-srv-011 to 018 • Felix - np04-srv-019 • NFS servers (no logins) – np04-srv-007 (6T/10T) – home (3T) and software (3T) – np04-srv-008 (6T/10T) – scratch (3T) and backups (3T) • Pddaq-gen01 to gen06 – used for test stand – Convert to np04 when other computers in operation – For now still login as pduser 4 21/08/17 Geoff Savage | NP04 DAQ Computing
Accounts • Individual accounts are active – List of accounts from np04-daq-dev egroup • np04daq group account is active – Login with your own kerberos principal – Everyone with an online account can login as np04daq • All accounts are in the np-comp Unix group – Unix groups are set through cern account management • To install official software login as the np04daq user – Eliminate software permission issues – Some discussion previously about a software installation account? 5 21/08/17 Geoff Savage | NP04 DAQ Computing
Configurations/Installation • np04online git repository to store configurations – Project in the protoDUNE SP DAQ gitLab workspace • https://gitlab.cern.ch/protoDUNE-SP-DAQ • SELinux is turned off – Cause of delay for getting computers configured • Installations done with pxe/kickstart – Can reinstall base Operating System easily • Configured with Ansible (instead of puppet) – Credit to Karol for driving Ansible configurations – Simplifies adding the same configuration to all computers 6 21/08/17 Geoff Savage | NP04 DAQ Computing
Disk Space • Use lvm for configurations – size is adjustable • NFS - Only allocated ~60% of disks so far – np04-srv-007 – 10 TB total • home – 3TB • sw – 3TB – np04-srv-008 – 10 TB total • rscratch - 3 TB (remote scratch) • Back – 3 TB • Local scratch on each computer (~200 GB) 7 21/08/17 Geoff Savage | NP04 DAQ Computing
Moving Forward • Everyone should login as themselves and np04daq – Report any issues to me – Check your group membership for your account • Installing software (directory structure coming soon) – I will install art daq in the central software area • Need to get all the packages for building installed • Then John Freeman will confirm that I installed things correctly – Identify WIB, Timing, RCE, SSP, trigger, …, software areas in nfs space – Contact me if your favorite editor or other software is missing • Develop a pddaq to np04 transition plan – Searching back through old computing items – Run control – Log stash 8 21/08/17 Geoff Savage | NP04 DAQ Computing
Integration • Transition DAQ to NP04 computers • Networking – Add 2 nd 10 Gbit network connections to Board Reader computers – Install firewall in network switch – Connect SSP, WIB, and timing to CERN network • Currently on private network • Access offsite repositories – Intermediate repository • Control room computing 9 21/08/17 Geoff Savage | NP04 DAQ Computing
Recommend
More recommend