A Smart Port Card Update John DeHart Washington University jdd@arl.wustl.edu http://www.arl.wustl.edu/~jdd Washington Kits Workshop 1 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS Motivation • Active Networking • Network Probe • High performance router architectures – PC as router is VERY limited – (Gigabit/s + Processing) on each port – MSR: Multi-Service multiport Router Washington Kits Workshop July 10/11 2000 2 WASHINGTON UNIVERSITY IN ST LOUIS page 1
Typical Pentium PC CPU/Memory Bus Addr/Data Ctrl Ctrl North- Cache CPU DRAM Bridge Addr/Data/Ctrl PCI Bus NMI INIT Intr PCI SouthBridge (PIIX3) Devices (PIC, PIT, …) ISA Bus ISA Super-IO BIOS BIOS Devices Kbd/Mse Parallel Floppy Uarts RTC ... Washington Kits Workshop 3 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS What SPC Needs CPU/Memory Bus Addr/Data Ctrl Ctrl North- Cache CPU DRAM Bridge Addr/Data/Ctrl PCI Bus NMI INIT Intr APIC SouthBridge (PIC, PIT, …) BIOS BIOS Uarts RTC Washington Kits Workshop July 10/11 2000 4 WASHINGTON UNIVERSITY IN ST LOUIS page 2
SPC Architecture Addr/Data Ctrl Ctrl North- Cache CPU DRAM Bridge Addr/Data/Ctrl Intel Embedded Module PCI Bus NMI INIT Intr APIC RTC’ PIC PIT UART1 UART1 Interface BIOS ROM Link Interface UART2 UART2 Interface System FPGA Switch Interface Washington Kits Workshop 5 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS New Feature: System FPGA Reset • SPC needs a reset before every download: – switch reset: • causes SPC to be reset • causes all connections in switch to be lost – System FPGA reset • causes SPC to be reset • has no effect on the switch Washington Kits Workshop July 10/11 2000 6 WASHINGTON UNIVERSITY IN ST LOUIS page 3
Software: SPC Kernel Modifications • Kernel Configuration File: – Memory Disk – Serial Console – Most device drivers unneeded (e.g no Ethernet…) • Source Code Changes: – PCI Device Configuration: ./dev/pci/if_apic_pci.c • APIC Specific configuration handled by driver – Change some APIC defaults: ./dev/ic/apic.c • made switch port the default – No HLT instruction: locore.s – Kernel Memory Page Allocation: • ./arch/i386/include/pmap.new.h – RTC: ./arch/i386/isa/clock.c, ./ufs/ffs/ffs_vfsops.c • We still had to remove some RTC code... Washington Kits Workshop 7 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS Caveats • Intel Embedded Module problem – Memory corruption caused by noise on M/A bus – Hopefully it will be fixed before we ship – We work around it with 25 MHz PCI and no HLT • This reduces the probability of noise on the bus • PCI Bus – 33 MHz vs. 25 MHz – Adjustment of NetBSD clock may be needed • NetBSD Kernel HLT instruction – if absolutely nothing to do, NetBSD does a “HLT” – this reduces power consumption – Side Effect: large power/current swings – We have removed the HLT instruction for the SPC Washington Kits Workshop July 10/11 2000 8 WASHINGTON UNIVERSITY IN ST LOUIS page 4
Schedule: Subject to Change (Updated since Friday) • All Parts Due Back: July 7 • Out to Fab: July 10 • First 3 SPCs Back from Fab: July 14 • Test 3 SPCs: July 14-16 • Give go ahead to Fab the rest: July 17 • Rest of SPCs back from Fab: Early August • Testing: 1-2 weeks • Shipping: September 1 • In your hands: September 4 Washington Kits Workshop 9 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS What You Will Get • 2 Assembled SPCs: – SPC board – CPU Module attached (33MHz PCI or 25MHz PCI?) – System FPGA SProm installed – System FPGA boot load jumper installed – Memory module installed • Serial Cables per SPC – 2 Standard 15 inch PC Serial port jumpers. – 2 Standard 10 foot Null Modem cables • Software: everything you will use in the Exercises – SPC Utilities – Kernel files with SPC modifications (or a full 1.4.1 source tree?) – build scripts – boot loader – Jammer scripts Washington Kits Workshop July 10/11 2000 10 WASHINGTON UNIVERSITY IN ST LOUIS page 5
References: New Links from Kits References Page • Intel Embedded Module: – Data Sheet – Design Guide • 430HX Chipset – NorthBridge – SouthBridge • System FPGA • Memory • Mobile Pentium with MMX – Software Developer Manuals 1,2,3 – Datasheet • APIC • Cache Washington Kits Workshop 11 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS SPC Tutorial Recap • 19 Visitors Attended • 10-12 Groups Represented • 1/2 Day of Talks describing SPC – SPC Hardware – SPC Software – SPC Utilities • 1 1/2 Days of Exercises: + Exercise 1: Download and Boot + Exercise 2: Build Kernel and SPC Filesystem ± Exercise 3: IP and the SPC as a Router + Exercise 4: SPC Hardware Installation ± Open Exercise: AAL5 Download Program Washington Kits Workshop July 10/11 2000 12 WASHINGTON UNIVERSITY IN ST LOUIS page 6
What We Learned • IP Connectivity Debugging Tools – ping – netstat – route show – WUGS Switch Counters – atm_ifconfig apic0 getall – APIC readCounts utility – tcpdump – traceroute Washington Kits Workshop 13 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS What We Learned (continued) • Routes, IP Addressing and IP Address aliases – Even though it looks a little complicated… – It’s a little worse then it looks… – We still have something to learn about IP alias addresses... Washington Kits Workshop July 10/11 2000 14 WASHINGTON UNIVERSITY IN ST LOUIS page 7
What We Learned (continued) • One example sequence that may lead to trouble: > ifconfig apic0 inet 192.168.10.10 netmask 0xffffff00 up > atm_ifconfig apic0 0xc5 open -aal5 -llc -besteffort -inport 0 -outports 1 > route add -iface 192.168.20.1 -link apic0:0.0.0.c5 > ifconfig apic0 down > ifconfig apic0 inet 192.168.10.1 netmask 0xffffff00 up > atm_ifconfig apic0 0xc5 open -aal5 -llc -besteffort -inport 0 -outports 1 – The route caches the device IP address to use as the source address on outgoing packets. This does not show up with “> route show” – If the device IP address is changed, all routes should be flushed Washington Kits Workshop 15 July 10/11 2000 WASHINGTON UNIVERSITY IN ST LOUIS Conclusions • Everyone learned the basics – Downloading kernels – Getting the SPC to boot – Using a serial port as a boot console – Modifying Kernels and SPC Filesystems – Configuring IP between an PC and an SPC • We can make things better – AAL5 Download program • Should do kernel download in seconds instead of minutes • We learned a few things that should lead to this getting done. – We will work out some examples of what went wrong and how to fix things. Washington Kits Workshop July 10/11 2000 16 WASHINGTON UNIVERSITY IN ST LOUIS page 8
Recommend
More recommend
