Units 11 and 12 Risk Reduction Activity MetalMapper Advanced Classification Fort Ord, California PRESENTED BY: DAVID EISEN JOHN JACKSON ANDY GASCHO ALISON PASKI DEAN KEISWETTER OCTOBER 22, 2015
The Team • U.S. Army Corps of Engineers • David Eisen • John Jackson KEMRON • • Project Management • UXO Subsurface Removal Team • Gilbane • Andy Gascho • NAEVA Geophysics • Mark Howard Peter Jump • • Ryan Swaffer • Kevin Hagie • Alison Paski • Cora Blits • Ben Dameron • Acorn Science and Innovation Dean Keiswetter • • ESTCP/CB&I/Black Tusk Geophysics 2
ESTCP Demonstration Results 3
ESTCP Demonstration • Primary Objective: • Demonstrate whether large munitions such as 155mm and 8 ‐ inch projectiles at depths to 2 feet can be confidently classified within a challenging high metallic anomaly density background. • Secondary Objectives: • Demonstrate whether large munitions at depths to 4 feet can be confidently classified within a challenging high metallic anomaly density background. • Demonstrate if smaller munitions such as 40mm projectiles can be confidently classified within the range of high background conditions. 4
ESTCP Grid Locations 5
Initial ROC Curve (Primary) TOI1 TOI1 FtOrd BlackTusk PolMatch None MetalMapper Custom s1 v1 FtOrd BlackTusk PolMatch None MetalMapper Custom s1 v1 Analyst's Type Non-TOI Small TOI Medium TOI Large TOI Total 100 90 2030 83 97 54 2264 Non-TOI Percent of TOIs Correctly Classified (%) 80 70 Small TOI 60 Small TOI (diam<50mm) Difficult TOIs: 50 Medium TOI (50mm<=diam<100mm) Medium TOI 155mm legacy Large TOI (100mm<=diam) 40 30 Large TOI 1 24 25 20 10 2031 83 97 78 2289 Total 0 0 500 1000 1500 2000 Number of Non-TOIs Incorrectly Classified 6
Final(ish) ROC Curve (Primary) TOI1 FtOrd BlackTusk PolMatch None MetalMapper Custom s2 v1 Analyst's Type Non-TOI Small TOI Medium TOI Large TOI Total 1802 259 133 55 2249 Non-TOI Percent of TOIs Correctly Classified (%) Small TOI Small TOI (diam<50mm) Medium TOI (50mm<=diam<100mm) Medium TOI Large TOI (100mm<=diam) Large TOI 24 24 1802 259 133 79 2273 Total 7
Initial ROC Curve (Secondary) TOI1or2 TOI1or2 FtOrd BlackTusk PolMatch None MetalMapper Custom s3 v1 FtOrd BlackTusk PolMatch None MetalMapper Custom s3 v1 Analyst's Type Non-TOI Small TOI Medium TOI Large TOI Total 100 90 Non-TOI 1777 286 147 38 2248 Percent of TOIs Correctly Classified (%) 80 Difficult TOIs: 35mm legacy 70 10 93 6 2 111 60mm legacy Small TOI 20mm legacy 60 35mm legacy Small TOI (diam<50mm) 20mm legacy 50 Medium TOI 1 2 168 6 177 Medium TOI (50mm<=diam<100mm) 20mm legacy Large TOI (100mm<=diam) 40mm legacy 40 35mm legacy 40mm legacy 30 1 32 33 Large TOI 40mm legacy + 1 more ... 20 10 Total 1788 381 322 78 2569 0 0 500 1000 1500 2000 Number of Non-TOIs Incorrectly Classified 8
Results and Conclusions • 2,804 unique cued locations • 35 total TOI 1 (100%) • 361 total TOI 2 (350/361 = 97%) • Achieving primary objective (large TOI to 2 ‐ feet) = EASY! • Achieving secondary objective 1 (large TOI to 4 ‐ feet) = DIFFICULT but DOABLE! • Achieving secondary objective 2 (all TOI to depth of detection)= CLOSE, but NOT POSSIBLE! • Moving forward, need to address depth –vs ‐ signal strength –vs ‐ anomaly density issues • Removal action –vs ‐ risk reduction 9
Units 11 and 12 Risk Reduction Objective 10
Units 11 and 12 Risk Reduction Goals • Remove large MEC items from planned burn areas to address the potential risk identified for areas to be burn ‐ ready (with additional site preparation activities) • Evaluate the ability of the advanced technology to classify items of interest in high density environment in real sites as initially indicated by ESTCP demonstration • All Quality Control and Quality Assurance seeds and 100% of the targets of interest (TOI) were correctly classified and recovered 11
Site Background Information • Prescribed burns within the Impact Area at Fort Ord are part of the remedy and support • Vegetation clearance to support MEC removal actions • Periodic burning to maintain natural habitat • Prescribed burns originally planned for Units 11 and 12 in 2011 • Canceled due to the discovery of large MEC items on the ground surface • Subsequent activities conducted in Units 11 and 12 • Vegetation cutting • Surface MEC removal • Digital geophysical mapping • Prescribed burns rescheduled for fall of 2015 12
Risk Reduction Objective • Reduce risk to prescribed burn personnel by removing large, near ‐ surface MEC that might unintentionally detonate during prescribed burn operations • Targets of interest (TOI) • 155mm projectiles • 8 ‐ inch projectiles • Larger MEC • Removal depth requirements • Outer Zone (within 436 feet of fuel breaks) • Removal of TOI to 2 ‐ foot depth • Detonation presents a risk to burn personnel on perimeter fuel break roads • Inner Zone (greater than 436 feet from fuel breaks) • Removal of TOI to 1 ‐ foot depth • Detonation presents a risk to support aircraft flying overhead 13
Assumptions • From the existing DGM data, it is possible to select a subset of anomalies that could represent 155mm and 8 ‐ inch projectiles down to two ‐ foot depths • Advanced geophysical classification utilizing the MetalMapper can evaluate these anomalies and identify those that match the signal characteristics of 155mm and 8 ‐ inch projectiles • Depths of classified items can be predicted with high confidence 14
Risk Reduction Goals • MetalMapper cued anomaly data analysis to model and classify each investigated anomaly • TOI – Highly ‐ likely to be large MEC items (155mm projectiles, 8 ‐ inch projectiles) • Non ‐ TOI – highly ‐ likely to be something other than TOI • TOI – removed prior to the commencement of burn operations • Non ‐ TOI – left in place • Targets where the acquired data does not support a confident classification decision (“cannot analyze”) will be removed. 15
Site Layout and Anomaly Selection Procedures 16
Anomaly Selection • Approximately 550,000 anomalies in existing EM61 detection data • Naval Research Laboratory EM61 response data used to determine minimum response of a 155mm projectile at the required removal depths • Outer Zone • 2 feet below ground surface • Select anomalies with EM61 channel 3 response values of 114mV or greater • Inner Zone • 1 foot below ground surface • Select anomalies with EM61 channel 3 response values of 446mV or greater 17
MetalMapper Investigation Anomalies Resp sponse se Va Value Zo Zone Anomalies lies Th Thre resh shold (m (mV) Unit 11 ‐ Outer 446 2,695 Unit 11 ‐ Inner 114 192 Unit 12 ‐ Outer 446 1,717 Unit 12 ‐ Inner 114 21 TO TOTA TAL 4,625 18
MetalMapper Investigation Anomalies 19
Quality Control 20
Measurement Quality Objectives 21
QC Seeding • Blind QC seed items buried prior to MetalMapper investigation • Large ISO • Average of 1 QC seed item each day – 35 total • Blind Seed Firewall Plan to protect the integrity of QC seed program 22
Data Acquisition Procedures 23
Instrument Setup and Configuration • MetalMapper advanced TEM system • Tow vehicle with platform and sled mount • Positioning with GPS and IMU • Long time range collection settings • Infield inversion settings
Initial Instrument Tests and Initial Library • Performed tests described in the Units 11 and 12 MEC Risk Reduction GCMR ‐ QAPP • Setup and configuration • Sensor assembly • Software settings and configuration • Initial IVS • Background survey was performed • Seeded survey compared result to large ISO in standard library with good result • Test pit • 25ms data needed to establish UX ‐ Analyze library • Performed measurements over large ISO, 155mm and 8 inch projectiles
Field Collection Procedures • Twice daily IVS survey • Initial background readings to validate location. Hourly background readings during survey. • Collect cued reading and refine location based on infield inversion result • Infield inversion performed in separate software from data logging software • Ensures the MetalMapper is positioned above the target • Provides fit location for a single source inversion result
Data Processing and Classification 27
Data Processing Steps • UX ‐ Analyze Advanced Software • ESTCP supported development, has been successfully demonstrated at multiple sites • Special build for 25ms MetalMapper data • Initial instrument tests and site specific library • Initial and Daily IVS • Daily Data Verification • Library Validation • Initial Classification • Final Classification 28
Initial Instrument Tests/Establish Initial Library • Instrument tests evaluated to confirm correct setup, configuration and operation • Test Pit • Were provided data from ESTCP demo test pit • Processed data and evaluated early time gates • Determined for large shallow items the use later time gates • Initial IVS • IVS library established with the initial fit location and polarizabilities • Initial library from IVS and Test Pit • Representative samples of expected TOI at the site • 155mm, 8 inch, Large ISO • Contained 44 entries with measurements of test items at different depths and orientations 29
Recommend
More recommend