the f inal results
play

THE F INAL RESULTS ! Daniel le Berre, Olivier Roussel, Laurent Simon - PowerPoint PPT Presentation

Nov 28, 2023 •569 likes •1.89k views

Rules Participants First Stage Winners Conclusion Certified UNSAT AIG T HE SAT07 C ONTEST THE F INAL RESULTS ! Daniel le Berre, Olivier Roussel, Laurent Simon { leberre,roussel } @cril.univ-artois.fr, simon@lri.fr May, 2007 The SAT

  1. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C OMPLETE , CDCL SOLVERS CMUSAT , Himanshu Jain and Edmund CDCL, Standard Template Clarke Lib. CMUSAT-base Niklas Sorensson and Niklas Who don’t know Minisat? Minisat-2007 Een Picosat Armin Biere Knot Pipatsrisawat and Ad- Rsat nan Darwiche David R. Bregman and David Best student solver (sat-race MXC G. Mitchell 06) Mmisat Monahov Ivan Tinisat , Jinbo Huang pronounce “teeny sat” TiniSatELite Christian Kern, Moham- SAT7 mad Khaleghi, Stefan Kugele, Christian Schallhart, Michael Tautschnig and Andreas Weis

  2. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C OMPLETE , NON -CDCL SOLVERS Anbulagan LA Saturation with restriction dewSatz-1a in satz kcnfs-2004 , Gilles Dequen and Olivier kcnfs-2006 , Dubois kcnfs-smp march-ks Marijn Heule and Hans van Maaren Ivor Spence stands for “Ternary Tree tts-4.0 Solver” Marijn Heule, Denis de multi-bit assignements UnitMarch Leeuw Duarte, and Hans van Maaren

  3. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG O THER SOLVERS SATzilla-CRAFTED , Lin Xu, Frank Hutter, Holger Specialized Portfolio SATzilla-RANDOM , H. Hoos and Kevin Leyton- Brown SATzilla-ALL MiraXTv1 , Tobias Schubert, Matthew Multi-threaded solver MiraXTv2 , Lewis, Natalia Kalinnik and Bernd Becker MiraXTv3

  4. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG D EMONSTRATION D IVISION SUBMITTED IN COMPETITION DIVISION barcelogic Robert Nieuwenhuis, Albert Oliveras and Tomas Lioret Siert Wieringa, Hans van minimarch Maaren and Marijn Heule Anbulagan dewSatz

  5. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG D EMONSTRATION D IVISION Chu-Min Li, Wanxia Wei and adaptg2wsat Harry Zhang Daniel Le Berre SAT4J-1.7 Spear , Spear-FH , Domagoj Babic Spear-FHS Olivier Roussel Ornithorynque

  6. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C RAFTED Series Subseries contest02 (10) contest03 looksrandom (10), others (10) contest04 connamacher (10), others (10) contest05 counting-clq (10), counting-php (10), jarvisalo (10), others (20), pebbling (10), phnf (10), QG (10), sabharwal (10) Difficult contest-02-03-04 (9), contest05 (36) spence hard (6), medium (10)

  7. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A VIEW OF CRAFTED BENCHMARKS 1e+07 contest02-mix contest03-looksrandom contest03-others contest04-connamacher contest04-others contest05-counting-clq 1e+06 contest05-counting-php contest05-jarvisalo contest05-others contest05-pebbling contest05-phnf contest05-QG 100000 contest05-sabharwal Difficult-contest-02-03-04 Total Size Difficult-contest05 spence-hard spence-medium 10000 1000 100 10 100 1000 10000 100000 1e+06 #Variables

  8. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG R ANDOM O N T RESHOLD BENCHMARKS 5 SAT benchmarks, 5 UNSAT benchmarks per series 3SAT from 360 to 650 variables (7 series) 5SAT from 90 to 130 variables (7 series) 7SAT from 45 to 75 variables (7 series)

  9. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG R ANDOM O N T RESHOLD BENCHMARKS 5 SAT benchmarks, 5 UNSAT benchmarks per series 3SAT from 360 to 650 variables (7 series) 5SAT from 90 to 130 variables (7 series) 7SAT from 45 to 75 variables (7 series) 2+0.7SAT from 3500 to 6500 variables (4 series) 2+p0.8SAT from 1295 to 2405 variables (4 series) 2+p0.9SAT from 630 to 1170 variables (4 series)

  10. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG R ANDOM O N T RESHOLD BENCHMARKS 5 SAT benchmarks, 5 UNSAT benchmarks per series 3SAT from 360 to 650 variables (7 series) 5SAT from 90 to 130 variables (7 series) 7SAT from 45 to 75 variables (7 series) 2+0.7SAT from 3500 to 6500 variables (4 series) 2+p0.8SAT from 1295 to 2405 variables (4 series) 2+p0.9SAT from 630 to 1170 variables (4 series) L ARGE BENCHMARKS : 10 (hopefully) SAT benchmarks per series 3SAT from 4000 to 19000 variables (6 series) 5SAT from 600 to 1100 variables (6 series) 7SAT from 140 to 240 variables (6 series)

  11. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A VIEW OF RANDOM BENCHMARKS 1e+06 2+p-p0.7-v3500 LargeSize-7SAT-v180 2+p-p0.7-v4500 LargeSize-7SAT-v200 2+p-p0.7-v5500 LargeSize-7SAT-v220 2+p-p0.7-v6500 LargeSize-7SAT-v240 2+p-p0.8-v1295 OnTreshold-3SAT-v360 2+p-p0.8-v1665 OnTreshold-3SAT-v400 2+p-p0.8-v2035 OnTreshold-3SAT-v450 2+p-p0.8-v2405 OnTreshold-3SAT-v500 2+p-p0.9-v1170 OnTreshold-3SAT-v550 2+p-p0.9-v630 OnTreshold-3SAT-v600 100000 2+p-p0.9-v810 OnTreshold-3SAT-v650 2+p-p0.9-v990 OnTreshold-5SAT-v100 LargeSize-3SAT-v10000 OnTreshold-5SAT-v110 LargeSize-3SAT-v13000 OnTreshold-5SAT-v120 Total Size LargeSize-3SAT-v16000 OnTreshold-5SAT-v130 LargeSize-3SAT-v19000 OnTreshold-5SAT-v70 LargeSize-3SAT-v4000 OnTreshold-5SAT-v80 LargeSize-3SAT-v7000 OnTreshold-5SAT-v90 LargeSize-5SAT-v1000 OnTreshold-7SAT-v45 LargeSize-5SAT-v1100 OnTreshold-7SAT-v50 LargeSize-5SAT-v600 OnTreshold-7SAT-v55 10000 LargeSize-5SAT-v700 OnTreshold-7SAT-v60 LargeSize-5SAT-v800 OnTreshold-7SAT-v65 LargeSize-5SAT-v900 OnTreshold-7SAT-v70 LargeSize-7SAT-v140 OnTreshold-7SAT-v75 LargeSize-7SAT-v160 1000 10 100 1000 10000 100000 #Variables

  12. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG I NDUSTRIAL Series Subseries anbulagan hard-sat (7), hard-unsat (24), medium-sat (10), medium-unsat (6) babic dspam (10), hsatv17 (10), xinetd (10) crypto (10) fuhs hard (6), medium (10) grieu (10) jarvisalo (7) manolios (10) narain (5) palacios hard (7), medium (10), uts (10) velev vliw-sat-4.0 (10), vliw-unsat-4.0 (10) zarpas IBM-FV-2002-13-rule-1 (19), IBM-FV-2002- 31-1-rule-1 (16), IBM-FV-2004-30 (18)

  13. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A VIEW OF INDUSTRIAL BENCHMARKS 1e+08 anbulagan-hard-sat anbulagan-hard-unsat anbulagan-medium-sat anbulagan-medium-unsat babic-dspam babic-hsatv17 1e+07 babic-xinetd crypto-crypto fuhs-hard fuhs-medium grieu-grieu jarvisalo-jarvisalo 1e+06 manolios-manolios narain-narain Total Size palacios-hard palacios-medium palacios-uts velev-vliw_sat_4.0 velev-vliw_unsat_2.0 100000 zarpas-IBM_FV_2002_13_rule_1 zarpas-IBM_FV_2002_31_1_rule_1 zarpas-IBM_FV_2004_30 10000 1000 100 1000 10000 100000 1e+06 1e+07 #Variables

  14. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG R OAD M AP History, rules and Goals 1 The participants 2 3 T HE F IRST S TAGE Overall Pictures Remaining benchmarks The Winners 4 Conclusion and next contests 5 Certified UNSAT Special Track 6 And Inverter Graph Special Track 7

  15. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A LL SOLVERS , ALL BENCHMARKS ← SAT4J−−JVM−PARAM−CHANGED−SAT−2007 ← minisat−SAT−2007−(with−assertions) ← DEWSATZ−2007−04−26−(fixed) ← minimarch−2007−04−26−(fixed) ← CMUSAT−BASE−2007−02−08 ← Barcelogic−Fixed−2007−04−13 ← DEWSATZ−1A−2007−02−08 ← adaptg2wsatp−2007−02−08 ← adaptg2wsat+−2007−02−08 ← adaptg2wsat0−2007−02−08 ← adaptnovelty−2007−02−08 ← adaptg2wsat−2007−02−08 ← TiniSatELite−2007−02−08 ← ornithorynque−0.1−alpha ← UnitMarch−2007−02−08 ← March−KS−2007−02−08 ← CMUSAT−2007−02−08 ← gnovelty+−2007−02−08 ← Hybrid1−2007−02−08 ← Mmisat−2007−02−08 ← tinisat−2007−02−08 ← Spear−2007−02−12 ← sapsrt−2007−02−08 ← SAT7−2007−02−08 ← ranov−2007−02−08 ← SATzilla−RANDOM ← SATzilla−CRAFTED ← SAT4J−SAT−2007 ← saps−2007−02−08 ← Rsat−2007−02−08 ← MXC−2007−02−08 ← minisat−SAT−2007 ← Spear−FHS−1.0 ← FH−2007−02−08 ← SATzilla−FULL ← Spear−FH−1.0 ← KCNFS−2006 ← KCNFS−2004 ← KCNFS−SMP 1400 ← picosat−535 ← MiraXT−v3 ← MiraXT−v1 ← MiraXT−v2 ← TTS−4.0 Mmisat−2007−02−08 ( 3 ) TTS−4.0 ( 40 ) 1200 ornithorynque−0.1−alpha ( 53 ) SAT4J−SAT−2007 ( 66 ) UnitMarch−2007−02−08 ( 69 ) DEWSATZ−1A−2007−02−08 ( 126 ) tinisat−2007−02−08 ( 145 ) Spear−2007−02−12 ( 151 ) TiniSatELite−2007−02−08 ( 162 ) 1000 CMUSAT−BASE−2007−02−08 ( 165 ) Spear−FH−1.0 ( 165 ) SAT4J−SAT−2007 ( 167 ) Barcelogic−Fixed−2007−04−13 ( 168 ) sapsrt−2007−02−08 ( 170 ) CPU−Time needed (s) Spear−FHS−1.0 ( 171 ) saps−2007−02−08 ( 173 ) 800 DEWSATZ−2007−04−26−(fixed) ( 176 ) Rsat−2007−02−08 ( 186 ) CMUSAT−2007−02−08 ( 187 ) KCNFS−2006 ( 190 ) gnovelty+−2007−02−08 ( 206 ) MiraXT−v3 ( 206 ) 600 KCNFS−SMP ( 207 ) SAT7−2007−02−08 ( 210 ) picosat−535 ( 216 ) KCNFS−2004 ( 219 ) MiraXT−v1 ( 220 ) adaptnovelty−2007−02−08 ( 224 ) MiraXT−v2 ( 224 ) 400 ranov−2007−02−08 ( 228 ) adaptg2wsatp−2007−02−08 ( 233 ) FH−2007−02−08 ( 235 ) adaptg2wsat−2007−02−08 ( 236 ) Hybrid1−2007−02−08 ( 241 ) adaptg2wsat+−2007−02−08 ( 242 ) 200 adaptg2wsat0−2007−02−08 ( 242 ) MXC−2007−02−08 ( 242 ) March−KS−2007−02−08 ( 253 ) minisat−SAT−2007 ( 267 ) minisat−SAT−2007−(with−assertions) ( 269 ) minimarch−2007−04−26−(fixed) ( 280 ) SATzilla−FULL ( 325 ) 0 SATzilla−RANDOM ( 339 ) 0 50 100 150 200 250 300 350 400 450 #Solved SATzilla−CRAFTED ( 362 )

  16. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C LUSTERING OF SOLVERS 233 adaptg2wsatp−2007−02−08 236 273, 208 adaptg2wsat−2007−02−08 242 268, 211 adaptg2wsat0−2007−02−08 261, 218 242 adaptg2wsat+−2007−02−08 252, 225 287, 190 235 FH−2007−02−08 241 Hybrid1−2007−02−08 257, 207 224 adaptnovelty−2007−02−08 292, 152 240, 212 228 ranov−2007−02−08 206 gnovelty+−2007−02−08 222, 153 173 saps−2007−02−08 186, 157 170 sapsrt−2007−02−08 362 SATzilla−FULL 397, 304 339 SATzilla−CRAFTED 414, 262 325 SATzilla−RANDOM 617, 0 176 DEWSATZ−2007−04−26−(fixed) 431, 85 188, 114 126 DEWSATZ−1A−2007−02−08 207 KCNFS−2004 226, 200 286, 90 219 KCNFS−2006 232, 172 190 KCNFS−SMP 271, 172 253 March−KS−2007−02−08 Solvers 66 SAT4J−−JVM−PARAM−CHANGED−SAT−2007 53 126, 0 501, 0 ornithorynque−0.1−alpha 85, 2 3 Mmisat−2007−02−08 41, 2 185, 0 40 TTS−4.0 69 UnitMarch−2007−02−08 216 picosat−535 187 CMUSAT−2007−02−08 209, 143 274, 62 165 CMUSAT−BASE−2007−02−08 383, 0 168 Barcelogic−Fixed−2007−04−13 210, 144 258, 62 186 Rsat−2007−02−08 151 Spear−2007−02−12 245, 84 193, 127 165 Spear−FH−1.0 179, 157 171 Spear−FHS−1.0 220, 98 367, 56 145 tinisat−2007−02−08 175, 132 162 TiniSatELite−2007−02−08 206 MiraXT−v2 220 253, 183 MiraXT−v1 244, 200 224 269, 136 MiraXT−v3 167 SAT4J−SAT−2007 242 338, 123 MXC−2007−02−08 255, 197 210 SAT7−2007−02−08 320, 179 280 minimarch−2007−04−26−(fixed) 269 308, 240 minisat−SAT−2007 269, 267 267 minisat−SAT−2007−(with−assertions) 0 50 99 149 198 248 297 Distance

  17. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A LL SOLVERS ON C RAFTED BENCHMARKS ← minisat−SAT−2007−(with−assertions) ← DEWSATZ−2007−04−26−(fixed) ← Barcelogic−Fixed−2007−04−13 ← minimarch−2007−04−26−(fixed) ← CMUSAT−BASE−2007−02−08 ← DEWSATZ−1A−2007−02−08 ← adaptg2wsat0−2007−02−08 ← adaptg2wsatp−2007−02−08 ← adaptg2wsat+−2007−02−08 ← adaptnovelty−2007−02−08 ← adaptg2wsat−2007−02−08 ← TiniSatELite−2007−02−08 ← UnitMarch−2007−02−08 ← ornithorynque−0.1−alpha ← March−KS−2007−02−08 ← gnovelty+−2007−02−08 ← CMUSAT−2007−02−08 ← Mmisat−2007−02−08 ← Hybrid1−2007−02−08 ← sapsrt−2007−02−08 ← tinisat−2007−02−08 ← Spear−2007−02−12 ← SATzilla−CRAFTED ← saps−2007−02−08 ← ranov−2007−02−08 ← SAT4J−SAT−2007 ← SAT7−2007−02−08 ← MXC−2007−02−08 ← SATzilla−RANDOM ← minisat−SAT−2007 ← Rsat−2007−02−08 ← FH−2007−02−08 ← Spear−FHS−1.0 ← Spear−FH−1.0 ← SATzilla−FULL ← KCNFS−2006 ← KCNFS−2004 ← KCNFS−SMP 1400 ← picosat−535 ← MiraXT−v3 ← MiraXT−v1 ← MiraXT−v2 ← TTS−4.0 gnovelty+−2007−02−08 ( 1 ) sapsrt−2007−02−08 ( 1 ) 1200 Mmisat−2007−02−08 ( 2 ) saps−2007−02−08 ( 2 ) adaptnovelty−2007−02−08 ( 3 ) UnitMarch−2007−02−08 ( 3 ) adaptg2wsat0−2007−02−08 ( 4 ) adaptg2wsatp−2007−02−08 ( 4 ) 1000 adaptg2wsat−2007−02−08 ( 6 ) adaptg2wsat+−2007−02−08 ( 6 ) ranov−2007−02−08 ( 6 ) FH−2007−02−08 ( 7 ) Hybrid1−2007−02−08 ( 8 ) CPU−Time needed (s) ornithorynque−0.1−alpha ( 9 ) KCNFS−2006 ( 14 ) 800 KCNFS−2004 ( 14 ) DEWSATZ−2007−04−26−(fixed) ( 15 ) KCNFS−SMP ( 15 ) DEWSATZ−1A−2007−02−08 ( 20 ) tinisat−2007−02−08 ( 25 ) TiniSatELite−2007−02−08 ( 27 ) Spear−2007−02−12 ( 31 ) 600 SAT4J−SAT−2007 ( 32 ) Spear−FHS−1.0 ( 32 ) March−KS−2007−02−08 ( 33 ) Spear−FH−1.0 ( 33 ) CMUSAT−BASE−2007−02−08 ( 37 ) Rsat−2007−02−08 ( 37 ) TTS−4.0 ( 37 ) 400 Barcelogic−Fixed−2007−04−13 ( 40 ) SATzilla−FULL ( 44 ) picosat−535 ( 46 ) SAT7−2007−02−08 ( 46 ) CMUSAT−2007−02−08 ( 52 ) MXC−2007−02−08 ( 53 ) 200 MiraXT−v3 ( 55 ) MiraXT−v1 ( 55 ) MiraXT−v2 ( 57 ) minimarch−2007−04−26−(fixed) ( 67 ) SATzilla−CRAFTED ( 69 ) SATzilla−RANDOM ( 69 ) minisat−SAT−2007−(with−assertions) ( 71 ) 0 minisat−SAT−2007 ( 71 ) 0 10 20 30 40 50 60 70 80 #Solved

  18. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S CORES OF SOLVERS ON C RAFTED BENCHMAKRS Solver #Solv. Sc. All Sc. SAT Sc. UNS TTS 4.0 37 ( 2 35 ) 36458 252 32300 SATzilla CRAFTED 69 ( 24 45 ) 30337 8239 22054 March-KS 2007-02-08 33 ( 15 18 ) 29134 9621 14048 minisat SAT-2007 71 ( 22 49 ) 24601 8652 15905 MXC 2007-02-08 53 ( 15 38 ) 15504 2133 13596 MiraXT v3 57 ( 18 39 ) 14739 6012 8683 MiraXT v1 55 ( 15 40 ) 13793 5318 8431 CMUSAT 2007-02-08 52 ( 15 37 ) 13728 5779 9405 SATzilla RANDOM 44 ( 22 22 ) 13113 8117 5667 MiraXT v2 55 ( 15 40 ) 10923 2837 8543 picosat 535 46 ( 20 26 ) 10514 4838 5841 Rsat 2007-02-08 37 ( 11 26 ) 9164 2583 6574 SAT7 2007-02-08 46 ( 16 30 ) 7353 2398 5216 CMUSAT-BASE 2007-02-08 37 ( 14 23 ) 5276 1694 4074 DEWSATZ-1A 2007-02-08 20 ( 4 16 ) 4609 434 4258 TiniSatELite 2007-02-08 27 ( 9 18 ) 3574 1135 2854 tinisat 2007-02-08 25 ( 10 15 ) 3134 1131 2418 KCNFS SMP 15 ( 2 13 ) 2222 272 2015 KCNFS 14 2149 275 1939

  19. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S CORES OF SOLVERS ON C RAFTED BENCHMAKRS Solver #Solv. Sc. All Sc. SAT Sc. UNS TTS 4.0 37 ( 2 35 ) 36458 252 32300 SATzilla CRAFTED 69 ( 24 45 ) 30337 8239 22054 March-KS 2007-02-08 33 ( 15 18 ) 29134 9621 14048 minisat SAT-2007 71 ( 22 49 ) 24601 8652 15905 MXC 2007-02-08 53 ( 15 38 ) 15504 2133 13596 MiraXT v3 57 ( 18 39 ) 14739 6012 8683 MiraXT v1 55 ( 15 40 ) 13793 5318 8431 52 ( 15 37 ) 13728 5779 9405 CMUSAT 2007-02-08 SATzilla RANDOM 44 ( 22 22 ) 13113 8117 5667 MiraXT v2 55 ( 15 40 ) 10923 2837 8543 46 ( 20 26 ) 10514 4838 5841 picosat 535 37 ( 11 26 ) 9164 2583 6574 Rsat 2007-02-08 SAT7 2007-02-08 46 ( 16 30 ) 7353 2398 5216 CMUSAT-BASE 2007-02-08 37 ( 14 23 ) 5276 1694 4074 DEWSATZ-1A 2007-02-08 20 ( 4 16 ) 4609 434 4258 TiniSatELite 2007-02-08 27 ( 9 18 ) 3574 1135 2854 tinisat 2007-02-08 25 ( 10 15 ) 3134 1131 2418 KCNFS SMP 15 ( 2 13 ) 2222 272 2015 KCNFS 14 2149 275 1939

  20. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG T HE TTS CASE S CORING NOT SO STRANGE BEHAVIOR How can TTS have a so great score while solving so few benchmarks?

  21. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG T HE TTS CASE S CORING NOT SO STRANGE BEHAVIOR How can TTS have a so great score while solving so few benchmarks? TTS IS THE ONLY ONE TO SOLVE THE FOLLOWING BENCHMARKS spence/hard/s101-100 spence/hard/s97-100 Hard/contest05/counting-php/harder-fphp-016-015 Hard/contest05/counting-php/easier-fphp-020-015 Hard/contest05/counting-php/harder-fphp-018-017 Difficult/contest05/sabharwal/counting-easier-fphp-014-012 Difficult/contest05/sabharwal/counting-harder-php-018-017 Difficult/contest05/sabharwal/counting-easier-php-018-014 Difficult/contest05/sabharwal/counting-harder-php-014-013 Difficult/contest05/jarvisalo/mod2c-3cage-unsat-10-3 Difficult/contest05/jarvisalo/mod2c-3cage-unsat-10-2

  22. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A LL SOLVERS ON R ANDOM BENCHMARKS ← minisat−SAT−2007−(with−assertions) ← minimarch−2007−04−26−(fixed) ← DEWSATZ−2007−04−26−(fixed) ← Barcelogic−Fixed−2007−04−13 ← CMUSAT−BASE−2007−02−08 ← DEWSATZ−1A−2007−02−08 ← adaptg2wsatp−2007−02−08 ← adaptg2wsat+−2007−02−08 ← adaptg2wsat0−2007−02−08 ← adaptnovelty−2007−02−08 ← adaptg2wsat−2007−02−08 ← TiniSatELite−2007−02−08 ← ornithorynque−0.1−alpha ← UnitMarch−2007−02−08 ← March−KS−2007−02−08 ← CMUSAT−2007−02−08 ← gnovelty+−2007−02−08 ← Mmisat−2007−02−08 ← Hybrid1−2007−02−08 ← tinisat−2007−02−08 ← Spear−2007−02−12 ← sapsrt−2007−02−08 ← SATzilla−CRAFTED ← Rsat−2007−02−08 ← SAT4J−SAT−2007 ← SAT7−2007−02−08 ← minisat−SAT−2007 ← MXC−2007−02−08 ← saps−2007−02−08 ← SATzilla−RANDOM ← ranov−2007−02−08 ← FH−2007−02−08 ← Spear−FHS−1.0 ← Spear−FH−1.0 ← SATzilla−FULL ← KCNFS−SMP ← KCNFS−2006 ← KCNFS−2004 1400 ← picosat−535 ← MiraXT−v2 ← MiraXT−v3 ← MiraXT−v1 Mmisat−2007−02−08 ( 1 ) ornithorynque−0.1−alpha ( 11 ) 1200 Barcelogic−Fixed−2007−04−13 ( 29 ) tinisat−2007−02−08 ( 30 ) TiniSatELite−2007−02−08 ( 32 ) Spear−2007−02−12 ( 38 ) Spear−FH−1.0 ( 39 ) Spear−FHS−1.0 ( 40 ) Rsat−2007−02−08 ( 43 ) 1000 CMUSAT−2007−02−08 ( 46 ) CMUSAT−BASE−2007−02−08 ( 48 ) UnitMarch−2007−02−08 ( 62 ) picosat−535 ( 67 ) MiraXT−v2 ( 68 ) CPU−Time needed (s) MiraXT−v3 ( 74 ) 800 MiraXT−v1 ( 78 ) SAT4J−SAT−2007 ( 78 ) DEWSATZ−1A−2007−02−08 ( 84 ) SAT7−2007−02−08 ( 95 ) minisat−SAT−2007−(with−assertions) ( 100 ) minisat−SAT−2007 ( 101 ) MXC−2007−02−08 ( 105 ) 600 minimarch−2007−04−26−(fixed) ( 125 ) DEWSATZ−2007−04−26−(fixed) ( 142 ) KCNFS−SMP ( 165 ) sapsrt−2007−02−08 ( 167 ) saps−2007−02−08 ( 169 ) KCNFS−2006 ( 189 ) SATzilla−CRAFTED ( 189 ) 400 KCNFS−2004 ( 191 ) gnovelty+−2007−02−08 ( 203 ) SATzilla−FULL ( 205 ) March−KS−2007−02−08 ( 208 ) SATzilla−RANDOM ( 215 ) ranov−2007−02−08 ( 216 ) 200 adaptnovelty−2007−02−08 ( 218 ) FH−2007−02−08 ( 220 ) adaptg2wsat−2007−02−08 ( 222 ) adaptg2wsatp−2007−02−08 ( 222 ) Hybrid1−2007−02−08 ( 226 ) adaptg2wsat+−2007−02−08 ( 227 ) adaptg2wsat0−2007−02−08 ( 231 ) 0 0 50 100 150 200 250 #Solved

  23. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S CORES OF SOLVERS ON R ANDOM BENCHMARKS Solver #Solv. Sc. All Sc. SAT Sc. UNS gnovelty+ 2007-02-08 203 ( 203 0 ) 69639 65013 0 adaptg2wsat0 2007-02-08 231 ( 231 0 ) 68244 68285 0 adaptg2wsat+ 2007-02-08 227 ( 227 0 ) 63732 63773 0 Hybrid1 2007-02-08 226 ( 226 0 ) 61927 61968 0 adaptnovelty 2007-02-08 218 ( 218 0 ) 59476 57517 0 adaptg2wsatp 2007-02-08 222 ( 222 0 ) 57506 56880 0 FH 2007-02-08 220 ( 220 0 ) 57102 56477 0 March-KS 2007-02-08 208 ( 121 87 ) 48845 14386 41953 ranov 2007-02-08 216 ( 216 0 ) 45428 45469 0 KCNFS 2004 191 ( 106 85 ) 40314 12362 34447 KCNFS 2006 189 ( 105 84 ) 38672 11618 33549 sapsrt 2007-02-08 167 ( 167 0 ) 37641 37682 0 SATzilla RANDOM 215 ( 137 78 ) 37616 16678 27432 KCNFS SMP 165 ( 80 85 ) 37031 7862 34827 saps 2007-02-08 169 ( 169 0 ) 32931 32972 0 SATzilla CRAFTED 189 ( 143 46 ) 23670 17606 8358 MXC 2007-02-08 105 ( 63 42 ) 10480 5924 6671 minisat SAT-2007 101 ( 59 42 ) 9727 5097 6745 SAT7 95 8387 4940 5187

  24. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S CORES OF SOLVERS ON R ANDOM BENCHMARKS Solver #Solv. Sc. All Sc. SAT Sc. UNS gnovelty+ 2007-02-08 203 ( 203 0 ) 69639 65013 0 adaptg2wsat0 2007-02-08 231 ( 231 0 ) 68244 68285 0 adaptg2wsat+ 2007-02-08 227 ( 227 0 ) 63732 63773 0 Hybrid1 2007-02-08 226 ( 226 0 ) 61927 61968 0 adaptnovelty 2007-02-08 218 ( 218 0 ) 59476 57517 0 adaptg2wsatp 2007-02-08 222 ( 222 0 ) 57506 56880 0 FH 2007-02-08 220 ( 220 0 ) 57102 56477 0 208 ( 121 87 ) 48845 14386 41953 March-KS 2007-02-08 216 ( 216 0 ) 45428 45469 0 ranov 2007-02-08 191 ( 106 85 ) 40314 12362 34447 KCNFS 2004 KCNFS 2006 189 ( 105 84 ) 38672 11618 33549 167 ( 167 0 ) 37641 37682 0 sapsrt 2007-02-08 215 ( 137 78 ) 37616 16678 27432 SATzilla RANDOM KCNFS SMP 165 ( 80 85 ) 37031 7862 34827 saps 2007-02-08 169 ( 169 0 ) 32931 32972 0 SATzilla CRAFTED 189 ( 143 46 ) 23670 17606 8358 MXC 2007-02-08 105 ( 63 42 ) 10480 5924 6671 minisat SAT-2007 101 ( 59 42 ) 9727 5097 6745 SAT7 95 8387 4940 5187

  25. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A LL SOLVERS ON I NDUSTRIAL BENCHMARKS ← SAT4J−−JVM−PARAM−CHANGED−SAT−2007 ← minisat−SAT−2007−(with−assertions) ← DEWSATZ−2007−04−26−(fixed) ← minimarch−2007−04−26−(fixed) ← CMUSAT−BASE−2007−02−08 ← Barcelogic−Fixed−2007−04−13 ← DEWSATZ−1A−2007−02−08 ← adaptg2wsat0−2007−02−08 ← adaptg2wsatp−2007−02−08 ← adaptg2wsat+−2007−02−08 ← adaptnovelty−2007−02−08 ← adaptg2wsat−2007−02−08 ← TiniSatELite−2007−02−08 ← UnitMarch−2007−02−08 ← March−KS−2007−02−08 ← ornithorynque−0.1−alpha ← gnovelty+−2007−02−08 ← CMUSAT−2007−02−08 ← Hybrid1−2007−02−08 ← sapsrt−2007−02−08 ← ranov−2007−02−08 ← SATzilla−RANDOM ← SAT7−2007−02−08 ← SATzilla−CRAFTED ← Spear−2007−02−12 ← tinisat−2007−02−08 ← saps−2007−02−08 ← SAT4J−SAT−2007 ← MXC−2007−02−08 ← minisat−SAT−2007 ← Rsat−2007−02−08 ← FH−2007−02−08 ← Spear−FHS−1.0 ← SATzilla−FULL ← Spear−FH−1.0 ← KCNFS−2004 ← KCNFS−2006 ← KCNFS−SMP 1400 ← picosat−535 ← MiraXT−v1 ← MiraXT−v3 ← MiraXT−v2 ← TTS−4.0 gnovelty+−2007−02−08 ( 2 ) KCNFS−2004 ( 2 ) 1200 saps−2007−02−08 ( 2 ) sapsrt−2007−02−08 ( 2 ) adaptnovelty−2007−02−08 ( 3 ) TTS−4.0 ( 3 ) UnitMarch−2007−02−08 ( 4 ) ranov−2007−02−08 ( 6 ) 1000 adaptg2wsat0−2007−02−08 ( 7 ) adaptg2wsatp−2007−02−08 ( 7 ) Hybrid1−2007−02−08 ( 7 ) adaptg2wsat−2007−02−08 ( 8 ) FH−2007−02−08 ( 8 ) CPU−Time needed (s) adaptg2wsat+−2007−02−08 ( 9 ) KCNFS−2006 ( 10 ) 800 March−KS−2007−02−08 ( 12 ) KCNFS−SMP ( 16 ) DEWSATZ−2007−04−26−(fixed) ( 19 ) DEWSATZ−1A−2007−02−08 ( 22 ) ornithorynque−0.1−alpha ( 33 ) SAT4J−SAT−2007 ( 57 ) 600 SAT4J−SAT−2007 ( 66 ) SATzilla−RANDOM ( 66 ) SAT7−2007−02−08 ( 69 ) CMUSAT−BASE−2007−02−08 ( 80 ) SATzilla−CRAFTED ( 81 ) Spear−2007−02−12 ( 82 ) MiraXT−v1 ( 83 ) 400 MXC−2007−02−08 ( 84 ) minimarch−2007−04−26−(fixed) ( 88 ) SATzilla−FULL ( 88 ) CMUSAT−2007−02−08 ( 89 ) MiraXT−v3 ( 89 ) tinisat−2007−02−08 ( 90 ) MiraXT−v2 ( 91 ) 200 Spear−FH−1.0 ( 93 ) minisat−SAT−2007−(with−assertions) ( 96 ) minisat−SAT−2007 ( 97 ) Barcelogic−Fixed−2007−04−13 ( 99 ) Spear−FHS−1.0 ( 99 ) picosat−535 ( 103 ) 0 TiniSatELite−2007−02−08 ( 103 ) 0 20 40 60 80 100 120 Rsat−2007−02−08 ( 106 ) #Solved

  26. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S CORES OF SOLVERS ON I NDUSTRIAL BENCHMARKS Solver #Solv. Sc. All Sc. SAT Sc. UNS Rsat 2007-02-08 106 ( 47 59 ) 44626 19422 22801 TiniSatELite 2007-02-08 103 ( 43 60 ) 30305 10911 18991 minisat SAT-2007 97 ( 37 60 ) 29721 13467 15850 MiraXT v3 89 ( 35 54 ) 26595 13292 11359 picosat 535 103 ( 51 52 ) 25513 16749 9360 CMUSAT 2007-02-08 89 ( 28 61 ) 25339 7275 18186 MiraXT v1 91 ( 36 55 ) 23850 12138 11958 tinisat 2007-02-08 90 ( 40 50 ) 20241 10264 9274 MXC 2007-02-08 84 ( 37 47 ) 19175 10609 9163 MiraXT v2 83 ( 27 56 ) 18824 6708 12513 CMUSAT-BASE 2007-02-08 80 ( 38 42 ) 18730 10138 8714 SATzilla CRAFTED 81 ( 35 46 ) 16727 8006 9317 SATzilla RANDOM 66 ( 28 38 ) 14937 6484 8103 SAT7 2007-02-08 69 ( 30 39 ) 11454 5883 5898 KCNFS 2006 16 ( 1 15 ) 3030 277 2952 KCNFS SMP 10 ( 0 10 ) 2877 0 2877 DEWSATZ-1A 2007-02-08 22 ( 3 19 ) 2591 249 2342 FH 2007-02-08 8 ( 5 3 ) 1871 1542 329 March-KS 12 1848 217 1630

  27. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S CORES OF SOLVERS ON I NDUSTRIAL BENCHMARKS Solver #Solv. Sc. All Sc. SAT Sc. UNS Rsat 2007-02-08 106 ( 47 59 ) 44626 19422 22801 TiniSatELite 2007-02-08 103 ( 43 60 ) 30305 10911 18991 minisat SAT-2007 97 ( 37 60 ) 29721 13467 15850 MiraXT v3 89 ( 35 54 ) 26595 13292 11359 picosat 535 103 ( 51 52 ) 25513 16749 9360 CMUSAT 2007-02-08 89 ( 28 61 ) 25339 7275 18186 MiraXT v1 91 ( 36 55 ) 23850 12138 11958 tinisat 2007-02-08 90 ( 40 50 ) 20241 10264 9274 84 ( 37 47 ) 19175 10609 9163 MXC 2007-02-08 MiraXT v2 83 ( 27 56 ) 18824 6708 12513 CMUSAT-BASE 2007-02-08 80 ( 38 42 ) 18730 10138 8714 81 ( 35 46 ) 16727 8006 9317 SATzilla CRAFTED SATzilla RANDOM 66 ( 28 38 ) 14937 6484 8103 SAT7 2007-02-08 69 ( 30 39 ) 11454 5883 5898 KCNFS 2006 16 ( 1 15 ) 3030 277 2952 KCNFS SMP 10 ( 0 10 ) 2877 0 2877 DEWSATZ-1A 2007-02-08 22 ( 3 19 ) 2591 249 2342 FH 2007-02-08 8 ( 5 3 ) 1871 1542 329 March-KS 12 1848 217 1630

  28. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG SOTAC SOLVERS O VER ALL BENCHMARKS , FIRST STAGE Solver #SOTAC Solver #SOTAC 11 2 TTS Hybrid1 5 2 gnovelty+ MiraXT 4 2 March KS CMUSAT 3 1 adaptg2wsatp MiraXT 3 1 SATzilla picosat 3 1 adaptnovelty DEWSATZ 3 1 adaptg2wsat+ SAT4J 2 1 adaptg2wsat0 minimarch 2 1 adaptg2wsat Spear 2 1 Rsat MXC

  29. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S OLVED CRAFTED BENCHMARKS , FIRST STAGE Series SubSeries #Solved #Tot contest02 mix 3 10 contest03 looksrandom 0 10 contest03 others 1 10 contest04 connamacher 2 10 contest04 others 1 10 contest05 counting-clq 0 10 contest05 counting-php 3 10 contest05 jarvisalo 10 10 contest05 others 14 20 contest05 pebbling 10 10 contest05 phnf 2 10 contest05 QG 3 10 contest05 sabharwal 10 10 Difficult contest-02-03-04 9 9 Difficult contest05 31 36 spence hard 2 6 spence medium 10 10

  30. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S OLVED RANDOM BENCHMARKS , FIRST STAGE Series SubSeries #Solved #Tot 2+p-p0.7 v3500 10 10 2+p-p0.7 v6500 6 10 2+p-p0.8 v1295 10 10 2+p-p0.8 v2405 6 11 2+p-p0.9 v1170 5 10 2+p-p0.9 v990 6 10 LargeSize-3SAT v7000 10 10 LargeSize-3SAT v19000 1 10 LargeSize-5SAT v600 10 10 LargeSize-5SAT v1100 7 10 LargeSize-7SAT v140 10 10 LargeSize-7SAT v240 0 10 OnTreshold-3SAT v360 10 10 OnTreshold-3SAT v650 5 10 OnTreshold-5SAT v70 10 10 OnTreshold-5SAT v130 5 10 OnTreshold-7SAT v45 10 10 OnTreshold-7SAT v75 6 10

  31. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S OLVED INDUSTRIAL BENCHMARKS , FIRST STAGE Series SubSeries #Solved #Tot anbulagan hard-sat 1 7 anbulagan hard-unsat 1 24 anbulagan medium-sat 10 10 anbulagan medium-unsat 5 6 babic dspam 10 10 babic xinetd 10 10 crypto crypto 10 10 fuhs hard 1 6 fuhs medium 10 10 grieu grieu 10 10 jarvisalo jarvisalo 5 7 manolios manolios 10 10 narain narain 4 5 palacios hard 2 7 palacios uts 10 10 velev vliw-sat-4.0 10 10 velev vliw-unsat-2.0 4 9 zarpas IBM-FV-2002-13-rule-1 0 19 zarpas IBM-FV-2002-31-1-rule-1 2 16 zarpas IBM-FV-2004-30 10 18

  32. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG R OAD M AP History, rules and Goals 1 The participants 2 The First Stage 3 4 T HE W INNERS Smallest unsolved benchmarks The crafted winners The random winners The industrial winners Conclusion and next contests 5 Certified UNSAT Special Track 6 And Inverter Graph Special Track 7

  33. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S MALLEST UNSOLVED CRAFTED BENCHMARKS Benchmark size #clauses #variables spence/hard/s117-100 732 244 117 Hard/contest03/looksrand/hgen8-n260 904 399 212 Hard/contest03/looksrand/hgen8-n320-01 1102 486 260 Hard/contest03/looksrand/hgen8-n320-03 1108 489 260 Hard/contest03/looksrand/hgen8-n320-02 1114 492 260

  34. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S MALLEST UNSOLVED RANDOM BENCHMARKS Benchmark size #clauses #var OnTres/3SAT/v550/unif-k3-r4.26-v550-c2343-07.UNSAT 7029 2343 550 OnTres/3SAT/v550/unif-k3-r4.26-v550-c2343-03.UNSAT 7029 2343 550 OnTres/3SAT/v550/unif-k3-r4.26-v550-c2343-15.UNSAT 7029 2343 550 OnTres/3SAT/v550/unif-k3-r4.26-v550-c2343-01.UNSAT 7029 2343 550 OnTres/3SAT/v550/unif-k3-r4.26-v550-c2343-20.UNSAT 7029 2343 550

  35. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG S MALLEST UNSOLVED INDUSTRIAL BENCHMARKS Benchmark size #clauses #variables jarvisalo/eq.atree.braun.12.unsat 14874 5726 1694 jarvisalo/eq.atree.braun.13.unsat 17668 6802 2010 fuhs/hard/AProVE07-01 76290 28770 7502 fuhs/hard/AProVE07-25 83706 31884 8920 fuhs/hard/AProVE07-26 211276 79766 21734

  36. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A ND N OW ... The results for the crafted category...

  37. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , minisat SAT-2007 , picosat 535 And the winner is...

  38. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , minisat SAT-2007 , picosat 535 And the winner is... SATzilla CRAFTED

  39. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , minisat SAT-2007 , picosat 535 And the winner is... SATzilla CRAFTED minisat SAT-2007

  40. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , minisat SAT-2007 , picosat 535 And the winner is... SATzilla CRAFTED minisat SAT-2007 MXC 2007-02-08

  41. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT +U NS SPECIALTY T HE DETAILS ! Solver Score #SAT #Uns SATzilla CRAFTED 74469 27 67 minisat SAT-2007 63371 26 72 MXC 2007-02-08 39848 20 57 MiraXT v3 34236 24 54 CMUSAT 2007-02-08 26461 21 45 Rsat 2007-02-08 19532 15 40 picosat 535 19081 22 38

  42. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is...

  43. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is... March-KS 2007-02-08

  44. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is... March-KS 2007-02-08 SATzilla CRAFTED

  45. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is... March-KS 2007-02-08 SATzilla CRAFTED minisat SAT-2007

  46. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , S AT SPECIALTY T HE DETAILS ! Solver Score #SAT #Uns March-KS 2007-02-08 16323 18 0 SATzilla CRAFTED 14275 27 0 minisat SAT-2007 13785 26 0 MiraXT v3 11601 24 0 CMUSAT 2007-02-08 8093 21 0 picosat 535 7153 22 0 MXC 2007-02-08 5136 20 0 Rsat 2007-02-08 4475 15 0 TTS 4.0 1155 3 0

  47. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is...

  48. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is... SATzilla CRAFTED

  49. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is... SATzilla CRAFTED TTS 4.0

  50. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SATzilla CRAFTED , TTS 4.0 , minisat SAT-2007 , picosat 535 And the winner is... SATzilla CRAFTED TTS 4.0 minisat SAT-2007

  51. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY CRAFTED , U NSAT SPECIALTY T HE DETAILS ! Solver Score #SAT #Uns SATzilla CRAFTED 39922 0 67 TTS 4.0 38950 0 39 minisat SAT-2007 38090 0 72 MXC 2007-02-08 26151 0 57 March-KS 2007-02-08 19684 0 29 MiraXT v3 18379 0 54 CMUSAT 2007-02-08 16437 0 45 Rsat 2007-02-08 13373 0 40 picosat 535 11011 0 38

  52. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A LL SOLVERS ON C RAFTED BENCHMARKS ← March−KS−2007−02−08 ← CMUSAT−2007−02−08 ← SATzilla−CRAFTED ← minisat−SAT−2007 ← Rsat−2007−02−08 ← MXC−2007−02−08 ← picosat−535 ← MiraXT−v3 ← TTS−4.0 6000 5000 4000 CPU−Time needed (s) TTS−4.0 ( 42 ) March−KS−2007−02−08 ( 47 ) Rsat−2007−02−08 ( 55 ) picosat−535 ( 60 ) CMUSAT−2007−02−08 ( 66 ) 3000 MXC−2007−02−08 ( 77 ) MiraXT−v3 ( 78 ) SATzilla−CRAFTED ( 94 ) minisat−SAT−2007 ( 98 ) 2000 1000 0 0 10 20 30 40 50 60 70 80 90 100 #Solved

  53. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A ND N OW ... The results for the random category...

  54. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 And the winner is...

  55. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 And the winner is... SATzilla RANDOM

  56. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 And the winner is... SATzilla RANDOM March-KS 2007-02-08

  57. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 And the winner is... SATzilla RANDOM March-KS 2007-02-08 KCNFS 2004

  58. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT +U NS SPECIALTY T HE DETAILS ! Solver Score #SAT #Uns SATzilla RANDOM 189835 147 101 March-KS 2007-02-08 167430 146 111 KCNFS 2004 124280 130 107 minisat SAT-2007 36387 83 57 MXC 2007-02-08 35538 82 53 DEWSATZ-1A 2007-02-08 30754 73 48 SAT7 2007-02-08 30282 74 48 MiraXT v3 26491 69 37

  59. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , adaptg2wsat+ 2007-02-08 , adaptg2wsat0 2007-02-08 , adaptnovelty 2007-02-08 , gnovelty+ 2007-02-08 , minisat SAT-2007 , ranov 2007-02-08 , sapsrt 2007-02-08 And the winner is...

  60. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , adaptg2wsat+ 2007-02-08 , adaptg2wsat0 2007-02-08 , adaptnovelty 2007-02-08 , gnovelty+ 2007-02-08 , minisat SAT-2007 , ranov 2007-02-08 , sapsrt 2007-02-08 And the winner is... gnovelty+ 2007-02-08

  61. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , adaptg2wsat+ 2007-02-08 , adaptg2wsat0 2007-02-08 , adaptnovelty 2007-02-08 , gnovelty+ 2007-02-08 , minisat SAT-2007 , ranov 2007-02-08 , sapsrt 2007-02-08 And the winner is... gnovelty+ 2007-02-08 adaptg2wsat0 2007-02-08

  62. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , MiraXT v3 , SAT7 2007-02-08 , SATzilla RANDOM , adaptg2wsat+ 2007-02-08 , adaptg2wsat0 2007-02-08 , adaptnovelty 2007-02-08 , gnovelty+ 2007-02-08 , minisat SAT-2007 , ranov 2007-02-08 , sapsrt 2007-02-08 And the winner is... gnovelty+ 2007-02-08 adaptg2wsat0 2007-02-08 adaptg2wsat+ 2007-02-08

  63. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , S AT SPECIALTY T HE DETAILS ! Solver Score #SAT #Uns gnovelty+ 2007-02-08 122500 242 0 adaptg2wsat0 2007-02-08 114109 248 0 adaptg2wsat+ 2007-02-08 112877 252 0 adaptnovelty 2007-02-08 96497 240 0 ranov 2007-02-08 86647 242 0 sapsrt 2007-02-08 68218 188 0 SATzilla RANDOM 29895 147 0 March-KS 2007-02-08 26721 146 0 KCNFS 2004 23786 130 0 MXC 2007-02-08 13308 82 0 minisat SAT-2007 12397 83 0 SAT7 2007-02-08 11594 74 0 DEWSATZ-1A 2007-02-08 10832 73 0 MiraXT v3 10614 69 0

  64. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 , MiraXT v3 And the winner is...

  65. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 , MiraXT v3 And the winner is... March-KS 2007-02-08

  66. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 , MiraXT v3 And the winner is... March-KS 2007-02-08 KCNFS 2004

  67. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , U NSAT SPECIALTY T HE WINNER ! W ERE QUALIFIED DEWSATZ-1A 2007-02-08 , KCNFS 2004 , MXC 2007-02-08 , March-KS 2007-02-08 , SAT7 2007-02-08 , SATzilla RANDOM , minisat SAT-2007 , MiraXT v3 And the winner is... March-KS 2007-02-08 KCNFS 2004 SATzilla RANDOM

  68. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY RANDOM , U NSAT SPECIALTY T HE DETAILS ! Solver Score #SAT #Uns March-KS 2007-02-08 88041 0 111 KCNFS 2004 73087 0 107 SATzilla RANDOM 61008 0 101 minisat SAT-2007 16870 0 57 MXC 2007-02-08 14997 0 53 DEWSATZ-1A 2007-02-08 12794 0 48 SAT7 2007-02-08 12628 0 48 MiraXT v3 9573.3 37 37

  69. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A LL SOLVERS ON R ANDOM BENCHMARKS ← DEWSATZ−1A−2007−02−08 ← adaptg2wsat+−2007−02−08 ← adaptg2wsat0−2007−02−08 ← adaptnovelty−2007−02−08 ← gnovelty+−2007−02−08 ← March−KS−2007−02−08 ← SAT7−2007−02−08 ← minisat−SAT−2007 ← sapsrt−2007−02−08 ← ranov−2007−02−08 ← SATzilla−RANDOM ← MXC−2007−02−08 ← KCNFS−2004 ← MiraXT−v3 6000 5000 4000 CPU−Time needed (s) MiraXT−v3 ( 106 ) DEWSATZ−1A−2007−02−08 ( 121 ) SAT7−2007−02−08 ( 122 ) MXC−2007−02−08 ( 135 ) minisat−SAT−2007 ( 140 ) 3000 sapsrt−2007−02−08 ( 188 ) KCNFS−2004 ( 237 ) adaptnovelty−2007−02−08 ( 240 ) gnovelty+−2007−02−08 ( 242 ) ranov−2007−02−08 ( 242 ) adaptg2wsat0−2007−02−08 ( 248 ) SATzilla−RANDOM ( 248 ) 2000 adaptg2wsat+−2007−02−08 ( 252 ) March−KS−2007−02−08 ( 257 ) 1000 0 0 50 100 150 200 250 300 #Solved

  70. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG A ND N OW ... The results for the industrial category...

  71. Rules Participants First Stage Winners Conclusion Certified UNSAT AIG C ATEGORY INDUSTRIAL , S AT +U NS SPECIALTY T HE WINNER ! W ERE QUALIFIED CMUSAT 2007-02-08 , MXC 2007-02-08 , MiraXT v3 , Rsat 2007-02-08 , SAT7 2007-02-08 , SATzilla CRAFTED , TiniSatELite 2007-02-08 , minisat SAT-2007 , picosat 535 And the winner is...

Recommend

T HE F INAL WORD ON CUSMA 2 T HE F INAL WORD ON CUSMA We lc ome & Intr oduc

T HE F INAL WORD ON CUSMA 2 T HE F INAL WORD ON CUSMA We lc ome & Intr oduc

T HE F INAL WORD ON CUSMA 2 T HE F INAL WORD ON CUSMA We lc ome & Intr oduc tions Ag e nda T he impo rta nt c ha ng e s in CUSMA fro m NAF T A Ho w to minimize impo rte r risk tra nsitio ning fro m NAF T A

293 views • 13 slides
Ret inal Prot eins (Rhodopsins) Molecular Mechanisms of Photoactivation and Spectral

Ret inal Prot eins (Rhodopsins) Molecular Mechanisms of Photoactivation and Spectral

Ret inal Prot eins (Rhodopsins) Molecular Mechanisms of Photoactivation and Spectral Membrane prot eins Seven t ransmembrane helices Tuning in Retinal Proteins Ret inal chromophore bound t o a lysine via a Schif f base Emad

213 views • 8 slides
Tax Fraud: W hen is Tax Avoidance a Crim inal Offence? By Craig Elliffe 2 July 2 0 1 0 Tax

Tax Fraud: W hen is Tax Avoidance a Crim inal Offence? By Craig Elliffe 2 July 2 0 1 0 Tax

Tax Fraud: W hen is Tax Avoidance a Crim inal Offence? By Craig Elliffe 2 July 2 0 1 0 Tax Avoidance and Crim inal Acts The difference between tax avoidance and tax evasion is the thickness of a prison wall. Denis Healey, former

313 views • 14 slides
Background of the Study The %inal report provides an extensive analysis of traf%ic enforcement

Background of the Study The %inal report provides an extensive analysis of traf%ic enforcement

5/23/16 Vermont State Police: An Examination of Traf5ic Stop Data July 1, 2010-December 31, 2015 Ins$tute on Race and Jus$ce Northeastern University May 24, 2016 Background of the Study The %inal report provides an extensive analysis of

264 views • 15 slides
Aborigina inal l Quitline line Commercial in Confidence | 1 Acknowledgement I would like to

Aborigina inal l Quitline line Commercial in Confidence | 1 Acknowledgement I would like to

Aborigina inal l Quitline line Commercial in Confidence | 1 Acknowledgement I would like to acknowledge the Traditional Custodians of this land on which we meet today the Gadigal Peoples and pay respect to Elders, both past, present and

481 views • 18 slides
FIN INAL AL REPO PORT RT OF MO MONITOR NITORING ING OF THE HE 2018 8 PR PRESIDENTIAL

FIN INAL AL REPO PORT RT OF MO MONITOR NITORING ING OF THE HE 2018 8 PR PRESIDENTIAL

FIN INAL AL REPO PORT RT OF MO MONITOR NITORING ING OF THE HE 2018 8 PR PRESIDENTIAL SIDENTIAL ELECTIO ECTIONS NS Pre-Elec Election tion Observ servatio ation n Mi Mission sion I Round Monitoring Period : : August 1 - October,

667 views • 38 slides
Ab Aborig igin inal Q l Quit itlin ine Pr Presentation Commercial in Confidence | 1

Ab Aborig igin inal Q l Quit itlin ine Pr Presentation Commercial in Confidence | 1

Ab Aborig igin inal Q l Quit itlin ine Pr Presentation Commercial in Confidence | 1 Acknowledgement of country I would like to acknowledge the Traditional Custodians of this land on which we meet today and pay respect to Elders, both

277 views • 16 slides
Cat at-App Fin inal l Workshop Draft t Programme Thursday 6 th September 2018 The SQUARE

Cat at-App Fin inal l Workshop Draft t Programme Thursday 6 th September 2018 The SQUARE

Cat at-App Fin inal l Workshop Draft t Programme Thursday 6 th September 2018 The SQUARE Brussels 9:00 9:30 Registration and Welcome Coffee Hans Ketelslegers, 9:30 9:40 Welcome and Introductions Concawe Thomas Hartung / Johns 9:40

455 views • 3 slides
Crim Crimin inal Co Court rt Famil ily Co Court rt Jud udge one one Jud udge tw two

Crim Crimin inal Co Court rt Famil ily Co Court rt Jud udge one one Jud udge tw two

The Hon. Donna Martinson Q.C. October 21, 2014, Fredericton, New Brunswick Crim Crimin inal Co Court rt Famil ily Co Court rt Jud udge one one Jud udge tw two Child Protection Immigration/ Court Refugee Proceedings Judge three

517 views • 36 slides
Golf lf Lin inks: Proposed Fin inal IS IS/MND, Car r Auction Agreement, & Im

Golf lf Lin inks: Proposed Fin inal IS IS/MND, Car r Auction Agreement, & Im

Pacif ific Grove Golf lf Lin inks: Proposed Fin inal IS IS/MND, Car r Auction Agreement, & Im Improvement Bid id Award Pacific Grove City Council May 2, 2018 Project Objectives and Description Improvement to golf course o

347 views • 14 slides
S CHOOL F ACILITIES P LANNING F INAL S UMMARY OF R ECOMMENDED P ROJECTS September 25, 2017 P

S CHOOL F ACILITIES P LANNING F INAL S UMMARY OF R ECOMMENDED P ROJECTS September 25, 2017 P

B LIND B ROOK -R YE UFSD S CHOOL F ACILITIES P LANNING F INAL S UMMARY OF R ECOMMENDED P ROJECTS September 25, 2017 P RESENTATION O UTLINE F OR T ONIGHT 1. Five-Year Capital Facilities Plan 2. Important facts about the construction projects 3.

312 views • 29 slides
Fina inal Re l Report port XII II Annu Annual Co al Confe nferenc rence of e of t the I

Fina inal Re l Report port XII II Annu Annual Co al Confe nferenc rence of e of t the I

Fina inal Re l Report port XII II Annu Annual Co al Confe nferenc rence of e of t the I he Int nter er- American N Ame rican Net etwork on work on Gov overnm ernment ent Pr Proc ocureme urement nt (ING (INGP) P)

455 views • 8 slides
Gyrotonic Aftermarket Bench Lift Design ME ME 395 F Fin inal l Pr Proje ject Gr Group up

Gyrotonic Aftermarket Bench Lift Design ME ME 395 F Fin inal l Pr Proje ject Gr Group up

Gyrotonic Aftermarket Bench Lift Design ME ME 395 F Fin inal l Pr Proje ject Gr Group up 1 1 Da David id T Tric ick, An Andr drew ew Du Duong ng, Hu Huy Le, e, Mi Micha hael el Gi Gilr lroy & & Ni Nick Schl

237 views • 20 slides
F INAL C HAPTER 1 Web Applications W EB P ROGRAMS The programs in this chapter require the

F INAL C HAPTER 1 Web Applications W EB P ROGRAMS The programs in this chapter require the

F INAL C HAPTER 1 Web Applications W EB P ROGRAMS The programs in this chapter require the use of either Visual Web Developer 2010 (packaged with this textbook) or the complete version of Visual Studio 2010. We assume that you are using

1.75k views • 164 slides
Spin inal drains and MEPs are a waste of tim ime ! Donald Adam University Hospitals Birmingham

Spin inal drains and MEPs are a waste of tim ime ! Donald Adam University Hospitals Birmingham

Spin inal drains and MEPs are a waste of tim ime ! Donald Adam University Hospitals Birmingham NHS Foundation Trust www.critical-issues-congress.com My remit from the course organisers.. How do we achieve low paraplegia rates without

126 views • 12 slides
FrailSafe Fin inal Conference 0 Brussels, EIT House, 2 April 2019 Soeren.haar@eithealth.eu EIT

FrailSafe Fin inal Conference 0 Brussels, EIT House, 2 April 2019 Soeren.haar@eithealth.eu EIT

0 FrailSafe Fin inal Conference 0 Brussels, EIT House, 2 April 2019 Soeren.haar@eithealth.eu EIT Health is supported by the EIT, a body of the European Union 0 0 Welcome and opening remarks 0 0 0 Three years EIT IT Healt lth:

538 views • 16 slides
P2-NEO-I SSA-NEO S EGMENT F INAL P RESENTATIONS DA Y ESRIN 1 F EBRUARY 2016 ETTORE PEROZZI Deimos

P2-NEO-I SSA-NEO S EGMENT F INAL P RESENTATIONS DA Y ESRIN 1 F EBRUARY 2016 ETTORE PEROZZI Deimos

T HE SSA-NEO C OORDINATION C ENTRE operation, maintenance, enhancement P2-NEO-I SSA-NEO S EGMENT F INAL P RESENTATIONS DA Y ESRIN 1 F EBRUARY 2016 ETTORE PEROZZI Deimos Space 1 OPERATIONS OBSERVATIONS SERVICE COMMUNICATION MAINTENANCE

564 views • 45 slides
dr T Tomasz sz Ostropolsk lski Head of Unit, European ean Crimin inal l Law Ministry of

dr T Tomasz sz Ostropolsk lski Head of Unit, European ean Crimin inal l Law Ministry of

dr T Tomasz sz Ostropolsk lski Head of Unit, European ean Crimin inal l Law Ministry of Justic ice, , Poland BRUXELLES, , 12 J JUNE NE 2013 Territoriality Personality - active personality (ex-)prohibition of

235 views • 20 slides
Collaboration in Crim inal Justice Response to Dom estic Violence Dom estic Violence Court

Collaboration in Crim inal Justice Response to Dom estic Violence Dom estic Violence Court

1 Collaboration in Crim inal Justice Response to Dom estic Violence Dom estic Violence Court Program 1985-87 Government Violence Against Women initiatives started: 10 Victim Witness Assistance Programs (V/ WAP) established

668 views • 28 slides
Assignm ssignment 4 nt 4: : Fina inal R l Rese search P h Pape per Pr r Proposa oposal

Assignm ssignment 4 nt 4: : Fina inal R l Rese search P h Pape per Pr r Proposa oposal

Assignm ssignment 4 nt 4: : Fina inal R l Rese search P h Pape per Pr r Proposa oposal l Sc ScWk Wk 2 242 Se Session 1 ssion 14 Slide Slides s 2 Methods & Me thods & R Rese search D h Design sign Ide

435 views • 24 slides
Cr Crim imin inal al Ju Justi tice ce Co Coordi ordina nating ting Co Counc ncil il

Cr Crim imin inal al Ju Justi tice ce Co Coordi ordina nating ting Co Counc ncil il

Cr Crim imin inal al Ju Justi tice ce Co Coordi ordina nating ting Co Counc ncil il September 10, 2018 Agenda Welcome/Call to Order By-Law (Final Comment and Vote) Executive Committee Nominations Website Discussion

392 views • 10 slides
Aborig igin inal al Aquacul Aquacultur ure in in Canada Canada In Initia itiativ tive May

Aborig igin inal al Aquacul Aquacultur ure in in Canada Canada In Initia itiativ tive May

Aborig igin inal al Aquacul Aquacultur ure in in Canada Canada In Initia itiativ tive May 30, 2018 Little Current, Ontario We Welcome & Thank Thanks fo for bei being her here!! !! Nicholas Huber, Waubetek Presen esenters fo for Ma

578 views • 21 slides
Fin inal l Report Webin inar Tuesday 25 August 2020 10.00-11.00 Scottish Citizens Basic

Fin inal l Report Webin inar Tuesday 25 August 2020 10.00-11.00 Scottish Citizens Basic

Fin inal l Report Webin inar Tuesday 25 August 2020 10.00-11.00 Scottish Citizens Basic Income Feasibility Project Welcome Webinar Chair Sarah Davidson Chief Executive Officer The Carnegie UK Trust Headlines - Final Report Scottish

549 views • 30 slides
UMMS A LUMNI S URVEY : F INAL R EPORT R ESPONSE R ATE : 35% (2558/7338) AS OF A UGUST 2011 S URVEY

UMMS A LUMNI S URVEY : F INAL R EPORT R ESPONSE R ATE : 35% (2558/7338) AS OF A UGUST 2011 S URVEY

UMMS A LUMNI S URVEY : F INAL R EPORT R ESPONSE R ATE : 35% (2558/7338) AS OF A UGUST 2011 S URVEY M ETHODOLOGY Developed in collaboration with I.S. & U.I.T.S. Disseminated first institution-wide alumni survey in October 2010

431 views • 21 slides

More recommend