CLEF-IP 2012: Retrieval in the Intellectual Property Domain Florina Piroi , Mihai Lupu, Allan Hanbury (1) Walid Magdy (2) , Alan Sexton (3) , Igor Filippov (4) IFS, Vienna University of Technology, Austria (1) QCRI, Quatar Foundation, Doha, Quatar (2) School of CS, University of Birmingham, UK (3) SAIC-Frederick Inc., USA (4)
CLEF-IP Collection Content Patent documents 1.5 patents English, German, French EPO, WIPO
CLEF-IP Collection Content 3.5 million XML files Multilingual content CLEF-IP
CLEF-IP Tasks Prior Art Retrieval (2009, 2010, 2011) Patent Classification (IPC) (2010, 2011) Image-based Patent Retrieval (2011) Patent Image Classification (2011)
CLEF-IP Tasks Prior Art Retrieval (2009, 2010, 2011) Patent Classification (IPC) (2010, 2011) Image-based Patent Retrieval (2011) Passage Retrieval based on Claims Patent Image Classification (2011) Flow-chart Recognition Chemical Structure Recognition
Passage Retrieval Based on Claims Patentability Search
Passage Retrieval Based on Claims 105 topics (3 x 35) XPaths in qrels
Passage Retrieval Based on Claims 0.35 PRES Recall MAP 0.30 0.25 0.20 0.15 0.10 0.05 PRES 0.00 Recall bit-2 bit-8 chm-1 bit-5 bit-3 chm-5 chm-3 hild-1 tuw-8 tuw-3 tuw-2 hild-2 chm-6 lut-5 tuw-7 lut-4 MAP
MAP(D) Precision(D) Passage Retrieval Based on Claims 0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 bit-2 bit-1 bit-8 bit-7 chm-5 chm-1 bit-5 bit-6 chm-3 chm-4 bit-3 bit-4 chm-6 chm-2 MAP(D) hild-4 hild-2 hild-3 hild-1 lut-3 Precision(D) lut-5 lut-4 lut-1 lut-2
Flow-chart Recognition Make content searchable
Flow-chart Recognition 100 topics Graph distance measure
Flow-chart Recognition Structure only 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 40 topics evaluated
Flow-chart Recognition Text Recognition (Edit distance) - average 120 100 80 60 40 20 0 40 topics evaluated
Flow-chart Recognition Node type match 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 40 topics evaluated
Chemical Structure Recognition Image segmentation Structure recognition
Chemical Structure Recognition Image segmentation Structure recognition
CLEF-IP 2012 www.ifs.tuwien.ac.at/~clef-ip CLEF-IP Workshop Wednesday and Thursday Thank You! Florina Piroi , Mihai Lupu, Allan Hanbury Walid Magdy, Alan Sexton, Igor Filippov
Recommend
More recommend