Presentation Experiment Conclusion Empirical Study: Expert Finding Matthieu Vergne vergne@fbk.eu Fondazione Bruno Kessler Information and Communication Technology University of Trento February 19th, 2014 Empirical Study: Expert Finding 1/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Outline 1 Presentation 2 Experiment 3 Conclusion Empirical Study: Expert Finding 2/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Your job: refine a set of requirements on some topics Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Suggestion: look in broad Open Source communities Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Suggestion: look in broad Open Source communities Candidate: XWiki, Open Source tool to build collaborative content managers (Wikis) Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Your Role Context: Your position: requirement analyst in a small IT company Check the needs of your customers are met and the necessary constraints are considered. Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Suggestion: look in broad Open Source communities Candidate: XWiki, Open Source tool to build collaborative content managers (Wikis) Final goal: evaluate people’s expertises in the XWiki mailing lists. Empirical Study: Expert Finding 3/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Dataset: XWiki mailing list URL: http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset Empirical Study: Expert Finding 4/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Dataset: XWiki mailing list URL: http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset ZIP: (also available on USB key) http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset.zip Empirical Study: Expert Finding 4/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Dataset: XWiki mailing list URL: http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset ZIP: (also available on USB key) http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset.zip Quick presentation Empirical Study: Expert Finding 4/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Dataset: XWiki mailing list URL: http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset ZIP: (also available on USB key) http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset.zip Quick presentation For fairness, use only the search feature of your browser! Empirical Study: Expert Finding 4/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Questionnaires Resources: Guidelines Empirical Study: Expert Finding 5/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Questionnaires Resources: Guidelines Pre-questionnaire Empirical Study: Expert Finding 5/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Questionnaires Resources: Guidelines Pre-questionnaire 2 Questionnaires (one after the other) Empirical Study: Expert Finding 5/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Questionnaires Resources: Guidelines Pre-questionnaire 2 Questionnaires (one after the other) Post-questionnaire Empirical Study: Expert Finding 5/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Questionnaires Resources: Guidelines Pre-questionnaire 2 Questionnaires (one after the other) Post-questionnaire You keep the guidelines, but the questionnaires are taken back when filled. Empirical Study: Expert Finding 5/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Experiment If you have questions, put a hand up. I will come to you. Following the guidelines: 1 ID assigned to you with your guidelines Empirical Study: Expert Finding 6/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Experiment If you have questions, put a hand up. I will come to you. Following the guidelines: 1 ID assigned to you with your guidelines 2 Pre-questionnaire Empirical Study: Expert Finding 6/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Experiment If you have questions, put a hand up. I will come to you. Following the guidelines: 1 ID assigned to you with your guidelines 2 Pre-questionnaire 3 Questionnaire A Specific topic Requirement analyst searching for support to refine a set of requirements Duration: around 20 minutes (notification 11:46, end 11:51). Empirical Study: Expert Finding 6/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Experiment If you have questions, put a hand up. I will come to you. Following the guidelines: 1 ID assigned to you with your guidelines 2 Pre-questionnaire 3 Questionnaire A Specific topic Requirement analyst searching for support to refine a set of requirements Duration: around 20 minutes (notification 11:46, end 11:51). 4 Questionnaire B Different topic, but same task Duration: around 20 minutes (notification 12:09, end 12:14). Empirical Study: Expert Finding 6/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion Experiment If you have questions, put a hand up. I will come to you. Following the guidelines: 1 ID assigned to you with your guidelines 2 Pre-questionnaire 3 Questionnaire A Specific topic Requirement analyst searching for support to refine a set of requirements Duration: around 20 minutes (notification 11:46, end 11:51). 4 Questionnaire B Different topic, but same task Duration: around 20 minutes (notification 12:09, end 12:14). 5 Post-questionnaire Privacy statement + contact information Empirical Study: Expert Finding 6/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Presentation Experiment Conclusion That’s it! The experiment is finished. Thanks for your participation. Questions? Empirical Study: Expert Finding 7/ 7 Matthieu Vergne ( vergne@fbk.eu ) FBK - ICT Doctoral School
Recommend
More recommend