CS492 Crowdsourcing - Final Team Presentation 1-Day-N-Questions 2016-12-15 Team MEDDLER 20165192 Sunggeun Ahn topmaze@kaist.ac.kr 20165161 Young-Min Baek ymbaek@se.kaist.ac.kr 20163703 Sungjae Hong yain@kaist.ac.kr
A Motivation
Very Global Problem for Learning Unfair and ineffective environment for learning Unfair education environment Ineffective learning materials Regional/Economic differences Fixed set of problems for learning Different environment (time) for education No proper stimulation for self-study 3
Specific Problems We want to get “good” learning materials “for free” We need to study, We need to be We need newer and anytime and anywhere motivated to learn more diverse problems How can we enable How can we provide Where can we get learners to study easily in the proper stimulation a number of their daily lives? for learning? various problems? Use smartphone! Use crowds! Use crowdsourced problems! 4
Already in Many Study Groups … They have already facilitated group-based crowdsourcing for effective learning for free Crowds (People) can effectively stimulate learners to study in a person-to-person way. 5
B Goal & Tasks
Overall Goal Crowdsourcing approach Traditional Crowd-powered Study Group Study Group Crowdsourcing platform for study groups Scope of prototype: A crowdsourced study group for studying English words 7
Tasks Examining user’s Solving a card Making a card achievements Notification messages Users should be able to should not be annoying Visualization of user’s make a word card easily & They should give an current status is in a brief time increased incentive for necessary to motivate learning learning process 8
C Solution: 1-Day-N-Questions
1-Day-N-Questions Crowdsourcing platform for study groups 1-Day-N-Questions 10
1-Day-N-Questions System Architecture Push notification Google Firebase message Firebase Cloud service Messaging (FCM) Push notification Push data & card with cards Acknowledgement Usage logging, casting target Global data View management (JSON objects) HTTP PROTOCOL Application 1DNQ services SERVER 1DNQ Crowdsourced data ANDROID APP User usage log data Management of Management of Global Local MySQL SQLite Users, Groups, Cards, Logs My Cards, My Groups database database SYNCHRONIZED 11
1-Day-N-Questions Key Functionalities Create/save/check an English word question Key Function 1 Receive an question through a push alarm Key Function 2 Check user achievement on the app. Key Function 3 Check important English words for the user Key Function 4 12
1-Day-N-Questions Motivating Users & Quality Control Motivating users Quality control Visualization of Fixed format of creating cards user’s current achievements Quality evaluation of User’s experience management other users’ cards Leaderboard of a study group Card maker’s quality points 13
D Demonstration
1-Day-N-Questions Demo Video 15
E Deployment & User Study (in-progress)
User study Preliminary study • How users feel about the creating question task • How users respond about the interrupted push alarm - In group study environment Usage Pattern analysis (in-progress) • 2 day’s long • Which factors are affected to motivate to create new question card • How they behave group study with interrupted alarm -in vivo 17
Recruitment Recruitment • Participants are same in both preliminary study and (will be) in- vivo study • 3 or 4 members of each labs, total of 9 participants were recruited. • age: mean 31.11, STDEV 8.43, 1 female 8 male • All of them are belonging in our team members lab • 6 of them have experience of group study 18
Study Results (1/3) User comments from preliminary study “Real people in group makes me a interesting and challenging problem” “Creative hint makes me funny in study” “Feeling of belonging makes me more careful when making a word set” “Isn’t there any way of simplest way to create a card?” “I need dictionary” “Need more gamification” 19
Study Results (2/3) Finding from preliminary study • Feeling of presence makes workers more mandatory • Users feel presence when they meet pushed questions card which are relative to their study context 20
Study Results (3/3) Finding from preliminary study • When users faced creative and impressed hint, tend to take more time to make a question • Restricted form filling area tend to make workers consider about their study context 21
F Limitations & Future Work
Limitations & Implications Need of level classification Limitation 1 Need of more motivation for card making Limitation 2 Lack of fun components to let users stick on Limitation 3 23
Future Work Proper user-question match system Future Work 1 Attractable reputation system Future Work 2 More gamification components Future Work 3 Fine-granularity user study based on user logs Future Work 4 24
CS492 Crowdsourcing - Final Project Final Presentation: 1-Day-N-Questions Thank You. 20165192 Sunggeun Ahn topmaze@kaist.ac.kr Server messaging, visualization, experiment design 20165161 Young-Min Baek ymbaek@se.kaist.ac.kr Front-end client Android app, UI/UX design, quality control 20163703 Sungjae Hong yain@kaist.ac.kr Server (+DB) management, data integration & distribution
Appendix
Crowdsourced Approach Why do we use crowdsourcing for the problem? Easy access to new problems Diversity/Variety of the problems Those who want to study something Automated machine cannot create a • • have to purchase some textbooks/ set of diverse problems for specific Without crowds workbooks. Expensive learners. No creativity • Or, they have to take private • A certain person or group has the educations/lessons. Expensive limits of diversity No diversity Lowering the cost of access to study Creative & diverse problem set • Crowdsourced platform can reduce • The more creative workers can help, With crowds the cost to get the problems or the the more effective and diverse answers for the education. problems can be made and shared.
1-Day-N-Questions I want to write down a word Workflow in my vocabulary notebook using 1DNQ app Learner A Target study group 1DNQ Learner A Learner B Loading... Learner C Learner D 28
1-Day-N-Questions I want to write down a word Workflow in my vocabulary notebook using 1DNQ app Learner A Target study group 1DNQ Learner A’s NEW WORD new word Problem Immigration Learner A Learner B Answer 이민 , 이주 , 출입국 관리소 Time limit 10 secs Learner C Learner D Register! 29
1-Day-N-Questions New question Workflow has arrived! Learner B Learner A Target study group New word New question has arrived! 1DNQ Learner A’s NEW WORD new word Learner C Problem Immigration Learner A Learner B New word Answer 이민 , 이주 , 출입국 관리소 Time limit 10 secs Learner C Learner D Register! New question New word has arrived! Learner D 30
1-Day-N-Questions 1DNQ A problem Workflow from Learner A Immigration Learner B Write your answer 이민 4 sec Submit left Learner A Target study group 1DNQ A problem 1DNQ from Learner A Immigration NEW WORD Learner C Write your answer Problem 여행 Immigration Learner A Learner B 6 sec Answer Submit 이민 , 이주 , left 출입국 관리소 Time limit 10 secs Learner C Learner D Register! 1DNQ A problem from Learner A Immigration Learner D Write your answer 이주 2 sec Submit left 31
1-Day-N-Questions 1DNQ Your answer is Workflow submitted. Correct answer √ 이민 , 이주 , Learner B 출입국 관리소 I was Correct I was Wrong Learner A Target study group Answer 1DNQ Your answer is 1DNQ submitted. Correct answer NEW WORD Learner C 이민 , 이주 , Problem 출입국 관리소 √ Immigration Learner A Learner B Answer I was Correct Answer 이민 , 이주 , I was Wrong 출입국 관리소 Time limit 10 secs Learner C Learner D Register! 1DNQ Answer Your answer is submitted. Correct answer Learner D 이민 , 이주 , √ 출입국 관리소 I was Correct I was Wrong 32
1-Day-N-Questions 1DNQ This problem Workflow was... EASY Learner B NORMAL HARD Learner A Target study group Evaluation 1DNQ This problem 1DNQ was... EASY NEW WORD Learner C NORMAL Problem HARD Immigration Learner A Learner B Evaluation Answer 이민 , 이주 , 출입국 관리소 Time limit 10 secs Learner C Learner D Register! 1DNQ Evaluation This problem was... EASY Learner D NORMAL HARD 33
1-Day-N-Questions Task 1 Task 1. Making a new problem • Motivation: Adding a new problem (word, phrase) into my database plays a role in construction of a crowdsourced question pool. • A learner just wants to collect words in a workbook for memorization and review. • Learners don’t notice that they are making questions for others. Requirements • [Req 1-A] Our system must provide a submission form for a user to fill out or customize a problem (e.g., word, phrase, idiom, sentence, etc.). • [Req 1-B] Each problem (question) has to contain question maker’s real - name and time limit. • [Req 1-C] Our system must check the redundancy of written problems and filter out them in real-time. 34
Recommend
More recommend
