Auto-grading for 3D Modeling Assignments in MOOCs Swapneel Mehta - PowerPoint PPT Presentation

Auto-grading for 3D Modeling Assignments in MOOCs Swapneel Mehta Nitin Ayer Chirag Raman Sameer Sahasrabudhe

Motivation 2

SKANI101XA Basic 3D Animation Using Blender Introductory course on 3D animation Motivation User Workflows Proposed System Summary 3

SKANI101XA Basic 3D Animation Using Blender Introductory course on 3D animation The course has been offered five times with an average of ~ 4000 enrolled students! Motivation User Workflows Proposed System Summary 4

SKANI101XA Basic 3D Animation Using Blender Introductory course on 3D animation The course has been offered five times with an average of ~ 4000 enrolled students! Assignments include generating simple 3D models Motivation User Workflows Proposed System Summary 5

Modeling Assignment A drill activity early in the course to demonstrate basic concepts of face selection and extrusion The intention is for the students to exactly follow the steps of the drill Motivation User Workflows Proposed System Summary 6

Modeling Assignment Motivation User Workflows Proposed System Summary 7

Modeling Assignment Motivation User Workflows Proposed System Summary 8

Modeling Assignment Motivation User Workflows Proposed System Summary 9

Modeling Assignment Motivation User Workflows Proposed System Summary 10

General Errors Incomplete Model! Motivation User Workflows Proposed System Summary 11

General Errors Incomplete Primitive! - Cube instead of Torus Motivation User Workflows Proposed System Summary 12

Motivation Around 25% of the students submit the first assignment Submissions are .blend files, not images Motivation User Workflows Proposed System Summary 13

Motivation Around 25% of the students submit the first assignment Submissions are .blend files, not images Grading is a resource intensive task! Motivation User Workflows Proposed System Summary 14

Typical User Workflows 15

IITBombayX Motivation User Workflows Proposed System Summary 16

IITBombayX Students Motivation User Workflows Proposed System Summary 17

IITBombayX Students Instructors Motivation User Workflows Proposed System Summary 18

IITBombayX Content Management System Students Instructors Motivation User Workflows Proposed System Summary 19

IITBombayX Content Management System Students Coursework Instructors Motivation User Workflows Proposed System Summary 20

IITBombayX Learning Content Management Management System System Students Instructors Motivation User Workflows Proposed System Summary 21

IITBombayX Learning Content Assignment Management Management System System Students Instructors Motivation User Workflows Proposed System Summary 22

IITBombayX Submissions (.blend) Learning Content Management Management System System Students Instructors Motivation User Workflows Proposed System Summary 23

IITBombayX Submissions (.blend) Learning Content Management Management System System Students Instructors Motivation User Workflows Proposed System Summary 24

IITBombayX IITBombayX Submissions (.blend) Learning Content Management Management System System Students Submissions Instructors Motivation User Workflows Proposed System Summary 25

IITBombayX Learning Content Management Management System System Students Assessments Instructors Motivation User Workflows Proposed System Summary 26

IITBombayX Learning Content Management Management System System Students Assessments Instructors Motivation User Workflows Proposed System Summary 27

IITBombayX Learning Content Assessments Management Management System System Students Assessments Instructors Motivation User Workflows Proposed System Summary 28

Proposed System Auto-grading for 3D Modeling Assignments in MOOCs 29

Auto-grader IITBombayX Learning Content Management Management Students System System Instructors Motivation User Workflows Proposed System Summary 30

Auto-grader IITBombayX Rubric Learning Content Management Management Students System System Instructors Motivation User Workflows Proposed System Summary 31

Auto-grader IITBombayX Rubric Submission Learning Content Management Management Students System System Instructors Motivation User Workflows Proposed System Summary 32

Auto-grader IITBombayX Submission Rubric Submission Learning Content Management Management Students System System Instructors Motivation User Workflows Proposed System Summary 33

Auto-grader IITBombayX Submission Rubric Learning Content Management Management Students System System Comparer Instructors Motivation User Workflows Proposed System Summary 34

Auto-grader IITBombayX Submission Rubric Learning Content Management Management Students System System Comparer Assessor Instructors Motivation User Workflows Proposed System Summary 35

Auto-grader IITBombayX Submission Rubric Learning Content Management Management Students System System Comparer Assessor Instructors Motivation User Workflows Proposed System Summary 36

Auto-grader IITBombayX Submission Rubric Learning Content Assessments Management Management Students System System Comparer Assessor Instructors Motivation User Workflows Proposed System Summary 37

Comparer Attributes extracted from the .blend files 01 | Object Placement (Location, Rotation) 02 | Polygon Count 03 | Number of Objects 04 | Additional Free Parameter Motivation User Workflows Proposed System Summary 38

Comparer Implemented as a Python script using the Blender 3D API Motivation User Workflows Proposed System Summary 39

Assessor - Grading Policy Generates assessments and feedback from the Comparer output using instructor specified grading policy ATTRIBUTE 1 0 Object Placement At origin, identity rotation Otherwise Polygon Count 576 +/- 100 Otherwise Number of Objects 1 Otherwise Additional Parameter (Type) Torus Otherwise Motivation User Workflows Proposed System Summary 40

Assessor Grades are assigned as an ordinal score in the range [0, 5] Motivation User Workflows Proposed System Summary 41

Assessor Grades are assigned as an ordinal score in the range [0, 5] FUTURE EXTENSIONS: Perform direct mesh-based evaluation ● Provide customized feedback ● Motivation User Workflows Proposed System Summary 42

Assessor Motivation User Workflows Proposed System Summary 43

Summary 44

Introduced a stand-alone auto-grading module that incorporates an instructor defined rubric for the automatic assessment of submitted 3D modeling assignments Motivation User Workflows Proposed System Summary 45

Future directions include integration with LTI tools, incorporating an intelligent sub-module for direct mesh-based evaluation, and providing customized feedback Motivation User Workflows Proposed System Summary 46

Thank you! Questions? 47