- From: W3C Community Development Team <team-community-process@w3.org>
- Date: Sat, 18 Oct 2014 07:46:46 +0000
- To: public-owled@w3.org
I was a bit late, but here we go! Chris Mungal asked yesterday for a link to the papers and/or slides. Here's the link to proceedings: http://ceur-ws.org/Vol-1265/ I'll try to go back and link through directly and call for slides. Tahani Alsubait, Bijan Parsia and Uli Sattler. Generating Multiple Choice Questions From Ontologies: Lessons Learnt presented by Tahani What is a MCQ and it's parts (stem, key, distractors) Example of good and bad distractors. What makes a good one: Item response theory: Tuned difficulty, low guess ability, and right discrimination. MCQ generation is difficult and time consuming and you need a lot of them (exam coverage, security, and practice exams). Automation! Difficulty prediction. Needed to increase validity and exam quality. People are bad at it. Similarly conjecture (degree of similarity between keys and distractors is proportional to difficulty). Existing measures didn't work so we developed new ones (see ISWC poster). Key questions: Can we control difficulty? Can we generate exams? Is it cost effective? Experiment description: 1) Build ontology. 2) Generate questions. 3) Expert (3 -- Two instructors and one domain expert) review. 4) Test with students. Two rounds of student tests (in review session and online). Usefulness rating: High heterogenity (only 1 question agreed upon by all reviewers). Distractor utility: For all 6 questions, 2 out of 3 distractor. 5 out of 6 questions the key was picked more frequently than the distractors. Discrimination: in class better than online Difficulty: 4 out of 6 correctly predicted by tool. Check out the tool: http://edutechdeveloper.com/MCQGen QA QUESTION: About reusability: Often the labels are general and not specific for domains, so may not be suitable. I.e., reusability in general might hurt applicability. Catherine Chavula and C. Maria Keet. Is Lemon Sufficient for Building Multilingual Ontologies for Bantu Languages? presented by Maria. ---------- This post sent on OWL: Experiences and Directions Community Group 'OWLED 2014: Day 2 LiveBlogging' http://www.w3.org/community/owled/2014/10/18/owled-2014-day-2-liveblogging/ Learn more about the OWL: Experiences and Directions Community Group: http://www.w3.org/community/owled
Received on Saturday, 18 October 2014 07:46:47 UTC