SlideShare une entreprise Scribd logo
1  sur  15
Dan Thompson
Coordinator of Instructional Design, Assessment, and
Educational Technology
Oklahoma State University Center for Health Sciences
Session Objectives
 At the completion of this session,
participants will be able to:
 Describe category mapping and how to
appropriately use this feature in curriculum
mapping for accreditation
 Utilize category mapping to appropriately align
assessment items with necessary accreditation
requirements
 Create a simple categorization process that is
conducive for curricular mapping to assist in
meeting accreditation needs
What are Categories?
 Each item in ExamSoft can be tagged to
categories that will allow us to identify the
exact subject matter, difficulty level (ex.
Bloom’s), author, instructional method
implemented, style of question, learning
objective(s) being assessed, etc.
 Items can be placed into an unlimited number of
categories
 Stats can be acquired based on each
category to learn the desired information.
How to Categorize
Questions
 Questions can be easily categorized when the question
is being created in ExamSoft
 Questions that have already been created and used in
assessments can be categorized as well
 Statistical analyses of these questions can be done
retroactively
 Categories should be pre-made, which will allow
question creators to simply click on the categories and
add them for each question
 Categories work as a folder structure if needed
 Very helpful in staying organized in curricular mapping and
preparing for accreditation!
Faculty/Staff Roles for
Curricular Mapping
 Primary item categorization in the system is
completed by instructional design staff
 Faculty and academic support staff contribute
to this effort as well
 **Recommendation: create a process first and
limit the number of individuals that work with
this process.
○ Improves consistency and program organization
Faculty/Staff Roles for Curricular
Mapping
 Content experts are needed for this process
as assessment items need to be matched to
learning objectives
 Assessment items can be mapped to more than
one learning objective if applicable
 Category statistics are monitored and
reviewed to assure program effectiveness and
to identify areas for improvement
Categorization Structure
Methodology
 Systems-based curriculum
 For curricular mapping and in
preparation for accreditation, items
are categorized by:
 Discipline
○ Example: pharmacology, physiology, histology
○ Case-based clinical lectures/sessions and
clinical problem solving group sessions
○ Indicates that we address the content (by
quantity) in our curriculum appropriately
Categorization Structure
Methodology
 Items are also mapped to the learning
objectives they address
 Functions on two levels:
 Small scale:
○ Indicates that we are assessing our learning objectives
○ The mapped items can come from quizzes, exams, and/or
other assignments
○ Shows student outcomes by learning objective – are students
appropriately meeting the learning objectives and therefore
reaching our course goals? This allows us to prove that
statistically
Categorization Structure
Methodology
 Large scale:
 Completes the back end portion of the
curricular mapping for accreditation
 Throughout the curriculum mapping for
accreditation process, the focus is to
completely map the curriculum from the
beginning (program mission) to the end
(course assessments)
 This ties the process together and closes the
loop on curricular mapping for accreditation
Moving Forward
 Our categorizing of assessment items
with learning objectives is currently
growing
 Once completed, an overall view of how
we are meeting learning objectives (and
therefore course goals, program goals,
mission, etc) will be available
 This initiative is being continued after
receiving positive feedback
Tips/Tricks
 Begin this process as early as possible
 Establish the process before categorizing any
exam items
 Identify individual roles in the mapping process
 Create the folder structure in advance
○ *The folder structure can be altered, so this process can be
flexible to meet an evolving curriculum
 Be proactive – ask/require faculty to identify which
learning objectives their assessment items map to when
questions are entered into ExamSoft
 This was not done at our institution initially
 Retroactively categorizing items is an option, but is a more
difficult task
Unintended (Positive!)
Outcomes
 Created an opportunity to improve and
streamline our learning objectives to
improve communication with students
 Improved faculty knowledge in the
educational process – built in faculty
development!
Thank you!!
 Questions?
 Dan.thompson@okstate.edu

Contenu connexe

Tendances

Aligning Assessments to Course Outcomes
Aligning Assessments to Course OutcomesAligning Assessments to Course Outcomes
Aligning Assessments to Course OutcomesChristine Salmon
 
Formative and summative assessments presentation
Formative and summative assessments presentationFormative and summative assessments presentation
Formative and summative assessments presentationmalayyan
 
Formative and Summative Assessment
Formative and Summative AssessmentFormative and Summative Assessment
Formative and Summative AssessmentDr. Amjad Ali Arain
 
1)tenants of an effective assessment process
1)tenants of an effective assessment process 1)tenants of an effective assessment process
1)tenants of an effective assessment process JenniferLude1
 
Curriculum Evaluation
Curriculum Evaluation Curriculum Evaluation
Curriculum Evaluation Bari Berger
 
3)Assessment Plan Components
3)Assessment Plan Components3)Assessment Plan Components
3)Assessment Plan ComponentsJenniferLude1
 
Erni types of evaluation
Erni  types of evaluationErni  types of evaluation
Erni types of evaluationYouise Saculo
 
Utilizing Assessment Data to Influence Curricular Decision-Making
Utilizing Assessment Data to Influence Curricular Decision-MakingUtilizing Assessment Data to Influence Curricular Decision-Making
Utilizing Assessment Data to Influence Curricular Decision-MakingExamSoft
 
Revising instructional material
Revising instructional materialRevising instructional material
Revising instructional materialKobieJones1
 
05 course design implementation phase
05 course design   implementation phase05 course design   implementation phase
05 course design implementation phaseDr. Chetan Bhatt
 
Program evaluation
Program evaluationProgram evaluation
Program evaluationYen Bunsoy
 
Program Evaluation
Program EvaluationProgram Evaluation
Program EvaluationBurhan Omar
 
Learning objectives and goals class session 3, 2017
Learning objectives and goals class session 3, 2017Learning objectives and goals class session 3, 2017
Learning objectives and goals class session 3, 2017tjcarter
 
501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluation501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluationKaWright1961
 

Tendances (20)

Aligning Assessments to Course Outcomes
Aligning Assessments to Course OutcomesAligning Assessments to Course Outcomes
Aligning Assessments to Course Outcomes
 
Methods of evaluation
Methods of evaluationMethods of evaluation
Methods of evaluation
 
Formative and summative assessments presentation
Formative and summative assessments presentationFormative and summative assessments presentation
Formative and summative assessments presentation
 
Formative and Summative Assessment
Formative and Summative AssessmentFormative and Summative Assessment
Formative and Summative Assessment
 
1)tenants of an effective assessment process
1)tenants of an effective assessment process 1)tenants of an effective assessment process
1)tenants of an effective assessment process
 
Curriculum Evaluation
Curriculum Evaluation Curriculum Evaluation
Curriculum Evaluation
 
3)Assessment Plan Components
3)Assessment Plan Components3)Assessment Plan Components
3)Assessment Plan Components
 
Erni types of evaluation
Erni  types of evaluationErni  types of evaluation
Erni types of evaluation
 
Ch. 12 powerpoint apt 501
Ch. 12 powerpoint apt 501Ch. 12 powerpoint apt 501
Ch. 12 powerpoint apt 501
 
Utilizing Assessment Data to Influence Curricular Decision-Making
Utilizing Assessment Data to Influence Curricular Decision-MakingUtilizing Assessment Data to Influence Curricular Decision-Making
Utilizing Assessment Data to Influence Curricular Decision-Making
 
Revising instructional material
Revising instructional materialRevising instructional material
Revising instructional material
 
Assessment
AssessmentAssessment
Assessment
 
Curriculum evaluation models
Curriculum evaluation modelsCurriculum evaluation models
Curriculum evaluation models
 
05 course design implementation phase
05 course design   implementation phase05 course design   implementation phase
05 course design implementation phase
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
 
Program Evaluation
Program EvaluationProgram Evaluation
Program Evaluation
 
Curriculum presentation
Curriculum  presentationCurriculum  presentation
Curriculum presentation
 
Learning objectives and goals class session 3, 2017
Learning objectives and goals class session 3, 2017Learning objectives and goals class session 3, 2017
Learning objectives and goals class session 3, 2017
 
501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluation501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluation
 
Assessment Template
Assessment TemplateAssessment Template
Assessment Template
 

En vedette

Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...Bilinguistics
 
Innovation Capabilities Assessment - Introduction
Innovation Capabilities Assessment - IntroductionInnovation Capabilities Assessment - Introduction
Innovation Capabilities Assessment - IntroductionJulian Keith Loren
 
Innovation Assessment Questionnaire
Innovation Assessment QuestionnaireInnovation Assessment Questionnaire
Innovation Assessment QuestionnaireBoardroom Metrics
 
The Recipe for High Converting Uberflip CTAs
The Recipe for High Converting Uberflip CTAsThe Recipe for High Converting Uberflip CTAs
The Recipe for High Converting Uberflip CTAsUberflip
 
15. Transactions in DBMS
15. Transactions in DBMS15. Transactions in DBMS
15. Transactions in DBMSkoolkampus
 
TCA CYCLE & ITS REGULATION
TCA CYCLE & ITS REGULATIONTCA CYCLE & ITS REGULATION
TCA CYCLE & ITS REGULATIONYESANNA
 
TCA cycle- steps, regulation and significance
TCA cycle- steps, regulation and significanceTCA cycle- steps, regulation and significance
TCA cycle- steps, regulation and significanceNamrata Chhabra
 
PowerPoint Tutorial Presentation - Tips & Tricks
PowerPoint Tutorial Presentation - Tips & TricksPowerPoint Tutorial Presentation - Tips & Tricks
PowerPoint Tutorial Presentation - Tips & TricksNiezette -
 

En vedette (11)

Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
Using Dynamic Assessment in Differential Diagnoses of Culturally and Linguist...
 
TCA
TCATCA
TCA
 
Innovation Capabilities Assessment - Introduction
Innovation Capabilities Assessment - IntroductionInnovation Capabilities Assessment - Introduction
Innovation Capabilities Assessment - Introduction
 
Innovation Assessment Questionnaire
Innovation Assessment QuestionnaireInnovation Assessment Questionnaire
Innovation Assessment Questionnaire
 
The Recipe for High Converting Uberflip CTAs
The Recipe for High Converting Uberflip CTAsThe Recipe for High Converting Uberflip CTAs
The Recipe for High Converting Uberflip CTAs
 
Primacy of categorical levels
Primacy of categorical levelsPrimacy of categorical levels
Primacy of categorical levels
 
15. Transactions in DBMS
15. Transactions in DBMS15. Transactions in DBMS
15. Transactions in DBMS
 
TCA CYCLE & ITS REGULATION
TCA CYCLE & ITS REGULATIONTCA CYCLE & ITS REGULATION
TCA CYCLE & ITS REGULATION
 
TCA cycle- steps, regulation and significance
TCA cycle- steps, regulation and significanceTCA cycle- steps, regulation and significance
TCA cycle- steps, regulation and significance
 
PowerPoint Tutorial
PowerPoint TutorialPowerPoint Tutorial
PowerPoint Tutorial
 
PowerPoint Tutorial Presentation - Tips & Tricks
PowerPoint Tutorial Presentation - Tips & TricksPowerPoint Tutorial Presentation - Tips & Tricks
PowerPoint Tutorial Presentation - Tips & Tricks
 

Similaire à Satisfying Accreditation Requirements Through Assessment Item Categorization

Educational assessment
Educational assessment Educational assessment
Educational assessment sonal patel
 
Lesson 3 Plan for teaching (2).ppt
Lesson 3  Plan for teaching (2).pptLesson 3  Plan for teaching (2).ppt
Lesson 3 Plan for teaching (2).pptMesfinShifara
 
Curriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluationCurriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluationDrGavisiddappa Angadi
 
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptxUNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptxElieser Sheya
 
Outcomnes-based Education
Outcomnes-based EducationOutcomnes-based Education
Outcomnes-based EducationCarlo Magno
 
Interrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbInterrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbRita Ndagire Kizito
 
Interrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionInterrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionRita Ndagire Kizito
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many facesleesha roberts
 
ALLAMA IQBAL OPEN UNIVERSITY, ISLAMABAD
ALLAMA IQBAL OPEN UNIVERSITY, ISLAMABADALLAMA IQBAL OPEN UNIVERSITY, ISLAMABAD
ALLAMA IQBAL OPEN UNIVERSITY, ISLAMABADKarin Faust
 
Unit 7 HIGHER EDUCATION CODE 8625
Unit 7 HIGHER EDUCATION CODE 8625Unit 7 HIGHER EDUCATION CODE 8625
Unit 7 HIGHER EDUCATION CODE 8625Zahid Mehmood
 
ASSESSMENT IN HIGHER EDUCATION-8625
ASSESSMENT IN HIGHER EDUCATION-8625ASSESSMENT IN HIGHER EDUCATION-8625
ASSESSMENT IN HIGHER EDUCATION-8625EqraBaig
 
Training &n Development Studies & Evaluation
Training &n Development Studies & EvaluationTraining &n Development Studies & Evaluation
Training &n Development Studies & EvaluationElsaCherian1
 
Role of objective Assessment and Evaluation
Role of objective Assessment and Evaluation  Role of objective Assessment and Evaluation
Role of objective Assessment and Evaluation munsif123
 
Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)Sheema Haider
 
Learning Outcomes Discussion
Learning Outcomes DiscussionLearning Outcomes Discussion
Learning Outcomes DiscussionLuke Dowden
 
Increasing Course Revision Efficacy
Increasing Course Revision EfficacyIncreasing Course Revision Efficacy
Increasing Course Revision EfficacySteven McGahan
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating AssessmentsChristina Sax
 

Similaire à Satisfying Accreditation Requirements Through Assessment Item Categorization (20)

Educational assessment
Educational assessment Educational assessment
Educational assessment
 
Lesson 3 Plan for teaching (2).ppt
Lesson 3  Plan for teaching (2).pptLesson 3  Plan for teaching (2).ppt
Lesson 3 Plan for teaching (2).ppt
 
Curriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluationCurriculum (formative & summative) evaluation
Curriculum (formative & summative) evaluation
 
Presentation: Assessments & Rubrics
Presentation: Assessments & RubricsPresentation: Assessments & Rubrics
Presentation: Assessments & Rubrics
 
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptxUNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
 
Outcomnes-based Education
Outcomnes-based EducationOutcomnes-based Education
Outcomnes-based Education
 
Interrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbInterrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionb
 
Interrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionInterrogating evaluation 2015 induction
Interrogating evaluation 2015 induction
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many faces
 
ALLAMA IQBAL OPEN UNIVERSITY, ISLAMABAD
ALLAMA IQBAL OPEN UNIVERSITY, ISLAMABADALLAMA IQBAL OPEN UNIVERSITY, ISLAMABAD
ALLAMA IQBAL OPEN UNIVERSITY, ISLAMABAD
 
Unit 7 HIGHER EDUCATION CODE 8625
Unit 7 HIGHER EDUCATION CODE 8625Unit 7 HIGHER EDUCATION CODE 8625
Unit 7 HIGHER EDUCATION CODE 8625
 
ASSESSMENT IN HIGHER EDUCATION-8625
ASSESSMENT IN HIGHER EDUCATION-8625ASSESSMENT IN HIGHER EDUCATION-8625
ASSESSMENT IN HIGHER EDUCATION-8625
 
Training &n Development Studies & Evaluation
Training &n Development Studies & EvaluationTraining &n Development Studies & Evaluation
Training &n Development Studies & Evaluation
 
Role of objective Assessment and Evaluation
Role of objective Assessment and Evaluation  Role of objective Assessment and Evaluation
Role of objective Assessment and Evaluation
 
Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)Triangulation in Teaching Assessment & learning Outcomes (2) (1)
Triangulation in Teaching Assessment & learning Outcomes (2) (1)
 
Learning Outcomes Discussion
Learning Outcomes DiscussionLearning Outcomes Discussion
Learning Outcomes Discussion
 
Unit 9-6503.pptx
Unit 9-6503.pptxUnit 9-6503.pptx
Unit 9-6503.pptx
 
VERSITIES_EYE_OPENER
VERSITIES_EYE_OPENERVERSITIES_EYE_OPENER
VERSITIES_EYE_OPENER
 
Increasing Course Revision Efficacy
Increasing Course Revision EfficacyIncreasing Course Revision Efficacy
Increasing Course Revision Efficacy
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating Assessments
 

Plus de ExamSoft

More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...ExamSoft
 
Creating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesCreating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesExamSoft
 
Psychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionPsychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionExamSoft
 
Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...ExamSoft
 
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...ExamSoft
 
Last Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterLast Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterExamSoft
 
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...ExamSoft
 
Check, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabCheck, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabExamSoft
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsExamSoft
 
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessUsing ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessExamSoft
 
Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research ExamSoft
 
Improve your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsImprove your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsExamSoft
 
Psychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouPsychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouExamSoft
 
From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...ExamSoft
 
What's in it for me-- said the student, faculty, and curriculum
 What's in it for me-- said the student, faculty, and curriculum What's in it for me-- said the student, faculty, and curriculum
What's in it for me-- said the student, faculty, and curriculumExamSoft
 
"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and CurriculumExamSoft
 
Closing the Loop on Clinical Competency Based Assessments
 Closing the Loop on Clinical Competency Based Assessments Closing the Loop on Clinical Competency Based Assessments
Closing the Loop on Clinical Competency Based AssessmentsExamSoft
 
Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities ExamSoft
 
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...ExamSoft
 
Stop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsStop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsExamSoft
 

Plus de ExamSoft (20)

More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...More Than Assessment: Using computer-based testing software to deliver instru...
More Than Assessment: Using computer-based testing software to deliver instru...
 
Creating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item TypesCreating Test Items Using NCLEX® Alternative Item Types
Creating Test Items Using NCLEX® Alternative Item Types
 
Psychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into actionPsychometrics 201: Putting assessment data into action
Psychometrics 201: Putting assessment data into action
 
Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...Programs Coming Together Using ExamSoft to assess interprofessional education...
Programs Coming Together Using ExamSoft to assess interprofessional education...
 
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
 
Last Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This SemesterLast Minute Tips to Positively Impact Your Students This Semester
Last Minute Tips to Positively Impact Your Students This Semester
 
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
 
Check, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation LabCheck, Check, Check in the Simulation Lab
Check, Check, Check in the Simulation Lab
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative Assessments
 
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan SuccessUsing ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft to Evaluate NCLEX Test Plan Success
 
Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research Using ExamSoft Rubrics to Assess Student Medical Research
Using ExamSoft Rubrics to Assess Student Medical Research
 
Improve your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing examsImprove your test item writing skills to help create better nursing exams
Improve your test item writing skills to help create better nursing exams
 
Psychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling YouPsychometrics 101: Know What Your Assessment Data is Telling You
Psychometrics 101: Know What Your Assessment Data is Telling You
 
From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...From Conception to Execution: Strategies for designing and implementing a com...
From Conception to Execution: Strategies for designing and implementing a com...
 
What's in it for me-- said the student, faculty, and curriculum
 What's in it for me-- said the student, faculty, and curriculum What's in it for me-- said the student, faculty, and curriculum
What's in it for me-- said the student, faculty, and curriculum
 
"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum"What's in it for me?" said the Student, Faculty, and Curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum
 
Closing the Loop on Clinical Competency Based Assessments
 Closing the Loop on Clinical Competency Based Assessments Closing the Loop on Clinical Competency Based Assessments
Closing the Loop on Clinical Competency Based Assessments
 
Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities Using Exam Data for Scholarly Activities
Using Exam Data for Scholarly Activities
 
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
 
Stop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on examsStop the cheating! best practices to minimize security risks on exams
Stop the cheating! best practices to minimize security risks on exams
 

Dernier

Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxVanesaIglesias10
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxCarlos105
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSJoshuaGantuangco2
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parentsnavabharathschool99
 
Food processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture honsFood processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture honsManeerUddin
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 

Dernier (20)

Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptx
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parents
 
Food processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture honsFood processing presentation for bsc agriculture hons
Food processing presentation for bsc agriculture hons
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 

Satisfying Accreditation Requirements Through Assessment Item Categorization

  • 1. Dan Thompson Coordinator of Instructional Design, Assessment, and Educational Technology Oklahoma State University Center for Health Sciences
  • 2. Session Objectives  At the completion of this session, participants will be able to:  Describe category mapping and how to appropriately use this feature in curriculum mapping for accreditation  Utilize category mapping to appropriately align assessment items with necessary accreditation requirements  Create a simple categorization process that is conducive for curricular mapping to assist in meeting accreditation needs
  • 3. What are Categories?  Each item in ExamSoft can be tagged to categories that will allow us to identify the exact subject matter, difficulty level (ex. Bloom’s), author, instructional method implemented, style of question, learning objective(s) being assessed, etc.  Items can be placed into an unlimited number of categories  Stats can be acquired based on each category to learn the desired information.
  • 4. How to Categorize Questions  Questions can be easily categorized when the question is being created in ExamSoft  Questions that have already been created and used in assessments can be categorized as well  Statistical analyses of these questions can be done retroactively  Categories should be pre-made, which will allow question creators to simply click on the categories and add them for each question  Categories work as a folder structure if needed  Very helpful in staying organized in curricular mapping and preparing for accreditation!
  • 5. Faculty/Staff Roles for Curricular Mapping  Primary item categorization in the system is completed by instructional design staff  Faculty and academic support staff contribute to this effort as well  **Recommendation: create a process first and limit the number of individuals that work with this process. ○ Improves consistency and program organization
  • 6. Faculty/Staff Roles for Curricular Mapping  Content experts are needed for this process as assessment items need to be matched to learning objectives  Assessment items can be mapped to more than one learning objective if applicable  Category statistics are monitored and reviewed to assure program effectiveness and to identify areas for improvement
  • 7. Categorization Structure Methodology  Systems-based curriculum  For curricular mapping and in preparation for accreditation, items are categorized by:  Discipline ○ Example: pharmacology, physiology, histology ○ Case-based clinical lectures/sessions and clinical problem solving group sessions ○ Indicates that we address the content (by quantity) in our curriculum appropriately
  • 8.
  • 9. Categorization Structure Methodology  Items are also mapped to the learning objectives they address  Functions on two levels:  Small scale: ○ Indicates that we are assessing our learning objectives ○ The mapped items can come from quizzes, exams, and/or other assignments ○ Shows student outcomes by learning objective – are students appropriately meeting the learning objectives and therefore reaching our course goals? This allows us to prove that statistically
  • 10. Categorization Structure Methodology  Large scale:  Completes the back end portion of the curricular mapping for accreditation  Throughout the curriculum mapping for accreditation process, the focus is to completely map the curriculum from the beginning (program mission) to the end (course assessments)  This ties the process together and closes the loop on curricular mapping for accreditation
  • 11.
  • 12. Moving Forward  Our categorizing of assessment items with learning objectives is currently growing  Once completed, an overall view of how we are meeting learning objectives (and therefore course goals, program goals, mission, etc) will be available  This initiative is being continued after receiving positive feedback
  • 13. Tips/Tricks  Begin this process as early as possible  Establish the process before categorizing any exam items  Identify individual roles in the mapping process  Create the folder structure in advance ○ *The folder structure can be altered, so this process can be flexible to meet an evolving curriculum  Be proactive – ask/require faculty to identify which learning objectives their assessment items map to when questions are entered into ExamSoft  This was not done at our institution initially  Retroactively categorizing items is an option, but is a more difficult task
  • 14. Unintended (Positive!) Outcomes  Created an opportunity to improve and streamline our learning objectives to improve communication with students  Improved faculty knowledge in the educational process – built in faculty development!
  • 15. Thank you!!  Questions?  Dan.thompson@okstate.edu