Analyzing Assessment Data

 

Data from assessments can used to determine if learners are meeting course or learning outcomes. Assessments can be utilized in many ways, such as learner practice, learner self-assessment, determining readiness, determine grades, etc. The purpose of this assignment is to analyze sample test statistics to determine if learning has taken place.

To address the questions below in this essay assignment, you will need to use the information from your textbook chapter readings and the data provided in the “NUR-648E Sample Item Analysis” resource.

In a 1,000-1,250 word essay respond to the following questions:

1. Explain what reliability is and whether this test is reliable based on the “Sample Item Analysis” resource. What evidence supports your answer?
2. What trends are seen in the raw scores? How would an instructor use this information?
3. What is the range for this sample? What information does the range provide and why is it important?
4. What information does the standard error of measurement provide? Does the test have a small or large standard error of measurement? How would an instructor use this information?
5. Explain the process of analyzing individual items once an instructor has analyzed basic concepts of measurement.
6. If one of the questions on the exam had a p value of .100, would it be a best practice to eliminate the item? Justify your answer.
7. If one of the questions on the exam has a negative PBI for the correct option and one or more of the distractors have a positive PBI, what information does this give the instructor? How would you recommend that the instructor adjust this item?
8. Based on the “Sample Item Analysis” resource, what steps would you take to improve learning?  

Prepare this assignment according to the guidelines found in the APA Style Guide, located in the Student Success Center.

This assignment uses a rubric. Please review the rubric prior to beginning the assignment to become familiar with the expectations for successful completion. 

You are required to submit this assignment to LopesWrite. 

NUR-648E Sample Item Analysis

© 2021. Grand Canyon University. All Rights Reserved.

Rubic_Print_

Format

Criteria

9.0%

9.0%

9.0%

8.0%

8.0%

8.0%

Format 10.0%

5.0%

5.0%

Course Code	Class Code	Assignment Title	Total Points
NUR-648E	NUR-648E-O500	Analyzing Assessment Data	140.0
	Criteria	Percentage	1: Unsatisfactory (0.00%)	2: Less Than Satisfactory (80.00%)	3: Satisfactory (88.00%)	4: Good (92.00%)	5: Excellent (100.00%)	Comments	Points Earned
70.0%
Reliability				8.0%	Paper does not explain what reliability is and whether the test is reliable. Evidence to support claims is not present.	Paper explains what reliability is and whether the test is reliable. Evidence to support claims is present but lacks detail or is incomplete.	Paper explains what reliability is and whether the test is reliable. Evidence to support claims is present.	Paper explains what reliability is and whether the test is reliable. Evidence to support claims is well developed.	Paper explains what reliability is and whether the test is reliable in a comprehensive manner. Evidence to support claims is exceptional.
Trends in Raw Scores				9.0%	Paper does not explain trends in raw scores and explanation of how an instructor would use this information is not present.	Paper explains trends in raw scores and includes and explanation of how an instructor would use this information, but it lacks details or is incomplete.	Paper explains trends in raw scores. Explanation of how an instructor would use this information is present.	Paper explains trends in raw scores. Explanation of how an instructor would use this information is well developed.	Paper explains trends in raw scores in a comprehensive manner. Explanation of how an instructor would use this information is exceptional.
Range for Sample	Paper does not determine the range for the sample. Explanation of what information the range provides and why it is important is not present.	Paper determines the range for the sample. An explanation of what information the range provides and why it is important is present but lacks detail or is incomplete.	Paper determines the range for the sample. An explanation of what information the range provides and why it is important is present.	Paper determines the range for the sample. An explanation of what information the range provides and why it is important is well developed.	Paper determines the range for the sample. An explanation of what information the range provides and why it is important is thorough.
Standard Error of Measurement	Paper does not explain what standard error of measurement is and what the standard of measurement is for the sample data. Explanation of how the instructor would use this information is not present.	Paper explains what standard error of measurement is and what the standard of measurement is for the sample data but lacks detail or is incomplete. Explanation of how the instructor would use this information is present but lacks detail or is incomplete.	Paper explains what standard error of measurement is and what the standard of measurement is for the sample data. Explanation of how the instructor would use this information present.	Paper explains what standard error of measurement is and what the standard of measurement is for the sample data. Explanation for how the instructor would use this information is well developed.	Paper explains what standard error of measurement is and what the standard of measurement is for the sample data in a comprehensive manner. Explanation for how the instructor would use this information is exceptional.
Analyzing Individual Test Items	Paper does not explain analysis of individual test items.	Paper explains analysis of individual test items but lacks detail or is incomplete.	Paper explains analysis of individual test items.	Paper explains analysis of individual test items, and explanation is well developed.	Paper explains analyzing individual test items in a comprehensive manner.
p Value	Paper does not explain best practices on test items based on p value.	Paper explains best practices on test items based on p value but lacks detail or is incomplete.	Paper explains best practices on test items based on p value.	Paper explains best practices on test items based on p value, and explanation is well developed.	Paper explains best practices on test items based on p value in a comprehensive manner.
PBI	Paper does not explain information regarding PBI on the sample analysis provided or discuss what information it gives the instructor. Paper does not include recommendations for adjustments.	Paper explains information regarding PBI on the sample analysis provided and discusses what information it gives the instructor but lacks detail or is complete. Paper includes recommendations for adjustments but lacks detail or is incomplete.	Paper explains information regarding PBI on the sample analysis provided and discusses what information it gives the instructor. Paper includes recommendations for adjustments.	Paper explains information regarding PBI on the sample analysis provided, discusses what information it gives the instructor, and is well developed. Paper includes recommendations for adjustments, and explanations are well developed.	Paper explains information regarding PBI on the sample analysis provided, discusses what information it gives the instructor, and is thorough. Paper includes recommendations for adjustments in a comprehensive manner.
Improving Learning		10.0%	Paper does not include an explanation of what steps would be taken to improve learning.	Paper includes an explanation of what steps would be taken to improve learning but lacks detail or is incomplete.	Paper includes an explanation of what steps would be taken to improve learning.	Paper includes a well-developed explanation of what steps would be taken to improve learning.	Paper includes a thorough explanation of what steps would be taken to improve learning.
Organization and Effectiveness	20.0%
Thesis Development and Purpose	7.0%	Paper lacks any discernible overall purpose or organizing claim.	Thesis is insufficiently developed or vague. Purpose is not clear.	Thesis is apparent and appropriate to purpose.	Thesis is clear and forecasts the development of the paper. Thesis is descriptive and reflective of the arguments and appropriate to the purpose.	Thesis is comprehensive and contains the essence of the paper. Thesis statement makes the purpose of the paper clear.
Argument Logic and Construction	Statement of purpose is not justified by the conclusion. The conclusion does not support the claim made. Argument is incoherent and uses noncredible sources.	Sufficient justification of claims is lacking. Argument lacks consistent unity. There are obvious flaws in the logic. Some sources have questionable credibility.	Argument is orderly, but may have a few inconsistencies. The argument presents minimal justification of claims. Argument logically, but not thoroughly, supports the purpose. Sources used are credible. Introduction and conclusion bracket the thesis.	Argument shows logical progressions. Techniques of argumentation are evident. There is a smooth progression of claims from introduction to conclusion. Most sources are authoritative.	Clear and convincing argument that presents a persuasive claim in a distinctive and compelling manner. All sources are authoritative.
Mechanics of Writing (includes spelling, punctuation, grammar, language use)			5.0%	Surface errors are pervasive enough that they impede communication of meaning. Inappropriate word choice or sentence construction is used.	Frequent and repetitive mechanical errors distract the reader. Inconsistencies in language choice (register) or word choice are present. Sentence structure is correct but not varied.	Some mechanical errors or typos are present, but they are not overly distracting to the reader. Correct and varied sentence structure and audience-appropriate language are employed.	Prose is largely free of mechanical errors, although a few may be present. The writer uses a variety of effective sentence structures and figures of speech.	Writer is clearly in command of standard, written, academic English.
Paper Format (Use of appropriate style for the major and assignment)	Template is not used appropriately or documentation format is rarely followed correctly.	Template is used, but some elements are missing or mistaken; lack of control with formatting is apparent.	Template is used, and formatting is correct, although some minor errors may be present.	Template is fully used; There are virtually no errors in formatting style.	All format elements are correct.
Documentation of Sources (citations, footnotes, references, bibliography, etc., as appropriate to assignment and style)	Sources are not documented.	Documentation of sources is inconsistent or incorrect, as appropriate to assignment and style, with numerous formatting errors.	Sources are documented, as appropriate to assignment and style, although some formatting errors may be present.	Sources are documented, as appropriate to assignment and style, and format is mostly correct.	Sources are completely and correctly documented, as appropriate to assignment and style, and format is free of error.
Total Weightage	100%