Student Item Analysis
Use Student Item Analysis to analyze a test by a student at the item level, and compare class performance to school and district performance. Before working with this report, you may want to read over the descriptions of the Summary Charts and Scores Tables to understand the displayed data.
|Primary Purpose||Guiding Questions|
|Displays a comprehensive overview of a test with an item-by-item, student-by-student breakdown.|
|Primary Users||Primary Uses|
Access Student Item Analysis
- From the main navigation menu, choose Reports, then Student Item Analysis.
Choose a Test Title.
Results only display for students to whom you have access and any tests in the menu that meet the following criteria:
- Honor any filters set for the school, teacher, course, or class
- Have been released
- Have generated and loaded student data
Click Additional Filters, then choose from the following options:
- Add Student Filter - Choose from the Student Filters to limit the student population. Setting filters for school, teacher, course, or class limits the test selection choices.
- Active Filters - Indicates the filters that are currently applied.
- Test Window - This filter is only available if the test had more than one test window. You can choose multiple test windows; however, if you choose only one, then the displayed results are from the most recent test window.
Correct a Response or Score
You can update student responses to correct scoring discrepancies. This is especially useful for interaction types like text entry, which may not have enough correct answer variations to capture all responses the teacher wants to count as correct.
To correct responses or scores, student response editing must be enabled for the test.
You must have Update permissions to the test to change this setting. This option is enabled by default for teachers who build a private test.
- In the Item Scores or Interaction Scores table, click the cell containing the score that needs to be updated.
- Click Edit Response.
Update the student response. If appropriate, this also updates the student's score.
Only machine-scored interaction types can be updated using this process. While responses to rubric-scored items may be editable, the score is not updated. Updates to rubric scores should be done using the scoring assignment for the test.
You must refresh your browser to review an updated score in the scores table.
Create a New Shared Report
- Click Save to create the shared report.
- Enter the Description.
- Click Save.
- If the information is correct, click Permissions.
- Click Add user or group.
- Add the individual users by name or add users by role. Click and hold the Control key on a PC, or the Command key on a Mac, to add multiple users or groups at once.
- Click OK.
Select permissions for each displayed group.
Assign Read access to the district to share this report with the entire district.
- Click Save.
- Click OK.
Export Results to Your Gradebook
You can export assessment results to your Gradebook account.
Before exporting assessment results, you must filter to a single class. You can only submit student scores for one class section at a time.
Gradebook is only available for teachers with access to PowerTeacher Pro or eSchoolPlus.
Enter the required information.
If the test has previously been sent to Gradebook, then all required attributes are auto-filled and disabled.
- Click Submit.
Summary Charts and Scores Tables
Reports include two primary sections: Summary Charts and Scores Tables.
You can choose from the following actions when reviewing Summary Charts and Scores Tables:
- Sorting - Click on a column header that includes a double-arrow to sort by that column.
- Export - Export the current display of the tables, honoring any filters selected.
- Click Excel to export a Microsoft Excel file with tabs for Item Scores and Interaction Scores, including full tables and color-coding.
- Click CSV to export a basic Interactions Scores table.
Opening the CSV file with Excel or another spreadsheet application may result in improper formatting of cell data. Format the cells as text for an appropriate overview of the data.
- Click Share to create a custom link that can be copied and shared with other users. The link includes any selected student filters.
Reviewing the content of a high-stakes test or any of its items requires a user to have high-stakes administrator permission. Only an administrator can assign high-stakes administrator permission to a user or group.
Hover over an item to review its statistics.
Summary Charts are organized into three tabs: Item Attributes, Performance Bands, and Item Detail.
The Item Attributes tab includes the standards assessed on the test and the percentage of students in each performance band assigned to that assessment.
Choose an attribute type to display a breakdown of the student percentage:
- Hover over a standard to display the full standard description.
- Click on a count to filter the results in the score table to only items with that attribute. Click again to clear the filter.
- The bars for % of Students are color-coded to match the test's performance bands. Hover over a section of the bar to display the count and percent details. Click on a section of the bar to filter the report by the students represented by that count for that attribute. Click again to remove the filter.
- Click a swatching box to include or exclude that performance band in the percentage value displayed in the column.
- A solid-filled box means the data for that color band is included. A partially filled box indicates data for that color band is excluded.
The value is the student percentage for all selected performance bands for each attribute.
Hover over an average to display the PE/PP (points earned / points possible).
Some districts may have Professional Development Platforms enabled.
Tests that use standards that are aligned to content from the platform have an icon next to the standard.
Click the Khan Academy icon to review the available Khan Academy content associated with the specific standard.
The stacked bar graph displays the overall performance band percentages using the test's performance band colors. Hover over a section to display details.
For teachers, this graph includes comparisons across student, school, and district performance. School and district-level users can display these comparisons by setting the school of enrollment and teacher filters.
If you use the school of instruction filter, all three bar graphs for comparison will not display. You must use the school of enrollment filter.
- Select the Performance Bands tab to review the student population percentage for each achievement level.
- The stacked bar graph displays the overall performance band percentages using the test's performance band colors. Hover over a section to display details.
- Select a section of the graph to filter the report by students in that performance band. Click the row again to clear the filter.
Select the Item Detail tab to review score or response distributions for individual test items, interactions, and rubrics.
- Click the item number in the header.
To display interaction choices distributions, click the bar chart icon.
The icon is only available for multiple-choice interactions
The bar chart provides an overview of all possible response scores for the selected item, interaction, or rubric. The graph also provides comparisons across student, school, and district performance. For multiple-choice interactions, the interaction choice displays the answer choice distribution).
- Hover over a bar to display the count and percentage details.
- Click on a bar to filter the report by students represented by that score.
- Choose from the display selector to switch item-level, interaction-level, or the rubric-level.
Another chart displays the overall percentage of points earned over points possible for the selected item.
- Hover over the sections of the outer ring to display the total number of students who answered correctly or incorrectly.
- Hover over the inner ring to display item details.
|Students||Total number of students scored for this item in the currently-selected population (based on any filters applied)|
|P-Value||Value of 0 to 1; indicates the degree of challenge for items based on the percentage of students who chose the correct answer|
|Item Discrimination||Value of -1 to 1; indicates the effectiveness of distractors and pinpoints possible misfits|
|Point Biserial||Value of -1 to 1; indicates how well the question tells the difference between high and low performers|
|Population||Total number of students scored for this item|
|PE||Total points earned for this item by the students in the currently-selected population (color-coded based on the test's performance band)|
|PP||Total points possible for this item by the students in the currently-selected population|
The Score Table includes up to three tabs: Interaction Scores, Item Scores, and Rubric Scores.
Rubric Scores only display if the test includes items that require manual scoring using a rubric.
Select the Interaction Scores, Item Scores, or Rubric Scores tab. If the test contains manually-scored interactions, select the Rubric Scores tab to review the breakdown of scores by rubric or scorer for the currently selected student population.
|Test Score %|
The header displays the overall test score for the student population.
Test points earned over the number of points available.
If a test contains sections, each section has a column.
|Interaction Number Columns|
|Item Number Columns|
Understand the Scores
|Interaction Scores||Items Scores||Rubric Scores|
If a column is blank and has the label n/a%, this is an item that has no student response because a teacher has not yet released this test section to the student, or the student has not completed the assessment, and the teacher has opened the test for online scoring.
Some items may have more than one interaction. The Student Item Analysis report allows you to review the overall score as well as the score per interaction.
|Items Scores||Interaction Scores|
|Click Item Scores to review the overall score for items. This is the total points earned for all interactions in the item. Click the cell to display all interactions and the student's responses.||Click Interaction Scores to review the score associated with each interaction. Click on any of the points earned cells to display all the interactions and the student's responses.|