Skip to main content
Skip table of contents

Student item analysis

Use the Student Item Analysis report to analyze a test by a student at the item level, and compare class performance to school and district performance. Analysis data is displayed using summary charts and scores tables.

Primary Users

Primary Uses

Guiding Questions

  • Teachers

  • School Administrators

  • Record test scores in a grade book.

  • Determine how students did on each question.

  • Review the correct and incorrect answers with students.

  • Identify areas of weakness and remediation needs.

  • Which questions or standards did the students do well on?

  • What are the areas of strength for my students? Weakness?

  • Which questions did most students get incorrect?

  • Was there a common incorrect response for troublesome questions?

  • How did my students perform according to the performance bands?

  • What were the overall results of the test?

  • How did my class perform compared to the school? Compared to the district?

  • How can I use data from assessments to develop my SLO/SGO goals?

Access student item analysis

Results only display for students to whom you have access and tests that meet the following criteria:

  • Honor any filters set for the school, teacher, course, or class

  • Have been released

  • Have generated and loaded student data

  1. From the main navigation menu, choose Reports, then Student Item Analysis.

  2. Choose a Test Title.

    • Test selection:

      • honors filters set for the school, teacher, course, or class

      • only includes released tests

      • includes only those with generated and loaded student data

Filter options

Click Additional Filters, then choose from the following options:

  • Add Student Filter - Choose from the Student Filters to limit the student population. Setting filters for school, teacher, course, or class limits the test selection choices.

    • Active Filters - Indicates the filters that are currently applied.

    • Test Window - This filter is only available if the test had more than one test window. You can choose multiple test windows; however, if you choose only one, then the displayed results are from the most recent test window.

Correct a response or score

You can update student responses to correct scoring discrepancies. This is especially useful for interaction types like text entry, which may not have enough correct answer variations to capture all responses the teacher wants to count as correct.

To correct responses or scores, student response editing must be enabled for the test.

To change this setting, you must have Update permissions to the test. This option is enabled by default for teachers who build a private test.

  • In the Item Scores or Interaction Scores table, click the cell containing the score that needs to be updated.

    • Click Edit Response.

    • Update the student response. If appropriate, this also updates the student's score.

      Only machine-scored interaction types can be updated using this process. While responses to rubric-scored items may be editable, the score is not updated. Updates to rubric scores should be done using the scoring assignment for the test.

    • Click Save.

You must refresh your browser to review an updated score in the scores table.

Create a new shared report

  1. Click Save to create the shared report.

  2. Enter the Description.

  3. Click Save.

  4. If the information is correct, click Permissions.

  5. Click Add user or group.

  6. Add the individual users by name or add users by role. Click and hold the Control key on a PC, or the Command key on a Mac, to add multiple users or groups at once.

  7. Click OK.

  8. Select permissions for each displayed group.

    Assign Read access to the district to share this report with the entire district.

  9. Click Save.

  10. Click OK.

Export results to your gradebook

You can export assessment results to your Gradebook account.

Before exporting assessment results, you must filter to a single class. You can only submit student scores for one class section at a time.

Gradebook is only available for teachers with access to PowerTeacher Pro or eSchoolPlus.

  1. Click Gradebook.

  2. Enter the required information.
    If the test has previously been sent to Gradebook, then all required attributes are auto-filled and disabled.

  3. Click Submit.

Summary charts and scores tables

Reports include two primary sections: Summary Charts and Scores Tables.

A screenshot that displays the Summary Charts and Scores Table.

You can choose from the following actions when reviewing Summary Charts and Scores Tables:

  • Sorting - Click on a column header that includes a double-arrow to sort by that column.

    • Export - Export the current display of the tables, honoring any filters selected.

      • Click Excel to export a Microsoft Excel file with tabs for Item Scores and Interaction Scores, including full tables and color-coding.

      • Click CSV to export a basic Interactions Scores table.

Opening the CSV file with Excel or another spreadsheet application may result in improper formatting of cell data. Format the cells as text for an appropriate overview of the data.

  • Click Share to create a custom link that can be copied and shared with other users. The link includes any selected student filters.

Reviewing the content of a high-stakes test or any of its items requires a user to have high-stakes administrator permission. Only an administrator can assign high-stakes administrator permission to a user or group.

Hover over an item to review its statistics.

Summary charts

Summary Charts are organized into three tabs: Item Attributes, Performance Bands, and Item Detail.

Item attributes

The Item Attributes tab includes the standards assessed on the test and the percentage of students in each performance band assigned to that assessment.

Choose an attribute type to display a breakdown of the student percentage:

  • Hover over a standard to display the full standard description.

    • Click on a count to filter the results in the score table to only items with that attribute. Click again to clear the filter.

    • The bars for % of Students are color-coded to match the test's performance bands. Hover over a section of the bar to display the count and percent details. Click on a section of the bar to filter the report by the students represented by that count for that attribute. Click again to remove the filter.

    • Click a swatching box to include or exclude that performance band in the percentage value displayed in the column.

      • A solid-filled box means the data for that color band is included. A partially filled box indicates data for that color band is excluded.

      • The value is the student percentage for all selected performance bands for each attribute.

    • Hover over an average to display the PE/PP (points earned / points possible).

An image of the item attributes tab.

Some districts may have Professional Development Platforms enabled.

Tests that use standards that are aligned to content from the platform have an icon next to the standard.

The stacked bar graph displays the overall performance band percentages using the test's performance band colors. Hover over a section to display details.

For teachers, this graph includes comparisons across student, school, and district performance. School and district-level users can display these comparisons by setting the school of enrollment and teacher filters.

If you use the school of instruction filter, all three bar graphs for comparison will not display. You must use the school of enrollment filter.


Performance bands

  • Select the Performance Bands tab to review the student population percentage for each achievement level.

    • The stacked bar graph displays the overall performance band percentages using the test's performance band colors. Hover over a section to display details.

    • Select a section of the graph to filter the report by students in that performance band. Click the row again to clear the filter.

Item detail

  • Select the Item Detail tab to review score or response distributions for individual test items, interactions, and rubrics.

    • Click the item number in the header.

    • To display interaction choices distributions, click the bar chart icon. Only available for multiple choice interactions.

The bar chart provides an overview of all possible response scores for the selected item, interaction, or rubric. The graph also provides comparisons across student, school, and district performance. For multiple-choice interactions, the interaction choice displays the answer choice distribution).

  • Hover over a bar to display the count and percentage details.

    • Click on a bar to filter the report by students represented by that score.

    • Choose from the display selector to switch between item-level, interaction-level, and rubric-level.

Another chart displays the overall percentage of points earned over the points possible for the selected item.

  • Hover over the sections of the outer ring to display the total number of students who answered correctly or incorrectly.

    • Hover over the inner ring to display item details.

Data Point

Description

Students

Total number of students scored for this item in the currently selected population (based on any filters applied)

P-Value

Value of 0 to 1; indicates the degree of challenge for items based on the percentage of students who chose the correct answer

Item Discrimination

Value of -1 to 1; indicates the effectiveness of distractors and pinpoints possible misfits

Point Biserial

Value of -1 to 1; indicates how well the question tells the difference between high and low performers

Population

Total number of students scored for this item

PE

Total points earned for this item by the students in the currently selected population (color-coded based on the test's performance band)

PP

Total points possible for this item by the students in the currently selected population

This report includes several item statistics.

Score tables

The Score Table includes up to four tabs: Interaction Scores, Item Scores, Rubric Scores, and Item Engaged Duration.

Rubric Scores only display if the test includes items that require manual scoring using a rubric.


Select the Interaction Scores, Item Scores, Rubric Scores, or Item Engaged Duration tab. If the test contains manually scored interactions, select the Rubric Scores tab to review the breakdown of scores by rubric or scorer for the currently selected student population.

Column

Details

Student Name

  • Click a student's name to navigate to the Student Detail Report.

    • If the student took the test using a scan sheet, click the scan sheet to display a copy of the answer sheet.

Test Score %

The header displays the overall test score for the student population.

  • Hover over the header score to display the student population count, overall points earned, overall points possible, and Cronbach's alpha score.

  • Click the play icon to display the student's test and responses. Click Download in the preview to download a copy.

PE/PP

Test points earned over the number of points available.

  • Cells are color-coded based on the test's performance band.

    • PP is calculated by adding all Points Possible of all scored items. Rubric-scored items must be human-scored before they are included in the score.

    • Colors are applied to the PE/PP column according to the sections completed and scored. For an online assessment, the column remains blank if any extended text, draw, or upload items are not yet scored.

Colors are applied for Answer Key Only tests regardless if rubric-scored items have been scored. Once rubric-scored items are scored, the color changes.

Section %

If a test contains sections, each section has a column.

  • Hover over any student score to display their points earned out of the total points possible.

    • Cells are color-coded based on the test's performance band.

Interaction Number Columns

  • Hover over an item number to display additional details.

    • Click on the play icon in the header to preview the item.

    • To display item score distributions, click the item number in the interaction's header.

    • To display interaction choices distributions for multiple-choice interactions, click the bar chart icon in the header.

    • Click the plot graph icon to display its Test Statistics report.

    • Student responses to choice interactions display in circles. Scores for text response display in squares. All other interactions only display the score.

    • Hover over any score within a square to review the student response.

    • Click an interaction response or score to display the item and response for that student.

Item Number Columns

  • Hover over an item number to display additional details.

    • To display the Item Details, click the bar chart icon.

    • Click the play icon in the header to preview the item.

    • Click the plot graph icon to display its Test Statistics report.

    • Click on interaction score to display the item and response for that student.

Rubric Columns

  • Hover over an item number to display additional details.

    • Click on the play icon in the header to preview the item.

    • To display item score distributions, click the item number in the interaction's header.

    • To display rubric scores distributions, click the bar chart icon in the header.

    • Click the plot graph icon to display its Test Statistics report.

    • The cells display the rubrics associated with each item, denoted by a "g" for the group number and an "r" for the rubric number.

    • Multiple columns for an item indicate the item is associated with multiple rubrics.

    • Multiple scores within a column indicate that more than one person scored the rubric.

    • Hover over a rubric number to display the rubric name and description.

    • Hover over a rubric score to display the score description.

    • Click on a rubric score to display the item, full rubric, and response for that student.

Item Engaged Duration

  • Duration is displayed only for students who have completed the test.

    • Displays the duration of time the student was engaged with each item.

    • The header displays the average time all students spent on each item.

    • Select CSV or Excel to download.

Understand the scores

Interaction scores

An image of the interaction scores.

Key

Interaction Type

Response/ Score

A

Multiple Choice

Incorrect response- no credit

B

Multiple Choice

Correct response- full credit

C

Multiple Choice

No response- no credit

D

Rubric Scored Item

Not scored- not factored into the score

E

Rubric Scored Item

Scored- partial credit

F

Rubric Scored Item

Scored- no credit

G

Rubric Scored Item

Scored- full credit

H

Interaction other than Multiple Choice

Incorrect response- no credit

I

Interaction other than Multiple Choice

Correct response- full credit

Items scores

A screenshot of an item score.

Key

Response

Score

A

Correct

Full Credit

B

Incorrect

No Credit

C

Not Scored

Not factored into the score

D

Partially Correct

Partial Credit

Rubric scores

An image displays the rubric scores.

Key

Response

Score

A

Correct

Full points awarded

B

Partially Correct

Partial points awarded

C

Incorrect

No points awarded

If a column is blank and has the label n/a, this is an item that has no student response because a teacher has not yet released this test section to the student, or the student has not completed the assessment, and the teacher has opened the test for online scoring.


Multi-Part Items

Some items may have more than one interaction. The Student Item Analysis report allows you to review the overall score as well as the score per interaction.

Item scores

Click Item Scores to review the overall score for items. This is the total points earned for all interactions in the item. Click the cell to display all interactions and the student's responses.

An image of item scores depicts the first question was answered incorrectly, the second question was answered partially correct, and the third question was answered correctly.

Key

Response

Score

A

Incorrect

No Credit

B

Partially Correct

Partial Credit

C

Correct

Full Credit

Interaction scores

Click Interaction Scores to review the score associated with each interaction. Click on any of the points earned cells to display all the interactions and the student's responses.

An image of interaction scores depicts that both interactions for the first question were answered incorrectly, only one interaction for the second question was answered correctly, and both interactions for the third question were answered correctly.

Key

Response

Score

A

Incorrect

No credit for either part

B

Partially Correct

Credit for the correct part

C

Correct

Credit for both parts

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.