In order to receive pilot-related emails, participants should adjust email spam filters to allow all emails from and

2014 Pilot Information

  • Timeline



Posted: December 20, 2013
Last Updated: May 1, 2014

Here is an overview of the Comprehensive ASW Pilot process and timeline based on feedback from the Spring 2013 pilot and analysis by internal teams and sub-committees:

  • December 2013 – March 2014: Online training modules and webinars become available to participants. NCDPI will communicate more information on specific release dates as it becomes available.

  • Early to Mid-January: Teachers complete the ASW Submission Form on paper.* Teachers and principals (or his/her designee) meet and discuss the ASW Submission Form. The ASW Submission Form includes:
    • a description of the teaching context to include verification of the total number of students served and instructional hours scheduled for each class,
    • an outline of a representative sample of the classes taught by the teacher, and
    • 3 Clarifying Objectives (COs) from the content area’s North Carolina Essential Standards that are drawn from the local curriculum developed for classes based on the Standard Course of Study or other appropriate standards.

After teachers complete the ASW Submission Form, they may begin collecting student work around each objective which will eventually comprise the Timelapse Artifacts of their Evidence Collection.

* During full implementation in 2014-2015, this step will be completed via the online platform.
For the pilot, Teachers will choose 3 COs that encompass the strands and/or Essential Standards across the representative sample of classes in the teaching assignment each year. During full implementation, Teachers will choose 5 COs.

  • Mid-January – May 12: Using the completed ASW Submission Form, teachers will choose student work samples for their ASW Evidence Collection, which will contain a maximum of 3 Timelapse Artifacts.*
    • A single Timelapse Artifact is comprised of two student work samples or evidences that show student learning at two different points in time (pre and post).
    • Teachers have two options for completing the Timelapse Artifact(s) related to a single objective:
      • Individual: Teachers collect pre and post evidence samples for all individual students in the class.
      • Whole Class: The teacher may choose to collect one pre and post evidence sample of the entire class (i.e. video of a choir or dance group, photographs of a whole class project
    • Evidences can be any kind of uploadable file(s), as specified with parameters for the online platform, that convey meaningful and authentic student learning in the classroom.
    • The two evidences that encompass a Timelapse Artifact should demonstrate growth from the same student or group in relationship to the identified Clarifying Objective.
    • Details in narrative format about the evidences in each Timelapse Artifact will be added to the ASW Submission Form.
    • If needed, supporting document(s) may be linked to the narrative (i.e. dance notation, sheet music, scoring rubrics, event program, excerpts of published works, play diagram, etc.).

*During full implementation in 2014-2015, Teachers will submit 5 Timelapse Artifacts.

  • May 12 – June 6: Teachers will access the online platform to enter the information from their ASW Submission Form. During full implementation, teachers will directly input their teaching context into the online platform at the beginning of the process. They will no longer need to complete the Submission Form on paper.

  • May 12: Teachers will receive a random sample of students for whom they must upload Timelapse Artifacts to the online platform.
    • The online platform will randomly identify 3 students for each objective chosen by the teacher. The teacher will submit a pre and post sample of student work on each of those students.*
    • Teachers may submit a single “whole class” Timelapse Artifact instead of individual samples.
    • If a student was not present for instruction or is no longer in the class, the teacher may request (with principal approval) that the platform identify a new student to replace the one who was not present for the instruction.

**Each teacher’s annual Evidence Collection should be archived at the LEA level for 3 years following the time when it is included in the 3-year rolling average for determination of the effectiveness status

  • May 12 – June 6: Teachers upload their entire Evidence Collections to the online platform .
    • The online platform will be secure and utilize a unique identifier for each teacher so that a blind review can be conducted, allowing for a reviewer to see the ASW Submission Form and Evidence Collection without viewing the teacher’s name, district or school.
    • Teachers will receive a predetermined amount of space per Evidence Collection so that teachers can upload a maximum of 3 Timelapse Artifacts.
    • Teachers will receive progress updates during the submission process and a final notification from the online platform when all components of each Timelapse Artifact have been successfully submitted and are ready for review.

  • June 9 – July 11: Reviewers will access the online platform to evaluate the Evidence Collections submitted by teachers in their content area.
    • Reviewers will be:
      • chosen for each content area through an application process, with additional applications submitted on an ongoing basis to ensure that an adequate number of trained reviewers are available each year.
      • trained each year on the content agnostic components of the ASW process and then in content-specific groups to ensure their preparedness to objectively rate Timelapse Artifacts.
    • Two Reviewers will separately conduct the blind reviews on an Evidence Collection which has been automatically matched to their content expertise by the online platform.
    • The Reviewers will assign individual ratings of “Does Not Meet,” “Meets,” or “Exceeds Expected Growth” to each Timelapse Artifact and an overall rating to the Evidence Collection.
    • Following the blind reviews, the online platform will compare the ratings from both Reviewers for the Evidence Collection. If the two ratings match, the review process is complete. If the two ratings do not match, a third blind review will be automatically triggered by the online platform.

2014-2015: NCDPI rolls out ASW statewide as the Standard 6 measure for designated content areas. Teachers in these areas will receive their first year of individual Standard 6 data. A 3-year rolling average of individual growth data from Standard 6 combines with ratings from NCEES Standards 1 – 5 to determine an educator’s overall effectiveness status.

Note: The appeals process for Standard 6 will be handled locally, as is done with Standards 1 -5. Guidance will be provided by Educator Effectiveness for how this can be done for all Standard 6 Measures of Student Learning.