What is the timeline for project completion? The process of asking these questions is often part of a needs analysis. During the needs analysis instructional designers (IDs) will determine constraints and resources in order to fine tune their plan of action. Design phase The design phase deals with learning objectives, assessment instruments, exercises, content, subject matter analysis, lesson planning, and media selection. The design phase should be systematic and specific. Systematic means a logical, orderly method that identifies, develops, and evaluates a set of planned strategies for attaining project goals. Specific means the team must execute each element of the instructional design plan with attention to detail. The design phase may involve writing a design document/design proposal or concept and structure note to aid final development. Development phase In the development phase, instructional designers and developers create and assemble content assets described in the design phase. If e-learning is involved, programmers develop or integrate technologies. Designers create storyboards. Testers debug materials and procedures. The team reviews and revises the project according to feedback. After completing the development of the course material, the designers should conduct an imperative pilot test; this can be carried out by involving key stakeholders and rehearsing the course material. Implementation phase The implementation phase develops procedures for training facilitators and learners. Training facilitators cover the course curriculum, learning outcomes, method of delivery, and testing procedures. Preparation for learners includes training them on new tools (software or hardware) and student registration. Implementation includes evaluation of the design. Evaluation phase The evaluation phase consists of two aspects: formative and summative. Formative evaluation is present in each stage of the ADDIE process, while summative evaluation is conducted on finished instructional programs or products. Donald Kirkpatrick's Four Levels of Learning Evaluation are often utilized during this phase of the ADDIE process. Other versions Some institutions have modified the ADDIE model to meet specific needs. For example, the United States Navy created a version they call PADDIE+M. The P phase is the planning phase, which develops project goals, project objectives, budget, and schedules. The M phase is the maintenance phase, which implements life cycle maintenance with continuous improvement methods. This model is gaining acceptance in the United States government as a more complete model of ADDIE. Some organizations have adopted the PADDIE model without the M phase. Pavlis Korres (2010), in her instructional model (ESG Framework), has proposed an expanded version