Project Design and Evaluation

NOAA Coastal Services Center

DAY 1

Time

Topic, objectives, and activities

8:30

Introduction, workshop overview and objectives

Objectives: Know other participants, workshop objectives, logistics, and the importance of proper project design and evaluation.

8:55

Instructional Design Theory

Objectives: Understand the “big picture” of instructional design theory (what it is, what it entails). Correctly identify and describe the steps in the ADDIE Model.

9:25

Needs Assessment

Objectives: Describe where needs assessment fits in the process of program and project planning; state the benefits of conducting a needs assessment; state the 12-step process for conducting needs assessments; identify the goals and objectives of NAs and how these differ from project goals and objectives.

10:10

Break

10:25

Needs Assessment (continued)

Objectives: Conduct a preliminary audience characterization; know the difference between needs and wants. Know the 7 types of data collection instruments.

12:00

Lunch

1:00

Needs Assessment (continued)

Objectives: Discuss the considerations for data collection, analysis, and management that must be considered in planning an NA. Articulate when it may be appropriate to abbreviate the 12-step NA process, which steps may be left out, and the risks associated with skipping any of the steps.

1:35

Project Design Overview

Objectives: Describe the general steps of project design, including writing project goals and objectives. Develop a work structure that details requirements and coordination needed to complete project.

2:00

Break

2:15

Logic Models

Objectives: Know the components of a logic model. Create logic models for projects. Use logic models in the project design and evaluation process.

3:30

Project Design: goals and objectives

Objectives: Write SMART project objectives.

4:15

Review and wrap-up (exit survey)

Day 2

8:30

Review Day 1 and Preview of Day 2

Review exit survey. Review exit survey/discuss their use in formative evaluation.

9:00

Logic Models and SMART Objectives, continued

Review and revise logic models and objectives

9:25

Project Design, continued (Evaluation Design)

Objectives: Define the types of evaluation (formative and summative) that should be considered in the project design phase. Use a logic model to identify the appropriate points in the in the project design process for evaluation to take place.

9:50

Project Design, continued (Evaluation Design)

Objectives: Use a logic model to identify the appropriate points on the project design process for evaluation to take place and create an evaluation plan.

10:20

Break

10:35

Performance Measures

Objectives: Describe performance measures and their use. Explain the relationship between performance measurement and evaluation. Identify and select some performance measures for projects.

11:35

Project Development: Overview

Objectives: Discuss the steps in developing a project and the importance of building on the design phase.

12:00

Lunch

1:00

Project Development: Adult Learning

Objectives: Discuss experiential learning, adult learning theory, decision making models. Compare and contrast various adult learning theories (andragogy, conditions of learning, experiential learning, and constructionist theories). Participants will “teach” other workshop participants the various learning theories (andragogy, conditions of learning, experiential learning, and constructionist theories).

2:00

Break

2:35

Project Development: Adult Learning, continued

(group report outs)

3:00

Project Development: Method Selection and Sequencing

Objectives: Explain the steps in developing a project and the importance of building on the design phase. List considerations when selecting the most appropriate technique and materials.

3:45

Project Implementation

Objectives: State the components of project implementation. Discuss the application of NA results to implementation. Use performance measures as a formative evaluation tool during project implementation. Use formative and summative evaluations to determine if the project is meeting its objectives.

4:20

Wrap up (geometric shapes assessment)

Day 3

8:30

Review feedback comments, and Preview of Day 3

Ice-breaker activity: overhead/puzzle or quiz

9:00

Evaluation

Objectives: Explain the 5 levels of evaluation and how these apply to program design and delivery. Use the evaluation matrix to select the appropriate types and levels of evaluation for different project and activity types. Select the appropriate data collection methods and techniques for project evaluation.

9:50

Break

10:05

Evaluation (continued)

Objectives: Describe how to use various evaluation tools and techniques. Select the appropriate data collection methods and evaluation techniques for project evaluation.

10:50

Program Design and Evaluation

Objectives: Understand the relationships between agency, program, and project planning. Describe the difference and similarities between the program planning process and the project planning process.

11:15

Evaluation and Discussion of applications to participants’ projects

Objectives: Reflect and digest workshop materials. Apply concepts from workshop discussions and applications to other projects.

11:50

The End.