week 14

Reading for this week 

2. Read: Chapter 7 (Level 4: Impact and ROI)

https://books.google.com/books?id=GqIOVVis8yYC&printsec=frontcover&dq=Evaluation+Basics+#v=onepage&q=Evaluation%20Basics&f=false

3. Read: Level 4 Training Evaluation–the key to measuring training value 

( http://elearningindustry.com/level-4-training-evaluation )

4. OPTIONAL: Review the Model for Determining ROI (handout)  ( in the attachment ) 

This is a nice flowchart that walked you through the process of determining ROI.  In this model, they are talking about the “Return on HRD” but the process is the same.

5. OPTIONAL: Watch this video where I walk through an ROI example and introduce another formula for ROI which is the Benefit to Cost calculation (4:23m)

Assignments

1.  Complete the ROI assignment (15 points)
     In this assignment you will be calculating the ROI for a training workshop and describing the rationale for doing
     an ROI, the benefit of the workshop, and describing with whom you will share this ROI data and why.

            Handout: ROI Assignment  ( in the attachment ) 

2. Discuss the readings and forum questions with your group members in the forum.

3. Grad students: Writing project is due the end of this week. 

4. OPTIONAL: Get started on your Reflection paper (15 points). DUE: end of week 16 (I am posting it now in case you want to start working on it.)

Critical reflection on our activities as learners (and teachers) help us to improve our practice by identifying areas of strengths, areas for development, and ways in which we can enhance our personal learning both in the classroom and in the workplace.  This paper is a chance for you to look back over the semester and think about what and how you learned.

You are welcome to share your papers with your group for feedback, but because of the personal nature of reflection papers, you are not required to share this paper for feedback.

Because of the bonus point assignments, some of you may have earned an “A” for the class prior to completing this assignment.  Bonus points will not take the place of this assignment and you should plan to complete it regardless of your total points at this time in the course.

Handout: Reflection paper assignment sheet  ( in the attachment ) 

Forum Discussion

Use the following questions as a starting point for your discussions on ROI.

•  Describe how a Level 4 Evaluation and an ROI analysis (level 5) work together.
•  What are the benefits of conducting a Level 4 or level 5 evaluation?
• What are the challenges and barriers to conducting a level 4 or level 5 evaluation?
•  Have you ever done an ROI analysis? Describe what experiences you have had to measure the ROI for a training program, project or investment.
  • What estimates did you mainly use ROI to calculate?
  • What were the main drivers for conducting an ROI analysis?
• After reading Chapter 7 (Level 4: Impact and ROI) describe how your opinion has changed, stayed the same, or any new insights you have after reading the chapter.

Class mate disscusion ( please response to each disscusion )

first disscusion 

Second disscusion  

 I believe that most industry leaders believe that the skills learned during training need to transfer to skills on the job with the proper utilization of tools and equipment. One aspect of the level 4 and 5 evaluations that I did not detect from the readings in the chapter is that in some cases the best rates of return are not always measureable in dollars.  For example, in the service industry that I am most familiar with, physical therapy, extensive training expense can relate to improved technical skills. Another example may be in nursing training for the proper administration of a medication. In a non health care related scenario management may receive extensive training that may ultimately improve the moral of their organization or influence the organization’s culture.  Ultimately the cost benefit analysis can be extremely positive for the organization but very difficult to measure in dollars.

     Ultimately level 4 and 5 evaluations are what actually matters the most to management. If the training results are measurable in dollars and do not adequately impact the business metric, then the course objectives have not been met.  The ROI gives the client an objective measurement to justify or not justify the expenses and business resources spent to provide the training. If the ultimate impact from the training is poor, most likely management will not continue to fund the continued training. A good example of a level 4 evaluation and ROI is presented in the McCain book regarding sales force training.  Even though many variables can relate to an ultimate increase in company sales, a measureable improvement in sales needs to occur in order for management to support continued training. The management will eventually want to know if the training is effective and useful on the job. The training can utilize the best equipment, in a great environment, and cover a large amount of content; however will be meaningless and problematic to the client if the impact of the training results does not provide an expected return.

“