Monday, May 27, 2013

Reflection #3- Administration and Evaluation

I appreciated learning about the differences between summative and formative evaluation. There is a time and place for each, and knowing which to choose is a skill.  Structuring the evaluation is also important, including the use of tangible, quantifiable measures.  The section on "Logic Models" was especially helpful for me.  The way the Logic Models broke down the process into easily defined, well-structured parts helped me to clarify my goals and develop a sound evaluation.

I was most engaged during the synchronous session and during our one-on-one phone call.  While taking these online courses, I've consistently found synchronous communication to be an efficient, helpful mode of learning.

I felt most distanced during the third week, while we were completing our 're-do' of the week 2 assignment.

Overall, I enjoyed learning about developing an evaluation of my program.  Building the evaluation for my e-learning initiative was great.  I believe I created an evaluation that will help me to accomplish my short-term and long-term goals.  I plan to add further evaluation to my course in the form of short (1-2 question) surveys completed periodically throughout the course.  I think this will help to keep my students engaged with me, and it will allow me to improve the course while I am conducting it.

Thank you!  

Saturday, May 4, 2013

Reflection #2- Administration and Evaluation

Now that you are more than halfway through the course, reflect on the content presented and discussed up to this point. What is something new that you have learned that you can apply in a work or professional setting? 

I like the logic models, including the cheesy video by Michael Brand.  Inputs => Activities => Outputs => Short Term Outcomes => Long Term Outcomes.

My inputs => CRM access, listing in brochure, salary.
My Activities => Developing and implementing a course on undergraduate admissions
Outputs => revenue for JHU Odyssey program
Short Term Outcomes =>  Knowledge for students, a new challenge for me
Long Term Outcomes => The knowledge gleaned from my class will hopefully help my students throughout the application process, teaching the class will hopefully help me build a good reputation for myself as an online teacher, opening up future opportunities, teach the class again and again, hopefully with more and more students (scalability!)

What do you think will be the most difficult part of online program administration and evaluation to implement?

For me, I think it will be gathering enough information to create reliable results.  With such small class sizes to start, each person (or data point) will skew the results greatly.  Out of 10 students, if 1 thinks the class was terrible, my overall ranking will decrease greatly, even if the others thought it was amazing.  Over time, this will be less of an issue.  I will need to do my best to ask the same questions consistently so I can gather a lot of answers to the same questions, thereby creating more reliable data.