Tag: Evaluation-Implementation

  • Instructional Design Internship and Project

    I did my internship with CHIME (College of Healthcare Information Management Executives) to design a course for their Digital Faculty, especially those new to online teaching. I had initially wanted to build it in their LMS (D2L) but due to time constraints and the learning curve, we opted to create it using Rise 360, which has been used for some of their courses as well. The initial course objectives “aimed a little too high in Bloom’s taxonomy” so were revised per the client’s instructions and were, essentially, individual module objectives.

    Course Outline:

    • Introduction
    • Training: Online versus In-Person
    • How People Learn
    • Using Media & Technology Effectively
    • Conclusion, Resources, and Further Reading

    Course Objectives:

    • Identify differences and similarities between online learning and in-person learning.
    • Identify adult learning theories and ways to incorporate them into the learning environment.
    • Identify strategies for effective use of media and technology in the learning environment.
    • Identify strategies for effective use of media and technology in the learning environment.
    • Identify types of engagement that build community in the online learning environment.

    Design Process

    I initially built one Articulate Rise course with four modules. In order to import it into the client’s LMS (D2L), I broke each module into its own Rise course, imbedding them into individual units.

    Each unit began with an ungraded quiz built in their LMS to check the learners’ current knowledge about the topic, then moved to the course built in Articulate Rise, and ended with a reflection prompt. The course itself ended with a graded quiz consisting of a mix pre-test questions and “knowledge check” questions. Some questions were identical to what the learner had done and seen in the individual units and some were similar. This was done in order to better gauge retention of the material.

    Each Rise course was also formatted similarly:

    • An introduction
    • The module objective
    • A quote relevant to the topic
    • Key terms (if needed)
    • The meat of the content
    • An ungraded knowledge check

    I used an informal voice that included a smattering of “breaking the fourth wall”. For example, in the Media & Technology lesson, in explaining alignment, I said, “For this module, I want you to be able to identify effective use of media and technology. That means I am going to teach it, provide materials that support it, and assessments will give you the opportunity to identify effective use of media and technology (i.e. I won’t ask you to define a term because “able to define” is not the objective).” And in the Online vs In-Person, there’s a little Easter Egg reference to Spiderman:

    Myth: Anyone can be successfull in an online course.

    The truth: Online isn’t for everyone. To be successful in an online course requires time management and self-motivation – for students and sometimes even faculty! You might even say that with great flexibility comes great responsibility.

    Some of the Rise courses included “Tricks of the Trade,” offering suggestions on ways to implement the information they were learning and tips on using technology which pulled from personal experience over the last year: things I’ve learned to use within Zoom that have improved my own presentations and that I’ve seen others use in webinars and workshops that I thought were a great use of the technology.

    I found the experience extremely relevant to what I had learned over the previous two years, referring back to almost every textbook I used in the degree program plus a few new ones. I also got to create a couple of graphics which, frankly, is one of my favorite parts of all this.

  • Process Evaluation

    I became a Program Coordinator for three small Internal Medicine Fellowship programs in 2016. At the time, the on-boarding and orientation processes for new trainees, which takes place every academic year, felt disorganized. There are a multitude of departments within UAB, each with different but connected purposes which, when executed properly, enables a new physician to fully function within the various systems at UAB. Additionally, trainees will also work within other entities, notably the Birmingham VA Medical Center and Children’s of Alabama, each with their own processes. After my first time going through these processes, I created a job aid which listed out the various groups, contacts, and information needed. Due to the cyclical nature of my position, the job aid has been fine-tuned each year.

    In the past, my “evaluation” method was to informally ask the fellows how things went. This project was my first time doing any sort of formal evaluation of the onboarding process and is something I now plan to do each year.

    Based on their responses, I plan to:

    • Create a checklist similar to GME’s (which they seemed to like) that includes VA (and COA for Palliative)
    • Communicate with incoming fellows currently at UAB to ensure they have what they need
    • Contact HSIS to give them access to their email in June
    • Locate existing “how‐to” instructions for accessing various systems and make sure incoming fellows know where to
      find them

    [pdf-embedder url=”https://www.elizabethmcalister.net/wp-content/uploads/securepdfs/2021/03/Evaluation-Plan-McAlister-Elizabeth.pdf” title=”Evaluation Plan – McAlister, Elizabeth”]

  • Program Coordinator Onboarding Curriculum

    2018-2020: With the Program Administrators and Coordinators Leadership Team, developed a 6-month rolling curriculum for onboarding new Program Coordinators in Graduate Medical Education (GME). Sessions cover six topic areas: Getting Started, Accreditation, GME Requirements and Processes, Onboarding/Offboarding, Recruitment, and Professional Development. Each team member is able to co-present on any given session but have specific assignments based on area of expertise.

    2020-present: Because of COVID, the in-person sessions were stopped. Additionally, because we all had to learn how to do our jobs remotely and via Zoom, the onboarding curriculum was essentially put on hold. In March 2021, the GME Education Coordinator and I became Power-Users in UAB’s Campus Learning LMS (Docebo) and are working with two other members who are passionate about education to move the curriculum into a self-paced format. 

    The initial project was written up, submitted, and accepted as a poster presentation for the 2019 Association of Hospital Medical Education conference.

    Craft J, Fleming R, Pickens T, Freiger B, Butler K, Chandler R, Chambless S, McAlister E, Millette N, Veazey M, Whitehead J. (2019). Program Coordinators Onboarding—It Takes a Village to Be Successful. Association for Hospital Medical Education 2019 AHME Institute; Savannah, GA.

    Abstract. In AY 2013, a Program Administrator and Coordinator Leadership Team (PACLT) was established to provide mentoring to Program Coordinators (PC). PACLT members are experienced in GME and represent residency and fellowship programs. Members routinely present best practices at the monthly institution-wide PC meetings and meet regularly with the GME Director (GMED) to identify quality improvement activities. Through collaboration, a GME PC Manual (PCM) was developed. Recognizing that the ACGME Next Accreditation System is continuously evolving, there is need to frequently create new institution-level processes. With an average of one new PC per month, the group determined that a standardized and comprehensive program was needed to effectively prepare PC for internal and external requests.

    The objective of this activity was to develop a comprehensive PC Onboarding Program (PCOP) to prepare new PC for their important role.  Key components were to include: 1) monthly learning sessions (LS); 2) individualized training meetings with the GME Education Coordinator (GMEEC); 3) a listing of institutional resources; 4) a calendar of GME deadlines; and 5) opportunities for professional development.