Beta software. Please report problems to muncat@med.mun.ca or 709-864-6010

Back to Overview
< Open Manual <
Beta software. Please report problems to muncat@med.mun.ca or 709-864-6010
...
... of ... ...
Logout
< Open Manual <

Instructions

Legend
Stage Column
EPA Column
TD
Transition to Discipline
F
Foundation
C
Core
TP
Transition to Practice
Number
Number of EPAs in stage in which Resident is entrustable.
Number of times resident attempted EPA.
Resident is entrustable in all EPAs in stage.
Resident is entrustable in EPA.
...
Resident has attempted EPAs in this stage.
[Not Applicable]
Stage contains an EPA with one or more unaddressed patient safety or professionalism concerns.
EPA has an observation with one or more unaddressed patient safety or professionalism concerns.

This is beta software and is still undergoing testing. Not all features are fully implemented and you may encounter problems.

Known issues:

Please report any other problems via:

Thank you for your feedback.

Memorial University Faculty of Medicine
MUNCAT Dashboard

---
Login
Help
Your session will end shortly and you will be
logged out automatically.
OK

MUNCAT Dashboard Manual

Table of Contents


Disclaimer

The dashboard is undergoing active development and there may be a few bugs present. If you encounter problems or if you have any suggestions for improving the dashboard, please let us know via email at: muncat@med.mun.ca or by phone at 709-864-6010.

Introduction

The MUNCAT dashboard is an application developed jointly by HSIMS and the eHealth Research Unit at Memorial University to monitor and assess residents. The dashboard allows residents and faculty members to access data collected by the MUNCAT mobile app during the course of their Postgraduate Medical Education program. The dashboard can be used as a tool for residents to review their progress throughout their respective programs and can be used by program directors/administrators to assess residents during competence committee meetings. The combination of the mobile app and dashboard is intended to replace the paper feedback cards that are currently be used to record and evaluate residents.

Requirements

The MUNCAT dashboard is a web application that is intended to be used on a desktop or laptop computer. While the dashboard can be used on mobile devices such as phones and tablets, the experience on those platforms will be less optimal. The dashboard can be used with any recently updated browser such as Firefox, Safari, Edge or Chrome on any operating system that supports these browsers (e.g., Microsoft Windows, Mac OS X, Linux).

If you are experiencing problems with the dashboard, please make sure you are using the most recent version before reporting any problems. Please note that the dashboard will not work with any version of Internet Explorer.

Logging into the MUNCAT Dashboard

You can login the MUNCAT dashboard by visiting the URL cbme.med.mun.ca in your web browser. The site uses https by default — all traffic between your computer and the backend server is encrypted.

In order to login to the dashboard, use the same username and password you use to access other MUN services such as your MUN e-mail account and my.mun.ca. Your MUN username must also be registered with MUNCAT. If you're already able to login to the mobile app, you should be able to use the dashboard. If you're not sure that your MUN username is registered for MUNCAT, you can contact the MUNCAT team by email at muncat@med.mun.ca or by phone at 709-864-6010.

Selecting your Role/Discipline and Cohort

Once you have supplied a correct username and password on the login page, the dashboard will take you to the Overview page. The data displayed on the overview page will depend on your user profile. Your profile contains all roles, disciplines and cohorts which are assigned to you when you were added to the MUNCAT system.

Resident Overviews

For example, if you are a first-year resident doing adult nephrology in 2015, your role, discipline and cohort is Learner, Adult Nephrology and 2015, respectively. Because there is only one role, discipline and cohort, the dashboard will automatically load and display your Overview page based on this profile as shown below:

[screenshot]

Note that the role/discipline/cohort of the overview is displayed below the resident's name near the top of the dashboard: Learner of Adult Nephrology 2015.

If you are a resident enrolled in Orthopedic Surgery in 2015, you'll also be enrolled in the Surgical Foundations (sub)discipline when you are added to the MUNCAT system. Your profile will therefore have two disciplines for the Learner role. When you login, the dashboard will automatically select your Learner role and will offer you two tabs denoting both your disciplines:

[screenshot]

Note that the role/discipline/cohort below the name is incomplete. The dashboard is waiting for you to select a discipline so it can show you the discipline overview that you wish to view. Clicking one of the discipline tabs will then implicitly select the 2015 cohort and then display the appropriate overview grid:

[screenshot]

Program Director/Administrator Overviews

If you are the Program Director for Medical Oncology, for example, your role and discipline will be Director and Medical Oncology, respectively. As a director, your profile will allow you access to all cohorts of residents enrolled in the Medical Oncology program. After you log in to the dashboard, your role and discipline will be selected automatically and you'll be offered several tabs — one for each cohort of Medical Oncology residents currently in the MUNCAT system:

[screenshot]

Note again that the role/discipline/cohort below the name is incomplete — the dashboard is waiting for you to select a cohort. Click one of the tabs to display the desired cohort you wish to view:

[screenshot]

Note that as Program Director you'll see all the residents in the cohort you selected, whereas a resident using the dashboard will see only their own data and not that of other residents.

The dashboard can also handle MUNCAT users who may have several roles in a similar fashion as described above. After you login, each of the roles assigned to you will be displayed in a row of tabs and you click the desired role. If the role you selected is associated with multiple disciplines, you will be presented with a second row of tabs — one for each discipline. In the general case, there can be up to three rows of tabs: one for each of the three aspects of your profile: roles, disciplines and cohorts.

All of the roles, disciplines and cohorts in your profile are all accessible with a single username and password. If you have more than one role in the dashboard, you need to login only once to access features available to each role.

The Overview Page

The overview page gives you a very high-level view of the EPA data collected for the residents. The overview initially shows a table containing columns of residents and Competence by Design (CBD) stages: (For simplicity, the examples below will show a resident dashboard which contains just a single resident.)

[screenshot]

These stages (and abbreviations) are typically:

(Note that not all disciplines will necessarily have the same stages.)

The number immediately below the stage abbreviations in the table header is the number of EPAs in the CBD stage. For example, in the table above, the Core (C) stage contains 26 EPAs to be completed by the resident.

The table elements to the right of each resident's name denote the progress of the resident through each of the stages. Each element can contain the following items.

Item Meaning
Resident is entrustable in all EPAs in stage.
1, 2, 3, ... Number of EPAs in this stage in which the resident is entrustable.
... Resident has attempted EPAs in this stage.
[empty] Resident has not attempted any EPAs in this stage.
Stage contains an EPA with one or more unaddressed patient safety or professionalism concerns.

So, in the overview table above, we see that resident John Doe has completed the Transition to Discipline stage (he's entrustable in all two EPAs in this stage). He is entrustable in 6 of the 11 EPAs in the Foundation stage, has attempted some of the 26 EPAs in the Core stage and has not attempted the single EPA in the Transition to Practice stage. Moreover, in the Foundation stage, an observer recorded a patient safety or professionalism concern during one or more of John Doe's attempted EPAs in this stage.

Expanding the Stage Columns

Each stage column can be expanded by clicking on the corresponding header. For example, clicking on the F header in the overview table above would expand the Foundation stage column. At this point, the column has transformed from a stage column into an EPA column. (Note that we can re-collapse the EPA column back to a stage column simply by clicking the header again.)

[screenshot]

The items in the row of an EPA column denote the residents' progress in each EPA of the expanded stage:

Item Meaning
Resident is entrustable in this EPA.
1, 2, 3, ... Number of times the resident attempted this EPA.
[empty] Resident has not attempted this EPA.
One or more attempts of this EPA by the resident have raised an unaddressed patient safety or professionalism concern.

So, looking at the expanded Foundation stage column in the above overview table, we see that resident John Doe is entrustable in EPAs #2, #4, #6, #9, #10, #11; has attempted EPAs #1, #3, #5, and #7, one, six, five and three times, respectively. He has not attempted EPA #8 at all and there was a patient safety or professionalism concern during one or more attempts of EPA #3.

Drilling down into an EPA: the EPA Details Viewer

When we have expanded a stage in the Overview table, we can drill down to get more details about a resident's attempt of particular EPA. For example, if we wanted to get more details about the resident's performance on Foundation EPA #3, we click on the corresponding table cell below the F-3 header (i.e., click on the cell containing 6 and the small in the corner). This displays the EPA viewer page:

[screenshot]

This page contains information related to all of the resident's attempts of the selected EPA as captured by the mobile app. Discrete Ottawa scores, fine-grained M-scores, milestones scores, any patient safety and professionalism issues as well as feedback related to each EPA attempt are all displayed on this page.

Each attempt of the EPA is shown in the rows of vertical bars near the top of the page. The top row of vertical bars is the Ottawa score of each attempt, the row of colourful vertical bars below it are the M-scores. The colour and height of these bars indicate where the observer dragged the slider on the M-score in the app: red/short means "Lots of assistance", blue/tall implies "Expert". If the vertical bar has a dotted border, that means that the PIN used to submit data related to the attempt was not confirmed by the app. The program director should contact the observer who submitted the observation details and ensure that the submission was valid.

Professionalism and patient safety concerns are shown below the bars: ✓ means that there was no professionalism/safety concern during the EPA attempt. denotes a concern that has yet to be addressed by the program director, while ✱ denotes a concern that has been addressed.

The Summary EPA Details

The EPA Viewer page shown above is the Summary page. In the bottom half of the page, various summary details about all the EPA attempts are displayed. These include the date range over which the attempts occurred, the total number of attempts and whether or not the resident is entrustable in this EPA. Program directors and administrators will have access to a toggle button which can be clicked to toggle a resident's entrustability during competence committee meetings.

The Milestone Summary table indicates how many times a particular score was achieved for a particular milestone. For example, in the table above, we can see that milestone "ME 2.2 Interpret urine microscopy" was achieved during four of the six attempts, but was not observed during the other two attempts.

The Context EPA Details

By clicking on the Context tab or by clicking on one of the columns of vertical bars in the top half of the page, the user can get details about the context of a particular EPA attempt. For example, if you wanted more details about the safety concern, you can click on the column of vertical bars denoted by Attempt #2. This highlights the attempt and shows the Context View, as shown below:

[screenshot]

This gives you details regarding the date of the attempt, as well as all the scores and all feedback given during the attempt. The reasons for any professionalism and/or safety concerns that occurred during the EPA attempt are also provided. The Milestones table shows the scores associated with each milestone for this particular attempt of the EPA. You can return to the summary view by clicking the Summary tab.

IMPORTANT NOTE: To return to the overview page, click the "Back to Overview" button near the upper right. (Don't click your browser's back button! Doing so will log you out of the dashboard and you'll have to log back in again. We're working on a fix.).

Logging out

To logout of the application, click the Logout button near the top right of the Overview page. For security reasons, the dashboard application will automatically log you out about thirty minutes after you login. Development is underway to allow you to extend your login session.