GNOSIS FAQs General Information What is GNOSIS? GNOSIS is an online learning platform for healthcare providers that delivers individualized and prioritized content, with a focus on areas of practice with the highest risk. What differentiates GNOSIS from other elearning platforms? GNOSIS provides statistically sound measurements of clinicians knowledge and judgment. Knowledge questions have one correct answer, informed by peer-reviewed best practices. Judgment questions introduce a clinical scenario, add more information as the patient s status changes, and asks for the best approach given the new information. The resulting curriculum is designed to make the learning process more relevant, time efficient, and effective. Will I get continuing education credit for completing courses on GNOSIS? Yes. Depending on the course content and clinicial role, APS courses are accredited by ACCME and/or ANCC. Certificates are available in GNOSIS to print or email for your records. Assessment Why is an Assessment deployed at the beginning of the course instead of the end? Pre-assessment scores are generally a better measure of a clinician s true understanding of a practice area than post-assessment scores. Post-test scores reflect the contents of short-term memory immediately following the training and do not necessarily reflect long-term improvement in critical thinking. How do I know the the Assessment is accurate? Expert physicians, nurses, medical writers and instructional designers develop the Assessment questions together. After several review cycles the questions then undergo beta population testing and statistical analysis to ensure their validity. Who are the experts? APS partners with a highly respected panel of nurse and physician medical experts who are selected based on their diverse healthcare experience and academic profiles. Criteria considered for our expert panel includes: Nationally or regionally recognized in their specialty Practice at highly respected academic medical center Contributor to academic or clinical literature Have experience or are currently at a high-volume community practice Geographic diversity of perspectives 1
What questions should I expect when completing the Assessment? The Assessment questions are designed to assess a clinician s knowledge and judgment. Knowledge questions are multiple-choice or multi-select and are developed to assess base knowledge in each clinical practice area. Judgment questions asses the application of knowledge and decision making under uncertainty in clinical scenarios. The questions are sometimes written using Script Concordance Theory (SCT) developed on solid theoretical grounds and supported by numerous peer-reviewed papers over the past 10 years. These questions can also be in the form of a more traditional multiple-choice or multi-select format. What do Script Concordance Theory (SCT) judgement questions look like? Clinicians are presented with a clinical scenario and a management plan. Next, users see a new piece of information. Subsequently, the clinician indicates how this new piece of information affects the original management plan by choosing a response from a Likert scale. What is a Likert scale? Likert scales use fixed choice response formats and are designed to measure attitudes or opinions. 1-2 The use of the Likert scales is well established when using Script Concordance Theory. 3 By creating ambiguity, the 5-point Likert scale closely simulates reality for situations that do not have a definitive binary answer. Likert scales also allow one to capture variability of clinical decisions that are seen among practitioners in day-to-day clinical practice. How are the questions scored? Multiple-choice and multi-select questions have one correct answer. Credit is only awarded for correct answers. Judgment questions with the Likert scale may be scored with partial credit based on the concordance with expert panel. If a question is given to a panel of 10 experts and six of them respond to the judgment question as could negate, then they form the majority opinion. If you also respond to the question as could negate, then you earn 100% of the credit. The remaining four experts respond as strongly negates. If you align with the four experts, you earn 67% of the credit because the majority (six experts) becomes the denominator. 2
How do I know what questions I get right and wrong? APS does not provide answers to questions asked in the Assessment. The reds and yellows in your Learning Path, in addition to your My Scores report, will provide you with insight into which topic areas in the Assessment were missed. We do not provide the learner with the Assessment answers to 1) protect the integrity of the questions and 2) create a learning experience in which the clinician needs to explore the content to discover the answer, rather than being directly delivered the answer. This process encourages the learner to truly review the content rather than stop short after receiving the correct answer. Do all clinicians get the same questions? The majority of questions during the Assessment are specific to clinical roles. However, because all clinical roles work closely together to deliver optimal care, there is some overlap with questions. Is the Assessment timed? The Assessment is intended to be a time-bound activity. The intent is that you find time when you are able to focus and ensure accuracy of the assessment results. A timer is provided as a guide in the top right corner of the screen; however, you are not forced to complete the Assessment before the clock reaches zero. If you have not finished answering the questions you are still able to continue on until the end. Can I pause during the Assessment and come back? In the event that you are not able to complete a full Assessment section you are able to save and come back at a later time. If you need to get up in the middle of a section your work will be saved and you may resume the activity when you come back. After I complete the Assessmentwhat do I do next? A personalized Learning Path will be generated and appear on the GNOSIS dashboard. Additionally, an individual Assessment results report is generated. The My Scores tab will provide a detailed explanation of your results. Learning Path What is the Learning Path? The Learning Path is the content that is assigned to a clinician based on their answers to the Assessment questions, in addition to core concepts for all clinicians to review to prevent medical errors and adverse events. A Learning Path is prioritized differently each time a clinician completes the Assessment. A proprietary algorithm is used to link answers from the Assessment questions to the prioritized content segments assigned. Which content segments do I have to complete? You will complete the reds and yellows in your learning path; greens are optional. 3
What kind of content am I going to see? Learning Path content segments address a diversity of learning styles. Our content includes concepts, cases, practice activities, exploratory tutorials, and expert commentary. Multimedia e.g., (medical illustrations, videos, and interactive 3D images) are complimented by text. APS works with medical writers, instructional designers and certified medical illustrators to provide a high quality and interactive education experience. Do I have to go through the Learning Path in order? No. The Learning Path is prioritized in order of concepts that, if unfamiliar to the learner, may lead to an increase in medical error or adverse events. GNOSIS does not prevent a learner from selecting content segments out of order. What do the numbers next to each content segment mean? The numbers are there to show the clinician the estimated amount of time it will take to complete the content segment, as well as the minutes earned for CME/CEU credits. Certificates of Completion How do I claim my CE/CME certificate? After the required content segments for a course have been completed, you have the option to claim your CE/CME certificate. A pop-up window will indicate to you that you have completed the required sections of the course. You can access your certificate using the pop-up or you can click the certificates tab in the top navgiation bar. Next to the course title there will be a Start Post Course link. By clicking on the link a post-test and evaluation will appear (required by ACCME and ANCC). Upon completion of the post-test and evaluation, a CE/CME certificate will be generated with the appropriate information for your clinical role. You can then either print or email this certificate for your records. Do I have to pass the posttest? The number of questions on the posttest for each course varies based on the number of clinical practice areas covered; however, all clinicians must receive a 70% to pass and claim a certificate. If the clinician does not pass the posttest the first time they take the test, they will be able to retake the test. The only exception is the Introduction to Fetal Heart Monitoring course, which has a passing score of 80%. How many CE credits will I receive? Each course has a specified amount of credits that will be awarded based on the length of the course and the number of clinical practice areas covered. To find the maximum amount of credits award for a course, please select the View Other Courses button at the bottom of your Dashboard. The available credits are listed to the far right of the screen, next to each course. 4
Why did I not receive full credit for the course? ACCME and ANCC allow credit to be accrued in 15 minutes increments. The certificate will automatically update every time you complete 15 minutes of content. To claim full credit for a course, be sure the click through all of the content segments (red, yellow and green) Will I receive a new certificate when I complete the course for a second, third, etc. time? Yes, you will be able to generate a certificate for a specific course completion. References 1. Bowling, A. (1997). Research Methods in Health. Buckingham: Open University Press. 2. Burns, N., & Grove, S. K. (1997). The Practice of Nursing Research Conduct, Critique, & Utilization. Philadelphia: W.B. Saunders and Co. 3. Charlin, B et. al., The Script Concordance Test: a Tool to Assess the Reflective Clinician, Teaching and Learning in Medicine, Fall 2000 5