Peer Audit: Difference between revisions
TOstryzniuk (talk | contribs) mNo edit summary |
Ttenbergen (talk | contribs) m Text replacement - "[[Category: " to "[[Category:" |
||
(19 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
The CCMDB Peer Audit | {{Project | ||
|ProjectActive=legacy | |||
|ProjectProgram=CC and Med | |||
|ProjectRequestor=internal | |||
|ProjectCollectionStartDate=2009-11-17 | |||
|ProjectCollectionStopDate=2010-06-18 | |||
|Project={{PAGENAME}} | |||
}} | |||
{{LegacyContent | |||
| explanation=Project ended long ago | |||
| successor=none, was a one-time project | |||
| content= | |||
The CCMDB Peer Audit was a real-time audit to quantify the variability in our data collection. | |||
== Purpose of an Audit== | == Purpose of an Audit== | ||
An audit is a scientific approach to obtaining a quantitative measure of the quality of the data data we collect. By quantity we mean "accuracy" and ease of "reproducibility" (precision) of the numerous elements we collect. Once we have a measure, the next phase is to collaborate as a team and identify any factors that are affecting reproducibility, and work together and make a plan to improve data quality........one step at a time. | An audit is a scientific approach to obtaining a quantitative measure of the quality of the data data we collect. By quantity we mean "accuracy" and ease of "reproducibility" (precision) of the numerous elements we collect. Once we have a measure, the next phase is to collaborate as a team and identify any factors that are affecting reproducibility, and work together and make a plan to improve data quality........one step at a time. | ||
Examples of | Examples of factors that may be affecting quality: | ||
*the collection process | *the collection process | ||
*source of information | *source of information | ||
Line 13: | Line 26: | ||
GO TO: [[List of Factor affecting data quality]] | GO TO: [[List of Factor affecting data quality]] | ||
=== What the Peer Audit is and is not === | === What the Peer Audit is and is not === | ||
The Peer Audit is not meant identify "wrong" data or to single out a specific collector who is doing something bad. We are trying to quantify the [http://en.wikipedia.org/wiki/Accuracy_and_precision precision rather than the accuracy] (reproducibility) of our individual data elements. A lot of us have hunches about where there are problems, this audit is to give us objective indicators. | The Peer Audit is not meant identify "wrong" data or to single out a specific collector who is doing something bad. We are trying to quantify the [http://en.wikipedia.org/wiki/Accuracy_and_precision precision rather than the accuracy] (reproducibility) of our individual data elements. A lot of us have hunches about where there are problems, this audit is to give us objective indicators. | ||
Line 21: | Line 31: | ||
=== Goals and follow-ups to the peer audit === | === Goals and follow-ups to the peer audit === | ||
[[Julie Mojica | Julie]] will do comparative analysis between the audit data and the database data by element. The proportion of dissimilarity of values will be calculated over time and presented in a statistical control chart. Values found outside the prescribed or predetermined control limits be investigated.[[User:JMojica|JMojica]] 10:16, 2 December 2009 (CST) | [[p:Julie Mojica | Julie]] will do comparative analysis between the audit data and the database data by element. The proportion of dissimilarity of values will be calculated over time and presented in a statistical control chart. Values found outside the prescribed or predetermined control limits be investigated.[[User:JMojica|JMojica]] 10:16, 2 December 2009 (CST) | ||
Once we have identified the elements which showed large discrepancies or variability, we will identify the reasons why, suggest changes to reduce the variation in the data, implement the changes and re-assess again to see if the change results in improvement in the quality of the data. This will largely happen ad-hoc using the wiki. We may also come back to you personally to find out why there are discrepancies, but this is to find the reasons and fix the underlying problem, not to criticize individuals. | Once we have identified the elements which showed large discrepancies or variability, we will identify the reasons why, suggest changes to reduce the variation in the data, implement the changes and re-assess again to see if the change results in improvement in the quality of the data. This will largely happen ad-hoc using the wiki. We may also come back to you personally to find out why there are discrepancies, but this is to find the reasons and fix the underlying problem, not to criticize individuals. | ||
Line 30: | Line 40: | ||
*See [[Peer Audit Partners]] table. | *See [[Peer Audit Partners]] table. | ||
* '''pilot by collectors - START TEST: Nov 17.09''' | * '''pilot by collectors - START TEST: Nov 17.09''' | ||
**sites to start '''Nov 17.09''': | **sites to start '''Nov 17.09''': | ||
***HSC SICU & MICU (Joyce and Lois) | ***HSC SICU & MICU (Joyce and Lois) | ||
Line 47: | Line 57: | ||
*Thank you everyone for the good work with the Peer audit! | *Thank you everyone for the good work with the Peer audit! | ||
*The program is currently in the process of analyzing the information and this is now in the prelimary stages. We have 283 files to date and a few more that will still come in. The information will be shared with the Collection Team once the analysis is complete and a report is written. --[[User:TOstryzniuk|TOstryzniuk]] 17:56, 17 June 2010 (CDT) | *The program is currently in the process of analyzing the information and this is now in the prelimary stages. We have 283 files to date and a few more that will still come in. The information will be shared with the Collection Team once the analysis is complete and a report is written. --[[User:TOstryzniuk|TOstryzniuk]] 17:56, 17 June 2010 (CDT) | ||
== Processes and Procedures == | == Processes and Procedures == | ||
Line 76: | Line 84: | ||
====What is '''INCLUDED''' for collection==== | ====What is '''INCLUDED''' for collection==== | ||
All data elements for patients | All data elements for patients | ||
*Includes: Medicine TMP: [[Moves]] data | *Includes: Medicine TMP: [[Moves for Medicine]] data | ||
====What is '''EXCLUDED''' for collection==== | ====What is '''EXCLUDED''' for collection==== | ||
Line 94: | Line 102: | ||
Starting on '''Thursday''' morning, the first patient admitted or transferred to the audit ward whom you have no prior information and whose chart you have seen the first time will be an '''audit patient''' and will be followed as if he or she were a patient admitted to the regular ward of that collector. | Starting on '''Thursday''' morning, the first patient admitted or transferred to the audit ward whom you have no prior information and whose chart you have seen the first time will be an '''audit patient''' and will be followed as if he or she were a patient admitted to the regular ward of that collector. | ||
The '''[[serial numbers]]''' to be used for audit patients will be 111 to 140 (if you need higher, you will not be able to send your audit data, contact Trish or Tina). If a patient is not discharged by next Thursday, use the next number, e.g. 112. Re-use earlier numbers once they become available, i.e. once patient 111 is sent and deleted, use the number for the next audit patient. | |||
The '''serial numbers''' to be used for audit patients will be 111 to 140 (if you need higher, you will not be able to send your audit data, contact Trish or Tina). If a patient is not discharged by next Thursday, use the next number, e.g. 112. Re-use earlier numbers once they become available, i.e. once patient 111 is sent and deleted, use the number for the next audit patient. | |||
==How to Send== | ==How to Send== | ||
Line 113: | Line 120: | ||
==== Data Sending ==== | ==== Data Sending ==== | ||
If the batch is labelled with an "a" (i.e. for audit patients) then [[CCMDB. | If the batch is labelled with an "a" (i.e. for audit patients) then [[CCMDB.accdb]] will send [[:Category:Task Elements | task]] and [[L TmpV2 | temp]] information to the following alternative '''audit locations''': | ||
* Tasks: [[Regional Server]]\output\tasks_1''_audit''.mdb | * Tasks: [[Regional Server]]\output\tasks_1''_audit''.mdb | ||
* Tmp: [[Regional Server]]\output\TmpV2_1''_audit''.mdb | * Tmp: [[Regional Server]]\output\TmpV2_1''_audit''.mdb | ||
Line 123: | Line 130: | ||
***Moves all files labels with C_a* or M_a* to SAN drive (X):\med_CCMED\CCMDB\Peer Audit | ***Moves all files labels with C_a* or M_a* to SAN drive (X):\med_CCMED\CCMDB\Peer Audit | ||
***Also copies [[tmpV2_1_audit.mdb]] and [[TASKS_1_audit.mdb]] to same folder. | ***Also copies [[tmpV2_1_audit.mdb]] and [[TASKS_1_audit.mdb]] to same folder. | ||
== Central Office- Data Analysis == | == Central Office- Data Analysis == | ||
* Statistician will retrieve file from | * Statistician will retrieve file from {{S:\MED\MED_CCMED}}\Med_CCMED\CCMDB|Peer Audit\backup location | ||
* match every field one on one, give count of good vs bad and degree of difference | * match every field one on one, give count of good vs bad and degree of difference | ||
* do a pair-analysis for dxs, Admit 1 specific, and others regardless of diagnosis number | * do a pair-analysis for dxs, Admit 1 specific, and others regardless of diagnosis number | ||
Line 136: | Line 139: | ||
* Post accuracy scores to this article | * Post accuracy scores to this article | ||
* further investigate causes for differences | * further investigate causes for differences | ||
==QUESTIONS from Collectors== | ==QUESTIONS from Collectors== | ||
Line 146: | Line 148: | ||
==== EMIP/OVER pts ==== | ==== EMIP/OVER pts ==== | ||
*''Also, Wendy and I now do S3 as well and all the EMIP/OVER patients and split the workload between our laptops. Do you want us to follow any of the S3 patients as most of these patients have been transferred from other wards and have been medically stable and are usually waiting placement?'' | *''Also, Wendy and I now do S3 as well and all the EMIP/OVER patients and split the workload between our laptops. Do you want us to follow any of the S3 patients as most of these patients have been transferred from other wards and have been medically stable and are usually waiting placement?'' | ||
**'''Shirley will audit N5 & S3. See: [[Peer Audit Partners]] for details'''. We will not audit EMIP or Over.---[[User:TOstryzniuk|TOstryzniuk]] 13:29, 19 November 2009 (CST) | **'''[[p:Shirley Kiesman-retired, Dec 31, 2018]] | Shirley Kiesman]] will audit N5 & S3. See: [[Peer Audit Partners]] for details'''. We will not audit EMIP or Over.---[[User:TOstryzniuk|TOstryzniuk]] 13:29, 19 November 2009 (CST) | ||
==== Audit Transfers as well? ==== | ==== Audit Transfers as well? ==== | ||
*''Do you want us to follow patients that are transferred between wards or just new admits?'' | *''Do you want us to follow patients that are transferred between wards or just new admits?'' | ||
**'''Both. If the first patient that arrives on your audit ward on Thursday is a patient that was transferred over from your own collection ward do not audit that patient. Select the "next" patient that arrived on your audit ward on Thursday. The main idea of a peer audit is to repeat data collection for a patient by two totally different data collectors'''.--[[User:TOstryzniuk|TOstryzniuk]] 13:29, 19 November 2009 (CST) | **'''Both. If the first patient that arrives on your audit ward on Thursday is a patient that was transferred over from your own collection ward do not audit that patient. Select the "next" patient that arrived on your audit ward on Thursday. The main idea of a peer audit is to repeat data collection for a patient by two totally different data collectors'''.--[[User:TOstryzniuk|TOstryzniuk]] 13:29, 19 November 2009 (CST) | ||
===Data Integrity Checks in Access=== | ===Data Integrity Checks in Access=== | ||
Line 164: | Line 165: | ||
**Checks above are in Version 1.9852. Rolled out Dec 16.09--[[User:TOstryzniuk|TOstryzniuk]] 21:25, 16 December 2009 (CST) | **Checks above are in Version 1.9852. Rolled out Dec 16.09--[[User:TOstryzniuk|TOstryzniuk]] 21:25, 16 December 2009 (CST) | ||
[[Category:QA]] | [[Category:QA]] | ||
[[Category:Peer Audit]] | [[Category:Peer Audit]] | ||
}} |