Centralized data Vetting Process: Difference between revisions

From CCMDB Wiki
Jump to navigation Jump to search
m Check for problems: headline consistency to link
m Text replacement - "[["Pull" Centralized_data.accdb]]" to ""Pull" Centralized_data.accdb"
 
(78 intermediate revisions by 3 users not shown)
Line 1: Line 1:
*'''need to make sure all in [[Data Appending Process]] is addressed.'''
"Vetting" is our name for the initial quality control our data goes through after [[Data collector]]s finish [[sending]] it. It is one of the main responsibilities of the [[Data Processor]].


== Checklist Tracker Sheet ==
== Instructions ==
This is still part of the old system as a cross check until we go totally with the new system.
* [["Pull" Centralized_data.accdb]]
* Double click to open ''Centralized_data_front_end.mdb''
* [[Reconnect CFE and initial error checks]]
* [[Pre-linking checks]] (PL checks)
* [[Populate linking_pairs]]
* [[Correcting suspect links]]
* [[Quality Assurance queries in CFE]] - NDC Queries
** as part of any of those, there might be [[Questioning data back to collectors]]
* [["Vet all sent" button]]
* [[Generate Person IDs]]
* [["Push" Centralized_data.accdb]] to return data to [[Regional Server]] so [[Data collector]]s can [[send]]


===Print a ''checklist tracker sheet''===
== Related articles ==
*My Documents
{{Related Articles}}
*Open ''workbook2.xls''
*Change header to sent date (use Wed date)
**click Insert
**Header & Footer
**Change the date
**File
**Print


==Check to see that everyone has sent==
*RegionalWRHA (wreath icon)
*Output (folder)
*check each folder to see who sent, and write the # on the tracker sheet
**the data collector sends these files
***there are only ''complete'' files in these xls cvs files
**when viewing these in the xls file, the header is included as Line 1, so the actual # of files sent will be one less, e.g. if it says 11, then there were 10 complete files sent


==To check the ''incomplete'' files==
*make a copy of ''[[PDA Pending.mdb]]''
***we have stopped sending to pda pending, what if anything is being used now? Ttenbergen 20:41, 2014 September 29 (CDT) {{discussion}}
**Regional
**Output
**right click PDA_pending.mdb
**Copy
*Paste the copy on the desktop
*prompts ''already a copy...''
*answer Yes
*open PDA_Pending.mdb
*check each site and write down the # of ''incomplete'' on the tracker sheet
**when viewing these files the header is not included, so the # is how many files pending
***at the bottom it says ''Record __ of __''
*close each file you have opened
*close PDA_Pending.mdb
==The Basic Steps==
# wait until the end of [[Designated sending times]]
# [["Pull" Centralized data.mdb]]
# [[#prep CFE for use]]
# [[#See who Sent]]
# [[#Check For Problems]]
# "Push" Centralized data.mdb
===prep CFE for use===
*Double click to open ''Centralized_data_front_end.mdb''
*click Reconnect
==== cross-check tables ====
*Open Patient List
*on the Left side,
*scroll All Access Objects
*Tables
**L_Log - write down the number
**L_PHI - write down the number
*click ''back to top''
**Queries
**L_Log_PHI - write down the number
'''**ALL 3 must be the same**'''
=== cross-check tracker sheet ===
Double check these numbers against the tracker sheet, which compares the old to the new combined centralized numbers
The ''complete'' numbers come from the xls csv file
The ''incomplete'' numbers come from the [[PDA_Pending.mdb]] file
* {{discussion}} don't think so, we don't use that any more. Ttenbergen 22:27, 2014 September 29 (CDT)
===See who Sent===
*[["Pull" Centralized data.mdb]]
* Queries
* P_Count_Of_Sent (double click)
*Home
*View
*Pivot Table
*View
*Filter by 'Date Sent'
*Right Click
*Field List
*drag 'sent Dt Time'
*close dialog box
*Home
*Design View
*Change to 'Wed' date
*Home
*View
*Pivot Table View
**shows the number of ''incomplete'' and ''sent'' in 2 separate tables
**use + (plus symbol) to expand
***when you expand, it shows the serial number
**use - (minus symbol) to collapse
*Click inside the column and scroll down to do a quick check of the location
* what are we checking for? what if something is wrong? {{discussion}}
* When done
**click '''x'''(in top right) and '''DO NOT''' 'save'
**It will prompt you 'do you want to save'
**say NO
**'''When finished viewing, just close, DO NOT 'save''''
=== Option to view-only data ===
see [["Copying" Centralized data.mdb]]
== Make PseudoPHINs ==
see [[Generating PseudoPHINs]]
== Check For Problems ==
Use [[Centralized data front end.mdb]] "NDC" (''New Data Check'') queries and fix data as needed; if a patient shows up in one of the queries fix if possible; if question to collector is required, set '''[[Record Status field]] to "questioned"'''
Perform the Queries in this order:
1. [[Orphans in Centralized data.mdb| "NDC_orphans"]]
should always be zero
2. NDC_Chart_9_Digit
3. NDC_Phin Fake or Blank
Home
Advanced
Advanced Filter Sort
LastName
Ascending
Toggle Filter
(This sorts by LastName)
*''' before assigning pseudo phin, make sure to check for the highest number in ''Highest Pseudo Phin'''''
** what do you do with that info? I thought we assing the pseudophin automatically now... Ttenbergen 09:57, 2014 July 31 (CDT) {{discussion}}
'''DO NOT''' assign pseudo Phin if a single, or if 'incomplete'
If they have previous encounters, we can correct that unassigned phin with the phin from the previous encounter
'''See''' 'Make Pseudo Phins'
'''Highest Pseudo Phin'''
When you are in NDC_Highest_Pseudo_Phin, you just want to do a quick check to make sure your assigned pseudo phin will be the correct one
Click on the first Phin in the Phin column
Right click
Sort by ''Largest to Smallest''
* {{discussion}} have we ever had the automatic process not assign the right next pseudophin? If not this may not be a required check. If we do want to keep doing this then let's fix the NDC query to not have to sort. Ttenbergen 09:59, 2014 July 31 (CDT)
Then when you assign a pseudo phin, you will see that the next assigned phin will be the next one after that highest one,  e.g.  highest psuedo phin is 7432, then the next assigned pseudo phin will be 7433
4. NDC_Diff_Phin__SameLN_FN_DOB
Home
Advanced
Advanced Filter/Sort
LastName (double click or drag & drop)
Sort by ''ascending''
Home
Toggle Filter
5. NDC_SameChart_Site_Diff_Phin
6. NDC_SamePhin_Diff_LN_FN_DOB_Sex
Home
Advanced
Advanced Filter/sort
Phin (double click or drag & drop)
Sort by ''ascending''
Home
Toggle Filter
7. NDC_SamePHIN_Site_Diff_chart
8. NDC_CLI_AcqDX_but_NoCLI_DateinTMPV2 (see [[CLI Dx vs Tmp checking]])
9. NDC_CLI_No_AcqDX_but_CLI_DateinTMPV2 (see [[CLI Dx vs Tmp checking]])
10. NDC_CLI_unacceptable_date (see [[CLI Dx vs Tmp checking]])
11. NDC_VAP_AcqDX_but_NoVAP_DateinTMPV2 (see [[VAP Dx vs Tmp checking]])
12. NDC_VAP_No_AcqDX_but_VAP_DateinTMPV2 (see [[VAP Dx vs Tmp checking]])
13. NDC_VAP_unacceptable_date (see [[VAP Dx vs Tmp checking]])
14. NDC_unvetted
Once every query has been performed, checked, and cleaned
then perform the first 7 queries once more, to make sure data is all clean and you did not forget any corrections
then ''Vet All Sent''
This changes the record status 'sent' to 'vetted'
For Queries 8-13
we are only monitoring ICU
look for 2014 ''sent'' and see if it has to be investigated
'''still working on this one''' (have not done this one yet)
[[Transfer_Ready_date_and_time #NDC_Missing_TransferDate_w_pivot|NDC_Missing_TransferDate_wPivot]]
[[User:Srusnak|Srusnak]] 12:01, 2014 July 23 (CDT)
== Set record as vetted ==
At this point all records with problems will have had the [[Record Status field]] set to "questioned" so the remaining ones that are set to "sent" are clean and can be set to "vetted". Press the "vet all sent" button. This will change all records currently set to "sent" to "vetted".
===VET ALL SENT===
When all data is cleaned, the last query is ''NDC_unvetted''
On the 'RecStatus' column
Right click the first one
Sort by Z to A which will sort by Sent, Questioned, Incomplete statuses
Scroll down to the last 'sent' record, to see how many records will be vetted
Then ''Vet All Sent''
Prompts 'are you sure'
answer Yes
prompts 'you are about to run ...'
answer Yes
prompts 'you are about to update ___ rows'
answer Yes
The number in the ''___ rows'', should be the same as the last 'sent' record from your scroll down
e.g. if your last 'sent' record was 25, then the prompt will say 'you are about to update 25 rows'
[[User:Srusnak|Srusnak]] 12:00, 2014 July 23 (CDT)
== Push up data ==
When all processing is done, run [[Push_up_centralized_data.vbs]] to return the data to where collectors can add to it.
Once all data is clean, then we can ''Vet All Sent''  (see '''Set record as vetted''')
===PUSH DATA STEPS===
Go to ''Centalized_CCMDB''
double click ''Push_up_centralized_data.vbs''
prompts 'do you want to ...'
answer Yes
when it is done, it will prompt 'finished'
click 'ok'
[[User:Srusnak|Srusnak]] 13:07, 2014 July 23 (CDT)
== Confirm data backups ==
Until we are comfortable with the process working, check that the backups for centralized are being created as they should be b [[Pull down centralized data.vbs]] and [[Push up centralized data.vbs]]. Once we are confident I would recommend a monthly Outlook task to check, with the link to the directory included. Ttenbergen 16:43, 2014 April 30 (CDT)
As per Trish, moved from [[1Backup.bat]], the [[Data Processor]] must regularly (at least once per week) check if backup went to location expected or not.  In the past main office has experienced backup batch files that for some reason stopped working. Because no one did regular checks we had long period with with no backup![[User:TOstryzniuk|Trish Ostryzniuk]] 18:54, 2014 April 29 (CDT)
[[Category:2013 data upgrades]]
[[Category:Data Processing]]
[[Category:Data Processing]]
At the end of the day, before backing up and going home,
'''ALWAYS''' make sure you are in the ''push'' mode
===BACK UP PROCEDURE===
Data processor can only perform ''Back Up'' in the ''Push'' mode.
Click on  ''Pagasa's Desktop'' (folder icon)
''CCMIS Batch_Files''
''1BackUp.bat''
press ''any key to continue''
enter
wait for it to do the back up
then it will say
''processing complete''
press any key to continue
[[User:Srusnak|Srusnak]] 12:45, 2014 July 30 (CDT)

Latest revision as of 15:42, 23 July 2025

"Vetting" is our name for the initial quality control our data goes through after Data collectors finish sending it. It is one of the main responsibilities of the Data Processor.

Instructions

Related articles

Related articles: