Centralized data Vetting Process: Difference between revisions

From CCMDB Wiki
Jump to navigation Jump to search
m (→‎Checklist Tracker Sheet: link and questions)
 
(83 intermediate revisions by 3 users not shown)
Line 1: Line 1:
*'''need to make sure all in [[Data Appending Process]] is addressed.'''
"Vetting" is our name for the initial quality control our data goes through after [[Data collector]]s finish [[sending]] it. It is one of the main responsibilities of the [[Data Processor]].


== Checklist Tracker Sheet ==
== Instructions ==
This is still part of the old system as a cross check until we go totally with the new system.
* [["Pull" Centralized data.mdb]]
* Double click to open ''Centralized_data_front_end.mdb''
* [[Reconnect CFE and initial error checks]]
* [[Pre-linking checks]] (PL checks)
* [[Populate linking_pairs]]
* [[Correcting suspect links]]
* [[Quality Assurance queries in CFE]] - NDC Queries
** as part of any of those, there might be [[Questioning data back to collectors]]
* [["Vet all sent" button]]
* [[Generate Person IDs]]
* [["Push" Centralized data.mdb]] to return data to [[Regional Server]] so [[Data collector]]s can [[send]]


===Print a ''checklist tracker sheet''===
== Related articles ==
*My Documents
{{Related Articles}}
*Open ''workbook2.xls''
*Change header to sent date (use Wed date)
**click Insert
**Header & Footer
**Change the date
**File
**Print


===Check to see that everyone has sent===
*RegionalWRHA (wreath icon)
*Output (folder)
*check each folder to see who sent, and write the # on the tracker sheet
**the data collector sends these files
***there are only ''complete'' files in these xls cvs files
**when viewing these in the xls file, the header is included as Line 1, so the actual # of files sent will be one less, e.g. if it says 11, then there were 10 complete files sent


===To check the ''incomplete'' files===
*make a copy of ''[[PDA Pending.mdb]]''
***we have stopped sending to pda pending, what if anything is being used now? Ttenbergen 20:41, 2014 September 29 (CDT) {{discussion}}
**Regional
**Output
**right click PDA_pending.mdb
**Copy
*Paste the copy on the desktop
*prompts ''already a copy...''
*answer Yes
*open PDA_Pending.mdb
*check each site and write down the # of ''incomplete'' on the tracker sheet
**when viewing these files the header is not included, so the # is how many files pending
***at the bottom it says ''Record __ of __''
*close each file you have opened
*close PDA_Pending.mdb
===Then ===
*check L_Log
*check L_PHI
*check L_LogPhi
*write these numbers on the tracker sheet
** are we really checking all three? If we checked just L_Log_PHI and it's correct, could the others possibly be wrong? Ttenbergen 20:44, 2014 September 29 (CDT) {{discussion}}
These files are found under the heading [[#Open Centralized Data Front End]] below
[[User:Srusnak|Srusnak]] 13:50, 2014 July 31 (CDT)
== Pull down data ==
Before processing run [[Pull_down_centralized_data.vbs]] to do backups and move data from the regional server for local processing. This also prevents collectors from sending while data is being processed.
The 'log' will show whether you are in 'push' or 'pull' mode.
* where would one find this log, pls tell a little more about it so someone first reading this would understand. Ttenbergen 10:02, 2014 July 24 (CDT)
At the beginning of the day, it should '''ALWAYS''' be in the 'push' mode.
The log is located in
RegionalWRHA (wreath icon)
Output (folder)
Logs (folder)
Deadline for collectors to send is Thursday at 1pm. 
When you 'pull'
''centralized.mdb''
and ''phi.mdb''
It goes into the desktop ''centralized_on_c'' (folder icon)
from the ''RegionalWRHA'' (wreath icon)
Pull mode is for the data processor to do edits, etc.
Push mode is for everyone else to see the data
'''**''' Before backing up, and going home '''ALWAYS''' make sure you are in the 'push' mode
===The Basic Steps===
1) Pull data - deadline to send is Thurs 1pm
2) See who Sent
this is where the data processor does a quick check for discrepencies in site, location, etc
3) Open Front End
4) Perform 'NDC Queries' to correct and clean data
steps are covered in '''Check For Problems''' below
5) Push data back
===STEPS TO PULL===
When in the ''Pull'' mode, data processor can edit, but not perform a ''Back Up''
Can only Back Up while in the ''Push'' mode
Go to ''Centralized_CCMDB'' (folder shortcut icon)
double click on ''Pull_down_centralized_data.vbs''
Prompts ''do you want to ...''
Answer Yes
Wait for the program to ''pull'' which takes approx. 5 minutes
Prompts ''finished processing pull script''
click OK
[[User:Srusnak|Srusnak]] 13:57, 2014 July 31 (CDT)
===STEPS TO SEE WHO SENT===
Pull --  ''Pull_down_centralized_data.vbs''
Queries
P_Count_Of_Sent (double click)
Home
View
Pivot Table
View
Filter by 'Date Sent'
*Right Click
*Field List
*drag 'sent Dt Time'
*close dialog box
Home
Design View
Change to 'Wed' date
Home
View
Pivot Table View
*shows the number of ''incomplete'' and ''sent'' in 2 separate tables
*use + (plus symbol) to expand
**when you expand, it shows the serial number
*use - (minus symbol) to collapse
Click inside the column and scroll down to do a quick check of the location
When done
click '''x'''(in top right) and '''DO NOT''' 'save'
It will prompt you 'do you want to save'
say NO
'''When finished viewing, just close, DO NOT 'save''''
===OPEN CENTRALIZED DATA FRONT END===
Double click to open ''Centralized_data_front_end.mdb''
Reconnect
Open Patient List
on the Left side,
scroll All Access Objects
Tables
L_Log
*write down the number
L_PHI
*write down the number
click ''back to top''
Queries
L_Log_PHI
*write down the number
'''**ALL 3 must be the same**'''
Double check these numbers against the tracker sheet, which compares the old to the new combined centralized numbers
The ''complete'' numbers come from the xls csv file
The ''incomplete'' numbers come from the PDA_pending file
L_Log,  L_PHI, and L_Log_PHI are part of the new combined centralized numbers.  These get checked after we ''Pull''
[[User:Srusnak|Srusnak]] 13:49, 2014 July 30 (CDT)
===OPTION TO VIEW DATA===
'''**You cannot edit any data.  The background will be red.**
'''
Go to ''Regional''
Output
Right click on ''centralized_data.mdb''
Copy
Then go to ''Pagasa's Centralized Manual Copy''
Paste
Then go into '''X'''
CCMDB
PHI
Right click on ''phi.mdb''
Copy
Then go to ''Pagasa's Centralized Manual Copy''
Paste
Double click on ''Centralized DataFrontEnd.mdb''
Reconnect
Open Patient List
'''**This only allows the data processor to VIEW these files.  The background will be red.**
'''
[[User:Srusnak|Srusnak]] 13:52, 2014 July 31 (CDT)
==clean ups==
=== do ONLY once when we import Ed's to centralized.mdb ===
* ''1use_only_update_3000_transfer_dates_to_null''
== Make PseudoPHINs ==
If it is determined that a patient legitimately without PHIN (e.g. out of province) has not been encountered before, generate a [[PseudoPHIN]]: 
# open the patient from the patient list
# click the '''pseudo''' button to the left of the PHIN field label
# the program will look up the highest previous PseudoPHIN and enter that + 1 into the PHIN field
When you are in
NDC_Phin Fake or Blank
sort 'RecStatus' by ZtoA
sort by LastName
Check the 'cat' first to make sure if a single encounter or a multiple encounter
If a multiple encounter, then  copy & paste the already assigned Phin
To change the Phin
Go on the 'binoculars' for that patient
delete the erroneous Phin, or the zero
click on the 'pseudo' button, and it will automatically asign a Phin
then it will prompt 'Do you want to ...'
say 'yes'
[[User:Srusnak|Srusnak]] 13:26, 2014 July 17 (CDT)
== Check for problems ==
Use [[Centralized data front end.mdb]] "NDC" (''New Data Check'') queries and fix data as needed; if a patient shows up in one of the queries fix if possible; if question to collector is required, set '''[[Record Status field]] to "questioned"'''
Perform the Queries in this order:
1. [[Orphans in Centralized data.mdb| "NDC_orphans"]]
should always be zero
2. NDC_Chart_9_Digit
3. NDC_Phin Fake or Blank
Home
Advanced
Advanced Filter Sort
LastName
Ascending
Toggle Filter
(This sorts by LastName)
*''' before assigning pseudo phin, make sure to check for the highest number in ''Highest Pseudo Phin'''''
** what do you do with that info? I thought we assing the pseudophin automatically now... Ttenbergen 09:57, 2014 July 31 (CDT) {{discussion}}
'''DO NOT''' assign pseudo Phin if a single, or if 'incomplete'
If they have previous encounters, we can correct that unassigned phin with the phin from the previous encounter
'''See''' 'Make Pseudo Phins'
'''Highest Pseudo Phin'''
When you are in NDC_Highest_Pseudo_Phin, you just want to do a quick check to make sure your assigned pseudo phin will be the correct one
Click on the first Phin in the Phin column
Right click
Sort by ''Largest to Smallest''
* {{discussion}} have we ever had the automatic process not assign the right next pseudophin? If not this may not be a required check. If we do want to keep doing this then let's fix the NDC query to not have to sort. Ttenbergen 09:59, 2014 July 31 (CDT)
Then when you assign a pseudo phin, you will see that the next assigned phin will be the next one after that highest one,  e.g.  highest psuedo phin is 7432, then the next assigned pseudo phin will be 7433
4. NDC_Diff_Phin__SameLN_FN_DOB
Home
Advanced
Advanced Filter/Sort
LastName (double click or drag & drop)
Sort by ''ascending''
Home
Toggle Filter
5. NDC_SameChart_Site_Diff_Phin
6. NDC_SamePhin_Diff_LN_FN_DOB_Sex
Home
Advanced
Advanced Filter/sort
Phin (double click or drag & drop)
Sort by ''ascending''
Home
Toggle Filter
7. NDC_SamePHIN_Site_Diff_chart
8. NDC_CLI_AcqDX_but_NoCLI_DateinTMPV2 (see [[CLI Dx vs Tmp checking]])
9. NDC_CLI_No_AcqDX_but_CLI_DateinTMPV2 (see [[CLI Dx vs Tmp checking]])
10. NDC_CLI_unacceptable_date (see [[CLI Dx vs Tmp checking]])
11. NDC_VAP_AcqDX_but_NoVAP_DateinTMPV2 (see [[VAP Dx vs Tmp checking]])
12. NDC_VAP_No_AcqDX_but_VAP_DateinTMPV2 (see [[VAP Dx vs Tmp checking]])
13. NDC_VAP_unacceptable_date (see [[VAP Dx vs Tmp checking]])
14. NDC_unvetted
Once every query has been performed, checked, and cleaned
then perform the first 7 queries once more, to make sure data is all clean and you did not forget any corrections
then ''Vet All Sent''
This changes the record status 'sent' to 'vetted'
For Queries 8-13
we are only monitoring ICU
look for 2014 ''sent'' and see if it has to be investigated
'''still working on this one''' (have not done this one yet)
[[Transfer_Ready_date_and_time #NDC_Missing_TransferDate_w_pivot|NDC_Missing_TransferDate_wPivot]]
[[User:Srusnak|Srusnak]] 12:01, 2014 July 23 (CDT)
== Set record as vetted ==
At this point all records with problems will have had the [[Record Status field]] set to "questioned" so the remaining ones that are set to "sent" are clean and can be set to "vetted". Press the "vet all sent" button. This will change all records currently set to "sent" to "vetted".
===VET ALL SENT===
When all data is cleaned, the last query is ''NDC_unvetted''
On the 'RecStatus' column
Right click the first one
Sort by Z to A which will sort by Sent, Questioned, Incomplete statuses
Scroll down to the last 'sent' record, to see how many records will be vetted
Then ''Vet All Sent''
Prompts 'are you sure'
answer Yes
prompts 'you are about to run ...'
answer Yes
prompts 'you are about to update ___ rows'
answer Yes
The number in the ''___ rows'', should be the same as the last 'sent' record from your scroll down
e.g. if your last 'sent' record was 25, then the prompt will say 'you are about to update 25 rows'
[[User:Srusnak|Srusnak]] 12:00, 2014 July 23 (CDT)
== Push up data ==
When all processing is done, run [[Push_up_centralized_data.vbs]] to return the data to where collectors can add to it.
Once all data is clean, then we can ''Vet All Sent''  (see '''Set record as vetted''')
===PUSH DATA STEPS===
Go to ''Centalized_CCMDB''
double click ''Push_up_centralized_data.vbs''
prompts 'do you want to ...'
answer Yes
when it is done, it will prompt 'finished'
click 'ok'
[[User:Srusnak|Srusnak]] 13:07, 2014 July 23 (CDT)
== Confirm data backups ==
Until we are comfortable with the process working, check that the backups for centralized are being created as they should be b [[Pull down centralized data.vbs]] and [[Push up centralized data.vbs]]. Once we are confident I would recommend a monthly Outlook task to check, with the link to the directory included. Ttenbergen 16:43, 2014 April 30 (CDT)
As per Trish, moved from [[1Backup.bat]], the [[Data Processor]] must regularly (at least once per week) check if backup went to location expected or not.  In the past main office has experienced backup batch files that for some reason stopped working. Because no one did regular checks we had long period with with no backup![[User:TOstryzniuk|Trish Ostryzniuk]] 18:54, 2014 April 29 (CDT)
[[Category:2013 data upgrades]]
[[Category:Data Processing]]
[[Category:Data Processing]]
At the end of the day, before backing up and going home,
'''ALWAYS''' make sure you are in the ''push'' mode
===BACK UP PROCEDURE===
Data processor can only perform ''Back Up'' in the ''Push'' mode.
Click on  ''Pagasa's Desktop'' (folder icon)
''CCMIS Batch_Files''
''1BackUp.bat''
press ''any key to continue''
enter
wait for it to do the back up
then it will say
''processing complete''
press any key to continue
[[User:Srusnak|Srusnak]] 12:45, 2014 July 30 (CDT)

Latest revision as of 21:25, 2022 March 24

"Vetting" is our name for the initial quality control our data goes through after Data collectors finish sending it. It is one of the main responsibilities of the Data Processor.

Instructions

Related articles

Related articles: