Centralized data Vetting Process: Difference between revisions

TOstryzniuk (talk | contribs)
m Text replacement - "[["Pull" Centralized_data.accdb]]" to ""Pull" Centralized_data.accdb"
 
(170 intermediate revisions by 4 users not shown)
Line 1: Line 1:
''see also [[Query for centralized]] for now.  
"Vetting" is our name for the initial quality control our data goes through after [[Data collector]]s finish [[sending]] it. It is one of the main responsibilities of the [[Data Processor]].
'' see [[Basic Analysis Capabilities]] for functionality not related to vetting new data


'''Need to resolve all http://ccmdb.kuality.ca/index.php/Special:WhatLinksHere/Centralized_data_Vetting_Process '''
== Instructions ==
* [["Pull" Centralized_data.accdb]]
* Double click to open ''Centralized_data_front_end.mdb''
* [[Reconnect CFE and initial error checks]]
* [[Pre-linking checks]] (PL checks)
* [[Populate linking_pairs]]
* [[Correcting suspect links]]
* [[Quality Assurance queries in CFE]] - NDC Queries
** as part of any of those, there might be [[Questioning data back to collectors]]
* [["Vet all sent" button]]
* [[Generate Person IDs]]
* [["Push" Centralized_data.accdb]] to return data to [[Regional Server]] so [[Data collector]]s can [[send]]


need to make sure all in [[Data Appending Process]] is addressed.
== Related articles ==
{{Related Articles}}


== Pull down data ==
'''not yet implemented... Ttenbergen 11:43, 2014 February 9 (CST)


Before processing run [[Pull_down_centralized_data.bat]] to do backups and move data from the regional server for local processing. This also prevents collectors from sending while data is being processed.
== Make PseudoPHINs ==
As a first step, make [[PseudoPHIN]]s for all entries, since the further checks depend on there beeing meaningful PHINs.
# Run NDC_PHIN_Fake_Blank and resolve PHINs using the "likely matches" form, accessed via the shaking hands button. Resolve all records on list until that query returns no results.
{{discussion}} NDC_Highest_PseudoPHIN canlikely go since we now have the pseudophin button. agreed? Ttenbergen 11:39, 2014 February 9 (CST))
== Check for problems ==
Use [[Centralized data front end.mdb]] "NDC" (New Data Check) queries and fix data as needed:
# NDC_SamePHIN_Site_Diff_chart - fix
# NDC_Chart_9_Digit - fix
# NDC_DiffPhin_SameLN_FN_DOB - confirm correct (do we have a list for false positives?), fix if needs
# NDC_SamePhin_Diff_LN_FN_DOB_Sex - confirm correct (do we have a list for false positives?), fix if needs
# NDC_SameChart_site_Diff_PHIN
# NDC_Missing_TransferDate_wPivot
#a) started: NDC_VAPinAcqDX_NoVAP_DateinTMPV2
#*b)started: ND_sub_VAPinAcqDX_NoVAP_DateinTMPV2_sub_TMPV2_component
#a) started: NDC_No_VAPinAcqDX_VAP_dateinTMPV2
#*b)started: ND_sub_NoVAPinAcqDX_VAP_DateinTMPV2_sub_had_VAP_acqDX
#need to create: CLIinAcqDX_NoCLI_DateinTMPV2
#need to create: No_CLIinAcqDX_CLI_DateinTMPV2
== changes needing to be implemented ==
=== CCMDB changes ===
'' the following could be done in CCMDB.mdb since all data is already available at collection; still can also do them in front end, should implement them so they translate easily... Ttenbergen 11:22, 2014 February 5 (CST)''
#started in centralized front end: See 8a & b above: NDC_VAPinAcqDX_NoVAP_DateinTMPV2
#started in centralize front end: see 9 above: NDC_No_VAPinAcqDX_VAP_dateinTMPV2
#need to create: CLIinAcqDX_NoCLI_DateinTMPV2
#need to create: No_CLIinAcqDX_CLI_DateinTMPV2
== Set record as vetted ==
* last: set [[Record Status field]] to ... how does "vetted" sound? if so, get rid of this comment. Ttenbergen 15:01, 2014 January 16 (CST) {{discussion}}
**How and when do you see Pagasa using this field?
== Push up data ==
'''not yet implemented... Ttenbergen 11:43, 2014 February 9 (CST)
When all processing is done, run [[Push_up_centralized_data.bat]] to return the data to where collectors can add to it.
[[Category:2013 data upgrades]]
[[Category:Data Processing]]
[[Category:Data Processing]]