Centralized data Vetting Process: Difference between revisions

From CCMDB Wiki
Jump to navigation Jump to search
← Older edit
No edit summary
m Text replacement - "[["Pull" Centralized_data.accdb]]" to ""Pull" Centralized_data.accdb"
 
(172 intermediate revisions by 4 users not shown)
Line 1: Line 1:
''see also [[Query for centralized]] for now.  
"Vetting" is our name for the initial quality control our data goes through after [[Data collector]]s finish [[sending]] it. It is one of the main responsibilities of the [[Data Processor]].
'' see [[Basic Analysis Capabilities]] for functionality not related to vetting new data


'''Need to resolve all http://ccmdb.kuality.ca/index.php/Special:WhatLinksHere/Centralized_data_Vetting_Process '''
== Instructions ==
* [["Pull" Centralized_data.accdb]]
* Double click to open ''Centralized_data_front_end.mdb''
* [[Reconnect CFE and initial error checks]]
* [[Pre-linking checks]] (PL checks)
* [[Populate linking_pairs]]
* [[Correcting suspect links]]
* [[Quality Assurance queries in CFE]] - NDC Queries
** as part of any of those, there might be [[Questioning data back to collectors]]
* [["Vet all sent" button]]
* [[Generate Person IDs]]
* [["Push" Centralized_data.accdb]] to return data to [[Regional Server]] so [[Data collector]]s can [[send]]


need to make sure all in [[Data Appending Process]] is addressed.
== Related articles ==
{{Related Articles}}


== Pull down data ==
'''not yet implemented... Ttenbergen 11:43, 2014 February 9 (CST)


Before processing run [[Pull_down_centralized_data.bat]] to do backups and move data from the regional server for local processing. This also prevents collectors from sending while data is being processed.
== Make PseudoPHINs ==
As a first step, make [[PseudoPHIN]]s for all entries, since the further checks depend on there beeing meaningful PHINs.
# Run NDC_PHIN_Fake_Blank and resolve PHINs using the "likely matches" form, accessed via the shaking hands button. Resolve all records on list until that query returns no results.
({{discussion}} NDC_Highest_PseudoPHIN canlikely go since we now have the pseudophin button. agreed? Ttenbergen 11:39, 2014 February 9 (CST))
== Check for problems ==
Use [[Centralized data front end.mdb]] "NDC" (New Data Check) queries and fix data as needed:
# NDC_SamePHIN_Site_Diff_chart - fix
# NDC_Chart_9_Digit - fix
# NDC_DiffPhin_SameLN_FN_DOB - confirm correct (do we have a list for false positives?), fix if needs
# NDC_SamePhin_Diff_LN_FN_DOB_Sex - confirm correct (do we have a list for false positives?), fix if needs
#NDC_SameChart_site_Diff_PHIN
#a) started: NDC_VAPinAcqDX_NoVAP_DateinTMPV2
#*b)started: ND_sub_VAPinAcqDX_NoVAP_DateinTMPV2_sub_TMPV2_component
#a) started: NDC_No_VAPinAcqDX_VAP_dateinTMPV2
#*b)started: ND_sub_NoVAPinAcqDX_VAP_DateinTMPV2_sub_had_VAP_acqDX
#need to create: CLIinAcqDX_NoCLI_DateinTMPV2
#need to create: No_CLIinAcqDX_CLI_DateinTMPV2
== changes needing to be implemented ==
=== CCMDB changes ===
'' the following could be done in CCMDB.mdb since all data is already available at collection; still can also do them in front end, should implement them so they translate easily... Ttenbergen 11:22, 2014 February 5 (CST)''
#started in centralized front end: See 8a & b above: NDC_VAPinAcqDX_NoVAP_DateinTMPV2
#started in centralize front end: see 9 above: NDC_No_VAPinAcqDX_VAP_dateinTMPV2
#need to create: CLIinAcqDX_NoCLI_DateinTMPV2
#need to create: No_CLIinAcqDX_CLI_DateinTMPV2
== Set record as vetted ==
* last: set [[Record Status field]] to ... how does "vetted" sound? if so, get rid of this comment. Ttenbergen 15:01, 2014 January 16 (CST) {{discussion}}
**How and when do you see Pagasa using this field?
== Push up data ==
'''not yet implemented... Ttenbergen 11:43, 2014 February 9 (CST)
When all processing is done, run [[Push_up_centralized_data.bat]] to return the data to where collectors can add to it.
[[Category:2013 data upgrades]]
[[Category:Data Processing]]
[[Category:Data Processing]]

Latest revision as of 15:42, 23 July 2025

"Vetting" is our name for the initial quality control our data goes through after Data collectors finish sending it. It is one of the main responsibilities of the Data Processor.

Instructions

Related articles

Related articles:
Retrieved from "https://ccmdb.kuality.ca/index.php?title=Centralized_data_Vetting_Process&oldid=165571"