Known data errors: Difference between revisions
Ttenbergen (talk | contribs) Created page with "Just a parking spot for now... M:\GAPS_OVERLAP_OVERS contains a list of some of this." |
Ttenbergen (talk | contribs) m Text replacement - "[[Category: " to "[[Category:" |
||
| (12 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
Some records have known errors or data that triggers false positives in consistency checks. [[L Problem]] is a record of these so they can be excluded from queries. The table would usually be populated by the [[data collector]] during [[vetting]]. | |||
== Instructions for adding a record == | |||
If a false positive or known uncorrected error is found: | |||
# open table [[L Problem]] from [[Centralized data front end.accdb]] | |||
# make a new line | |||
#* D_ID field: the D_ID of the record | |||
#* Query field: the name of the query that detected this record and from which it should be masked | |||
#* Notes field: explanations, eg why the error was not corrected or why it is a false positive | |||
== Instructions for using the table in queries == | |||
For every query, filter the [[L Problem]] table to only records related to that query and only list if null. | |||
== List of queries that use [[L_Problem table]] (SMW) == | |||
(Based on [[Property:DICLProblem]], [[Property:DICStatus]] as set in [[Template:Data Integrity Check]].) | |||
{{#ask: [[DICStatus::not entered||implemented||ready to implement||needs review]] [[DICLProblem::true]] | |||
|?DICStatus = Status | |||
|?DICLProblem = problem | |||
|sort=Modification date | |||
|order=ascending | |||
|limit=10000 | |||
|format=broadtable | |||
|link=all | |||
|class=sortable wikitable smwtable | |||
}} | |||
Cargo | |||
{{#cargo_query: | |||
tables=DataIntegrityChecks,Discussions,_pageData | |||
|join on=DataIntegrityChecks._pageName=_pageData._pageName,DataIntegrityChecks._pageName=Discussions._pageName | |||
|fields= | |||
DataIntegrityChecks._pageName=page, Status, Timing, Summary, Status | |||
|where=App="Centralized data front end.accdb " and (Status<>"retired" and Status<>"declined") and (L_Problem=true or L_Problem is null) | |||
|order by=question | |||
|limit=20 | |||
|more results text=Link to table of cross-checks that use L_Problem table to exclude false-positives | |||
|default=Nothing found | |||
|format=dynamic table | |||
|rows per page=20 | |||
}} | |||
== Other known errors == | |||
We store information about some other known errors in the [[L_Problem table]]: | |||
* [[Gaps and overlaps]] | |||
* [[Lost/missing chart]] | |||
== Related articles == | |||
{{Related Articles}} | |||
[[Category:Data Processing]] | |||