Known data errors: Difference between revisions

(17 intermediate revisions by 2 users not shown)

Line 1:

~~The [[Data processor]] keeps an Excel workbook~~ that ~~includes: reason some profiles are missing data elements (APACHE - 8 ICU profiles), gaps~~ in ~~database because of deletions including reasons for deletions, overlaps, overs~~. ~~Example missing all~~ [[~~APACHE~~]] ~~elements in~~ [[~~TMSX~~]], [[~~MedTMS~~]] ~~and reason why could never be obtained~~.~~18:01, 2014 May 2 (CDT)~~

Some records have known errors or data that triggers false positives in consistency checks. [[L Problem]] is a record of these so they can be excluded from queries. The table would usually be populated by the [[data collector]] during [[vetting]].

==~~Location of List~~==

== Instructions for adding a record ==

M:~~\GAPS_OVERLAP_OVERS~~

If a false positive or known uncorrected error is found:

# open table [[L Problem]] from [[Centralized data front end.accdb]]

# make a new line

#* D_ID field: the D_ID of the record

#* Query field: the name of the query that detected this record and from which it should be masked

#* Notes field: explanations, eg why the error was not corrected or why it is a false positive

==~~Link~~ table ~~to centralized.mdb~~==

== Instructions for using the table in queries ==

~~Tina~~ to ~~review this at a later date. Discussion about 8 profiles missing~~ only ~~APACHE~~ and ~~specific reason why missing etc. Suggestion was to link a table so reason why missing is together with centralized.mdb~~.~~[[User:TOstryzniuk|Trish Ostryzniuk]] 18:01, 2014 May 2 (CDT)~~

For every query, filter the [[L Problem]] table to only records related to that query and only list if null.

== List of queries that use [[L_Problem table]] (SMW) ==

(Based on [[Property:DICLProblem]], [[Property:DICStatus]] as set in [[Template:Data Integrity Check]].)

{{#ask: [[DICStatus::not entered||implemented||ready to implement||needs review]] [[DICLProblem::true]]

|?DICStatus = Status

|?DICLProblem = problem

|sort=Modification date

|order=ascending

|limit=10000

|format=broadtable

|link=all

|class=sortable wikitable smwtable

}}

Cargo

{{#cargo_query:

tables=DataIntegrityChecks,Discussions,_pageData

|join on=DataIntegrityChecks._pageName=_pageData._pageName,DataIntegrityChecks._pageName=Discussions._pageName

|fields=

DataIntegrityChecks._pageName=page, Status, Timing, Summary, Status

|where=App="Centralized data front end.accdb " and (Status<>"retired" and Status<>"declined") and (L_Problem=true or L_Problem is null)

|order by=question

|limit=20

|more results text=Link to table of cross-checks that use L_Problem table to exclude false-positives

|default=Nothing found

|format=dynamic table

|rows per page=20

}}

== Other known errors ==

We store information about some other known errors in the [[L_Problem table]]:

* [[Gaps and overlaps]]

* [[Lost/missing chart]]

== Related articles ==

[[Category:Data Processing]]

[[Category: Data Processing]]

@@ Line 1: / Line 1: @@
-The [[Data processor]] keeps an Excel workbook that includes: reason some profiles are missing data elements (APACHE - 8 ICU profiles),  gaps in database because of deletions including reasons for deletions, overlaps, overs.    Example missing all [[APACHE]] elements in [[TMSX]], [[MedTMS]] and reason why could never be obtained.18:01, 2014 May 2 (CDT)
+Some records have known errors or data that triggers false positives in consistency checks. [[L Problem]] is a record of these so they can be excluded from queries. The table would usually be populated by the [[data collector]] during [[vetting]].
-==Location of List==
+== Instructions for adding a record ==
-M:\GAPS_OVERLAP_OVERS
+If a false positive or known uncorrected error is found:
+# open table [[L Problem]] from [[Centralized data front end.accdb]]
+# make a new line
+#* D_ID field: the D_ID of the record
+#* Query field: the name of the query that detected this record and from which it should be masked
+#* Notes field: explanations, eg why the error was not corrected or why it is a false positive
-==Link table to centralized.mdb==
+== Instructions for using the table in queries ==
-Tina to review this at a later date.  Discussion about 8 profiles missing only APACHE and specific reason why missing etc. Suggestion was to link a table so reason why missing is together with centralized.mdb.[[User:TOstryzniuk|Trish Ostryzniuk]] 18:01, 2014 May 2 (CDT)
+For every query, filter the [[L Problem]] table to only records related to that query and only list if null.
+== List of queries that use [[L_Problem table]] (SMW) ==
+(Based on [[Property:DICLProblem]], [[Property:DICStatus]] as set in [[Template:Data Integrity Check]].)
+{{#ask: [[DICStatus::not entered||implemented||ready to implement||needs review]] [[DICLProblem::true]]
+ |?DICStatus = Status
+ |?DICLProblem = problem
+ |sort=Modification date
+ |order=ascending
+ |limit=10000
+ |format=broadtable
+ |link=all
+ |class=sortable wikitable smwtable
+}}
+Cargo
+{{#cargo_query:
+tables=DataIntegrityChecks,Discussions,_pageData
+|join on=DataIntegrityChecks._pageName=_pageData._pageName,DataIntegrityChecks._pageName=Discussions._pageName
+|fields=
+DataIntegrityChecks._pageName=page, Status, Timing, Summary, Status
+|where=App="Centralized data front end.accdb " and (Status<>"retired" and Status<>"declined") and (L_Problem=true or L_Problem is null)
+|order by=question
+|limit=20
+|more results text=Link to table of cross-checks that use L_Problem table to exclude false-positives
+|default=Nothing found
+|format=dynamic table
+|rows per page=20
+}}
+== Other known errors ==
+We store information about some other known errors in the [[L_Problem table]]:
+* [[Gaps and overlaps]]
+* [[Lost/missing chart]]
+== Related articles ==
+{{Related Articles}}
+[[Category:Data Processing]]
-[[Category: Data Processing]]