Instructions for requesting a batch of data from DSM
This article describes how to generate the requestor file for the DSM Lab Extract. The file is stored on a file share that DSM can access. See Instructions for importing a batch of DSM Data for the related import process.
How frequently to request
We will request quarterly.
Initially our DSM contact had concerns about workload and wanted a lower frequency, but then he said "Send on the ‘requestor’ file as often as you want to see the output and I will make the time." (as per email from Alun Carter, Monday, February 06, 2017 10:50)
Instruction/steps for requesting data
- copy files to local, they are large and won't work well on a share.
- make a new local directory
- Put the following into the directory
- make sure you have data where the NDC's have been completed. You should copy PREVIOUS days backup of both the centralized and PHIA data files.
- Centralized_data.mdb -the last one has been fully checked for links
- PHI.mdb
- DSM_Labs_Consistency_check.accdb
- DSM Labs data.accdb
- make sure you have data where the NDC's have been completed. You should copy PREVIOUS days backup of both the centralized and PHIA data files.
- open DSM Labs Consistency check.accdb
- click the "Export requestor file" button
- If you get the error message 58- there is already file in the folder that you need to delete.
- follow the wizard, which will export a file to the shared folder and start an email to DSM
- close Access and delete files you had copied
- enter at the top of the log below when you requested data, and for what range
- check the number requestors.xls if the same as the number you requested by using the send date time.
missing dispo dates
if at import time a dispo dttm is still missing it will be replaced with Now().
Dependencies
The request process asks for all, and the import process de-duplicates, so there should be no gaps or overlaps.
Requesting Lab DSM
- Need to send quarterly
Log
Put newest entry at the top
| Request Date | No_Records | Unmatched D_ID with DSM dump | SendDtTm range start | SendDtTm range end | Date Imported to Database | Comments |
|---|---|---|---|---|---|---|
| 2022 Jun 01 | 7337 | 2021 Dec 31 | 2022 Jun 01 | 2022 Jun 10 | Sent Vetted only. PT Import - 2975 Blanks (41%). | |
| 2022 Jan 02 | 3970 | 70 (1.8%) | 2021 Oct 13 | 2021 Dec 31 | 2022 Jun 10 | PT Sent only Vetted profiles. (JM using SAS - 95 have matched D_ID but no corresponding Lab dates.) PT import - Blanks 2522 (63%). |
| 2021 Oct 13 | 3984 | 64 (1.6%) | 2021 July 20 | 2021 Oct 13 | 2022 Jun 09 | PT Sent only Vetted profiles. (JM using SAS - 6 D_IDs at requestor were re-labeled to match the L_LOG; 104 have matched D_ID but no corresponding Lab Dates.) PT import - Blanks 1275 (32%). |
| 2021 July 20 | 8015 | 2021 Apr 15 | 2021 July 20 | 2021 Aug 12 | Included Incomplete = 3164 and Vetted = 4851 | |
| 2021 Apr 15 | 6289 | 2021 Jan 19 | 2021 Apr 15 | 2021-June 09 | Included Incomplete=3163 and Vetted=3126. | |
| 2021 Jan 19 | 4167 | 2020-Nov-27 | 2021-Jan-19 | 2021-Jan-27 | Included Incomplete=2076 and Vetted=2091. The following 5 Incompletes (H3_HSC_H4-19723, H3_HSC_H4-19777,H3_HSC_H4-19790, G8_GRA_N3-19794,G8_GRA_N3-19968) are not included on this sent because of D_ID changes. | |
| 2020 Dec 03 | 2580 | 2020-Sep-30 | 2020-Nov-27 | 2021-Jan-27 | Included only the VETTED in the requestor.xlsx | |
| 2020 Oct 14 | 1836 | 34 (1.8%) | 2020-Aug-31 | 2020-Sep-30 | 2020-Oct-29 | JM did this Oct2020: unmatched 34 (1.8%) |
| 2020 Aug 31 | 3589 | 237 (6.6%) | 2020-Jul-15 | 2020-Aug-31 | 2020-Sep-30 | JM re-do Oct2020: unmatched 237 (6.6%) |
| 2020 Jul 15 | 6848 | 1345 (19%) | 2020-Apr-21 | 2020-Jul-15 | 2020-Aug-14 | Added 793(12%) unmatched from batch 21April2020 making the total=6848; 1189 out 6848 are incomplete (398 with no dispo date and 791 with dispo date); JM re-do Oct2020: unmatched 681 (9.9%) |
| 2020 Apr 21 | 6269 | 766 (12%) | 2020-Jan-27 | 2020-Apr-21 | 2020-May15 | JM re-do Oct2020: unmatched 393 (6.3%) |
| 2020 Jan 27 | 5567 | 413 (7%) | 2019-Nov-20 | 2020-Jan-27 | 2020-Feb-10 | JM re-do Oct2020: unmatched 516 (9.3%) |
| 2019 Nov 21 | 7350 | 417 (5%) | 2019-Jul-31 | 2019-Nov-20 | 2019-Dec-18 | JM re-do Oct2020: unmatched 557 (7.6%) |
| 2019 Jul 31 | 5738 | 146 (2.5%) | 2019-May-13 | 2019-Jul-31 am | 2019-Oct-24 | JM re-do Oct2020: unmatched 410 (7.8%) |
| 2019 May 13 | 3583 | 491 (13%) | 2019-Mar-27 | 2019-May-13 am | 2019-May-29 | JM re-do Oct2020: unmatched 239 (6.7%) |
| 2019 Mar 28 | 4198 | 249 (6%) | 2019-Jan-23 | 2019-Mar-27 am | 2019-Apr-10 | JM re-do Oct2020: unmatched 320 (7.6%) |
| 2019 Jan 23 | 4521 | 1st- 1220 (27%), 2nd- 334 (7%) | 2018-Oct-31 | 2019-Jan-23 am | 1st- 2019-Mar-9; 2nd- 2019-Jun-14 | 1612 records of HSC have no lab data and re-send June 6, 2019; JM re-do Oct2020: unmatched 330 (7.8%) |
| 2018 Oct 31 | 5873 | 508 (9%) | 2018-Jul-11 | 2018-Oct-31 am | 2019-Mar-9 | |
| 2018 Jul 11 | 1716 | 106 (6%) | 2018-Jun-19 | 2018-Jul-11 am | 2019-Mar-9 | |
| 2018 Jun 19 | 4212 | 378 (9%) | 2018-Apr-05 | 2018-Jun-19 am | 2019-Mar-10 | |
| 2018 Apr 5 | 4532 | 359 (8%) | 2018-Jan-25 | 2018-Apr-05 am | 2018-May-18 | |
| 2018 Jan 25 | 5710 | 448 (8%) | 2017-Oct-26 | 2018-Jan-25 am | 2018-Apr-9 | |
| 2017 Oct 26 | 16590 | 1246 (8%) | 2016-Dec-31 | 2017-Oct-26 am | 2018-Apr-9 | |
| 2017-Mar-14 | 6078 | 559 (9%) | 2016-Aug-30 | 2016-Dec-31 am | 2017-Apr-12 ? |
Early requests that followed a different pattern:
- 16:05, 2016 October 17 (CDT) || 2016-08-01 (but use 1980-01-01 for import because first one) until 2016-08-30
- 2015-12-?? - Discharge date 2015-04-01 - 2015-04-30