Instructions for requesting a batch of data from DSM

From CCMDB Wiki
Revision as of 14:09, 2022 June 20 by JMojica (talk | contribs)
Jump to navigation Jump to search

This article describes how to generate the requestor file for the DSM Lab Extract. The file is stored on a file share that DSM can access. See Instructions for importing a batch of DSM Data for the related import process.

How frequently to request

We will request quarterly.

Initially our DSM contact had concerns about workload and wanted a lower frequency, but then he said "Send on the ‘requestor’ file as often as you want to see the output and I will make the time." (as per email from Alun Carter, Monday, February 06, 2017 10:50)

Instruction/steps for requesting data

  1. copy files to local, they are large and won't work well on a share.
  2. open DSM Labs Consistency check.accdb
  3. click the "Export requestor file" button
  4. If you get the error message 58- there is already file in the folder that you need to delete.
  5. follow the wizard, which will export a file to the shared folder and start an email to DSM
  6. close Access and delete files you had copied
  7. enter at the top of the log below when you requested data, and for what range
  8. check the number requestors.xls if the same as the number you requested by using the send date time.

missing dispo dates

if at import time a dispo dttm is still missing it will be replaced with Now().

Dependencies

The request process asks for all, and the import process de-duplicates, so there should be no gaps or overlaps.

Requesting Lab DSM

  • Need to send quarterly


Log

Put newest entry at the top

Request Date No_Records Unmatched D_ID with DSM dump SendDtTm range start SendDtTm range end Date Imported to Database Comments
2022 Jun 01 7337 2021 Dec 31 2022 Jun 01 2022 Jun 10 Sent Vetted only. PT Import - 2975 Blanks (41%).
2022 Jan 02 3970 70 (1.8%) 2021 Oct 13 2021 Dec 31 2022 Jun 10 PT Sent only Vetted profiles. (JM using SAS - 95 have matched D_ID but no corresponding Lab dates.) PT import - Blanks 2522 (63%).
2021 Oct 13 3984 64 (1.6%) 2021 July 20 2021 Oct 13 2022 Jun 09 PT Sent only Vetted profiles. (JM using SAS - 6 D_IDs at requestor were re-labeled to match the L_LOG; 104 have matched D_ID but no corresponding Lab Dates.) PT import - Blanks 1275 (32%).
2021 July 20 8015 2021 Apr 15 2021 July 20 2021 Aug 12 Included Incomplete = 3164 and Vetted = 4851
2021 Apr 15 6289 2021 Jan 19 2021 Apr 15 2021-June 09 Included Incomplete=3163 and Vetted=3126.
2021 Jan 19 4167 2020-Nov-27 2021-Jan-19 2021-Jan-27 Included Incomplete=2076 and Vetted=2091. The following 5 Incompletes (H3_HSC_H4-19723, H3_HSC_H4-19777,H3_HSC_H4-19790, G8_GRA_N3-19794,G8_GRA_N3-19968) are not included on this sent because of D_ID changes.
2020 Dec 03 2580 2020-Sep-30 2020-Nov-27 2021-Jan-27 Included only the VETTED in the requestor.xlsx
2020 Oct 14 1836 34 (1.8%) 2020-Aug-31 2020-Sep-30 2020-Oct-29 JM did this Oct2020: unmatched 34 (1.8%)
2020 Aug 31 3589 237 (6.6%) 2020-Jul-15 2020-Aug-31 2020-Sep-30 JM re-do Oct2020: unmatched 237 (6.6%)
2020 Jul 15 6848 1345 (19%) 2020-Apr-21 2020-Jul-15 2020-Aug-14 Added 793(12%) unmatched from batch 21April2020 making the total=6848; 1189 out 6848 are incomplete (398 with no dispo date and 791 with dispo date); JM re-do Oct2020: unmatched 681 (9.9%)
2020 Apr 21 6269 766 (12%) 2020-Jan-27 2020-Apr-21 2020-May15 JM re-do Oct2020: unmatched 393 (6.3%)
2020 Jan 27 5567 413 (7%) 2019-Nov-20 2020-Jan-27 2020-Feb-10 JM re-do Oct2020: unmatched 516 (9.3%)
2019 Nov 21 7350 417 (5%) 2019-Jul-31 2019-Nov-20 2019-Dec-18 JM re-do Oct2020: unmatched 557 (7.6%)
2019 Jul 31 5738 146 (2.5%) 2019-May-13 2019-Jul-31 am 2019-Oct-24 JM re-do Oct2020: unmatched 410 (7.8%)
2019 May 13 3583 491 (13%) 2019-Mar-27 2019-May-13 am 2019-May-29 JM re-do Oct2020: unmatched 239 (6.7%)
2019 Mar 28 4198 249 (6%) 2019-Jan-23 2019-Mar-27 am 2019-Apr-10 JM re-do Oct2020: unmatched 320 (7.6%)
2019 Jan 23 4521 1st- 1220 (27%), 2nd- 334 (7%) 2018-Oct-31 2019-Jan-23 am 1st- 2019-Mar-9; 2nd- 2019-Jun-14 1612 records of HSC have no lab data and re-send June 6, 2019; JM re-do Oct2020: unmatched 330 (7.8%)
2018 Oct 31 5873 508 (9%) 2018-Jul-11 2018-Oct-31 am 2019-Mar-9
2018 Jul 11 1716 106 (6%) 2018-Jun-19 2018-Jul-11 am 2019-Mar-9
2018 Jun 19 4212 378 (9%) 2018-Apr-05 2018-Jun-19 am 2019-Mar-10
2018 Apr 5 4532 359 (8%) 2018-Jan-25 2018-Apr-05 am 2018-May-18
2018 Jan 25 5710 448 (8%) 2017-Oct-26 2018-Jan-25 am 2018-Apr-9
2017 Oct 26 16590 1246 (8%) 2016-Dec-31 2017-Oct-26 am 2018-Apr-9
2017-Mar-14 6078 559 (9%) 2016-Aug-30 2016-Dec-31 am 2017-Apr-12 ?

Early requests that followed a different pattern:

  • 16:05, 2016 October 17 (CDT) || 2016-08-01 (but use 1980-01-01 for import because first one) until 2016-08-30
  • 2015-12-?? - Discharge date 2015-04-01 - 2015-04-30

Related articles

Related articles: