Transition to Database Server: Difference between revisions

From CCMDB Wiki
Jump to navigation Jump to search
m log
 
(29 intermediate revisions by 2 users not shown)
Line 1: Line 1:
CCMDB will eventually outgrow Microsoft Access as a storage format. We are investigating storing the data with [[Decision Support Services]].  
CCMDB will eventually outgrow Microsoft Access as a storage format for our [[Centralized_data.mdb]].  


*2016-10-31 Call from Trevor, booked meeting for show-and-tell for Nov 21.
== Technical considerations ==
*2016-10-24 sent follow-up email
* We need to be able to access this from collector laptops; these might be accessing the network remotely
*2016-10-12 sent follow-up email
*2016-10-03-- Meeting booked for.
*2016-09-22 emailed Trevor with likely structure.
*2016-09-22 sent email about how to get data to Trevor
*2016-09-19 made new structure; asked Trevor how to get it to him.
*2016-09-15 met w Dr Roberts and confirmed it’s ok to go ahead with preliminary testing
*2016-09-08 discussion with Trevor Strome
**ODBC connections should be possible
***Ability write and ? change tables
**Sticking point: auditing
**Terms and conditions changes – spongy answers
**Reporting: sql mgr, then anything that has ODBC connectivity SSRS MS reporting services
*Funding? …if there is a cost we want to keep it reasonable (can’t get better answer)
*Ownership of data? Will others look into our data
**Some should be accessible by all or many, to be discussed with owners
**Research by eg U of M special use of would go back to owners
*2016-08-04 Trevor emailed that things should start in Sept/Oct and we will need to discuss architecture. Asked for scope.
*2016-08-03 emailed for update
*2016-06-12 replied to let me know if I can help
Trevor: “We’ve made some very positive progress in bringing our SQL server on-line and accessing much of our other clinical datamarts (i.e., EDIS, ADT, etc) through direct queries. There are still a few governance/policy annoyances that we’re navigating, but overall things are looking good. If we connect in the next few weeks I should be able to provide you more information, and we can begin to sketch out how an architecture might look.”
*2016-06-02 emailed for follow-up
*2016-05-19 Trevor Strome (DSS) thinks there might be a way to get us a SQL server to store our data; waiting to hear back.


[[Category: eHealth]]
* Who will be allowed to program and implement changes on this system?
 
== Administrative and governance considerations ==
We now need to work out the following:
 
* What would be the terms and conditions of us using this repository
** who owns the data?
** how will this be funded?
** how do we navigate giving additional people access to the data?
*** will we be able to give partial access to data to people? Technically this is obviously possible, but would we be ''allowed'' to do this, and if so, would we be allowed to manage this ourselves?
** would we be able to access this and report from this via SQL reporting (a system Kym's group uses for real-time available reports for Accuro, which ties into the same type of database system)
 
== U of M centralized solution ==
U of M is in the process of setting up a centralized solution for data management. Allan is in contact with them for this.
 
=== Log ===
* 2024-03-13 - Allan organized meeting with dept leadership to discuss the U of M option; they were not enthusiastic and wanted to wait for a Shared Health solution instead.
* 2024-later - Allan met with Kiran and got the impression that they are an option for us
* 2024-02-08 - met with Kiran and her technical team to discuss our database and came away with the impression that they are not an option
* 2024-01-24 - Discussion with Kiran Kaur from U of M re. them hosting us to put our data into CyVerse - or not CyVerse. They asked for meeting to discuss [[Details U of M needs to know to consider Database solution for us]]
* 2023-04-19 - Allan reported that U of M is moving ahead with CyVerse, and there will be an opportunity to test soon. Cost structure still not clear.
* 2022-10-17 - Allan attended meeting that introduced [https://cyverse.org/ CyVerse] as a possible tool; U of M is working with Manitoba Health to find out if and how privacy can be accomplished with this. Early stages but Allan will stay in the loop with them.
 
== CHI ==
* Narmada Retnakaran (Manager, Data Coordinating Centre) is getting a handle on how they do stuff before she is prepared to discuss further with us
* we asked CHI if they could store this for us, but they said storing external data like this is not currently a project they can take on
=== Log ===
* 2019-08-22 - Allan reported that CHI will set up a group to work through the governance of such a server. Tina suggested to start the technical discussions in tandem with this, and Allan agreed to make the connection to do this.
 
== Shared Health ==
* 2024-05 - turns out it wasn't ''quite'' cancelled and is instead stalled with SH; asked for update 2024-05-14, Bojan escalated it to SH 2024-05-16, and Allan reported back after that there was some response about them working on it (or similar)
* 2023-03 - 2024-03 we went through an exciting attempt to move our database to Salesforce. On last note that project was cancelled.
* 2023-01-18 email from Alex Omsen responding to ticket 5698212 about slow access to our db back end; responded Jan 25
* 2022-09-27 long string of "waiting for input from Perry" as documented in [[Task Team Meeting - Rolling Agenda and Minutes 2022 | Task minutes]]
* 2021-11-04 that incident was taken over by Kevin Soroka a while ago, Tina emailed him to follow up; eventually a Christine Pawlett and Shelley Irving Day got back to us, had one meeting and progress stalled again
* 2021-08... was encouraged by MS Access upgrade team to start a new incident for this (INC000004781738) 
* 2021-02-12 - Summary of the last few months: we put in a "Provincial Intake" request with the help of Alex Omsen; Shelley Irving Day agreed to be the required executive level support; there is ongoing conversation at the leadership level how our database fits into ongoing needs and once that is decided we will hopefully move toward a solution.
 
=== older history ===
* a long time ago we tried to set up our own server within the Shared Health system; they initially offered to make this safe and doable within their network but then the price tag was to the moon, and they would not have allowed us to access this network from the rest of the network so no use
* there was at least one meeting at some point to which Kym Morris was also invited
* we tried to work with Decision Support Services and had a test system set up when the arrangement fell through because a data agreement could not be reached
** WRHA Department "Analytics & Business Intelligence" has given us access to a database on their database server where we would be able to store our data. The technical groundwork was in place: we were able to add/edit/remove tables and access them via an MS Access front end through ODBC. Then some decision was made that made this not a feasible solution, might have been when Trevor Strom left
 
== Related articles ==
{{Related Articles}}
 
 
[[Category:eHealth]]
[[Category:Warehouse]]
[[Category:Data Repository]]

Latest revision as of 11:27, 2024 May 27

CCMDB will eventually outgrow Microsoft Access as a storage format for our Centralized_data.mdb.

Technical considerations

  • We need to be able to access this from collector laptops; these might be accessing the network remotely
  • Who will be allowed to program and implement changes on this system?

Administrative and governance considerations

We now need to work out the following:

  • What would be the terms and conditions of us using this repository
    • who owns the data?
    • how will this be funded?
    • how do we navigate giving additional people access to the data?
      • will we be able to give partial access to data to people? Technically this is obviously possible, but would we be allowed to do this, and if so, would we be allowed to manage this ourselves?
    • would we be able to access this and report from this via SQL reporting (a system Kym's group uses for real-time available reports for Accuro, which ties into the same type of database system)

U of M centralized solution

U of M is in the process of setting up a centralized solution for data management. Allan is in contact with them for this.

Log

  • 2024-03-13 - Allan organized meeting with dept leadership to discuss the U of M option; they were not enthusiastic and wanted to wait for a Shared Health solution instead.
  • 2024-later - Allan met with Kiran and got the impression that they are an option for us
  • 2024-02-08 - met with Kiran and her technical team to discuss our database and came away with the impression that they are not an option
  • 2024-01-24 - Discussion with Kiran Kaur from U of M re. them hosting us to put our data into CyVerse - or not CyVerse. They asked for meeting to discuss Details U of M needs to know to consider Database solution for us
  • 2023-04-19 - Allan reported that U of M is moving ahead with CyVerse, and there will be an opportunity to test soon. Cost structure still not clear.
  • 2022-10-17 - Allan attended meeting that introduced CyVerse as a possible tool; U of M is working with Manitoba Health to find out if and how privacy can be accomplished with this. Early stages but Allan will stay in the loop with them.

CHI

  • Narmada Retnakaran (Manager, Data Coordinating Centre) is getting a handle on how they do stuff before she is prepared to discuss further with us
  • we asked CHI if they could store this for us, but they said storing external data like this is not currently a project they can take on

Log

  • 2019-08-22 - Allan reported that CHI will set up a group to work through the governance of such a server. Tina suggested to start the technical discussions in tandem with this, and Allan agreed to make the connection to do this.

Shared Health

  • 2024-05 - turns out it wasn't quite cancelled and is instead stalled with SH; asked for update 2024-05-14, Bojan escalated it to SH 2024-05-16, and Allan reported back after that there was some response about them working on it (or similar)
  • 2023-03 - 2024-03 we went through an exciting attempt to move our database to Salesforce. On last note that project was cancelled.
  • 2023-01-18 email from Alex Omsen responding to ticket 5698212 about slow access to our db back end; responded Jan 25
  • 2022-09-27 long string of "waiting for input from Perry" as documented in Task minutes
  • 2021-11-04 that incident was taken over by Kevin Soroka a while ago, Tina emailed him to follow up; eventually a Christine Pawlett and Shelley Irving Day got back to us, had one meeting and progress stalled again
  • 2021-08... was encouraged by MS Access upgrade team to start a new incident for this (INC000004781738)
  • 2021-02-12 - Summary of the last few months: we put in a "Provincial Intake" request with the help of Alex Omsen; Shelley Irving Day agreed to be the required executive level support; there is ongoing conversation at the leadership level how our database fits into ongoing needs and once that is decided we will hopefully move toward a solution.

older history

  • a long time ago we tried to set up our own server within the Shared Health system; they initially offered to make this safe and doable within their network but then the price tag was to the moon, and they would not have allowed us to access this network from the rest of the network so no use
  • there was at least one meeting at some point to which Kym Morris was also invited
  • we tried to work with Decision Support Services and had a test system set up when the arrangement fell through because a data agreement could not be reached
    • WRHA Department "Analytics & Business Intelligence" has given us access to a database on their database server where we would be able to store our data. The technical groundwork was in place: we were able to add/edit/remove tables and access them via an MS Access front end through ODBC. Then some decision was made that made this not a feasible solution, might have been when Trevor Strom left

Related articles

Related articles: