Changes to make Centralized data smaller: Difference between revisions

From CCMDB Wiki
Jump to navigation Jump to search
mNo edit summary
Line 23: Line 23:
=== [[Postal_Code_Master table]] ===
=== [[Postal_Code_Master table]] ===
There is a [[Postal_Code_Master table]] in [[Centralized data.mdb]]. The table is likely in the correct file because Pagasa maintains it and Julie uses it.  
There is a [[Postal_Code_Master table]] in [[Centralized data.mdb]]. The table is likely in the correct file because Pagasa maintains it and Julie uses it.  
When extracted to its own file, table is 89MB
Discussion with Julie established that she doesn't use the following fields, so eliminating them: latitude and longitude, so
{{Todo
| who = Tina
| todo_added = 2022-08-11
| todo_action = 2022-08-11
| question =  _after
* reduce field sizes as much as possible
* do some quality control
* remove
** latitude and longitude
}}
{{DJ |
...
** yes I use the table  and particularly helpful for MB where the RHA are listed. ...  ---[[User:JMojica|JMojica]] 09:44, 2022 August 11 (CDT)
*** How about the CA, CA_Name, NC, NC_Name columns - do you use those? If you use the table we will just keep it in there, but I might still reduce the field sizes, they don't need to be 255. [[User:Ttenbergen|Ttenbergen]] 10:52, 2022 August 11 (CDT)
**** I think I have used it when asked where from winnipeg area patients come from but very rare. - --[[User:JMojica|JMojica]] 11:03, 2022 August 11 (CDT)
***** Do you use the code and name fields for them or would you be OK if we use the code fields?  }}
==== Next Steps ====
{{Todo
| who = Tina
| todo_added = 2022-08-10
| todo_action = 2022-08-10
| question =  _after
* Waiting for info from Julie:
** Can we move the file out? [[User:Ttenbergen|Ttenbergen]] 16:38, 2022 August 10 (CDT)
** Can we reduce field sizes? [[User:Ttenbergen|Ttenbergen]] 16:38, 2022 August 10 (CDT)
}}


==== Log ====
==== Log ====
* removed "code" fields that duplicate "name" field data, and reduced field sizes as much as possible, which reduced table size from ~89MB to ~70MB.


== Related articles ==  
== Related articles ==  

Revision as of 14:11, 2022 August 11

As of 2022-08-10 Centralized data.mdb was 1.348GB . This is large and slowly approaching MS Access' 2GB limit. The size also makes it slow to copy down, and even slower to copy up. This page is about attempts to make the file smaller.

L_Dxs table and L_Como table

We can reduce the file size to 0.810GB by moving the legacy tables L_Dxs table and L_Como table to Legacy TMS Data.mdb. These tables are “stale” and no longer change, so we don’t really need to have them in Centralized data.mdb.

Next Steps
  • after Pagasa has legacy local, remove tables from Centralized master.
  • added: 2022-08-10
  • action: 2022-08-10
  • Cargo


  • Categories

Log

Postal_Code_Master table

There is a Postal_Code_Master table in Centralized data.mdb. The table is likely in the correct file because Pagasa maintains it and Julie uses it.

Log

  • removed "code" fields that duplicate "name" field data, and reduced field sizes as much as possible, which reduced table size from ~89MB to ~70MB.

Related articles

Related articles:
Retrieved from "https://ccmdb.kuality.ca/index.php?title=Changes_to_make_Centralized_data_smaller&oldid=157129"