Changes to make Centralized data smaller: Difference between revisions
Jump to navigation
Jump to search
Ttenbergen (talk | contribs) |
Ttenbergen (talk | contribs) |
||
| Line 21: | Line 21: | ||
}} | }} | ||
=== Postal_Code_Master table === | === [[Postal_Code_Master table]] === | ||
There is a [[Postal_Code_Master table]] in [[Centralized data.mdb]]. It’s in this file because Pagasa maintains it, so if it was in [[CFE]] it would get lost if Tina made an update to that file. Removing this table would further shrink the file to 0.721GB . | |||
{{DJ | | |||
* Do you actually use this table? If so we might need to keep it in Centralized so you get any updates Pagasa makes. [[User:Ttenbergen|Ttenbergen]] 16:38, 2022 August 10 (CDT) | |||
* The table has a lot of fields that are only populated for MB, an not even consistenly there. Do you use any of these fields for aggregation? Do you use this table at all when you do geographic analysis, or do you have a different one? They are all 255char fields, so if there are any we don't use we should consider eliminating them. There are also some erratic entries in there, eg. latitudes and longitudes missing their decimal points, or rhacode and province blank... do we need to review this? [[User:Ttenbergen|Ttenbergen]] 16:38, 2022 August 10 (CDT) | |||
}} | |||
If Pagasa is the only user of this table we could move it into a different file, which would just have to be added to the push pull and reconnect machinery for Pagasa. | |||
==== Next Steps ==== | ==== Next Steps ==== | ||
| Line 29: | Line 36: | ||
| todo_added = 2022-08-10 | | todo_added = 2022-08-10 | ||
| todo_action = 2022-08-10 | | todo_action = 2022-08-10 | ||
| question = | | question = _after | ||
* | * Waiting for info from Julie: | ||
** Can we move the file out? [[User:Ttenbergen|Ttenbergen]] 16:38, 2022 August 10 (CDT) | |||
** Can we reduce field sizes? [[User:Ttenbergen|Ttenbergen]] 16:38, 2022 August 10 (CDT) | |||
}} | }} | ||
==== Log ==== | ==== Log ==== | ||
== Related articles == | == Related articles == | ||
Revision as of 15:38, 2022 August 10
As of 2022-08-10 Centralized data.mdb was 1.348GB . This is large and slowly approaching MS Access' 2GB limit. The size also makes it slow to copy down, and even slower to copy up. This page is about attempts to make the file smaller.
L_Dxs table and L_Como table
We can reduce the file size to 0.810GB by moving the legacy tables L_Dxs table and L_Como table to Legacy TMS Data.mdb. These tables are “stale” and no longer change, so we don’t really need to have them in Centralized data.mdb.
Next Steps
|
|
|
Log
- 2022-08-10:
- emailed Julie and confirmed we should do this
- imported L Dxs table and L Como table into Legacy TMS Data.mdb as version 2022-08-10
|
|
Postal_Code_Master table
There is a Postal_Code_Master table in Centralized data.mdb. It’s in this file because Pagasa maintains it, so if it was in CFE it would get lost if Tina made an update to that file. Removing this table would further shrink the file to 0.721GB .
|
|
|
If Pagasa is the only user of this table we could move it into a different file, which would just have to be added to the push pull and reconnect machinery for Pagasa.
Next Steps
|
|
_after
|
|
Log
Related articles
| Related articles: |