Import Log: Difference between revisions

(29 intermediate revisions by 3 users not shown)

Line 1:

~~''' this article may be the evil twin of [[ImportLog]]~~

{{LegacyContent

~~Also referred to as the Append Log~~.

|explanation=No longer importing anything into TMSX or even using it.

|successor=

|content=

~~This is a log files that is created automatically by the [[PDA Uploader]].exe. every time the [[Data Processor]] uploads (appends) most of the sent csv files~~ to ~~either~~ the ~~Master Critical Care[[TMSX]]database or the Master Medicine [[MedTMS]]database repository.~~

Also referred to as the [[AppendLog]].

~~Other parts of the data that is sent if automatically appeneded other databases the reside on the [[Regional Server]] See~~ [[~~:Category: Data Repository | Data Repository~~]].

This is a log files that is created automatically by the [[PDA Reader]]/[[PDA Uploader]]exe. every time the [[Data Processor]] uploads (appends) most of the sent csv files to either the Master Critical Care([[TMSX]]) database or the Master Medicine ([[MedTMS]]) [[:Category: Data Repository | Data Repository]].

Other parts of the data that is sent are automatically appended other [[:Category: Data Repository | Data Repositories]].

that reside on the [[Regional Server]].

==Information on Import Log==

*append batch number

Line 13:

Line 19:

*end of last database [[Study number]] in main database that last file in the batch appends to.

==Weekly printout==

The data processor prints out the Import Log report each week when she appends data to master database.

Line 20:

Line 27:

==Location of Import log file==

===Paper Import log file===

A paper print out is done every week after appending data to master database and the paper is stored in an binder in the office.

*Blue label binder for ICU -paper printout

*Red label binder for MED -paper printout

**A print out is done every week and stored in an binder in the office. One for Critical Care and another one for Medicine.

~~***~~

===Electronic Import log file===

The automatically created log file is located on the local C drive of main data processor's computer:

Critical Care [[TMSX]] database:

*C:\CritPDAdnld\[[~~ImportLog~~]]\'''CriticalLog.log'''

*C:\CritPDAdnld\[[Import Log]]\'''CriticalLog.log'''

Medicine database [[MedTMS]]:

*C:\MEDPDAdnld\[[~~ImportLog~~]]\'''MedicalLog.log'''

*C:\MEDPDAdnld\[[Import Log]]\'''MedicalLog.log'''

The import log is not readable in current format. September 6.12 - The Database Programmer is working on changing [[PDA Uploader]].exe for both [[TMSX]] & [[MedTMS]] so that the import log is saved as a CSV (more user friendly file). Currently the import log has some machine language written into it which makes rather unreadable. The only way this log is legible is if ~~PDA uploader~~ executes a printout. We will stop printing and storing these paper logs in binders above once update is completed. Will have this in place before end of 2012. [[User:TOstryzniuk|Trish Ostryzniuk]] 18:57, 2012 October 25 (EDT)

The import log is not readable in current format. September 6.12 - The Database Programmer is working on changing [[PDA Uploader]].exe for both [[TMSX]] & [[MedTMS]] so that the import log is saved as a CSV (more user friendly file). Currently the import log has some machine language written into it which makes rather unreadable. The only way this log is legible is if [[Data Processor]] executes a printout from the [[PDA Reader]]/[[PDA Uploader]].exe. We will stop printing and storing these paper logs in binders above once update is completed. Will have this in place before end of 2012. [[User:TOstryzniuk|Trish Ostryzniuk]] 18:57, 2012 October 25 (EDT)

*There will be a maximum of 40 characters allowed in the label name for sent CSV data file. If we want electronic log, current PDA reader has a problem with sent files names longer than 16 characters. It truncates the label name when it reads in the log files names. 40 character max will give us some flexibilty and we will than not have to be so strict with these files names, example - "re-sent data" where we typed in added info into send file so Pagasa is clear it is a resend or test also some staff do not use only two letters for their intials when sending files.- [[User:TOstryzniuk|Trish Ostryzniuk]] 20:57, 2012 October 25 (EDT)

==Use of Import log==

~~{{Discussion}}~~

The import log (append log) provides the main office with quick and easy way for to locate and "original sent cvs file" from the backup files on M.

*Pagasa & Julie...[[User:~~TOstryzniuk~~|~~Trish Ostryzniuk~~]] ~~19:01, 2012 October 25 (EDT)~~

When errors are found in master database by the [[Statistician]], we alway try and trace where the error may originating from in order to decide if error is avoidable or not. We investigate if error was due to:

#collection error

#ccmdb.accdb problem (entry field limits or sending)

#appending error

#data Editing error

We must look at the original sent csv file, to see where error may have originated from before we pursue trying resolve problem. We will then review collection guidelines on Wiki and update and also discuss with collector. For ccmdb we notify [[User: Ttenbergen | Tina]] if there are changes that can be to be made to avoid error. If due to appending we notify programmer for [[TMSX]] or [[MedTMS]]. If error is due to in office editing by [[Data Processor]] we review process.

[[Category: Data Processing]]

[[Category:Legacy Data Processing]]

[[Category:Master Database Programs]]

}}

@@ Line 1: / Line 1: @@
-''' this article may be the evil twin of [[ImportLog]]
+{{LegacyContent
-Also referred to as the Append Log.
+|explanation=No longer importing anything into TMSX or even using it.
+|successor=
+|content=
-This is a log files that is created automatically by the [[PDA Uploader]].exe. every time the [[Data Processor]] uploads (appends) most of the sent csv files to either the Master Critical Care[[TMSX]]database or the Master Medicine [[MedTMS]]database repository.
+Also referred to as the [[AppendLog]].
-Other parts of the data that is sent if automatically appeneded other databases the reside on the [[Regional Server]] See [[:Category: Data Repository | Data Repository]].
+This is a log files that is created automatically by the [[PDA Reader]]/[[PDA Uploader]]exe. every time the [[Data Processor]] uploads (appends) most of the sent csv files to either the Master Critical Care([[TMSX]]) database or the Master Medicine ([[MedTMS]])  [[:Category: Data Repository | Data Repository]].
+Other parts of the data that is sent are automatically appended other [[:Category: Data Repository | Data Repositories]].
+that reside on the [[Regional Server]].
 ==Information on Import Log==
 *append batch number
@@ Line 13: / Line 19: @@
 *end of last database [[Study number]] in main database that last file in the batch appends to.
+==Weekly printout==
 The data processor prints out the Import Log report each week when she appends data to master database.
@@ Line 20: / Line 27: @@
 ==Location of Import log file==
 ===Paper Import log file===
+A paper print out is done every week after appending data to master database and the paper is stored in an binder in the office.
 *Blue label binder for ICU -paper printout
 *Red label binder for MED -paper printout
-**A print out is done every week and stored in an binder in the office. One for Critical Care and another one for Medicine.
-***
 ===Electronic Import log file===
 The automatically created log file is located on the local C drive of main data processor's computer:
 Critical Care [[TMSX]] database:
-*C:\CritPDAdnld\[[ImportLog]]\'''CriticalLog.log'''
+*C:\CritPDAdnld\[[Import Log]]\'''CriticalLog.log'''
 Medicine database [[MedTMS]]:
-*C:\MEDPDAdnld\[[ImportLog]]\'''MedicalLog.log'''
+*C:\MEDPDAdnld\[[Import Log]]\'''MedicalLog.log'''
-The import log is not readable in current format.  September 6.12 - The Database Programmer is working on changing [[PDA Uploader]].exe for both [[TMSX]] & [[MedTMS]] so that the import log is saved as a CSV (more user friendly file).    Currently the import log has some machine language written into it which makes rather unreadable. The only way this log is legible is if PDA uploader executes a printout.  We will stop printing and storing these paper logs in binders above once update is completed.   Will have this in place before end of 2012. [[User:TOstryzniuk|Trish Ostryzniuk]] 18:57, 2012 October 25 (EDT)
+The import log is not readable in current format.  September 6.12 - The Database Programmer is working on changing [[PDA Uploader]].exe for both [[TMSX]] & [[MedTMS]] so that the import log is saved as a CSV (more user friendly file).    Currently the import log has some machine language written into it which makes rather unreadable. The only way this log is legible is if [[Data Processor]] executes a printout from the [[PDA Reader]]/[[PDA Uploader]].exe.  We will stop printing and storing these paper logs in binders above once update is completed.   Will have this in place before end of 2012. [[User:TOstryzniuk|Trish Ostryzniuk]] 18:57, 2012 October 25 (EDT)
+*There will be a maximum of 40 characters allowed in the label name for sent CSV data file.  If we want electronic log, current PDA reader has a problem with sent files names longer than 16 characters.   It truncates the label name when it reads in the log files names.  40 character max will give us some flexibilty and we will than not have to be so strict with these files names, example - "re-sent data" where we typed in added info into send file so Pagasa is clear it is a resend or test also some staff do not use only two letters for their intials when sending files.- [[User:TOstryzniuk|Trish Ostryzniuk]] 20:57, 2012 October 25 (EDT)
 ==Use of Import log==
-{{Discussion}}
+The import log (append log) provides the main office with quick and easy way for to locate and "original sent cvs file" from the backup files on M.
-*Pagasa & Julie...[[User:TOstryzniuk|Trish Ostryzniuk]] 19:01, 2012 October 25 (EDT)
+When errors are found in master database by the [[Statistician]], we alway try and trace where the error may originating from in order to decide if error is avoidable or not.  We investigate if error was due to:
+#collection error
+#ccmdb.accdb problem (entry field limits or sending)
+#appending error
+#data Editing error
+We must look at the original sent csv file, to see where error may have originated from before we pursue trying resolve problem.    We will then review collection guidelines on Wiki and update and also discuss with collector.   For ccmdb we notify [[User: Ttenbergen | Tina]] if there are changes that can be to be made to avoid error.  If due to appending we notify programmer for [[TMSX]] or [[MedTMS]].  If error is due to in office editing by [[Data Processor]] we review process.
-[[Category: Data Processing]]
+[[Category:Legacy Data Processing]]
 [[Category:Master Database Programs]]
+}}