Difference between revisions of "Main Page/Research/MSB/processing model/20090130"

From phurvitz
Jump to: navigation, search
(New page: __FORCETOC__ =Processing Steps= ==Initial pre-processing== These should only need to get done once, related to copying files # MSB data ## collect from subjects ## place on gismo server in...)
 
 
Line 7: Line 7:
 
## place on gismo server in subject folders
 
## place on gismo server in subject folders
 
## push to ubicomp, process on ubicomp
 
## push to ubicomp, process on ubicomp
## download from ubicomp
+
## download from ubicomp ('''note: the file formats should be finalized as of 2009-02-26 bu J. Lester''')
 
# MyExperience data
 
# MyExperience data
 
## MyExperience (data collected on phone)
 
## MyExperience (data collected on phone)
Line 19: Line 19:
 
These should also only need to be done once (processes for all subjects), related to generating standardized formats for "final" processing
 
These should also only need to be done once (processes for all subjects), related to generating standardized formats for "final" processing
 
# MSB data
 
# MSB data
##
+
## -
 
# SMS
 
# SMS
 
## standardize 6 or 8 field messages  
 
## standardize 6 or 8 field messages  
Line 34: Line 34:
 
# MyExperience/SMS + MSB
 
# MyExperience/SMS + MSB
 
## Find the closest match in time
 
## Find the closest match in time
 +
#

Latest revision as of 18:52, 27 February 2009

Processing Steps

Initial pre-processing

These should only need to get done once, related to copying files

  1. MSB data
    1. collect from subjects
    2. place on gismo server in subject folders
    3. push to ubicomp, process on ubicomp
    4. download from ubicomp (note: the file formats should be finalized as of 2009-02-26 bu J. Lester)
  2. MyExperience data
    1. MyExperience (data collected on phone)
      1. collect from subjects
      2. open with MyExperience Analyzer
      3. save query results Get All Responses.csv
    2. SMS (sent from phone to msb@gismo.gis.washington.edu account)
      1. copy from gismo

Secondary pre-processing

These should also only need to be done once (processes for all subjects), related to generating standardized formats for "final" processing

  1. MSB data
    1. -
  2. SMS
    1. standardize 6 or 8 field messages
    2. check individual subject data for agreement between phone and GPS time (for 8-field records)
    3. evaluate (all) and fix records (where possible)
    4. creates a single file containing records for all subjects
  3. MyExperience
    1. find the closest SMS match for each MyExperience record
      Only those MyExperience records with SMS can have exactly matching times, the rest are unreliable
      creates a single file containing records for all subjects

Main processing

These need to be done on a per-subject basis

  1. MyExperience/SMS + MSB
    1. Find the closest match in time