Hello Guest, Welcome to Apnea Board !
As a guest, you are limited to certain areas of the board and there are some features you can't use.
To post a message, you must create a free account using a valid email address.

or Create an Account


New Posts   Today's Posts

OSCAR not importing today's data
#11
RE: OSCAR not importing today's data
Seems the right thing to do is as you say, git pull.  I've been told if I had any changes that I wanted to save, I would do a git stash.  That way I could pop the stash if necessary.  Thanks @GuyScharf.  I'll build that later today.
Post Reply Post Reply
#12
RE: OSCAR not importing today's data
For the sake of completeness, at least on an i7 Ubuntu 20.04 system this is what works.  And yes, I saved this to a file so I don't need to pester anyone about this again!

$ cd OSCAR/build
$ make clean
$ cd ../OSCAR-code
$ git pull
$ cd ../build
$ qmake ../OSCAR-code/OSCAR_QT.pro
$ make -j4

Executable is in OSCAR/build/oscar

Now running OSCAR 1.2.1.  Got a temporary scare when it wanted to create a new directory, but steered it to what I had.  All is good.

I stuck in the make clean to get rid of any old stuff to force a full build.

If this weird time error comes up again, I'll be ready!
Post Reply Post Reply
#13
RE: OSCAR not importing today's data
OSCAR failed to import this morning.  Here is the debug log.
This is getting frustrating.  Had a decent night and can't look at it!
Code:
00000: Debug: Started logging thread
00000: Debug: OSCAR starting Tue Nov 10 07:13:20 2020
00000: Debug: APP-NAME: "OSCAR-master"
00000: Debug: APP-PATH: "/home/xxx/Apps/OSCAR/build/oscar"
00000: Debug: Trying "/home/xxx/Apps/OSCAR/build/oscar/Translations/oscar_qt_fr.qm"
00000: Debug: APP-RESOURCES: "/home/xxx/Apps/OSCAR/build/oscar"
00000: Debug: OSCAR 1.2.1-alpha.0+master-fac78038-plus (linux x86_64)
00000: Debug: Built with Qt 5.12.8 on Nov  4 2020 17:12:56
00000: Debug: system locale date format "dddd, MMMM d, yyyy"
00000: Debug: shortened date format "ddd MMM d yyyy" dayFirst false
00000: Debug: number of built-in *.qm files 0
00000: Debug: Inbuilt Translations: en_US
00001: Debug: number of external *.qm files 48
00001: Debug: Number of external translations is 26
00001: Debug: Extra Translations: af, ar, bg, da, de, el, en_UK, es, es_MX, fi, fr, he, hu, it, ko, nl, no, ph, pl, pt, pt_BR, ro, sv, th, tr, zh
00001: Debug: Using default language en_US
00143: Debug: Logging UI initialized
00150: Debug: Using System Tray for Menu
00346: Debug: OSCAR 1.2.1-alpha.0+master-fac78038-plus (linux x86_64)
00346: Debug: Built with Qt 5.12.8 on Nov  4 2020 17:12:56
00346: Debug:
00346: Debug: Operating system: Ubuntu 20.04.1 LTS
00346: Debug: Graphics Engine: 4.6.0 NVIDIA 455.28
00346: Debug: Graphics Engine type: OpenGL
00346: Debug:
00346: Debug: App key: OSCAR-master
00346: Debug: AppData folder already exists, so ...
00346: Debug: Using /home/xxx/Documents/OSCAR_Data as OSCAR data folder
00347: Debug: Logging to /home/xxx/Documents/OSCAR_Data/logs/debug.txt
00348: Debug: Opening  /home/xxx/Documents/OSCAR_Data/Preferences.xml
00349: Debug: validateFont found 627 installed font families
00362: Debug: Opening  ":/docs/channels.xml"
00362: Debug: Processing xml file: "channels" "en" "1.0"
00363: Debug: Registering PRS1Loader
00372: Debug: Registering ResmedLoader
00378: Debug: Registering IntellipapLoader
00382: Debug: Registering F&P Icon Loader
00382: Debug: Registering WeinmannLoader
00382: Debug: Registering CMS50Loader
00382: Debug: cms50f37 - Registering CMS50F37Loader
00382: Debug: Registering MD300W1Loader
00382: Debug: Registering ViatomLoader
00383: Debug: Logging device connections to /home/xxx/Documents/OSCAR_Data/logs/connections/devices.xml
00383: Debug: Opening  /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/Profile.xml
00469: Debug: Opening profile "xxx yyyy"
00484: Debug: ResMed machine found.. locking OSCAR preferences to suit it's summary system
00485: Debug: Loading Journal record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/Journal_5d63b445/
00485: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/Journal_5d63b445/Summaries.xml.gz
00531: Debug: PreloadSummaries is false
00531: Debug: Queue task loader is not  available
00533: Debug: Loading Summary Data
00534: Debug: No tasks in m_tasklist
00539: Debug: Loaded Journal data in 54 ms
00539: Debug: Loading Session Info
00540: Debug: Loading CMS50F37 record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/CMS50F37_58600bca/
00540: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/CMS50F37_58600bca/Summaries.xml.gz
00549: Debug: PreloadSummaries is false
00549: Debug: Queue task loader is  available
00550: Debug: Loading Summary Data
00550: Debug: MachineLoader::runTasks MLtasklist size is 0
00553: Debug: Loaded CMS50F data in 12 ms
00553: Debug: Loading Session Info
00554: Debug: Loading ResMed record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/
00554: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Summaries.xml.gz
00558: Debug: PreloadSummaries is false
00558: Debug: Queue task loader is  available
00558: Debug: Loading Summary Data
00559: Debug: MachineLoader::runTasks MLtasklist size is 0
00562: Debug: Loaded AirCurve 10 VAuto data in 8 ms
00562: Debug: Loading Session Info
00563: Debug: Loading PRS1 record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/PRS1_P131660625673/
00563: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/PRS1_P131660625673/Summaries.xml.gz
00699: Debug: PreloadSummaries is false
00699: Debug: Queue task loader is  available
00718: Debug: Loading Summary Data
00719: Debug: MachineLoader::runTasks MLtasklist size is 0
00721: Debug: Loaded REMstar Auto (System One 60 Series) data in 158 ms
00725: Debug: Loading Session Info
00766: Debug: Loading channel.dat States
00810: Debug: Creating new Daily object
00823: Debug: Daily Left Panel Width is  466
00830: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Events/5fa8c49c.001
01074: Debug: Overview range combo from QDate("2020-10-26") to QDate("2020-11-08") with 13 days
01127: Debug: Finished opening Profile
06251: Debug: Adding "" on "/media/xxx/0123-4567" to drivelist
06251: Debug: Drive list size: 1
06256: Debug: Found "ResMed" datacard at "/media/xxx/0123-4567"
09751: Debug: Starting ResmedLoader::Open( with  "/media/xxx/0123-4567" )
09751: Debug: Parsing Identification File  "/media/xxx/0123-4567/Identification.tgt"
09751: Debug: Info: "AirCurve 10" "AirCurve 10 VAuto" "37051" "23151928951"
09751: Debug: We have seen this machime
09751: Debug: First day to import:  "Sun Nov 8 2020"
09751: Debug: "Backup Path is /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Backup/"
09760: Debug: Starting backupSTRfiles during new IMPORT
09761: Debug: Adding "ResMed_23151928951/Backup/STR.edf" with 17 days as "/STR_Backup/STR-20201023.edf" to STRmap
09761: Debug: Finished backupSTRfiles during new IMPORT
09775: Debug: "xxx/0123-4567/STR.edf" starts at QDate("2020-10-23") for 18 ends QDate("2020-11-09")
09775: Debug: xxx/0123-4567/STR.edf overlaps /STR_Backup/STR-20201023.edf for 18 days, ends QDate(2020-11-09)
09775: Debug: Removing "/STR_Backup/STR-20201023.edf" with 17 days from STRmap
09775: Debug: Adding "/media/xxx/0123-4567/STR.edf" to STRmap as "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Backup/STR.edf"
09776: Debug: Add files in STR_Backup to STRmap (unless they are already there)
09776: Debug: Backup/STR_Backup/STR-20201023.edf overlaps ResMed_23151928951/Backup/STR.edf for 17 ends QDate(2020-11-08)
09776: Debug: Skipping "Backup/STR_Backup/STR-20201023.edf"
09776: Debug: Starting ProcessSTRfiles
09822: Debug: Finished ProcessSTR
09823: Debug: Starting scan of DATALOG
09823: Debug: "Backup Path is /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Backup/"
09823: Debug: Generating list of EDF files
09823: Debug: First Import date is  QDate("2020-11-08")
09824: Debug: Generating EDF files list took 1 ms
09824: Debug: EDFfiles list size is  16
09824: Debug: Scanning  16  EDF files
09837: Debug: Starting EDF duration scan pass
10099: Debug: Scanning EDF files took 275 ms
10099: Debug: resdayList size is  2
10100: Debug: Finished DATALOG scan
10100: Debug: About to call runTasks()
10100: Debug: MachineLoader::runTasks MLtasklist size is 1
10102: Warning: mask time in future QDate("2020-11-09") now 1605010410 maskon 1604982540 maskoff 1605011340
10103: Warning: Future Date in "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Backup/DATALOG/2020/20201109_232930_SAD.edf" now 1605010410 maskon 1604982570 maskoff 1605011311
10103: Warning: Future Date in "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Backup/DATALOG/2020/20201109_232930_PLD.edf" now 1605010410 maskon 1604982570 maskoff 1605011311
10103: Warning: Future Date in "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyyy/ResMed_23151928951/Backup/DATALOG/2020/20201109_232929_BRP.edf" now 1605010410 maskon 1604982569 maskoff 1605011310
10103: Debug: No sessionGroups  for QDate("2020-11-09") FINSIHED
10107: Debug: Finshed runTasks() with 0 new sessions
10111: Debug: About to call finishAddingSessions()
10111: Debug: Finshed finishedAddingSessions() with 0 new sessions
10111: Debug: Performance / Efficiency Information
10111: Debug: Total toTimeDelta function usage: 0 in 0 seconds
10111: Debug: Total CPU time in EDF Open 0
10111: Debug: Total CPU time in EDF Parser 0
10111: Debug: Total CPU time in LoadBRP 0
10111: Debug: Total CPU time in LoadPLD 0
10111: Debug: Total CPU time in LoadSAD 0
10111: Debug: Total CPU time in LoadEVE 0
10111: Debug: Total CPU time in LoadCSL 0
10112: Debug: Total CPU time in (BRP) AddWaveform 0
10112: Debug: Total CPU time in TimeDelta function 0
10112: Debug: Total Events  0
10112: Debug: Total new Sessions  0
10271: Debug: Finished Importing data 0
Post Reply Post Reply
#14
RE: OSCAR not importing today's data
Thanks for the debug log (with the latest improvements to diagnostics).  This makes it all clear.

The debug log says that it was "Tuesday November 10, 2020 07:13:30 (am)" at the time you imported the data, but that the mask off (end of session) time was "Tuesday November 10, 2020 07:28:30 (am)."

So, it looks like the clock in the CPAP machine is not set the same as the clock in your computer, and you probably imported the data very shortly after getting up. Is this true?

Workaround is to import the data again in an hour or so.
Useful links
Download OSCAR (current version is 1.5.1)
Best way to organize charts
How to attach charts to your post

Apnea Board Monitors are members who help oversee the smooth functioning of the Board. They are also members of the Advisory Committee which helps shape Apnea Board's rules & policies. Membership in the Advisory Members group does not imply medical expertise or qualification for advising Sleep Apnea patients concerning their treatment.
Post Reply Post Reply
#15
RE: OSCAR not importing today's data
That makes some sense!  Yes, my new to me ResMed was received during DST and the clock was set then.  Of course, my computer has software on it which automatically adjusts the time, including DST/ST.  All modern computers do this.  So my computer clock is behind that of the ResMed.  (And will be for many months!)  It's a pity that the PAP machines don't adjust, but I can see why they wouldn't, both from a cost and security perspective.

To be honest, I was so excited to see a good number, so I wanted to hurry up and look at the results!

You said, "So, it looks like the clock in the CPAP machine is not set the same as the clock in your computer, and you probably imported the data very shortly after getting up. Is this true?Yes!  That is exactly what I did!

So for now, I can just wait a bit.  Wish there were a better solution, but this should work.
Post Reply Post Reply
#16
RE: OSCAR not importing today's data
Wouldn't the solution be to set the ResMed to UTC-n, where n is one's ST offset from UTC, and for OSCAR to use UTC-n for time? That way the clocks would always be correct? None of this DST confusion...
Post Reply Post Reply
#17
RE: OSCAR not importing today's data
It's not just a DST problem. And UTC vs local time is a giant can of worms!

I will be looking into the issue. I first need to find out what the thinking was behind making that check.
Useful links
Download OSCAR (current version is 1.5.1)
Best way to organize charts
How to attach charts to your post

Apnea Board Monitors are members who help oversee the smooth functioning of the Board. They are also members of the Advisory Committee which helps shape Apnea Board's rules & policies. Membership in the Advisory Members group does not imply medical expertise or qualification for advising Sleep Apnea patients concerning their treatment.
Post Reply Post Reply
#18
RE: OSCAR not importing today's data
@GuyScharf thanks for looking into it.

UTC by definition should be ok.  UTC by Standard Time offset should be ok, I think.  ST offset is fixed by location on the planet relative to UTC.  (Well, most of the time...)

From Wikipedia: Coordinated Universal Time (or UTC) is the primary time standard by which the world regulates clocks and time. It is within about 1 second of mean solar time at 0° longitude, and is not adjusted for daylight saving time. It is effectively a successor to Greenwich Mean Time (GMT).

Yes handling time correctly IS hard!
Post Reply Post Reply
#19
RE: OSCAR not importing today's data
Looking this up some more, I think the more technical term that should be used is UTC offset.  UTC offset should be DST invariant.  Whether UTC offset is universally DST invariant might depend on the platform, but I have not personally checked that.

So if OSCAR uses as its timebase UTC + UTC time offset, and we set the PAP device to the same, then apparent time will not vary over the year.  (Assuming the PAP device has a reasonable drift.  My computer is time corrected by timedatectl, and some kind of ntp service is active.)

$ timedatectl status

   Local time: Tue 2020-11-10 11:32:25 EST  
   Universal time: Tue 2020-11-10 16:32:25 UTC  
   RTC time: Tue 2020-11-10 16:32:25      
   Time zone: America/New_York (EST, -0500)
   System clock synchronized: yes                          
   NTP service: active                       
   RTC in local TZ: no   

If UTCoffset is DST invariant, then OSCARtime = UTC + UTCoffset

Perhaps a solution for DST variant UTCoffset might be:
OSCARtime = UTC + UTCoffset -DST*1, where DST=1 if daylight savings time is active, or DST=0 if in standard time

Guess the real issue is if DST is actually reported separately, rather than embedded into TZ.
Post Reply Post Reply
#20
RE: OSCAR not importing today's data
There is one little problem. Linux stores the time in BIOS as UTC(GMT) and then calculates your local time offset in the OS. Windows platforms store the local time in the BIOS and doesn't have an OS offset. I've learned the hard way as I bounce between the 2 OS's on the same box.
Crimson Nape
Apnea Board Moderator
www.ApneaBoard.com
___________________________________
Useful Links -or- When All Else Fails:
The Guide to Understanding OSCAR
OSCAR Chart Organization
Attaching Images and Files on Apnea Board
Apnea Helpful Tips

INFORMATION ON APNEA BOARD FORUMS OR ON APNEABOARD.COM SHOULD NOT BE CONSIDERED AS MEDICAL ADVICE. ALWAYS SEEK THE ADVICE OF A PHYSICIAN BEFORE SEEKING TREATMENT FOR MEDICAL CONDITIONS, INCLUDING SLEEP APNEA. INFORMATION POSTED ON THE APNEA BOARD WEB SITE AND FORUMS ARE PERSONAL OPINION ONLY AND NOT NECESSARILY A STATEMENT OF FACT.
Post Reply Post Reply


Possibly Related Threads...
Thread Author Replies Views Last Post
Question OK TO IMPORT SLEEP DATA FROM OLD SD CARD INTO OSCAR W/O MESSING UP CURRENT DATA? Plmnb 1 72 8 hours ago
Last Post: Ibrumley
  Trouble importing data to Oscar bubbafoxus 2 87 03-22-2024, 05:40 PM
Last Post: bubbafoxus
  OSCAR Profiles and Combining Different Brand CPAP Data StratCat48 2 49 03-22-2024, 08:00 AM
Last Post: StratCat48
  Where Oscar put the data file? Rosacer24 0 59 03-22-2024, 12:16 AM
Last Post: Rosacer24
  There's 1.5 years of data in my OSCAR, but now there's a problem Snackers 8 217 03-19-2024, 03:36 AM
Last Post: Snackers
  OSCAR v1.5.2- error code 5, unable to write to data directory sleepynotion 2 106 03-18-2024, 12:09 PM
Last Post: sleepynotion
  OSCAR data backup strategy matt2 2 95 03-18-2024, 10:32 AM
Last Post: LoudSnorer


New Posts   Today's Posts


About Apnea Board

Apnea Board is an educational web site designed to empower Sleep Apnea patients.