Hello Guest, Welcome to Apnea Board !
As a guest, you are limited to certain areas of the board and there are some features you can't use.
To post a message, you must create a free account using a valid email address.

or Create an Account


New Posts   Today's Posts

OSCAR not importing today's data
#1
OSCAR not importing today's data
I don't know why, but OSCAR won't import last night's data.  The data is on the SD card for last night.  Subdirectory looks just about the same as the subdirectory for the previous night.  Same number and types of files.  File sizes are similar.

OSCAR just reported that it was up to date and there was nothing to import.  This is wrong.  
Almost tragically wrong since I had a pretty good night and wanted to look at it.  (jk about tragic)  Feeling data withdrawal already...

In my profile it says last imported this morning (today).  I built OSCAR 1.2.0 from source, if it matters.  For the record, although I may have posted about adjusting the clock in the main forum, I did not - I only asked about it.  
Here is the debug log.  For privacy reasons the paths are edited (redacted).

Code:
00000: Debug: Started logging thread
00001: Debug: OSCAR starting Wed Nov 4 07:17:43 2020
00001: Debug: APP-NAME: "OSCAR"
00001: Debug: APP-PATH: "/home/xxx/Apps/OSCAR/build/oscar"
00001: Debug: Trying "/home/xxx/Apps/OSCAR/build/oscar/Translations/oscar_qt_fr.qm"
00002: Debug: APP-RESOURCES: "/home/xxx/Apps/OSCAR/build/oscar"
00002: Debug: OSCAR 1.2.0+master-6d9f544a-plus (linux x86_64)
00002: Debug: Built with Qt 5.12.8 on Oct 14 2020 21:38:45
00002: Debug: system locale date format "dddd, MMMM d, yyyy"
00002: Debug: shortened date format "ddd MMM d yyyy" dayFirst false
00003: Debug: number of built-in *.qm files 0
00003: Debug: Inbuilt Translations: en_US
00004: Debug: number of external *.qm files 48
00005: Debug: Number of external translations is 26
00005: Debug: Extra Translations: af, ar, bg, da, de, el, en_UK, es, es_MX, fi, fr, he, hu, it, ko, nl, no, ph, pl, pt, pt_BR, ro, sv, th, tr, zh
00005: Debug: Using default language en_US
00182: Debug: Logging UI initialized
00192: Debug: Using System Tray for Menu
00416: Debug: OSCAR 1.2.0+master-6d9f544a-plus (linux x86_64)
00416: Debug: Built with Qt 5.12.8 on Oct 14 2020 21:38:45
00416: Debug:
00416: Debug: Operating system: Ubuntu 20.04.1 LTS
00416: Debug: Graphics Engine: 4.6.0 NVIDIA 455.28
00416: Debug: Graphics Engine type: OpenGL
00416: Debug:
00416: Debug: AppData folder already exists, so ...
00416: Debug: Using /home/xxx/Documents/OSCAR_Data as OSCAR data folder
00419: Debug: Logging to /home/xxx/Documents/OSCAR_Data/logs/debug.txt
00419: Debug: Opening  /home/xxx/Documents/OSCAR_Data/Preferences.xml
00421: Debug: validateFont found 627 installed font families
00437: Debug: Opening  ":/docs/channels.xml"
00438: Debug: Processing xml file: "channels" "en" "1.0"
00438: Debug: Registering PRS1Loader
00450: Debug: Registering ResmedLoader
00456: Debug: Registering IntellipapLoader
00460: Debug: Registering F&P Icon Loader
00460: Debug: Registering WeinmannLoader
00460: Debug: Registering CMS50Loader
00461: Debug: cms50f37 - Registering CMS50F37Loader
00461: Debug: Registering MD300W1Loader
00461: Debug: Registering ViatomLoader
00463: Debug: Logging device connections to /home/xxx/Documents/OSCAR_Data/logs/connections/devices.xml
00463: Debug: Opening  /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/Profile.xml
00568: Debug: Opening profile "xxx yyy"
00576: Debug: ResMed machine found.. locking OSCAR preferences to suit it's summary system
00578: Debug: Loading Journal record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/Journal_5d63b445/
00578: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/Journal_5d63b445/Summaries.xml.gz
00645: Debug: PreloadSummaries is false
00645: Debug: Queue task loader is not  available
00646: Debug: Loading Summary Data
00647: Debug: No tasks in m_tasklist
00647: Debug: Loaded Journal data in 69 ms
00648: Debug: Loading Session Info
00648: Debug: Loading CMS50F37 record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/CMS50F37_58600bca/
00648: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/CMS50F37_58600bca/Summaries.xml.gz
00653: Debug: PreloadSummaries is false
00653: Debug: Queue task loader is  available
00653: Debug: Loading Summary Data
00654: Debug: MachineLoader::runTasks MLtasklist size is 0
00654: Debug: Loaded CMS50F data in 6 ms
00654: Debug: Loading Session Info
00655: Debug: Loading ResMed record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/
00655: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Summaries.xml.gz
00658: Debug: PreloadSummaries is false
00658: Debug: Queue task loader is  available
00658: Debug: Loading Summary Data
00659: Debug: MachineLoader::runTasks MLtasklist size is 0
00659: Debug: Loaded AirCurve 10 VAuto data in 4 ms
00659: Debug: Loading Session Info
00660: Debug: Loading PRS1 record: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/PRS1_P131660625673/
00661: Debug: Loading /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/PRS1_P131660625673/Summaries.xml.gz
00748: Debug: PreloadSummaries is false
00748: Debug: Queue task loader is  available
00768: Debug: Loading Summary Data
00768: Debug: MachineLoader::runTasks MLtasklist size is 0
00769: Debug: Loaded REMstar Auto (System One 60 Series) data in 108 ms
00774: Debug: Loading Session Info
00815: Debug: Loading channel.dat States
00868: Debug: Creating new Daily object
00886: Debug: Daily Left Panel Width is  466
00896: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Events/5fa0d854.001
01596: Debug: Overview range combo from QDate("2015-07-27") to QDate("2020-11-02") with 1925 days
03255: Debug: Finished opening Profile
12829: Debug: Adding "" on "/media/xxx/0123-4567" to drivelist
12829: Debug: Drive list size: 1
12847: Debug: Found "ResMed" datacard at "/media/xxx/0123-4567"
16809: Debug: Starting ResmedLoader::Open( with  "/media/xxx/0123-4567" )
16809: Debug: Parsing Identification File  "/media/xxx/0123-4567/Identification.tgt"
16810: Debug: Info: "AirCurve 10" "AirCurve 10 VAuto" "37051" "23151928951"
16810: Debug: We have seen this machime
16810: Debug: First day to import:  "Mon Nov 2 2020"
16810: Debug: "Backup Path is /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Backup/"
16826: Debug: Starting backupSTRfiles during new IMPORT
16827: Debug: Adding "ResMed_23151928951/Backup/STR.edf" with 11 days as "/STR_Backup/STR-20201023.edf" to STRmap
16828: Debug: Finished backupSTRfiles during new IMPORT
16829: Debug: "xxx/0123-4567/STR.edf" starts at QDate("2020-10-23") for 12 ends QDate("2020-11-03")
16829: Debug: xxx/0123-4567/STR.edf overlaps /STR_Backup/STR-20201023.edf for 12 days, ends QDate(2020-11-03)
16829: Debug: Removing "/STR_Backup/STR-20201023.edf" with 11 days from STRmap
16830: Debug: Adding "/media/xxx/0123-4567/STR.edf" to STRmap as "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Backup/STR.edf"
16830: Debug: Add files in STR_Backup to STRmap (unless they are already there)
16831: Debug: Backup/STR_Backup/STR-20201023.edf overlaps ResMed_23151928951/Backup/STR.edf for 11 ends QDate(2020-11-02)
16831: Debug: Skipping "Backup/STR_Backup/STR-20201023.edf"
16831: Debug: Starting ProcessSTRfiles
16848: Debug: Finished ProcessSTR
16849: Debug: Starting scan of DATALOG
16849: Debug: "Backup Path is /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Backup/"
16849: Debug: Generating list of EDF files
16849: Debug: First Import date is  QDate("2020-11-02")
16855: Debug: Generating EDF files list took 6 ms
16855: Debug: EDFfiles list size is  16
16855: Debug: Scanning  16  EDF files
16856: Debug: Starting EDF duration scan pass
17115: Debug: Scanning EDF files took 260 ms
17115: Debug: resdayList size is  2
17115: Debug: Finished DATALOG scan
17116: Debug: About to call runTasks()
17116: Debug: MachineLoader::runTasks MLtasklist size is 1
17116: Warning: mask time in future QDate("2020-11-03")
17117: Warning: Future Date in "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Backup/DATALOG/2020/20201103_232046_BRP.edf"
17117: Warning: Future Date in "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Backup/DATALOG/2020/20201103_232046_SAD.edf"
17117: Warning: Future Date in "/home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Backup/DATALOG/2020/20201103_232046_PLD.edf"
17117: Debug: No sessionGroups  for QDate("2020-11-03") FINSIHED
17118: Debug: Finshed runTasks() with 0 new sessions
17118: Debug: About to call finishAddingSessions()
17119: Debug: Finshed finishedAddingSessions() with 0 new sessions
17119: Debug: Performance / Efficiency Information
17119: Debug: Total toTimeDelta function usage: 0 in 0 seconds
17119: Debug: Total CPU time in EDF Open 0
17119: Debug: Total CPU time in EDF Parser 0
17119: Debug: Total CPU time in LoadBRP 0
17119: Debug: Total CPU time in LoadPLD 0
17119: Debug: Total CPU time in LoadSAD 0
17119: Debug: Total CPU time in LoadEVE 0
17119: Debug: Total CPU time in LoadCSL 0
17119: Debug: Total CPU time in (BRP) AddWaveform 0
17119: Debug: Total CPU time in TimeDelta function 0
17119: Debug: Total Events  0
17119: Debug: Total new Sessions  0
17263: Debug: Finished Importing data 0
42631: Debug: Page change time (in ms): Unload = 3 Load = 51 Other = 0
48082: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Events/5f9f8ad0.001
48151: Debug: Page change time (in ms): Unload = 0 Load = 70 Other = 0
50851: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Events/5fa0d854.001
50904: Debug: Page change time (in ms): Unload = 0 Load = 53 Other = 0
607489: Debug: Saving "Daily" settings
607490: Debug: Saving "Overview" settings
607572: Debug: Page change time (in ms): Unload = 0 Load = 55 Other = 0
674480: Debug: Opening profile "xxx yyy"
682545: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Events/5f9f8ad0.001
682601: Debug: Page change time (in ms): Unload = 0 Load = 57 Other = 0
683968: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Events/5f9e2e4c.001
684037: Debug: Page change time (in ms): Unload = 1 Load = 68 Other = 1
741209: Debug: Loading ResMed Events: /home/xxx/Documents/OSCAR_Data/Profiles/xxx yyy/ResMed_23151928951/Events/5fa0d854.001
741265: Debug: Page change time (in ms): Unload = 0 Load = 57 Other = 0
742122: Debug: Page change time (in ms): Unload = 0 Load = 54 Other = 0
745251: Debug: Page change time (in ms): Unload = 0 Load = 59 Other = 0
746169: Debug: Page change time (in ms): Unload = 0 Load = 48 Other = 0
The problem is on 17116: Warning: mask time in future QDate("2020-11-03")
I did not change any times on my ResMed.  I have not changed any times on my computer.  The SD card is locked whenever in my pc.  The SD is unlocked when in the ResMed.  This appears to be an OSCAR time related bug.  If I can offer further assistance please don't hesitate to ask.  For what it is worth, OSCAR did not properly handle TZ shift day, ie. Halloween night - Nov 1.  Start time was shifted 1 hour forward from true time.  Graphs had correct time.  Nov 1 & 2 "Start time" were correctly handled.

I have a screen shot of the subdirectories if this is desired.

Umm, so how can I have OSCAR import last night's files now?
Post Reply Post Reply
#2
RE: OSCAR not importing today's data
I think there's a way to delete today's upload and then to upload again. Data may or may not have been uploaded today, but this is what it's acting like. If it applies, consider trying it.
INFORMATION ON APNEA BOARD FORUMS OR ON APNEABOARD.COM SHOULD NOT BE CONSIDERED MEDICAL ADVICE. ALWAYS SEEK THE ADVICE OF A PHYSICIAN BEFORE SEEKING TREATMENT FOR MEDICAL CONDITIONS, INCLUDING SLEEP APNEA. INFORMATION POSTED ON THE APNEA BOARD WEBSITE AND FORUMS ARE PERSONAL OPINION ONLY AND NOT NECESSARILY A STATEMENT OF FACT.
Post Reply Post Reply
#3
RE: OSCAR not importing today's data
Is that Purge Current Selected Day?  I don't see a way to select a particular day!  Does this matter?

At this startup, OSCAR states, the last time I used my machine was 1 day ago on Monday Nov 2.  But the profile page still says I last imported 11/4/20  7:18am.

Please advise.

Update:
Weird.  Did another import, from the file menu, but left the card out for a while then inserted it.  Worked fine.  This still smells like a software issue...  

At least today I am out of the woods.
Post Reply Post Reply
#4
RE: OSCAR not importing today's data
For future reference; To use Purge Current Selected Day, using the calendar go to the day you wish to purge in the Daily screen then select this option.
Crimson Nape
Apnea Board Moderator
www.ApneaBoard.com
___________________________________
Useful Links -or- When All Else Fails:
The Guide to Understanding OSCAR
OSCAR Chart Organization
Attaching Images and Files on Apnea Board
Apnea Helpful Tips

INFORMATION ON APNEA BOARD FORUMS OR ON APNEABOARD.COM SHOULD NOT BE CONSIDERED AS MEDICAL ADVICE. ALWAYS SEEK THE ADVICE OF A PHYSICIAN BEFORE SEEKING TREATMENT FOR MEDICAL CONDITIONS, INCLUDING SLEEP APNEA. INFORMATION POSTED ON THE APNEA BOARD WEB SITE AND FORUMS ARE PERSONAL OPINION ONLY AND NOT NECESSARILY A STATEMENT OF FACT.
Post Reply Post Reply
#5
RE: OSCAR not importing today's data
I don't see anything obvious, and I can import last night's data without problem on my system.

Could you make a debug change and try again?  In resmed_loader.cpp around line 2238 you should see:

Code:
               qWarning() << "Future Date in" << fullpath;

Change that to:

Code:
               qWarning() << "Future Date in" << dur.start << dur.end << fullpath;

and send me those lines of the debug log.
Useful links
Download OSCAR (current version is 1.5.1)
Best way to organize charts
How to attach charts to your post

Apnea Board Monitors are members who help oversee the smooth functioning of the Board. They are also members of the Advisory Committee which helps shape Apnea Board's rules & policies. Membership in the Advisory Members group does not imply medical expertise or qualification for advising Sleep Apnea patients concerning their treatment.
Post Reply Post Reply
#6
RE: OSCAR not importing today's data
(11-04-2020, 09:13 AM)happydreams Wrote: Weird.  Did another import, from the file menu, but left the card out for a while then inserted it.  Worked fine.  This still smells like a software issue... 

You can ignore my previous post as OSCAR is working for you now, although the diagnostics would be useful if it ever happens again. I will improve the warning messages for the future to clarify what timestamps OSCAR is looking at if this happens.

I've once seen a glitch myself where OSCAR didn't import the most recent data. Importing again (from the big Import button on the Welcome page) solved the problem. I thought it was a FlashPap problem at the time but didn't pursue it.
Useful links
Download OSCAR (current version is 1.5.1)
Best way to organize charts
How to attach charts to your post

Apnea Board Monitors are members who help oversee the smooth functioning of the Board. They are also members of the Advisory Committee which helps shape Apnea Board's rules & policies. Membership in the Advisory Members group does not imply medical expertise or qualification for advising Sleep Apnea patients concerning their treatment.
Post Reply Post Reply
#7
RE: OSCAR not importing today's data
Thanks for the tip @Crimson Nape!
Post Reply Post Reply
#8
RE: OSCAR not importing today's data
happydreams: I have merged changes that improve the qWarning messages you saw. Those will let me figure out where the problem is if this happens again (in the next release or if you rebuild, of course).
Useful links
Download OSCAR (current version is 1.5.1)
Best way to organize charts
How to attach charts to your post

Apnea Board Monitors are members who help oversee the smooth functioning of the Board. They are also members of the Advisory Committee which helps shape Apnea Board's rules & policies. Membership in the Advisory Members group does not imply medical expertise or qualification for advising Sleep Apnea patients concerning their treatment.
Post Reply Post Reply
#9
RE: OSCAR not importing today's data
@GuyScharf, I'll rebuild with your changes if it happens again.  Unfortunately, as you well know, non-repeatable bugs are the worst to find!  

On second thought, I will rebuild anyways, that way if it does happen some additional information would be available.  Since the error is sporadic and possibly non-repeatable, it would be better to have this in place, before the event happens.  The changes should not affect regular operation.    

Want to confirm the basic steps.  

Basic instructions are:
1) $ git pull origin master             fresh copy from repo
2) do edits as you suggested        no edits required since there was a merge
3) Build per normal instructions

Did I get that right?  Sometimes I get rusty with git.  Please confirm.  Thanks!

My tree is /OSCAR
               there no files in OSCAR, only directories
               then /OSCAR/build
               and  /OSCAR/OSCAR-code
I presume the git push is done from /OSCAR/OSCAR-code?
Post Reply Post Reply
#10
RE: OSCAR not importing today's data
Yes, I think that's right. Normally I just do a "git pull" with master being the current project. I think "git pull origin master" has the same result. I am not a git expert either -- I just know enough to use it for OSCAR.

Are you asking where I do the "git push" from? Yes, it is from /oscar/oscar-code on my computer.
Useful links
Download OSCAR (current version is 1.5.1)
Best way to organize charts
How to attach charts to your post

Apnea Board Monitors are members who help oversee the smooth functioning of the Board. They are also members of the Advisory Committee which helps shape Apnea Board's rules & policies. Membership in the Advisory Members group does not imply medical expertise or qualification for advising Sleep Apnea patients concerning their treatment.
Post Reply Post Reply


Possibly Related Threads...
Thread Author Replies Views Last Post
Question OK TO IMPORT SLEEP DATA FROM OLD SD CARD INTO OSCAR W/O MESSING UP CURRENT DATA? Plmnb 1 77 Today, 01:07 AM
Last Post: Ibrumley
  Trouble importing data to Oscar bubbafoxus 2 88 03-22-2024, 05:40 PM
Last Post: bubbafoxus
  OSCAR Profiles and Combining Different Brand CPAP Data StratCat48 2 49 03-22-2024, 08:00 AM
Last Post: StratCat48
  Where Oscar put the data file? Rosacer24 0 60 03-22-2024, 12:16 AM
Last Post: Rosacer24
  There's 1.5 years of data in my OSCAR, but now there's a problem Snackers 8 223 03-19-2024, 03:36 AM
Last Post: Snackers
  OSCAR v1.5.2- error code 5, unable to write to data directory sleepynotion 2 107 03-18-2024, 12:09 PM
Last Post: sleepynotion
  OSCAR data backup strategy matt2 2 98 03-18-2024, 10:32 AM
Last Post: LoudSnorer


New Posts   Today's Posts


About Apnea Board

Apnea Board is an educational web site designed to empower Sleep Apnea patients.