Post Reply 
Just found a 2015 Bench Test for APAPs
Author Message
robysue Offline
Wiki Editor
Advisory Members

Posts: 1,247
Joined: Oct 2013

Machine: PR Dreamstation BiPAP Auto
Mask Type: Nasal pillows
Mask Make & Model: Swift FX
Humidifier: PR Dreamstation humidfier
CPAP Pressure: min EPAP = 4; max IPAP = 9;
CPAP Software: SleepyHead EncoreBasic EncorePro

Other Comments: Papping since September 2010

Sex: Female
Location: Buffalo, NY

Post: #11
RE: Just found a 2015 Bench Test for APAPs
(04-24-2016 09:29 PM)DeepBreathing Wrote:  There's not really a lot of detail in this paper. However the prime criterion was the ability to achieve "breathing normalisation" which appears to be the ability of the machine to "blow through" an obstructive apnea, with only the Resmed and F&P reaching a high enough pressure to do so.
I think you are misinterpreting what the authors mean by "breathing normalization". I think the authors are talking about how quickly additional events are "eliminated" and the breathing returns to normal.

Of course, the authors are also running all the machines wide open---i.e. the machines are all running in APAP 4-20cm. And the authors have rigged the test so that the test SDB breathing pattern won't clear up until a pressure level of 12cm has been reached; in other words they keep throwing SDB breathing patterns at the machine every few minutes as long as the pressure is still below 12cm. And the test is run for only 30 minutes. So the test clearly favors machines that quickly raise the pressure at the first sign of trouble and to raise pressure rapidly until things improve. Once the pressure is above 16, only a few isolated events or flow limitations get through to cause further increases.

In their (highly artificial) test, the A10 running in both AutoSet modes breaks up the apnea cluster within the first 5 minutes by aggressively raising the pressure from 4cm to 16cm during that time. Think about that, however: The machine has just raised the pressure at an average rate of 2.4cm per minute for 5 minutes. That's enough to wake a lot of us up. Or trigger aerophagia. Or both.

In other words, the way the authors set the test up means that APAPs that are less aggressive are at a serious disadvantage in this particular test. The machines that don't "normalize breathing" all probably do a fine job in treating OSA while running in APAP mode if they are used with a reasonable min pressure setting.

Quote:I wonder how useful this type of study really is? There's possibly a lot of unreported raw data which may be useful to machine designers and engineers. But I don't think this type of trial can in any way be taken as a guide to how the machines will perform on real patients in their own beds.
Bench tests that are funded by company money usually are not designed to "prove" anything about how the machines will work in practice. They are, however, designed to show the strengths of the algorithm being used. In this case, the strength that is being demonstrated is the ability of the A10 to respond quickly to a dense cluster of events and potentially prevent the cluster from growing into a 30 minute long cluster. This can be a real advantage if a person needs a lot more pressure (as in 8-10cm more pressure) when they hit REM than when they're in non-REM sleep. There are people like that and if they can sleep through the wild pressure swings at the start a nasty cluster, they may be able to use a Resmed A10 AutoSet with a significantly lower min pressure than they would need for a PR DreamStation.

But another important thing about bench tests is that it allows you to see how different machines algorithms will kick in. The real takeaway from this bench test is this: The Resmed and Icon are far more aggressive in terms of pressure increases than the other machines in the study. In particular, they're far more aggressive than the PR machines.

There are (older) studies funded by PR where the criteria was set to favor machines that would "control" a given kind of test SDB breathing pattern with the least average pressure. In these tests, the test SDB breathing pattern "clears up" quickly when the fake airway is given time to stabilize between pressure increases and/or responds well to the PR Search algorithm. And they couch the results in language about how other machines (particular Resmed) over titrate because they keep responding too aggressively to the breathing pattern.

Finally it is possible to do a bench test that doesn't clearly favor one approach over another. But it is more expensive to do such a bench test. You have to have multiple kinds of breathing patterns involved, including ones that are known to cause problems for any given approach and ones that play to the strengths of any given approach. Running machines wide open is considered part of the challenge: Too many manufacturers suggest in their advertising that running them wide open is an acceptable thing to do, or at least acceptable as part of a home titration. So you want to know what machines are going to do when run wide open.

The study published on the NIH site was NOT funded by any manufacturer. They also ran the machines wide open, but with a variety of different kinds of test breathing, including a really interesting "full night" test breathing complete with fake REM cycles. The Resmed S9 and PR System One came out about about the same in the overall test, but did perform quite differently. And neither was successful in bringing the residual obstructive part of AHI down to below 5. But the machines that did bring the residual obstructive part of the AHI down below 5 were also noted as having real problems with detecting CAs (even when they claimed they could) and raising pressure in the presence of CAs. The authors made no conclusions about "machine A" being better or worse than "machine B". Rather they conclude that there is a wide variance in how APAPs react to the same breathing pattern and that variance may have significant clinical implications, particularly if an APAP is being used a home titration device in lieu of a titration PSG. They also point out that if APAP is going to be used as a full time therapy, then narrowing the range by increasing the min pressure up to just below the 90-95% pressure level should improve the efficacy of the APAP therapy since the machine will not need to increase the pressure as much if/when a cluster of events occurs.

The much older 2009 bench study published in Sleep Review was also funded without manufacturer money. It was designed to investigate the varying responses of the APAPs to different kinds of SDB patterns and came away with a conclusion that manufacturer choices could lead some APAPs to deliver far more pressure than the patient actually needed. The aggressiveness of the F&P SleepStation and the Resmed S8 in attacking flow limitations with pressure was noted. The authors did invite the manufacturers to respond to the paper, and their responses are integrated into each section in a way that makes it clear that the manufacturer is talking. (The manufacturer comments are illuminating on the kinds of decisions that they each make in designing their APAP algorithms. Many of those choices are still evident in today's APAP algorithms.

Questions about SleepyHead?
See my Guide to SleepyHead
04-25-2016 03:05 AM
Find all posts by this user Post Reply Quote this message in a reply

Donate to Apnea Board
DeepBreathing Offline
Wiki Editor

Posts: 2,374
Joined: Sep 2013

Machine: Resmed S9 VPAP Adapt
Mask Type: Full face mask
Mask Make & Model: F&P Simplus
Humidifier: Resmed H5i
CPAP Pressure: EPAP: 9 - 15 PS: 3 - 10
CPAP Software: ResScan SleepyHead

Other Comments:

Sex: Male
Location: Perth, Western Australia

Post: #12
RE: Just found a 2015 Bench Test for APAPs
Quote:I think you are misinterpreting what the authors mean by "breathing normalization". I think the authors are talking about how quickly additional events are "eliminated" and the breathing returns to normal.

On re-reading the paper I think you may be right. The NIH study seems to have a lot more useful information, which I don't have time to read just at the moment. I also came across an interesting comparison on the way ASV machine algorithms work, which you might find interesting:

Apnea Board Moderator


04-25-2016 05:01 AM
Find all posts by this user Post Reply Quote this message in a reply
PoolQ Offline

Advisory Members

Posts: 1,001
Joined: Jul 2015

Machine: AirCurve 10 VAUTO
Mask Type: Full face mask
Mask Make & Model: Amara View
Humidifier: Integrated
CPAP Pressure: 6.2, 15, PS4.0
CPAP Software: SleepyHead

Other Comments:

Sex: Male
Location: Sillicon Valley

Post: #13
RE: Just found a 2015 Bench Test for APAPs
Robysue I think you have hit the nail on the head regarding how the study was skewed to Resmed, not a big surprise. The wide open, 30 minute, 12 CMH2O requirement pretty much controls the study to fast acting CPAP's. As you say they have their place in the market, but so do the others and I am pretty sure that being able to go from 4 -12 CMH2O in 5 minutes is most likely not required for most of us.
04-25-2016 10:47 AM
Find all posts by this user Post Reply Quote this message in a reply

Donate to Apnea Board
Mosquitobait Online

Advisory Members

Posts: 815
Joined: Apr 2015

Machine: Resmed AirSense 10 For Her
Mask Type: Nasal pillows
Mask Make & Model: Respironics Dreamwear
Humidifier: integrated, Climate line tube
CPAP Pressure: 9-12.6
CPAP Software: SleepyHead

Other Comments: RLS and Bradycardia

Sex: Female
Location: Minneapolis

Post: #14
RE: Just found a 2015 Bench Test for APAPs
According to that report, the Ich Machine from Apex Medical looks good. Shame it doesn't work with Sleepyhead. A bit lower in cost than either Resmed and Respironics for those without the $$.
07-17-2016 11:01 PM
Find all posts by this user Post Reply Quote this message in a reply
PaytonA Offline
Wiki Editor

Posts: 3,047
Joined: Dec 2013

Machine: ResMed S9 VPAP Auto
Mask Type: Full face mask
Mask Make & Model: Resmed Mirage Quattro
Humidifier: H5i(distilled-top up)
CPAP Pressure: VAuto MinE14.0 MaxI 20.6 PS4.0
CPAP Software: ResScan SleepyHead

Other Comments:

Sex: Male
Location: Orange County,California

Post: #15
RE: Just found a 2015 Bench Test for APAPs
We sure do have a lot of words of a defensive nature in this thread.
07-18-2016 12:12 PM
Find all posts by this user Post Reply Quote this message in a reply

Donate to Apnea Board
Post Reply 

Possibly Related Threads...
Thread: Author Replies: Views: Last Post
  Dr. Wants To Do A 24-Hour Test harmon k 6 318 12-08-2016 02:55 PM
Last Post: robysue
  2015 peer reviewed article comparing a bench test of 11 APAPs robysue 4 567 12-06-2016 07:06 AM
Last Post: cands
  2015 peer reviewed article on how xPAPs score events and auto algorithms respond robysue 1 208 12-03-2016 07:48 PM
Last Post: Perchas
  Found something interesting.. tisho23 4 336 12-02-2016 05:36 AM
Last Post: tisho23
  newbie questions re sleep test results Frances 4 395 10-20-2016 08:21 AM
Last Post: cate1898
  Found an awesome sleep Doc! Want2SleepInMT 4 442 10-02-2016 09:40 PM
Last Post: Want2SleepInMT
  [Diagnosis] Could Sleeping Pill During Test Cause False Apnea Diagnosis Violetskyye 20 1,234 09-23-2016 03:22 PM
Last Post: Sleeprider

Forum Jump:

Who's Online (Complete List)