DSP Mode VS Nebula App

DSP Mode has a number of enabling benefits that are hard to ignore:

  • Enables Worldwide release due to Device Independence i.e. all phones with video output will work regardless of Android version or Carrier support. DP does not need to be enabled at system level.
  • Dex can be used
  • iPhones and iPads can be used
  • Privacy Preserved i.e. Apps like Nebula do not compromise privacy
  • DSP in combination with OpenXR as another worldwide release enabler
  • Nebula app can be replaced with existing Virtual Desktop apps designed for OpenXR headsets i.e. once OpenXR is available at end of year

None of the above is possible with the Nebula app.
Processing capability requirements onboard glasses are relatively low as only screen shifting and zooming are involved.

@nreal-dev would you be able to comment on how Nreal views DSP Mode ?

Cheers

3 Likes

Hi, thanks for your suggestion, sorry that I cannot comment much on the DSP mode. But I have several questions about the benefits you listed.
Do you mean that the glass can be connected wirelessly once DSP mode is adopted? Because I noticed that you mentioned iPhones can be used directly. Also, the power consumption and heat of glass will hugely increase under DSP mode, so we have to re-design the DSP board even the hardware appearance I think.

Hi @nreal-dev

Main distinction of DSP Mode is that it unlocks 2D image from head position in a device/software independent way.
iPhones/iPads and Dex are currently stuck locked to head. MacOS/Windows require Nebula app.
DSP Mode eliminates these limitations for productivity scenarios.
Only a few Android phones are supported by Nebula, whereas, DSP Mode will let any phone be used for mirroring with head unlocked.
Above are significant benefits that should not be ignored.

Nebula = 3 screens unlocked from head + heavily device/OS dependent + hammers CPU/GPU of the host device + hammers battery of the host device
DSP Mode = 1 screen unlocked from head + device/OS independent + does not use CPU/GPU of the host device + does not use more power than host device’s built-in screen

I am mainly referring to wired connections.
Wireless could be optional and, if anything, wireless in combination with decompression will use equal if not more power than wired DSP Mode.
Lenovo T1 does it without power overload issues. Order a pair and see if they use Qualcomm chips or a 3rd party DSP.
Qualcomm’s DSP is used for hand tracking(Nreal Light) which is more power intensive than screen shifting and screen zooming. I do not see how DSP Mode will use more power than hand tracking of Nreal Light.
Based on this, I do not see why your boards need redesigning if hand tracking already works without overheating.
Please let me know if I am overlooking something ?

Sry I am really no HW/SW developer, for me understanding, do you mean the Hardware (like “Qualcomm chip”) to add to Glasses, for use the DSP “Mode”, or is it only Software?

I’m confused sry.
Can you say full name on DSP please, is not efficient for google :slight_smile:

Hi @PierreU
DSP is a Digital signal processor - Wikipedia
DSP come included with XR1/XR2 chips i.e. no extra chips need to be added.
DSP Mode is a Firmware solution i.e. code runs on the glasses as opposed to Software(Nebula) that runs on the host device glasses are connected to.

@nreal-dev
What I overlooked was that the XR1 spec includes an Adreno 615 GPU.

It will be a lot easier and potentially a lot more power efficient to use the Adreno for screen shifting/scaling/zooming.
Does the Adreno GPU included in XR1 have access to DP input frame buffer?

Thanks for Explaned to me an Link!

And again you like to goes OpenSorce, you lose Ground each day the Company don’t give Software Support to Windows and Open Android App Market for apps to use in Nebular.

You can add a Control Fee for Apps, (20USD or some) to get and official work / and Checked from NReal but open the Channels … (Example Blender)

and or!!! use the Power of Educational University´s and private Schools for sponsor him Devices with an Delevopment Lector 2 Mentoring Times in a Week to make Project to create Content.
(Example Autodesk)

Being totally honest, I do not see myself ordering Nreal without a DSP/Firmware Mode facilitating a wide floating screen. Do not wish to be subjected to compatibility hellscape.

Sharp/clear small fonts is the other deal breaking requirement. Optics need improving. Resolution does not relate to this problem.

@nreal-dev thanks for letting me know you guys are looking into adding DSP/Firmware mode for next gen.
Will we get any info on next gen specs by end of year ?

It’s OKAY! not the best, but fine, I can read all mostly fonts and texts sharp enough to 8pt, if I doesn’t move me Head to murtch :slight_smile:

Also I had the Nreal AIR in “use” I can’t do any Productivity Work with it about only Handycontroller for selection in MR Space, I will love it on multi Monitorings in Windows.

One monitor in front of your Face is fine on Desktop PC but not worth it!

@PierreU sharpness would have to shift from “okay” to “good”. In addition to fonts, image gets blurry around screen edges.
Could you please post a good through-the-lens picture of what different font sizes look like?
Put VR cover on and place glasses on the table facing downwards. Adjust and lock camera focus, lock white balance and take a pic of a few lines of text. One line in 6pt, one in 8pt, one in 10pt and the last in 12pt.

DSP mode should be able to handle a single screen with 3840x1080(double FHD) resolution that will display 1920x1080 at a time. This way OS sees it as a single screen, yet the experience is like of 2 screens within the glasses.

@nreal-dev
Will there be any info on next gen glasses by end of the year ?

Hi, sorry I don’t have the specs even the draft. Once I have the file, I will post it in forum.