Lossless video streaming over USB

[eszdman]

Now headsets that support streaming have an increasingly faster USB controller, this allows the use of binning or similar techniques used by PC and headset GPU to transfer data without loss and higher latency.

Basically it should be several methods which you can select it's pretty cheap by computations on both headset and PC in compare to compression methods:

1. Pixel binning - combine nxm pixels into one and reconstruct it on headset shader code.
2. Pixel binning with pixel shift - similar method that use binning but shift input image every frame and reconstructs it on headset shader (similar to TAA).
3. Interlacing output - Can be used with previous methods, we can interlace frames in mosaic-like pattern to get higher frame rate with same baud rate.

With this techniques we can achieve insane amount of baud rate comparing to compression 960Mbps vs 20000+Mbps this will lead to a significant improvement in image quality, especially when the image is highly detailed.

I hope that my proposal will be passed on to the ALVR community because at the moment there are no such solutions.

[zmerp]

Thanks for the proposal.
Currently we are giving priority to other things. I believe you can achieve a good image quality using the current encoders given enough bitrate.

[eszdman]

I believe you can achieve a good image quality using the current encoders given enough bitrate.

No it's not, you can't change the fact that there's missing data with such compression schemes (it's aimed at working with low bitrates) comparing to pure data over display port / USB

[lividhen]

With the optics on the quest pro and 3 compression artifacts, even at high bitrates, are very clearly visible. I agree that current streaming methods are good enough for now but it might be a good idea to eventually look in to something like this.