Author Topic: Audiosurf + Stereoscopic 3D [dylan please have a look]  (Read 10155 times)

BlackShark

  • Newbie
  • *
  • Posts: 17
    • View Profile
    • Email
Audiosurf + Stereoscopic 3D [dylan please have a look]
« on: July 01, 2008, 05:07:11 am »
Hi
I didn't know exactly about where to put this topic since it covers many different areas : i have feature requests, and a bug report, but since this is something which very few people would actually use right now, and involves installation of 3rd party software and hacks, i think it should go to the modding section.
if it's not in the right section , feel free to move the topic.

What is stereoscopic 3D ?
Stereoscopic 3D is a technique which allows the viewer (or player) to percieve depth in an image (or video or game). This is done by showing a slightly different image to each eye produced by 2 diffrent cameras separated by a few centimeters, to imitate human vision.

Stereoscopic 3D gaming applies the principle of the 3D cinema to your games, it's been around for quite a few years but never really took off because of lack of a way to display high quality 3D images at home at an affordable price.
For years, the only affordable way to do it was to use special glasses (called shutter glasses) which worked well but required ultra-high grade CRT monitors working at 120Hz or the flicker effect from the monitor would be too strong and cause serous headaches after a few minutes of use.

But 3D technology is coming back, some TV and monitor manufacturers are now making new 3D-ready plasma TVs and 3D LCD monitors at a more affordable price, drivers have also improved a lot and even hollywood is now pushing for more and more 3D technology in theatres, and home is next.

So what about audiosurf ?

Well i've tested audiosurf with the most advanced 3D driver called "iZ3D" (yes, nvidia is no longer n°1 in stereoscopic 3D), and actually audiosurf works quite well in 3D.
I've taken some screenshots, i've uploaded them in their original format (dual images, side by side, full colour) here : http://blacksharkfr.free.fr/media/images/Tra3d/iz3dbeta/audiosurf/

i have also assembled one of the images in anaglyph so you can see how it looks like if you've got one of those cheap red&blue 3D glasses

You'll notice i've changed the block colours to reckognize them in anaglyph.

Now, everything isn't perfect and Dylan, there's something you can do about it :
In order to properly draw a 3D scene in stereoscopic 3D, you need to think about the depth of every object and every special effect.
That's something you don't necessarely do when you draw a scene which will be projected on a traditionnal 2D screen, so if you aren't careful, some visual anomalies appear.
The less visual anomalies, the better the depth effect becomes because the illusion of depth is perfect.
3D driver creators can help a little by doing some profiling each game and applying some tweaks to their drivers, but takes a lot of ressources for them and they can't correct everything, while you could do it much better and much more efficiently since you know your game and you're the only one who owns the source code of your game.

I've noticed four visual anomalies in Audiosurf :
1 - HUD depth (major anomaly) :
most of the menu interface and a big part of the hud is projected at a random depth because when you draw these HUD elements in 2D, you don't specify the correct depth. In order to avoid this, there is a convention which states that all HUD elements should be drawn at a specified depth (i think it's z=0, not sure) so that 3D drivers reckognize the HUD and draw it at the correct depth (the depth of the screen)
There is one element which is drawn at the correct depth though : it's the title of the song. You draw this element every time at the correct conventionnal HUD depth.
Dylan, i wish you would check though your code about which depth you used to draw this HUD element, and apply it to the rest of the hud (menues, options, etc...) so that Stereoscopic 3D drivers would know it's the hud and draw it correctly.

2 - Particles' depth = 2D hud (major anomaly)
Although this is a logic thing to do when you draw for a conventionnal 2D screen, when it comes to stereoscopic 3D a visual anomaly appears.
That's because the particles are hidden by the road, so your brain thinks they're behind, but your eyes tell you it's drawn at the same depth as the HUD which is in front, this products a contradiction between what your eyes see and what your brain thinks and this tends to distract you, so if you could solve this by forcing the particle effects to be drawn very far in the back, it would make Audiosurf play a lot better in 3D

3 - Trails effect, premium graphics (minor anomaly)
The trails seem to be strongly disturbed by the tiny camera displacements that Stereo 3D drivers use.
Just look at this screenshot :
http://blacksharkfr.free.fr/media/images/Tra3d/iz3dbeta/audiosurf/Audiosurf%200005.jpg
It's not a major issue because you can only see this for a few seconds when reaching the end of a level, but if you could correct it, you'd get a flawless 3D rendering.
I don't know exactly how or why this happens (i'm just a player), it must be something with the fullscreen postprocess effect, 3D drivers hate them because 3D drivers never know whether to draw these effect separately for each eye (slower) or to draw both eyes at the same time (to draw it faster) but you could ask iZ3D engineers about it and they would probably tell you exactly why this happens and how to solve it.

4 - The mysterious vertical bar (minor anomaly)
There is a mysterious vertical black bar floating in the center of the screen, I have absolutely no idea about where it comes from or what it is supposed to represent.
I isn't very disturbing at all, it's just that... it shouldn't be there, but since i have absolutely no idea about why it's there can't tell you how to remove it.

As i just said before, i'm just a gamer interested in Stereoscopic 3D, i'm playing anaglyph right now but i intend to buy a 3D monitor for christmas, and i'd really like to enjoy Audiosurf in the best conditions.
If you have any technical questions about 3D drivers you can contact their authors.
The most advanced 3D driver right now is the one from iZ3D www.iz3d.com it works under windows XP or vista and with any gaphics card,
next is nvidia's one it's a little behind but it's become windows vista only and of course only works with nvidia graphics cards.

I really hope you'll get interested into Stereoscopic 3D and see if you can improve Audiosurf to display better in 3D.
Thanks
« Last Edit: July 01, 2008, 11:29:56 am by BlackShark »

Lavos^

  • Hero Member
  • *****
  • Posts: 2251
    • View Profile
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #1 on: July 01, 2008, 06:25:30 am »
Ew that's too trippy. I'm gonna try.

Wait I actually have to buy one of their monitors? That's fucking retarded. Unless you plan on getting Dylan to ship a free $600 22" monitor with every Audiosurf sale, you can forget this.
« Last Edit: July 01, 2008, 06:28:52 am by Lavos^ »

BlackShark

  • Newbie
  • *
  • Posts: 17
    • View Profile
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #2 on: July 01, 2008, 08:39:39 am »
No, the driver is free for anaglyph mode. the anaglyph mode is like a demo to show what their driver can achieve.
check again
« Last Edit: July 01, 2008, 08:59:37 am by BlackShark »

LeFail

  • Sr. Member
  • ****
  • Posts: 416
  • Lasers
    • View Profile
    • Youtubizzle.
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #3 on: July 01, 2008, 10:36:01 am »
I'm sorry, if I still have to buy a monitor to get this to work, you can forget about it.

If you're implying that it doesn't need a 3D monitor, I might be willing to try.
R.I.P. the Mono Mishap.
http://www.youtube.com/watch?v=oRWgb7iBuus, is it (732k) in you?

BlackShark

  • Newbie
  • *
  • Posts: 17
    • View Profile
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #4 on: July 01, 2008, 11:09:25 am »
No you don't have to buy a new monitor to try 3D.

The cheapest way to try 3D is to use anaglyph glasses (the super cheap red&blue glasses made of paper and a sheet of plastic)
like this :

It works on absolutely every single monitor in the world.
Which is why i've put the screenshot in anaglyph.
It costs less than a buck to make, but that for if you want to buy thousands all at once, if you just want to buy one pair, it should cost about 2 or 3 $, there are some shops on the internet who sell these. The other solution is to look for magazines, cereals for kids or books about optical illusions, there are sometimes anaglyph glasses included. You've probably already used a pair when you were a kid and thrown the glasses away years ago.

There are many different solutions to view 3D images. Anaglyph is the cheapest one but you loose one of the primary colours (red), which is why these other solutions (more expansive) exist. The 3D monitor is one of the most expansive but it's the best (logic), which is why the iZ3D driver has a free anaglyph mode anyone can use (even if you haven't bought their screen, which is my case)
The nvidia stereo3D driver also has an anaglyph feature but since the driver is windows visa 32bit only and only works with nvidia's cards so i can't use them.
« Last Edit: July 01, 2008, 11:35:56 am by BlackShark »

Laserrobotics

  • Robot Overlord
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3484
  • Beep boop everyone.
    • View Profile
    • Steam ID
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #5 on: July 01, 2008, 11:25:12 am »
most people who had kids should have one or two pairs lying around.  i know that i have a few that came with a 3D video that i got.
Note to self:  1/24/12 Awawayabeft

LeFail

  • Sr. Member
  • ****
  • Posts: 416
  • Lasers
    • View Profile
    • Youtubizzle.
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #6 on: July 02, 2008, 10:59:59 am »
Oh I see now.

I'm still meh on the idea though; it's already "3D," and I don't like to have "3D-3D" popping out of my screen at me so much.
R.I.P. the Mono Mishap.
http://www.youtube.com/watch?v=oRWgb7iBuus, is it (732k) in you?

Chance

  • Sr. Member
  • ****
  • Posts: 397
    • AOL Instant Messenger - chanceman93
    • View Profile
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #7 on: July 05, 2008, 05:59:40 pm »
Its not already 3D.  Well it is but so are movies.  And there are 3D movies.

This would be a great addition to AS, it is incorperated in alot of other games.

And how did anyone get the idea that you had to buy a moniter?  It was clear that all you need are paper glasses.  :D

LeFail

  • Sr. Member
  • ****
  • Posts: 416
  • Lasers
    • View Profile
    • Youtubizzle.
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #8 on: July 05, 2008, 10:02:58 pm »
And how did anyone get the idea that you had to buy a moniter?  It was clear that all you need are paper glasses.  :D

I've used these 3D monitors. They are meh, and I didn't realize that software could render the same effect that the monitor's hardware was doing.

So basically, I thought it would enable an option to double the screen through the monitor, which was obviously wrong.
R.I.P. the Mono Mishap.
http://www.youtube.com/watch?v=oRWgb7iBuus, is it (732k) in you?

Thendalis

  • Newbie
  • *
  • Posts: 9
    • View Profile
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #9 on: July 06, 2008, 05:26:41 pm »
I tried it, with AS and World of Warcraft.  It's pretty nifty, but it really makes my framerate go down.

Crazy Diamond

  • Newbie
  • *
  • Posts: 3
    • View Profile
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #10 on: July 11, 2008, 03:14:37 am »
I love this idea :D. It would make my time with audiosurf even more enjoyable, hopefully Dylan looks into it or at least patches a few bugs. Great idea. :D

Dylan

  • Developer
  • Administrator
  • Hero Member
  • *****
  • Posts: 1277
    • View Profile
    • Audiosurf
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #11 on: July 11, 2008, 09:16:45 am »
I can't believe I've never tried stereoscopic Audiosurf. I was way into it a while back and even played Magic Carpet with my eyes crossed for 5 or 10 minutes: http://www.3dexpo.com/crosseye.htm

I need to give it a try and see if any of those problems are easy to fix.

BlackShark

  • Newbie
  • *
  • Posts: 17
    • View Profile
    • Email
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #12 on: July 11, 2008, 12:24:16 pm »
Thanks for the positive reply Dylan

I've never been able to view games crosseyed, it's quite hard. Anaglyph is much easier (alright maybe not audiosurf in anaglyph since you really have to tweak colours a lot but after tweaking it works)

The interface should be the quickest to fix since you already draw the title of the song and the browser correctly.
The trails in premium mode are less important (since most people (me included) would rather trade premium mode for framerate)  but it would be great if the game was rendered 100% correctly. It would ensure the game to run perfect one i switch to my next gaming rig (probably in 2 years ;) )

About the particles, i don't really know if it would look better in the background (particles hidden by read, like the current game) or on HUD (like the current depth but with particles not hidden by the road).

Anyway, i'm glad you're giving it a shot.
Thanks.
« Last Edit: July 11, 2008, 02:10:50 pm by BlackShark »

bonz

  • Newbie
  • *
  • Posts: 8
    • View Profile
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #13 on: July 25, 2008, 02:23:59 pm »
I can't believe I've never tried stereoscopic Audiosurf. I was way into it a while back and even played Magic Carpet with my eyes crossed for 5 or 10 minutes: http://www.3dexpo.com/crosseye.htm

I need to give it a try and see if any of those problems are easy to fix.
Nice to hear that you like the idea!
But please don't use crosseye 3D because that causes headaches after a few minutes for me.
I think red/blue or red/cyan is the way to go, because those spectacles are very cheap (even better ones made with a plastic frame and proper plastic lenses).

Another tip:
Make the two colours customizable, so people can adjust the correct colour of their glasses or can create their own ones.

BTW, the boxed version of Trackmania United Forever contains a pair of red/blue anaglyph spectacles.

Chance

  • Sr. Member
  • ****
  • Posts: 397
    • AOL Instant Messenger - chanceman93
    • View Profile
Re: Audiosurf + Stereoscopic 3D [dylan please have a look]
« Reply #14 on: July 25, 2008, 04:05:19 pm »
Also if you don't want to buy the $40 TMUF (which is a good buy) you can also get a free pair of glasses sent to you by going to http://www.rainbowsymphony.com/freestuff.html