Posts Tagged ‘racing’

Kinect Joy Ride

The third Kinect (Project Natal) game Microsoft demoed (after Kinect Sports) at their E3 2010 press conference was Kinect Joy Ride.

E3 2010 trailer video:

Here’s the same game, at E3 2009, one year ago, before they moved to Project Natal/Kinect. It was originally going to be free:

And the E3 2009 trailer video:

It looks like a lot of fun. More fun than the Burnout Paradise racing game they have been showing previously. But maybe that’s just my taste.

New Kinect Trailer (E3 2010)

New Xbox 360 Kinect trailer! (Kinect is the new name for Project Natal).

First it shows Kinectimals which is the Kinect (Project Natal) equivalent of Sony’s PlayStation Move game EyePet. But it’s been super-sized. You get a life-size tiger, lion, or other big cat to play with. And it doesn’t appear to have augmented reality.

Then it shows the latest version of Ricochet, the game where your avatar deflects balls back to destroy blocks. Microsoft have been showing this game almost exclusively for the past year.

Then it shows Kinect Adventures, which is the river rafting game for two players.

Then it shows the media player with voice controls which was in the video last year. They were watching Harry Potter. I wonder if there will be Harry Potter games for Kinect, since they would be an obvious choice for gesture and voice control. Lego Harry Potter (Parts 1 and 2) and Harry Potter and the Deathly Hallows (Parts 1 and 2) are still to be released, so keep your fingers crossed. There are two franchises players have been dreaming of Kinect controls for since long before Project Natal: Star Wars and Harry Potter.

Then it shows a new dancing game, called “Dance Central”. Unlike the standard Dance Dance Revolution/Guitar Hero rhythm and timing games, this game doesn’t have scrolling notes that you have to hit in time with the music. Instead it has a wheel on the side of the screen that tells you what dance move you have to do and what the next ones will be, and you have to spend a few seconds doing that move correctly. And of course this game requires no extra hardware, due to Kinect.

Then it shows two Kinect Sports games hurdles and table tennis. Sony’s PlayStation Move also does table tennis, as does Nintendo’s Wii Motion Plus. Microsoft’s version seems the worst since you are using your open hand instead of a table tennis bat. If I was Microsoft, I would let players hold any random prop they have lying around the house and use it as a table tennis bat. A spatula, a carrot, your TV remote control, even a real table tennis bat, or a Wii Remote. I don’t see why Kinect can’t use random household objects as props.

Then it shows Your Shape: Fitness Evolved. You might remember this from the Nintendo Wii, it came with a Wii webcam peripheral. Now it doesn’t need one. This was an obvious choice for Kinect, and I’m surprised it never occurred to me that we would see this game for Kinect.

Then it shows Kinect Joy Ride. This is actually an old game that was going to be released last year for free on Xbox Live Arcade with traditional controls, but it was delayed and made into a Kinect launch title. It is a cartoony car racing game with obstacles that includes split-screen multiplayer.

Lots more games are being announced though, so stay tuned for a low more info and videos.

Stereoscopic 3D TVs and Project Natal

One thing we haven’t heard much from Microsoft about is stereoscopic 3D (aka S3D) support for Xbox 360 and specifically for Project Natal. A couple of games that I can think of support stereoscopic 3D on the Xbox 360: Avatar, and G-Force. And there are lots of new stereoscopic 3D TVs hitting the market now.

Stereoscopic 3D means each eye sees a separate image because it is seeing the scene from a slightly different angle. Your brain automatically looks at the difference between the two eyes and calculates depth from it. That’s why people have two eyes.

Anything that’s at the same screen position for both eyes will look like it’s at the same distance as the screen is. Which is what normal TV looks like. But anything that’s drawn further to the left on your right eye, and further to the right on your left eye, looks like it’s popping out in front of the screen. On the other hand, anything that’s drawn further to the left on the left eye, and further to the right on the right eye looks like it’s behind the screen. Your eyes are very sensitive, and even one pixel difference is enough for you to see the difference in depth.

By now you should have seen that effect at a stereoscopic 3D movie. If not, go and watch Avatar 3D. It is really, really cool. You feel like you can reach out and grab things that are in front of the screen. And just as good is feeling like there is a whole huge world stretching far out into the distance behind the screen.

atokirina': Avatar 3D seeds

Of course in Avatar when you reach out and touch the floating seeds that seem just in front of you, you can’t actually grab them and hold them and move them around in your hand. You’re probably thinking: “Well, duh! Of course not!”. But with Project Natal you can actually do that!

You see, project Natal already knows exactly where your hand is in 3D space. And it knows exactly where your eyes are in 3D space. So if you tell Project Natal exactly where your TV is in 3D space, by telling it what size TV you have and where you put the Natal sensor bar, then it can very easily calculate the line from your eye to your hand to the point on the screen that you are grabbing. So it knows which part of the scene you are touching.

More importantly, it knows exactly where to draw something so it looks like you are holding it in your hand! Imagine that 3D in front of the screen effect in Avatar but with a sword, gun, baseball bat, or even a weighted companion cube, that is drawn at the exact location of your hand and follows your hand precisely whenever you move or rotate your hand, and compensates for moving your head. It would look exactly like you were holding the virtual object in your real hand right in front of your eyes. You wouldn’t have to mime anything, because you can really see and hold the virtual object in your hand.

So, what’s the catch? Well, it only works when your hand is in front of the TV. When the 3D object looks like it should cross in front of the edge of the TV, the edge of the TV actually goes in front of it instead, and half the object disappears and it spoils the illusion. So you need a big enough TV, and you need to be close enough to the TV.

And there’s the catch that the hilt of a sword or the handle of a gun that is supposed to be drawn in front of your hand can’t actually be drawn in front of your hand because it’s drawn on the screen and your hand is in the way. The rest of the gun or sword would look right, but not the part that should be covering your hand but instead your hand seems to be covering.

The other catch is that the image on the TV is a bit out of focus and blurry when you look at your hand. Even if the image is in stereoscopic 3D and looks like it is right next to your hand, either the image or your hand will be out of focus because in reality they are at completely different depths. That would be OK, except that it is actually hard for your eyes to focus on one depth while they are converging (aiming) at a different depth. That makes it hurt to look at 3D that is too far in front of the screen. So you need to be reasonably close to the screen, and have your hand a reasonable distance away from your eyes. Or you just need to not look directly at the object in your hand and focus more on the rest of the scene.

Another catch is that there is lag. You would move your hand, and 100 ms later the thing you are holding will move. The same with moving your head.

I still think it would be awesome though. Especially with a big screen.

Ricochet's avatar (from Scientific American)

Think about the Project Natal game Ricochet. You don’t actually hit balls with your body. Your avatar on the screen, in it’s own virtual world, copies your movements and hits the virtual balls. Meanwhile you are outside in the real world and balls never come out of the screen towards you. But with Stereoscopic 3D, the real world and the virtual world can share the same space out in front of your TV in your living room with you. So the balls would come all the way out to your real hand, and you can hit them with your real hand, or catch them with your real hands, and even hold them and move them around in your hands. The same with fighting games, or sports games, or shooting games. Wouldn’t it be cool to have to physically duck projectiles that are really coming out of the screen at you.

Most project Natal games that we have seen have an avatar interacting with things on your behalf, instead of you interacting with them. Except for Milo and Kate, Burnout Paradise (the racing game), the quiz game, and the first part of the fighting game when you talk to the opponent. Wouldn’t Milo and Kate be better though if the thrown goggles really did seem to come out of the screen? And if you really could catch the goggles? And if you could see the goggles in your hands? And if you could really put them on? Obviously you wouldn’t be able to feel them, but you could see the goggles in your hands and responding to how you move them.

To some extent the things that I’ve said above can also be done without stereoscopic 3D, and only using the Johnny Lee head-tracking 3D effect, but it wouldn’t be quite as realistic (unless you only have one eye).

With stereoscopic 3D support, Natal would need a new slogan:
“No avatar required. You are the avatar.”

Project Natal at CES 2010

Project Natal’s most recent appearance was at CES 2010 earlier this month.

At CES, Microsoft gave a really boring introduction, then showed a new video called “Innovation Journey”.

This is my favourite video, since it actually explains how Project Natal works, shows what Project Natal’s depth sensor is actually seeing, and talks a bit to some of the people behind it. And of course it tells us the release date!

Note in particular the scenes where it shows on the screen a 3D view of what the depth sensor is seeing, with the different object types colour-coded. Notice how there is a black hole in the background where the camera can’t see what’s there because it’s blocked by you standing in front of it. But aside from that, it has a very good 3D model of the scene. You can see how easy it would be to recognise different kinds of objects from this sort of information, even without the colour data that you also get. Much more powerful than just a camera like eye-toy.

We also get to see a (blurry) close-up of the back of the project natal hardware.

At CES 2010, Microsoft also talked about Xbox Live, and their own version of Nintendo’s Virtual Console. The Xbox is getting a virtual arcade called Games Room, where your avatar can walk into a 3D arcade and see and hear all their purchased arcade games in their 3D cabinets in attract mode before you play them. You can also invite friends and play against them online. They have 30 different arcade games that you can buy.

And they talked about how people will be able to rent and watch videos online quickly, using Xbox Live.

Japanese Game Developers Back Project Natal

With any luck the Xbox 360 should be getting lots of new games supporting Project Natal. Which is good, because most existing Xbox 360 games probably aren’t going to have Project Natal support added.

At TGS 2009 (that’s the Tokyo Game Show), Microsoft featured a panel with Japanese game developers. And they announced that most of the big game development companies are keen on supporting Project Natal.

The following game companies have been confirmed as currently developing for Project Natal: Activision Blizzard, Bethesda Softworks, CAPCOM, Disney Interactive, Electronic Arts, Konami, MTV Games, Namco Bandai, Sega, Square Enix, THQ Inc., and Ubisoft.

Those companies make up 70% of the third party games sold for recent consoles. So don’t fear that we won’t get any games for Natal.

As mentioned in the video above, representatives from Konami, Capcom and Sega (left to right) gave a special panel presentation at TGS. Here’s a humorous snippet:

Project Natal at Tokyo Game Show 2009 (TGS)

Back in September 2009, the Xbox 360’s Project Natal made another public appearance, this time at the Tokyo Game Show.

Here we got to see new Project Natal controls for Beautiful Katamari:

And new Project Natal controls for Space Invaders Extreme (see the end of this portuguese video), plus more Ricochet and Burnout Paradise (car racing):

Project Natal Parody

This parody has nothing to do with Milo. It is a parody of most aspects of the original Project Natal announcement video. It’s very funny:

Project Natal Video at E3

Microsoft first showed Project Natal to the public at E3 in June 2009. And people were stunned.

First they showed a video that they had prepared earlier, featuring a happy family playing on their XBox 360, using only their bodies, voices, and a real skateboard:

First it demonstrated recognising when a user entered the room, and which user it was. This is a confirmed feature that Project Natal will be able to do.

And it demonstrates a virtual character maintaining eye contact with the user as they walk around in front of the screen. That is also quite easy for Natal to do.

And it demonstrates the virtual character addressing the user by name in a sentence full of emotion. Which means either Microsoft has made a massive leap in speech synthesis technology; or more likely, that game makers could get their voice actors to record many of the most common names in various contexts, so users can feel personally involved. I’d like to see this more in games, even if some users with uncommon names miss out.

Then it demonstrates the virtual character responding to spoken dialog like “Let’s do it.” with an appropriate response and doing what it’s told.

Then it demonstrates how Natal could be used for 1-to-1 fighting games, where real punches, kicks, and blocks are used, and the avatar follows all the users moves perfectly. I can’t wait to try that kind of game.

Next came car racing with tracked hands steering in the air, and changing gears. I can’t see how they are controlling acceleration and braking, but Natal could do that by tracking your feet. It allowed multiplayer and didn’t get confused by others’ hands. And it allowed actual pit-work with 1-to-1 motions. That’s pretty impressive. But I suspect gamers would rather have a split-screen multiplayer racing option.

As we’d already seen, there was tracking of all your limbs in a rampage-like game. But this time they went for a mirror view rather than looking at the back of a transparent avatar. The impressive part is the roaring and breathing fire. I don’t know if that was done with the microphone or the 3D camera, but it looked cool.

Then they showed soccer with full body tracking. I can see that being popular, since sports games have always been successful with innovative but realistic controls. I’ve never been able to get into sports games much, but it was fun on the Wii.

I really like the part when the XBox 360 scans the appearance of the skateboard, and uses it as an in-game object. Users like being able to customise their game characters, but consoles have never before had an easy enough way to draw or send designs to the program. I doubt Project Natal can really project a flash of visible light onto it, but the video could be showing us the camera view as it’s displayed on the TV screen.

And the hand gestures to control the menu are good, but could get annoying if you have to go through a long list one item at a time. In real life when you spin something it has momentum, and spinning it harder makes it go faster. Unfortunately there is no haptic feedback, so there is no easy way to measure how hard someone is pushing, only how fast they are pushing.

Skateboarding games could work well, without the need of a Balance board like on the Nintendo Wii.

Then it goes back to facial recognition like at the start of the clip, to log into instant messaging, and voice commands to call someone. Who surprisingly answers the call instantly without complaining about being interrupted in the middle of something.

The video phone system looks good. But I can’t help noticing the video of your friend is in 2D. Project Natal has a 3D camera. So it wouldn’t be hard to have the friend extending out in front of the frame, especially when she does the hand gestures. It would look better on a stereoscopic 3D TV, which I really hope XBox 360 will be supporting one day, with or without Project Natal.

Since Project Natal can make a 3D scan of your whole body and use it as an avatar, the dressing up your avatar while online shopping could be useful. You could virtually try it on, and move around in it. But that would require significant effort on the part of clothes shops or manufacturers. Perhaps it would just be used for downloading clothes for your avatars.

The quiz game looks interesting, if it can do the hand tracking accurately enough to tell who pressed their “buzzer first”. But the video gets one thing wrong. The host is trying to draw out suspense with “Millard Filmore is… ” before saying “correct”, and the players are worried. But the fact that the game show host recognised the name and was able to say it back shows that the game makers programmed it in, which they wouldn’t have done for a random wrong name.

It also shows online play against another family.

And last of all, it shows a media player controlled by gestures and voice commands.