Motion Sports
UbiSoft also showed a trailer for their Kinect sports game: Motion Sports. Which appears to include multiplayer skiing, soccer, and gridiron (US football). And perhaps boxing (see the magazine at the end).
I love the snow throwing part of the Skiing game.
Categories: Project Natal Tags: boxing, E3, gridiron, Motion Sports, multiplayer, skiing, soccer, video
Kinect Adventures
Kinect Adventures was the fourth game Microsoft demoed for Kinect (Project Natal) at their E3 2010 press conference. It is a combination of Ricochet (the famous ball deflecting brick breaking game), River Rush, and some other “adventures” that involve collecting white tokens with the letter A on them by holding your body in the right shape.
This video features the same woman who demonstrated Ricochet last year, demonstrating the River Rush part of Kinect Adventures.
Kinect Adventures trailer:
It turns out, Ricochet is actually multiplayer. Here’s a gameplay video of Kinect Adventures:
This is the original version of Ricochet seen last year:
We’ve seen Ricochet videos from this year with a white token with a letter A on it, and now we know why. It’s been fitted into another game. I’m guessing that means Ricochet won’t be included for free with the Kinect hardware, despite Ricochet having been synonymous with Project Natal for the past year. It’s more likely Kinect Sports will be bundled with Kinect.
Categories: Project Natal Tags: E3, Kinect Adventures, multiplayer, Ricochet, video
Kinect Joy Ride
The third Kinect (Project Natal) game Microsoft demoed (after Kinect Sports) at their E3 2010 press conference was Kinect Joy Ride.
E3 2010 trailer video:
Here’s the same game, at E3 2009, one year ago, before they moved to Project Natal/Kinect. It was originally going to be free:
And the E3 2009 trailer video:
It looks like a lot of fun. More fun than the Burnout Paradise racing game they have been showing previously. But maybe that’s just my taste.
Categories: Project Natal Tags: E3, JoyRide, multiplayer, racing, video
Kinect Star Wars
The best Kinect (Project Natal) game that has been demoed so far at E3 2010 is an unnamed Star Wars game that will be released in 2011 by LucasArts. It looks like an on-rails lightsaber and force powers game specially for the Project Natal.
Here’s the Star Wars Kinect Trailer:
LucasArts weren’t brave enough to actually demo the gameplay live, so instead Cirque Du Soleil mimed along to the prerecorded trailer. Here is a short clip (the only one I could find):
Unfortunately the above clip focuses on the part that is impossible with Kinect: pushing against your opponent’s light saber. As Newton’s third law of motion tells us, you can’t push against something unless it is also pushing back against you an equal amount. And empty air won’t do that. Fortunately, that law of physics doesn’t apply to the Force, so I’m looking forward to Force Push gestures, Force Speed gestures, and other force powers. And deflecting laser beams and slicing up Storm Troopers also looks fun, since it makes sense that Storm Troopers wouldn’t offer much physical resistance to a light saber. But light sabers aren’t supposed to be able to go through other light sabers, so there’s going to be a limit to how well light saber combat will work.
Why is it on rails? Well, so far nobody has shown how people will navigate in a Kinect game without a controller. Oops. Kind of an important oversight. Sony’s PlayStation Move also had that exact same problem, which they only solved by introducing the Move SubController, which is basically a Nunchuk.
Personally I think navigation would be one of the most fun parts of Project Natal. There are several ways I imagine it could be done. You could walk or run on the spot to walk. You could turn by turning the upper half of your body, or by swinging your arms around your body in the direction you want. Or you could just turn your feet, or one foot. You could lean in the direction you want to go. You could move one leg in the direction you want to go. You could stand on different parts of the floor like a virtual dance mat. There are lots of possibilities and I hope someone looks into it.
Anyway, this will be a great Star Wars game to look forward to next year.
Two other Star Wars games are being shown at E3.
The Force Unleashed 2. The original game made a big deal about motion controls, so I’m surprised there’s been no word yet on Kinect or PlayStation Move compatability. It will be released a week before Kinect. It would be a shame if this only supports Wii Motion plus.
Here’s the E3 2010 cinematic trailer (betrayal):
The Old Republic. This is a Massively Multiplayer Online game set a few thousand years before the Star Wars period we are more familiar with. Currently it’s only for the PC, which is unfortunate. However online games have a longer life than other games and are more likely to receive large updates.
Here’s the E3 2010 cinematic trailer:
Categories: Project Natal Tags: E3, multiplayer, navigation, PC, Star Wars, video
New Kinect Trailer (E3 2010)
New Xbox 360 Kinect trailer! (Kinect is the new name for Project Natal).
First it shows Kinectimals which is the Kinect (Project Natal) equivalent of Sony’s PlayStation Move game EyePet. But it’s been super-sized. You get a life-size tiger, lion, or other big cat to play with. And it doesn’t appear to have augmented reality.
Then it shows the latest version of Ricochet, the game where your avatar deflects balls back to destroy blocks. Microsoft have been showing this game almost exclusively for the past year.
Then it shows Kinect Adventures, which is the river rafting game for two players.
Then it shows the media player with voice controls which was in the video last year. They were watching Harry Potter. I wonder if there will be Harry Potter games for Kinect, since they would be an obvious choice for gesture and voice control. Lego Harry Potter (Parts 1 and 2) and Harry Potter and the Deathly Hallows (Parts 1 and 2) are still to be released, so keep your fingers crossed. There are two franchises players have been dreaming of Kinect controls for since long before Project Natal: Star Wars and Harry Potter.
Then it shows a new dancing game, called “Dance Central”. Unlike the standard Dance Dance Revolution/Guitar Hero rhythm and timing games, this game doesn’t have scrolling notes that you have to hit in time with the music. Instead it has a wheel on the side of the screen that tells you what dance move you have to do and what the next ones will be, and you have to spend a few seconds doing that move correctly. And of course this game requires no extra hardware, due to Kinect.
Then it shows two Kinect Sports games hurdles and table tennis. Sony’s PlayStation Move also does table tennis, as does Nintendo’s Wii Motion Plus. Microsoft’s version seems the worst since you are using your open hand instead of a table tennis bat. If I was Microsoft, I would let players hold any random prop they have lying around the house and use it as a table tennis bat. A spatula, a carrot, your TV remote control, even a real table tennis bat, or a Wii Remote. I don’t see why Kinect can’t use random household objects as props.
Then it shows Your Shape: Fitness Evolved. You might remember this from the Nintendo Wii, it came with a Wii webcam peripheral. Now it doesn’t need one. This was an obvious choice for Kinect, and I’m surprised it never occurred to me that we would see this game for Kinect.
Then it shows Kinect Joy Ride. This is actually an old game that was going to be released last year for free on Xbox Live Arcade with traditional controls, but it was delayed and made into a Kinect launch title. It is a cartoony car racing game with obstacles that includes split-screen multiplayer.
Lots more games are being announced though, so stay tuned for a low more info and videos.
Categories: Project Natal Tags: augmented reality, Dance Central, dancing, E3, fitness, Harry Potter, hurdles, JoyRide, Kinect Adventures, Kinect Sports, Kinectimals, media player, multiplayer, props, racing, Ricochet, table tennis, video, Your Shape
Project Natal Renamed Kinect?
Sorry about the lack of updates, I’ve been busy with political causes and my personal life.
But according to rumours, Microsoft has accidentally let the cat out of the bag, and the new name for Project Natal is Kinect.
And among other games, Kinect will have the following “Kinect” named games:
“Kinectimals: A virtual ‘big cat’ trainer that lets you train and play with 20 different feline members of the animal kingdom, including tigers, lions and cheetah.
Kinect Sports: Microsoft’s answer to Wii Sports, Kinect Sports features table tennis, boxing, bowling, soccer, beach volleyball, and track and field; all controlled using your body.
Kinect Adventures: This game combines a river raft simulator (recently seen on Youtube) and obstacle course for up to four players. Rafting works in pairs, with players working together and moving in the same direction to steer. Jumping will also grant access to secret areas.”
But keep checking back over the next couple of days for a lot more information, as E3 will bring loads of official announcements.
Categories: Project Natal Tags: E3, fighting, Kinect Adventures, Kinect Sports, Kinectimals, multiplayer, soccer
How Project Natal Works
Project Natal has two input devices:
First is a 3D camera, which can measure both the colour and the distance of every pixel.
Second is a microphone array, which is several directional microphones arranged in a pattern. They can separate out different sound sources and determine where each sound came from, and can thus filter out any noise.
The 3D camera is actually made out of two cameras, one that senses distance using infra-red and one normal one that senses colour. But it helps to think of it as a single camera that can also measure depth.
The 3D camera makes Project Natal much more powerful than a 2D camera like the Eye-toy. It makes it dead easy to filter out background objects, and find only the objects that you are looking for. And it doesn’t need to rely on colours to recognise things, it can just look at their 3D shape.
It could operate in complete darkness and still see the 3D shape of everything, but knowing the colours would make it easier to recognise hands and faces and other things.
The 3D camera would also allow it to easily scan in any 3D object and convert it into a virtual object in the game. It has only been demonstrated with the 2D image on a skateboard, but there is no reason why Natal couldn’t scan in any object you showed it, if you showed it from a few different angles.
One downside of the 3D camera is that it relies on line-of-sight and can’t see behind things. So it can’t track your hand when it goes behind your back, or when someone stands in front of you. But a Wii Remote, or magnetic 6DOF tracker could still track it.
Another downside is that it could get confused about the distance of transparent or reflective objects, since the IR light that goes back might have first come from somewhere further away.
The microphone array is important for speech recognition, since it can filter out noise, and could separately recognise several speakers talking at once. Especially since the TV will also be making noise. It could also be used to have virtual characters still look at you when you go out of sight of the camera and still talk to it. And in a multiplayer game it helps it know which player is speaking by knowing which sound came from which body that it can see.
It doesn’t just recognise words though. In games like Milo and Kate it can recognise the emotion of the speaker, and can tell things like whether they are telling a joke. It could also be used for rhythm games by using anything that makes a sound, or by clapping. It’s not known whether the monster game used the microphone or facial expression tracking to control breathing fire. It would have to be a good quality microphone, because normally speech recognition requires a microphone a few cm from your mouth.
But the most important part of how Project Natal works is the software. Microsoft, with some help from Peter Molyneux, went around to all their different research projects that they’d been working on for other projects, and collected their software technology and put it all together.
First, there’s the speech recognition. Microsoft has been working on their own speech recognition engine and API for a long time. You can use the same speech recognition engine as Natal for free in gaming right now if you want. Download GlovePIE, and train speech recognition in the Speech control panel. If you only have Windows XP, you will need to first either install the speech recognition from Microsoft Office (best way) or download and install the SAPI 5 SDK with speech recognition.
Then there’s facial recognition. You might have seen this in other Microsoft products, such as Windows Live Photo Gallery, which you can download here for free, and start your computer automatically recognising all the faces in your photos.
Peter Molyneux also mentions handwriting recognition, although we haven’t seen it used yet. But I’m guessing we will in some games.
And there was no doubt a lot of other code.
Then there’s a huge amount of new software which Microsoft had to write. It has to find the shapes of people, and from there convert the surface data into 48 skeletal points for each player. It can do that for 4 people at once, 30 times per second. It can even identify individual fingers if they are close enough.
The need for all that software is why Project Natal could only have been made fully by Microsoft, not Nintendo, Sony, or Sega.
Categories: Project Natal Tags: Milo, multiplayer, rampage, skateboard
Project Natal Parody
This parody has nothing to do with Milo. It is a parody of most aspects of the original Project Natal announcement video. It’s very funny:
Categories: Project Natal Tags: fighting, media player, multiplayer, painting, parody, racing, video, video conferencing
Project Natal Video at E3
Microsoft first showed Project Natal to the public at E3 in June 2009. And people were stunned.
First they showed a video that they had prepared earlier, featuring a happy family playing on their XBox 360, using only their bodies, voices, and a real skateboard:
First it demonstrated recognising when a user entered the room, and which user it was. This is a confirmed feature that Project Natal will be able to do.
And it demonstrates a virtual character maintaining eye contact with the user as they walk around in front of the screen. That is also quite easy for Natal to do.
And it demonstrates the virtual character addressing the user by name in a sentence full of emotion. Which means either Microsoft has made a massive leap in speech synthesis technology; or more likely, that game makers could get their voice actors to record many of the most common names in various contexts, so users can feel personally involved. I’d like to see this more in games, even if some users with uncommon names miss out.
Then it demonstrates the virtual character responding to spoken dialog like “Let’s do it.” with an appropriate response and doing what it’s told.
Then it demonstrates how Natal could be used for 1-to-1 fighting games, where real punches, kicks, and blocks are used, and the avatar follows all the users moves perfectly. I can’t wait to try that kind of game.
Next came car racing with tracked hands steering in the air, and changing gears. I can’t see how they are controlling acceleration and braking, but Natal could do that by tracking your feet. It allowed multiplayer and didn’t get confused by others’ hands. And it allowed actual pit-work with 1-to-1 motions. That’s pretty impressive. But I suspect gamers would rather have a split-screen multiplayer racing option.
As we’d already seen, there was tracking of all your limbs in a rampage-like game. But this time they went for a mirror view rather than looking at the back of a transparent avatar. The impressive part is the roaring and breathing fire. I don’t know if that was done with the microphone or the 3D camera, but it looked cool.
Then they showed soccer with full body tracking. I can see that being popular, since sports games have always been successful with innovative but realistic controls. I’ve never been able to get into sports games much, but it was fun on the Wii.
I really like the part when the XBox 360 scans the appearance of the skateboard, and uses it as an in-game object. Users like being able to customise their game characters, but consoles have never before had an easy enough way to draw or send designs to the program. I doubt Project Natal can really project a flash of visible light onto it, but the video could be showing us the camera view as it’s displayed on the TV screen.
And the hand gestures to control the menu are good, but could get annoying if you have to go through a long list one item at a time. In real life when you spin something it has momentum, and spinning it harder makes it go faster. Unfortunately there is no haptic feedback, so there is no easy way to measure how hard someone is pushing, only how fast they are pushing.
Skateboarding games could work well, without the need of a Balance board like on the Nintendo Wii.
Then it goes back to facial recognition like at the start of the clip, to log into instant messaging, and voice commands to call someone. Who surprisingly answers the call instantly without complaining about being interrupted in the middle of something.
The video phone system looks good. But I can’t help noticing the video of your friend is in 2D. Project Natal has a 3D camera. So it wouldn’t be hard to have the friend extending out in front of the frame, especially when she does the hand gestures. It would look better on a stereoscopic 3D TV, which I really hope XBox 360 will be supporting one day, with or without Project Natal.
Since Project Natal can make a 3D scan of your whole body and use it as an avatar, the dressing up your avatar while online shopping could be useful. You could virtually try it on, and move around in it. But that would require significant effort on the part of clothes shops or manufacturers. Perhaps it would just be used for downloading clothes for your avatars.
The quiz game looks interesting, if it can do the hand tracking accurately enough to tell who pressed their “buzzer first”. But the video gets one thing wrong. The host is trying to draw out suspense with “Millard Filmore is… ” before saying “correct”, and the players are worried. But the fact that the game show host recognised the name and was able to say it back shows that the game makers programmed it in, which they wouldn’t have done for a random wrong name.
It also shows online play against another family.
And last of all, it shows a media player controlled by gestures and voice commands.
Categories: Project Natal Tags: E3, fighting, media player, multiplayer, quiz, racing, rampage, shopping, skateboard, soccer, video, video conferencing