The Life and Times of Brock

I talk about my life as a geek. You love it.

Eluvium - A Life in Tides Less Current

(download)

Give a listen to this song, at night, with your eyes closed, and no distractions. It's 10 minutes and 41 seconds. I'll wait.

Now, tell me what you feel.

I'll update this later with context. At the moment, this is just for a friend to listen to, so we can share ideas.
Posted

Touch-based Mobile Games

Okay so the main problem with the mobile space is that it’s currently dominated by touchscreens, and as such it makes it difficult to create first-person immersion in a game.

The technology is near-perfect for games that require an overhead view (such as an RPG a la Final Fantasy), or a third-person view (a la Diablo), where the touch commands can be quite easily mapped and pinpointed. Also, because of gesture-based movements (using the accelerometer) it’s quite easy, and possible, to have racing games.

Casual, puzzle and racing games basically dominate the market. However, now with Final Fantasy I and II on the market, hopefully the RPG market will get heavier (and then eventually saturate, but that’s a story more inclined with economics instead of game ideas).

As I see it, the main problem that people have with touch technology is that they’re still stuck in the days of having either a mouse pointer, a keyboard, or a controller. As such, nearly all games I’ve played that require some type of first- or third-person controls, it will emulate the PS3 and Xbox controllers, essentially having two touch-based ‘joysticks’ on the screen.

The first fps I played on a mobile device was actually Doom for Android, which used a virtual D-Pad (horrible) to move, and a roller ball for shooting (press it to shoot) and moving (roll forward/backwards to move, left/right to turn). All in all, it gave me a bad feeling in my throat every time I played it and tried to like it. Basically from that moment on, I told myself there had to be a better way to manipulate a character in first-person.

Needless to say, there are problems with the current idea of using touchpad-based joysticks, for a few reasons.

  1. The touch-sensitivity is very broad, especially based on one’s fingers. Movements are very ambiguous, and hard to make concise and accurate.
  2. A double-edged sword: either the ‘joystick’ pads are too far in the middle of the screen, and cause the fingers to take up too much visual content, or they are too far to the bottom corners that it makes it nearly impossible to move it backwards or to the side (on both sides where the edge is).
  3. The pads are usually too big, and take up too much space, or they are made too small (reference point number 1) and hard to use (the optimal thing to do here would be to make them semi-transparent, anyway).

Basically, what I’m saying is that we are using a new input technology, and both the software and our way of thinking also needs an update.

Noting here, Final Fantasy I is using an arrow-based D-Pad approach to movement in the game. It’s not actually that bad because it’s a boolean approach (ie. there are only four points that are either on or off, and not a more fuzzy approach of a joystick-like movement scheme), and that it’s transparent. It keeps the fingers away from the content of the page, while still being easy enough for a user to automatically learn how it works.

The battle screen here is thankfully touch-based, with big, bold icons to show what act a person could do. A lot of thought has gone into this to be optimal for touch devices.

http://images.pcworld.com/news/graphics/167403-iphone-3gs-final-fantasy-7_original.jpg

If we have a look here, it’s an emulator for the iPhone and iPod Touch, using exactly the same controls. I can understand why this is like this (after all, it’s en emulator, not a completely rethought game), but the reason I put this here was to show that this is the mind-set of most developers at the current moment (that is, grab a pre-existing technology, and hack it into a touch-based game. Profits ftw!).

In keeping with my idea of updating the user interface to match with the touch-based device, here is what I would have personally done if I were making an RPG on a mobile touch device (and who knows? I still actually might):

phantomtrainlocomotive1

Of course it would look slightly better than that (hopefully with transparent images around the side that maybe blur the background like Aero Glass, but not exactly destroy the game’s vision), but I’m sure you can catch where I’m coming from here; both hands are used to do an even amount of tasks, and it’s visually taking up less of the main content (the central area) than the version of Final Fantasy above (not that above is necessarily bad, I just believe that this is more optimized for touch). And of course I would try to offer the option of changing back to the other option if the user wanted, but I just prefer this solution.

If the player wants to access the menu, they won’t mind so much if their fingers cover the central area (they are, after all, going to a splash screen). If the player wants to talk, or interact with anything they are facing, pressing the middle part of the screen (with either finger, and the character would start interaction (or fire the event, whichever works).

Also, with exactly the same buttons I’ve got here, I can cause the characters to run (by double-tapping a button and holding it, or pressing both up/up or down/down buttons for multitouch-based devices), or turn but not move (by tapping one of the ‘buttons’ for less than a few milliseconds).

What I’m saying is, this idea fills the criteria for an RPG, while optimizing it for touch by not trying to make it exactly as its last platform was (as in, a D-Pad on the left side, action buttons on the right etc).

Then I started thinking, “why can’t we apply those principles of simplicity to first-person games?” and this is what I came up with:

Quake-2-3D-FPS

Again, simple movement touch-pads that surrounds the main area, stopping the user from obstructing the vision with his own fingers. In order to sprint (if this is a multitouch device), both forward buttons can be used at the same time (and same with running backwards, I suppose). If the device is not capable of multitouch, a double-tap can be substituted on one of the directional buttons. A player can still move diagonally forward (there would be a hot-spot between the side-keys and the forward/back keys which enables diagonal movement), and change weapons quite easily (when the weapon-change button is pressed, the menu pops out—it is not there for regular gameplay). The reload section would have a quick visual interface which would show how many bullets were left in the current gun, and the menu would subsequently pause the game.

I imagine that the facing of the game would either be controlled by the accelerometer (by moving the device itself) or by swiping the finger across the middle, as is seen in most applications.

From here on, the part about shooting the weapon (which even begs the question about why we need so much violence in a mobile, handheld game?): we can choose to press wherever on the screen, and the weapon shoots in that direction, or we could choose to have the weapon honed in the middle of the screen, unmoving. Either way, they both have their own reasons, and I would have to try it out to make a proper decision as to which way I prefer.

In most games, there is the ability to aim ‘down the scope’ of some weapons. This would be handled in the same section of “tap to shoot”, but would be done by holding the finger down for a set number of time. This would cause the weapon to be placed close to the eye, and subsequently more accurate (as opposed to ‘firing from the hip’ as our good friends in Call of Duty 4 inform us). To break from aiming down the scope, one can tap and hold the middle, or just choose to sprint somewhere (as mentioned above).

So basically all I need to do now is create a prototype of this. If someone is reading this, and such an interface already exists on a mobile device, I would like to know to try it out and see how it works (if it does, come to a realization that I’m in over my head here and quit, and if it fails, pretty much radically change my ideas and release a Family Guy-based jigsaw puzzle—Either way it’s back to the drawing board).

Either way, tell me your thoughts.

Posted

The Problem with Computer Touch Screens

Okay, so touch-screens are certainly not a new thing, and even integrating them into laptops are not even new (Microsoft and its partners have been doing so since the early 2000’s), but have always remained a niche market. There are a couple of reasons.
  1. The touch technology has no been very good until capacitive touch – that is, they’ve needed to use some type of stylus or it just was not accurate enough for a finger to use
  2. Touch screens have been integrated into monitors, which are standing vertically, meaning that, in order to interact with them, the fingers and hands must cover the content of the monitor to actually use them. Also,
  3. Nobody wants to lift their arms up all day to work on a single display. This phenomena is what is called the ‘gorilla arm’, where it would cause strain in the arms and shoulders of the users if it went for too long.
The iPhone and iPod Touch, as well as a series of fantastic touch-based phones (mostly made by HTC) are doing fantastically well. But this is due to the fact that they are smaller than a 4” screen, and are designed to be used with the thumbs. It’s natural, intuitive, and our hands don’t usually get in the way.
Try that with a proper monitor, though, and it just doesn’t work.
Hence, my idea to bring touch completely into the desktop world is deliciously simple. Basically, we throw out our mouse and keyboard, and replace that with the same sized monitor laying flat on the desk. It should have the same size and resolution of the main monitor, and have capacitive touch technology to it.
Top 10 Coolest Laptop Concepts
This picture gives us a quick idea of how it would be, except that, in my idea, both monitors will show exactly the same content. The hands would be rested at the bottom, with indicators for where the fingers are located at the top. The mouse cursor would be gone entirely, with everything touching directly to the bottom monitor.
Essentially, here we have destroyed the need for the mouse. The scroll wheel can be controlled by gestures, and both right-click and left-click are handled by default in Windows 7 (regular tap to click, then either click and hold, or put two fingers down to right-click).
Now, the main problem is the keyboard. Most people would define a dual-screen computer or laptop with a regular-sized keyboard, such as this concept from Hewlett-Packard:
Top 10 Coolest Laptop Concepts
Just by looking at that, one can tell it’s not going to be fantastic to type on. Firstly, there’s no tactile response for the keys, and one can’t properly tell where their fingers are (because there’s no feeling, it’s just a flat plane, I’m sure mistyped words would be commonplace).
The iPhone here works because we can use our thumbs, see what buttons we’re about to press, and when we do press the buttons a large indicator shows up above the finger (where it would previously be blocked). This works, because it’s a smaller device. But if we make the device bigger, then it’s not quite as optimal.
So I’ve decided to change our concept of the keyboard somewhat. Microsoft had a decent idea back in their earlier touch-screen days called DialKeys:
I imagine my concept would be somewhat similar to that, without spreading it out as much. Make it less circular, more to the ergonomics of how we use our hand. Here is Windows 7’s default touch keyboard looks:

There are a couple of problems with the default. Firstly, it covers up too much screen content. Secondly, it’s too rigid and square.
My touch keyboard would be curved, more in-line with the DialKeys (but maybe a midpoint between the two), with everything being Glass (transparent), so that the top screen can still see content behind it, yet see what the fingers are touching.
Now, the positioning of the keyboard would be crucial. Should it go low, just above the taskbar (as are the DialKeys), or should the taskbar be moved elsewhere (to the top or sides?), and then how do we access it when we need it (I’m going to assume we throw the keyboard away when we don’t need it, and activate it when we do).
I still need to do some concepts, and will update this post with drawings and so on. I imagine there is a tab on the side of the page (as is with current Windows 7 touch interface) that is ‘dragged out’ and becomes the keyboard.
Then, finally my last concept is to have vibration creators just in the corner of the screen which are activated every time a key is pressed, to give the user tactile feedback every time they tap a key, as per most Android devices.
This post is far from finished. Hopefully if I’m able to purchase a touch-screen monitor, I’ll be able to figure out how to hack it up and turn it into a mouse/keyboard replacement.
Posted