The Life and Times of Brock

I talk about my life as a geek. You love it.

Seabird: A Mozilla Labs Concept Series Phone

By now, the stories around the web are far and wide on the new Mozilla concept phone called Seabird. If you've not read, you can see it on the following link: https://mozillalabs.com/conceptseries/2010/09/23/seabird/

And it looks sexy:
Seabird Concept 1

It uses Android (but only looks like Eclair; would like some Froyo love to make it look more modern), and has some interesting things, such as the concept of dual pico projectors for keyboards.
Seabird Concept 2

Seabird Concept 3

While these both look cool and will undoubtedly give you awesome bragging rights to anyone you showed this to, I'm not sure exactly how comfortable these will be to use. Soft keyboards (touch-based, software keyboards) have a problem of usually being too small, and the fact that your finger covers the keys, but the problems on a projector-based keyboard is that it removes Haptic feedback (something that comes in handy on nearly any type of touch screen), and that the surface it's on will still be entirely flat (depending on what it's on). Also, it has problems with camera input, in that it's capable of multitouch (it uses a basic camera, after all), but it has trouble differentiating between fingers if one goes in front of the other. For the upper picture (split keyboard), I can see overlapping fingers being a real problem. Of course the software developers can just go the Xbox Kinect route and develop fingers as bone structures and try to internally render where it believes the fingers to be touching.

For most words, it won't be a problem. But if we get words that use multiple keys on a single line, such as sad, agree, typewriter, among others, will become quite annoying, and force users to make exaggerated movements when typing (those who employ a two-finger typing scheme - a slower typing scheme - will ironically be least affected by this technology constraint, I'm guessing).

I think that Pico-based keyboards need their own input style also, similar to the concept of Swype (using a gesture to trace a word's path on a keyboard). The projector could map out the path (even offer a line trailing the finger). The good thing about using this type of soft keyboard is that the keyboard size and way it functions can change on the fly, and offer word suggestions as part of the projector (instead of using valuable screen real-estate for such things).

However, my big problem is seeing a full version of Windows 7 running the Firefox browser coming out of a projector. I'm not sure if that's an RDC client running through the phone or what, but it's a tad unreasonable to assume it could run a fully-blown OS like Windows alongside Android on a phone.

Seabird Concept 4
While that's certainly a nice looking phone, I don't like that it has a Mini-USB and not Micro-USB. Mini-USB is the past, whereas Micro-USB is the future, is thinner, and much more durable.
Look how sexy the right one is, in comparison.

Another thing that I'm not so sure about is how top-heavy it looks. The bottom of it looks rounded, and therefore unstable when on a flat surface. Also, it doesn't seem to be the most comfortable of devices when reaching for the top-half of the screen (something Android users tend to do quite an amount, with the slide-screen notification bar at the top).

Still, the concept is cool and it's amazing to see what geeks with a certain kind of passion and finesse for design can create. Certainly, go and look at the video posted on the site, and tell me what you think.
Posted

The Infamous Tablet Computing Interface

So the iPad came on sale the other day, and has sold huge numbers and generated massive amounts of hype. The computer is a tablet, or a slate, which is a form factor that is designed to sit squarely in-between smartphones and laptops.

The world was split the day the announcement came out. Half of them (mostly first-gen iPhone users I’d be willing to bet) praised Steve Jobs on his incredible vision of the future, while many others gave it one massive ‘meh’. The concept of this computer is designed so that anyone is able to use it without much hassle, even people who haven’t used computers before.

But for power users, it’s not exactly their type of beast. I couldn’t see myself scurrying off to spend a minimum of US$500 on this type of device, in that it lacks what I want of my computers: multitasking (background processing) and access to some sort of file structure.

Firstly, due to the small screen size and limited processing capacity of the iPod Touch and iPhone, it makes sense for a user to only want to be running a single application at a time. Using too many applications drop battery life significantly, makes programs run much slower, and there is also the idea of switching tasks on such a small screen which is difficult to fathom (from the Windows Mobile- and Android-based devices I’ve seen and used, it’s failed quite considerably, though apparently the Palm Pre is quite elegant in multitasking). However, in a screen that is 10 inches, people would assume there would be room to have some type of dock on the bottom that would allow for task switching. But it wasn’t so.

Secondly, I want to be able to access the file structure of programs. Apple has moved away from the old ‘Explorer’ interface where everything is controlled by apps, which exist in a form of virtual vacuum. Sometimes I want to share files between computers just by dragging and dropping, and not having to go through some intermediate middleware that nobody really needs that much (I’m looking at you, iTunes!). I would like to be able to synchronize Live Mesh with my tablet, and be able to access and edit those files from anywhere, but it’s not so. It must be done through some sort of intermediate app.

In other news, Microsoft released details of their concept of tablet computing, which is basically the antithesis to Apple’s iPad, named the Microsoft Courier (which is a far better name anyway). Gizmodo went on to blog about the Courier and basically what it does, where it’s headed, and how it’s used.

http://cache.g4tv.com/ImageDb3/177127_S/Microsoft-Courier-Revealed.jpg

Rather than being a single screen tablet, the Courier establishes itself in an incredibly nice metaphor of a newspaper, booklet, or journal, which automatically enables multi-tasking—the ability to use several apps at a single time. While one screen is using the web browser, another one can be taking notes, chatting to friends, looking through photos, playing music… the list is endless. I assume that, by the video posted below, there will be some pretty handy gestures that we’ll end up using to change applications.

 

The main movement that these big companies are trying to do, is that they’re trying to extend this metaphor of invisible computing: not necessarily that the computers themselves can’t be seen, but that they are not noticeable distinctly as computers. The way the iPod market is, I would be willing to bet money that only a minor percentage would consider any iPod a ‘computer’, because of the basic things: no keyboard, no mouse, it’s either worn, or carried in a pocket, and isn’t used in the same way that a ‘regular’ computer is used. The punch-line is: these companies want us using computers without even realizing we’re using computers. Hence why there’s such a strong attraction to the Microsoft Courier: we are all familiar with books, pens and paper, so why not just digitize what we are familiar with, in a familiar way?

If we are talking about invisible computing, why not just give a quick mention to the Microsoft Surface?

microsoft_surface_main

Here, the basic idea of having a coffee tablet as a computer is incredibly appealing (as much as naysayers would disagree, I’m sure). It uses a strong metaphor of an actual desktop, meaning that objects in the computer have physics and collision detection attached to them, in a way to trick us into using these devices, not as a computer, but as we would a real-world object. It will even interact with your objects just by placing them on the table.

microsoft-surface

This way, it can be as intuitive and natural as possible. If you’ve got an image on one device and want it copied to the other, place both devices on there, grab the image and throw it to the other phone. The computer will do the rest of the work, which is usually pretty messy work, all the while the user is believing that they actually ‘gave’ a phone an image, which it accepted and took for its own. This is Surface’s idea of using Windows’ File Explorer interface, but with a much stronger visual metaphor running behind it.

* * *

Posted

Touch-based Mobile Games

Okay so the main problem with the mobile space is that it’s currently dominated by touchscreens, and as such it makes it difficult to create first-person immersion in a game.

The technology is near-perfect for games that require an overhead view (such as an RPG a la Final Fantasy), or a third-person view (a la Diablo), where the touch commands can be quite easily mapped and pinpointed. Also, because of gesture-based movements (using the accelerometer) it’s quite easy, and possible, to have racing games.

Casual, puzzle and racing games basically dominate the market. However, now with Final Fantasy I and II on the market, hopefully the RPG market will get heavier (and then eventually saturate, but that’s a story more inclined with economics instead of game ideas).

As I see it, the main problem that people have with touch technology is that they’re still stuck in the days of having either a mouse pointer, a keyboard, or a controller. As such, nearly all games I’ve played that require some type of first- or third-person controls, it will emulate the PS3 and Xbox controllers, essentially having two touch-based ‘joysticks’ on the screen.

The first fps I played on a mobile device was actually Doom for Android, which used a virtual D-Pad (horrible) to move, and a roller ball for shooting (press it to shoot) and moving (roll forward/backwards to move, left/right to turn). All in all, it gave me a bad feeling in my throat every time I played it and tried to like it. Basically from that moment on, I told myself there had to be a better way to manipulate a character in first-person.

Needless to say, there are problems with the current idea of using touchpad-based joysticks, for a few reasons.

  1. The touch-sensitivity is very broad, especially based on one’s fingers. Movements are very ambiguous, and hard to make concise and accurate.
  2. A double-edged sword: either the ‘joystick’ pads are too far in the middle of the screen, and cause the fingers to take up too much visual content, or they are too far to the bottom corners that it makes it nearly impossible to move it backwards or to the side (on both sides where the edge is).
  3. The pads are usually too big, and take up too much space, or they are made too small (reference point number 1) and hard to use (the optimal thing to do here would be to make them semi-transparent, anyway).

Basically, what I’m saying is that we are using a new input technology, and both the software and our way of thinking also needs an update.

Noting here, Final Fantasy I is using an arrow-based D-Pad approach to movement in the game. It’s not actually that bad because it’s a boolean approach (ie. there are only four points that are either on or off, and not a more fuzzy approach of a joystick-like movement scheme), and that it’s transparent. It keeps the fingers away from the content of the page, while still being easy enough for a user to automatically learn how it works.

The battle screen here is thankfully touch-based, with big, bold icons to show what act a person could do. A lot of thought has gone into this to be optimal for touch devices.

http://images.pcworld.com/news/graphics/167403-iphone-3gs-final-fantasy-7_original.jpg

If we have a look here, it’s an emulator for the iPhone and iPod Touch, using exactly the same controls. I can understand why this is like this (after all, it’s en emulator, not a completely rethought game), but the reason I put this here was to show that this is the mind-set of most developers at the current moment (that is, grab a pre-existing technology, and hack it into a touch-based game. Profits ftw!).

In keeping with my idea of updating the user interface to match with the touch-based device, here is what I would have personally done if I were making an RPG on a mobile touch device (and who knows? I still actually might):

phantomtrainlocomotive1

Of course it would look slightly better than that (hopefully with transparent images around the side that maybe blur the background like Aero Glass, but not exactly destroy the game’s vision), but I’m sure you can catch where I’m coming from here; both hands are used to do an even amount of tasks, and it’s visually taking up less of the main content (the central area) than the version of Final Fantasy above (not that above is necessarily bad, I just believe that this is more optimized for touch). And of course I would try to offer the option of changing back to the other option if the user wanted, but I just prefer this solution.

If the player wants to access the menu, they won’t mind so much if their fingers cover the central area (they are, after all, going to a splash screen). If the player wants to talk, or interact with anything they are facing, pressing the middle part of the screen (with either finger, and the character would start interaction (or fire the event, whichever works).

Also, with exactly the same buttons I’ve got here, I can cause the characters to run (by double-tapping a button and holding it, or pressing both up/up or down/down buttons for multitouch-based devices), or turn but not move (by tapping one of the ‘buttons’ for less than a few milliseconds).

What I’m saying is, this idea fills the criteria for an RPG, while optimizing it for touch by not trying to make it exactly as its last platform was (as in, a D-Pad on the left side, action buttons on the right etc).

Then I started thinking, “why can’t we apply those principles of simplicity to first-person games?” and this is what I came up with:

Quake-2-3D-FPS

Again, simple movement touch-pads that surrounds the main area, stopping the user from obstructing the vision with his own fingers. In order to sprint (if this is a multitouch device), both forward buttons can be used at the same time (and same with running backwards, I suppose). If the device is not capable of multitouch, a double-tap can be substituted on one of the directional buttons. A player can still move diagonally forward (there would be a hot-spot between the side-keys and the forward/back keys which enables diagonal movement), and change weapons quite easily (when the weapon-change button is pressed, the menu pops out—it is not there for regular gameplay). The reload section would have a quick visual interface which would show how many bullets were left in the current gun, and the menu would subsequently pause the game.

I imagine that the facing of the game would either be controlled by the accelerometer (by moving the device itself) or by swiping the finger across the middle, as is seen in most applications.

From here on, the part about shooting the weapon (which even begs the question about why we need so much violence in a mobile, handheld game?): we can choose to press wherever on the screen, and the weapon shoots in that direction, or we could choose to have the weapon honed in the middle of the screen, unmoving. Either way, they both have their own reasons, and I would have to try it out to make a proper decision as to which way I prefer.

In most games, there is the ability to aim ‘down the scope’ of some weapons. This would be handled in the same section of “tap to shoot”, but would be done by holding the finger down for a set number of time. This would cause the weapon to be placed close to the eye, and subsequently more accurate (as opposed to ‘firing from the hip’ as our good friends in Call of Duty 4 inform us). To break from aiming down the scope, one can tap and hold the middle, or just choose to sprint somewhere (as mentioned above).

So basically all I need to do now is create a prototype of this. If someone is reading this, and such an interface already exists on a mobile device, I would like to know to try it out and see how it works (if it does, come to a realization that I’m in over my head here and quit, and if it fails, pretty much radically change my ideas and release a Family Guy-based jigsaw puzzle—Either way it’s back to the drawing board).

Either way, tell me your thoughts.

Posted

The Problem with Computer Touch Screens

Okay, so touch-screens are certainly not a new thing, and even integrating them into laptops are not even new (Microsoft and its partners have been doing so since the early 2000’s), but have always remained a niche market. There are a couple of reasons.
  1. The touch technology has no been very good until capacitive touch – that is, they’ve needed to use some type of stylus or it just was not accurate enough for a finger to use
  2. Touch screens have been integrated into monitors, which are standing vertically, meaning that, in order to interact with them, the fingers and hands must cover the content of the monitor to actually use them. Also,
  3. Nobody wants to lift their arms up all day to work on a single display. This phenomena is what is called the ‘gorilla arm’, where it would cause strain in the arms and shoulders of the users if it went for too long.
The iPhone and iPod Touch, as well as a series of fantastic touch-based phones (mostly made by HTC) are doing fantastically well. But this is due to the fact that they are smaller than a 4” screen, and are designed to be used with the thumbs. It’s natural, intuitive, and our hands don’t usually get in the way.
Try that with a proper monitor, though, and it just doesn’t work.
Hence, my idea to bring touch completely into the desktop world is deliciously simple. Basically, we throw out our mouse and keyboard, and replace that with the same sized monitor laying flat on the desk. It should have the same size and resolution of the main monitor, and have capacitive touch technology to it.
Top 10 Coolest Laptop Concepts
This picture gives us a quick idea of how it would be, except that, in my idea, both monitors will show exactly the same content. The hands would be rested at the bottom, with indicators for where the fingers are located at the top. The mouse cursor would be gone entirely, with everything touching directly to the bottom monitor.
Essentially, here we have destroyed the need for the mouse. The scroll wheel can be controlled by gestures, and both right-click and left-click are handled by default in Windows 7 (regular tap to click, then either click and hold, or put two fingers down to right-click).
Now, the main problem is the keyboard. Most people would define a dual-screen computer or laptop with a regular-sized keyboard, such as this concept from Hewlett-Packard:
Top 10 Coolest Laptop Concepts
Just by looking at that, one can tell it’s not going to be fantastic to type on. Firstly, there’s no tactile response for the keys, and one can’t properly tell where their fingers are (because there’s no feeling, it’s just a flat plane, I’m sure mistyped words would be commonplace).
The iPhone here works because we can use our thumbs, see what buttons we’re about to press, and when we do press the buttons a large indicator shows up above the finger (where it would previously be blocked). This works, because it’s a smaller device. But if we make the device bigger, then it’s not quite as optimal.
So I’ve decided to change our concept of the keyboard somewhat. Microsoft had a decent idea back in their earlier touch-screen days called DialKeys:
I imagine my concept would be somewhat similar to that, without spreading it out as much. Make it less circular, more to the ergonomics of how we use our hand. Here is Windows 7’s default touch keyboard looks:

There are a couple of problems with the default. Firstly, it covers up too much screen content. Secondly, it’s too rigid and square.
My touch keyboard would be curved, more in-line with the DialKeys (but maybe a midpoint between the two), with everything being Glass (transparent), so that the top screen can still see content behind it, yet see what the fingers are touching.
Now, the positioning of the keyboard would be crucial. Should it go low, just above the taskbar (as are the DialKeys), or should the taskbar be moved elsewhere (to the top or sides?), and then how do we access it when we need it (I’m going to assume we throw the keyboard away when we don’t need it, and activate it when we do).
I still need to do some concepts, and will update this post with drawings and so on. I imagine there is a tab on the side of the page (as is with current Windows 7 touch interface) that is ‘dragged out’ and becomes the keyboard.
Then, finally my last concept is to have vibration creators just in the corner of the screen which are activated every time a key is pressed, to give the user tactile feedback every time they tap a key, as per most Android devices.
This post is far from finished. Hopefully if I’m able to purchase a touch-screen monitor, I’ll be able to figure out how to hack it up and turn it into a mouse/keyboard replacement.
Posted