Posts tagged “recognition”.

iPad handwriting recognition apps found lacking

February 23rd, 2012

Brian Mikol at Atomic Firefly:

While there’s clearly a range of active third-party development going on to bring handwriting recognition to the iPad, unfortunately in my tests they’re far from the quality and accuracy offered by the last version of the Newton OS.

Mikol reviews several stylus options and a few iPad apps, looking for a potential replacement for his Newton in the iPad. His advice: try the free apps first, then spend money.

[via Newtontalk]

Quote of the week: don’t miss it

July 14th, 2010

“While it still surely has its niche uses, I personally don’t miss handwriting recognition. Not even a little. And I can’t help wondering if voice recognition will go the same way.”

Jeff Atwood at Coding Horror, on how tough voice recognition (and handwriting recognition) is, despite today’s super-powered PCs.

Quote of the week: Newton poetry, indeed

April 14th, 2010

“I thought the handwriting recognition ‘bugs’ were a PLUS– great way to write surreal stories and poetry, write out your ideas and they got translated to weird madlib gibberish.”

Boing Boing reader ill ich. I like to remember the early days of this blog, when that’s all I did: poetry translated by a Newton MessagePad 110. Since then, I – how should I put it? – moved on.

[Via NewtonTalk on Twitter.]

WWDC ’09: Chinese HWR in Snow Leopard

June 9th, 2009

chinesesnow

Lots of good stuff from Apple’s Worldwide Developer’s Conference (including a new iPhone 3GS), but the part that caught my eye was the ability of OS X 10.6 Snow Leopard to recognize Chinese symbols through handwriting recognition on Mac trackpads:

You can now use a Multi-Touch trackpad to draw Chinese characters in your documents. They’ll appear on the screen in a new input window, which recommends characters based on what you drew and lets you choose the right one. The input window even offers suggestions for subsequent characters based on what you chose.

The iPhone had this ability first, but now it’s an OS X-wide feature. Pretty cool.

Us Newton users are always curious to see how Apple uses handwriting recognition in our post-MessagePad world. The technology lives on in Inkwell, but would it be useful to have English handwriting recognition on Mac trackpads?

WritePad offers Newton-like features for the iPhone

March 30th, 2009

writepad

There are a few iPhone apps available that attempt to mimick Newton features, such as an updated PocketMoney and a few sketching applications.

The one that recently got my attention was WritePad by Phatware. WritePad is a free download, and offers the one Newton feature that the iPhone has been lacking so far: handwriting recognition (HWR). WritePad also offers cut and paste, a feature iPhone and iPod Touch users won’t experience until the 3.0 release this summer.

But how does it work?

Before we get into that, it’s worth noting that WritePad is a trial application. Phatware wants to test HWR on the touchscreen and is looking for feedback from WritePad users. That feedback will help develop the PhatNotes app. Hence the free download. Phatware also uses WritePad’s HWR engine to power other iPhone apps, like WritePad Events and WritePad Notes.

It’s basically a word processing program that lets you make and edit text files on your iPhone. The app includes a lengthy tutorial on how to use WritePad’s myriad features, like Auto Correct and user-defined dictionaries. There’s a lot to read and digest.

To start with, the logistics of “handwriting” on Apple’s new touchscreens are difficult. With only a few square inches to work with, and a thicker-than-a-stylus finger, your results will definitely vary. Accuracy is limited by the size of your scribbling, the size of your fingertip, and your handwriting style. And unlike the Newton, the iPhone’s relatively small screen size limits the length of your scribbles. WritePad employs a unique solution to the small screen size: you can overlap your letters in individual words. But is that even practical?

iTouch Tips give a great demonstration of the many features, like gestures and HWR options, and I’d recommend reading their post before digging in with WritePad’s options.

Without messing with the options or the tutorials, I went ahead and gave WritePad a test drive. Here are a few examples.

writepad_newton

Given short, one-word scribbles, WritePad does a fair-enough job. I made a conscious effort to write neatly and cleanly on my iPhone, and WritePad’s HWR did the job just fine.

writepad_writesmall

Given groups of complicated words, however, WritePad starts to fall apart. It reminds me of Newton 1.x’s brand of HWR: effective at times, but not nearly as good as 2.x.

writepad_eggfreckles

I made several attempts at writing “Egg Freckles” in WritePad, and none of the translations came up accurate. In fact, the text got more garbled the more I tried.

writepad_egghoriz

WritePad does offer a “learn your handwriting” option, where possible words pop up to match your own scribbles. And supposedly, after a while, WritePad will learn your handwriting style. So part of it is patience, and part of it is giving the system time to adapt.

The only problem is, your words-per-minute speed will be miserable using WritePad’s HWR. With the keyboard, it logically gets better. Maybe an iPhone stylus would improve things, but I imagine few iPhone users will bother with a stylus.

It’s too bad that WritePad’s HWR is limited to in-app use. I imagine developers could find some use for system-wide HWR using WritePad’s method, but HWR is probably one of those “background” features that Apple doesn’t allow.

The other feature WritePad offers is copy/cut/paste, and this is done fairly well.

writepad_paste

Here I write “Paste” using WritePad’s HWR (again, it does well at translating simple words).

writepad_pastehighlight

WritePad translates the word (above). To copy the text, tap twice and drag across the word to highlight it.

writepad_pastex

WritePad offers cut, copy, and paste buttons at the bottom of the screen. To cut my “Paste” word, I just tap on the little scissors icon. To paste, simple tap on the clipboard icon, and WritePad pastes the word as many times as you tap. Clean and easy.

With the buttons, WritePad’s style of copy and paste differs both from the Newton and the upcoming iPhone 3.0 way of doing things. I can’t say if it’s better or worse because you can only copy and paste within the app. When you’re in WritePad, the copy and paste buttons are an automatic part of the UI. They work as advertised.

I had hoped that WritePad could act as a Newton-like Notepad application for the iPhone. Since you can open and save text files within WritePad, you can accumulate a hefty amount of notes. The Newton Notepad offered easy ways to organize your notes, however, which is something WritePad lacks. With WritePad, you have a list of text files with no apparent folder or file system to organize your notes.

If you want an easy way to edit and write text files on your iPhone, WritePad is a fine enough word processor – assuming you use the keyboard. But any hope for using HWR in an iPhone app effectively, especially one that replicates the Newton, is dashed when you start to write longer-form words or sentences on the smaller iPhone screen. WritePad’s HWR doesn’t seem practical enough for extended use.

A WritePad app on a larger-form iPod Touch or tablet, however? The possibilities of Newton-like performance start to grow. And to be fair, WritePad is a simple testing application that provides Phatware with enough user testing to implement WritePad’s HWR engine into a new, improved suite of apps.

So we’ll see how it works out. In the meantime, WritePad offers a bit of Newton-like functionality with the HWR, and a preview of cut/copy/paste that we’ll see later this summer. And hey – it’s free, which helps.

How Newton handwriting recognition works

July 16th, 2008

Andy Hertzfeld\'s legends of Mac

From Paul Potts, back in 1993:

Lewis Carroll’s famous poem, Jabberwocky, begins as follows:

`Twas brillig, and the slithy toves
Did gyre and gimble in the wabe:
All mimsy were the borogoves,
And the mome raths outgrabe.

This is fun nonsense, but interestingly, nonsense can teach us a bit about how the very first MessagePad’s handwriting recognition software works, by bringing about some “worst-case scenario” behavior. Handwriting recognition was one of the features of the original MessagePad that was perhaps too strongly hyped with respect to what it delivered, while the improved recognizers in later models never received the public credit they deserved.

Potts explains in this Folklore.org story how word lists and dictionaries can affect how the Newton translates handwriting. Interesting reading. And while you’re at it, check out the rest of Folklore – Andy Hertzfeld’s compendium of early Macintosh stories.

Wanted: Handwriting recognition engineer

April 10th, 2008

Apple\'s Newton 2.0?

Check this out:

The Handwriting Recognition team is seeking an engineer who will be responsible for advancing Apple’s handwriting recognition technology for Mac OS X. The ideal candidate will be an expert in the area of pattern recognition, with an excellent understanding of handwriting recognition issues. The person will also assume primary responsibility for maintaining and enhancing existing code and tools. The recognition technology you create may extend beyond Mac OS X to other applications and the iPhone.

This is from Apple’s job site. Someone shared the post from Macrumors.com, who reminds us that “Rosetta technology has found its way into Mac OS X under the name ‘Inkwell,’ but requires a tablet to be installed for use.”

So what do you say? Got what it takes to invent the next Newton?