I’m again experimenting with voice-to-text transcription. I keep hoping for that Star Trek experience — you know, where the characters whap their comm badge, speak with normal speed and diction, and have the computer fully understand them.<\/p>\n
But for me, that’s truly fiction. In real life, with free-form text, voice to-text accuracy is likely to range from meh<\/i> to awful<\/i>.<\/p>\n
For example, I recently used voice-to-text in a jokey email to my wife in which I said: Voice to text rendered it as: I\u2019m glad I proofread that before I sent it!<\/p>\n (I bet my wife is, too!)<\/p>\n That kind of not-even-close transcription is all too common with voice to text. And even when the errors are less severe, they still require much back-pedaling, correction, and revision before your text is ready for anything but the most casual of uses.<\/p>\n On more than one occasion, I\u2019ve dictated a paragraph or two into a voice-to-text application, but when I later tried to read the transcript, so many words were mangled that I couldn’t figure out what I was originally trying to say!<\/p>\n Still, it had been a while since I explored voice to text, and with all the current activity (OK Google, Siri, Alexa, Bixby, etc.,…) I thought it was time for a fresh look at the kinds of native text-to-speech being built into today’s devices and operating systems.<\/p>\n I wasn\u2019t so much interested in exploring the pre-scripted commands that those apps can respond to — with a context-limited universe of words to choose from, most of these applications do pretty well.<\/p>\n You can, for example, say to an Android phone, \u201cOK Google, navigate from here to Boston Common by foot.\u201d Google will open Maps, find the best walking route from your current location to Boston Common (or wherever you specify), and launch turn-by-turn directions.<\/p>\n That\u2019s cool, but it\u2019s not free-form, flowing, natural speech. True natural speech to text transcription is a whole \u2018nother ballgame.<\/p>\n Want to see some real-life examples? Below, you\u2019ll find four transcripts of voice-to-text output, as produced by four different combinations of hardware and software.<\/p>\n They’re all versions of the following sample paragraph that I wrote manually — fingers on keyboard. The sample paragraph also explains more of the setup:<\/p>\n First, I\u2019ll read this paragraph using Google\u2019s \u201cvoice typing\u201d (the voice-to-text option built into the Gboard keyboard on my Android Samsung S8 phone). I\u2019ll read it using the phone\u2019s built-in mic, and then again using a brand new Bluetooth 4.1 headset optimized for dictation (condenser microphone on a boom). Next, I\u2019ll read this paragraph using Windows 10\u2019s built-in dictation function (Windows Key+H<\/strong>) both with my PC’s built-in microphone, and with the same Bluetooth headset used for the Android versions.<\/em><\/p>\n But before I show you the results, let me stipulate that none<\/em><\/span> of these transcription apps handle punctuation very well. The Android app is supposed to recognize punctuation such as \u201copen parentheses\u201d and \u201cclose parentheses,\u201d but it’s spotty at best. Windows 10 can understand that you mean a \u201c;<\/big><\/strong>\u201d when you say the word \u201csemicolon,\u201d but it falls down in areas such as recognizing that you want to start a new paragraph when you say \u201cnew paragraph.\u201d (It inserts the phrase \u201cnew paragraph\u201d into the body of your text.)<\/p>\n The poor handling of punctuation is a real problem unless you’re producing very simple texts. But it\u2019s a whole different kind of trouble than, say, mistaking \u201clucky girl\u201d for \u201clike a cow!\u201d<\/p>\n Now, back to the results: Up first, the nearly-perfect output of Google\u2019s Gboard voice typing on a Galaxy S8, with a good-quality dictation headset connected via Bluetooth 4.1; with the phone connected to the internet via my office 5GHz Wifi router.<\/p>\n As you can see, the punctuation and capitalization are funky, but the words themselves are OK.<\/p>\n First I’ll read this paragraph using Google’s voice typing The Voice to Text option built into the gboard keyboard on my Android Samsung S8 phone. I’ll read it using the phone’s built-in mic, and then again using a brand new Bluetooth 4.1 headset optimized for dictation condenser microphone on a boom. Next, I’ll read this paragraph using Windows 10 built-in dictation function Windows key + H both with my PCS built-in microphone, and with the same Bluetooth headset used for the Android versions.<\/em><\/p>\n Next up: A surprise — I also got the same nearly perfect results using the phone\u2019s standard, built-in mic instead of the separate headset!<\/p>\n First, I’ll read this paragraph using Google’s voice typing The Voice to Text option built into the gboard keyboard on my Android Samsung S8 phone. I’ll read it using the phone’s built-in mic, and then again using a brand new Bluetooth 4.1 headset optimized for dictation condenser microphone on a boom. Next, I’ll read this paragraph using Windows 10 built-in dictation function Windows – key + H both with my PCS built-in microphone and with the same Bluetooth headset used for the Android versions.<\/em><\/p>\n Next, in the third example, you\u2019ll see that Windows 10\u2019s built-in dictation function (Windows Key+H<\/strong>) didn\u2019t do as well. The PC itself shouldn\u2019t have been a problem— it\u2019s an SSD-based 64-bit, 2.4GHz Core i7, with a wired Ethernet connection to my office router. But here\u2019s the result of reading the above sample paragraph, using the PC’s built-in microphone. I’ve highlighted the worst non-punctuation\/verbiage errors in red.<\/p>\n First, I’ll read this paragraph using Google Voice typing Voice to text option built into the Jeep board<\/strong><\/span> keyboard on my Samsung S 8 phone. I’ll read it using the phone’s built in mic, and then again using a brand new Bluetooth 4.1 headset optimized for dictation condenser microphone on a boom. next, I’ll read this paragraph using Windows 10 built in dictation function windows key<\/span><\/strong> plus H both with my PC’s built in microphone, and with the same blue tooth<\/span><\/strong> headset use for Android versions.<\/em><\/p>\n I can understand mistaking Gboard<\/strong> for Jeep board<\/strong>, I guess, but shouldn’t Windows recognize the phrase \u201cWindows Key<\/strong>?\u201d And how can it not know Bluetooth<\/strong>?<\/p>\n The fourth and last test was very odd: Using my dictation headset (same as above) actually made Windows 10\u2019s built-in dictation function a little worse<\/em><\/span><\/strong>! I have no idea why, because using a good headset usually improves voice recognition. Not this time.<\/p>\n First, out<\/strong><\/span> read this paragraph using Google’s voice typing voice to text option built into the Jeep board<\/strong><\/span> keyboard on my Android Samsung S 8 phone. I’ll read it using the phone’s built in mic, and then again using a brand new Bluetooth 4.1 headset optimized for dictation condenser microphone on a boom. Next, I’ll read this paragraph using windows tens built in dictation function windows key<\/strong><\/span> plus H both with my kisise<\/strong><\/span> built in microphone and with the same blue tooth<\/strong><\/span> headset used for Android version.<\/em><\/p>\n Along with the same errors mentioned above, this iteration mistook \u201cI\u2019ll<\/strong>\u201d for \u201cout<\/strong>\u201d and turned \u201cmy PC\u2019s<\/strong>\u201d into \u201ckisise.<\/strong>\u201d That last is truly baffling: It\u2019s not even an English word, and makes at least that part of the sentence wholly unintelligible.<\/p>\n That many fundamental verbiage errors, along with a dozen or so punctuation and capitalization errors is, to me, unacceptable in so brief a paragraph (just 83 words). For me, it’s still much faster and cleaner to type.<\/p>\n I love the convenience of voice-to-text (especially when there\u2019s no keyboard, or only a virtual\/on-screen keyboard available). And voice to text can work quite well indeed if you stick to scripted commands (words and phrases that fall within the context of what the software is already expecting), and use careful diction. But that\u2019s not normal speech.<\/p>\n For natural, freeform, floating speech, voice to text still isn’t quite ready for prime time.<\/p>\n Those Star Trek comm badges are going to have to wait!<\/span><\/p>\n Permalink: https:\/\/wp.me\/paaiox-7N<\/a><\/em><\/p>\n
\n\u201cYou may have missed it, lucky girl.\u201d<\/strong><\/p>\n
\n\u201cYou may have missed it, like a cow.\u201d<\/strong><\/p>\n
\n