Apple’s AR is closer to reality than Google’s
ARKit hasn’t been out for long and already some pretty crazy things are going down
ARKit hasn’t been out for long and already some pretty crazy things are going down
Funny how just after I post that article talking about magic notebooks and how I use One Note for handwriting recognition and how it’s not quite there yet, I discover this app Nebo.
Nebo is a handwriting recognition app. And it works. Really well. Just to prove it to you, I’m using it right now. here’s the screenshot of what I wrote:
Part of what makes it effective is that it displays its interpretation of your scrawl live as you write. So if you do get a little too sloppy – ironically, this happened to me with the wards “handwriting recognition” – you can immediately adjust. It has a lot of neat pencil gesture tricks, too. Like to erase a word, you scratch it out. Or underline for bold, etc. But the major part of it is that the text conversion works really, really well. Living-in-the-future well.
Anyway, this app is taking a place in my home screen IMMEDIATELY.
I wrote seven years ago about magic books. By that I meant various technologies that were transforming the way I/we read: RSS, read later services like Instapaper, e-readers like the Kindle, audiobooks and podcasts, etc. etc. What would a magic notebook be? Something that transformed the way we create, not just consume? For many years this has been a notebook computer, i.e. a laptop. But for me, the magic notebook is now the iPad Pro.
Let me go out on a limb and declare writing with a pen or pencil as far more natural-feeling than typing on a keyboard. We learn to do it earlier, and because it’s easier to switch to drawing, and to use space to arrange your writing, it’s more versatile. I love handwriting, especially for brainstorming. But I’m not a Moleskine dude. I’m terrible at keeping track of physical pieces of paper and I am so totally into having everything all digital and linkable and searchable and easily revised.
I’ve had iPads since the first and almost as early on I was buying various styli. My dream was, I hand write something onto the sheer sparkling glass of the iPad and it converts itself into glorious digital text. Now that’s a magic notebook. But it was not to be, not then. The early styli felt like writing with someone else’s finger. But I knew I wanted to play around with the iPad Pros once they came out, more or less because of the Pencil.
So I got one. (Note: I got one a couple months ago, so I’m referring to the previous generation iPad Pro 9.7”, not the new ones that just came out (d’oh!).) And: my dream isn’t here, but it’s a hell of a lot closer.
The pencil works really well for my purposes, which are short on drawing, long on hand-written notes. I use OneNote and although the Pencil support isn’t the greatest, it lets me keep everything in one place. Also, it has handwriting-to-text! It’s not great, especially as my handwriting looks like something you might write in mud with a stick as death spasms wracked your mutilated body. Plus, seems that feature only works on Microsoft OSes right now (speaking of death spasms).
UPDATE: See this post about the app Nebo for some seriously next-level handwriting recognition.
But it’s getting there. So let’s imagine a near-future utopian world in which Microsoft has enabled this on the iPad. Then let’s imagine that same world where the machine vision craziness has continued to proceed apace. Assuming we’re not all cowering in the muck as T1000s hunt us down to force us into indentured servitude in SkyNet’s underground sugar mills – or something – then perhaps my dream will be here. Writing longhand, tapping convert and leaning back as my insta-posted genius blog post / promo script goes out into the world and somehow causes dollar bills basically to start flying out of my screen as I give a double thumbs up and grin wildly, revealing a full set of solid gold shark teeth…
Sorry, where was I?
Something something iPad something.
So anyway, I’m using it for brainstorming and rough notes and then kinda formulating my first draft with an actual keyboard. And oddly enough, here’s where two other Microsoft products make an appearance, in hardware form.
Number one is a $5 loop with adhesive, the Surface Pen Loop, which you can use to affix your Apple Pencil… well, anywhere really, but I’m sticking it to the edge of my case like so:
That way the pencil’s always with the iPad.
The case is a cheapo number, the Moko Ultra Slim. I’m… very fussy. There, I admitted it. So I bought two other cases and returned them, and tried a few others in-store, and this $17 Moko is my favourite. It’s like an Apple Smart Cover in principle, except a lot cheaper and the back is clear plastic. Importantly for me, it’s light and slim.
When I do need a keyboard I have Microsoft product number two, The Microsoft Universal Foldable Keyboard. Like I said I tried a lot of cases, including the two premier keyboard cases, the Apple Smart Keyboard and the Logitech Create. I didn’t find the Apple Keyboard comfortable to type on. The Logitech Create was great for typing, but as a case it’s not great – it doubles the weight of the iPad, for one. And both of them are expensive. The Microsoft folding one is thin and light, costs half as much, and stays in my bag until I need it. Most of the time I don’t need the keyboard, and so the iPad is as light and portable as possible until I do. in that case it folds out wider than the screen of the tablet, giving the keys more room. I will not lie: some of them are still cramped. But I find it quite agreeable to type on. I still have a full-sized Bluetooth keyboard at home and I figure if I ever need to write for hours on my iPad I will bring that.
Short answer: I fucking love this thing.
Slightly longer: this iPad is my favourite thing for: reading the news, browsing the web, editing photos, writing, and general purpose computing. Certain things I still need a computer for: video editing, web stuff (although thanks to the incredible Coda I still do a bunch on the iPad), design. The pro apps are still lacking on the iPad. I love the portability compared to a laptop – I mostly have it in my bag by default.
My iPad is already out of date with the advent of the 10.5″ model, which has a slightly bigger and significantly better screen, is faster, and boasts better pencil performance. Thing is, I’m happy enough with this one to not care. I’m good. Mine is already overkill in all of those areas. (It could be, though, that the Smart Keyboard is greatly improved by the added width; that’s my one regret with this model, but it’s not much of one.)
IOS 11 has a shitload of iPad-specific improvements: easier app switching, better multitasking, a file browser, and more pencil functions. I’m excited about all of those.
The area that needs real improvement is the pro app world. I can’t find a good pro video editor: where is Final Cut iOS? I am having trouble finding a design app that meets my needs. I’ve run into situations with relatively simple photo manipulations, say wanting to rotate a batch of images at once, where the stock photos app doesn’t do the trick and I don’t know where to turn. Hopefully Apple pushes forward in this area. It certainly looks like they are. They’ve been touting the iPad as the future of computing for a while, and only recently have they begun to back that up. And only recently do I think I agree with them.
Sure but no way Apple will sell some system that goes into someone else’s car models. So this is like a half-assed denial that they are making a car, despite all the permits they are applying for.
Some not particularly unique thoughts.
WatchOS stuff was all welcome, but relatively minor. Would like to see third party faces and maybe smart complications, i.e. same principle as the Siri watch face except for any face. But I suppose it’s been a good year for the watch, so there’s no need to rock the boat.
Mac stuff: OS and app stuff not particularly thrilling. New Macs! It’s nice to see them revving the MacBooks Pro so soon after the latest update – it’s gotten so that Apple refreshing hardware at faster than yearly pace is eyebrow-raising. I think it’s been longer than that for the other Macs, but they updated a lot of things at once: modern GPUs! VR support!
The iMac Pro looks sweet but obvs so expensive that I doubt I will ever get near one. Although I suppose it does put them back into contention in the workstation class.
As usual there was a lot more heat on the iOS front, and especially for the iPad. They implemented almost the entirety of an iPad nerd’s wishlist: improved multitasking, drag and drop, pencil improvements, proper file browser. Interesting to see Apple Notes getting a lot of improvements including a document scanner. And of course new iPads Pro to seal the deal. I just bought a new 9.7” iPad Pro a couple months ago, but I don’t even feel bad about it. For one, it’s waaay faster than I need it to be already, and for two I will get all the software improvements anyway.
The ARkit stuff is interesting. I’m fairly sure Apple will release some sort of AR device at some point in the near future (Apple Glasses? Apple Monocle? Apple Telescoping EyePiece?), and this is a significant step in that direction.
And the speaker. It’s overpriced, which is not really a shocker considering we’re talking about Apple here. Especially so if you consider it an Amazon Echo competitor, which Apple doesn’t want you to. They positioned it as a cross between an Echo and a Sonos. I have two Sonos speakers, so I have a dog in this hunt. I went with Sonos not so much because of the multi-room capability but because they deliver reliable wireless playback. Neither Bluetooth nor Apple’s AirPlay was able to do that for me, and believe me, I gave it a shot. So no matter how good this thing is I doubt I’ll sell my Sonoses as I love them, but I’d pay special attention to how reliable AirPlay 2 is.
Speaking of Maciej Cegłowski, here is the text of a recent talk. Lots here on the rise of the nationalist right and its use of tech, the “feudal internet” of huge tech companies that dominate our online lives, and what can be done about it.
No way! One bookmarking service To Rule Them All. Nice work, Maciej!
After lobbying from nice organizations like the major telecoms, advertisers, Facebook and Google, while everyone else was distracted by the Trump shitshow, Republicans gutted Obama-era laws preventing ISPs from selling your browsing history. Because clearly what the world needs is more creepy microtargeted psychometric manipulation
Valley douchebag charity poseur syndrome
This speedy revolution, a Stanford economist says, will be driven by technology, not climate policies — and while his timing may be off a few years, there is little doubt about the direction
Or Aphex Twin track names?
Important stuff in here. Note that what Russia is accused of doing sounds very similar to what Cambridge Analytica does, and what many advertisers do. To quote at length:
Russia plays in every social media space. The intelligence officials have found that Moscow’s agents bought ads on Facebook to target specific populations with propaganda. “They buy the ads, where it says sponsored by–they do that just as much as anybody else does,” says the senior intelligence official. (A Facebook official says the company has no evidence of that occurring.) The ranking Democrat on the Senate Intelligence Committee, Mark Warner of Virginia, has said he is looking into why, for example, four of the top five Google search results the day the U.S. released a report on the 2016 operation were links to Russia’s TV propaganda arm, RT. (Google says it saw no meddling in this case.) Researchers at the University of Southern California, meanwhile, found that nearly 20% of political tweets in 2016 between Sept. 16 and Oct. 21 were generated by bots of unknown origin; investigators are trying to figure out how many were Russian.
As they dig into the viralizing of such stories, congressional investigations are probing not just Russia’s role but whether Moscow had help from the Trump campaign. Sources familiar with the investigations say they are probing two Trump-linked organizations: Cambridge Analytica, a data-analytics company hired by the campaign that is partly owned by deep-pocketed Trump backer Robert Mercer; and Breitbart News, the right-wing website formerly run by Trump’s top political adviser Stephen Bannon.
This is an article from January about Cambridge Analytica using psychometrics for the Trump in 2016 – the same company that worked for the Brexit campaign, and is tied to both Bannon and Robert Mercer.
Amazon announced their long-rumoured Echo with a screen today and frankly I think this thing is a dog, but what do I know.
So this is basically… a smart TV for your kitchen? Is there any other room in the prototypical house for which this would be an appropriate arrangement of screens and speakers? In a living room a TV would probably be better, on a desk a computer would be better, and in a bedroom basically any one of tablet/laptop/TV would be better. My problem is I haven’t tried a normal Echo, and I gather it’s distinguished by an unusually effective voice service, so maybe if I got hooked on Alexa I’d want one of these.
There are plenty of rumours now of Apple getting into this game, and Phil Schiller spoke up saying he thought screenless smart speakers weren’t that useful. But I don’t think that means Apple is bringing out a smart speaker with a screen. I think it means they’ll bring out a smart speaker that will send stuff to your Apple devices that have screens, which is pretty much all of them. Apple needs to bring Siri up to the level of Alexa, integrate more smart home stuff with HomeKit, and make Siri something that is essentially ubiquitous in your home (could be the speaker, but the Watch gets you 90% there), and it could dominate this category right quick. Easier said than done, I guess.
The TV business is changing incredibly rapidly at this point.
Big data meets military psyops meets the far right.
Crazy, alarming story.