Posted on Leave a comment

‘SiriOS’ predicted for 2020 WWDC – here’s what it might be

Apple should produce a “SiriOS,” a report into voice recognition and digital assistants by Mangrove Capital Partners suggests, but while the firm is certain the “voice community” expects it to be revealed by 2020, there is little detail on what it could be.

The “Voice Tech 2019” report from investment firm Mangrove anticipates a greater shift into voice-based computing over the next decade, with the use of systems that rely on AI and machine learning, as well as voice recognition likely to spawn a “new generation of technology companies in every category.”

Equipped with a higher-than 95% word accuracy rate that puts them on a par with humans for understanding language, it is claimed voice is a “far more natural, convenient, and efficient form of communication” via a device than typing, and will become the primary human-machine interface in the future. The rise of Internet of Things devices and smart appliances with voice recognition systems is also highlighted, along with the wide variety of languages supported by Google and the flexibility of Alexa skills.

The improvements in AI are touted to further build up the abilities of voice assistants, with first-wave algorithms and second-wave decision-making improvements to be succeeded by a third-wave AI that collects data from sensors and can automate more complex processes. As these improvements impact how users work with devices, this will apparently prompt companies to “rethink how it interacts with its audience,” using “context-aware voice-first interfaces” that don’t rely on predictable scripted responses.

How Siri appears within macOS

How Siri appears within macOS

Mangrove believes investment in voice startups has reached $768 million in 2019 so far, above the $581 million observed in 2018 and $298 million in 2017. Over a billion dollars is said to be invested in voice startups in the United States, with another $118 million in Europe.

Privacy and Ecosystem

Towards the end of the report, it moves on to the concept of privacy, which a Microsoft survey suggests 41% of users are concerned about, especially relating to passive listening. After noting the discovery of microphones in Google Nest devices and an Amazon patent to “listen to all conversations in a room,” Mangrove suggests tech companies will be following Apple in responding to user concerns, something it has “been doing particularly effectively.”

The example given is Apple’s acquisition of Silk Labs, which deals with on-device AI software that performs processing on the iPhone or iPad itself, without relying on communicating with cloud servers. The acquisition is heralded as a “shrewd move.”

In contrast, Apple is said to have been “less effective at building an ecosystem around voice.” The vision of the “Knowledge Navigator” suggests Apple’s voice strategy was “more clearly articulated in 1987 than it is now.”

Getting SiriOS

The report then declares “The voice community expects Apple to release a SiriOS for its developer community at WWDC 2020 which would accelerate innovation and adoption.” Aside from quoting Brett Kinsella of Voicebot.ai as calling SiriOS “desirable for enabling innovation and is viewed by many as required to match the progress made by Amazon and Google with their voice assistants,” there is no discussion as to what form this SiriOS would take.

Siri Shortcuts, an automation tool that some apps tap to use Siri commands

Siri Shortcuts, an automation tool that some apps tap to use Siri commands

Tracking down the quote’s source reveals it would be a Siri operating system that would be the equivalent of Alexa with Alexa Skills Kit or the Google Assistant using the Actions on Google development environment. Rather than being a part of existing operating systems, governed and limited by guidelines and rules developers would have to follow in SiriKit, with differences for iOS and macOS, SiriOS would effectively be an independent software system from the device’s operating system.

By having SiriOS separate, it could allow for Siri functions and features across Apple’s operating systems to have parity across the board, and for changes to be implemented on all devices simultaneously. For developers, SiriOS would also ideally be unfettered by many of the existing restrictions of SiriKit, and wouldn’t necessarily require intimate knowledge of how each device operating system’s particular Siri implementation would work.

By separating Siri from the operating system, this could feasibly open up other ways for the digital assistant to be used. For example, developers could potentially integrate Siri into their apps directly, giving a highly customized experience depending on the app’s abilities.

It is assumed that this is in the ballpark of what the Mangrove report suggests when it mentions SiriOS, due to the lack of detail offered. The bottom line is Mangrove believes it is Apple’s best interests to open up Siri to developers further than it currently does.

For the time being, developers have to use SiriKit and to take advantage of Siri Shortcuts. Ultimately, the ball is in Apple’s court as to whether something approximating a SiriOS could be produced, and it would have to rely on whether Apple would want to cede control of its iconic and prized virtual assistant away to third parties.

Posted on Leave a comment

iOS app porting won’t make Mac feel like iPhone, Apple’s Federighi says

 

Apple’s efforts to bring iOS apps to the Mac have been underway for two years, and the porting process for third-party developers won’t be completely automatic, software engineering head Craig Federighi said in an interview.

Home app on macOS Mojave

Xcode will have an option to flag an app project as intended for both macOS and iOS, Federighi explained to Wired. But while some interface actions will be converted automatically — a long press for instance becoming a two-finger click — extra work may be required to cope with things like menus, sidebars, and share buttons.

Apple confirmed plans to bring iOS apps to the Mac during its Monday WWDC keynote. Early first-party examples will show up in this fall’s macOS Mojave, such as Home and Apple News.

Mojave includes a version of iOS’ UIKit, making it easier to code ports. The two platforms already share some underlying frameworks, such as Metal, which should leave few performance gaps based on chip architectures.

“At this level, not so much,” he said. “In a lot of our core APIs, things like Metal, we’ve done the hard work over the years of making them run well on both Mac and its associated CPUs and GPUs, and on iOS.”

After a very clear “no” delivered during the keynote, Federighi once again denied any plans to merge iOS and macOS, or develop a touchscreen-equipped Mac.

“We really feel that the ergonomics of using a Mac are that your hands are rested on a surface, and that lifting your arm up to poke a screen is a pretty fatiguing thing to do,” he said. “I don’t think we’ve looked at any of the other guys to date and said, how fast can we get there?”

He even referred to touchscreen-equipped Windows laptops as “experiments,” despite their increasing prevalence. Microsoft’s Surface devices have proven reasonably popular, although the Surface Pro and Surface Book are consciously designed with tablet use in mind.

Federighi further noted that developers will be able to control how converted macOS apps are sold, skipping the Mac App Store if they want. The public may hear about third-party access to conversion tools at WWDC 2019.

“That would be a reasonable thing to think,” he said.

Rumors of Apple’s plans to bring iOS apps to the Mac have been around since late 2017. At the time the project was allegedly called “Marzipan,” with a goal of improving the quality and update frequency of Mac apps.

The reveal by Federighi differs from what was rumored, or has evolved. As it stands, Apple’s frameworks, scheduled to be released to developers in 2019, will just serve to ease the difficulties of transitioning apps from iOS to the Mac, not run them in emulation or any similar environment.

Posted on Leave a comment

App Roundup: Things 3, Plex for iOS, Overflow 3.0, Philips Hue 3.0, more!

 

New apps and updates to existing software are pushed to the App Store and other online marketplaces every day, and there are simply too many of them to keep track of all of the changes. AppleInsider has collected together some of the main macOS and iOS updates and launches from the last week that you should know about.

This week’s highlighted apps include the addition of podcasts to Plex for iOS, the streamlined interface of Overflow 3.0 for macOS, and a bunch of changes to both Things 3 versions for iPad and iPhone.

Microsoft Groove

Microsoft Groove

Microsoft actually retired Groove as a streaming music service last year, faced with tough competition from the likes of Apple, Spotify, and Pandora. It has kept clients around though, supporting them as a means to listen to files stored on OneDrive.

As of June 1, both the iOS and Android Groove apps have been pulled from download. A Windows 10 app remains available.

Affected users should consider moving to another streaming service, such as Apple Music.

Safari Technology Preview 57

Safari Technology Preview

Installed separately from the regular version of Safari, the Technology Preview offers developers and the public a chance to test bugfixes and upcoming featuers before they migrate to everyone.

Update 57 includes fixes and minor feature upgrades for animations, accessibility, media, JavaScript, WebDriver, Web Inspector, and the Storage Access API.

Get it for macOS: Free Requires macOS 10.13.

Plex for iOS

Plex iOS podcasts

The popular media server system now supports podcasts, including features like variable speed playback, cross-device location sync, and recommendations for new shows. The app’s overall discovery interface has been overhauled, for instance letting users enable and disable content types and personalize their homescreens. Content can be added from a variety of sources including cloud servers.

Other improvements include multiple audio streams for Live TV, and a collection of bugfixes, dealing with issues like recording all the events for a particular sports team.

Get it for iOS: Free Requires iOS 9.3 or later.

Camera+ 2

Camera+ 2 is a complete redesign of the photography app, for instance not only supporting both iPhones and iPads but offering multitasking on the latter. A single purchase unlocks all features across all platforms.

The main purpose of the app is enabling maximum manual control, including not just shutter speed, ISO, and white balance, but working in RAW, and flexible depth adjustments when using an iPhone 7 Plus, 8 Plus, or X. Some dedicated modes include Smile and Stabilizer, which only shoot when a smile or a stable image is detected respectively, as well as Burst, Timer, and Slow Shutter.

Get it for iOS: $2.99 Requires iOS 11 or later.

Overflow 3.0

Overflow 3

Overflow is a visual launcher for macOS, letting people cut back on Dock items by moving some of them into single app. Tabs further organize them into sub-categories, such as images or work.

The 3.0 update sports a streamlined interface, “Type-to-Search” for finding any item on a Mac, and the ability to drag in URLs from Finder or a Web browser. Stunt Software has also added Quicklook and more keyboard commands.

Get it for macOS: $14.99

Philips Hue 3.0

Philips’ long-promised overhaul of its iPhone and iPad app is now available, and implements a streamlined interface intended to fix common complaints. It should for instance be faster to reach favorite colors and scenes, and users can access brightness and light visualization controls within rooms. New color pickers are meant to enable better control and grouping of lights.

There also over 30 new preset picture scenes, and a revised “picture-to-light” algorithm for generating scenes from camera roll images.

Get it for iOS: Free Requires iOS 10 or later.

Things 3 for iPad and iPhone

Things 3 iPad

Updates have been made to both versions of Things 3, with the iPad and iOS versions getting their own set of changes in the latest update.

Things 3 for iPad version 3.6 adds keyboard-based selection to bring it closer to the Mac version, allowing the arrow keys and Shift to be used to select more to-do items, and over 70 other keyboard shortcuts, with available options viewable by holding the Command key on any view. This also applies to popovers, which can be selected and filtered quickly with keyboard shortcuts.

Type Travel, the Mac feature that allowed users to navigate the app by typing straight away, without the need to use a shortcut, is also present in the iPad edition. Lastly for this version, it is possible to drag and drop to-dos into the Things sidebar, tags and deadlines can be applied to multiple to-dos at once, and there is now support for app-wide undo and redo.

Things 3 for iPhone 3.6 also adds some new features, including applying tags to multiple to-dos at once, deadlines receiving a similar treatment, and the ability to duplicate a multi-selected group of to-dos.

Get Things 3 for iPad: $19.99. Requires iOS 10.0 or later.

Get Things 3 for iPhone: $9.99. Requires iOS 10.0 or later.