An example of a contextual query Siri will be able to answer, eventually. – Image Credit: Apple
The long-delayed overhaul of Siri was hit by repeated failures to progress, with leadership problems making it harder to execute than it should’ve been.
In March, Apple admitted that its attempt to make Siri more personalized and up to date was far behind schedule. It confirmed that there were delays in getting Siri to the state where the company wanted it to be, and that it would be sorted out in the coming year.
Since that rare admittance from Apple, the company has done what it can to fix the situation. This included a managerial reshuffle, pushing John Giannandrea out of the top Siri role in favor of Mike Rockwell.
It was a major event in a situation that was extremely embarrassing to Apple. However, the entire affair is something that could have been avoided, reports The Information, had Siri not fallen victim to poor leadership choices.
Siri hot potato
Multiple people who worked in the AI and software engineering groups within Apple told the report that conflicting personalities were a problem. Some, who worked under the AI and machine learning group under Giannandrea said that poor leadership was at play.
The sources also identified Robby Walker, who worked under Giannandrea, as being one of the reasons for the issues, due to an apparent lack of ambition and willingness to take risks on future Siri designs.
The employees also referred to Siri as a “hot potato” within Apple, due to it being passed between the different teams over the years. With the latest reshuffle putting Siri under the oversight of software boss Craig Federighi, they have some hope that favorable changes will be made.
A lengthy Siri issue
The problems getting Siri modernized started years ago, in 2018, when Giannandrea moved from Google to work on Apple’s new AI group. At a time when Siri was beginning to stagnate, Giannandrea took an interest in managing the digital assistant.
Before then, engineers working on Siri felt as if they were second-class citizens with Apple, with frustrations that the software engineering team’s control over iOS updates failing to prioritize Siri fixes. Those software engineers also felt the Siri team weren’t able to keep up with new features being developed in the group.
Giannandrea’s plan was to make Apple’s own AI-based voice assistant, using a playbook he gleaned from Google. He believed Apple had to get better training data, and to do better at web-scraping for answers.
However, when urged to shake up Siri’s leadership, he declined to do so.
Walker’s safe work
The lack of risk-taking by Walker was a problem, the group of sources added. It was believed that Walker downplayed efforts to swing for the fences, and instead worked on other less meaningful metrics.
This apparently included celebrations of small wins, like reducing the response time for user queries. His work to remove “Hey” from “Hey Siri” also took more than two years to pull off, with little actual real benefit in the end.
Walker also dismissed one attempt in 2023 for one team to use LLMs for Siri to gain emotional sensitivity, such as to detect if a user is in distress. He said he would rather focus on the next Siri release instead of committing resources to the effort.
That team still went away to work on the project via the software engineering group’s safety and location team, without his knowledge.
Increased tension
The software engineering group and the AI team had a dysfunctional relationship, with respective leaders Federighi and Giannandrea having dramatically different managing styles.
Resentments also built up over difference in pay, the speed of promotions in the AI group, and vacation periods.
Eventually, Federighi’s groups started to mass together hundreds of machine learning engineers to work on its own models, separate from the main AI team. This included building demos to voice-control apps without Siri, which the Siri team didn’t appreciate.
An attempt to introduce voice control systems for apps on a headset that would become the Apple Vision Pro was also problem-filled. Hostility between Walker and others in the group, as well as the slowness of the Siri group in general, became a big point of friction once again.
When ChatGPT was released in 2022, the AI group didn’t respond with any real urgency, the engineers claim. By contrast the software engineering group were far more interested, with demos presented to Federighi of what could be accomplished.
Eventually, Apple’s managers said in 2023 that engineers couldn’t include external models in Apple products. But, the responsibility to build the models was the responsibility of the AI group.
They also apparently didn’t perform as well as OpenAI’s offerings, employees explained.
The current shakeup
Despite years of issues, the current situation where the Federighi-controlled software engineering groups would oversee the AI work led by Rockwell should be a fruitful one for Siri’s progress.
Federighi is viewed as having more knowledge of technical details than many under his control. He has also told Siri’s machine learning engineers to do whatever they need to make the best AI features, even if it’s using open-source models from other companies.
Meanwhile Rockwell, who has a good track record in the company, is viewed as someone with vision, which Walker certainly lacked.
