Apple in talks with PrismML to shrink large AI models for iPhone

Five days after initial reports that there was an AI-model shrinking technology by PrismML suitable for iPhones, the company has confirmed it is talking to Apple over the use of its technology.Siri at work on an iPhoneOne of the major problems with AI processing is the need to manage massive models that most normal computers and smartphones cannot easily handle alone. On July 9, the start-up PrismML surfaced with a solution to shrink down the models to a more manageable size.A few days later, on July 14, the startup confirmed the talks were underway. Speaking to CNBC, startup CEO Babak Hassibi said that Apple and other companies are evaluating its models. Continue Reading on AppleInsider | Discuss on our Forums

PrismML says its compressed version of Alibaba’s Qwen model uses up to 15 times less memory, potentially advancing Apple’s AI push.

PrismML says it compressed a 27-billion-parameter model from 54GB to under 4GB, letting it run on an iPhone 15 or newer

Apple has held meetings with PrismML about ways it could use the startup's technology to run much larger AI models directly on iPhones, according to The Information. The report said PrismML has managed to shrink down Alibaba's open-source large language model Qwen 3.6 to run entirely on an iPhone 17 Pro. The model has 27 billion parameters, which is larger than Apple's on-device AFM 3 Core Advanced model with 20 billion parameters. Apple's model powers iOS 27 enhancements such as Siri AI's more expressive voices and improved systemwide dictation on iPhone 17 Pro and iPhone Air models. Unlike with AFM 3 Core Advanced, all of Qwen 3.6's parameters can be active at the same time. "One new on-device Apple model has 20 billion parameters but uses a so-called sparse architecture, in which only 1 billion to 4 billion parameters are active at a time," the report said, in reference to AFM 3 Core Advanced. "In the case of PrismML's on-device model, all 27 billion parameters are active at the same time." Larger models running directly on iPhones would allow for more Apple Intelligence features to run on device instead of on Apple's Private Cloud Compute servers, which could reduce Apple's costs and further enhance user privacy.Tags: Apple Intelligence, The InformationThis article, "Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones" first appeared on MacRumors.comDiscuss this article in our forums

PrismML, a startup that uses mathematical wizardry to shrink the size of large language models, could be used to bring more advanced AI capabilities to iPhones in the future.Apple wants to bring bigger AI models to the iPhoneThe company has already been able to compress the 54GB Qwen 3.6 model to just 4GB. And, importantly, the technology that it uses doesn't impact the model's performance.Apple is already keen to find ways to shrink LLMs that would normally run on servers. The company prefers such models to run on-device, but has so far been limited by the huge amount of data that more advanced models require. Continue Reading on AppleInsider | Discuss on our Forums

The Information reports that Apple may be interested in PrismML’s technology. The firm is focused on shrinking AI models that generally require servers to function, offering on-device functionality with comparable intelligence.