Sentient OS runs an on-device LLM nightly that reads what is new in a user's life (email, messages, files, Granola transcripts) entirely locally and distills it into a knowledge base, then presents prepared work (drafts, subscription renewals, reports) one click from firing through computer use. It built its own stack, a custom LiteRT-LM fork with KV-cache reuse, speculative decoding, and custom k-quants, that runs nightly on 8 GB Macs, with the user's hardware doing about 90% of the compute. It soft-launched late July with one Reddit post, reaching top of r/macapps and 2,000+ users in 48 hours with $0 marketing.
Sentient OS primarily offers an on-device Large Language Model (LLM) known as the "Sentient nightly agent." This innovative product operates locally on users' devices, specifically designed for Mac users on Apple silicon. Here are the key features and benefits of their offerings:
Local Processing: The Sentient nightly agent reads various forms of new life data, including emails, messages, files, and Granola transcripts, entirely on-device. This ensures user privacy and data security, as no sensitive information is sent to external servers.
Knowledge Base Creation: The LLM distills the gathered information into a personalized knowledge base, making it easier for users to access relevant data and insights.
Prepared Work Generation: The agent can generate drafts, subscription renewals, and reports with just one click, streamlining the workflow for users and enhancing productivity.
Custom Technology Stack: Sentient OS has developed its own technology stack, including a custom LiteRT-LM fork that utilizes KV-cache reuse, speculative decoding, and custom k-quants. This allows the software to run efficiently on devices with as little as 8 GB of RAM, leveraging the user's hardware for about 90% of the computational load.
User-Friendly Experience: The product is designed to be intuitive and user-friendly, making it accessible for individual consumers, enterprise teams, and open-source developers.
Rapid Adoption: After its soft launch in late July 2026, the product quickly gained traction, reaching over 2,000 users within 48 hours, indicating strong market interest and demand.
Overall, Sentient OS aims to enhance productivity and streamline daily tasks for its users through advanced AI technology, all while maintaining a focus on privacy and local data processing.