Explained | Startup Humane is trying to replace your smartphone with its AI Pin — what is it?

(Image: Humane)

According to Humane, the AI Pin remains dormant until manually activated by a tap and drag motion on the touchpad.

The AI Pin's operation hinges on a fusion of sensors and AI technology, predominantly relying on extensive language models. This enables the device to comprehend user context and furnish pertinent information and functionality.

The pin can project a display onto the user's palm, with which they can interact with a finger tap, much like Apple's Vision Pro headset.

(Image: Humane)

(Image: Humane)

For instance, while strolling down a street, the AI Pin utilises its camera to identify objects and landmarks, subsequently presenting contextual details like restaurant names or distances to bus stops. The company has also outlined plans to introduce navigational capabilities in 2024.

Moreover, the AI Pin extends its functionality to device control. Users can leverage the device to make calls, send texts, manage smart home devices, or play music on their smartphones. Additionally, the AI Pin serves as a gateway to a multitude of AI-powered applications, encompassing translation services, virtual assistants, and personal trainers.

(Image: Humane)

(Image: Humane)

Central to the AI Pin's functionality is its integration with AI models through the proprietary AI Mic software. In a press release, Humane mentions collaborations with both Microsoft and OpenAI, with the latter's ChatGPT playing a pivotal role as one of the device's core features. The operating system, aptly named Cosmos, streamlines user interactions by automatically directing queries to the appropriate tools, eliminating the need for extensive app downloads and management.

(make: Humane)

Humane's vision for the AI Pin revolves around simplifying the user interface, eschewing conventional home screens and intricate settings. Users interact with the Pin primarily through voice commands or touch, articulating their desires or inquiries and witnessing automatic execution. The company draws inspiration from the recent surge in functionality accessible through straightforward text commands to chatbots, striving to replicate this simplicity in a tangible device.

Also interesting is the Catch Me Up feature, which will give users a snapshot of all their messages, emails, et al.

(Image: Humane)

While the announcement details several features, such as voice-based messaging, a summarisation tool for email inboxes, nutritional information retrieval via the camera, and real-time translation, the AI Pin appears to position itself as a wearable, AI-powered search engine. Humane acknowledges plans to expand its capabilities to include navigation and shopping, intending to empower developers to create their own tools for the device.

Humane is positioning the AI Pin as the first phase of a broader initiative, anticipating improvements as underlying AI models evolve. Drawing parallels to the evolution of smartphones, the company envisions a trajectory where enhanced hardware contributes to an evolving user experience, with the true revolution arising from the device's expanding capabilities.