In a game-changing move for its AI product lineup, Google has rolled out new features for its flagship AI tool, Gemini, following the release of its latest Gemini models. Starting today, users can explore a powerful Canvas feature that enables them to draft, edit, and refine documents and code seamlessly. Additionally, Gemini is introducing Audio Overviews, enhancing the user experience and accessibility of its AI capabilities.

Canvas Feature Overview

The Canvas feature, reminiscent of OpenAI’s similarly named functionality, allows users to upload documents directly within the Gemini interface, whether on the web or mobile app. Once a document is uploaded, users can instruct Gemini to perform various tasks. For instance, in a showcase example, a user requests the creation of a speech based on class notes found in a PDF, and Gemini delivers the document almost instantly.

Within the Canvas, users have access to a robust set of writing tools that are integrated throughout the Google suite. Features like suggested edits and tone adjustments are all available, providing a comprehensive editing experience. For those wanting to delve deeper into collaboration or additional editing, a simple click exports the document directly to Google Docs.

Coding Capabilities

Gemini's Canvas is not just a writing tool; it is highly proficient in coding tasks as well. Users can request the generation of anything from prototype web applications to Python scripts and HTML code. The real-time editing capability allows for immediate previews of changes made, whether by the user or the AI, facilitating a more interactive experience.

Audio Overviews Feature

Moving on to Audio Overviews, which first appeared in Google’s NotebookLM, this feature now receives a significant boost within Gemini. Audio Overviews allow users to upload documents, from which Gemini generates a simulated podcast discussion between two fictional hosts. This unique format allows for an engaging way to digest information, often with the hosts even naming their podcast episodes!

To create an Audio Overview, users simply need to click the "Generate Audio Overview" button after uploading their document. However, patience is key, as the audio generation process may require several minutes, especially with larger texts. While this feature echoes functionalities from NotebookLM, it benefits from enhanced capabilities in Gemini.

Integration with Deep Research

Moreover, Audio Overviews have been integrated with Google’s innovative Deep Research tool, an AI-powered assistant capable of browsing the web for information on users' behalf. Google recently made Deep Research available for free with limited use, and now, the results of these reports can also be transformed into an Audio Overview, further enriching the user experience.

Accessibility and Future Plans

Both the Canvas and Audio Overviews features are accessible globally to all users, including those using the free version of Gemini. However, it’s worth noting that Audio Overviews are currently only available in English, with plans for multi-language support in the future.

Conclusion

In summary, these new features mark a significant advancement in how users interact with AI for writing and coding. With Gemini's Canvas and Audio Overviews, Google is not only redefining productivity but also making learning and collaboration more interactive and enjoyable. Stay tuned for updates on additional languages and features as Gemini continues to evolve!