pwshub.com

Local LLMs Take Flight in Opera's Experimental Browser

Local LLMs Take Flight in Opera's Experimental Browser
Local LLMs Take Flight in Opera's Experimental Browser

Opera's AI Feature Drop Program has introduced experimental support for running large language models (LLMs) locally on the Opera One Developer browser. This adds 150 LLMs from various families, including LLaMA and Gemma, to the browser.

Unlike chatbots such as Microsoft's Copilot and OpenAI's ChatGPT, which rely on internet connectivity, Opera's local LLMs keep data on users' PCs. This eliminates the need for an internet connection during use, except for initial LLM download.

Opera envisions potential use cases for these local LLMs, where the browser could utilize AI solutions based on user input while keeping data on the device. However, the privacy implications of a browser-based LLM retaining significant data may be a concern.

The local LLM feature is still in its experimental phase and may encounter glitches. As such, Opera has not yet announced a timeline for its integration into the regular Opera One browser.

Despite potential limitations in speed and storage requirements, Opera One Developer is the first browser to offer local LLM support. It joins a select group of solutions that bring LLMs locally to PCs, such as Nvidia's ChatWithRTX chatbot.

While it may seem paradoxical that an internet browser provides AI chatbots that do not require internet connectivity, this innovation demonstrates the growing availability of local LLM solutions.

newsid: x6v054heoxorzdb

Related stories
18 seconds ago - The Open Home Foundation establishes Home Assistant as a non-profit, protecting open-source smart home solutions and promoting data privacy and consumer choice.
7 minutes ago - Windows 11 Pro, with enhanced security features, is available for a discounted $32, but compatibility and advanced user knowledge are requi
34 minutes ago - Apple may skip the M3 chip generation for the Mac mini and focus on the AI-driven M4 series with faster release cycles.
41 minutes ago - Repurpose an old PC with various software and hardware modifications to serve as a media server, NAS device, virtual machine, or other specialized system.
54 minutes ago - Mercedes offers Level 3 self-driving cars in California and Nevada with limited autonomy under specific conditions, including designated roads, speeds below 40 mph, and daylight hours.
Other stories
1 minute ago - Google releases a second April security update for Pixel devices, addressing cellular issues reported by users.
2 minutes ago - Fallout TV show surge drives record traffic to NexusMods, causing performance issues for the popular modding platform.
2 minutes ago - Speedrunner nucular sets a new Skyrim world record by reaching level 80 and defeating the Ebony Warrior in under 12 minutes.
3 minutes ago - Meta's Horizon OS will power third-party headsets from ASUS, Lenovo, and Xbox.
5 minutes ago - Pokémon GO Sustainability Week 2024 focuses on Buddy Pokémon and 2 KM Eggs with increased Shiny chances for event-themed hatches and Buddy bonuses.