Google Is Reportedly Developing a ‘Computer-Using Agent’ AI System

Project Jarvis would take over a web browser to carry out tasks on users’ behalf.

Oct 28, 2024

Google could preview its own take on Rabbit’s large action model concept as soon as December, reports The Information. “Project Jarvis,” as it’s reportedly codenamed, would carry tasks out for users, including “gathering research, purchasing a product, or booking a flight,” according to three people the outlet spoke with who have direct knowledge of the project.

Powered by a future version of Google’s Gemini, Jarvis reportedly only works with a web browser (it’s tuned specifically for Chrome). The tool is aimed at helping people “automate everyday, web-based tasks” by taking and interpreting screenshots and then clicking buttons or entering text, The Information writes. In its current state, it apparently takes “a few seconds” between actions.

The biggest AI companies are all working on models that do things like what The Information is describing. Microsoft’s Copilot Visionwill let you talk with it about webpages you’re viewing. Apple Intelligence is expected to be aware of what’s on your screen and do things for you across multiple apps at some point in the next year. Anthropic debuted a “cumbersome and error-prone” Claude beta update that can use a computer for you, and OpenAI is reportedly working on a version of that, too.

How Generative AI Is Disrupting Creative Communities | ABC News Special Report

AI companies capable of generating creative content from text, images, video and music are disrupting and jeopardizing the livelihoods of some creatives worldwide, and they are fighting back.

AI Agents: A Dual Opportunity For Family Offices As Investments And Operational Tools

For generations, family offices have cultivated investment approaches defined by passionate principals and ambitious management teams mixed with a preservation-centric cautious approach and a long-term vision. But a new frontier is beckoning, one that merges technology with the promise of sector-specific transformation: AI Agents. Unlike the grand ambitions surrounding Artificial General Intelligence (AGI), which remains on the distant horizon, AI Agents are grounded in today’s realities and designed to reshape industries by addressing their specific challenges.

Increasingly, family offices are turning their attention to this targeted form of artificial intelligence. The intrigue lies in AI agents that do more than mimic human conversation or intelligence; they perform specialized, high-impact tasks within individual sectors, from healthcare and finance to professional services. Yet the appeal of AI agents extends beyond portfolio diversification. These AI agents have the potential to redefine family office operations themselves, enabling greater efficiency, improved decision-making, and streamlined workflows. By investing in AI agents, family offices are positioning themselves to drive innovation in the industries they oversee and within their own operational structures.

The Allure of Agents for Family Offices

Vertical AI agents, the application of AI agents tailored to specific industries, has a dual utility for family offices: transforming both investments or operational businesses and also internal operations. As a highly specialized alternative to general AI, agents deployed in a specific vertical focus on mastering tasks within a particular field, offering a precision that addresses unique industry needs more effectively than general-purpose AI tools.

Pivot Or Die: Why Adaptability Is the Key To Survival In the Age Of AI | Gary Shapiro

In his new book "Pivot or Die," Gary Shapiro argues that businesses must embrace change to thrive in today's rapidly evolving technological landscape. Bernard Marr is joined by Gary, who heads up the Consumer Technology Association (organizers of CES) to discuss the importance of pivoting, the challenges companies face, and strategies for staying ahead in an AI-driven world.

Reddit Posters Tanking Google Search Results Illustrates Perils of AI Scrapers

"Spreading misinformation suddenly becomes a noble goal," one Redditor says.

A trend on Reddit that sees Londoners giving false restaurant recommendations in order to keep their favorites clear of tourists and social media influencers highlights the inherent flaws of Google Search’s reliance on Reddit and Google's AI Overview.

In May, Google launched AI Overviews in the US, an experimental feature that populates the top of Google Search results with a summarized answer based on an AI model built into Google’s web rankings. When Google first debuted AI Overview, it quickly became apparent that the feature needed work with accuracy and its ability to properly summarize information from online sources.

AI Overviews are “built to only show information that is backed up by top web results," Liz Reid, VP and head of Google Search, wrote in a May blog post. But as my colleague Benj Edwards pointed out at the time, that setup could contribute to inaccurate, misleading, or even dangerous results: “The design is based on the false assumption that Google's page-ranking algorithm favors accurate results and not SEO-gamed garbage."

As Edwards alluded to, many have complained about Google Search results' quality declining in recent years, as SEO spam and, more recently, AI slop float to the top of searches. As a result, people often turn to the Reddit hack to make Google results more helpful. By adding "site:reddit.com” to search results, users can hone their search to more easily find answers from real people. Google seems to understand the value of Reddit and signed an AI training deal with the company that’s reportedly worth $60 million per year.

Linus Torvalds On The Kernel, GenAI, EVs, Programming Languages and More …

Linus Torvalds, the creator and maintainer of the Linux kernel, joined me at the recent Open Source Summit in Vienna for an insightful conversation covering a wide range of topics. He discussed his ongoing role in the Linux kernel’s development, emphasizing his focus on merging and maintaining stability.

Torvalds pointed out a significant shift in the open-source community, where development is now driven more by large companies with specific needs than by individual contributors.

This change, he said, has resulted in a more structured and hierarchical approach to development. Torvalds also highlighted the importance of security, criticizing long embargoes on hardware security issues. He expressed skepticism about the current AI hype, preferring to focus on practical applications.

When it came to programming languages, Torvalds also mentioned his preference for C over Rust and his dislike for synchronous meetings, opting for asynchronous communication via email. He wrapped up by expressing his continued interest in the intersection of hardware and software development.

Apple Intelligence Launches This Week. How to get it, and what you can do with it

When Apple Intelligence debuts on select devices this week. you’ll be able to do things you could never do before. Here’s what to expect.

After months of anticipation, Apple’s official foray into the world of artificial intelligence launches this week. That’s when the company will roll out its Apple Intelligence AI platform to eligible devices. Apple isn’t being shy about how profound of an event this will be for the company and its future. In an interview with The Wall Street Journal, Apple CEO Tim Cook said that Apple Intelligence would make the experience of using Apple products “profoundly different” and likened Apple’s AI technology to the iPhone’s touch interface and the iPod’s click wheel in terms of innovation and importance.

That’s a high bar—and possibly a problematic one. That’s because the Apple Intelligence that gets rolled out this week won’t be a finished product but rather a work in progress. All of the Apple Intelligence features the company previewed in June won’t be coming to your iPhone or other devices just yet. So, what features are coming this week? Here’s what you need to know.

APPLE INTELLIGENCE FEATURES ON LAUNCH DAY

When Apple Intelligence launches this week, it will include a swath of new AI features baked into the iPhone’s operating system—iOS 18.1 (Apple Intelligence is also coming to supported iPads and Macs this week). These features can be broken down into four main categories, according to the release notes. They are:

More about the launch of Apple Intelligence on Fast Company

General Catalyst CEO Hemant Taneja On The Investing Landscape, & Impact Of AI

Hemant Taneja, General Catalyst CEO and managing partner, joins 'Squawk Box' to discuss news of the company raising $8 billion in new capital, state of the investing landscape, impact of AI, and more.

Thats all for today, however new advancements, investments, and partnerships are happening as you read this. Subscribe today, so you don’t miss any AI related news.