Anthropic’s Latest Claude 3.5 Sonnet AI Update Can Use a Computer On Its Own

Anthropic’s new ‘computer use’ feature for Claude AI is now available to developers.

Oct 23, 2024

Anthropic’s latest Claude 3.5 Sonnet AI model has a new feature in public beta that can control a computer by looking at a screen, moving a cursor, clicking buttons, and typing text. The new feature, called “computer use," is available today on the API, allowing developers to direct Claude to work on a computer like a human does, as shown on a Mac in the video below.

Microsoft’s Copilot Vision feature and OpenAI’s desktop app for ChatGPT have shown what their AI tools can do based on seeing your computer’s screen, and Google has similar capabilities in its Gemini app on Android phones. But they haven’t gone to the next step of widely releasing tools ready to click around and perform tasks for you like this. Rabbit promised similar capabilities for its R1, which it has yet to deliver.

Anthropic does caution that computer use is still experimental and can be “cumbersome and error-prone.” The company says, “We’re releasing computer use early for feedback from developers, and expect the capability to improve rapidly over time.”

Arm CEO on Intel, Chips, AI, Listing in US

Arm Holdings Plc Chief Executive Officer Rene Haas talks about the future of AI, he says it's not overhyped. He also says a secondary share sale in London is not a top priority and he wants to see Intel, a competitor, succeed. He speaks to Peter Elstrom at the Bloomberg Tech Summit in London.

Nvidia Chief Makes The Case for AI-First Companies at Gartner IT Symposium/Xpo

Nvidia Chief Executive Jensen Huang told thousands of business technology leaders that their companies must become artificial intelligence-powered organizations to prepare for what he calls a “new industrial revolution.” Jensen Huang says the chip giant is taking its own advice by applying AI to areas like chip design and supply chain, and creating an ‘AI brain’

Huang spoke onstage at market research and consulting firm Gartner’s IT Symposium/Xpo event in Orlando on Tuesday, making the case that chief executives and chief information officers simply need to get started with AI, and the rest will follow. The Santa Clara, Calif.-based chip giant has applied that mindset already, Huang said, putting AI to work in areas such as designing chips, writing software and managing its supply chain.

The most important takeaway for CIOs, Huang told The Wall Street Journal at the event, is to find something effective inside their companies, and ask how AI can transform that work. For Nvidia, those three areas “move the needle most profoundly,” he said. “When it’s our most impactful work, it’s easiest to get energy around it.”

Apple’s Craig Federighi Explains Apple Intelligence Delays, Siri’s Future and More

While others rush AI to market, Apple is taking its time. WSJ’s Joanna Stern talks with the company’s head of software Craig Federighi about the future of Siri, privacy, funny notification summaries and Apple’s slower approach.

Microsoft and OpenAI Are Giving News Outlets $10 Million To Use AI Tools

Microsoft and OpenAI announced they’re offering a select group of media outlets up to $10 million ($2.5 million in cash plus $2.5 million worth of “software and enterprise credits” from each) to try out AI tools in the newsroom.

This news comes while the two companies are still facing a slew of copyright lawsuits, including from The New York Times, The Intercept, Raw Story, AlterNet, the Center for Investigative Reporting, and Alden Global Capital, the hedge fund behind the New York Daily News and Chicago Tribune. Those have continued despite licensing deals reached with many media outlets, including The Verge’s parent company, Vox Media.

The first round of funding will go to Newsday, The Minnesota Star Tribune, The Philadelphia Inquirer, Chicago Public Media, and The Seattle Times. These outlets will receive a grant to hire a two-year fellow who will work to develop and implement AI tools using Microsoft Azure and OpenAI credits. The program is part of a collaboration between Microsoft, OpenAI, and the Lenfest Institute for Journalism, which aims to promote local media.

SEC Chair Gary Gensler on Regulating AI

US Securities and Exchange Commission Chair Gary Gensler talks about the challenges around regulating artificial intelligence and cryptocurrencies.

Canva CEO Melanie Perkins Talks New AI Tools, Reverting Prices, and Competing With Adobe

Canva shows no signs of slowing down. Last year, the creative tools company was the first major player to integrate generative AI into its core workflow. That AI has been used 10 billion times since, during a time of considerable growth for the company.

Canva has added 75 million more users since (to reach 200 million total), increased revenue to $2.5 billion a year, and released a complete design overhaul to its Visual Suite. Today, Canva is going a few steps further. Along with dozens of updates around core product functionality, it’s revealed a completely new AI tool called Dream Lab, which lets you generate images with a text prompt, in one of 15 preset styles.

While Canva kicked off its approach to generative AI by integrating it deep into the UX of workflows (so you could create an image or generate text right inside a presentation you were working on), Dream Lab lives more superficially as its own stand-alone tab inside Canva. In this side channel, you generate higher quality images built upon a model by Leonardo AI (a company Canva acquired only three months ago), which stack atop each other like a creative timeline.

Leaders Vs. Learners: It All Comes Down To AI Accessibility | CEO, Reshma Saujani

There's a vanguard leading the charge to make AI accessible to all, and others are still catching up. Yet, amidst this progress, a concerning reality exists: a gender gap is forming in the field of AI.

As much as we talk about reducing AI bias and promoting AI diversity, women and lower income populations are being left out, avoiding AI or in some cases using it without knowing they are.

The good news is, it’s not too late. Listen to Reshma Saujani, Founder & CEO of Girls Who Code, talk about “aspirational AI” and what we can do to close the gap.

Thats all for today, however new advancements, investments, and partnerships are happening as you read this. Subscribe today, so you don’t miss any AI related news.