Toggle light / dark theme

Tesla has finally decided to release its Autopilot safety data report after taking a break of more than a year.

For years, Tesla used to release a “Vehicle safety report” that tracked miles between accidents in its vehicles based on the level of Autopilot used or not used and compared it to the industry average.

The automaker used the report to claim that its Autopilot technology resulted in a much safer driving experience and that its vehicles would crash much less often than the average car in the US even without Autopilot.

Still, ChatGPT operates in a mostly siloed fashion. It can’t yet venture out “into the wild” to execute online tasks. For example, if you wanted to buy a milk frother on Amazon for under $100, ChatGPT might be able to recommend a product or two, and even provide links, but it can’t actually navigate Amazon and make the purchase.

Why? Besides obvious concerns, like letting a flawed AI model go on a shopping spree with your credit card, one challenge lies in training AI to successfully navigate graphical user interfaces (GUIs), like your laptop or smartphone screen.

But even the current version of GPT-4 seems to grasp the basic steps of online shopping. That’s the takeaway of a recent preprint paper in which AI researchers described how they successfully trained a GPT-4-based agent to “buy” products on Amazon. The agent, dubbed the MM-Navigator, did not actually purchase products, but it was able to analyze screenshots of an iOS smartphone screen and specify the appropriate action and where it should click, with impressive accuracy.