LLMs

One program in this benchmark never looks at the data. It ignores the step counts, the sleep hours and the resting heart rates, and returns the same number every time: the average score in the data…

A student writes her own argument and asks a chatbot to tidy the sentences. Another asks the chatbot for the argument, then rewrites every line in his own voice. Hand both essays to an AI-text…

Ask a language model to grade a piece of writing twice, and the second grade is supposed to be a fresh one. Five researchers at Infobip, a messaging company with offices across Croatia and Bosnia,…

Put a price on asking for help and people ask for less of it. That part of a new experiment out of the University of California, Irvine behaved exactly as you would expect. The interesting part came…

The pitch for AI agent teams is intuitive, which is part of why it sells so well. If one language model can draft an answer, surely two can catch each other's mistakes, and a whole committee of them…

Ask a chatbot for a proof and you brace for a confident, wrong answer. So there is a certain irony in what a team of four researchers reported this week: they asked a language model to help with a…

The microphone button keeps moving closer to the middle of the screen. Assistants now open in voice mode, cars and headphones take dictation, and the implicit promise is that speaking a question and…

Imagine two people on the phone, each holding a photograph. Neither can see the other's. Their job is to decide whether the two pictures are the same and, if not, to find the difference. This is a…