From Wired:
What a difference seven days makes in the world of generative AI.
Last week Satya Nadella, Microsoft’s CEO, was gleefully telling the world that the new AI-infused Bing search engine would “make Google dance” by challenging its long-standing dominance in web search.
The new Bing uses a little thing called ChatGPT—you may have heard of it—which represents a significant leap in computers’ ability to handle language. Thanks to advances in machine learning, it essentially figured out for itself how to answer all kinds of questions by gobbling up trillions of lines of text, much of it scraped from the web.
Google did, in fact, dance to Satya’s tune by announcing Bard, its answer to ChatGPT, and promising to use the technology in its own search results. Baidu, China’s biggest search engine, said it was working on similar technology.
But Nadella might want to watch where his company’s fancy footwork is taking it.
In demos Microsoft gave last week, Bing seemed capable of using ChatGPT to offer complex and comprehensive answers to queries. It came up with an itinerary for a trip to Mexico City, generated financial summaries, offered product recommendations that collated information from numerous reviews, and offered advice on whether an item of furniture would fit into a minivan by comparing dimensions posted online.
WIRED had some time during the launch to put Bing to the test, and while it seemed skilled at answering many types of questions, it was decidedly glitchy and even unsure of its own name. And as one keen-eyed pundit noticed, some of the results that Microsoft showed off were less impressive than they first seemed. Bing appeared to make up some information on the travel itinerary it generated, and it left out some details that no person would be likely to omit. The search engine also mixed up Gap’s financial results by mistaking gross margin for unadjusted gross margin—a serious error for anyone relying on the bot to perform what might seem the simple task of summarizing the numbers.
More problems have surfaced this week, as the new Bing has been made available to more beta testers. They appear to include arguing with a user about what year it is and experiencing an existential crisis when pushed to prove its own sentience. Google’s market cap dropped by a staggering $100 billion after someone noticed errors in answers generated by Bard in the company’s demo video.
Why are these tech titans making such blunders? It has to do with the weird way that ChatGPT and similar AI models really work—and the extraordinary hype of the current moment.
What’s confusing and misleading about ChatGPT and similar models is that they answer questions by making highly educated guesses. ChatGPT generates what it thinks should follow your question based on statistical representations of characters, words, and paragraphs. The startup behind the chatbot, OpenAI, honed that core mechanism to provide more satisfying answers by having humans provide positive feedback whenever the model generates answers that seem correct.
ChatGPT can be impressive and entertaining, because that process can produce the illusion of understanding, which can work well for some use cases. But the same process will “hallucinate” untrue information, an issue that may be one of the most important challenges in tech right now.
Link to the rest at Wired
If Microsoft can use AI/ML technology to weed out the AI generated (or equivalent human generated) spam sites (such as “top 10 tools for blah!” from Bing’s search results, I’ll be very happy 🙂
“Can” is not really the appropriate predicate here. “Will” is slightly better; “Is allowed to by the terms of its contracts with its advertisers and unstated conflicts of interest” is a mouthful, but much closer…
The reason that there is an SEO (search-engine optimization) subindustry is that there are severe contractual limits on the ability of those providing advertising opportunities — that is, the search engines — to intentionally alter a paying advertiser’s prominence after the ad has been made public, at least during the same payment period. That is, SEO is exploiting a loophole… Shocking, I know.
Be very, very afraid indeed when Wired expresses skepticism about a new technology. It’s very much the equivalent of high-school cheerleaders betting against their own team.
I will pause while you futilely attempt to scrub the image of scruffy techbro-journalists bouncing up and down locker-lined hallways carrying pompoms before the Big Game from your brain. And if you don’t succeed: My work here is done.