Leaders.com
  • Business
  • Leadership
  • Wealth
  • Master Classes
  • Business
    • Entrepreneurs
    • Executives
    • Marketing and Sales
    • Social Media
    • Innovation
    • Women in Business
  • Leadership
    • Personal Growth
    • Company Culture
    • Public Speaking
    • Productivity
    • Hiring
    • Social Issues
    • Leaders
  • Wealth
    • Investing
    • Cryptocurrency
    • Retirement
    • Venture Capital
    • Loans and Borrowing
    • Taxes
    • Markets
    • Real Estate
  • Master Classes
Tech

Alphabet stock dropped after an AI Bard demonstration made an error

By Tyler Hummel Leaders Staff

Tyler Hummel

Tyler Hummel

Tyler Hummel is a news writer for Leaders Media. He was the Fall 2021 College Fix Fellow and Health Care...

Full bio


Learn about our editorial policy

Mar 22, 2023

Why Chatbots Cite Incorrect Information

Artificial intelligence (AI) chatbots—like ChatGPT and Bard AI—are significant and powerful technologies, but they struggle with accurately citing data and facts

Key Details

  • Google parent Alphabet lost $100 billion in valuation on February 8 following a demonstration of Bard AI, where the AI incorrectly stated the James Webb Space Telescope satellite had first photographed an extra-solar planet, not the European VLT satellite, in 2004.  
  • Beta-testers for the new ChatGPT-powered Bing search engine, by Microsoft, noticed the following week that the chatbot had the same issue, getting multiple answers completely incorrect and being unable to distinguish between fact and fiction. 
  • In a presentation last week, Microsoft executives announced a new suite of AI-powered features. They defended the technology as “usefully wrong,” claiming its new “Copilot” software is still powerful and dismissed small mistakes as easily fixed.

Why It’s Important 

AIs have to be trained on datasets in order to learn how to build convincing language models. ChatGPT currently does not have access to a dataset after December 2021, meaning it cannot answer questions on current events, trends, or scientific developments. As the noted demonstrations show, the existing chatbots are struggling with correct citations. 

This has placed a severe limitation on the current software’s applicability. While these results haven’t slowed the ongoing AI arms race, they have cut against promises that chatbots could answer complex questions in an easy-to-understand way for the benefit of users. It is unclear whether the technology will be useful for accurate citations.

Breaking Down The Issue 

Dr. Jie Wang is a professor of computer science at the University of Massachusetts Amherst. His work in AI has focused on downstream applications of language models and data modeling. He tells Leaders Media that the citation issue is not so much a technical problem as a limitation of resources and training. 

“Data gathering from the internet is often done by deploying web crawlers, which are programs to automatically visit websites and collect web publications, news, blogs, academic papers, and images, among other things. These data are then processed and turned into the pure text form suitable as input for training neural networks,” says Wang.  

Bard AI, ChatGPT, and GPT-4 are language models trained on large datasets, and the quality of their respective answers will depend on the quality of those training models. Those early models are bound to make many mistakes based on the quality and volume of information sampled. As Wang notes, it is possible to train a chatbot to answer questions purposefully incorrectly or for two chatbots trained on the same information to come to different conclusions. 

These are issues that the development teams behind ChatGPT and Bard AI are fully aware of. They could resolve some of these issues by expanding the training dataset with more up-to-date information, but this comes at the expense of extreme costs. Having a specific data cutoff and focusing the training on then-current or obsolete information is a generally accepted practice.  

“Keep in mind that training a large model is extremely costly. It takes a long time and a lot of powerful machines to train a large model. For economic reasons, model updates are not done frequently. A company can update its model with new data at any time. The only concern is whether it is worth doing because of the time and money needed to complete this task,” says Wang. 

An Optimistic Outlook 

Even with the noted limitations, the technology has overall proved disruptive, with schools and universities already needing to roll out technology that can scan essays for a text generated in ChatGPT. As the online proofreading website Scribbr notes, no official citation format for ChatGPT has been released by any of the official style guides. Citation authorities are still uncertain if allowing ChatGPT-sourced information will be appropriate.

Dr. Wang speaks optimistically about the potential of AI. One of the applications he is exploring is improving K-12 students’ reading comprehension skills, believing that more powerful AI creates possibilities for helping strengthen students. 

“ChatGPT is a double-edged sword. On the one hand, schools and universities should ban students from using ChatGPT to produce term papers and computer programs in their coursework, among other things. On the other hand, ChatGPT can also be used to help improve teaching and research in a positive way,” he says. 

Home / News / Why Chatbots Cite Incorrect Information
Share
FacebookTweetEmailLinkedIn

Related Stories

Parent’s Wealth Tip The Scales In SAT Scores and College Admissions

by PJ Howland Leaders Staff
Wealth

Oct 25, 2023

Parent's wealth tips the scales for SAT numbers

New data shows a strong correlation between family income and SAT scores, indicating the exam may act as a “wealth test” that advantages higher-income students.

Key Details

  • Students from wealthier families tend to score higher on the SAT than lower-income peers due to advantages like well-funded schools, tutors, and extracurricular activities.
  • The pandemic has exacerbated SAT score disparities, with average scores dropping the most among disadvantaged groups.
  • Addressing the gap requires increased funding for lower-income school districts and expanding access to test prep resources.
  • Children from the top 1% of families are twice as likely to attend an Ivy-Plus college (Ivy League, Stanford, MIT, Duke, and Chicago) compared to middle-class families with similar SAT/ACT scores.

Go deeper

FacebookTweetEmailLinkedIn

Seattle Takes The Crown For Advanced Tech Talent

by PJ Howland Leaders Staff
Tech

Oct 24, 2023

Seattle tech talent

Seattle has emerged as the metro area with the most advanced tech talent, beating out tech hubs like San Francisco and Silicon Valley.

Key Details

  • According to a new ranking by the Burning Glass Institute, Seattle has the highest proportion of advanced tech workers compared to other cities with similarly sized tech workforces.
  • The ranking evaluated 60 million high-paying, in-demand tech job postings and histories to identify cities with cutting-edge roles like AI and cybersecurity rather than legacy tech positions.
  • With tech giants Amazon and Microsoft headquartered in Seattle, the city edged out the San Francisco Bay Area, Boston, Austin, and Raleigh on the list.
  • The report found that demand for software developers and IT support specialists has declined over the past five years as companies seek more specialized tech talent.

Go deeper

FacebookTweetEmailLinkedIn

More Americans Can’t Keep Up With Car Payments

by Colin Baker Leaders Staff
Loans and Borrowing

Oct 23, 2023

car loans, used cars

A record number of Americans are behind on their car loan payments as higher interest rates and prices weigh on consumers.

Key Details

  • According to data from Fitch Ratings, 6.11% of car loans were at least 60 days delinquent in September, the highest since tracking began in the early 2000s.
  • Some interest rates on used cars can rise to as much as 21%, according to Bankrate.
  • Soaring prices and rising interest rates are squeezing consumers, making it difficult for some to keep up with their auto loans.

Go deeper

FacebookTweetEmailLinkedIn
Chevron Gas Deal
Markets

Oct 23, 2023

Chevron Makes $53 Billion Deal Amid Surging Gas Prices

by PJ Howland Leaders Staff
nike logo
Company Culture

Oct 20, 2023

Nike to Require More In-Office Days From Employees

by Colin Baker Leaders Staff
blue collar workers
Retirement

Oct 20, 2023

Explaining The ‘C+ Grade’ Retirement Ecosystem in The United States

by PJ Howland Leaders Staff

Recent Articles

Hiring

Nov 1, 2023

Learn the Winning Answers to the Most Common Phone Interview Questions

Come to your next phone interview fully prepared

Personal Growth

Oct 30, 2023

85 Quotes on Self-Love to Boost Your Self-Esteem

Don’t fall into the trap of harsh self-criticism

Company Culture

Oct 27, 2023

What is a Sabbatical? Your Ticket to Restful Growth and Meaning

Sabbaticals can benefits both employees and businesses

  • Business
  • Leadership
  • Wealth
Join the Leaders Community

Get exclusive tools and resources you need to grow as a leader and scale a purpose-driven business.

Subscribing indicates your consent to our Terms & Conditions and Privacy Policy

Leaders.com
  • Privacy Policy
  • About
  • Careers
  • Cookie Policy
  • Terms
  • Disclosures
  • Editorial Policy
  • Member Login

© 2025 Leaders.com - All rights reserved.

Search Leaders.com