Leaders.com
  • Login
  • Subscribe
  • Business
  • Leadership
  • Wealth
  • Master Classes
  • Business
    • Entrepreneurs
    • Executives
    • Marketing and Sales
    • Social Media
    • Innovation
    • Women in Business
  • Leadership
    • Personal Growth
    • Company Culture
    • Public Speaking
    • Productivity
    • Hiring
    • Social Issues
    • Leaders
  • Wealth
    • Investing
    • Cryptocurrency
    • Retirement
    • Venture Capital
    • Loans and Borrowing
    • Taxes
    • Markets
    • Real Estate
  • Master Classes
  • Login
  • Subscribe
Tech

Alphabet stock dropped after an AI Bard demonstration made an error

By Tyler Hummel Leaders Staff

Tyler Hummel

Tyler Hummel

Tyler Hummel is a news writer for Leaders Media. He was the Fall 2021 College Fix Fellow and Health Care...

Full bio


Learn about our editorial policy

Mar 22, 2023

Why Chatbots Cite Incorrect Information

Artificial intelligence (AI) chatbots—like ChatGPT and Bard AI—are significant and powerful technologies, but they struggle with accurately citing data and facts

Key Details

  • Google parent Alphabet lost $100 billion in valuation on February 8 following a demonstration of Bard AI, where the AI incorrectly stated the James Webb Space Telescope satellite had first photographed an extra-solar planet, not the European VLT satellite, in 2004.  
  • Beta-testers for the new ChatGPT-powered Bing search engine, by Microsoft, noticed the following week that the chatbot had the same issue, getting multiple answers completely incorrect and being unable to distinguish between fact and fiction. 
  • In a presentation last week, Microsoft executives announced a new suite of AI-powered features. They defended the technology as “usefully wrong,” claiming its new “Copilot” software is still powerful and dismissed small mistakes as easily fixed.

Why It’s Important 

AIs have to be trained on datasets in order to learn how to build convincing language models. ChatGPT currently does not have access to a dataset after December 2021, meaning it cannot answer questions on current events, trends, or scientific developments. As the noted demonstrations show, the existing chatbots are struggling with correct citations. 

This has placed a severe limitation on the current software’s applicability. While these results haven’t slowed the ongoing AI arms race, they have cut against promises that chatbots could answer complex questions in an easy-to-understand way for the benefit of users. It is unclear whether the technology will be useful for accurate citations.

Breaking Down The Issue 

Dr. Jie Wang is a professor of computer science at the University of Massachusetts Amherst. His work in AI has focused on downstream applications of language models and data modeling. He tells Leaders Media that the citation issue is not so much a technical problem as a limitation of resources and training. 

“Data gathering from the internet is often done by deploying web crawlers, which are programs to automatically visit websites and collect web publications, news, blogs, academic papers, and images, among other things. These data are then processed and turned into the pure text form suitable as input for training neural networks,” says Wang.  

Bard AI, ChatGPT, and GPT-4 are language models trained on large datasets, and the quality of their respective answers will depend on the quality of those training models. Those early models are bound to make many mistakes based on the quality and volume of information sampled. As Wang notes, it is possible to train a chatbot to answer questions purposefully incorrectly or for two chatbots trained on the same information to come to different conclusions. 

These are issues that the development teams behind ChatGPT and Bard AI are fully aware of. They could resolve some of these issues by expanding the training dataset with more up-to-date information, but this comes at the expense of extreme costs. Having a specific data cutoff and focusing the training on then-current or obsolete information is a generally accepted practice.  

“Keep in mind that training a large model is extremely costly. It takes a long time and a lot of powerful machines to train a large model. For economic reasons, model updates are not done frequently. A company can update its model with new data at any time. The only concern is whether it is worth doing because of the time and money needed to complete this task,” says Wang. 

An Optimistic Outlook 

Even with the noted limitations, the technology has overall proved disruptive, with schools and universities already needing to roll out technology that can scan essays for a text generated in ChatGPT. As the online proofreading website Scribbr notes, no official citation format for ChatGPT has been released by any of the official style guides. Citation authorities are still uncertain if allowing ChatGPT-sourced information will be appropriate.

Dr. Wang speaks optimistically about the potential of AI. One of the applications he is exploring is improving K-12 students’ reading comprehension skills, believing that more powerful AI creates possibilities for helping strengthen students. 

“ChatGPT is a double-edged sword. On the one hand, schools and universities should ban students from using ChatGPT to produce term papers and computer programs in their coursework, among other things. On the other hand, ChatGPT can also be used to help improve teaching and research in a positive way,” he says. 

Home / News / Why Chatbots Cite Incorrect Information
Share
FacebookTweetEmailLinkedIn

Related Stories

Senate And House Battle Over Debt-Ceiling Bill

by Hannah Bryan Leaders Staff
Public Policy

9 hours ago

debt ceiling

The U.S. Senate has announced hearings for committees to analyze the debt-ceiling bill passed by the Republican-led House last week. 

Key Details

  • Though the White House has stood firm in its refusal to negotiate the debt-ceiling terms with House Speaker Kevin McCarthy (R-CA), the House passed a bill last week to jumpstart negotiations. 
  • Senate Majority Leader Chuch Schumer (D-NY) announced Monday that Senate committees would evaluate the recently passed bill.
  • While McCarthy’s bill attempts to bring President Joe Biden to the table, the bill is unlikely to pass in the Senate. 
  •  "The president says, 'I'm not going to talk to him until he offers a plan,’" McCarthy says. "Not only did we offer a plan, we passed it.”

Go deeper

FacebookTweetEmailLinkedIn

Gen Z Is Changing Workplace Habits

by Hannah Bryan Leaders Staff
Company Culture

11 hours ago

working late

Remote work has opened the door for many changing workplace traditions, including changing the nine-to-five workday. 

Key Details

  • Hard workers and early risers are often associated with one another, but a recent study shows that most Gen Z employees prefer to begin their work at 6 p.m.
  • In an Adobe study that sampled workers in the UK, U.S., and Japan, younger workers were found to be more productive in the evenings, Fortune reports. 
  • These younger employees prefer to work through the night and spend their downtime during the daylight hours. 
  • Only 6% of Boomers reported being productive from 6 p.m. to 3 p.m. compared to 26% of Gen Zers. 

Go deeper

FacebookTweetEmailLinkedIn

Phoenix Suns Shift From Traditional Broadcasting 

by Tyler Hummel Leaders Staff
Entertainment

12 hours ago

The owner of the Phoenix Suns and Phoenix Mercury is striking out on his own—shifting away from traditional broadcasting deals. 

Key Details

  • The bankruptcy of Diamond Sports Group in March has resulted in numerous sports teams attempting to void their streaming contracts. 
  • Two Phoenix, Arizona-based teams are making a similar attempt, shaking their traditional local streaming contract with Bally Sports Arizona to seek new opportunities. 
  • Both teams announced on Friday that games will be broadcast on over-the-air local television in Phoenix, Tucson, and Yuma and that free broadcasts will be made available through streaming. 
  • Diamond has argued that the announcement is a breach of contract for the sports teams, while ESPN is warning that the decision could cost tens of millions of dollars in the short term for the teams. 
  • The team owner believes the change will “more than triple the reach” of their audience. 

Go deeper

FacebookTweetEmailLinkedIn
Markets

12 hours ago

Dimon Says: (Part Of) the Banking Crisis Is Over 

by Tyler Hummel Leaders Staff
right to repair
Business

13 hours ago

Farmers Still Struggle To Fix John Deeres

by Hannah Bryan Leaders Staff
amazon ads
Business

15 hours ago

Amazon’s A-To-Z Adage Does Include Ads

by Hannah Bryan Leaders Staff

Recent Articles

Personal Growth

18 hours ago

How Adaptability Can Make or Break Your Career in the Coming Years

The business world is always changing, making adaptability a necessary skill.

Wealth

Apr 27, 2023

How to Make an Extra $1000 a Month Starting With Only $100 

You can make an extra $1000 per month with a small upfront investment or a part-time job.

Leadership

Apr 26, 2023

Narcissists in the Workplace: Signs Your Coworker or Boss Might Be One of Them

Narcissistic bosses do whatever it takes to gain success and power.

  • Business
  • Leadership
  • Wealth
Join the Leaders Community

Get exclusive tools and resources you need to grow as a leader and scale a purpose-driven business.

Subscribing indicates your consent to our Terms & Conditions and Privacy Policy

Leaders.com
  • Privacy Policy
  • About
  • Careers
  • Cookie Policy
  • Terms
  • Disclosures
  • Editorial Policy
  • Member Login

© 2023 Leaders.com - All rights reserved.

Search Leaders.com

x