Skip to main navigation Skip to search Skip to main content

Too Confident to Correct? How Generative AI Reliability Cues Shape User Overconfidence

  • Åbo Akademi University

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

This research investigates how the reliability of Artificial Intelligence (AI) affects human confidence in the decision-making process. The study used an experimental design, recruiting 192 participants (N = 192) who were assigned to three controlled conditions (No AI, 0%; AI with 75% reliability; and AI with 95% reliability). The research process comprises 10 General-knowledge true-false questions, which were provided to the research participants. Participants were provided with AI-generated suggestions for all true and false statements, along with their assigned reliability level. This research study aimed to evaluate the impact of GenAI reliability and the presence of AI support on participants’ confidence in their decisions, regardless of decision accuracy. The results of ANOVA indicate that AI assistance significantly affects research participants’ overconfidence. Participants in all controlled conditions, including 75% and 95% AI reliability, observed that AI was more accurate and reliable.
Original languageEnglish
Title of host publicationRecent Trends and Challenges in Information Systems and Technologies : WorldCIST 2026, Volume 1
EditorsAlvaro Rocha, Hojjat Adeli, Fernando Moreira
Volume1
Place of PublicationCham
PublisherSpringer
Publication date2027
Pages155–165
ISBN (Print)9783032320285
ISBN (Electronic)9783032320292
DOIs
Publication statusPublished - 2027
SeriesLecture Notes in Networks and Systems
Volume2091
ISSN2367-3370

Bibliographical note

Published online: 19 July 2026.

Keywords

  • Artificial intelligence
  • Overconfidence
  • HCI
  • Decision making
  • GenAI reliability

Cite this