Great World Texts: Kim Jiyoung, Born 1982 : Utilizing Generative AI for Your Project

Do AI Chatbots Provide Credible Information?

ChatGPT and other AI chatbots can be powerful tools in some contexts, but have been found to be unreliable when searching for credible information. 

AI chatbots:

• are predictive text generators, not search engines; they are designed to respond to questions in a human-like manner, not to find reliable information sources

• do not evaluate for accuracy, bias, or credibility

• can generate factually incorrect statements

• make up (“hallucinate”) sources

• link to sources that are irrelevant to the output or do not support claims in the output

• do not respond to prompts consistently

• are trained on undisclosed data that: 

  • retains systemic biases found online

  • generally does not include paywalled scholarly articles

  • may not be current

Although it's not advised to use generative AI directly to find sources on your topic, AI chatbots may be helpful for some parts of your research process. For instance: 

• Prompt a chatbot to help brainstorm ideas or to narrow or broaden your topic. (Just be sure to confirm accuracy as you research further.)
• Prompt a chatbot to generate a list of keywords associated with your topic. Use these terms as you search online, in the Library catalog, or in our Library databases. 
• Use a chatbot to translate or summarize sources for improved readability.

3 Tips for Communicating with a Chatbot

• Provide clear context: Offer background details to help the chatbot understand your request better.
   
• Give precise instructions: Be specific about what you're asking to improve accuracy.
   
• Expect iteration: The first response may not be perfect. Communication with a chatbot is a collaborative process, so be ready to refine your instructions or offer additional information as needed.
   

Gruda, D. (2024). Three ways ChatGPT helps me in my academic writing. Nature. https://doi.org/10.1038/d41586-024-01042-3