Artificial Intelligence - AI : Evaluating AI Content

Lateral Reading is a strategy used to compare a source with other sources to verify it's validity.

ROBOT is an AI evaluation tool.

R = Reliability

• How reliable is the information available about the AI technology?
• If it’s not produced by the party responsible for the AI, what are the author’s credentials? Bias?
• If it is produced by the party responsible for the AI, how much information are they making available? 
  • Is information only partially available due to trade secrets?
  • How biased is they information that they produce?

O  = Objective

• What is the goal or objective of the use of AI?
• What is the goal of sharing information about it?
  • To inform?
  • To convince?
  • To find financial support?

B  = Bias

• What could create bias in the AI technology?
• Are there ethical issues associated with this?
• Are bias or ethical issues acknowledged?
  • By the source of information?
  • By the party responsible for the AI?
  • By its users?

O = Ownership

• Who is the owner or developer of the AI technology?
• Who is responsible for it?
  • Is it a private company?
  • The government?
  • A think tank or research group?
• Who has access to it?
• Who can use it?

T  = Type

• Which subtype of AI is it?
• Is the technology theoretical or applied?
• What kind of information system does it rely on?
• Does it rely on human intervention? 

Hervieux, S. & Wheatley, A. (2020). The ROBOT test [Evaluation tool]. The LibrAIry. https://thelibrairy.wordpress.com/2020/03/11/the-robot-test

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

S =  Stop

I =  Investigate the source

F = Find better coverage

T = Trace claims, quotes and media to the original source

An evaluation method created by Michael Caulfield

 This work is licensed under a Creative Commons Attribution 4.0 International License.