An IS auditor is assessing an AI-powered chatbot that produces inaccurate or fabricated information for customer queries. Which of the following is the BEST recommendation when the model’s configuration emphasizes creativity over accuracy?
Answer(s): D
Adjusting the model’s temperature parameter to lower randomness is the best recommendation. Lowering temperature reduces creative variability, making the chatbot more deterministic and accurate in its responses, which directly addresses the issue of fabricated information.
An AI-driven incident management system determines the root cause of a security event by:
Answer(s): A
Correlating similar events across multiple systems allows the AI-driven incident management system to identify common patterns and pinpoint the root cause of a security event more effectively than isolated analysis.
Which of the following metrics should an IS auditor recommend as a key performance indicator (KPI) to assess the reliability of a natural language processing AI model?
Answer(s): C
Recall-Oriented Understudy for Gisting Evaluations (ROUGE) is the appropriate KPI for assessing the reliability of a natural language processing (NLP) model. ROUGE measures the quality of text generation by comparing the model’s output with reference texts, making it suitable for evaluating NLP reliability.
The PRIMARY objective of conducting a red team simulation to test the security of an AI model is to:
The primary objective of a red team simulation for an AI model is to identify weaknesses in the model's ability to resist adversarial inputs. This helps uncover vulnerabilities that could be exploited to manipulate or degrade the model’s performance.
Which of the following assessments of data quality would an IS auditor use to validate relationship completeness between large data sets?
Referential integrity checks are used to validate relationship completeness between large data sets. They ensure that linked data across tables or sources is consistent and accurate, which is essential for maintaining reliable AI model training and outputs.
Post your Comments and Discuss ISACA AAIA exam prep with other Community members:
Our website is free, but we have to fight against AI bots and content theft. We're sorry for the inconvenience caused by these security measures. You can access the rest of the AAIA content, but please register or login to continue.