Which of the following evaluation criteria is the HIGHEST priority when auditing an organization's management of AI vendors?
Answer(s): C
Service level objectives define measurable performance, availability, and reliability expectations for the AI vendor, providing the primary basis for governance, oversight, and accountability in vendor management.
A health organization has deployed an AI model to analyze chest X-rays. The model reports high accuracy, but thresholds for classifying results are unclear and performance is not broken down by different patient demographics. Which of the following is the PRIMARY reason to avoid relying only on overall accuracy to evaluate this model?
Answer(s): A
Overall accuracy can mask poor performance on specific demographic groups, which can introduce significant fairness and patient safety risks if the model underperforms for certain populations.
An IS auditor is planning for an audit of an organization’s use of AI to screen applicants for open positions. Which of the following is MOST important to include within the audit scope?
The data sources used for candidate evaluation directly influence model behavior and potential bias, making them critical to assess for fairness, legality, and compliance in AI-driven hiring decisions.
Which of the following is the GREATEST risk when an organization uses publicly available social media data to train its AI model without obtaining explicit user consent?
Answer(s): D
Using personal data without explicit consent can violate data privacy laws and regulations, exposing the organization to significant legal penalties and compliance risks.
An IS auditor identified that an AI model was optimized to approve more loans to meet growth targets, which led to a rise in defaults and expected losses. Which action will BEST address this situation?
Answer(s): B
The issue stems from misaligned optimization objectives, where the model prioritizes short-term approvals over long-term credit risk. Aligning the reward function with long-term risk metrics ensures decisions balance growth with sustainable risk outcomes.
Post your Comments and Discuss ISACA AAIA exam prep with other Community members:
Our website is free, but we have to fight against AI bots and content theft. We're sorry for the inconvenience caused by these security measures. You can access the rest of the AAIA content, but please register or login to continue.