What distinguishes BLEU scores from ROUGE scores when evaluating natural language processing models?
Answer(s): C
BLEU (Bilingual Evaluation Understudy) and ROUGE (Recall-Oriented Understudy for Gisting Evaluation) are metrics used to evaluate natural language processing (NLP) models, particularly for tasks like machine translation and text summarization. According to NVIDIA's NeMo documentation on NLP evaluation metrics, BLEU primarily measures the precision of n-gram overlaps between generated and reference translations, making it suitable for assessing translation quality. ROUGE, on the other hand, focuses on recall, measuring the overlap of n-grams, longest common subsequences, or skip-bigrams between generated and reference summaries, making it ideal for summarization tasks. Option A is incorrect, as BLEU and ROUGE do not measure fluency or uniqueness directly. Option B is wrong, as both metrics focus on n-gram overlap, not syntactic or semantic analysis. Option D is false, as neither metric evaluates efficiency or complexity.
NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user- guide/docs/en/stable/nlp/intro.htmlPapineni, K., et al. (2002). "BLEU: A Method for Automatic Evaluation of Machine Translation." Lin, C.-Y. (2004). "ROUGE: A Package for Automatic Evaluation of Summaries."
Which principle of Trustworthy AI primarily concerns the ethical implications of AI's impact on society and includes considerations for both potential misuse and unintended consequences?
Accountability is a core principle of Trustworthy AI that addresses the ethical implications of AI's societal impact, including potential misuse and unintended consequences. NVIDIA's guidelines on Trustworthy AI, as outlined in their AI ethics framework, emphasize accountability as ensuring that AI systems are transparent, responsible, and answerable for their outcomes. This includes mitigating risks of bias, ensuring fairness, and addressing unintended societal impacts. Option A (Certification)refers to compliance processes, not ethical implications. Option B (Data Privacy) focuses on protecting user data, not broader societal impact. Option D (Legal Responsibility) is related but narrower, focusing on liability rather than ethical considerations.
NVIDIA Trustworthy AI: https://www.nvidia.com/en-us/ai-data-science/trustworthy-ai/
What are the main advantages of instructed large language models over traditional, small language models (< 300M parameters)? (Pick the 2 correct responses)
Answer(s): D,E
Instructed large language models (LLMs), such as those supported by NVIDIA's NeMo framework, have significant advantages over smaller, traditional models:Option D: LLMs often have cheaper computational costs during inference for certain tasks because they can generalize across multiple tasks without requiring task-specific retraining, unlike smaller models that may need separate models per task.Option E: A single generic LLM can perform multiple tasks (e.g., text generation, classification, translation) due to its broad pre-training, unlike smaller models that are typically task-specific. Option A is incorrect, as LLMs require large amounts of data, often labeled or curated, for pre- training. Option B is false, as LLMs typically have higher latency and lower throughput due to their size. Option C is misleading, as LLMs are often less interpretable than smaller models.
NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user- guide/docs/en/stable/nlp/intro.htmlBrown, T., et al. (2020). "Language Models are Few-Shot Learners."
When comparing and contrasting the ReLU and sigmoid activation functions, which statement is true?
Answer(s): D
ReLU (Rectified Linear Unit) and sigmoid are activation functions used in neural networks. According to NVIDIA's deep learning documentation (e.g., cuDNN and TensorRT), ReLU, defined as f(x) = max(0, x), is computationally efficient because it involves simple thresholding, avoiding expensive exponential calculations required by sigmoid, f(x) = 1/(1 + e^(-x)). Sigmoid outputs values in the range [0, 1], making it suitable for predicting probabilities in binary classification tasks. ReLU, with an unbounded positive range, is less suited for direct probability prediction but accelerates training by mitigating vanishing gradient issues. Option A is incorrect, as ReLU is non-linear (piecewise linear). Option B is false, as ReLU is more efficient and not inherently more accurate. Option C is wrong, as ReLU's range is [0, ), not [0, 1].
NVIDIA cuDNN Documentation: https://docs.nvidia.com/deeplearning/cudnn/developer- guide/index.htmlGoodfellow, I., et al. (2016). "Deep Learning." MIT Press.
Which aspect in the development of ethical AI systems ensures they align with societal values and norms?
Ensuring explicable decision-making processes, often referred to as explainability or interpretability, is critical for aligning AI systems with societal values and norms. NVIDIA's Trustworthy AI framework emphasizes that explainable AI allows stakeholders to understand how decisions are made, fostering trust and ensuring compliance with ethical standards. This is particularly important for addressing biases and ensuring fairness. Option A (prediction accuracy) is important but does not guarantee ethical alignment. Option B (complex algorithms) may improve performance but not societal alignment. Option C (autonomy) can conflict with ethical oversight, making it less desirable.
Post your Comments and Discuss NVIDIA NCA-GENL exam prep with other Community members:
Our website is free, but we have to fight against AI bots and content theft. We're sorry for the inconvenience caused by these security measures. You can access the rest of the NCA-GENL content, but please register or login to continue.