A data engineer is designing the final layer of a Medallion architecture (the Gold layer) to support the company's executive dashboards and BI reporting tools. Which two characteristics typically describe the data found in this layer? (Select TWO).
Answer(s): D,E
The Gold layer contains de-normalized, business-level tables that are read-optimized for analytics, dashboards,and reporting, providing fast and simplified data access.
A data engineer team has decided to implement a new data platform on Databricks and is currently deciding how to store each kind of data on each data layer.What is the appropriate layer and data pairing for medallion architecture?
Answer(s): C
In the Medallion architecture, the Silver layer holds cleansed and conformed data (such as master customer data), which has been cleaned, validated, and standardized after ingestion from the Bronze layer.
A data engineer has been provided a PySpark DataFrame named df with columns product and revenue. The data engineer needs to compute complex aggregations to determine each product's total revenue, average revenue, and transaction count.Which code snippet should the data engineer use?
Answer(s): A
The correct code uses PySpark functions (sum, avg, count) with aliases inside .agg() after grouping by product.This produces total revenue, average revenue, and transaction count for each product.
A data engineer is developing an ETL process based on Spark SQL. The execution fails. The data engineer checks the Spark UI and can see the ERRORS as follows:"java.lang.OutofMemoryError: Java heap space"Which two corrective actions should the data engineer perform to resolve this issue? (Choose two.)
Answer(s): A,B
Reducing input with narrower filters lowers memory pressure, and increasing executor resources (upsize worker nodes) plus enabling adaptive/auto shuffle partitioning provides more memory and better partitioning to avoid Java heap OOM during Spark SQL execution.
A data engineer is working in a Python notebook on Databricks to process data, but notices that the output is not as expected. The data engineer wants to investigate the issue by stepping through the code and checking the values of certain variables during execution.Which tool should the data engineer use to inspect the code execution and variables in real-time?
The Python Notebook Interactive Debugger in Databricks allows stepping through code execution, setting breakpoints, and inspecting variable values in real-time. This makes it the correct tool for debugging Python code inside a Databricks notebook.
Which of the following code blocks will remove the rows where the value in column age is greater than 25 from the existing Delta table my_table and save the updated table?
A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.Which of the following commands could the data engineering team use to access sales in PySpark?
Answer(s): E
Which of the following commands will return the location of database customer360?
Post your Comments and Discuss Databricks Certified Data Engineer Associate exam prep with other Community members:
Our website is free, but we have to fight against AI bots and content theft. We're sorry for the inconvenience caused by these security measures. You can access the rest of the Certified Data Engineer Associate content, but please register or login to continue.