What are the layers of data in databricks?
CodingTechnical InterviewEasyData EngineerLast asked 1 hour ago
Question
Describe the layers of ETL in Databricks.
Answer
Databricks moves the data into three layers bronze, silver and gold.
Bronze Layer (Extract)
Stages the data from the sources as is
Silver Layer (Transform)
Make transformations on the data like remove Nulls, add new columns, Joins, Unions among tables and any kind of transformation to make the tables ready to be used for next layer.
Gold Layer (Load)
The last layer which is consumed by data analysts, data scientists, BI developers or any other team. In the layer the tables are clean enough and available to be used as Tables, Views, Materialized Views, Functions, or and others.