What are the layers of data in databricks?

Question

Describe the layers of ETL in Databricks.

Answer

Databricks moves the data into three layers bronze, silver and gold.

Bronze Layer (Extract)

Stages the data from the sources as is

Silver Layer (Transform)

Make transformations on the data like remove Nulls, add new columns, Joins, Unions among tables and any kind of transformation to make the tables ready to be used for next layer.

Gold Layer (Load)

The last layer which is consumed by data analysts, data scientists, BI developers or any other team. In the layer the tables are clean enough and available to be used as Tables, Views, Materialized Views, Functions, or and others.