Mô tả

This is the ultimate course for aspiring and experienced data engineers alike. This comprehensive course is meticulously designed to take you through the entire process of creating a data warehouse, from conceptualization to implementation, using Amazon Redshift and the medallion architecture.

This course is designed for data professionals, analysts, and anyone interested in mastering data warehousing, this course will equip you with the skills and knowledge needed to create robust and scalable data warehouses from the ground up.

Through hands-on lessons and real-world examples, you'll learn how to:


  1. Establish the logical architecture and design of a data warehouse, ensuring a solid foundation for your project.

  2. Create and configure a data warehouse in the cloud using Amazon Redshift, leveraging the power and scalability of cloud computing.

  3. Implement various data loading strategies to efficiently populate your data warehouse with relevant data from multiple sources.

  4. Convert the logical design into a physical implementation, setting up the necessary infrastructure and configurations on AWS.

  5. Implement the Medallion Architecture in your Redshift data warehouse, following industry best practices for data modeling and organization.

  6. Write comprehensive test cases and implement data quality measures to ensure the integrity and reliability of your data warehouse.

  7. Utilize DBT (Data Build Tool) for seamless data transformation, analysis, and documentation, streamlining the entire data warehousing process.

This course is suitable for all regardless of your job function; a data analyst, business intelligence professional, or simply someone passionate about data, this course will provide you with the skills and knowledge required to design and build a robust data warehouse from scratch, enabling you to unlock valuable insights and drive data-driven decision-making within your organisation.


Enroll now and embark on a journey to become a data warehousing expert with "Designing Data Warehouse From Scratch: End to End Guide".


Bạn sẽ học được gì

Begin with the basics of data warehousing, understanding its significance, and exploring data modeling concepts to design the logical view of your DW

Get hands-on with Amazon Redshift, learning how to set up, manage, and optimize your data warehouse cluster for performance and cost-efficiency.

Translate your logical model into a robust physical model in Redshift, mastering the art of schema design, table creation, and query optimization.

Explore various data ingestion methods and learn how to transform raw data into insightful, analytical information using ETL and ELT processes.

Implement the cutting-edge medallion architecture in your data warehouse to streamline data processing and enhance analytical capabilities.

Yêu cầu

  • Basic Understanding of AWS Services
  • Basic SQL Technical Skills
  • Basic Understanding of Datawarehouse and Data Modelling

Nội dung khoá học

10 sections

Introduction

3 lectures
Prerequisites
07:18
Steps Involved in Creating a Data Warehouse
11:32
Discussing the business usecase
01:32

Creating Logical View of Datawarehouse

1 lectures
Creating the Logical Architecture View of the DW
33:30

Converting Logical View to Physical View

7 lectures
Creating Security Groups on AWS
01:27
Connecting and Managing your Redshift Cluster
05:02
Creating Glue crawler to create table from S3
08:30
Uploading data to s3 and crawling them with Glue crawler
08:57
Verifying the data loaded into Data Warehouse
09:46
Creating VPC, Subnets, Internet Gateways on AWS
02:26
Creating Subnet Groups on Redshift for VPC
00:53

Creating a Datawarehouse in the Cloud

2 lectures
Creating a Redshift Cluster on AWS
03:31
Finalising the creation Redshift Cluster on AWS
13:33

Data Loading into Datawarehouse

1 lectures
Data Warehouse Data Loading Strategies
50:16

Implementing Medallion Architecture in Redshift Datawarehouse

2 lectures
Creating DBT Project and Implementing Medallion Architecture
01:07:05
Finishing up on the Gold layer Facts
29:30

Data Quality and Testing

3 lectures
Writing Test Cases for Dimension Layers
13:00
Writing Test Cases for Gold Layer
17:43
Writing Data Quality Test Cases
06:50

DBT Analyses

1 lectures
Working with DBT Analyses
14:53

DBT Documentation

1 lectures
Writing DBT Documentation for the Project
05:36

Course Resources

1 lectures
Full Code
00:03

Đánh giá của học viên

Chưa có đánh giá
Course Rating
5
0%
4
0%
3
0%
2
0%
1
0%

Bình luận khách hàng

Viết Bình Luận

Bạn đánh giá khoá học này thế nào?

image

Đăng ký get khoá học Udemy - Unica - Gitiho giá chỉ 50k!

Get khoá học giá rẻ ngay trước khi bị fix.