成为 Databricks 数据工程师专家的实用路线图.pdf

1、A Practical Roadmap to Becoming an Expert Databricks Data EngineerDerar AlhusseinAgendaData Engineer RoleData Engineering on DatabricksLearning Paths&CertificationsGet Hands-On ExperienceReference MaterialsDerar Alhussein Databricks MVPAcadford,Founder&CEOUdemy Instructor(85K+Students)OReilly Author

2、8x Databricks CertifiedData Engineer Role?Data Processing SystemsReady to-use dataraw dataData Engineer Role?Data Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsSoftware EngineeringData Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsCode DevelopmentSQLPy

3、thonVersion ControlTestingData FormattingDataOpsCode DevelopmentSQLPythonCI/CDOrchestrationData QualityControlMonitoringData Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsVersion ControlTestingData FormattingMaintenanceCode DevelopmentSQLPythonCI/CDOrchestrationMonitoringData

4、 Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsOptimizationClean upVersion ControlTestingData FormattingData QualityControlData GovernanceCode DevelopmentSQLPythonCI/CDOrchestrationData QualityMonitoringData Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataO

5、psOptimizationClean upVersion ControlTestingData FormattingData Engineering on Databricks Data Engineering on Databricks Code DevelopmentSpark SQLPySparkGit FolderspytestCI/CDDatabricks Jobs LakehouseMonitoring Notifications/Logging/Spark UISpark vs.DLTSoftwareEngineeringMaintenanceUnity CatalogData

6、OpsOptimize/Z-order indexing/Liquid ClusteringVacuumDelta LakeLearning RoadmapStep 1 SQLStep 2 PythonStep 3 Apache SparkStep 4 Data Engineering FundamentalsStep 5 Data Engineering IntermediateStep 6 Data Engineering AdvancedLearning RoadmapStep 1 SQLStep 2 PythonStep 3 Apache SparkStep 4Data Enginee