《成为 Databricks 数据工程师专家的实用路线图.pdf》由会员分享,可在线阅读,更多相关《成为 Databricks 数据工程师专家的实用路线图.pdf(26页珍藏版)》请在三个皮匠报告上搜索。
1、A Practical Roadmap to Becoming an Expert Databricks Data EngineerDerar AlhusseinAgendaData Engineer RoleData Engineering on DatabricksLearning Paths&CertificationsGet Hands-On ExperienceReference MaterialsDerar Alhussein Databricks MVPAcadford,Founder&CEOUdemy Instructor(85K+Students)OReilly Author
2、8x Databricks CertifiedData Engineer Role?Data Processing SystemsReady to-use dataraw dataData Engineer Role?Data Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsSoftware EngineeringData Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsCode DevelopmentSQLPy
3、thonVersion ControlTestingData FormattingDataOpsCode DevelopmentSQLPythonCI/CDOrchestrationData QualityControlMonitoringData Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsVersion ControlTestingData FormattingMaintenanceCode DevelopmentSQLPythonCI/CDOrchestrationMonitoringData
4、 Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataOpsOptimizationClean upVersion ControlTestingData FormattingData QualityControlData GovernanceCode DevelopmentSQLPythonCI/CDOrchestrationData QualityMonitoringData Processing SystemsSoftwareEngineeringMaintenanceData GovernanceDataO
5、psOptimizationClean upVersion ControlTestingData FormattingData Engineering on Databricks Data Engineering on Databricks Code DevelopmentSpark SQLPySparkGit FolderspytestCI/CDDatabricks Jobs LakehouseMonitoring Notifications/Logging/Spark UISpark vs.DLTSoftwareEngineeringMaintenanceUnity CatalogData
6、OpsOptimize/Z-order indexing/Liquid ClusteringVacuumDelta LakeLearning RoadmapStep 1 SQLStep 2 PythonStep 3 Apache SparkStep 4 Data Engineering FundamentalsStep 5 Data Engineering IntermediateStep 6 Data Engineering AdvancedLearning RoadmapStep 1 SQLStep 2 PythonStep 3 Apache SparkStep 4Data Enginee