从命令式到声明式范式：使用 Hatch 和 DAB 重建 CI CD 基础设施.pdf

1、Luigi Di Tacchio06/10/2025From imperative to declarative paradigmRebuilding a CI/CD Infrastructure using Hatch and Databricks Asset BundlesMeet the speakerSr.Software Engineer,FreeWheel(Comcast)5 years in academic research focused on energy-efficient data transfers5+years at FreeWheel building scala

2、ble data pipelines using Spark and DatabricksLuigi Di Tacchio2What is a CI/CD infrastructure3Continuous Integration and Continuous Delivery/DeploymentSystem that helps developers deliver code changes quickly and automaticallyDelivery vs Deployment:ready for deployment or automatically deployedPipeli

3、ne:set of steps to take code from development to productionCheckout codebaseBuildTestDeploy“The best code is no code at all.”4Jeff Atwood,Co-founder of Stack Overflow The best CI/CD code is no code at allIt builds,releases,and runs other codeHard to test and prone to bugsCI/CD is meta-codeComplexity

4、=fragilityLearn and improve the infrastructure more quicklyEasier maintenance5Some reasons whySection 1The infrastructure that we inheritedOld CI/CD infrastructure7Unified build and deployOld CI/CD infrastructure8Per-project Jenkins pipelineOld CI/CD infrastructure9Build scriptOld CI/CD infrastructu

5、re10Deploy scriptAreas for improvementLack of version control leading to multiple JenkinsfilesHardcoded environmentNumerous pipelines doing the same thingDelegation of actual deployment11Jenkins sideAreas for improvementNo deployment standardizationOutdated practices(Python eggs)Artifact replicatedO

6、n Artifactory and S3In staging and productionDeployment using REST APIComplexityHigh maintenance12Project sideSection 2The design principles that inspired usDesign principles12 Factor AppOne codebase,many deploysSeparation of config from codeBuild,release,runDRY:Dont Repeat YourselfSeparation of con