Skyscanner 实现实用数据和人工智能治理的旅程.pdf

1、2024 Databricks Inc.All rights reservedMichael Ewins,Director of Engineering&JM Michael Ewins,Director of Engineering&JM LaplanteLaplante,Principal Software Engineer,Principal Software Engineer1SKYSCANNERS JOURNEY SKYSCANNERS JOURNEY OF ENABLING PRACTICAL OF ENABLING PRACTICAL DATA&AI GOVERNANCEDATA

2、&AI GOVERNANCE2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedA global leader in travel and technology connecting millions of people every day with trusted travel providers.2About SkyscannerAbout Skyscanner2024 Databricks Inc.All rights reservedWe reach more than 110 mi

3、llion users every month2024 Databricks Inc.All rights reserved5,000search requests per second2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedAnalytical data is used to optimize the business and user experience.We use Machine Learning models to rank and recommend travel

4、optionsAI Search answer traveller questions to inspire new experiences.5Data fuels SkyscannerData fuels Skyscanner2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved6Data journey:Data journey:where wewhere westartedstarted2024 Databricks Inc.All rights reserved2024 Databri

5、cks Inc.All rights reserved7Firefighting to keep data flowingFirefighting to keep data flowingWe were fixing symptoms not underlying issuesWe were fixing symptoms not underlying issues72024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved8Complex Data PipelinesComplex Data P

6、ipelinesLate arriving data,inconsistent data quality,unhappy data customersLate arriving data,inconsistent data quality,unhappy data customers82024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved9Multiple Data Technology StacksMultiple Data Technology StacksComplexity,dupli