Delta-rs、Apache Arrow、Polars、WASM：Rust 是分析的未来吗？.pdf

1、Is Rust the Future of Analytics?Delta-rs,Apache Arrow,Polars,WASMDatabricks2023The JVM is dead.Hi Oz Katz CTO,Co-Founder lakeFS Present of AnalyticsData SourcesIngestProcess,store,analyzeCRMERPCDPOperational DBsCRMData Pipeline(s)Data SourcesIngestProcess,store,analyzeCRMERPCDPOperational DBsCRMData

2、 Pipeline(s)Data SourcesIngestProcess,store,analyzeCRMERPCDPOperational DBsCRMData Pipeline(s)Data SourcesIngestProcess,store,analyzeCRMERPCDPOperational DBsCRMData Pipeline(s)The JVM is dead.OK,it will never dieOK,it will never dieOK,it will never dieBut its starting to show its age.Moores law CLAS

3、SPATH GCDatabricks PhotonYes,but Python PythonWell,cpythonPythonCC is hardCorrectnessMemory managamentDependenciesC+?Databricks PhotonThe FutureRustRust Correctness Memory management DependenciesRust:Interoppyo3.rsCFFIRusts data ecosystem ndarray tikv Databend Materialize Roapi BurnWebAssembly is a

4、binary instruction format for a stack-based virtual machine.Wasm is designed as a portable compilation targetfor programming languages,enabling deployment on the web for client and server applications.https:/webassembly.org/Running full SQL-On Parquet-In the browserhttps:/ Future?Data SourcesIngestP

5、rocess,store,analyzeCRMERPCDPOperational DBsA bunch of Excels somewhereData continuumClientExplorationBIVisualizationflightData SourcesIngestProcess,store,analyzeCRMERPCDPOperational DBsA bunch of Excels somewhereData continuumClientExplorationBIVisualizationflight?https:/ MoreTHANK YOUhttps:/lakefs.io/https:/docs.lakefs.io/slack