2. Flink Forward SF 2020 - Splunk数据基础架构的演变.pdf

1、2020 SPLUNK INC. The Evolution of Data Infrastructure at Splunk Flink Forward SF/Virtual 2020 Eric Sammer - VP, Distinguished Engineer 2020 SPLUNK INC. What is Splunk? A platform for the collection, storage, query, and analysis of event and time series data. Logs, but other kinds of events too Tons

2、of query-time processing features Core platform experience, increasingly domain-specific applications 2020 SPLUNK INC. Ad hoc query - Human and apps Scheduled query - Materialized view maintenance, app processes, alerting Realtime query - Ad hoc (“Live tail”), app processes Classes of Workload 2020

3、SPLUNK INC. + 2020 SPLUNK INC. two and a half years ago. 2020 SPLUNK INC. Connector Agent Indexer Pipeline Index All data lands in an index Index 2020 SPLUNK INC. Index Index QueryApplication Applications and platform services use scheduled queries to build views or process data Query ViewApplicationQuery 2020 SPLUNK INC. Challenges Latency Polling query workload overhead - View maintenance, aler