2019年Kubernetes日志平台建设最佳实践.pdf

《2019年Kubernetes日志平台建设最佳实践.pdf》由会员分享，可在线阅读，更多相关《2019年Kubernetes日志平台建设最佳实践.pdf（27页珍藏版）》请在三个皮匠报告上搜索。

1、?-?3?1?G?9?2?2?2?0D?T?O?LP?B?AP?/P?I?Kubernetes?&?Kubernetes?KubernetesKubernetes?/?Stdout?EventJournalIoT?100W*1M=1TB100W*1%=10000?SAAS?LogReduce?:16PB+?:40?+?Logtail?:200W+?CPU?1.6%?43MB?Kubernetes?8W+?10?+?5PB+?1?DaemonSet or Sidecar?DaemonSet?PASS?SidecarDaemonSetSidecar?2?/app/data/logsSidecar?

2、40?40GB SSD 5W?2PB SSD?3?M?b?kP?iLogtail?J?D?A?C?B?CB?h?f?Ak?k?Cuh?Gvn?a?b?uh?Fkvn?Fk?S?vn?b?f?k?B?o?ts?C?lp?lp?lp?o?bo?m?e?r?ce?PB?grepgreppgm awk sed egrep1GB1TBpsshA and B or(C and D)?order.value 10 and status:ok?1PB?Session?TraceId?SQL92?/?JoinJoin?IPIP?(1/2)?Ingress?90%?Service?A/B Test?10S?Ser

3、vice?Service?B?A AInIn A ARatioRatioID=10029568%ID=1002 Method=Get8074%ID=1002 Method=Get IP=1203434037%ID=10032019%B BA AInIn A ARatioRatioInIn B BRatioRatioID=10029568%1003%ID=1002 Method=Get8074%1003%ID=1002 Method=GetIP=1203434037%2507.5%ID=10032019%50015%?(2/2)?+?OSSHybrid Storage ArrayMassive

4、Structured,Unstructured&Semi-structured DataSQL?NoSQLLog Service/LogShipperMobile&WebIoTMobileLogsWebText&LogsServices&LanguagesIoT&DevicesCamera?Log Service/LogHubReal-time Data Stream?VisualizationQuickBIDataVLog Service/Dashboard?Stream ProcessingSparkStreamingFunction ComputeHadoopHIVEBig Data A

5、nalyticsBatch ProcessingPigPAIMaxComputeEMRInteractive AnalyticsDLALog Service/Analytics?FlinkStorm?AuditIngressMeshEventHPAKubernetes?Mesh?Stdout?EventDaemonSetSidecarAppenderJournal?1-3?/?1-?PAAS?R?R?I?I?DCS?DCS?I?c?I?c?Mesh/Trace?Ingress?ServiceMesh?Ingress?dada?+?0?+?0e?e?+?+1?+?+1?e?A?e?A?B?B?API?SLS?API?Trace?2-?Trace?FUSE?All in DaemonSet?Automation?ITOps?