1、OPENSEARCH FOR THE PRODUCTIVITYWIN;FOSTERING ADOPTION ACROSSTEAMSMarisa Strong,Development Team ManagerTerry Brady,So?ware Developerhttps:/ WE ARE1.2CALIFORNIA DIGITAL LIBRARYCDL provides transformative digital library services,partnering both with UC campuses and externalcollaborators,we amplify th
2、e impact of the libraries,scholarship,and resources of the University ofCalifornia.1.3CDL HAS 4 ACTIVE PROGRAMS:Publishing&Special CollectionsDiscovery&DeliveryCollections&LicensingUC Curation Center(UC3)1.4UC3The mission of University of California Curation Center(UC3)is to provide transformative p
3、reservation,curation,and research data management systems,services,and initiatives that sustain and promote openscholarship.1.5UC3 ARCHITECTURE1.6UC3 3RD PARTY APPLICATIONS2BACKGROUND3.1THE LOG4J INCIDENTRaised the priority to improve our logging systems tobe able to patch and address security vulne
4、rabilitiesinconsistent logging across our microservicesdistributed environment3.2LOGGING NEEDSFind specific error events in logsCalculate metricsDiscover unreported errors3.3Join #8557 277Join at#8557 277slido com3.4WHY OPENSEARCHFOR LOGS?4.1NEED FOR CONSOLIDATEDLOGGINGCDL had SplunkDevelopment team
5、s did not have accessCDL is an AWS shopOpenSearch is the AWS solution for logs4.2WHAT ISOPENSEARCH?5.1AN OPEN SOURCE FORK OFELASTICSEARCHhttps:/opensearch.org/5.2ELASTIC(CORPORATION)CREATED ELASTICSEARCHhttps:/www.elastic.co/5.3ELASTICSEARCHSearch engine built on Apache LuceneNoSQL databaseIndexing
6、JSON documentsCore to the ELK stack5.4ELK STACKElasticsearch(search engine)Logstash(file ingestion)Kibana(web interface)https:/ AND AWSConflict:Elastic vs AWS2021Elastic changed the licensing for Elasticsearchand KibanaAWS created OpenSearch2024Elastic changed the license again in 20245.6OPENSEARCH-