URL 查找：回顾、进展和未来计划.pdf

1、Hessisches Statistisches LandesamtURL finding:looking back,progress and plans for the futureWeb Intelligence Network Conference04.02.2025Heidi KhnemannStatistics Hesse2Hessisches Statistisches Landesamt URL finding in a nutshell What has been done(during the WIN):URL finding methodology reportWP 2 O

2、BEC annotation exercise Browser comparison(at Statistics Hesse)Plans and ideas for the futureOutline3Hessisches Statistisches LandesamtAutomated procedure to identify enterprise websites,usually containing these steps:sending search terms to a search engine,scraping the result URLs,extracting the re

3、levant information from the scraped data and applying a machine learning or rule-based model to link websites to enterprisesURL finding in a nutshell4Hessisches Statistisches LandesamtURL finding at the WIN:cooperation of WP 2 OBEC&WP 3 UC 5 Both WPs use enterprise websites as starting pointOBEC:cla

4、ssifiy online shops,social media presence,from enterprisewebsites for new indicatorsUC 5:classify economic activity codes and extract contact informationfrom enterprise websites to enhance the business registerCommon methodology report on URL findingSystematic collection of experiences and practical

5、 advice toimplement URL finding5Hessisches Statistisches LandesamtSome challenges with URL finding URL finding not possible on the WIH Scraping search engine result URLs is costly(e.g.storage,processingcapacities)URL finding is a difficult task,eg.because:o many to many relationship between enterpri

6、ses and websiteso Not all websites with enterprise data are the correct websiteso SBR data and website data are not always identical Despite all this:satisfactory accuracy of URL finding6Hessisches Statistisches LandesamtWP 2 OBEC:Manual creation of evaluation dataAnnotation exercise for URL finding