基于支持向量機技術(shù)的主題爬行策略研究

1、河北工業(yè)大學(xué)碩士學(xué)位論文基于支持向量機技術(shù)的主題爬行策略研究姓名：李春波申請學(xué)位級別：碩士專業(yè)：計算機應(yīng)用技術(shù)指導(dǎo)教師：牛存良20091101基于支持向量機技術(shù)的主題爬行策略研究iiRESEARCHONTHEMECRAWLINGSTRATEGYBASEDONSUPPTVECTMACHINETECHNOLOGYABSTRACTSearchengineisaveryactivetopicareasaroundthewldatanywhere

2、onthewldwecanseethesearchengine’spresence.NowsearchengineshasbecomeanimptantsupptofinfmationindustryWebcrawlerasanimptantcomponentofsearchenginedrawsmemeattentiononitself.Indertomeettheneedscomingfromdifferentbackgrounds

3、differentlevelsverticalsearchenginesfocusingoncertainsubjectcometothewldatthesametimethethemecrawlerbegantoemergecrawlerscrawlerscrawlingstrategiestailedtothesubjectofstudyisrisinggradually.Themecrawlingthroughtheapplica

4、tionofsupptvectmachinetechnologythispaperpresentsamehumanemeintelligentlystrategyofthemecrawlingfocusonthefollowing.1)Analyzingthethemecrawlersystemtotallyusingthesupptvectmachinetechnologythispaperrealizeathemecrawlerfo

5、cusingonthesubjectofnationalday.Throughmultithreadingtechnologytoincreasetheefficiencyofcrawlerscrawlingthroughthecrelationanalysistopreventstopthe“topicdrift“fromoccurringbygivingacertainwebpageunrelatedtothethemeof“exp

6、ectedvalue“totapits“potentialvalue“approachtopreventthecrawlerintoa“l(fā)ocalbestexcellentsolution“trouble.2)Thispaperpresentsastrategyofthemecrawlingbasedonsupptvectmachinetechnology.FirstlydownloadtheHTMLpagestolocalmachin

7、eusingvideobasedresultspageblockalgithmtodealwiththewebpagesdownloadedtothelocalmachineremovingtheadvertisinginfmationcopyrightinfmationother“noise“useSupptVectMachinetechnologytodistinguishthetextblockslinkblocksanalyzi

8、ngtherelationshipbetweenwebpagesthesubjectusethetrainedSupptVectMachinestoclassifytheWebpagedomeanalysisuntilthesystemterminated.InthispaperusingSupptVectMachinetechnologytorealizethethemecrawlingexperimentalresultsshowt