文本過濾技術(shù)的研究和實(shí)現(xiàn).pdf

1、復(fù)旦大學(xué)碩士學(xué)位論文文本過濾技術(shù)的研究和實(shí)現(xiàn)姓名：胡恬申請學(xué)位級別：碩士專業(yè)：計算機(jī)應(yīng)用技術(shù)指導(dǎo)教師：吳立德20030420Abs仃actAbstractTherapidIntemetgrowthwitnessesthebloomingoftheresearchworkinthefieldofInformationFilteringThispaperintroducestheframeworkandcomponentsofanInfor

2、mationfilteringststem—FDFilterwhichtheauthorjoinedtoimplementedindetailsThesystemattendstheTRECIOFilteringBenchmarktestandachievesthetopthreeinthecompetitionAfterthetheoreticdiscussionoftheInformationFilteringtechniquesi

3、nChapter2，theauthordiscussestheimportantcomponentsofafilteringengineincludinggainingstateandselfadjustfilteringstateInChapter3，theauthorfocusesonhowtocreatetheinitialfilteringprofileandsettheinitialthreshold，andhowtomaxi

4、mallyutilizethetopicdescriptionAfterstudyingthetopicdescriptioncarefullytheauthorimplementsawinnow—basedmethod，inwhichawinnowclassifierfromthedescriptionandnarrativefieldsisconstructed，andthenutilizedtoassistouradaptivef

5、ilteringsystemIntheChapter4，moreattentionWaspaidontheprofileandthresholdadjustmentalgorithm，TheRocchioalgorithmwasappliedtoadjusttheprofileTheexperimentshowstheRocchioalgorithmisveryefficientinprofileadjustingThresholdad

6、justingisanotherimportantstageinadaptivetextfilteringItisalsoverydifficultfortherearefewpositivesamplesfortrainingandsparsedatawhilefilteringTheauthorappliedaprecision—orientedalgorithmtothefilteringsystemTheprecision—ba

7、sedalgorithmmakesuseoftheinformationsuchastheprecisionandaveragesimilaritytoadjustthethresholdThisalgorithmhasthemeritsofusingfewpositivesamples，adjustingfastandhighperformanceIntheChapter5，introduceddatastructureandalgo

8、rithmthatusedinsomemoduleofFDFilterincludingcorpusformationprocess，featureselectionandindexbuildThentheauthorgivestheexperiment013bothEnglishcorpusandChinesecorpusTheresultisinspiringandindicatesoursystemhavereachedadvan