基于多Agent系統(tǒng)的主題爬蟲理解與協(xié)作研究.pdf

1、西華大學(xué)碩士學(xué)位論文基于多Agent系統(tǒng)的主題爬蟲理解與協(xié)作研究姓名：王瑩煜申請學(xué)位級別：碩士專業(yè)：計算機(jī)軟件與理論指導(dǎo)教師：杜亞軍20100501AbstractTheMultiAgentsystem(MAS)isakindoftechnologytoachievecertainsystemtargetsortosolvesomeproblemsinlargescaleusingthecharacteristicsofAgentmau

2、tonomy，flexibility，interactionandotherfeaturesInMAS，communicationisthebaseofcooperationandnegotiationamongagentsHowever，differentAgentwhichstandsindifferentplatformorholdsdifferentknowledgeandbackgroundalwayshasdifferent

3、messageformatordifferentunderstandingsontheconceptsandstructuresinthemessagecontentThesedirectlyleadtotheconfusioninAgentcommunicationTherefore，theAgentsneedtoshareknowledgeandunifythemessageformatAgentcommunicationbased

4、onOntologyandFormalConceptAnalysis(FCA)isamethodpointedoutregardingtheproblemsaboveItcanstrengthenAgent’Ssemanticunderstandingonmessagecontentandincreasetheefficiencyofcommunicationandcooperation，accordinglyenhancethereu

5、sability，interoperationandreliabilityofthesoftwareWiththerapiddevelopmentoftheInternet，generalpurposewebcrawlerbecomesmoreandmorepowerlessonextractingthewebinformationefficientlyandeffectivelyfromthemountainsofthenetwork

6、However，theTopic—specificcrawlersolvethescalabilitylimitseffectivelytogatheronlyparticularpagesrelatedtospecifictopic，whichcanguidethecrawlURLlinksandextractthelandingpageswithhighlyrelevantcontentThispaperpresentsaTopic

7、—specificcrawlermodelbasedonMASandtriestocalculatetheunderstandingbetweenAgentCrawlersreliesonOntologyandFCABycalculatingthesimilaritybetweenconceptandconcept，conceptandAgent，AgentandAgenttomeasurethedegreeofunderstandin

8、g，itsapplicationinthethemebasedonMAStoguidethecrawlingreptilesThispapermainlysummarizedasfollows：1ThispaperpresentsanewmethodtomeasuretheunderstandingamongWebCrawlersBasedonMASWhencalculatethesimilaritybetweentheconcepts

9、oftheIntelligenceAgentCrawlers，notjustnaturallanguagecomparisonbetweenwords，butalsoconsidertheuseofontologyanditssemanticrelationshipsThatisextendingtheextensionoftheconcepttothevariouslinksrelationsbetweenpagesandadding

10、thesemanticofontology，suchassynonymous，equal，Is—AandPartofetctotheconnotationoftheconceptBesides，itconsiderstheleveloftheconceptlatticetothesimilarityTosomeextents，itcaneliminatetheambiguityofnaturallanguageandimprovethe

11、accuracyofunderstanding2AtopicspecificcrawlermodelbasedonMASWasdesignedandimplementedontheJADEplatformbasedonit，usingthemodifiedcontractnetprotocolsimulationofmultiAgentcoordinationFinally，usingthewebtestsetstoevaluateth