首页> 外国专利> ONLINE INTERNET TOPIC MINING METHOD BASED ON IMPROVED LDA MODEL

ONLINE INTERNET TOPIC MINING METHOD BASED ON IMPROVED LDA MODEL

机译:基于改进LDA模型的在线互联网主题挖掘方法

摘要

Disclosed is an online Internet topic mining method based on an improved LDA model. The method corresponds to a continuous and streaming type topic mining process conducted in a segmented mode, n web pages are processed each time, and these web pages are usually acquired by web crawlers from the Internet in an online and real-time mode, and mining results of the contents of these web pages generate k topics. After current n web pages are processed, newly acquired n web pages are continuously processed through the process. The process mainly comprises initialization of On-LDA model hyper-parameters, dynamic updating of the On-LDA model hyper-parameters, Internet topic mining based on the On-LDA model and the like. By means of the present invention, the assignment method and effect of use in respect to the hyper-parameters and of a traditional LDA model in the topic mining process are radically changed. Classified information to which the web page contents belong is fully utilized to assign initial values to the model hyper-parameters, so that the initial values of the hyper-parameters completely depend on the web page contents to be mined, and the computing process is simplified and rationality is achieved.
机译:公开了一种基于改进的LDA模型的在线互联网主题挖掘方法。该方法对应于以分段模式进行的连续流式主题挖掘过程,每次处理n个网页,这些网页通常由网络爬虫以在线和实时方式从互联网获取,并进行挖掘。这些网页的内容的结果产生了k个主题。在处理当前的n个网页之后,通过该过程连续处理新获取的n个网页。该过程主要包括On-LDA模型超参数的初始化,On-LDA模型超参数的动态更新,基于On-LDA模型的Internet主题挖掘等。通过本发明,在主题挖掘过程中,针对超参数和传统LDA模型的分配方法和使用效果发生了根本变化。充分利用网页内容所属的分类信息为模型超参数分配初始值,从而使超参数的初始值完全依赖于要挖掘的网页内容,简化了计算过程。并达到合理性。

著录项

  • 公开/公告号WO2017035922A1

    专利类型

  • 公开/公告日2017-03-09

    原文格式PDF

  • 申请/专利权人 YANG PENG;

    申请/专利号WO2015CN92047

  • 发明设计人 LU YUNCHENG;DONG YONGQIANG;

    申请日2015-10-16

  • 分类号G06F17/30;

  • 国家 WO

  • 入库时间 2022-08-21 13:31:55

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号