CDN加速镜像 | 设为首页 | 加入收藏夹
登陆 | 会员注册
当前位置： 首页 资源下载 源码下载 Internet/网络编程 网络截获/分析
收藏

文件名称:Java爬虫软件

  • 所属分类：
    网络截获/分析
  • 标签属性：
    [Java] [源码]
  • 上传时间：
    2019-09-17
  • 文件大小：
    6.54mb
  • 已下载：
    0次
  • 提 供 者：
    trope@sina.com
  • 相关连接：
    无
  • 下载说明：
    别用迅雷下载，失败请重下，重下不扣分！
修正介绍说明

介绍说明－－下载内容来自于网络，使用问题请自行百度

Java爬虫软件，爬取网站的URL后保存到Mongo数据库里面，并记录哪些爬过了，哪些没爬
(系统自动生成,下载前可以参看下载内容)

下载文件列表

压缩包 : Crawler4.zip 列表
Crawler/.classpath
Crawler/.project
Crawler/.settings/.jsdtscope
Crawler/.settings/org.eclipse.core.resources.prefs
Crawler/.settings/org.eclipse.jdt.core.prefs
Crawler/.settings/org.eclipse.wst.common.component
Crawler/.settings/org.eclipse.wst.common.project.facet.core.xml
Crawler/.settings/org.eclipse.wst.jsdt.ui.superType.container
Crawler/.settings/org.eclipse.wst.jsdt.ui.superType.name
Crawler/WebContent/Index.jsp
Crawler/WebContent/JS/jquery-1.8.0.js
Crawler/WebContent/META-INF/MANIFEST.MF
Crawler/WebContent/WEB-INF/lib/assertj-core-1.5.0.jar
Crawler/WebContent/WEB-INF/lib/commons-codec-1.6.jar
Crawler/WebContent/WEB-INF/lib/commons-collections-3.2.1.jar
Crawler/WebContent/WEB-INF/lib/commons-io-1.3.2.jar
Crawler/WebContent/WEB-INF/lib/commons-lang-2.6.jar
Crawler/WebContent/WEB-INF/lib/commons-lang3-3.1.jar
Crawler/WebContent/WEB-INF/lib/commons-logging-1.1.3.jar
Crawler/WebContent/WEB-INF/lib/commons-pool-1.5.5.jar
Crawler/WebContent/WEB-INF/lib/fastjson-1.1.37.jar
Crawler/WebContent/WEB-INF/lib/guava-15.0.jar
Crawler/WebContent/WEB-INF/lib/hamcrest-core-1.3.jar
Crawler/WebContent/WEB-INF/lib/httpclient-4.3.3.jar
Crawler/WebContent/WEB-INF/lib/httpcore-4.3.2.jar
Crawler/WebContent/WEB-INF/lib/jedis-2.0.0.jar
Crawler/WebContent/WEB-INF/lib/json-path-0.8.1.jar
Crawler/WebContent/WEB-INF/lib/json-smart-1.1.1.jar
Crawler/WebContent/WEB-INF/lib/jsoup-1.7.2.jar
Crawler/WebContent/WEB-INF/lib/junit-4.11.jar
Crawler/WebContent/WEB-INF/lib/log4j-1.2.17.jar
Crawler/WebContent/WEB-INF/lib/mongo-2.7.2.jar
Crawler/WebContent/WEB-INF/lib/slf4j-api-1.7.6.jar
Crawler/WebContent/WEB-INF/lib/slf4j-log4j12-1.7.6.jar
Crawler/WebContent/WEB-INF/lib/webmagic-core-0.5.2.jar
Crawler/WebContent/WEB-INF/lib/webmagic-extension-0.5.2.jar
Crawler/WebContent/WEB-INF/lib/xsoup-0.2.4.jar
Crawler/WebContent/WEB-INF/web.xml
Crawler/build/classes/crawler.properties
Crawler/build/classes/log4j.xml
Crawler/build/classes/mongo.properties
Crawler/build/classes/pers/ghost/mongo/dao/AbstractBaseMongoTemplete.class
Crawler/build/classes/pers/ghost/mongo/dao/MongoCrawerHtmlDao.class
Crawler/build/classes/pers/ghost/mongo/dao/MongoCrawerUrlDao.class
Crawler/build/classes/pers/ghost/mongo/dao/MongoCrawerUrlStatusDao.class
Crawler/build/classes/pers/ghost/url/bean/CrawlerResult.class
Crawler/build/classes/pers/ghost/url/bean/UrlResult.class
Crawler/build/classes/pers/ghost/url/configure/CrawlerConfiguration.class
Crawler/build/classes/pers/ghost/url/configure/MongoConfiguration.class
Crawler/build/classes/pers/ghost/url/crawler/Crawler.class
Crawler/build/classes/pers/ghost/url/crawler/DownLoadFilePipeline.class
Crawler/build/classes/pers/ghost/url/crawler/StopQueueScheduler.class
Crawler/build/classes/pers/ghost/url/crawler/UrlCrawlerProcessor.class
Crawler/build/classes/pers/ghost/url/crawler/UrlDisplayProcessor.class
Crawler/build/classes/pers/ghost/url/crawler/UrlDownLoadProcessor.class
Crawler/build/classes/pers/ghost/url/server/CrawlerServer.class
Crawler/build/classes/pers/ghost/url/server/CrawlerStopServer.class
Crawler/build/classes/pers/ghost/url/server/CrawlerUrlGetServer.class
Crawler/build/classes/pers/ghost/url/utils/UrlRegex.class
Crawler/config/crawler.properties
Crawler/config/mongo.properties
Crawler/error.log
Crawler/resource/log4j.xml
Crawler/src/pers/ghost/mongo/dao/AbstractBaseMongoTemplete.java
Crawler/src/pers/ghost/mongo/dao/MongoCrawerHtmlDao.java
Crawler/src/pers/ghost/mongo/dao/MongoCrawerUrlDao.java
Crawler/src/pers/ghost/mongo/dao/MongoCrawerUrlStatusDao.java
Crawler/src/pers/ghost/url/bean/CrawlerResult.java
Crawler/src/pers/ghost/url/bean/UrlResult.java
Crawler/src/pers/ghost/url/configure/CrawlerConfiguration.java
Crawler/src/pers/ghost/url/configure/MongoConfiguration.java
Crawler/src/pers/ghost/url/crawler/Crawler.java
Crawler/src/pers/ghost/url/crawler/DownLoadFilePipeline.java
Crawler/src/pers/ghost/url/crawler/StopQueueScheduler.java
Crawler/src/pers/ghost/url/crawler/UrlCrawlerProcessor.java
Crawler/src/pers/ghost/url/crawler/UrlDisplayProcessor.java
Crawler/src/pers/ghost/url/crawler/UrlDownLoadProcessor.java
Crawler/src/pers/ghost/url/server/CrawlerServer.java
Crawler/src/pers/ghost/url/server/CrawlerStopServer.java
Crawler/src/pers/ghost/url/server/CrawlerUrlGetServer.java
Crawler/src/pers/ghost/url/utils/UrlRegex.java

相关说明

  • 本站资源为会员上传分享交流与学习,如有侵犯您的权益,请联系我们删除.
  • 搜珍网是交换下载平台，只提供交流渠道，下载内容来自于网络，除下载问题外，其它问题请自行百度。更多...
  • 本站已设置防盗链，请勿用迅雷、QQ旋风等下载软件下载资源，下载后用WinRAR最新版进行解压.
  • 如果您发现内容无法下载，请稍后再次尝试；或换浏览器；或者到消费记录里找到下载记录反馈给我们.
  • 下载后发现下载的内容跟说明不相乎，请到消费记录里找到下载记录反馈给我们，经确认后退回积分.
  • 如下载前有疑问，可以通过点击"提供者"的名字，查看对方的联系方式，联系对方咨询.
查看所有评论

相关评论

暂无评论内容．

发表评论

*快速评论： 推荐 一般 有密码 和说明不符 不是源码或资料 文件不全 不能解压 纯粹是垃圾
*内　　容：
*验 证 码：
搜珍网 www.dssz.com