文件名称:spider2006
-
所属分类:
- 标签属性:
- 上传时间:2012-11-16
-
文件大小:31kb
-
已下载:1次
-
提 供 者:
-
相关连接:无下载说明:别用迅雷下载,失败请重下,重下不扣分!
介绍说明--下载内容来自于网络,使用问题请自行百度
可配置:线程数、线程等待时间,连接超时时间,可爬取文件类型和优先级、下载目录等。
状态栏显示统计信息:排入队列URL数,已下载文件数,已下载总字节数,CPU使用率和可用内存等。
有偏好的爬虫:可针对爬取的资源类型设置不同的优先级。
健壮性:十几项URL正规化策略以排除冗余下载、爬虫陷阱避免策略的使用等、多种策略以解析相对路径等。
较好的性能:基于正则表达式的页面解析、适度加锁、维持HTTP连接等。
-C# spider.
状态栏显示统计信息:排入队列URL数,已下载文件数,已下载总字节数,CPU使用率和可用内存等。
有偏好的爬虫:可针对爬取的资源类型设置不同的优先级。
健壮性:十几项URL正规化策略以排除冗余下载、爬虫陷阱避免策略的使用等、多种策略以解析相对路径等。
较好的性能:基于正则表达式的页面解析、适度加锁、维持HTTP连接等。
-C# spider.
(系统自动生成,下载前可以参看下载内容)
下载文件列表
spider_demo
spider_demo/spider_demo.sln
spider_demo/spider_demo.suo
spider_demo/spider_demo
spider_demo/spider_demo/base64.cs
spider_demo/spider_demo/workThread.cs
spider_demo/spider_demo/spider_demo.cs
spider_demo/spider_demo/spider.cs
spider_demo/spider_demo/spider_demo.csproj
spider_demo/spider_demo/spider_demo.Designer.cs
spider_demo/spider_demo/Listener.cs
spider_demo/spider_demo/spider_demo.resx
spider_demo/spider_demo/bin
spider_demo/spider_demo/bin/Release
spider_demo/spider_demo/bin/Release/WebRegex.dll
spider_demo/spider_demo/bin/Release/html
spider_demo/spider_demo/bin/Release/yy.txt
spider_demo/spider_demo/bin/Debug
spider_demo/spider_demo/bin/Debug/WebRegex.dll
spider_demo/spider_demo/bin/Debug/yy.txt
spider_demo/spider_demo/bin/Debug/html
spider_demo/spider_demo/obj
spider_demo/spider_demo/obj/spider_demo.csproj.FileList.txt
spider_demo/spider_demo/obj/Release
spider_demo/spider_demo/obj/Release/TempPE
spider_demo/spider_demo/obj/Release/TempPE/Properties.Resources.Designer.cs.dll
spider_demo/spider_demo/obj/Release/Refactor
spider_demo/spider_demo/obj/Debug
spider_demo/spider_demo/Properties
spider_demo/spider_demo/Properties/AssemblyInfo.cs
spider_demo/spider_demo/Properties/Resources.resx
spider_demo/spider_demo/Properties/Resources.Designer.cs
spider_demo/spider_demo/Properties/Settings.settings
spider_demo/spider_demo/Properties/Settings.Designer.cs
spider_demo/spider_demo/HtmlAnalyzer.cs
spider_demo/spider_demo/GetHtml.cs
spider_demo/spider_demo/Program.cs
spider_demo/readme.txt
spider_demo/spider_demo/CRC.cs
spider_demo/spider_demo.sln
spider_demo/spider_demo.suo
spider_demo/spider_demo
spider_demo/spider_demo/base64.cs
spider_demo/spider_demo/workThread.cs
spider_demo/spider_demo/spider_demo.cs
spider_demo/spider_demo/spider.cs
spider_demo/spider_demo/spider_demo.csproj
spider_demo/spider_demo/spider_demo.Designer.cs
spider_demo/spider_demo/Listener.cs
spider_demo/spider_demo/spider_demo.resx
spider_demo/spider_demo/bin
spider_demo/spider_demo/bin/Release
spider_demo/spider_demo/bin/Release/WebRegex.dll
spider_demo/spider_demo/bin/Release/html
spider_demo/spider_demo/bin/Release/yy.txt
spider_demo/spider_demo/bin/Debug
spider_demo/spider_demo/bin/Debug/WebRegex.dll
spider_demo/spider_demo/bin/Debug/yy.txt
spider_demo/spider_demo/bin/Debug/html
spider_demo/spider_demo/obj
spider_demo/spider_demo/obj/spider_demo.csproj.FileList.txt
spider_demo/spider_demo/obj/Release
spider_demo/spider_demo/obj/Release/TempPE
spider_demo/spider_demo/obj/Release/TempPE/Properties.Resources.Designer.cs.dll
spider_demo/spider_demo/obj/Release/Refactor
spider_demo/spider_demo/obj/Debug
spider_demo/spider_demo/Properties
spider_demo/spider_demo/Properties/AssemblyInfo.cs
spider_demo/spider_demo/Properties/Resources.resx
spider_demo/spider_demo/Properties/Resources.Designer.cs
spider_demo/spider_demo/Properties/Settings.settings
spider_demo/spider_demo/Properties/Settings.Designer.cs
spider_demo/spider_demo/HtmlAnalyzer.cs
spider_demo/spider_demo/GetHtml.cs
spider_demo/spider_demo/Program.cs
spider_demo/readme.txt
spider_demo/spider_demo/CRC.cs
本网站为编程资源及源代码搜集、介绍的搜索网站,版权归原作者所有! 粤ICP备11031372号
1999-2046 搜珍网 All Rights Reserved.