搜索资源列表
spider
- 本系统为简易网络爬虫,输入初始url,系统自动在网上搜索网页信息,并记录下来做为搜索引擎的数据.-The system for the Simple Network reptiles, enter the initial url, system automatically searches the Web page information, and record data as a search engine.
doSearch
- 改写的小爬虫，希望大家多提意见，怎样使它下载的网页解析得更好-Rewrite small reptiles, I hope everybody do so, how to download web pages to make it a better analysis
content_abstract
- 针对高校教师的个人网页的源文件进行的正文提取，也可应用于一般的网页的正文提取。-Colleges and universities for their personal web page of the source file to extract the body, but also can be applied to the general body of the page extraction.
UTF-8andGB2312
- 这是一种网页编码转换的方法。很实用的,希望大家工同学习。-This is a web transcoding methods. Very practical, and hope that we work with the study.
gekhtml
- 基于ekhtml,自动提取网页正文，将提取出来的title,author,正文text, 文章发布的时间存入mysql数据库.-Based on ekhtml, Automatic extraction of web page text, will be extracted out of the title, author, body text, the article published time into mysql database.
ROSTDM
- 网页文本抓取，通过设置XML可以批量抓取任意网站的任意数据-Web text crawl, crawl any website any data volume by setting XML