PHP Classes

Web Crawler using MySQL DB: Retrieve Web pages and store links in a database

Recommend this page to a friend!
     
  Info   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStar 52%Total: 3,387 All time: 1,015 This week: 455Up
Version Licenses PHP version Categories
dbcrawler 1.0.0BSD License, GNU ...4.0HTML, Databases, Searching
Description 

Author

This class can be used to retrieve Web pages and store the URLs links in a MySQL database.

It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.

The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.

The class can also display in a Web page the list of URLs already stored from a given domain.

Picture of vivek
Name: vivek <contact>
Classes: 1 package by
Country: India India
Age: ???
All time rank: 94755 in India India
Week rank: 187 Up14 in India India Up

  Files folder image Files (4)  
File Role Description
Plain text file spider_advanced.class.php Class advanced spider
Plain text file spider_advanced_example.php Example advanced class example file
Accessible without login Plain text file spider_simple.class.php Class DBCrawler
Plain text file spider_simple_example.php Example example

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
 Version Control Unique User Downloads Download Rankings  
 0%
Total:3,387
This week:0
All time:1,015
This week:455Up
User Ratings User Comments (1)
 All time
Utility:75%StarStarStarStar
Consistency:75%StarStarStarStar
Documentation:-
Examples:75%StarStarStarStar
Tests:-
Videos:-
Overall:52%StarStarStar
Rank:2326
 
Warning: include(spider.
16 years ago (milo)
35%StarStar