I need to write a basic bot in PHP, which collects random urls from the internet to a database. Basically I need a bunch of random webpages. Any help would be appreciated! (I need it for work in a few weeks :/)
I need to write a basic bot in PHP, which collects random urls from the internet to a database. Basically I need a bunch of random webpages. Any help would be appreciated! (I need it for work in a few weeks :/)
so you want a web crawler to grab random URL's from random sites?
or you want a PHP script to grab all links off of certain pages?
The only true authority stems from knowledge, not from position.
You can contact me via matrix protocol: @grats:grats.win or you can email me at the same domain, any user/email address.
The only true authority stems from knowledge, not from position.
You can contact me via matrix protocol: @grats:grats.win or you can email me at the same domain, any user/email address.
You can also use VBSCRIPT with InternetExplorerApplication as well as SIMBA and or SCAR! they use gethttp and can easily read and grab links from text!
WHEN TEXTSEARCH.BAT WILL LOOK LIKECode:Set xmlhttp = CreateObject("MSXML2.ServerXMLHTTP") Set oWS = CreateObject("Shell.Application") xmlhttp.open "GET","http://CODEGURU.COM", false xmlhttp.send "" xmlhttp.waitForResponse() if xmlhttp.status = 200 then oWS.ShellExecute "TEXTSEARCH.BAT",CHR(34)&xmlhttp.responseText&CHR(34) else WScript.Echo("bad response") end if Set xmlhttp = nothing Set oWS = nothing
THOUGH BATCH CAPSULATING THE HTML IS TRIVIAL - THIS WILL OBVIOUSLY NOT WORK BUT IF IT DOES THEN ITS THE IDEACode:@ECHO OFF SET "HTML="%1"" ECHO "%HTML%" PAUSE
I've made a crawler in php for school tring to find the code atm.
There are currently 2 users browsing this thread. (0 members and 2 guests)