Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

php forms and database navigatio
Hello,
I'm new to php and i'd like to post the following.
I have written code to get records f

Best way to read this text file.
Hi.I am planning to make a small application in C# to convert the players from Football manager 2010

Dealing with code in db query
I am dealing with C code and I need to make sure it is encoded some how to ensure its integrity and

Weird Problem with curl while sending data
I am facing a weird problem with sending data to a site via curl.

If i send the value by this

Need help with basic sql
Hi,

I am using oracle 10g, and having some small doubts related to sql , here goes the si

Credit card verification
I have a client who wants to process credit card transactions from his web site rather than the goin

storing results of a function - previous result overwritten with new result
I have created a function to validate input.

function validate_dimension($value,$name) {
<

MySQL Does not UPDATE- SQLString Problem
vb Syntax (Toggle Plain Text) 1. SQL = "UPDATE sampletable SET column1 = 'C1sample1'"

help with mysql_error()
Hi,

I am trying to insert data into a table, but I am not able to insert it. I wanted to see

small inaccuracies
I have this code to convert fractional base 10 into base 2:

while($num > 0)