Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

TemplatePower & AJAX
Hi all,



I'm currently implementing some AJAX features in my PHP-framework (which is b

Querying info from one table based on info in another
Hi, I am currently trying to make a part for my user driven website where one user can subscribe to

Javascript using window.location seems to lose state
Not sure what forum so let me know if I'm in the wrong place. I have a main window with a ajax grid

Displaying image pathname instead of image
Hello

Im trying to upload and then display images from a mysql database - Its only basic and

single page with referrer to show correct page
I have a simple website with a couple of different pages. I would like to be able to in a div tag w

include
Hi I have this way of licensing my PHP application, and I want to know if you guys can answer some q

Help with syntax
Hi all!

The $bridge variable is not getting passed while it is contained in the line below:

want to add a break after a certain amount of characters
i was wondering how to add a break in a blog post after a certain amount of characters... any idea o

Date Question
I'm using the TIMESTAMP() function within mysql to set the date/time for certain events. However, ho

Email Form Syntax Issue
I need the TO: in email to display To: CEO instead of To: abc@mail.com

How to alter the scri