Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

Php navigation
I have four buttons on a php page.
If i click a button it will redirect to different php pages.

mod_rewrite.c on windows ??
why it's not working on windows while it's working on other hosts???

this is the code i got

search function
HI guys,

if anyone could point us in the right direction of how to do this, or provide some t

building a function with multiple outputs
I want to build a function that has multiple outputs.

I know but am not to sure how I should

Creating a function
Basically i wanna put all this code in a seperate file

Code: <?php

How to load mysql (and other) extensions into PHP
How to load mysql (and other) extensions into PHP PHP Development forum discussing coding practices,

add 20 000 to the rowcnt
Hi ...
I need to add 20 000 to the row count but just cant find a way to do this i am new to php

upload only text files
hi guys i want to upload only text like like (pdf,note pad and ofiice files) so can any one please t

php mysql script to find record
Hi,

Currently I have a simple table with 4 columns. A, B, C, D

If I want to find all

Writing Windows Device Drivers with C
Yes: one of the nice features of C is void*. You can put anything there and get anything out. Very