Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

Number Format
Hi All,

I have number '000000000050085' I want to format it to 500.85 Can any one give me

Display search result
Hi!

I have a SQL database with information about albums and track (music).

This is wh

use an array from 1 class in a second class
I have a class that adds data to an array

Then I have a second class and I need to check if t

that old Malformed Headers problem again!!!!! HELP!!!!!!
I've read the http://www.phpfreaks.com/forums/index.php/topic,37442.0.html

I don't think my c

weeks in a year
hi,

i found this snippet on php.net
QuoteFor the week number for weeks starting on Sunday:

Upload simple problem
Really confused!! I run once and it worked, but when i tried today...it didn't work

Which par

Upload Code Help
Hi everyone I need some help with a bit of code ive been working with for a while. I am completely s

Open browser page depending on XML results
Hello,

I have some PHP code that sends webbased from data to an external url ( in the form of

weird problem
last time, i did post a topic concerning why my page sometime will load as blank page when using IE.

string to currency format
Hi guys...

Actually I chunk out some data from txtfile and one of the data contains amount va