Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

PHP & Java
Hello,

can PHP code be used inside java code?

Code: [Select]<SCRIPT LANGUAGE=&q

Calling All PHPFREAKS Blackberry Users
Are you a member of PHPFreaks and have a blackberry? Well RIM just recently released Blackberry Mes

Backflush
I am looking for a report in SAP that would give me a list of all parts that are populated with a ba

timed header image rotation
I have a joomla site and I was trying to setup a rotating image based on timing NOT just refreshing

Word Trimming
Hi Guys & Gals!!

Hope you are all ok....

I need some help with the following

Production Order Enterprise Service to Manufacturing Exctn Sys (MES) ???
Hello Experts,

In our current landscape SAP ECC 5.0 is integrated to MES system via PI 7.

Custom CMS
This is a big custom CMS script I'd like to develop and would like some help atleast figuring out wh

do while...woes
I'm sure this is childsplay but it is stumping me, everytime i try what I think would make this work

ScriptResource.axd gives an error on fresh install of ASP.NET Ajax 1.0
Hello,I have a fresh install of Microsoft ASP.NET Ajax 1.0. When I create an Ajax enabled website in

Lining up columns nicely.
Hello everyone, I'm having problems with making columns line up properly. Here is my code: