Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

Multidimensional Array into an Html table, help!
Hello all, I am new to HTML/PHP so any help would be great.

I have a multidimensional array f

Recognising Revenue daily
Hello.
Has anyone come across daily recognition of deferred income?
We want to implement R

Creating web pages by php
Hello again,
I was just wondering us there a way to use a php script to create a new web page. I

Embedding flash object in Else statement
This is my first major project in PHP and I'm having some trouble embedding a flash object in an Els

PHP url branch??
Functionally, using PHP, I'm doing a test of login input submitted by a user via an html form in a f

IS Retail & Manufacturing
Hi

Can IS Retail and Manufacturing activities be done in same instance ie. in same client

Slow data retrieval which requires improvement..please help
I am working on a Help Desk Ticketing system and have a page called MY TICKETS which shows all ticke

if statements problems
Hi. I'm trying to make a web form, but I kind of hit a dead end trying to figure out why it doesn't

WELCOME SCREEN
first of all let me tell you what does my script do,

it´s a very simple query to show a e

cyrillic string conversion question
Hello,

First time here...

I would like to know if there is a way to convert a