Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

rand() function
just a general question guys a girls, is the rand() function 100% random or is it based on time?

Newb advice
Hi all,

I'm a flash front end designer and I've taken on a project that needs some back end p

Login Issue's
Code: <?php
$file = fopen('user.txt', 'r');

/* Set login to false initially */

Inserting 100x and 100y coordinates in mysql table - easy
Is there a way to insert this data into a mysql table named 'map' with the fields: 'x int 3' , 'y in

Not reloading page after php form submit
Hello helpful souls out there. You guys have come through for me in the recent past and I'm hoping s

TinyMCE / Ajax Postback Problem
Hiya all,

I have a page which loads the TinyMCE editor. On the postback I obviously want to f

help, header() is not working!
Hello, I have this code:


<?php

/**
* @author samoi
* @copyright 200

Thought I has this figured out especially after all the help i received?
Cags, Salathe, Daniel helped me with this yesterday, but not sure i took it all in.
I am attempti

Include a php
Hello,

I'm trying to include a function that shows the recent searches.
Example I have <

$variable = $variable
Hello

Sorry if this is a really simple question but I have run out of ideas. Is there a reall