Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

difference between datetimes
($row['totime']-$row['fromtime'])/60

this is giving me 0

example of totime and fromtim

Help with setcookie()
Merry Xmas to those on this foruum
Older guy here with some experience but not allot so please be

array empty
Hiya peeps,

Ok here is the codes.

order.php

Code:

Preg_match with an array
is there an away to use preg_match with an array?

i want to check a string with an array to s

problem with array - multilingual page
this is my test page :
Code: <?php
if(isset($_GET['lang'])) {
if($_GET['la

php multiple action on submit
I have a form which says:

<form enctype='multipart/form-data' method='post' action='pr

Stumped by Third Day of Month problem
I am trying to build an algorithm that will essentially do this:
Code: [Select]$this_month = Oct

Running External Scripts
I am very new to PHP and am not even sure what I'm asking is possible. I have just installed mediaW

Need help in log in and log out?
hi there all of u. i have recently created a site for someone. i have placed log in and log out and

restricting another login once you logout
Hello,

how can I restrict a page from login authenticating against info in a MySQL DB for a s