Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

how can i make a .gif images for my site
Dear Friends ,

Pls solve my problem , I am starting making new site but i dont know how can i

PHP Blog help
Need help with posting comments in a word press blog? I have a comments page where the comments are

Convert .fdf to .pdf
I currently have a web form that uploads the form data to an .fdf file and emails it.

However

Multidimensional array problems in $_POST
I'm having trouble with a three-dimensional $_POST array. It starts as a two-dimensional array on th

get the country of visitor and display content based on that
Hello all,

I have seen that Google analytics can tell you where a visitor is coming from and

Ajax Issues - Update Panel / Timer. Intellisense doesn't know about them
Type 'System.Web.UI.ScriptManager' does not have a public property named 'UpdatePanel'. That is wha

Open browser page depending on XML results
Hello,

I have some PHP code that sends webbased from data to an external url ( in the form of

please hep to get values from a table row
can anyone tel me how I can select and get data from one row by pressing an Edit button in that row

Searching keywords from array
Hello everyone, Im just wondering if someone could help me with another issue im having. Im still le

Check before inserting in DB ???
This is my code
---------------
if ( $_POST ['Submit'])
{{
$username = $_POST ['usernm