Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

curl javascript problem
Hi Experts.
I'm new curl and wanna to get some info from this http://www.amadeus.net/

when

ORA-01017: invalid username/password; logon denied
Dear All,

I am facing problem in taken backup from db13 it comes up with the following l

having a small php error tha deals with the 'foreach'
Last night i was working on a script for a cart and it seemed to working good, until this morning. F

While Problem
i am having a problem with a while statement here is the code
Code: [Select]<?php
sess

remove trailing slash from array
I have the following array which contains trailing slashes I need to remove. What is the best way to

array ...
hi
Code: function formatCategories($categories, $parentId)
{
// $navCat stores all child

Multidimensional $_POST
Hello

How to get a single array from array of array (2 - dimension).
For example I have a

Basic Question about Threading and PHP...
I have a page that I am working on and it is taking several hours to process. The basics of what th

Help with echo()
I'm having some problems with this code:

Code: echo '
<A HREF="jav

Blank record injected into database
I always found several blank records inside my database, although $SESSION is required to insert the