Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

Matchcode in ALV change header column
Hello everyone,

I am working in an SAP system that is currently in upgrade and conversion

Output Buffering question
Hi all,

I've been trying to wrap my head around output buffering. So far I've found tons of

Get last modified date of web page
Hai All,

In php how can i get last modified date of a give web page . I have tried to g

Help with lottery style system?
I'm working on a currency system for forums and it is going to have a type of lottery system built i

Why use interfaces in PHP (OOP)
I am learning OOP in PHP and its been a pretty good learning experience so far. What I didn't unders

Looping Problem
I've got a client that has a database with about 200 events at any given time. I'm trying to loop t

SQL query not working well
Hi,
I made a small table with 5 rows and want to make them an sql consult using rownum

Generate PDF
Hi guys,

I would like to know if there is a way to generate pdf when clicking on a link. In f

puting for loop in 1 value
hi ,

how do i put this code in 1 value:
Code: <?php
for ($i=1; $i<=5; $i

php problem?
I don't think I'm stupid, but maybe I am.

I am working on a sit for a friend I am try to put