Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

Loosing changed contents when used FM REUSE_ALV_GRID_DISPLAY
Hi,

I have used FM REUSE_ALV_GRID_DISPLAY in my program as below.

CALL FUNCT

Google Wave
So... has anyone used it yet? Is it any good?

http://wave.google.com/help/wave/about.html#vid

if else problem, help please
i have this script that i made only i try to also put in a if else for for some reason the script is

Do something every fifth time?
I'm trying to write a loop, but I want it to do something different after every fifth instance. Like

cookie problem
I hv a website url
In this site main menu functionality based on cookie when user click on parti

email CODING Problem
Email coding problem.

I need to send a section of the info to $tf and the same as a Cc to $em

need help with mail()
hi i want to send an email with attaching pdf file using php. i have the following script but the pr

ECC6 - Single sign-on
We are in the process of upgrading to ECC 6 which will support single sign on with user passwords al

Re-Order by ID Number
I have a cms set up for inputting an image, thumb, title, pdf, and eps. When input the database ass

PHP Error
On my .php page I have a drop down box that has several names in it. When a user clicks the name &am