Why does my crawler script suddenly end with no error?

Posted on 16th Feb 2014 07:03 pm by admin

Hi.

I have written a web crawler script. It will visit a large number of URL's with cURL.

After around 2-3 minutes of running, it will just stop, with no error output or notices.

I have these settings:
Code: [Select]set_time_limit(0);
ini_set('display_errors',1);
error_reporting(E_ALL|E_STRICT);
Any ideas why it would just stop?

Your Answer:

Login to answer

Other forums

PHP Game
hy i was wondering what's the best method in order to make some automatic updates in a php game
<

IIS & NW MII on the same server
Hi,

We're weighing the possibility to run both IIS and MII (NetWeaver) on the same server

mail() problem
Hi Guys,

I've set up a contact email form. It sends the information fine, but it sends it to

How to sum these output values
Hi

I need sum the month totals
SELECT region_name, area_name ,SUM (CASE WHEN S

Script not running properly
Hello Everyone
This is a basic script for posting to a database. I'm not sure why it doesn't work

help with image upload code
Hello,

right now this code I have resizes images and then places them into the uploads folder

. and .. appearing instead of pictures
First of all, thanks very much for providing this forum. It is very much appreciated!

My son

PHP SUBMIT
Code: <input name="doLogin" type="image" src="images/loginsubmit.jpg

Windows 7
Windows 7 default user account control worries experts. Corporate IT departments should be pleased w

Is there a function ... auto send IP
Is there some function that can be sent to a ddns service that returns the ip address of a ddns forw