Using Curl_multi for processing multiple URLs

Posted on 16th Feb 2014 07:03 pm by admin

Hi,

I am at a loss as to how to implement this. I would like to be able to automatically assign a number of urls taken from a file to x amount of curl_multi handles determined by the user on the form, so if i had 100 urls, and the user types 2 threads, each handle will process and go through 50 urls each.

The problems I face are how do I get php to create the number of handles based on the users' preference, are variable variables the only way? Because I really don't want to go there as my head will explode.

Also, how do I ensure that thread A can not process urls that Thread B is currently working on? Could this be done by popping the url off an array just before the thread goes to work on it?

Many thanks

Your Answer:

Login to answer

Other forums

How can I get my program to read a larger array ??
Hi:

I have this program that reads from an array to do calculations. The array are just t

User input in to variable
Hi all,

I'm sure this is very easy but I'm having another brain freeze!

At the end of

mail() problem
Hi Guys,

I've set up a contact email form. It sends the information fine, but it sends it to

How To Make More Than One Redirection with PHP on the same page?
Hey im trying to do a direction page where it open differently link direction pages every time som

form problem
Hi all, I think this is going to be easy to resolve but for I have been looking at it to long and I

selection tool on raster image
Hi!
I have to implement in my app a selection tool which lets users to select region of any shape

Class not found error
I am getting Class 'index' not found in Eval function:

//write config

$pat

that old Malformed Headers problem again!!!!! HELP!!!!!!
I've read the http://www.phpfreaks.com/forums/index.php/topic,37442.0.html

I don't think my c

Probably Easy, Need help with Check Boxes in PHP Code
hello,

Thanks for looking this over and helping me out. My problem is I have a online store l

getting most records by count
Code: [Select]<?php

$connect = mysql_connect("localhost","dam