Using Curl_multi for processing multiple URLs

Posted on 16th Feb 2014 07:03 pm by admin

Hi,

I am at a loss as to how to implement this. I would like to be able to automatically assign a number of urls taken from a file to x amount of curl_multi handles determined by the user on the form, so if i had 100 urls, and the user types 2 threads, each handle will process and go through 50 urls each.

The problems I face are how do I get php to create the number of handles based on the users' preference, are variable variables the only way? Because I really don't want to go there as my head will explode.

Also, how do I ensure that thread A can not process urls that Thread B is currently working on? Could this be done by popping the url off an array just before the thread goes to work on it?

Many thanks

Your Answer:

Login to answer

Other forums

Whats wrong with my query?
I am trying to get this query to show the appropriate ticked vehicle roof height, unless no boxs are

Dealing with code in db query
I am dealing with C code and I need to make sure it is encoded some how to ensure its integrity and

Pass sql into pl/sql and create RMAN duplicate script.
Hi,

I'm new to pl/sql and I'm trying to write a script that will generate some RMAN comma

How do I use ValidatorCallout extender in Login control?
Hi,I'd like to customize the look and feel of the login control a little bit. One thing I'd love to

str_replace help
I am thinking str_replace is my only option to filter outputs from my database to convert them to sa

article site help remaining text
Hi all hope you will be fine
I am creating a article site in this site i want to put some text on

Select question
Hi,

First I would like to say that php is pretty new for me..
so please don't shoot me if

ldap connection
We are using ldap to get user information from the domain controller. It was working before. Recentl

Secure FTP
Hi experts,
There is no SFTP action in MII workbench.
This means it needs developing custo

=> and <=
So I was digging through some code when I came across the <= operator. This is the first tim