Using Curl_multi for processing multiple URLs

Posted on 16th Feb 2014 07:03 pm by admin

Hi,

I am at a loss as to how to implement this. I would like to be able to automatically assign a number of urls taken from a file to x amount of curl_multi handles determined by the user on the form, so if i had 100 urls, and the user types 2 threads, each handle will process and go through 50 urls each.

The problems I face are how do I get php to create the number of handles based on the users' preference, are variable variables the only way? Because I really don't want to go there as my head will explode.

Also, how do I ensure that thread A can not process urls that Thread B is currently working on? Could this be done by popping the url off an array just before the thread goes to work on it?

Many thanks

Your Answer:

Login to answer

Other forums

Linked Keywords
I am trying to get a script that makes my predefined keyword converted to links and / or converted t

Searching keywords from array
Hello everyone, Im just wondering if someone could help me with another issue im having. Im still le

square instead of number
Hello
I do not know why but this code seems to work fine only in my xampp local insallation but n

PHP and SMS
Hi all forum members. I am new here and am unsure what category shoild I post this in.
Moderator

remove trailing slash from array
I have the following array which contains trailing slashes I need to remove. What is the best way to

Why does first ever HttpSendRequest take longer?
I promise this isn't as simple as it sounds. I'm wondering why the the first ever call to HttpSendRe

foreach result into a single variable
Hi,

I have this code...

Code: [Select]foreach ($_POST['Interests'] as $interest =&

mysql UNION | warning mysql_fetch_array !!
Code: <?php
$i = 0;
$query1="SELECT * FROM `products` WHERE `div

Problem with HTTP Caching...?
Hi there, im trying to implement caching. But it doesn't always work.
I post it here because ther

redirect standard error and assert (how to?)
How do you redirect standard error and assert?

---

(Why? I am creating an web app and