Basic Question about Threading and PHP...

Posted on 16th Feb 2014 by admin

I have a page that I am working on and it is taking several hours to process. The basics of what the page does is get all the items out of a database then with cURL download some HTML parse through it and if anything has changes update values back in the database. 90% of the time is spent waiting on libcurl to download the page and the page is VERY low on CPU usage. In the effort of trying to speed things up I thought about trying to thread the download process, but from a quick google search it appears that PHP lacks Threading support. Does anyone know of anything that could be done to speed things up? Maybe something I missed with cURL that would make it download faster or an alternative to Threading?

Thanks

Other forums