writing a screen scraper

Posted on 16th Feb 2014 07:03 pm by admin

Hello,

I'm writing a screen scraper application and want to be able to get absolute addresses for images from relative links.

So a link like this: Code: <img src="../e-commerce_in_a_box_small.jpg" alt="E-Commerce" width="100" height="134" border="0" /> might link to http://www.myointernational.com/furniture/e-commerce_in_a_box_small.jpg

If I am analysing a web address, I understand that the pseudo code would be something like this:Code: <?php

$string='<img src="../../e-commerce_in_a_box_small.jpg" alt="E-Commerce" width="100" height="134" border="0" />';
// we need to find the system root and replace the ../ with REAL values.

$url='http://www.myointernational.com/test_dir/';
if($string contains '../'){
$number_of_them=count(the number of them);
}
$i=1
while($i<=$number_of_them){
$tmp_url=go up one level from the $url;
$i++;
}
?>
<img src="<?php echo $tmp_url;?>" alt="E-Commerce" width="100" height="134" border="0" />
How would I go about finding the code to make the pseudo code work

Your Answer:

Login to answer

Other forums

Quick Syntax Question
Hi folks,

I'm getting the following error: "unexpected T_LNUMBER". I'm trying to b

reating a background image
I am building a site in drupal and have a php form in it, due to certain annoyances with module buil

Log $_POST
How would i log submits on a form, by everyone? I want to then echo the number of submissions.

Need Reporting Advice
My SQL server doesn't support MS SQL reporting services that comes with SQL Enterprise or Express. T

need help with mail()
hi i want to send an email with attaching pdf file using php. i have the following script but the pr

php or sql?
Sorry not sure if this is a sql problem or php the following code is supposed to delete data from th

timed header image rotation
I have a joomla site and I was trying to setup a rotating image based on timing NOT just refreshing

form variables from database help.
Hi all,

I would like to have a form that gives you options based on the results of an mysql q

Help Ordering Arrays
Hi, I have 3 arrays as shown below.

Code: $users = $this->get_latest_users();
$flir

reading xml faster than DB call?
I am trying to optimize a high traffic website, and I enabled a feature where there are three photos