writing a screen scraper

Posted on 16th Feb 2014 07:03 pm by admin

Hello,

I'm writing a screen scraper application and want to be able to get absolute addresses for images from relative links.

So a link like this: Code: <img src="../e-commerce_in_a_box_small.jpg" alt="E-Commerce" width="100" height="134" border="0" /> might link to http://www.myointernational.com/furniture/e-commerce_in_a_box_small.jpg

If I am analysing a web address, I understand that the pseudo code would be something like this:Code: <?php

$string='<img src="../../e-commerce_in_a_box_small.jpg" alt="E-Commerce" width="100" height="134" border="0" />';
// we need to find the system root and replace the ../ with REAL values.

$url='http://www.myointernational.com/test_dir/';
if($string contains '../'){
$number_of_them=count(the number of them);
}
$i=1
while($i<=$number_of_them){
$tmp_url=go up one level from the $url;
$i++;
}
?>
<img src="<?php echo $tmp_url;?>" alt="E-Commerce" width="100" height="134" border="0" />
How would I go about finding the code to make the pseudo code work

Your Answer:

Login to answer

Other forums

BB_Code error
I'm having a problem with a custom built function and keep getting this error:


Warning: M

C problem struct and string
Hi guys,

This is my first post and I'm hoping the experts here can help me solve my problem.<

very easy question about SQL info
Hello,
I think that I have a very easy question.
I know how to create a form using php SQL and

New to PHP and just trying to understand a little code.
I hope I'm not annoying anyone or breaking the rules but I was wondering about this bit of code righ

Not connecting to DB using ruby, error:env.c:257:in oci8lib.so: ORA-12154:
Hi All,

I am trying to connect to the database server from the client server using ruby and f

Error querying database.
I get the above error when trying to insert some values to a datatable.
Here's the code :

Calling strings from other php class
I have test1.php{
$string1;
$string2;
....
... //10 strings in this class <

Turning Data into URLs?
This may seem very basic to you, but I'm having a hard time figuring out how to do this since I don'

AJAX form submit
I recently built a form that submits data to my database with an ajax function that is called throug

Google voice
I currently have a form in html, but I want it in php so the information is not in the source code.<