web scraping - Perl Scrappy select using class attribute -


i trying scrape using perl scrappy. select html elements class attribute using 'select'.

<p>   <h1>    <a href='http://test.com'>test</a>    <a href='http://list.com'>list</a>   </h1> </p> <p class='parent-1'>   <h1>    <a class='child-1' href="http://sample.com">samplelink</a>    <a class='child-2' href="http://list.com">list</a>   </h1> </p> 

i need element('a' tag) class name 'child-1' child nod of <p class='parent-1'> using select method.

i have tried this

#!/usr/bin/perl  use scrappy;   $scraper = scrappy->new; $scraper->get($url); $scraper->select('p a')->data; 

but select first 'p' tag also.

could please me this?

bearing in mind choroba's warning, select <a> element class of child-1 child of <p> element class of parent-1 write

$scraper->select('p.parent-1 > a.child-1') 

Comments

Popular posts from this blog

php - Invalid Cofiguration - yii\base\InvalidConfigException - Yii2 -

How to show in django cms breadcrumbs full path? -

ruby on rails - npm error: tunneling socket could not be established, cause=connect ETIMEDOUT -