Scraping a site
Hello,
I need to scape one site for links and want to ask for tips of what to use.
The situation:
There's a site : http://www.info.lt
There are many companies there from my country and their e-mail adresses are displayed there w/o any protection and I need them. I can scrape email addresses with imacros easily(already done some sections), but I figured that it would be best that I could scrape all the companies and then just save the emails for later.
All the companies are stored in http://www.info.lt/imones/ example: http://www.info.lt/imones/Ekometrija-UAB/2117555
All the sections are listed here: http://www.info.lt/puslapiai/veiklos but you must pick a subsection to see a list of companies in that subsection like this: http://www.info.lt/rubrika/Aplinkos-apsauga/100209478
What I want to do: basically crawl all subsections for links in http://www.info.lt/imones/* and save them for later.
Anyone done anything like this?
I need to scape one site for links and want to ask for tips of what to use.
The situation:
There's a site : http://www.info.lt
There are many companies there from my country and their e-mail adresses are displayed there w/o any protection and I need them. I can scrape email addresses with imacros easily(already done some sections), but I figured that it would be best that I could scrape all the companies and then just save the emails for later.
All the companies are stored in http://www.info.lt/imones/ example: http://www.info.lt/imones/Ekometrija-UAB/2117555
All the sections are listed here: http://www.info.lt/puslapiai/veiklos but you must pick a subsection to see a list of companies in that subsection like this: http://www.info.lt/rubrika/Aplinkos-apsauga/100209478
What I want to do: basically crawl all subsections for links in http://www.info.lt/imones/* and save them for later.
Anyone done anything like this?
