Собрать данные с вэб каталогов (парсер)

Требуется одноразовый сбор данных

1. http://www.outletseeker.com Собрать данные об американских

оутлетах, как outlet malls/centers так и магазинах stores

Ссылка USA outlet malls, затем справа Outlet Malls by State

результат в таблицу:

outletseeker_malls: id, page_url, name, description, state, address, phone, opening_hours, store_ids

Затем http://www.outletseeker.com/store/ :

outletseeker_stores: id, page_url, store_img_url, name, description, brands, tags, state, address, phone, opening_hours, mall_id

=======================================================================

2. Mall directory http://www.malletin.com/storelocator

malletin_malls: id, page_url, name, introduction, stores, state, address, phone, opening_hours, official_site, map_url, store_ids

malletin_stores: id, page_url, name, introduction, Category, tags, state, address, phone, opening_hours, mall_id

=======================================================================

3. Westfield malls:

http://corporate.westfield.com/properties/

http://corporate.westfield.com/properties/au/westfield-belconnen/?region=ACT

westfield_malls: id, page_url, name, description, country, region, address, number_of_stores,

leasing_contact_name, leasing_contact_position, leasing_contact_phone, leasing_contact_email

http://www.westfield.com/us/retailers#categories=us-childrens-fashion&centres=missionvalley

stores: id, page_url, mall_id, name, description, phone, site, categories

categories to grab: us-childrens-fashion, us-fashion-accessories, us-fashion-jewelry, us-fine-jewelry-and-watches,

us-maternity, us-mens-clothing, us-teen-fashion, us-womens-fashion, us-shoes

4. Скачать магазины из 3х категорий:

http://www.bluewater.co.uk/stores/stores-result?StoreCategory=Fashion+-+Mens

http://www.bluewater.co.uk/stores/stores-result?StoreCategory=Fashion+-+Womens

http://www.bluewater.co.uk/stores/stores-result?StoreCategory=Fashion+-+Mixed

stores: name, description, phone, site, mall, floor, near

bluewater_stores: id, category, page_url, store_WINDOW_IMG_url, store_NAME_IMG_url, name, description, brands, tags, state, address, phone, website, opening_hours

5. Скачать данные о Лондонских магазинах - London Fashion Stores:

http://www.visitlondon.com/things-to-do/activities/shopping/clothes

visitlondon_stores: id, category, page_url, store_IMG_url, name, description, brands, address, phone, website, opening_hours

http://www.timeout.com/london/shopping/the-100-best-shops-in-london

http://www.timeout.com/london/shopping/the-100-best-shops-in-london-100-91

http://www.timeout.com/london/shopping/the-100-best-shops-in-london-90-81

...

timeout_stores: id, category, page_url, store_IMG_url, name,description, brands, address, tube, phone, website, opening_hours

http://fashion.telegraph.co.uk/columns/kate-finnigan/TMG8841053/The-50-best-fashion-boutiques-outside-London.html

Все данные на одной странице

fashion_telegraph_stores: id, store_img_url, name, description, phone, website

Так же на одной странице по Гонконгу:

http://www.timeout.com.hk/shopping/features/58849/hong-kongs-best-secret-shops.html

timeout_hk_stores: id, store_img_url, name, description, phone, website

так же по Парижу:

http://www.telegraph.co.uk/travel/destinations/europe/france/parisandaround/10591700/Pariss-best-fashion-boutiques.html

http://www.telegraph.co.uk/luxury/travel/13498/the-best-shops-in-paris-an-insiders-guide.html

http://www.telegraph.co.uk/travel/destinations/europe/france/parisandaround/10659914/Pariss-best-fashion-shops.html

telegraph_stores: id, name, img, description, website, phone, address

по New York:

http://www.nyc.com/best-of-new-york/best_clothing_boutiques_in_new_york.s1904/

только здесь на магазин кликаем и получаем чуть website и description пополнее

6. http://ifdb.co Internet Fashion Database, sites, labels, agencies - to download!

http://ifdb.co/models/ http://ifdb.co/labels/ http://ifdb.co/agencies/

Собрать данные о моделях, брэндах (labels) и агенствах

Таблицы ifdb_models и т.д. все текстовые данные, колонки таблицы

согласно названия данных плюс всегда page_url с которого данные взяты.

7. 100 крупнейших центров шопинга в UK http://www.bcsc.org.uk/centrelist_100.asp

bcsc_orguk_malls: id, city, postal_code, website, region, lat, lng

8. Malls and Department Stores of HK:

http://www.discoverhongkong.com/eng/shop/where-to-shop/malls-and-department-stores/index.jsp

discoverhongkong_malls: id, page_url, img_url, name, description, address, phone, website, opening_hours

9. McArthurGlen Designer Outlets - tens of outlet centers around EU

http://www.mcarthurglen.com/en/outlets/

mcarthurglen_outlets: id, page_url, country, city, address,

opening_hours, name, description, brands, phone, fax, email

10. http://www.outlet2go.com

outlet2go_outlets: id, page_url, country, city, address, opening_hours, name, description, brands, phone

P.S. Платить мне удобно чз Приватбанк или PayPal.