Shop::Amazon - scraper produktów Amazon

Przegląd scrapera
Używając scrapera produktów amazon, możesz pobierać wszystkie dane z karty produktu, zbierać bazę linków do produktów, śledzić dynamikę cen produktów i dostawy, zbierać oceny ratingowe oraz liczbę opinii o produkcie, pobierać zdjęcia produktów, a także uzyskać listę sklepów.
Funkcjonalność A-Parser pozwala zapisywać ustawienia scrapowania do późniejszego wykorzystania (presety), ustawiać harmonogram scrapowania i wiele więcej. Możesz korzystać z automatycznego mnożenia zapytań, podstawiania podzapytań z plików, generowania kombinacji alfanumerycznych i list, aby uzyskać maksymalną możliwą liczbę wyników.

Pobierane dane

- Nazwa produktu
- Link do produktu
- Zdjęcie produktu
- Cena i cena bez zniżki
- Rating, liczba komentarzy
- Liczba sprzedaży i sprzedawców
- Sprzedawca
- Dodatkowe informacje (Bestseller, Sponsored)
Warianty użycia
- Zbieranie linków do produktów
- Ocena popularności produktów
- Śledzenie dynamiki cen
Zapytania
Jako zapytania należy podawać nazwy produktów, dokładnie tak samo, jak gdyby były wpisywane bezpośrednio w formularz wyszukiwania Amazon, na przykład:
iphone 11pro max
Bezprzewodowa mysz Bluetooth, domowa mysz do gier
Karta pamięci Micro Sd Sandisk, karta Micro Sd Class10 TF
AMD Ryzen R3 2200U
Podstawianie zapytań
Możesz użyć wbudowanych makr do mnożenia zapytań, na przykład gdy chcemy uzyskać bardzo dużą bazę produktów według marek,
philips
sony
xiaomi
samsung
W formacie zapytań wskażemy generowanie znaków od a do zzzz, ta metoda pozwala maksymalnie rotować wyniki wyszukiwania i uzyskiwać wiele nowych unikalnych wyników:
$query {az:a:zzzz}
To makro utworzy 475254 dodatkowych zapytań dla każdego początkowego zapytania wyszukiwania, co łącznie da 4 x 475254 = 1901016 zapytań wyszukiwania. Liczba jest imponująca, ale to żaden problem dla A-Parser. Przy prędkości 2000 zapytań na minutę takie zadanie zostanie przetworzone w zaledwie 16 godzin.
Warianty wyprowadzania wyników
A-Parser obsługuje elastyczne formatowanie wyników dzięki wbudowanemu silnikowi szablonów Template Toolkit, co pozwala mu wyprowadzać wyniki w dowolnej formie, a także w formie strukturalnej, na przykład CSV lub JSON
Wyprowadzanie nazwy, nowej i starej ceny, waluty
Format wyniku:
$products.format('$title, $price, $oldprice, $currency\n');
Przykład wyniku:
Vertical Stand with Dual Cooling Fans for Sony PS5 Digital Edition & PS5 UHD with 2 DualSense PS5 Controller Chargers and 3 USB Ports for Sony Playstation 5 DE & UHD Edition, 39.99, $46.99, $
Marvel's Spider-Man: Miles Morales Ultimate Launch Edition – PlayStation 5, 69.99, , $
Ps5 skin protective wrap customizable cover vinyl sticker decals for sony playstation 5 disk version console and two dual sense 5 sticker skins cyber net yellow black blue, 21.99, , $
Werewolf: The Apocalypse - Earthblood (PS5) - PlayStation 5, 49.99, , $
Sackboy: A Big Adventure – PlayStation 5, 59.99, , $
Charger Stand for PS5 DualSense Controller, MENEEA Controller Type-C Fast Dual Charging Station Dock with LED Indicator for Sony Playstation 5 with Dual Detachable USB C Ports, 14.99, $17.99, $
HEYSTOP PS5 Controller Charger, PS5 Wireless Charger DualSense Fast Charging Station Compatible with Sony Playstation 5 Controller, 15.99, , $
Marvel’s Spider-Man: Miles Morales Launch Edition – PlayStation 5, 49.44, , $
CYTXSWARDWELL PS5 Controller Charger, Dual USB PS5 Controller Charging Station, for Playstation 5 Console DualSense PS5 Controllers. (Pearl White), 18.99, , $
Seltureone Compatible for Playstation 5 Media Remote Cover, Silicone Protective Case Sleeve for PS5 Remote Control, Shock Absorption Washable, White, 9.95, , $
PS5 Controller Cover Case, Anti-Slip Silicone Skin Protective Cover Case for Playstation 5 DualSense Wireless Controller with 8 Thumb Grip Caps(Comics Dynamic), 11.99, , $
Wyprowadzanie nazwy, ceny i waluty
Format wyniku:
$products.format('Nazwa: $title, Cena: $price, Waluta: $currency\n');
Przykład wyniku:
Nazwa: Resident Evil Village Deluxe Edition - PlayStation 5 Deluxe Edition, Cena: 69.99, Waluta: $
Nazwa: DualSense Wireless Controller, Cena: 69.98, Waluta: $
Nazwa: Persona 5 Strikers - PlayStation 4, Cena: 59.99, Waluta: $
Nazwa: Assassin’s Creed Valhalla PlayStation 5 Standard Edition, Cena: 34.99, Waluta: $
Nazwa: Demon’s Souls – PlayStation 5, Cena: 69.99, Waluta: $
Nazwa: NexiGo Dobe PS5 Controller Charger, Upgraded Playstation 5 Charging Station Dock with LED Indicator, Safety Chip Protection, Dual USB Type C Fast Charging, for Sony DualSense Controller, White, Cena: 19.99, Waluta: $
Nazwa: PS5 Controller Charger, Charging Dock for Playstation 5 / PS5/ Controller, OIVO PS5 Controller Charging Dock Station with 2 USB-C Adapter with LED Indicator, Cena: 17.99, Waluta: $
Nazwa: PlayStation 5 DualSense Wireless Controller, Cena: 79.95, Waluta: $
Wyprowadzanie wyniku i ceny z uwzględnieniem dostawy do tabeli CSV
Wyprowadzimy wynik z zmienną total_price, która jest równa sumie ceny produktu + koszt dostawy, cena dostawy jest umowna (50$)
Format wyniku:
[% FOREACH item IN products;
total_price = item.price + 50;
tools.CSVline(item.title, item.price, total_price );
END %]
Przykład wyniku:
Charger Stand for PS5 DualSense Controller, MENEEA Controller Type-C Fast Dual Charging Station Dock with LED Indicator for Sony Playstation 5 with Dual Detachable USB C Ports",14.99,64.99
"Marvel's Spider-Man: Miles Morales Ultimate Launch Edition – PlayStation 5",69.99,119.99
"PlayStation 5 DualSense Wireless Controller",79.95,129.95
"HEYSTOP PS5 Controller Charger, PS5 Wireless Charger DualSense Fast Charging Station Compatible with Sony Playstation 5 Controller",15.99,65.99
"PS5 Controller Charger, Charging Dock for Playstation 5 / PS5/ Controller, OIVO PS5 Controller Charging Dock Station with 2 USB-C Adapter with LED Indicator",17.99,67.99
"PS5 Controller Cover Case, Anti-Slip Silicone Skin Protective Cover Case for Playstation 5 DualSense Wireless Controller with 8 Thumb Grip Caps(Comics Dynamic)",11.99,61.99
"PomisGam Vertical Stand for Playstation 5 with Cooling Fan Charing Station for PS5 Digital Edition/PS5 Ultra HD,Multi-Function Charger Station with 2 Controller Charging Docks",35.99,85.99
"Vertical Stand with Dual Cooling Fans for Sony PS5 Digital Edition & PS5 UHD with 2 DualSense PS5 Controller Chargers and 3 USB Ports for Sony Playstation 5 DE & UHD Edition",39.99,89.99
"Persona 5 Strikers - PlayStation 4",59.99,109.99
"FYOUNG Controller Charging Station for PS5, Charging Dock Compatible for Playstation 5 DualSense Wireless Controller with LED Light Indicators and USB C Cable",16.99,66.99
"PlayStation 5 Console",,50
"Resident Evil Village - PlayStation 5 Standard Edition",59.99,109.99
Wyprowadzanie wyniku z datą scrapowania do tabeli CSV
Wyprowadzimy wynik z zmienną total_price, która jest równa sumie ceny produktu + maks. koszt dostawy
Format wyniku:
[% USE date;
d = date.format(mytime, format = "%Y %d %H:%M");
FOREACH item IN products;
total_price = item.price + 50;
tools.CSVline(d, item.title, item.price, item.link, total_price );
END %]
Przykład wyniku:
"2021 29 18:31","PlayStation 5 Console",,https://www.amazon.com/PlayStation-5-Console/dp/B08FC5L3RG/ref=sr_1_1?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-1,50
"2021 29 18:31","PlayStation 4 Console - 1TB Slim Edition",384.99,https://www.amazon.com/PlayStation-4-Console-1TB-Slim/dp/B074LRF639/ref=sr_1_2?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-2,434.99
"2021 29 18:31","PlayStation VR Marvel's Iron Man VR Bundle",349.99,https://www.amazon.com/PlayStation-Marvels-Iron-Man-Bundle-4/dp/B08NRGF2DL/ref=sr_1_3?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-3,399.99
"2021 29 18:31","Turtle Beach Stealth 600 White Gen 2 Wireless Gaming Headset for PlayStation 5 and PlayStation 4",99.95,https://www.amazon.com/Stealth-Wireless-Gaming-Headset-PlayStation-Console/dp/B08D44WZTS/ref=sr_1_4?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-4,149.95
"2021 29 18:31","$100 PlayStation Store Gift Card [Digital Code]",100.00,https://www.amazon.com/PlayStation-Store-Gift-Card-Digital/dp/B00K59HKIQ/ref=sr_1_5?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-5,150
"2021 29 18:31","Oculus Quest 2 — Advanced All-In-One Virtual Reality Headset — 256 GB",399.00,https://www.amazon.com/Oculus-Quest-Advanced-All-One-2/dp/B08F7PTF54/ref=sr_1_6?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-6,449
"2021 29 18:31","DualSense Wireless Controller",69.98,https://www.amazon.com/DualSense-Wireless-Controller-PlayStation-5/dp/B08FC6C75Y/ref=sr_1_7?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-7,119.98
"2021 29 18:31","Resident Evil Village Deluxe Edition - PlayStation 5 Deluxe Edition",69.99,https://www.amazon.com/Resident-Evil-Village-Deluxe-PlayStation-5/dp/B08TR5R8S4/ref=sr_1_8?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-8,119.99
"2021 29 18:31","Demon’s Souls – PlayStation 5",68.95,https://www.amazon.com/Demons-Souls-PlayStation-5/dp/B08FC5TTBF/ref=sr_1_10?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-10,118.95
"2021 29 18:31","Marvel's Spider-Man: Miles Morales Ultimate Launch Edition – PlayStation 5",69.99,https://www.amazon.com/Marvels-Spider-Man-Morales-Ultimate-Launch-PlayStation/dp/B08FC66ZV4/ref=sr_1_11?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-11,119.99
"2021 29 18:31","Persona 5 Strikers - PlayStation 4",59.99,https://www.amazon.com/Persona-5-Strikers-PlayStation-4/dp/B08Q6YYLN5/ref=sr_1_12?dchild=1&keywords=playstation+5&qid=1611934312&sr=8-12,109.99
Wyprowadzanie do tabeli CSV
Format wyniku:
[% FOREACH item IN products;
tools.CSVline(item.link, item.title, item.price, item.oldprice, item.rating, item.commentscount);
END %]
Nazwa pliku:
$datefile.format().csv
Tekst początkowy:
Link do produktu, Nazwa produktu, Cena, Stara cena, Rating, Liczba komentarzy
Przykład wyniku:
Link do produktu, Nazwa produktu, Cena, Stara cena, Rating, Liczba komentarzy
https://www.amazon.com/Oculus-Quest-Advanced-All-One-2/dp/B08F7PTF54/ref=sr_1_5?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-5,"Oculus Quest 2 — Advanced All-In-One Virtual Reality Headset — 256 GB",399.00,,"19,203
https://www.amazon.com/DualSense-Wireless-Controller-PlayStation-5/dp/B08FC6C75Y/ref=sr_1_6?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-6,"DualSense Wireless Controller",69.93,,"11,451
https://www.amazon.com/Resident-Evil-Village-Deluxe-PlayStation-5/dp/B08TR5R8S4/ref=sr_1_7?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-7,"Resident Evil Village Deluxe Edition - PlayStation 5 Deluxe Edition",69.99,,
https://www.amazon.com/Demons-Souls-PlayStation-5/dp/B08FC5TTBF/ref=sr_1_8?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-8,"Demon’s Souls – PlayStation 5",69.89,,"1,963
https://www.amazon.com/gp/slredirect/picassoRedirect.html/ref=pa_sp_mtf_aps_sr_pg1_1?ie=UTF8&adId=A0678777UQU133BE10NC&url=%2FController-Charging-Playstation-Indicator-Game-Boy%2Fdp%2FB08QNJNXNF%2Fref%3Dsr_1_9_sspa%3Fdchild%3D1%26keywords%3Dplaystation%2B5%26qid%3D1611928056%26sr%3D8-9-spons%26psc%3D1&qualifier=1611928056&id=1074325077257761&widgetName=sp_mtf,"PS5 Controller Charger, Charging Dock for Playstation 5 / PS5/ Controller, OIVO PS5 Controller Charging Dock Station with 2 USB-C Adapter with LED Indicator",17.99,,2
https://www.amazon.com/gp/slredirect/picassoRedirect.html/ref=pa_sp_mtf_aps_sr_pg1_1?ie=UTF8&adId=A056102415216X4GXFBHL&url=%2FController-DualSense-Orgaization-Accessories-playstation-5%2Fdp%2FB08R8DVJ8K%2Fref%3Dsr_1_10_sspa%3Fdchild%3D1%26keywords%3Dplaystation%2B5%26qid%3D1611928056%26sr%3D8-10-spons%26psc%3D1&qualifier=1611928056&id=1074325077257761&widgetName=sp_mtf,"PS5 Controller Charger Station,Double Charging Dock for DualSense Wireless Controller with Type-C USB Cable Play Station 5 Consle Orgaization Accessories Station",17.39,,
https://www.amazon.com/Persona-5-Strikers-PlayStation-4/dp/B08Q6YYLN5/ref=sr_1_11?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-11,"Persona 5 Strikers - PlayStation 4",59.99,,
https://www.amazon.com/Marvels-Spider-Man-Morales-Ultimate-Launch-PlayStation/dp/B08FC66ZV4/ref=sr_1_12?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-12,"Marvel's Spider-Man: Miles Morales Ultimate Launch Edition – PlayStation 5",69.97,,"3,468
https://www.amazon.com/PlayStation-5-DualSense-Wireless-Controller/dp/B08H99BPJN/ref=sr_1_13?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-13,"PlayStation 5 DualSense Wireless Controller",79.95,,"9,685
https://www.amazon.com/Sackboy-Big-Adventure-PlayStation-5/dp/B08FC64CNF/ref=sr_1_14?dchild=1&keywords=playstation+5&qid=1611928056&sr=8-14,"Sackboy: A Big Adventure – PlayStation 5",,,911
W Formacie wyników stosowany jest silnik szablonów Template Toolkit do wyprowadzania tablicy $products w pętli FOREACH.
Aby opcja "Prepend text" była dostępna w Edytorze zadań, należy aktywować "More options". W "Prepend text" wpisujemy nazwy kolumn oddzielone przecinkami, a drugą linię pozostawiamy pustą.
Zapisywanie w formacie SQL
Format wyniku:
[% FOREACH item IN products;
"INSERT INTO products VALUES('" _ item.title _ "', '"; item.link _ "', '"; item.price _ "', '"; item.currency _ "')\n";
END %]
Przykład wyniku:
INSERT INTO products VALUES('Resident Evil Village Deluxe Edition - PlayStation 5 Deluxe Edition', 'https://www.amazon.com/Resident-Evil-Village-Deluxe-PlayStation-5/dp/B08TR5R8S4/ref=sr_1_1?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-1', '69.99', '$')
INSERT INTO products VALUES('DualSense Wireless Controller', 'https://www.amazon.com/DualSense-Wireless-Controller-PlayStation-5/dp/B08FC6C75Y/ref=sr_1_2?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-2', '69.98', '$')
INSERT INTO products VALUES('Assassin’s Creed Valhalla PlayStation 5 Standard Edition', 'https://www.amazon.com/Assassins-Creed-Valhalla-PlayStation-5-Standard/dp/B08FS5HKTR/ref=sr_1_3?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-3', '34.99', '$')
INSERT INTO products VALUES('Demon’s Souls – PlayStation 5', 'https://www.amazon.com/Demons-Souls-PlayStation-5/dp/B08FC5TTBF/ref=sr_1_4?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-4', '68.95', '$')
INSERT INTO products VALUES('Charger Stand for PS5 DualSense Controller, MENEEA Controller Type-C Fast Dual Charging Station Dock with LED Indicator for Sony Playstation 5 with Dual Detachable USB C Ports', 'https://www.amazon.com/DualSense-Controller-MENEEA-Playstation-Detachable/dp/B08L7N3MF1/ref=sr_1_5?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-5', '14.99', '$')
INSERT INTO products VALUES('Marvel's Spider-Man: Miles Morales Ultimate Launch Edition – PlayStation 5', 'https://www.amazon.com/Marvels-Spider-Man-Morales-Ultimate-Launch-PlayStation/dp/B08FC66ZV4/ref=sr_1_6?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-6', '69.99', '$')
INSERT INTO products VALUES('PlayStation 5 DualSense Wireless Controller', 'https://www.amazon.com/PlayStation-5-DualSense-Wireless-Controller/dp/B08H99BPJN/ref=sr_1_7?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-7', '79.95', '$')
INSERT INTO products VALUES('Vertical Stand with Dual Cooling Fans for Sony PS5 Digital Edition & PS5 UHD with 2 DualSense PS5 Controller Chargers and 3 USB Ports for Sony Playstation 5 DE & UHD Edition', 'https://www.amazon.com/Vertical-DualSense-Controller-Chargers-Playstation-5/dp/B08NL49YJ3/ref=sr_1_8?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-8', '39.99', '$')
INSERT INTO products VALUES('PomisGam Vertical Stand for Playstation 5 with Cooling Fan Charing Station for PS5 Digital Edition/PS5 Ultra HD,Multi-Function Charger Station with 2 Controller Charging Docks', 'https://www.amazon.com/PomisGam-Vertical-Playstation-Multi-Function-Controller/dp/B08PNZXGMY/ref=sr_1_11?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-11', '35.99', '$')
INSERT INTO products VALUES('Persona 5 Strikers - PlayStation 4', 'https://www.amazon.com/Persona-5-Strikers-PlayStation-4/dp/B08Q6YYLN5/ref=sr_1_12?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-12', '59.99', '$')
INSERT INTO products VALUES('HEYSTOP PS5 Controller Charger, PS5 Wireless Charger DualSense Fast Charging Station Compatible with Sony Playstation 5 Controller', 'https://www.amazon.com/HEYSTOP-Controller-DualSense-Compatible-Playstation/dp/B08R3K1977/ref=sr_1_13?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-13', '15.99', '$')
INSERT INTO products VALUES('PlayStation 5 Console', 'https://www.amazon.com/PlayStation-5-Console/dp/B08FC5L3RG/ref=sr_1_14?dchild=1&keywords=playstation+5&qid=1611934195&sr=8-14', '', '')
Zrzut wyników do JSON
Ogólny format wyniku:
[% IF notFirst;
",\n";
ELSE;
notFirst = 1;
END;
obj = {};
obj.query = query;
obj.items = [];
FOREACH item IN p1.products;
obj.items.push({
link = item.link
title = item.title
price = item.price
});
END;
obj.json %]
Tekst początkowy:
[
Tekst końcowy:
]
Przykład wyniku:
[
{
"items": [
{
"link": "https://www.amazon.com/Controller-Protector-Playstation-Anti-Slip-Christmas/dp/B08CVRCFK3/ref=sr_1_18?dchild=1&keywords=playstation+5&qid=1611933831&sr=8-18",
"title": "2 Pack PS5 Controller Skin Covers Xmas Gifts for Men Women Hubby Wife Friends Grip Protector with 16 pcs Thumb Grip Caps for Sony Playstation 5 Anti-Slip Silicone",
"price": "10.90"
},
{
"link": "https://www.amazon.com/Controller-Protector-Playstation-Anti-Slip-Christmas/dp/B08CVRCFK3/ref=sr_1_18?dchild=1&keywords=playstation+5&qid=1611933831&sr=8-18",
"title": "2 Pack PS5 Controller Skin Covers Xmas Gifts for Men Women Hubby Wife Friends Grip Protector with 16 pcs Thumb Grip Caps for Sony Playstation 5 Anti-Slip Silicone",
"price": "10.90"
},
{
"link": "https://www.amazon.com/Controller-Protector-Playstation-Anti-Slip-Christmas/dp/B08CVRCFK3/ref=sr_1_18?dchild=1&keywords=playstation+5&qid=1611933831&sr=8-18",
"title": "2 Pack PS5 Controller Skin Covers Xmas Gifts for Men Women Hubby Wife Friends Grip Protector with 16 pcs Thumb Grip Caps for Sony Playstation 5 Anti-Slip Silicone",
"price": "10.90"
},
{
"link": "https://www.amazon.com/Controller-Protector-Playstation-Anti-Slip-Christmas/dp/B08CVRCFK3/ref=sr_1_18?dchild=1&keywords=playstation+5&qid=1611933831&sr=8-18",
"title": "2 Pack PS5 Controller Skin Covers Xmas Gifts for Men Women Hubby Wife Friends Grip Protector with 16 pcs Thumb Grip Caps for Sony Playstation 5 Anti-Slip Silicone",
"price": "10.90"
},
{
"link": "https://www.amazon.com/Controller-Protector-Playstation-Anti-Slip-Christmas/dp/B08CVRCFK3/ref=sr_1_18?dchild=1&keywords=playstation+5&qid=1611933831&sr=8-18",
"title": "2 Pack PS5 Controller Skin Covers Xmas Gifts for Men Women Hubby Wife Friends Grip Protector with 16 pcs Thumb Grip Caps for Sony Playstation 5 Anti-Slip Silicone",
"price": "10.90"
}
]
}
]
Aby opcje "Prepend text" i "Append text" były dostępne w Edytorze zadań, należy aktywować "More options".
Możliwe ustawienia
| Parametr | Wartość domyślna | Opis |
|---|---|---|
| Pages count | 5 | Liczba stron do scrapowania |
| Amazon domain | United States | Domeny Amazon w różnych strefach domenowych |
| AntiGate preset | default | Preset Anti-Gate do włączenia rozwiązywania captch |