https://www.aboutyou.de/c/maenner/bekleidung-20290
- JSOUP v.1.13.1 to get data from web page in JSON format;
- GSON v.2.2.4 to parse and save data in JSON;
The URL for parsing was obtained after examining the Network tab with XHR filter in Chrome, while scrolling down. Parsing algorithm is based on iterating over the index in URL. Number of subpages for full page content is 5.
Was used simple multi-threading. Thread count is 2.
The extracted offers will be written into a JSON file "output.json" in the same folder where jar file is.
- Amount of triggered HTTP requests
- Amount of extracted products