Good day, I have to make a data scraper and after I take the informations I have to get them in a CSV file.This is the original request:For the final java academy test you have to create a small crawler.
What do I mean by "crawler"?
A crawler it is a small java program that scans everything from a
website. It is similar to what google is doing when it is indexing the
whole world wide web.
So here are the details.
Your crawler must crawl all the products found in the website www.reifen.com
When you enter this website the first filter is for the type of vehicle.
Crawl ONLY the items found in the category: Vehicle. Ignore motorcycle,
off-road or van.
Bellow you find filters for tyre dimensions. Crawl all those dimensions.
Example for dimensions you have to crawl:
205 55 r16
205 55 r17
215 55 r16
215 55 r17
215 55 r18
...
...
...
and so on
Crawl all the dimensions!
Leave the other filters as they are. Do not change them.
When the list of tires is shown look for brand, tire profile and price
Save this information into a csv file.
Example with 2 lines from the csv file:
205;55;r16;continental;
maxcontact;20EUR
205;55;r17;dunlop;profile_name;30EUR
That's it!
So your crawler must crawl the specified website and save the
information into a CSV file.
I WOULD NEED IT FOR TODATY, THIS IS MY DEATHLINE. iT'S MY FAULT AS A BEGINNER THAT I TRIED BY MYSELF ALL WEEK AND COULD NOT MAKE THE PROGRAM ALONE. TODAT,04.05.17 AT 12:00AM WOULD BE GREAT AS TO SEND IT DIRECTLY.MY TIMELINE IS UTC+2:00 ATHENS,BUCHAREST.NOW IS 5.34AM(I TRIED FROM YESTERDAY AT 20:00 UNTIL NOW BUT STILL NO SUCCES. My email is petrisor_cristian93@yahoo.com I know the ids and that it would br good to use a streambuilder and the csv filewith FireWriter method
