I need a Spider/Robot/Crawler (or whatever the correct word is) which will go to a website
and fetch/download all data, including pdfs, and save it in a MySQL database.
The same categories as used on the website shall be used in the MySQL database. The data shall be updated every day.
The date must be saved in "date-format" (and not as text) to enable to sort datasets by date.