Member Avatar for moteutsch

I am interested in starting to work on a recipe search engine. The problem is though, is getting the recipes. I would like to access the ones in the top online recipe search engines, but I am not sure what way would be the most efficient and most legal way to do this.

Here are the options I am considering:

  • On-the-fly screen scraping
  • Screen scraping in advance and creating a massive database
  • A combination of the two, scraping on-the-fly and then saving it to a database that will be checked along with the other sites
  • Finding some free API

Which of these would be the best, in your opinion, as well as being legal?

To see some sites that do something similar to this see SNIP, SNIP and SNIP

Regards,
Moshe

Edited by happygeek because: links snipped
  • 2 Contributors
  • 2 Replies
  • 146 Views
  • 2 Days Discussion Span
  • Latest Post Latest Post by moteutsch
Member Avatar for WaltP

Not to rain on your picnic table, but of what real use is yet another site that has recipes that are already posted on a dozen other sites already?

Member Avatar for moteutsch

It is targeting a niche that I think I will be able to retain as repeat visitors, and will contain functionality that that target audience wants/requires.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.