Hello, I'm doing a small project that aims to develop a search engine. What I need is a web crawler that can scrape backlinks for a website. I need to scratch:
Title, PageText, Page Size, Back Links
Does anyone know of a good web crawler that can give me that?
need help!