Hello master...
I want to build a web crawler that can detect all files which extension is :
.pdf
.ppt
.xls
.doc
First, insert the domain of a website to search files, than the result will be like this :
domain : www.examle.com
Files :
1. xxx.doc
2. xxx2.doc
3. xxx3.ppt
4. xxx4.pdf
5. xxx5.xls
Found 5 files in www.example.com
Please tell me how to do something like that. Please.