Member Avatar for SaaDwTk

I need an code to go this page:
http://steamcommunity.com/groups/KiFFERSTUEBCHEN/members

And grab the data beetwen:
http://steamcommunity.com/id/ and "

href="http://steamcommunity.com/id/otti">threeD</a><br />

so it will grab in this case the word "otti"
Theres a lot of lines like that, so i need a code that grab all the specified words of the page and store that on a litbox or some listtext, one word for line.

And when its done with all words of the page he need to goes to next page:
http://steamcommunity.com/groups/KiFFERSTUEBCHEN/members?p=2

so i need to make something like that

If grab on page is over then navigate to the next page "actualpage"+1

and if theres no specified word it stops.

Edited by SaaDwTk because: n/a
  • 3 Contributors
  • 3 Replies
  • 185 Views
  • 2 Days Discussion Span
  • Latest Post Latest Post by thomas49th
Member Avatar for codeorder

Since the pages you want to retrieve data from are in total of over 15 thousand, I would use Net.HttpWebResponse to retrieve the innerHtml of a web-page instead of using a WebBrowser.
This way you do not overload your Temporary Internet Files folder with Files that you have no use for.

Using Net.HttpWebResponse, you should be able to locate and extract the IDs and also extract the Total Pages from that first page.
Then just add +=1 and extract next page until you are at the Total number of pages available.

Edited by codeorder because: n/a
Member Avatar for SaaDwTk

Thank you very much codeorder.

Member Avatar for thomas49th

what is going on? How are you doing it?

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.