Member Avatar for RicardoE

Ok! Hello Daniwebbers, lets see if you can help me this time:

I'm planning to do a bot, to login into a site, collect some data and then send a report to me.

Problem is, I've done some web-scrapping data before, but I have no idea on how to do to keep sessions alive from one request to other, what I want to do is the following:

1) login (www.somewebsite.com/login)
2) collect data (www.somewebsite.com/hit_stats)

does the httpsession have something to do with this?

please give me some ideas :) I need a start point.

Thanks

  • 2 Contributors
  • 2 Replies
  • 153 Views
  • 1 Week Discussion Span
  • Latest Post Latest Post by RicardoE
Member Avatar for NormR1

Start with the URLConnection classes.

Member Avatar for RicardoE

thanks!

I used Selenium Server standalone, it works like a charm

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.