.net - HttpWebRequest parse bot protected site -

.net - HttpWebRequest parse bot protected site -

i trying parse website bot protection using vb.net httpwebrequest.

currently code below:

cookiecontainer = new cookiecontainer() httpwebrequest = directcast(webrequest.create(urlbase & page), httpwebrequest) httpwebrequest.cookiecontainer = cookiecontainer httpwebrequest.useragent = "mozilla/6.0 (windows; u; windows nt 7.0; en-us; rv:1.9.0.8) gecko/2009032609 firefox/3.0.9 (.net clr 3.5.30729)" webresponse = httpwebrequest.getresponse() result = new system.io.streamreader(webresponse.getresponsestream(), system.text.encoding.[default]).readtoend()

but in response have been marked bot prompting me captcha prove i'm not. states: "possible reason why happend : dont have javascript or cookies enabled have virus , ip listed in projecthoneypot making more 100 requests per sec site you, or virus on pc are/is faking user-agent , pretending search engine"

my ip not listed in projecthoneypot, not making more 1 request per minute. guessing problem javascript & cookies or user-agent.

.net vb.net cookies httpwebrequest