http - Python urllib2, how to avoid errors - need help -


i using python urllib2 download pages web. not using kind of user_agent etc. getting below sample errors. can tell me easy way avoid them.

http://www.rottentomatoes.com/m/foxy_brown/ server couldn't fulfill request. error code:  403   http://www.spiritus-temporis.com/marc-platt-dancer-/ server couldn't fulfill request. error code:  503  http://www.golf-equipment-guide.com/news/mark-nichols-(golfer).html!! server couldn't fulfill request. error code:  500   http://www.ehx.com/blog/mike-matthews-in-fuzz-documentary!! failed reach server. reason:  timed out incompleteread(5621 bytes read) traceback (most recent call last):     file "download.py", line 43, in <module>     localfile.write(response.read())     file "/usr/lib/python2.6/socket.py", line 327, in read     data = self._sock.recv(rbufsize)     file "/usr/lib/python2.6/httplib.py", line 517, in read     return self._read_chunked(amt)     file "/usr/lib/python2.6/httplib.py", line 563, in _read_chunked     raise incompleteread(value) incompleteread: incompleteread(5621 bytes read)

thank you
bala

many web resources require kind of cookie or other authentication access, 403 status codes result of this.

503 errors tend mean you're rapidly accessing resources server in loop , need wait briefly before attempting access.

the 500 example doesn't appear exist...

the timeout error may not need "!!", can load resource without it.

i recommend read on http status codes.


Comments

Post a Comment

Popular posts from this blog

asp.net - repeatedly call AddImageUrl(url) to assemble pdf document -

i'm using abcpdf , i'm curious if can recursively call addimageurl() function assemble pdf document compile multiple urls? something like: int pagecount = 0; int theid = thedoc.addimageurl("http://stackoverflow.com/search?q=abcpdf+footer+page+x+out+of+", true, 0, true); //assemble document while (thedoc.chainable(theid)) { thedoc.page = thedoc.addpage(); theid = thedoc.addimagetochain(theid); } pagecount = thedoc.pagecount; console.writeline("1 document page count:" + pagecount); //flatten document (int = 1; <= pagecount; i++) { thedoc.pagenumber = i; thedoc.flatten(); } //now try again theid = thedoc.addimageurl("http://stackoverflow.com/questions/1980890/pdf-report-generation", true, 0, true); //assemble document while (thedoc.chainable(theid)) { thedoc.page = thedoc.addpage(); theid = thedoc.addimagetoc
Read more

java - Android recognize cell phone with keyboard or not? -

in android app, want detect user's device if device has keyboard(like motorola milestone) , show corresponding user interface. guys know how that? ! regards justicepenny http://developer.android.com/reference/android/content/res/configuration.html public int keyboard the kind of keyboard attached device. 1 of: keyboard_nokeys, keyboard_qwerty, keyboard_12key. that's it!
Read more

iphone - How would you achieve a LED Scrolling effect? -

how achieve led scrolling effect example below? led sign - led ticker emulator iphone , ipad http://img.skitch.com/20101201-rsfh4p1bajb1wp94k466pdpiuj.preview.jpg sometimes remunerates comment in other posts :) have put code you, should implement font '8pin matrix' realistic feeling. uilabel *label; - (void)viewdidload { [super viewdidload]; label = [[uilabel alloc]initwithframe:cgrectmake(10, 50, 300, 20)]; label.font = [uifont fontwithname:@"courier-bold" size:16.0]; label.backgroundcolor = [uicolor blackcolor]; label.textcolor = [uicolor greencolor]; label.linebreakmode = uilinebreakmodecharacterwrap; // otherwise "…" label.text = @"this led text scrolled "; // blanks space between [self.view addsubview:label]; [nstimer scheduledtimerwithtimeinterval:0.12f target:self selector:@selector(scrolllabel) use
Read more