Skip to main content
16 events
when toggle format what by license comment
Jul 18, 2017 at 0:47 history edited Jamal CC BY-SA 3.0
deleted 12 characters in body; edited tags
Apr 24, 2017 at 21:40 comment added Shawn @TravisBathurst The tool is not as important generally as a fully worked solution. Do a check for 301 and 302 redirects. :-) Happy coding.
Apr 24, 2017 at 21:40 comment added Travis Bathurst We do have a lot of redirects on our site.
Apr 24, 2017 at 21:40 comment added Travis Bathurst Thank you, not 100% sure why I started with Python. I had a buddy in high that was a real big python nerd so I figured that I would start learning that first. The reason I wanted to use selenium was because eventually I am going to build off this to check other features of my site and selenium seems to be a real good webkit for website testing. I do want to learn PHP. Figured I would get my feet wet with python first. Thank you for responding.
Apr 24, 2017 at 21:39 comment added Shawn (cont.) My solution will also if you check the code status on say a permanent redirect, to capture the new updated url and update yours.
Apr 24, 2017 at 21:31 comment added Shawn This was my solution using only curl in PHP; The reason I am including it is I show using just curl how to check for valid pages. It is possible the link will give you a temporary redirect but is still valid so you should check this condition. In addition my solution will only capture the header and will not load the full page. This will make your script super fast. I am not sure if you can do it in python but perhaps there is some useful pieces there. In my case I was using it to scan site links of around 300,000 links so speed was a concern. stackoverflow.com/a/21032909/1361532
Apr 24, 2017 at 21:26 comment added Travis Bathurst Thank you, I will consider this and update my script. I appreciate you taking the time to help me.
Apr 24, 2017 at 18:38 history tweeted twitter.com/StackCodeReview/status/856578060178653185
Apr 24, 2017 at 13:36 history edited 200_success CC BY-SA 3.0
edited tags; edited title
Apr 24, 2017 at 13:22 answer added alecxe timeline score: 4
Apr 24, 2017 at 12:53 answer added Graipher timeline score: 4
S Apr 24, 2017 at 12:38 history suggested Martijn Pieters CC BY-SA 3.0
Cut away some of the chatter to focus on the actual question. Remove snippet syntax.
Apr 24, 2017 at 12:22 review Suggested edits
S Apr 24, 2017 at 12:38
Apr 24, 2017 at 12:16 comment added dot.Py IMO using ii instead of i is kinda ugly.
Apr 24, 2017 at 12:14 history migrated from stackoverflow.com (revisions)
Apr 24, 2017 at 12:13 history asked Travis Bathurst CC BY-SA 3.0