Skip to main content

Timeline for Scraping webelements if found

Current License: CC BY-SA 4.0

18 events
when toggle format what by license comment
S Jul 17, 2021 at 21:15 history bounty ended PythonNewbie
S Jul 17, 2021 at 21:15 history notice removed PythonNewbie
Jul 17, 2021 at 7:20 vote accept PythonNewbie
Jul 16, 2021 at 13:18 answer added ShapeOfMatter timeline score: 2
Jul 16, 2021 at 3:19 answer added Reinderien timeline score: 3
Jul 15, 2021 at 19:43 comment added PythonNewbie @Mast Python 3.8 :) 3.8.2 to be exact
Jul 15, 2021 at 19:25 comment added Mast For what Python version did you write this, Python 3.7? .8? .9?
Jul 15, 2021 at 17:58 comment added PythonNewbie @Mast Yes :) It should work in any sydsvenskan.se articles for now. :) Later on the point is to do a copy paste of this script and create for other sites such as bbc news etc etc...
Jul 15, 2021 at 17:56 comment added Mast Does this scrape only a single page? Just 1?
S Jul 15, 2021 at 17:27 history bounty started PythonNewbie
S Jul 15, 2021 at 17:27 history notice added PythonNewbie Canonical answer required
Jul 14, 2021 at 8:42 comment added PythonNewbie @Reinderien I have now updated the code and this is the real code I have been working on for a while with some pause in between. I hope this is much better compare from the beginning :)
Jul 14, 2021 at 8:38 history edited PythonNewbie CC BY-SA 4.0
deleted 94 characters in body
Jul 13, 2021 at 19:08 history edited PythonNewbie CC BY-SA 4.0
added 2033 characters in body
Jul 13, 2021 at 18:50 comment added PythonNewbie @Reinderien I will work on a more real end to end scraper in that case :) Should I update this thread and create a new one for that?
Jul 13, 2021 at 18:39 comment added PythonNewbie @Reinderien the context manager, the logging with discord notification and all that you have taught me is implemented but this was more a question regarding the "If we find a webelement, then we take the text/href or whatever else it can be and if we dont find the element then return empty."
Jul 13, 2021 at 18:37 comment added PythonNewbie Hi @Reinderien, Regarding the adopted stuff that you have taught me is still there. The reason I haven't added it here is due to I wanted to make it easy for the people to use the script where I am more curious about the scraping part where I use the dataclasses like you showed me before but without the dicts if you remember. The difference is that when we last spoke we or rather I didnt had the chance to ask if we find rhe webelement then we should return it with the dataclass and if not then return empty value and thats what I was looking for.
Jul 13, 2021 at 17:26 history asked PythonNewbie CC BY-SA 4.0