Timeline for Scraping webelements if found
Current License: CC BY-SA 4.0
18 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
S Jul 17, 2021 at 21:15 | history | bounty ended | PythonNewbie | ||
S Jul 17, 2021 at 21:15 | history | notice removed | PythonNewbie | ||
Jul 17, 2021 at 7:20 | vote | accept | PythonNewbie | ||
Jul 16, 2021 at 13:18 | answer | added | ShapeOfMatter | timeline score: 2 | |
Jul 16, 2021 at 3:19 | answer | added | Reinderien | timeline score: 3 | |
Jul 15, 2021 at 19:43 | comment | added | PythonNewbie | @Mast Python 3.8 :) 3.8.2 to be exact | |
Jul 15, 2021 at 19:25 | comment | added | Mast♦ | For what Python version did you write this, Python 3.7? .8? .9? | |
Jul 15, 2021 at 17:58 | comment | added | PythonNewbie | @Mast Yes :) It should work in any sydsvenskan.se articles for now. :) Later on the point is to do a copy paste of this script and create for other sites such as bbc news etc etc... | |
Jul 15, 2021 at 17:56 | comment | added | Mast♦ | Does this scrape only a single page? Just 1? | |
S Jul 15, 2021 at 17:27 | history | bounty started | PythonNewbie | ||
S Jul 15, 2021 at 17:27 | history | notice added | PythonNewbie | Canonical answer required | |
Jul 14, 2021 at 8:42 | comment | added | PythonNewbie | @Reinderien I have now updated the code and this is the real code I have been working on for a while with some pause in between. I hope this is much better compare from the beginning :) | |
Jul 14, 2021 at 8:38 | history | edited | PythonNewbie | CC BY-SA 4.0 |
deleted 94 characters in body
|
Jul 13, 2021 at 19:08 | history | edited | PythonNewbie | CC BY-SA 4.0 |
added 2033 characters in body
|
Jul 13, 2021 at 18:50 | comment | added | PythonNewbie | @Reinderien I will work on a more real end to end scraper in that case :) Should I update this thread and create a new one for that? | |
Jul 13, 2021 at 18:39 | comment | added | PythonNewbie | @Reinderien the context manager, the logging with discord notification and all that you have taught me is implemented but this was more a question regarding the "If we find a webelement, then we take the text/href or whatever else it can be and if we dont find the element then return empty." | |
Jul 13, 2021 at 18:37 | comment | added | PythonNewbie | Hi @Reinderien, Regarding the adopted stuff that you have taught me is still there. The reason I haven't added it here is due to I wanted to make it easy for the people to use the script where I am more curious about the scraping part where I use the dataclasses like you showed me before but without the dicts if you remember. The difference is that when we last spoke we or rather I didnt had the chance to ask if we find rhe webelement then we should return it with the dataclass and if not then return empty value and thats what I was looking for. | |
Jul 13, 2021 at 17:26 | history | asked | PythonNewbie | CC BY-SA 4.0 |