Skip to main content
4 of 6
added 92 characters in body

For simply content scrapping without javascript and ajax content try scrapy for best practices. Scrapy uses python classes by default as it is a python framework. Easy tutorial to learn Scrapy ScrapingHub Tutorial Official site of ScrappingHub

Selenium is good for scraping dynamic content and causes unnecessary overhead as mentioned in above answer.

For above code: Try avoiding time.sleep and use EC.presence_of_element_located and similar functions to obtain desired behavior. Selenium Waits