Web Scraping (2/2)

  • Selenium webdriver.
  • Python / Ruby or Javascript , HTML , CSS
  • Learn to parse robots.txt file.
  • Knowing how to inspect elements / selectors
  • Basic knowledge of web development
  • Familiar with Chrome Developer Tools
  • Crawl data for marketing which is common in many companies
  • Extract information for data processing (to train your “AI”)
  • Bettings / gambling / entertainment. Many folks do this to extract information to analyze their gambling bets
  • Capture rentals location, cheapest deals (air ticket, any items that you want to monitor before purchasing) , big items purchase, financial stock for personal usage



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store


I am a Software Engineer. Follow me on Linkedin at linkedin.ivantay.org