Using Selenium to fetch product information from an online store produces no data even though the browser opens. See revised sample code below:
from selenium import webdriver
from selenium.webdriver.common.by import By
import time, json
drvr = webdriver.Chrome()
drvr.minimize_window()
drvr.get('https://exampleecom.com/items')
time.sleep(10)
cards = drvr.find_elements(By.XPATH, "//div[@class='item-card']")
extracted = []
for card in cards:
try:
name = card.find_element(By.XPATH, './/h2').text
except Exception:
name = ''
try:
cost = card.find_element(By.XPATH, './/span[@class="amount"]').text
except Exception:
cost = ''
extracted.append({'name': name, 'price': cost})
with open('results.json', 'w') as fout:
json.dump(extracted, fout)
drvr.quit()
Need guidance to resolve this issue.