All Questions

Tagged with
Filter by
Sorted by
Tagged with
0votes
0answers
5views

Selenium using python and configuration problem

I have installed Pycharm community edition and configured the interpreter successfully which includes selenium also. Wen I am trying to write selenium code like calling webdriver . It is not ...
user avatar
-1votes
1answer
12views

Getting the same HREF link instead of different HREF links with Selenium

This is the first time I'm making a website scraper and I'm relatively new to programming in general. So I'm trying to get the HREF links for all the subpages on this site:. But when I ran the code, ...
user avatar
  • 1
1vote
2answers
32views

Selenium Select to return a list?

In python we have: select = Select(driver.find_element_by_id('fruits01')) But what if I want to have a list of all select tags and not just the first one? I tried: select = Select(driver....
user avatar
  • 23
1vote
1answer
33views

Python Selenium How to Select from Dropdown?

I was testing my code over: https://semantic-ui.com/modules/dropdown.html I wrote the following code in Python3 which finds all drop-downs in a given webpage and selects the last option for each drop-...
user avatar
  • 23
0votes
0answers
7views

i try click button "tweet" but i can't do nothin in new window

action = ActionChains(self.driver) find = self.driver.find_element finds = self.driver.find_elements #FADED = (By.XPATH, '//*[@id="homefeatured"]/li[1]/div/div') faded = find(...
user avatar
1vote
1answer
19views

How to display a certain number of links along with information

How to display a certain number of links along with information? First code asks me which page to open and how many items to display. But no matter what I do, my links are displayed correctly, but the ...
user avatar
  • 47
2votes
3answers
35views

How to scrape the list of image urls from college football data using Selenium by class_name

I'm trying to scrape player data from college football roster sites. I am primarily interested in getting the player image, weight, and name. I have already been able to extract the weight and name ...
user avatar
-1votes
1answer
34views

Selenium How to Submit Form?

I was testing: 177.6.167.168 on my python script which uses selenium I tried: password_input.send_keys(Keys.RETURN) and login_form.submit() where password_input is the password input in the login ...
user avatar
  • 51
1vote
2answers
48views

How to display a certain amount of information. Python 3

How to display a certain amount of information. I am using selenium I have 15 items displayed (there are 15 on the page). And I need to limit the amount of output information (My English is bad) from ...
user avatar
  • 47
0votes
1answer
15views

Scroll down the dynamically loading webpage

I am using this code given below to scroll down a dynamically loading webpage. Time_delay =3 # Get scroll height last_height = driver.execute_script("return document.body.scrollHeight") ...
user avatar
0votes
1answer
23views

My web crawler gets stuck on the Dell website. Is it fixable?

First off, I'm new to coding and Python. This is the first project that I came up with to try. When I run this code there are no errors and I get to the point of opening the Dell website, inputting ...
user avatar
1vote
1answer
36views

Can Selenium detect when webpage finishes loading in Python3?

In python I wrote: driver = webdriver.Chrome(service=Service(ChromeDriverManager().install()), options=chrome_options) driver.get(url) try: WebDriverWait(driver, 10).until( lambda driver: ...
user avatar
  • 51
0votes
2answers
43views

Buttons click with selenium webdriver not work/not found

Actually, i have a script with python 3.10, selenium, undetected-chromedriver and i want to click on two buttons on this webpage: https://keepa.com/#! Buttons are french flag, and ".fr" here:...
user avatar
  • 85
0votes
1answer
108views

Python Selenium stuck after page "loaded"

I'm using these options with chrome version 99.0.4844.82: chrome_options = Options() chrome_options.page_load_strategy = 'eager' chrome_options.add_argument('--no-sandbox') chrome_options.add_argument(...
user avatar
0votes
0answers
29views

What is ReadTimeoutError in python selenium?

2022-03-15 16:21:01,230 : POST http://127.0.0.1:34661/session/51dfe287ba054e814c0b664c662330c5/element {"using": "css selector", "value": "[name=\"Submit\"]...
user avatar
0votes
0answers
19views

Selenium - Convert Web page to PDF with WKHTML?

While inside as a Logged In Session as a User with Selenium, currently i'am trying to convert the Web Page to PDF using WKHTML. The PDF that is generated only shows half of the article, as if the web ...
user avatar
  • 151
1vote
1answer
41views

Python+Selenium How to find elements by class name length

Title is very explicative, i'm looking for every class in the page having a certain lenght. Now i'm using list=[] #empty array elements = x.find_elements(By.XPATH,"//*[@class]") #finds out ...
user avatar
0votes
1answer
48views

Selenium - How to automatically Download PDF Files of Web Page if there is no Download Button?

1.) I'am trying to Download the Article PDF Files from multiple web pages to a local folder on the computer. But there is now "Download PDF" button on the web pages. What would be the ...
user avatar
  • 151
0votes
1answer
14views

Seleniumwire dont intercept HTTPS if user-data-dir is defined

I try to intercept requests by seleniumwire. If I dont use option --user-data-dir everything is fine. All requests are showed by driver.requests. But I need parse some sites with authentication. So I ...
user avatar
-2votes
1answer
31views

How can i call a Python Function from C++ in the same instance succesfully?

hey so im trying to embed Python Selenium in C++ , but i managed it to just open the browser and get a item. How can i succesfully open the browser and search HELLO inside the google searchbar? #...
user avatar
0votes
0answers
20views

Using the Action Chains with Firefox rightclick is happening but action is not taking place

With Firefox By using ActionChains giving the right click on the map, it should open the menu. but the problem is right-clicked is happening but the menu isn't opening. using gecko driver version 0.30....
user avatar
  • 1
-1votes
0answers
21views

Web-scrapping problem, cant scrap sections from div - Python [closed]

Hello everyone I have a problem, I would like to extract my bets, stakes, winnings, etc. from my bookmaker, make a sheet and visualize it, calculate the profit, etc., a kind of scrap out of boredom ...
user avatar
0votes
1answer
43views

selenium cannot find element using python

This is the html I got and I'm trying to select this fsuser and use send_keys to input some value. I tried this: input_username = driver.find_element_by_xpath("//table/tbody/tr[2]/td/form/table/...
user avatar
  • 11
0votes
1answer
20views

Python Selenium How to click on the Input type number increment or decrement buttons

With Python Selenium how can I click on the increment or decrement buttons of an Input type number. The increment and decrement buttons are Browser specific objects and not part of the DOM. So I can ...
user avatar
  • 1,445
-1votes
2answers
44views

webscraping from cnn function to get text from a article error in python

So i want to get the text from a specific article(not only one) so heres the function therefore: def get_article(): for url in get_href(): options = webdriver.ChromeOptions() ...
user avatar
  • 1
0votes
0answers
12views

Python traceback occurs when trying to located element by xpath

Currently have a script which logs me into our company website, clicks an element which loads a table of data i'm trying to collect, the code that provides traceback is selenium.common.exceptions....
user avatar
1vote
2answers
37views

Python help me in returning the corresponding index of this list

I have two distinct columns on a csv file one for numbers (values may occur twice or more times) and the other for links.each row on the file represent a different element I added them into two lists ...
user avatar
-1votes
1answer
27views

how i can open up many links with chromedriver that are stored in one variable

So i wrote this code for now to web-scrape cnn and get articles about a specific topic: from bs4 import BeautifulSoup import time from selenium import webdriver from webdriver_manager.chrome import ...
user avatar
0votes
0answers
10views

Changing innerhtml(onclick) in selenium python without auto reload

I'm trying to replace an innerhtml "onclick" element of educational website. Which originally is onclick="if(movieEnd){fnViewChildMove('4', 'ft05', '403');}else{ alert('Finish the video ...
user avatar
1vote
2answers
37views

selenium loop through radio buttons python

I am trying to loop through two radio buttons click on one get some details and then click on the second one and get the same details again. Its clicking on the first one but I can't get it to click ...
user avatar
0votes
1answer
39views

Unable to load existing firefox profile with selenium 4's option.set_preference in python

I have this code that works and loads the firefox profile from selenium import webdriver from selenium.webdriver.firefox.options import Options from selenium.webdriver.firefox.firefox_profile import ...
user avatar
  • 379
1vote
1answer
33views

How to send text within username input field on a https://discord.com/register webpage with Selenium and Python3

I'm trying to select the username text box in the https://discord.com/register website I tried: driver.find_element ( by=By.CSS_SELECTOR ...) driver.find_element ( by=By.CLASS_NAME ...) driver....
user avatar
-1votes
1answer
44views

Error when webscraping news from cnn using selenium and bs4 to get links and titles from articles

I wrote this code for now to webscrape news from a spacific topic from cnn: from bs4 import BeautifulSoup from selenium import webdriver from selenium.webdriver.chrome.service import Service ...
user avatar
0votes
1answer
48views

Python Selenium cannot click the close button

I am trying to download the data from https://projects.propublica.org/nonprofits for my research. When the page is open, a notification window pops up. I tried to use python selenium to close it. My ...
user avatar
0votes
1answer
33views

TypeError: object of type 'numpy.int64' has no len() selenium

first of all i'm sorry if this isn't the good place to ask my question i'm trying to learn python i'm learning web form filling automation here's my code from selenium import webdriver from selenium....
user avatar
0votes
1answer
26views

How to make our webscraping script check both scenarios but execute only the one needed

I scrape some data on website, here's my script : import warnings warnings.filterwarnings("ignore") import re import requests from requests import get from bs4 import BeautifulSoup import ...
user avatar
0votes
1answer
19views

python selenium upload images to an element?

How do I upload images to an element? enter code here <input type="file" class="inline_upload" onchange="WallPosting.onFeedUploadInputChange(this, event, '/wall?act=add&...
user avatar
  • 1
0votes
1answer
25views

My code cannot append next pages tables to the end of the list

I trying to scrap all tables of 8 pages but my code just scrap 1st table. It can move to other pages also it works individually on each page but it cannot scrap all pages. data_ingram = [] n = 1 for i ...
user avatar
  • 63
1vote
1answer
41views

Selenium + Python: Print an element that I located by ID

I am new to Selenium and Python. I would like to navigate through a website, find an element and print it (or store it in a csv file). Python version: 3.10; Selenium Webdriver: Firefox; IDE: PyCharm ...
user avatar
  • 35
-1votes
1answer
33views

check if any child element meets specific words starting from a sibling DOM

I would like seach which of these siblings has a specific text 'app'. Since there are no absolute references I start my search from the word 'DOD'. Afterwards, I search: following-sibling::td/div/...
user avatar
  • 21
0votes
1answer
29views

Extract key in messy website with Beautiful soup

I'm new in webscraping with beautiful soup and I have some problems... Here is my code from bs4 import BeautifulSoup import numpy as np from time import sleep from random import randint from selenium ...
user avatar
0votes
1answer
20views

Scraping points on a graph on a website using beautifulsoup or selenium

I want to get the values of the data points from the graph titled "Total Followers for 'OlympusDAO' (Monthly)" from this website: https://socialblade.com/twitter/user/olympusdao/monthly Here'...
user avatar
  • 143
0votes
0answers
27views

Selenium (Python) .click_and_hold().perform() more than once

I'am trying to scroll results from google maps, then go to more results and then scroll again, but click function (to down/up the bar) only works once. part of my code: from selenium import webdriver ...
user avatar
0votes
1answer
11views

Jenkins cloud : Chrome failed to start: exited abnormally

I have this code to run a simple automated test : class AddToCartTest(unittest.TestCase): direct = os.getcwd() def setUp(self): if os.getenv('CHROMEWEBDRIVER'): chromewebdriverbin = os....
user avatar
0votes
0answers
32views

"TypeError: expected string or bytes-like object" when setting cookies gotten from selenium to python requests

I wrote a selenium script to get the cookies of a site: pickle.dump(driver.get_cookies() , open("cookies.pkl","wb")) and i try to pass the gotten cookies to requests cookies = ...
user avatar
  • 37
0votes
1answer
67views

How to use Selenium with Scrapy?

I am new to web scraping. I am learning web scraping in Python. I am following the documentation from this link. I was trying to integrate Selenium into my practice but I was not successful. So, I ...
user avatar
0votes
2answers
26views

Select specific HREF link using Selenium Python

I'm trying to automate a download via Selenium using Python. The website I'm trying to download from has multiple options, with each option having a HTML HREF and an Excel HREF. So the site code looks ...
user avatar
0votes
1answer
25views

How do i loop to one page to another in my web scraping project.. should scrap datas from all 250 pages..But it stops in the first page

#So this is a part of the scrapping code...but it does not gets looped more than the first page please help me to loop all through 250 pages of the etsy ecommerce website URL = f'https://www.etsy.com/...
user avatar
1vote
1answer
36views

How to skip a request if it shows an error message on python

I want to create a script that grabs the info from the website using selenium. However, if it doesn't find the info and shows an error message, it skips that request and continues to the next one. ...
user avatar
  • 25
0votes
2answers
40views

Select date from daterangepicker using selenium

I want to select date from daterangepicker: Ex of daterangepicker: Default: Mar 09, 2022 - Mar 13, 2022 .html Code: <input type="text" class="form-control travel-date-section" ...
user avatar

15 30 50 per page
1
2 3 4 5
99