Dockerized SB with UC mode doesn't save file in downloaded_files dir

[balovp]

Hello. We had built docker image with seleniumbase. Seleniumbase runs scripts well, saves screenshots, but doesn't download files into downloaded_files folder. Could you help us?

requirements.txt

dockerfile:

FROM debian:bullseye-20240513

ARG ARGUMENTS

ARG USER_ID

ARG GRUP_ID

ARG OPTIONS

# WORKDIR /

COPY requirements.txt .

USER root

#============================
# Install Linux Dependencies
#============================
RUN apt update && apt install -y \
    software-properties-common \
    apt-transport-https \
    ca-certificates \
    libcairo2-dev \
    fonts-liberation \
    libasound2 \
    libatk-bridge2.0-0 \
    libatk1.0-0 \
    libatspi2.0-0 \
    libcups2 \
    libdbus-1-3 \
    libdrm2 \
    libgbm1 \
    libgtk-3-0 \
    libnspr4 \
    libnss3 \
    libwayland-client0 \
    libxcomposite1 \
    libxdamage1 \
    libxfixes3 \
    libxkbcommon0 \
    libxrandr2 \
    libu2f-udev \
    libvulkan1 \
    xdg-utils \
    dirmngr \
    gnupg2

#=================================
# Install Bash Command Line Tools
#=================================
RUN apt-get -qy --no-install-recommends install \
    curl \
    sudo \
    unzip \
    nano \
    wget \
    xvfb && \
    rm -rf /var/lib/apt/lists/*

#================
# Add GPG-keys
#================
RUN gpg --batch --keyserver hkp://keyserver.ubuntu.com --recv-keys E88979FB9B30ACF2 && \
    gpg --export --armor E88979FB9B30ACF2 | apt-key add - && \
    apt-get purge -y gnupg2 dirmngr && \
    rm -rf /var/lib/apt/lists/*

#================
# Install Chrome
#================
RUN curl -fSsL https://dl.google.com/linux/linux_signing_key.pub | gpg --dearmor | tee /usr/share/keyrings/google-chrome.gpg >> /dev/null && \
    echo deb [arch=amd64 signed-by=/usr/share/keyrings/google-chrome.gpg] http://dl.google.com/linux/chrome/deb/ stable main | tee /etc/apt/sources.list.d/google-chrome.list && \
    apt update && apt install -y google-chrome-stable

#================
# Install Python
#================
RUN apt update && apt install -y \
    python3-setuptools \
    python3-venv \
    python3-pip \
    python3-dev \
    python3 && \
    alias python=python3 && \
    echo "alias python=python3" >> ~/.bashrc

#===========================
# Configure Virtual Display
#===========================
RUN set -e && \
	  echo "Starting X virtual framebuffer (Xvfb) in background..." && \
	  Xvfb -ac :99 -screen 0 1280x1024x16 > /dev/null 2>&1 & \
	  export DISPLAY=:99 && \
	  exec "$@"

COPY SeleniumBase /SeleniumBase
COPY SeleniumBase/integrations/docker/docker-entrypoint.sh /
COPY SeleniumBase/integrations/docker/run_docker_test_in_chrome.sh /

RUN chmod +x *.sh && \
	  python3 -m venv venv && \
	  pip install --upgrade pip

RUN pip install -r requirements.txt && \
  	pip install --upgrade pip setuptools wheel

ENV PYTHONPATH=/home/app/.local

ENTRYPOINT ["/docker-entrypoint.sh"]
CMD ["/bin/bash"]

testing script:

from seleniumbase import SB
import os


with SB(uc=True, headless2=True) as sb:
    sb.open("http://xcal1.vodafone.co.uk/")
    sb.uc_click('a[href="http://212.183.159.230/5MB.zip"]')


    sb.driver.sleep(30)

[mdmintz]

Not sure what's going on with your Dockerfile, but here's a regular script that downloads the files in the same way you did: (Headless, UC Mode, uc_click):

from seleniumbase import SB

with SB(uc=True, headless2=True) as sb:
    sb.open("https://pypi.org/project/sbvirtualdisplay/#files")
    sb.assert_element("span#pip-command")
    sb.assert_text("Download files", "div#files h2.page-title")
    sb.assert_text("Download files", "a#files-tab")
    pkg_header = sb.get_text("h1.package-header__name").strip()
    pkg_name = pkg_header.replace(" ", "-")
    whl_file = pkg_name + "-py2.py3-none-any.whl"
    tar_gz_file = pkg_name + ".tar.gz"

    # Click the links to download the files into: "./downloaded_files/"

    whl_selector = 'div#files a[href$="%s"]' % whl_file
    tar_selector = 'div#files a[href$="%s"]' % tar_gz_file

    sb.uc_click(whl_selector)  # Download the "whl" file
    sb.sleep(0.1)
    sb.uc_click(tar_selector)  # Download the "tar" file

    sb.sleep(2)

    sb.assert_downloaded_file(whl_file)
    sb.assert_downloaded_file(tar_gz_file)
    print("Successfully downloaded files!")

If the issue is with Docker, then there's probably someone else who can give better help.

[balovp]

I have succesfully built with your dockerfile yesterday, but container didn't run, returning an error:

$ docker run -it seleniumbase
exec /docker-entrypoint.sh: no such file or directory

I use docker desktop on my windows 10 x64 laptop

[mdmintz]

I saw this:

=> ERROR [ 5/38] RUN apt-get install -y ./google-chrome-stable_current_amd64.deb                      0.3s 
------                                                                                                      
 > [ 5/38] RUN apt-get install -y ./google-chrome-stable_current_amd64.deb:                                 
0.264 Reading package lists...
0.293 Building dependency tree...
0.294 Reading state information...
0.296 Some packages could not be installed. This may mean that you have
0.296 requested an impossible situation or if you are using the unstable
0.296 distribution that some required packages have not yet been created
0.296 or been moved out of Incoming.
0.296 The following information may help to resolve the situation:
0.296 
0.296 The following packages have unmet dependencies:
0.296  google-chrome-stable:amd64 : Depends: libasound2:amd64 (>= 1.0.17) but it is not installable
0.296                               Depends: libatk-bridge2.0-0:amd64 (>= 2.5.3) but it is not installable
0.296                               Depends: libatk1.0-0:amd64 (>= 2.2.0) but it is not installable
0.296                               Depends: libatspi2.0-0:amd64 (>= 2.9.90) but it is not installable
0.296                               Depends: libc6:amd64 (>= 2.17) but it is not installable
0.296                               Depends: libcairo2:amd64 (>= 1.6.0) but it is not installable
0.296                               Depends: libcups2:amd64 (>= 1.6.0) but it is not installable
0.296                               Depends: libcurl3-gnutls:amd64 but it is not installable or
0.296                                        libcurl3-nss:amd64 but it is not installable or
0.296                                        libcurl4:amd64 but it is not installable or
0.296                                        libcurl3:amd64 but it is not installable
0.296                               Depends: libdbus-1-3:amd64 (>= 1.9.14) but it is not installable
0.296                               Depends: libdrm2:amd64 (>= 2.4.75) but it is not installable
0.296                               Depends: libexpat1:amd64 (>= 2.1~beta3) but it is not installable
0.296                               Depends: libgbm1:amd64 (>= 17.1.0~rc2) but it is not installable
0.296                               Depends: libglib2.0-0:amd64 (>= 2.39.4) but it is not installable
0.296                               Depends: libgtk-3-0:amd64 (>= 3.9.10) but it is not installable or
0.296                                        libgtk-4-1:amd64 but it is not installable
0.296                               Depends: libnspr4:amd64 (>= 2:4.9-2~) but it is not installable
0.296                               Depends: libnss3:amd64 (>= 2:3.35) but it is not installable
0.296                               Depends: libpango-1.0-0:amd64 (>= 1.14.0) but it is not installable
0.296                               Depends: libvulkan1:amd64 but it is not installable
0.296                               Depends: libx11-6:amd64 (>= 2:1.4.99.1) but it is not installable
0.296                               Depends: libxcb1:amd64 (>= 1.9.2) but it is not installable
0.296                               Depends: libxcomposite1:amd64 (>= 1:0.4.4-1) but it is not installable
0.296                               Depends: libxdamage1:amd64 (>= 1:1.1) but it is not installable
0.296                               Depends: libxext6:amd64 but it is not installable
0.296                               Depends: libxfixes3:amd64 but it is not installable
0.296                               Depends: libxkbcommon0:amd64 (>= 0.5.0) but it is not installable
0.296                               Depends: libxrandr2:amd64 but it is not installable
0.296 E: Unable to correct problems, you have held broken packages.
------
Dockerfile:46
--------------------
  44 |     #================
  45 |     RUN curl -LO  https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb
  46 | >>> RUN apt-get install -y ./google-chrome-stable_current_amd64.deb
  47 |     RUN rm google-chrome-stable_current_amd64.deb
  48 |     
--------------------
ERROR: failed to solve: process "/bin/sh -c apt-get install -y ./google-chrome-stable_current_amd64.deb" did not complete successfully: exit code: 100

The same script worked for me before, so I’m wondering what changed. Maybe something with Docker Desktop on a Mac.

[mdmintz]

Nevermind, this solved it (macOS M2): docker build --platform linux/amd64 -t seleniumbase .

[balovp]

Would be great if you test your script in dockerized seleniumbase and write back!

[mdmintz]

It worked in the Dockerfile: pytest test_download_files.py --xvfb --headed --uc
SeleniumBase/examples/test_download_files.py

Important things to note: UC Mode must be headed to work properly on Linux. The latest version of SeleniumBase gives you a special X11 virtual display to handle that. (--xvfb / xvfb=True)

[codesshaman]

You need check your relative path to the file in COPY directive. If you run entrypoint from root ( / ) your need copy this file from contain folder to root.