Skip to content

Automation for capturing full-size screenshots of web pages and HTML files using Selenium web scraping tools

License

Notifications You must be signed in to change notification settings

Mohamad-fcz/Fullsize_screenshot

Repository files navigation

  

GitHub release (latest by date)    GitHub    GitHub top language GitHub top language GitHub top language GitHub top language

This program makes use of a straightforward method for automating the process of taking periodic full-page screenshots from HTML files stored on your local hard drive or web pages retrieved from the internet.

This application makes use of the most well-known web scraping tools, such as Selenium and chrome web driver, in order to capture full-size screenshots of web pages for the purpose of tracking and analyzing changes. One of the many applications that can be linked to deep learning and used to fit a model with the help of a sequence of screen shots includes, for instance, the movement of hurricanes and the results of sensor readings.

Storm heat

FIRST_COH_0124_event

Features

  • 100% Jupyter Notebook
  • Compatible with IDEs such as Pycharm
  • Jupyter widgets base for more convenience to use
  • Light weight

Installation

This project makes use of Jupyter Notebooks for increased convenience. In order for you to be able to interact with the widgets contained within the notebook, you will first need to install Jupyer Notebook along with its dependencies in the form of Ipywidgets.

Installing Jupyter Lab or installing the Jupyter meta package through conda is the more convenient alternative for achieving this objective. Both of these options make it simple for you to access everything in an effective Jupyter environment that you might require for this project or other projects.

Check that you have the most recent version of Anaconda downloaded and installed on your system.

  • Downdload Anaconda Using Anaconda Prompt:
  • installing the most recent version of Jpyter along with all of its dependencies.
  conda install -c conda-forge jupyter

or

  • installing the most recent version of Jupyter notebook and activating Ipywidgets manually in case you are short on space or for any reason do not intend to install full Jupyter meta package from above method.
  conda install -c conda-forge notebook
  conda install -c conda-forge nb_conda_kernels
  conda install -c conda-forge jupyter_contrib_nbextensions
  conda install -c conda-forge ipywidgets

Afterwards, proceed to install the remaining packages that are necessary for web scraping.

  • Install the latest version of below packages in the environment using conda
  conda install -c conda-forge selenium
  conda install -c conda-forge webdriver-manager
  conda install -c conda-forge tqdm
 

How to use

Be certain to run the import cell as well as the functions cell.

With Jupyter widgets, you have a straightforward graphical user interface for setting parameters like the time between screenshots and the duration of the screenshots themselves. In the most recent update, we also included a feature that lets you feed the program code from locally stored HTML web pages on your hard drive.

In the following, we have provided two different examples of web page URLs and local HTML directory paths that can be copied and pasted into the program's text box.

without any pre/pro position and quotation mark

  https://github.com/Mohamad-fcz
  C:\Project\FullSize_Screenshot_Automation\Test.html

Screenshot_20230101_091004

After you have finished making configurations, you can begin the automation process by clicking the Done button and then running the last cell to begin the automation.

Author

  • portfolio

GitHub top language

🔗 Contacting us

portfolio linkedin twitter

FAQ

In the event that you run into any issues while utilizing the program, you are more than welcome to post a problem in the issues section of GitHub.