Semantic Web Search Application IE

This project was taken as a year long project under IE NITK 2020.

Demo

Requirements

• ElasticSearch
• Flask
• Universal Sentence Encoder

Usage

Move the Univesal_Encoder folder to the Spiders folder in the Directory. Go to the Spiders Directory and run the following command

scrapy crawl stackoverflow -o <output file name>.json

After installing ElasticSearch, go to its directory and run

.\bin\elasticsearch.bat

Move the Universal_Encoder folder back to IE_Web_Search_Application.

Run the API.py file from the root directory using the following command:

python api.py

Run the App.py file from the root directory using the following command:

python app.py

Project Structure

• IE_Web_Search_Application
  • ElasticSearch Test.ipynb
  • README.md
  • api.py
  • app.py
  • images
    • demo_image(1).jpeg
    • demo_image(2).jpeg
    • demo_image(3).jpeg
    • demo_image(4).jpeg
    • demo_image(5).jpeg
  • templates
    • WhatsApp Image 2021-03-06 at 9.40.01 PM.jpeg
    • image_search.html
    • index.html
    • result.html
    • search.html
    • style.css
  • universal_encoder
    • saved_model.pb
    • variables
      • variables.data-00000-of-00001
      • variables.index
  • wsa_scraper
    • index.py
    • scrapy.cfg
    • wsa_scraper
      • __init__.py
      • items.py
      • middlewares.py
      • pipelines.py
      • settings.py
      • spiders
        • stackoverflow.py
        • temp.json
        • test.json
        • universal_encoder
          • saved_model.pb
          • variables
            • variables.data-00000-of-00001
            • variables.index