Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Twitter monitor #457

Open
wants to merge 9 commits into
base: master
Choose a base branch
from
Open

Twitter monitor #457

wants to merge 9 commits into from

Conversation

s1s1fo
Copy link

@s1s1fo s1s1fo commented Jan 25, 2020

Added a new module that allows to monitor the content published in Twitter either within a certain period of time or in real time, in addition to performing a sentiment analysis and a statistical analysis of the publications collected.

README


More information about the module features, instructions and more ... can be found here:

https://github.com/Sisifo-Stone/TwitterMon


TWITTERMON MODULE

New module "TwitterMon" is added to /var/www/modules:
It allows to monitor Twitter (no API needed) and check the results of the statistical and sentiment analysis.

It provides three web pages(monitor, analyse, settings):

  • /var/www/modules/TwitterMon/templates/TwitterMon.html
  • /var/www/modules/TwitterMon/templates/TwitterMon_results.html
  • /var/www/modules/TwitterMon/templates/TwitterMon_settings.html

Retrieving Tweets:

  • /var/www/modules/TwitterMon/TweetsImporter.py
  • /var/www/modules/TwitterMon/TM_Status.py

Module configuration:

  • /var/www/modules/TwitterMon/config/TwitterMon.cfg

Interface with AIL:

  • /var/www/modules/TwitterMon/Flask_TwitterMon.py

Auxiliary files:

  • /var/www/modules/TwitterMon/templates/header_TwitterMon.html
  • /var/www/templates/nav_bar.html
  • /var/www/templates/twittermon/menu_sidebar.html

TWEETS ANALYSIS

Statistical and Sentiment analysis are performed by the following files, once the Tweets are received in the queue:

  • TwitterAnalyzer.py
  • packages/Tweet.py
    Please note that the original Vader sentiment library is used due to the lack of emoji analysis in the ntlk.vader library.

AIL MODIFICATIONS

Modifications made to the AIL files are for launching the module, subscribe to Redis_Global, install dependencies and to display a link to the TwitterMon page:

  • LAUNCH.sh: Launch the module
  • packages/modules.cfg: Subscribe to Redis_Global
  • ../var/www/templates/nav_bar.html: Link to module
  • installing_deps.sh: Install dependencies of the module.

New module "TwitterMon" is added to /var/www/modules:
It allows to monitor Twitter (no API needed) and check the results of the statistical and sentiment analysis.

It provides three web pages(monitor, analyse, settings):
  -  /var/www/modules/TwitterMon/templates/TwitterMon.html
  -  /var/www/modules/TwitterMon/templates/TwitterMon_results.html
  -  /var/www/modules/TwitterMon/templates/TwitterMon_settings.html

Retrieving Tweets:
  -  /var/www/modules/TwitterMon/TweetsImporter.py
  -  /var/www/modules/TwitterMon/TM_Status.py

Module configuration:
  -  /var/www/modules/TwitterMon/config/TwitterMon.cfg
Statistical and Sentiment analysis are performed by the following files, once the Tweets are received in the queue:
  -  TwitterAnalyzer.py
  -  packages/Tweet.py
Please note that the original Vader sentiment library is used due to the lack of emoji analysis in the ntlk.vader library.
Launch TwitterMon module at start-up
Subscribe to Redis Global for TwitterAnalyzer.py (in charge of statistical and sentiment analysis of Tweets from TwitterMon)
Install dependencies for TwitterMon.
Please note that the original Vader sentiment library is used due to the lack of emoji analysis in the ntlk.vader library.
@codecov-io
Copy link

Codecov Report

Merging #457 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #457   +/-   ##
=======================================
  Coverage   12.02%   12.02%           
=======================================
  Files          74       74           
  Lines        7601     7601           
=======================================
  Hits          914      914           
  Misses       6687     6687

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b63fa51...784ba4f. Read the comment docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants