Skip to content

omarsar/data_mining_lab_fall_2

Repository files navigation

Hello Everyone,

Here is the list of packages needed for our second Data Mining Lab Session.

Software:


Computing Resources:


  • Operating System: Preferably Linux or MacOS (Windows break but you can try it out)
  • RAM: 4GB
  • Disk Space: 8GB (mostly to store word embeddings)

Test:


Once you have installed all the necessary packages, you can test to see if everything is working by running the following python code:

import logging
logging.root.handlers = []  # Jupyter messes up logging so needs a reset
logging.basicConfig(format='%(asctime)s : %(levelname)s : %(message)s', level=logging.INFO)
from smart_open import smart_open
import pandas as pd
import numpy as np
from numpy import random
import gensim
import nltk
from sklearn.cross_validation import train_test_split
from sklearn import linear_model
from sklearn.feature_extraction.text import CountVectorizer, TfidfVectorizer
from sklearn.metrics import accuracy_score, confusion_matrix
import matplotlib.pyplot as plt
from gensim.models import Word2Vec
from sklearn.neighbors import KNeighborsClassifier
from sklearn import linear_model
from nltk.corpus import stopwords
%matplotlib inline

If you have any further questions please feel free to contact me at [email protected]

Have Fun,

Elvis Saravia (Data Mining TA)