analysis.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import json"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "data = []\n",
    "with open('./../preprocess/total_eval') as f:\n",
    "    for line in f:\n",
    "        data.append(json.loads(line))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "datas = []\n",
    "for d in data:\n",
    "    for context, bio in zip(d['context'], d['bio']):\n",
    "        datas.append([context,d['topic'],bio])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "755"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(datas)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "ans = [[],[]]\n",
    "with open('./saved_models/total_crf/pred.txt') as f:\n",
    "    for i, line in enumerate(f):\n",
    "        ans[i%2].append(line.strip())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "B I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O O B I I I I I I I I I I I I B I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I O B I I I I I I I I I I I I O O O O O B I I I I I I I I I I I O B I I I I I I I I I I I I O\n",
      "preventative measures will help improve general health state of all citizens . for example , vaccines will guarantee that pregnant women and their babies are protected from serious infectious diseases such as flu , smallpox , rubella so on . when huge injection campaigns are organized throughout our country , the communitys health state will be improved remarkably . as human resources play a key role in the development of a country , investing money to enhance the general health state is a totally right decision . in addition , because the cost of treatment is often much higher than that of prevention , the government can save a lot of money for our countrys health budget .\n",
      "\n",
      "Prevention is better than cure\n",
      "\n",
      "['as', 'human', ',', 'investing', ',']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O O O O\n",
      "nowadays , many countries are concerned with the environment problems . there is a viewpoint that the government and big firms should assume the responsibility to protect the environment and normal citizens have nothing to do for that . personally , i think both government and common people should have the responsibility for the environment , but we need to analyze some specific situations .\n",
      "\n",
      "The environment problems facing today's world are so great\n",
      "\n",
      "['both', 'government', 'and', 'common', 'people', 'should', 'have', 'the', 'responsibility', 'for', 'the', 'environment']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I I I O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I O B I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "many people think that \" past has nothing to do with present , as time never stops , the next generations are completely different from the predecessors \" . although it is true that life changes rapidly , there are many things in the past that we can learn about , such as mistakes , success and knowledge in many fields of study .\n",
      "\n",
      "Success and knowledge\n",
      "\n",
      "['life', 'changes', 'rapidly', 'of', 'study']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "O O B I I I I I I I I I I O B I I I I I I I I I I I I I O B I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "secondly , peoples success in the past is as significant as those mistakes . if the predecessors mistakes are the indirect way that leads us to the goals , others accomplishment can be served as the direct way . by looking into the ways other people use to achieve their targets , we have the chance to make those mine , put them into practice and , of course , be successful like them . for instance , edisons statement \" genius is 1 percent inspiration and 99 percent perspiration \" is still helpful for everyone today , and probably in the future .\n",
      "\n",
      "Success and knowledge\n",
      "\n",
      "[',', 'others']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O B I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O O O\n",
      "all in all , the pasts mistakes , success and knowledge all have crucial impact on peoples lives today . we should make full use of the past , instead of ignoring it , for a better and brighter future .\n",
      "\n",
      "Success and knowledge\n",
      "\n",
      "['the', 'pasts', 'mistakes', ',', 'success', 'and', 'knowledge', 'all', 'have', 'crucial', 'impact', 'on', 'peoples', 'lives', 'today']\n",
      "-------------------------------------\n",
      "O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I O\n",
      "in conclusion , after analysing the effects of world games both for countries at war and for organising countries , it is clear that they not only constitute a tremendous appeal towards a peaceful society , but also guide the public demonstrations of national proudness . this has been true for centuries and will certainly not change in the foreseeable future .\n",
      "\n",
      "Sporting events easing international tensions, releasing patriotic feelings\n",
      "\n",
      "['after', 'analysing', 'the', 'effects', 'of', 'world', 'games', 'both', 'for', 'countries', 'at', 'war', 'and', 'for', 'organising', 'countries', ',', 'it', 'this', 'has', 'been', 'true', 'for', 'centuries', 'and', 'will', 'certainly', 'not', 'change', 'in', 'the', 'foreseeable', 'future']\n",
      "-------------------------------------\n",
      "O O O O B I I I I I I I I O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I O O B I I I I I I I I O\n",
      "O O O O O B I I I I I I I O O O O O O O O O O O O O B I I I I I I I I O O B I I I I I I I I O O B I I I I I I I I O\n",
      "all in all , that ease to prepare food has improved peoples lives . and that happened mainly because of the development of the technology . but people should be careful with what they eat , because some industrial foods are very bad for their health , so they should buy only food from well known brands .\n",
      "\n",
      "Easy preparation of food leads to a better life\n",
      "\n",
      "['that', 'ease', 'but', 'people', 'should', 'be', 'careful', 'with', 'what', 'they', 'eat']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I I I I I I O O O B I I I I I I I I I I I I I I I I I O O O O O B I I I I I I I I I I I I I I I I I I I I O O O O O B I I I I I I I I O\n",
      "O O B I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I O B I I I I I I I I I I I O O O B I I I I I I I I I I I I I I I I I O O O O O B I I I I I I I I I I I I I I I I I I I I O O O O O B I I I I I I I I O\n",
      "admittedly , some countries may place economic developments ahead of environmental protection , thus ruining the local environments . as these needy countries lack adequate financial and human resources , advanced technologies and experience , they have to rely on natural resources to maintain their living standards . besides , people in the poverty stricken areas are not likely to be equipped with knowledge to preserve the ecosystems . as a result , unchecked and reckless uses of the local raw materials may happen , which can put a strain on the natural resources . in this view , the economic development and environmental protection can be conflicting .\n",
      "\n",
      "Economic development vs environment\n",
      "\n",
      "[',', 'they']\n",
      "-------------------------------------\n",
      "O O O B I I I I I I I I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O\n",
      "O O O B I I I I I I I I I I I I I I I I I I O O O O O B I I I I I I I I I I I I I I I I O\n",
      "to conclude , the fast responding internet media with vast information will be replacing newspapers and magazines as new and information provider for valid reasons . though considering the current infrastructure and mindset of people , paper media will continue for another few years .\n",
      "\n",
      "Internet will end the era of newspapers and magazines\n",
      "\n",
      "['for', 'valid', 'reasons', 'considering', 'the', 'current', 'infrastructure', 'and', 'mindset', 'of', 'people', ',', 'paper', 'media', 'will', 'continue', 'for', 'another', 'few', 'years']\n",
      "-------------------------------------\n",
      "O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "O O O B I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "of course , some celebrities , e . g . writers , passionate entrepreneurs are good examples to children for they share fascinating stories or how to pursue their goal by doing something that has a meaning to them and may change the world .\n",
      "\n",
      "Drugs, alcohol and messy sex lives\n",
      "\n",
      "['for', 'they']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O O O O O O O O\n",
      "learning is a thing that we do in all of our lives . getting the best lessons , besides our abilities to self study , depends on our teachers a lot . there are people who believe that no one else is better than our parents in terms of teachers . i whole heartedly agree with this opinion because of these following reasons .\n",
      "\n",
      "Parents are our teachers from the very early time in our life\n",
      "\n",
      "['no', 'one', 'else', 'is', 'better', 'than', 'our', 'parents', 'in', 'terms', 'of', 'teachers']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "most of the universities in the world seek to develop some research in some countries . these researches can be aimed for several fields such as business or agriculture . if a university plans to develop a new research in my country and i have to choose between establishing a centre for business research or a centre for agriculture research , i would opt for the second one .\n",
      "\n",
      "A university plans to devlope a new research centre in your country\n",
      "\n",
      "['if', 'a', 'university', 'plans', 'to', 'develop', 'a', 'new', 'research', 'in', 'my', 'country', 'and', 'i', 'have', 'to', 'choose', 'between', 'establishing', 'a', 'centre', 'for', 'business', 'research', 'or', 'a', 'centre', 'for', 'agriculture', 'research', ',', 'i', 'would', 'opt', 'for', 'the', 'second', 'one']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I O B I I I I I O\n",
      "the issue of whether using of machine are bring many advantages to society is of great concern to many people . in my opinion , although using machines have many benefits , we cannot ignore its negative effects .\n",
      "\n",
      "Advantages and disadvantages of machines instead of human to do the work\n",
      "\n",
      "['although', 'using', ',', 'we']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I O B I I I I I I I I I I I I I I I O O O B I I I I I I I I I O O O B I I I I I I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I O\n",
      "O O B I I I I I I I I I I O B I I I I I I I I I I I I I I I O O O B I I I I I I I I I O O O B I I I I I O B I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "secondly , juveniles who possess mobile phones have great tendencies to become materialistic . they would not only purchase a phone because of its functionality but also for its brand . relatively , these do not come at a significant and inexpensive cost . furthermore , most of these juveniles are students so they would need their parents to support them financially for what they want . an illustration of this unfortunate trend can be seen almost everywhere these days , wherein most teens at an early age own phones which are worth twice the salary of their parents .\n",
      "\n",
      "Popularity of mobile phones to young people\n",
      "\n",
      "['so', 'they', 'an', 'illustration', 'of', 'this', 'unfortunate', 'trend', 'can', 'be', 'seen', 'almost', 'everywhere', 'these', 'days', ',', 'wherein', 'most']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O B I I I I I I I I I I O\n",
      "along with the development of technologies , advanced medical care has played an important role in the improvement of life expectancy . although the increase in life expectancy has some pressure on the medicare system , i am inclined to believe that the advanced medical care brings with it more benefits than disadvantages .\n",
      "\n",
      "Improved medical care\n",
      "\n",
      "['the', 'increase', 'in', 'life', 'expectancy', 'has', 'some', 'pressure', 'on', 'the', 'medicare', 'system']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I O\n",
      "O O B I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I O\n",
      "besides , nowadays technology is entering into our society really quick and scientists develop robots , which help people cope with their problems or just invent coffee machines , engines with integrated computers and etc . for example , before centeries , there were not washing machines , which clean your clothes , while a person do another job .\n",
      "\n",
      "There have been significant developments in the field of IT!\n",
      "\n",
      "['and', 'scientists']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I O O O O O O O O O O O O O O O O O O\n",
      "in the present age , it is a matter of fact that increasing minority languages have diminished from the world due to the proliferation of english . some people claim its a reasonable loss in globalization while others argue the demerits exceed the merits . personally , i agree with the former opinion .\n",
      "\n",
      "Influence of English - advantages outweigh the disadvantages\n",
      "\n",
      "['its', 'a', 'reasonable', 'loss', 'in', 'globalization']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O O\n",
      "there are many factors that contribute to ones success . however , which factor is the most influential one is open to debate . some people believe that nowadays the assitance from family is quite a essential factor in ones success . it seems that one can achieve success more easily with the help from his or her family . i agree with this statement . in my opinion , family plays a more important role in helping one to pursuit success . there are a couple of reasons .\n",
      "\n",
      "The opportunity to receive education from university\n",
      "\n",
      "['one', 'can', 'achieve', 'success', 'more', 'easily', 'with', 'the', 'help', 'from', 'his', 'or', 'her', 'family']\n",
      "-------------------------------------\n",
      "O O O O B I I I I I I I I I I I O O B I I I I I I I I O B I I I I I I I I I O B I I I I I I I I I I I I O O O O B I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I O O O O O O O B I I I I I I I I I I O B I I I I I I I I I I I I O B I I I I I O B I I I I I O\n",
      "O O O O B I I I I I I I I I I I O O B I I I I I I I I O B I I I I I I I I I O B I I I I I I I I I I I I O O O O B I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I O B I I I I O B I I I I I I I I I I O B I I I I I I I I I I I I O B I I I I I O B I I I I I O\n",
      "first of all , more and more people have the opportunity to receive education from university . since our parents receive better education than our grandparents did , they can provide more advices and helps in our career . in the past , seldom people have the chance to attend a collage . for example , my grandparents did not get a education even in high school , so when my father had difficulty in solving a problem in his childhood , he had to go to his teacher for help . things have changed a lot . i grow up in a better condition than my father did . whenever i have problems , i can always ask my parents for help . they can solve the problem quickly because they have learned quite a lot .\n",
      "\n",
      "The opportunity to receive education from university\n",
      "\n",
      "['things', 'have', 'changed', 'a', 'lot']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O\n",
      "nowadays , the popularity of mobile phones has brought about a lot of convenience but at the meanwhile a variety of problems as well , such as social , medical and technical problems . however , i do not think these disadvantages will outweigh the advantages brought by cell phones . in this essay , i would like to analyze these three issues in order to support my viewpoint .\n",
      "\n",
      "Effects of mobile phones\n",
      "\n",
      "['i', 'do', 'not', 'think', 'these', 'disadvantages', 'will', 'outweigh', 'the', 'advantages', 'brought', 'by', 'cell', 'phones']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O\n",
      "B I I I I I I I I I I I O O O O O O\n",
      "i prefer the serious movies which are simple , touching and powerful . here are my reasons .\n",
      "\n",
      "Serious or entertaining movies\n",
      "\n",
      "['i', 'prefer', 'the', 'serious', 'movies', 'which', 'are', 'simple', ',', 'touching', 'and', 'powerful']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O B I I I I I I I I I I I I I I I I O\n",
      "for the above reasons , i prefer to see those serious movies which make people have deep thoughts toward their real lives .\n",
      "\n",
      "Serious or entertaining movies\n",
      "\n",
      "['i', 'prefer', 'to', 'see', 'those', 'serious', 'movies', 'which', 'make', 'people', 'have', 'deep', 'thoughts', 'toward', 'their', 'real', 'lives']\n",
      "-------------------------------------\n",
      "O O O O B I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I O B I I I I I I I I I I I O\n",
      "O O O O B I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I O O O B I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I O B I I I I I I I I I I I O\n",
      "to start with , all people who are able to work should pay tax to the government , as it is the most important source of governments revenue , which is mainly used to serve all citizens . for example , a large proportion of the tax is spent on national defence and in maintaining social stability , so that every one can work and live in a peaceful environment . the tax is also used to pay the salaries of workers working in public service sectors , such as teachers and police officers . although these workers do not produce profit directly , what they do is for the well being of the whole society .\n",
      "\n",
      "Paying taxes is enough contribution from citizens\n",
      "\n",
      "[',', 'so', 'that', 'every']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I O O O O O O O O O O O O O O O O\n",
      "recently , a great deal of attention has been paid to means of transportation . some state that automobile is the most convenient transportation , while others assert that alternative forms of transport should be considered in view of environmental pollution . in my opinion , i strongly agree that alternative means of transportation and international laws in controlling automobiles should be introduced . in this essay , several reasons will be described carefully in the following passages .\n",
      "\n",
      "Alternative forms of transport to alleviate traffic congestion\n",
      "\n",
      "['alternative', 'means', 'of', 'transportation', 'and', 'international', 'laws', 'in', 'controlling', 'automobiles', 'should', 'be', 'introduced']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "O O O O O B I I I I I I O O O O O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "in summary , even though some people claim the convenience of automobile , i would state that alternative forms of transport and international laws on controlling automobiles are necessary due to the environmental protection and the alleviation of traffic congestion .\n",
      "\n",
      "Alternative forms of transport to alleviate traffic congestion\n",
      "\n",
      "['some', 'people', 'claim', 'the', 'convenience', 'of', 'automobile']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I O\n",
      "in summation , people may attend university for various reasons . some want to enjoy new experiences , some are going to prepare for their future career , while others are eager to develop their understanding . even though the purposes could be various , everybody who is studying in university should concentrate on the objectives and try their best .\n",
      "\n",
      "Concentrate on the objectives - people attend schools for various reasons\n",
      "\n",
      "['everybody', 'who', 'is', 'studying', 'in', 'university', 'should', 'concentrate', 'on', 'the', 'objectives', 'and', 'try', 'their', 'best']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I I I I I I I I I I O\n",
      "O O B I I I I I I I I O O O B I I I I I I I I I O\n",
      "i believe public museums and art galleries will still be necessary , even though we can see the art works and historical objects online .\n",
      "\n",
      "Are museums necessary?\n",
      "\n",
      "[',', 'even', 'though', 'we']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I O B I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I O B I I I I O B I I I I I I I I I O B I I I I I I I I I I I O\n",
      "seeing an art work on computer screen is not the same as you watch it by your own eyes . for instance , you cant see the texture of the artwork which is very important to study the skills used by the artist . whats more , not all the details of the artwork can be shown on the computer screen . some details might be dim since the resolution ratio of the screen is not high enough . these may influence the comprehension of the art work or historical objects .\n",
      "\n",
      "Are museums necessary?\n",
      "\n",
      "['since', 'the']\n",
      "-------------------------------------\n",
      "O O O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "O O O O O B I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "in conclusion , i believe we still need museums and art galleries but computers can be introduced to museums and galleries in order to help visitors to know more about the art works or historical objects .\n",
      "\n",
      "Are museums necessary?\n",
      "\n",
      "['but', 'computers']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O O O\n",
      "one of the best characteristics of a mature adult is responsibility , specially in financially matters . actually what is the best way to learn responsibility ? many people argue about learning their children the financial responsibility in young ages or in adulthood . i am a kind of person who believes to children should learn to manage their own money at a young age , due to reasons that i stated below .\n",
      "\n",
      "Children managing their own money - best way to learn responsibility\n",
      "\n",
      "['children', 'should', 'learn', 'to', 'manage', 'their', 'own', 'money', 'at', 'a', 'young', 'age']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I O\n",
      "O O O O O B I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I O\n",
      "although some people argue that children should be free to spend money to they what they want , in my opinion it is very important to learn our children from their beginning of their life to be financially responsible persons , because our personality form in childhood and it is not easy to change it in adulthood .\n",
      "\n",
      "Children managing their own money - best way to learn responsibility\n",
      "\n",
      "['children', 'should', 'be', 'free', 'to', 'spend', 'money', 'to', 'they', 'what', 'they', 'want']\n",
      "-------------------------------------\n",
      "O O O O B I I I I I O B I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I O B I I I I I I O O O B I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I O\n",
      "O O O O B I I I I I O B I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I O O O O B I I I I I I O B I I I I I I O B I I I I I I O O O B I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I O\n",
      "first of all , television has useful and educational programs . not only the up to date news , but also there are many programs which has educational purposes . if children can use those programs wisely , they can learn many information from it . for example , in korea , theres program called ebs . it is targeted for children to teenager . we can study subjects through ebs lecture . also , there are many documentary films such as the life of a great man in korea . using those education programs let people get a lot of inspirations instead of having negative effects .\n",
      "\n",
      "Tv has NO negative effects on children\n",
      "\n",
      "['.', 'it']\n",
      "-------------------------------------\n",
      "O O O B I I I I I I I I I I I I I I I I I I O O O B I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I O B I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I O O O O B I I I I I I I I O O O B I I I I I I I I I I O\n",
      "O O O B I I I I I I I I I I I I I I I I I I O O O B I I I I I I I I I O O B I I I I I I I I I I I O B I I I I I I I I O B I I I I I I I I I I O B I I I I I I I I I I I I I I I I I O O O O B I I I I I I I I I I I I I O B I I I I I I I I I I I O O O B I I I I I I I I I I O\n",
      "at first , it should have more alternatives to use public transportation , such as a subway train or a sky train . hence , people will have more ways to go to a place . since now buses are only a kind of public transportation in this community , it makes people in this area have no choice . they must take only a bus to go to another place . if a subway and a sky train are available here , it will be more convenience to them . for example , people can estimate time from taking a subway train due to the train schedule . on the contrary they cannot do so in case of a bus . also , this improvement will decrease a bad traffic on the road indirectly .\n",
      "\n",
      "One important thing that I want to change about my hometown\n",
      "\n",
      "[',', 'it', 'on', 'the', 'contrary', 'they']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O B I I I I I I I I I I I O O O O O O O B I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O B I I I I I I I O B I I I I I I I I I I I O O O O O O O B I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "based on the reasons demonstrated above , i prefer to express my opinion in person because the advantages of this are qualitatively greater than that of the opposite . in other words , i think the best way of communication is by means of face to face . it is not to say , of course , that other points of view are completely without merit . still , i am firmly convinced that the reasons i proposed in favor of my own sentiment are much more tenable and cogent .\n",
      "\n",
      "More convincing\n",
      "\n",
      "['i', 'prefer', 'to', 'express', 'my', 'opinion', 'in', 'person']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I O\n",
      "O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I O O O O O B I I I I I I I I I I I I I I I O\n",
      "the last 50 years have seen a significant increase in the number of tourist traveling worldwide . while some might think the tourism bring large profit for the destination countries , i would contend that this industry has affected the cultural attributes and damaged the natural environment of the tourist destinations .\n",
      "\n",
      "International tourism is now more common than ever before\n",
      "\n",
      "['the', 'tourism', 'bring', 'large', 'profit', 'for', 'the', 'destination', 'countries']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "most of what you said is either patently false or simplification to the point of absurdity , but more importantly has nothing to do with whether or not america is a democracy . democracies can be oppressive illiberal regimes , totalitarian systems , command and control socialist systems , social democracies , liberal capitalist states , oligarchies etc . you have yet to give evidence that there is widespread tampering with free and fair elections which define the us as a democratic state .\n",
      "\n",
      "america is not a democracy\n",
      "['but', 'more', '.', '.', '.']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O\n",
      "B I I I I I I I I I I\n",
      "is political power in the us held by elected officials ?\n",
      "\n",
      "america is not a democracy\n",
      "['is', 'political', 'power', 'in', 'the', 'us', 'held', 'by', 'elected', 'officials', '?']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O\n",
      "B I I I I I I I I I I\n",
      "are those officials elected in free and fair democratic elections ?\n",
      "\n",
      "america is not a democracy\n",
      "['are', 'those', 'officials', 'elected', 'in', 'free', 'and', 'fair', 'democratic', 'elections', '?']\n",
      "-------------------------------------\n",
      "B I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "B I I I I I I I I B I I I I I O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "cheating is not just a single mistake though . it is a series of mistakes , and each time the cheater made the \" mistake , \" he or she was making * a conscious knowing decision to betray his or her spouse * several times in a row by the time physical cheating happens .\n",
      "\n",
      "people who cheat on their spouses can and should , in some cases , be forgiven\n",
      "[',', 'and', 'each']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I B I I I I I I I I I I B I I I I I I I I I I I I I I I I B I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I B I I I I I I I I I I B I I I I I I I I I I I I I I I I B I I I I I I I I I I O B I I I I I I I I I I B I I I I I I I I I\n",
      "i think some of the biggest threats to global stability comes from the political fringes . its either the extreme left , or the extreme right . radicalism almost always leads to violence , and is a plague on democratic society and governments . since communism has been relegated to just a handful of countries , the far left has for the most part been dealt with however the far right continues to be a menace .\n",
      "\n",
      "most democracies are far too tolerant of extremism , especially the likes of neo fascism , neo nazism , radical islamism and violent intolerance . the world has been to soft on these ideologies and they need to be eliminated whenever they appear .\n",
      "[',', 'however', '.']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I O\n",
      "O O B I I I I I I I I I I I I I I I I B I I I I I I B I I I I I I I I I I I I O\n",
      "instead , i think governments should do much more and try to completely stamp out any signs of fascism after the horrors of world war 2 i find it completely absurd that we still put up with their ideologies .\n",
      "\n",
      "most democracies are far too tolerant of extremism , especially the likes of neo fascism , neo nazism , radical islamism and violent intolerance . the world has been to soft on these ideologies and they need to be eliminated whenever they appear .\n",
      "['i']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I O O B I I I I I I I B I I I I I I I I I I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I I O O B I I I I I I I B I I I I I I I B I I I I I I I I I I I I I\n",
      "bringing socio economic growth to communities that feel disenfranchised just is not enough , and their will always be a few bad apples these bad apples need to be weeded out instead , we allow them to spread their rot , and infect society .\n",
      "\n",
      "most democracies are far too tolerant of extremism , especially the likes of neo fascism , neo nazism , radical islamism and violent intolerance . the world has been to soft on these ideologies and they need to be eliminated whenever they appear .\n",
      "['instead']\n",
      "-------------------------------------\n",
      "O O O O O O\n",
      "B I I I I O\n",
      "the options are as follows :\n",
      "\n",
      "i believe you have three choices once you discover the suffering animals endure in the meat industry . . .\n",
      "['the', 'options', 'are', 'as', 'follows']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I I\n",
      "i think restricting this concept to the meat industry limits us to a \" vegetarian / vegan lifestyle vs . carnivore lifestyle \" debate , when its actually a lot deeper than that .\n",
      "\n",
      "i believe you have three choices once you discover the suffering animals endure in the meat industry . . .\n",
      "[',', 'when', 'its']\n",
      "-------------------------------------\n",
      "B O B I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "B O B I I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I B I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "yeah , i think theres just a limited number of things that people are capable of caring about at one time , and issues that are of personal relevance are always going to carry more weight . so while someone might take option 1 on a personally significant issue that has a lot of meaning to them , the limitations of the human mind force them to take option 3 on a whole lot of other issues . so somebody who takes option 3 on a particular issue may not be making a true choice to * ignore * that issue . they ' re just prioritizing their mental resources . without prioritizing those resources , theres a risk of \" compassion fatigue , \" which you see frequently among people in empathy intensive occupations ( especially medicine , education , and other fields where issues outside the individuals control tend to produce strong feelings of frustration and futility ) .\n",
      "\n",
      "i believe you have three choices once you discover the suffering animals endure in the meat industry . . .\n",
      "['theres', ',', 'and', 'issues', 'so', 'while', 'someone', 'so', 'somebody', 'which']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I O\n",
      "O O O B I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "thank you , whilst my original view still stands , you ' ve altered it in such a way that i now feel a little able to understand others better and in a less scornful light at least !\n",
      "\n",
      "i believe you have three choices once you discover the suffering animals endure in the meat industry . . .\n",
      "['whilst', 'my', 'original', 'view', 'still', 'stands', 'you', \"'\", 've', 'altered', 'it', 'in', 'such', 'a', 'way', 'that', 'i', '!']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I O O O O O O O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I I I I I I O O O O O O B I I I I I I I I I O B I I I I I I I I I I I O\n",
      "like many american kids , i was often forced throughout my childhood to participate in \" monopoly \" games with my family . from what i can tell , there is very little skill involved in playing the game , it just seems to be a giant crapshoot the whole way through .\n",
      "\n",
      "i think the board game \" monopoly \" is poorly designed\n",
      "['.', ',', 'it']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "one thing not calculated in the slightly psychotic weighing of the value of human life as \" useful \" is the sociological effect of the 55 million just gone : a zeitgeist wherein 55 million abortions is weighed as good for industry or not , the resulting thinking it good on account of efficiency , as certain citizens look on themselves and others as a figure or livestock the attitude of human value as \" what they [ potentially ] contributed to me / exxon mobile \" is the spirit of eugenics and genocide , subjects often glorified on reddit .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "[':', 'a']\n",
      "-------------------------------------\n",
      "B I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I\n",
      "B I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I O B I I I I I I I B I I I I I I I I I I I I I I I O\n",
      "its the same problem with war : once killing foreigners is an acceptable / inevitable means to profit and expand , you find that attitudes exposed to such behavior change with it > other countries also build militaries to do so and to \" defend \" against each other , and its no longer viewed as a hostile or paranoid thing to do because everybodys doing it and so must do it > it becomes a recursive loop and generates a hostile attitude towards foreigners and other countries .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['>', 'other', 'because', 'everybodys', '>', 'it', '.']\n",
      "-------------------------------------\n",
      "B B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I B I I I I I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "O O O O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I O O O O B I I I I I I I I I I I I I I I I I I B I I I I I I I O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I O\n",
      "so with 55 million abortions , you ' re also treated to relaxed attitudes towards eugenics and genocide , and all the warped views of human value and what a \" better place \" is that come with it decisions are give and take and has benefits as well as problems . you see , there would have certainly been benefits to a preemptive tactical nuclear strike against the ussr , and costs too anybody who denies either is blinded by zeal , and i ' m not saying such a strike would have been worth it , only that benefits would exist and its our job to weigh those against the costs always if you cannot see the cost of the 55 million abortions , it means that you should immediately change your view so you can experience the other side of your thinking , which has hijacked your perception and mistaken itself for truth recursively .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['so', 'with', '55', 'million', 'abortions', ',', 'you', 'decisions', '.', 'you', 'see', ',', 'anybody', 'i', \"'\", 'm', 'not', 'saying', 'such', 'a', 'strike', 'would', 'have', 'been', 'worth', 'it', ',', 'only', 'always', 'if', ',', 'which', '.']\n",
      "-------------------------------------\n",
      "O O O O O B I I I I I I I I I I I I I I I I I I I I I I B I I I I I I O O O O O O\n",
      "B I I O O B I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I O\n",
      "that is true , and such sentiment should be properly weighed by someone attempting to assess whether or not these 55 million abortions have had a positive outcome this should not overtake their thinking and drown out the other considerations .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['that', 'is', 'true', 'drown', 'out', 'the', 'other', 'considerations']\n",
      "-------------------------------------\n",
      "B I I I I I I I O O O B I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I O O O B I I I I I I I I I B I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "i believe you are in agreement with that . however , you take the zeitgeist as pretty much the highest consideration this is where we disagree . i believe in a shittier today for a better tomorrow , such as how our ancestors had miserable and productive lives that ended up with us living to be 80 and fat .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['this', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "its why we recruit teens into the military they ' re very easy to trick and convince to shoot a guy in a field for wearing different clothes without asking a lot of questions or thinking too hard about consequences .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['they']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I\n",
      "B I I I I I I B I I I I I I I O\n",
      "really , your argument is absolutely ludacris it boils down to a well constructed shitpost .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['it', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B B I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I B I I I I I I I I I I I I I O B I I I I I I I I I I I O O B I I I I I I I I I I O O B I I I I I I I I I I I O O O O O O O O O O O O O O O O\n",
      "teens are still developing , you know theres [ plenty of research ] ( supporting that their minds arent fully developed and that they ' re incapable of certain higher processes regarding emotional awareness . also i was careful to say that psychosis was a developmental disorder , and that teenage reasoning only appears quasi psychotic , but that its not , in explaining how people think emotionally and why in a way you could understand .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['theres', 'and', 'that', '.', 'also', 'psychosis', ',', 'and', 'that', ',', 'in', 'explaining', 'how', 'people', 'think', 'emotionally', 'and', 'why', 'in', 'a', 'way', 'you', 'could', 'understand']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I O\n",
      "most people would have thought that , and would have been satisfied to ignore you for this very reason and not respond . i did anticipate this , and i ' m not doing it to troll , but i really do want to change your view more specifically , that sort of it ' ll go well with you to be smarter than that .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['most', 'people', 'would', 'have', 'thought', 'that', ',', 'and', 'would', 'have', 'been', 'satisfied', 'to', 'ignore', 'you', 'for', 'this', 'very', 'reason', 'and', 'not', 'respond', 'sort', 'of', 'it']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I B I I O O O O O O B I I I I I I I I I I I I I I I I I I I I I B O O O O O O O O O O O O B I I I I I I I I I I I I O O O O O\n",
      "O O O O O B I I I I I I I B I I I I I I I I B I I I I I I I I I I I I I I I I I I I I B B I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I\n",
      "i ' m not anticipating that was the entire point of my cmv did you not even read any of this ? did you not see the note that said that i was fishing for insight into the impact of 55 million abortions ? you could have actually posed consequences to change my view and christ , you said you * had the courtesy to explain this to me * . kid . . .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['i', \"'\", 'm', 'not', 'anticipating', 'that', 'even', 'read', 'any', 'of', 'this', '?', '?', 'could', 'have', 'actually', 'posed', 'consequences', 'to', 'change', 'my', 'view', 'and', 'christ', ',', 'you', '.', 'kid', '.', '.', '.']\n",
      "-------------------------------------\n",
      "O O O O O O\n",
      "B I I I I I\n",
      "a little self important eh ?\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['a', 'little', 'self', 'important', 'eh', '?']\n",
      "-------------------------------------\n",
      "O O O\n",
      "B I O\n",
      "rambling on .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['rambling', 'on']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O\n",
      "B I I I I I I I I I I I I\n",
      "600 people would at least agree that it was an interesting thought .\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['600', 'people', 'would', 'at', 'least', 'agree', 'that', 'it', 'was', 'an', 'interesting', 'thought', '.']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O\n",
      "B I I I I I I I I I I\n",
      "visit the subreddit / r / iamverysmart to see your error\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['visit', 'the', 'subreddit', '/', 'r', '/', 'iamverysmart', 'to', 'see', 'your', 'error']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O\n",
      "O B I I I I I I I I I I I I I I I\n",
      "praise this intellectual has blessed me with correcting my false facts ! i should be thankful !\n",
      "\n",
      "america is a better place because of the 55 million abortions its had\n",
      "['this', 'intellectual', 'has', 'blessed', 'me', 'with', 'correcting', 'my', 'false', 'facts', '!', 'i', 'should', 'be', 'thankful', '!']\n",
      "-------------------------------------\n",
      "O O O B I I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I B I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "for example , imagine a relatively long ( 30 + years ) period of peace all of a sudden , war is a possibility . i would like my decision making body to have at least a few people who might have had prior experience with a war .\n",
      "\n",
      "people over the retirement age ( 62 ) should not be allowed to participate in politics .\n",
      "['for', 'example', ',', 'imagine', 'all']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "B I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O\n",
      "i guess we will always need first hand experience when odd situations come up . i ' ll give you a delta in a bit when i ' m on not on mobile .\n",
      "\n",
      "people over the retirement age ( 62 ) should not be allowed to participate in politics .\n",
      "['i', 'guess', 'we', 'will', 'always', 'need', 'first', 'hand', 'experience', 'when', 'odd', 'situations', 'come', 'up']\n",
      "-------------------------------------\n",
      "O O O B I I I I I I I I I I I I I I I I I I I I O O O B I I I I I I I I I I I I I I I I O\n",
      "B O B I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I\n",
      "okay , but even if religion did motivate people to kill , it does not provide the means to kill , only the motivation . however , assuming that a gun provides the motivation , it also provides the tool to kill someone with .\n",
      "\n",
      "religion is not violent or not violent , its followers are .\n",
      "['okay', 'but', 'even', '.', 'however', ',', 'assuming', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I O O O O O O B I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "your stance relies on the assumption that religion has no influence on the actions of its followers beyond the superficial . yet something must exist that allows this pattern to occur . ill narrow it down to religion or culture . so , you are correct if you assume the culture dominates the religion , and you are incorrect if the reverse is true . with this in mind , i think its safe to assume the truth is somewhere in between , with both the religion and the culture somehow influencing the unrest we see .\n",
      "\n",
      "religion is not violent or not violent , its followers are .\n",
      "['.', 'yet', 'something', 'must', 'exist', 'that', 'allows', 'this', 'pattern', 'to', 'occur', '.', '.', 'with', 'this', 'in', 'mind', ',', 'i', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I O O B I I O\n",
      "i suppose i was taking a harsh stance when i assumed that religion had no effect on behavior , when it obviously does .\n",
      "\n",
      "religion is not violent or not violent , its followers are .\n",
      "[',', 'when', 'it']\n",
      "-------------------------------------\n",
      "O O O O B I I I I I I I I I I I I I I I I I I O O O O O O O O O\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I\n",
      "i ' m sure you can find many people who self identify as patriots while also favoring policies that would allow more immigration . i ' m one of these people .\n",
      "\n",
      "cmv : patriotism is the belief that being born on one side of a line makes you better .\n",
      "['i', \"'\", 'm', 'sure', 'you', '.', 'i', \"'\", 'm', 'one', 'of', 'these', 'people', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I\n",
      "sure firefighters , emt ' s , and nurses do great things for people . . . for those who have money and great insurance . what a douchebag line .\n",
      "\n",
      "emts , sar , firefighters , police , etc . should receive \" military discounts \" .\n",
      "['what']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I O O O B I I I I I I I B I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I O O O B I I I I I I I B I I I I I I I I I I I B I I I I I I I I I I I I I B I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "actually , most commentators think they did not show up for a year or two . also , \" inn \" is arguably a poor translation it was not a hotel that did not have room for them it was that extended family did not have a guest room for josephs family perhaps because of the scandalous nature of marys pregnancy ? them being stuck in a barn has nothing to do with joseph being cheap and everything to do with his family having poor hospitality .\n",
      "\n",
      "nativity scenes are antisemitic .\n",
      "['actually', ',', 'most', 'perhaps']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I O O B I I I I I I I I I I I I I O\n",
      "interesting , i was not aware of this perspective , and certainly a lot can be lost in translation , especially multiple translations over centuries .\n",
      "\n",
      "nativity scenes are antisemitic .\n",
      "['interesting', ',', 'i', ',', 'and', 'certainly']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I B I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "on boards you will find echo chambers where people are more prone to believe rumors than proof things about e celebrities will start as rumors , ideas about them or things will get taken out of context and it will be posted continually until its taken as fact it will reach conspiracy theory levels of \" proof \" where people will simply believe it because they feel as if they are a part of a group effort thats uncovering something .\n",
      "\n",
      "i believe that regularly browsing 4chan will make you into a worse person\n",
      "[',', 'ideas', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I O O B I I I I I I I I I I I O\n",
      "i ' m not saying that every person who browses 4chan is depressed or negative , but that the majority of them are affected negatively by browsing the site .\n",
      "\n",
      "i believe that regularly browsing 4chan will make you into a worse person\n",
      "[',', 'but', 'that']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I O B I I I I I I I I\n",
      "the problem is a lot of people only understand the surface of chan boards like 4chan and equate the anonymity as some cheap way for them to be hateful under the guise of free speech , but that couldnt really be further from the truth .\n",
      "\n",
      "i believe that regularly browsing 4chan will make you into a worse person\n",
      "['and', 'equate', ',', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I B B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I I I I B I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "i have used 4chan a bunch of times to let out my problems about being depressed , suicidal and raped . its wonderful because i can let it all out and continue to be a member of that community without the community permanently tying what happened to me to my identity . if i fully discussed my rape irl i was always going to feel broken because everyone i talked to would then associate it with my identity and it would be something i would never escape . even on reddit i was originally hesitant to be open about it because of the username system would tie it to my reddit identity . but on 4chan i could discuss it all i wanted and it was a massive emotional relief . in real life you do not know if your emotional troubles are going to annoy or be a burden to whoever is kind enough to listen , you do not know if they ' re just being kind and do not truly care , but on 4chan style board , if no one cares they ' re not going to respond and if they feel your problems are stupid they grant you the right to start over immediately and do not force anyone to carry their past with them .\n",
      "\n",
      "i believe that regularly browsing 4chan will make you into a worse person\n",
      "['and', 'continue', 'because', 'everyone', 'on', 'you', 'do', 'not', 'know', 'if', 'they', \"'\", 're', 'just', 'being', 'kind', 'and', 'do', 'not', 'truly', 'care', '.']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O B I I I I I O O O B I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I I I I B I I I I I I O O B I I I I I I I I I I\n",
      "i ' ll preface this by saying i ' m a fan of both the books and movies . i like them both for different reasons , but gun to my head i probably slightly prefer the films .\n",
      "\n",
      "the theatrical cuts of lord of the rings are superior to the extended cuts and should be considered the definitive versions .\n",
      "['i', \"'\", 'll', 'preface', 'this', 'by', 'saying', 'i', \"'\", 'm', 'a', 'fan', 'of', 'both', 'the', 'books', 'and', 'movies', '.', 'reasons', '.']\n",
      "-------------------------------------\n",
      "O O O O O O\n",
      "B I I I I I\n",
      "peter jackson agrees with me :\n",
      "\n",
      "the theatrical cuts of lord of the rings are superior to the extended cuts and should be considered the definitive versions .\n",
      "['peter', 'jackson', 'agrees', 'with', 'me', ':']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O\n",
      "B I I I I I I I I I I I I I I I I I I I I I I O\n",
      "this sub is currently engaged in a 46 comment thread about whether or not [ men should sit down to urinate . ] (\n",
      "\n",
      "the theatrical cuts of lord of the rings are superior to the extended cuts and should be considered the definitive versions .\n",
      "['this', 'sub', 'is', 'currently', 'engaged', 'in', 'a', '46', 'comment', 'thread', 'about', 'whether', 'or', 'not', '[', 'men', 'should', 'sit', 'down', 'to', 'urinate', '.', ']']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O\n",
      "B I I I I I I I I I I I I I I\n",
      "i ' m sure we can find a way to argue about movies ; )\n",
      "\n",
      "the theatrical cuts of lord of the rings are superior to the extended cuts and should be considered the definitive versions .\n",
      "['i', \"'\", 'm', 'sure', 'we', 'can', 'find', 'a', 'way', 'to', 'argue', 'about', 'movies', ';', ')']\n",
      "-------------------------------------\n",
      "B I I I I I I B I I I I I I I I I I I O\n",
      "B I I I I I I B I I I I I I I I O O B O\n",
      "war for oil sustains our economy . not sure where you got your idea of communism , but ok .\n",
      "\n",
      "emts , sar , firefighters , police , etc . should receive \" military discounts \" .\n",
      "[',', 'but', 'ok']\n",
      "-------------------------------------\n",
      "O B I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I O O O O\n",
      "O B I I I I I I I I I I I I I O O B I I I I I I I I I O B I I I I I I I I I I I I I I O O O O\n",
      "while obviously a balanced exercise regimen is the best choice for health and well being , if someone were forced to stick to a single exercise technique , there is no reason other than lack of availability to choose anything other than swimming . swimming is :\n",
      "\n",
      "swimming is the best form of exercise\n",
      "['if', 'someone', ',', 'there']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O\n",
      "O O O O O O O B I I I I I I I I O\n",
      "edit 2 : view changed , because \" best form of exercise \" is actually meaningless .\n",
      "\n",
      "swimming is the best form of exercise\n",
      "['\"', 'best', 'form', 'of', 'exercise', '\"', 'is', 'actually', 'meaningless']\n",
      "-------------------------------------\n",
      "O O B I I I I I I I I I I I I O O O O O O O O O O\n",
      "O O B I I I I I I I I I I I I I B I I I I I I I I\n",
      "also , you are dismissing \" lack of availability \" as a reason pretty easily . that is probably one of the biggest reasons .\n",
      "\n",
      "swimming is the best form of exercise\n",
      "['.', 'that', 'is', 'probably', 'one', 'of', 'the', 'biggest', 'reasons', '.']\n",
      "-------------------------------------\n",
      "B I I I I I B I I I I I I I I I I I I I I I I I I I I B I I I I B I I I I I I I I I I O O B I I I I I I I I I I I I I I I I B I I I I I I I I I I O O O O O\n",
      "B I I I I I I I I I I I I I I I B I I I I I I I I I I B I I I I B I I I I I I I I I I O O B I I I I B I I I I I I I I I I I B I I I I I I I I I I I O O O O\n",
      "according to the theory of evolution it makes more sense that the egg preceded the chicken before the chicken there was a similar but different creature . lets call it x . its completely arbitrary when the x officially evolved into a chicken , but at some point it does an x , not a chicken lays the first chicken egg . the chicken egg comes before any creature considered a chicken exist . am i wrong ?\n",
      "\n",
      "cmv the egg came first before the chicken .\n",
      "['it', 'before', 'an', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I O O O\n",
      "B I I I I I I I I I I I I I I I I I B\n",
      "the chicken , as far as we know came into existence around [ 2500 2100 bc . ] (\n",
      "\n",
      "cmv the egg came first before the chicken .\n",
      "['.', ']', '(']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I O\n",
      "B I I I I I I I I I I I I I I I B\n",
      "egg bearing animals , however , seem to be [ as old as the dinosuars ] (\n",
      "\n",
      "cmv the egg came first before the chicken .\n",
      "['(']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I B I I I I O\n",
      "lets say you ' re a drug addict and due to your addiction you cant hold down a job , are really strung out and resort to one of the stupidest ways to make $ 100 for your next fix which is mugging people on the street . not getting the money is not an option because you ' re desperate .\n",
      "\n",
      "i think the paris shooting makes a good case for culture of responsible gun ownership any carrying .\n",
      "['because', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I I I I I I B I I I I I I I I I I I O B I I I I I I I I I I O\n",
      "you lose your temper and get out of your brand new car yelling up a storm . you notice after a bit of yelling that the guy is carrying and he has observed that you are as well and is scared .\n",
      "\n",
      "i think the paris shooting makes a good case for culture of responsible gun ownership any carrying .\n",
      "['and', 'he', '.']\n",
      "-------------------------------------\n",
      "B I I I I I I I I I I I B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I\n",
      "B I I I I I I I I I I I B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I O O B I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I\n",
      "you ' d likely be dead in scenarios 2 and 3 . this is not the movies where you duck bullets and dive behind a table or something . by the time they have their hand on their gun you have maybe 2 seconds , and by the time they start aiming it at you , you have a fraction of one . there is a reason why police , when they have reason to believe that someone is armed have their guns already drawn . that shit happens fast , and reactive speed is not fast enough .\n",
      "\n",
      "i think the paris shooting makes a good case for culture of responsible gun ownership any carrying .\n",
      "[',', 'and', 'by']\n",
      "-------------------------------------\n",
      "B I I B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I I I I I I I O O O O O\n",
      "O O O B I I I I I I I I I I I I I I I I I I I O B I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I B I I I I I I I I I I I I O B I I I O O O O O O\n",
      "at times , i feel like the interplay between men and women is always ( at least always initially ) a bs game where the man tries to show the woman how non threatening and valuable he is from a non romantic standpoint before she is comfortable with allowing herself to think of him as a safe partner something about that seems so sinister , cynical , and hollow to me that i cant stand it . please change this view .\n",
      "\n",
      "the highest form of relationship between men and women doomed to be romance\n",
      "['at', 'times', ',', 'where', 'the', 'that', 'i', '.']\n",
      "-------------------------------------\n",
      "O O O O O O O O O O O O O O O O O O O O O O O O O B I I I I I I I I I I I I I I I O B I O O B I I I O\n",
      "B I I I I I I I I I I I I I I I I I I I I I B I B I I I I I I I I I I I I I I I I I I I I B I I I I I\n",
      "the one thing i have learned about life and romance going through high school and college ? there is no manual . none . and we try to define all of these interactions between the sexes as one thing or another because its easy . but it really is not .\n",
      "\n",
      "the highest form of relationship between men and women doomed to be romance\n",
      "['the', 'one', 'thing', 'i', 'have', 'learned', 'about', 'life', 'and', 'romance', 'going', 'through', 'high', 'school', 'and', 'college', '?', 'there', 'is', 'no', 'manual', '.', 'none', '.', 'and', 'we', 'because', 'its', '.', 'but', 'it', '.']\n",
      "-------------------------------------\n"
     ]
    }
   ],
   "source": [
    "temp = []\n",
    "count = 0\n",
    "ana = {}\n",
    "for pred, label, context in zip(ans[0], ans[1], datas):\n",
    "    if(pred!=label):\n",
    "        total = []\n",
    "        t_a, t_b = 0, 0\n",
    "        for p, l, c in zip(pred.split(), label.split(), context[0].split()):\n",
    "            if(p!=l):\n",
    "                total.append(c)\n",
    "            if(p=='B'):\n",
    "                t_a+=1\n",
    "            if(l=='B'):\n",
    "                t_b+=1\n",
    "        try:\n",
    "            ana[t_b-t_a]+=1\n",
    "        except:\n",
    "            ana[t_b-t_a]=1\n",
    "        if(t_a==t_b):\n",
    "            continue\n",
    "        if(len(total)==1 and total[0]=='.'):\n",
    "            continue\n",
    "        temp.append([pred,label,context])\n",
    "        if(t_b-t_a == 1):\n",
    "            print(pred)\n",
    "            print(label)\n",
    "            print(context[0])\n",
    "            print()\n",
    "            print(context[1])\n",
    "            print(total)\n",
    "            print('-------------------------------------')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "496"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(temp)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "470"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(temp)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "339"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(temp)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{2: 25, 0: 157, -1: 158, -3: 14, 1: 91, -2: 37, -4: 6, 4: 3, 3: 3, 9: 1, -5: 1}"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ana"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}