| title | authors | |
|---|---|---|
Index legacy documents, files and directories & file shares to Elastic Search |
|
How to index document files like Word documents or PDF files, file directories and file shares to Elastic Search with open source tools?
You can import files, documents, directories and file shares to Elastic Search index with the Open Semantic ETL framework and its files connector (all components are free software & open source):
- Download and install Open Semantic ETL Elastic Search edition package
- Index a directory with document files:
opensemanticsearch-index-file */home/user/Documents* - Search the content of the files with Elastic Search or Kibana.
Install a preconfigured Open Semantic ETL package (Please donate: or Open Semantic Desktop Search and Open Semantic Search appliance) with the flavour "elastic search"-edition.
or
install Open Semantic ETL and set in the config file /etc/etl/config the option "export" to "elasticsearch".
Documents are analyzed and enriched by enhancer plugins.
For example image files or images inside PDF documents are enriched by automatic textrecognition (OCR), so it is possible to find text even in graphic format based PDFs like scans or photographed documents.
For better OCR results you can configure another language (default language: english).
To import / index directories, documents and files you can use one of our standard tools and system integrations:
- Just add to shared folder to the Open Semantic Search Virtual Machine like Open Semantic Desktop Search or Open Semantic Search Appliance
- Command line tools (so you can integrate with own scripts or standard Linux tools like Cron)
- Plugins for file managers like Nautilus or the Windows Filemanager
- Firefox Plugins
- Web API (REST API)
- File monitoring tools
After document processing and indexing you can use the Open Source user interface Kibana for full text search in your files and documents.
We've got a first donation to improve performance, so only few donations are neccessary so one of the next versions will be able to index more documents in less time. More about how to increase performance soon.
Standard CSV tables are indexed automatically, soon.
Please donate so we can release the CSV Manager UI for Elastic Search sooner, so you can import very big CSV files in a more structured form and import non-standard CSV files easier.
A very easy to install and fully preconfigured Open Semantic Desktop Search Elastic Search and Kibana flavoured Virtual Machine is planned.
Please donate to realize this earlier.
Please donate so we can release the Thesaurus for Named Entity Extraction for Elastic Search sooner.