#

text-processing

Here are 1,611 public repositories matching this topic...

learnbyexample / Command-line-text-processing

⚡ From finding text to search and replace, from sorting to beautifying text and more 🎨

ruby linux command-line regex perl ebook awk sed text-processing grep

Updated Jun 5, 2024
Shell

google / diff-match-patch

Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.

diff match patch text-processing difference

Updated May 22, 2024
Python

chmln / sd

Intuitive find & replace CLI (sed alternative)

rust cli terminal command-line regex text-processing

Updated May 28, 2024
Rust

PyMuPDF

pymupdf / PyMuPDF

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

python pdf font data-science ocr tesseract epub mupdf text-processing pdf-documents extract-data table-extraction text-shaping xps pymupdf

Updated Nov 21, 2024
Python

fastnlp / fastNLP

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

natural-language-processing deep-learning text-classification chinese-nlp text-processing nlp-parsing nlp-library

Updated Jun 5, 2023
Python

pyparsing / pyparsing

Python library for creating PEG parsers

python parsing parser-combinators python3 parsing-expression-grammar python-3 text-processing python-2 python2 parsing-library peg-parsers

Updated Nov 18, 2024
Python

kk7nc / Text_Classification

Text Classification Algorithms: A Survey

deep-learning random-forest text-classification recurrent-neural-networks naive-bayes-classifier dimensionality-reduction logistic-regression document-classification convolutional-neural-networks text-processing decision-trees boosting-algorithms support-vector-machines hierarchical-attention-networks nlp-machine-learning conditional-random-fields k-nearest-neighbours deep-belief-network rocchio-algorithm deep-neural-network

Updated Oct 10, 2024
Python

chonkie

bhavnicksm / chonkie

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

ai text-processing chunking rag retrieval-augmented-generation

Updated Nov 21, 2024
Python

roshan-research / hazm

Persian NLP Toolkit

python nlp natural-language-processing tokenizer embeddings persian text-processing dependency-parser farsi pos-tagging persian-nlp normalization lemmatization

Updated Jul 16, 2024
Python

birchb1024 / frangipanni

Program to convert lines of text into a tree structure.

go golang tree-structure text-processing

Updated Jun 15, 2023
Go

lingua-go

pemistahl / lingua-go

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

nlp go natural-language-processing language-detection language-modeling golang-library text-processing nlp-machine-learning language-recognition language-processing language-identification language-classification

Updated Nov 15, 2024
Go

BurntSushi / aho-corasick

A fast implementation of Aho-Corasick in Rust.

search finite-state-machine text-processing aho-corasick substring-matching

Updated Sep 25, 2024
Rust

PyThaiNLP / pythainlp

Thai natural language processing in Python

python natural-language-processing thai-language thai computational-linguistics text-processing soundex nlp-library word-segmentation thai-nlp hacktoberfest thai-nlp-library thai-soundex

Updated Nov 20, 2024
Python

helix-editor / nucleo

A fast and convenient fuzzy matcher library for rust

rust performance fuzzy-search fuzzy-matching text-processing

Updated Nov 12, 2024
Rust

sstadick / hck

A sharp cut(1) clone.

rust command-line text-processing

Updated Jul 17, 2024
Rust

cbaziotis / ekphrasis

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

nlp tokenizer text-processing semeval nlp-library word-segmentation spelling-correction tokenization text-segmentation spell-corrector word-normalization

Updated Feb 27, 2024
Python

derek73 / python-nameparser

A simple Python module for parsing human names into their individual components

python text-processing text-parser python-module

Updated May 28, 2024
Python

abadojack / whatlanggo

Natural language detection library for Go

nlp go language text-processing

Updated Mar 28, 2023
Go

ChenghaoMou / text-dedup

All-in-one text de-duplication

nlp text-processing data-processing de-duplication

Updated May 21, 2024
Python

open-korean-text / open-korean-text

Open Korean Text Processor - An Open-source Korean Text Processor

natural-language-processing tokenizer korean text-processing korean-text-processing korean-tokenizer

Updated Mar 12, 2024
Scala

Improve this page

Add a description, image, and links to the text-processing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the text-processing topic, visit your repo's landing page and select "manage topics."