Wikipedia text corpus for self-supervised NLP model training
-
Updated
Jul 17, 2022 - Python
Wikipedia text corpus for self-supervised NLP model training
Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.
A simple Ruby script that contains a GUI desktop application providing typical NLP tasks ready to apply on English or German text files. Available for macOS, Windows and Linux.
German Categorized Wordlist Project
DERBI (DEutscher RegelBasierter Inflektor) is a simple rule-based automatic inflection model for German based on spaCy. Applicable regardless of POS!
Ph.D. Thesis
future time reference classification in english, dutch, and german
Multi-stage cleaning + tokenization pipeline for LLM pretraining corpora (German/English/code) — from the Auralis/Helix project.
Web scraper written with Scrapy to extract user reviews in German of organic and fair trade coffee brands
LoRA-tuned MiniCPM5-1B that repairs messy German address records on-device: rules floor, base vs SFT on a frozen 2,000-record test set, with audit trail and review routing.
200k-vocab SentencePiece (Unigram) tokenizer for German-primary LLMs — German/English/code, low fertility, byte-fallback, chat-template tokens. From the Auralis/Helix project.
Deutschsprachige KI-Infrastruktur für Dokumente, Datenschutz, Suche und RAG: deutsche PII-Erkennung mit Prüfsummen, Komposita-Zerlegung, strukturtreues Chunking, hybrides Retrieval und RAG mit geprüften Quellenangaben. Live-Demo im Browser.
Analyze German texts and subtitles: word/lemma frequency, part-of-speech filtering, context sentences, CSV export.
A multilingual retrieval system for Belgian law articles using dense retrieval, FAISS indexing, and cross-encoder reranking.
Multi-LLM peer-review audit framework — measure hallucinations, bias and policy compliance across Claude, GPT, Gemini, Mistral. Built by DeepThink AI.
Text Normalization on Learner Texts (South Tyrolean German as a L2)
Local MCP memory server for AI assistants: plain SQLite with FTS5, German morphology, two-axis filing. No vector store, no embeddings, no external service.
Skills classifier assignment challenge
To associate your repository with the german-nlp topic, visit your repo's landing page and select "manage topics."