Academic Inquiries, TEI-XML Access & Institutional Research (علمي څېړنې، TEI-XML ډیټا او اداري لاسرسی)
Compliant with the guidelines of the Text Encoding Initiative (TEI P5), the Linguistic Data Consortium (LDC), and the CLARIN European Research Infrastructure. All lexical datasets are permanently dedicated under the Creative Commons Attribution 4.0 International (CC-BY-4.0) license at pashtodictionary.com.
- 3 days
- Typical response time for institutional inquiries
- TEI P5
- Machine-readable lexical entries on request
- CC BY 4.0
- All datasets free, including commercial use
- v2.4
- Current corpus release (October 2026)
1. Institutional Research Mission (زموږ علمي او اکاډمیک ماموریت)
The Open Pashto Lexicon operates as a public-good computational linguistics infrastructure. Our objective is to empower university researchers, natural language processing (NLP) labs, dialectologists, machine translation engineers, and cultural preservation institutions with machine-readable, peer-reviewed Pashto lexical data.
We actively partner with academic departments and research institutes specializing in:
Iranian & Central Asian Philology
Historical phonology, etymological trees, Karlani vowel shifts, and split-ergative morphosyntax across classical manuscripts and modern dialects.
LLM Alignment & NLP Benchmarking
Low-resource language pretraining, tokenization improvement, subword vocabulary optimization, and cultural debiasing for frontier neural models.
Speech Technologies (ASR & TTS)
Acoustic phonetic pronunciation dictionaries, phonemic alignments, retroflex consonant acoustic modeling, and dual-dialect synthetic voice training.
2. Open-Access Licensing: Creative Commons CC-BY-4.0
To ensure unhindered global access, all lexical definitions, trilingual translations, IPA transcriptions, grammatical paradigms, and syntactic signposts are released under Creative Commons Attribution 4.0 International (CC-BY-4.0).
CC-BY-4.0 Compliance Deed
Open AccessYou Are Free To:
- ✓Share: Copy and redistribute the material in any medium or format.
- ✓Adapt: Remix, transform, and build upon the material for any purpose, including commercial applications, LLMs, and databases.
Under The Following Terms:
- •Attribution: You must give appropriate credit to "Open Pashto Lexicon (PashtoDictionary.com)", provide a link to the license, and indicate if changes were made.
- •No Additional Restrictions: You may not apply legal terms or technological measures that legally restrict others.
3. Text Encoding Initiative (TEI-XML P5) Specification
For computational lexicographers and digital humanities archives, entries are structured in strict conformance with the TEI P5 Guidelines for Electronic Text Encoding and Interchange (Dictionary Module tei:entry).
Canonical TEI-XML Entry Sample: kitāb (کتاب)
TEI P5 Compliant<?xml version="1.0" encoding="UTF-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0" xml:lang="ps">
<teiHeader>
<fileDesc>
<titleStmt>
<title>Open Pashto Lexicon — TEI Dictionary Entry</title>
<sponsor>PashtoDictionary.com Editorial Board</sponsor>
</titleStmt>
<publicationStmt>
<publisher>Open Pashto Lexicon Consortium</publisher>
<availability status="free">
<licence target="https://creativecommons.org/licenses/by/4.0/">CC-BY-4.0</licence>
</availability>
</publicationStmt>
<sourceDesc>
<p>Digitally compiled from historical and contemporary verified corpora.</p>
</sourceDesc>
</fileDesc>
</teiHeader>
<text>
<body>
<entry xml:id="lemma_kitab_001">
<form type="lemma" xml:lang="ps">
<orth type="vocalized">کِتَاب</orth>
<orth type="plain">کتاب</orth>
<pron notation="ipa" scheme="SW">/ki.tɑ́b/</pron>
<pron notation="ipa" scheme="NE">/ki.tɑ́b/</pron>
</form>
<gramGrp>
<pos>noun</pos>
<gen>masculine</gen>
<number>singular</number>
<case>direct</case>
<subc>inanimate</subc>
</gramGrp>
<sense n="1" xml:id="sense_kitab_1">
<usg type="domain">general</usg>
<def xml:lang="ps">هغه ليکل شوې يا چاپ شوې پاڼې چې يو ځای تړل شوې وي.</def>
<cit type="translation" xml:lang="en">
<quote>book; bound printed volume.</quote>
</cit>
<cit type="translation" xml:lang="ur">
<quote>کتاب؛ جلد شدہ تحریر۔</quote>
</cit>
<cit type="example">
<quote xml:lang="ps">ما يو ګټور کتاب واخیست.</quote>
<cit type="translation" xml:lang="en">
<quote>I bought a useful book.</quote>
</cit>
</cit>
</sense>
<sense n="2" xml:id="sense_kitab_2">
<usg type="domain">theology</usg>
<def xml:lang="ps">اسماني صحيفه يا د وحې ټولګه.</def>
<cit type="translation" xml:lang="en">
<quote>Scripture; holy revealed codex.</quote>
</cit>
</sense>
<etym type="borrowing" lang="ar">
<mentioned>كِتَاب</mentioned>
<gloss>writing, document</gloss>
</etym>
</entry>
</body>
</text>
</TEI>4. Public REST & Developer API (د پروګرامونې انټرفېس)
Researchers and engineers can programmatically query the lexicon via an open, rate-limited REST API. Full documentation and code integration snippets are available on our dedicated Academic & API Documentation page.
Core REST Endpoints Overview
Base URL: https://api.pashtodictionary.com/v1/ Endpoints: GET /entries/:slug Retrieve full entry object with inflections & audio URLs GET /search?q=:query&lang=ps Full-text fuzzy search across all scripts GET /paradigms/noun/:slug Full nominal declension grid (Direct, Oblique, Vocative, Ablative) GET /paradigms/verb/:slug Full verbal conjugation matrix across all aspects & genders GET /dialects/isogloss/:root Phonetic realization across the 5 major isogloss regions
5. Bulk Datasets & Computational Corpora
For offline institutional research, batch model evaluation, and LLM tokenizer training, we publish pre-compiled database snapshots:
| Dataset Package | Format | File Size | Description |
|---|---|---|---|
| Complete Lexicon Dump | SQLite 3 | ~142 MB | Normalized relational database containing all 126,184 lemmas, 196,460 senses, and FTS5 indices. |
| TEI-XML Full Corpus | XML (TEI P5) | ~88 MB (gzip) | Standardized lexical interchange format for digital humanities repositories. |
| Phonetic Pronunciation Lexicon | TSV / JSONL | ~18 MB | Lemma-to-IPA mapping covering Southwestern, Northeastern, and Central dialects for TTS/ASR. |
| Inflectional Paradigm Tables | Parquet / CSV | ~64 MB | 504,916 fully expanded inflected wordforms tagged with morphosyntactic features. |
| Hugging Face Hub Snapshot | Parquet | Streamable | Hosted under huggingface.co/datasets/open-pashto-lexicon. |
6. Academic Citation Standards (څنګه حواله ورکړو؟)
If you use the Open Pashto Lexicon in published academic research, thesis dissertations, NLP papers, or digital collections, please cite our project using one of the following formats:
@misc{openpashtolexicon2026,
author = {{Open Pashto Lexicon Consortium}},
title = {{Pashto Dictionary: The Open Trilingual Lexicon and Morphological Database for Pashto}},
year = {2026},
howpublished = {\url{https://pashtodictionary.com}},
note = {Version 2.4, Licensed under CC-BY-4.0},
address = {Kabul, Peshawar, and London}
}7. Institutional Inquiries & Academic Contact Form
We invite university departments, linguistic associations, and doctoral researchers to reach out for formal collaborations, data grants, or co-authored research publications:
Open Pashto Lexicon Initiative
Department of Digital Humanities & Eastern Iranian Linguistics
Inquiries: contact@pashtodictionary.com
Web: https://pashtodictionary.com/contact
8. Standards & Data Governance References
Academic communications, TEI-XML serialization, and open data licensing adhere to international computational lexicography protocols:
- [1] TEI Consortium. (2023). TEI P5: Guidelines for Electronic Text Encoding and Interchange. Version 4.7.0. TEI Consortium. (Dictionary Module specification for print and digital lexicons).
- [2] ISO 24613-4:2021. Language resource management — Lexical markup framework (LMF) — Part 4: TEI serialization. Geneva: International Organization for Standardization.
- [3] CLARIN ERIC. (2022). Standards for Language Resources: Persistent Identifiers and Interoperable Lexical Databases. Utrecht: Common Language Resources and Technology Infrastructure.
- [4] Committee on Publication Ethics (COPE). (2021). Principles of Transparency and Best Practice in Scholarly Publishing.
- [5] Modern Language Association. (2021). MLA Handbook (9th ed.). New York: Modern Language Association of America.