Academic Inquiries, Licensing (CC-BY-4.0), & API Documentation (علمي څېړنې، ازاد جواز او د API لارښود)
Formulated in alignment with the Open Knowledge Foundation, the Creative Commons Attribution 4.0 International (CC-BY-4.0) legal code, and the computational lexicography standards of the Text Encoding Initiative (TEI P5) and W3C Ontolex-Lemon. Modeled after the developer portals and data licensing frameworks of Oxford Dictionaries API, Merriam-Webster Developer Center, and Wiktionary Dumps.
- v2.4
- Current dataset release (October 2026)
- TEI P5
- Canonical XML interchange format
- CC BY 4.0
- All exports, including commercial use
- Monthly
- Dataset export cadence (SQLite, Parquet, JSON-LD)
1. Open Access & Licensing Framework (د جواز حقوقي چوکاټ)
1.1 Creative Commons Attribution 4.0 International (CC-BY-4.0)
All curated lexical records, grammatical paradigms, phonetic transcriptions, dialectal variants, and editorial commentaries generated by the Open Pashto Lexicon (pashtodictionary.com) are released under the terms of the Creative Commons Attribution 4.0 International License (CC-BY-4.0).
Creative Commons Attribution 4.0 (CC-BY-4.0) Deed
Open LicenseCopy and redistribute in any medium or format worldwide.
Remix, transform, and build upon data for AI models and research.
Usable in commercial software, web products, and LLM pipelines.
Requirement: Explicit attribution to Pashto Dictionary (pashtodictionary.com) with canonical link.
1.2 Terms of Reuse & Attribution Clause
When incorporating, reproducing, or fine-tuning machine learning models using the Open Pashto Lexicon dataset or API, you must provide:
- Appropriate Credit: Acknowledge "Open Pashto Lexicon Project (pashtodictionary.com)" and name contributing lexicographers where cited.
- License Link: Provide a direct hyperlink to the CC-BY-4.0 License.
- Change Log: Indicate if changes, automated transliterations, or morphological extensions were made to the original database records.
- No Additional Restrictions: You may not apply legal terms or technological protection measures (DRM) that legally restrict others from doing anything the license permits.
“Lexical data, dialect transcriptions, and grammatical paradigms courtesy of the Open Pashto Lexicon Project (pashtodictionary.com), licensed under Creative Commons Attribution 4.0 International (CC-BY-4.0).”
2. Academic Inquiries & Research Partnerships (علمي همکارۍ او اړيکې)
We actively partner with linguistics departments, natural language processing (NLP) labs, and lexicographical bodies globally to advance computational resources for low-resource Iranian languages.
2.1 Areas of Scholarly Collaboration
Acoustic Phonetics & Speech Synthesis
Calibrating acoustic models for Kandahari, Peshawari, Central (Ghilji), and Southern (Quetta/Wazirwola) phonology with Praat-based formant benchmarks.
Morphological Parser Development
Validating finite-state transducers (FST) against our 4-case nominal inflection matrices and split-ergative verb aspect tables.
Corpus Linguistics & Lexical Frequency
Integrating multi-million word historical corpora (from Khushal Khan Khattak, Rahman Baba, and 20th-century periodicals) to establish empirical lemma frequency curves.
Etymological & Diachronic Research
Tracing proto-Indo-Iranian and Avestan cognates across Eastern Iranian dialects and Dardic contact zones.
2.2 Scholarly Citation Formats
@misc{open_pashto_lexicon_2026,
author = {{Open Pashto Lexicon Editorial Board}},
title = {Open Pashto Lexicon: A Trilingual Computational Dictionary of the Pashto Language},
year = {2026},
publisher = {Pashto Dictionary Foundation},
url = {https://pashtodictionary.com},
note = {Dataset version 2.4, Licensed under CC-BY-4.0}
}3. Lexical Data Dumps & Open Datasets (ډیټابیس او ډیټاسیټونه)
For computational linguists, researchers, and offline developers, our verified database of 126,184 root headwords is exported monthly in standardized open formats:
| Format | File Structure | Intended Use Case | Licensing |
|---|---|---|---|
| TEI-XML (P5) | <entry>, <form>, <gramGrp>, <sense> | Digital humanities, corpus archives, lexical exchange | CC-BY-4.0 |
| JSON Lines (.jsonl) | Flattened UTF-8 JSON objects per headword | NLP fine-tuning, tokenizers, LLM embeddings | CC-BY-4.0 |
| SQLite (.db) | Relational tables with pre-built FTS5 index | Mobile applications (Android/iOS), offline desktop engines | CC-BY-4.0 |
| CSV / TSV | Lemma, POS, English, Urdu, IPA, Dialect tags | Quick spreadsheet analysis, statistical linguistics | CC-BY-4.0 |
4. Developer API Documentation (د پروګرامینګ لارښود)
The Open Pashto Lexicon provides a high-performance RESTful API designed for search engines, translation tools, machine learning pipelines, and language-learning applications.
4.1 Base URL & Protocol
- All responses are served over
HTTPSwith UTF-8 encoding. - Response payloads are formatted as
application/json. - Strict CORS headers (
Access-Control-Allow-Origin: *) are enabled for client-side web applications.
4.2 Rate Limits & Access Tiers
| Tier | Rate Limit | Authentication | Cost |
|---|---|---|---|
| Public / Open | 60 requests / minute | None required (IP-throttled) | Free |
| Academic / Researcher | 600 requests / minute | Bearer Token (Authorization: Bearer <KEY>) | Free (Institutional email) |
| Enterprise / Infrastructure | Uncapped / Bulk sync | Dedicated API key + webhook feeds | Community sponsorship |
5. Code Integration Examples (د کوډ بېلګې)
Drop-in client examples for integrating the Open Pashto Lexicon into machine learning models and web apps:
import requests
def lookup_pashto_word(query: str):
url = "https://api.pashtodictionary.com/v1/search"
params = {"q": query, "direction": "all", "limit": 1}
headers = {"Accept": "application/json"}
response = requests.get(url, params=params, headers=headers)
if response.status_code == 200:
results = response.json().get("data", [])
if results:
entry = results[0]
print(f"Headword: {entry['headword_vocalized']} ({entry['transliteration']})")
print(f"English: {entry['senses'][0]['english_gloss']}")
print(f"Urdu: {entry['senses'][0]['urdu_gloss']}")
return entry
return None
lookup_pashto_word("کتاب")async function fetchWord(slug: string) {
const res = await fetch(`https://api.pashtodictionary.com/v1/entries/${encodeURIComponent(slug)}`);
if (!res.ok) throw new Error(`HTTP error ${res.status}`);
const json = await res.json();
return json.data;
}6. Institutional Inquiry & API Key Request Form
Request an elevated academic Bearer Token (600 req/min) or propose an institutional data sharing partnership:
7. Standards & Legal References
- [1] Creative Commons Corporation. (2013). Creative Commons Attribution 4.0 International Public License (CC BY 4.0).
- [2] Text Encoding Initiative Consortium. (2023). TEI P5: Guidelines for Electronic Text Encoding and Interchange.
- [3] W3C Ontolex Community Group. (2016). Lexicon Model for Ontologies (Ontolex-Lemon). W3C Community Group Report.
- [4] Open Knowledge Foundation. (2020). The Open Definition: Defining Open in Open Data, Open Content and Open Knowledge.