Which AI-text detectors work on Hungarian?
Seven detectors evaluated on the same 1,000 Hungarian documents. Preds 3, a detector built specifically for Hungarian, leads every metric with 99.6% accuracy and did not flag a single human-written text as AI.
| 1 | Preds 3 Top result | 99.6% | 99.60% | 0.9996 | 0.0% | 0.8% |
|---|---|---|---|---|---|---|
| 2 | GPTZero | 90.1% | 89.04% | 0.9923 | 0.2% | 19.6% |
| 3 | Originality.ai | 82.0% | 84.29% | 0.9574 | 32.6% | 3.4% |
| 4 | Plag.hu | 76.5% | 69.44% | 0.9480 | 0.4% | 46.6% |
| 5 | isgen.ai | 65.5% | 48.43% | 0.7317 | 1.4% | 67.6% |
| 6 | ZeroGPT | 64.7% | 64.52% | 0.6911 | 34.8% | 35.8% |
| 7 | Smodin | 62.9% | 41.39% | 0.7655 | 0.4% | 73.8% |
FPR: share of the 500 human texts flagged as AI (false accusations). FNR: share of the 500 AI texts that passed as human. Lower is better for both. Click a column to sort. Measured September 2026.
Disclosure: the dataset and this leaderboard are maintained by the developer of Preds, one of the evaluated detectors. That is why every text, label and per-detector confusion count is public.
Submit a detector
- Download HuDetect-1k and run your detector on every row, in order.
- Save
predictions.csvwith apredcolumn (0 human, 1 AI) and ascorecolumn (AI probability). - Open a discussion in this Space with the file, the detector name, version and date. Results are verified and added to the table.
from sklearn.metrics import confusion_matrix, roc_auc_score
import pandas as pd
y = pd.read_csv("hf://datasets/mihalykiss/GenAIDetectHU/hudetect1k_v1.3.csv")["label"]
p = pd.read_csv("predictions.csv")
tn, fp, fn, tp = confusion_matrix(y, p["pred"]).ravel()
print("accuracy", (tp + tn) / len(y), "FPR", fp / (fp + tn), "FNR", fn / (fn + tp))
print("AUROC", roc_auc_score(y, p["score"]))
Why the results differ so much
GPTZero ranks texts well (AUROC 0.9923) but decides too cautiously on Hungarian, so it misses a fifth of AI texts. Originality.ai catches almost all AI texts but flags 32.6% of human ones.
ZeroGPT, isgen.ai and Smodin score an AUROC between 0.69 and 0.77, so their scores barely separate the two classes. No threshold fixes that; it usually points to little Hungarian training data. Preds 3, trained on Hungarian, reaches 0.9996.
For checking theses and essays, the false positive rate matters most. A practical guide in Hungarian: Szakdolgozat AI-ellenőrzése.
Dataset composition
| Domain | Human | AI |
|---|---|---|
| Creative writing | 70 | 70 |
| Essays and academic | 70 | 70 |
| General web | 70 | 70 |
| Technical and IT | 70 | 70 |
| News | 60 | 60 |
| Reference and education | 60 | 60 |
| Legal and administrative | 55 | 55 |
| Social and Q&A | 30 | 30 |
| Science and medicine | 15 | 15 |
| Generator | AI texts |
|---|---|
| GPT-5.6 | 88 |
| Gemini 3.8 Flash | 86 |
| DeepSeek V4 Flash | 58 |
| Kimi K2.6 | 58 |
| Llama 4 Scout | 56 |
| Qwen 3.7 Flash | 52 |
| GLM 5.3 Flash | 28 |
| Mistral Small | 27 |
| Claude Haiku 4.5 | 17 |
| Grok 4.3 | 16 |
| gpt-oss-120b | 14 |
Lengths are matched within each domain (80 to 995 words, median 198). The AI texts were generated fresh and were not used to train any evaluated detector.