Skip to content

Evaluating Vision-Language Models as a Zero-Shot Learning Alternative to You Only Look Once and Optical Character Recognition for Nigerian License Plate Recognition

🕒 Published (v1): 2026-07-02 10:55 UTC · Source: Arxiv · link

Why this paper was selected

Zero-shot VLM vs. YOLO+OCR for license plate recognition; narrow but concrete evaluation comparison

Ask a follow-up

Open an assistant pre-loaded with this paper's context.

💬 Ask ChatGPT✦ Ask Claude

TL;DR

This paper benchmarks five commercial VLMs (Gemini 2.0 Flash Exp, Qwen2.5-VL-7B-Instruct, GPT-4o, Claude 4 Sonnet, Llama 3.2 Vision 90B) as zero-shot replacements for the traditional YOLO+OCR pipeline on 88 challenging Nigerian license plate images. Gemini achieves the lowest average Character Error Rate (CER = 0.243) and Qwen follows closely (CER = 0.322), while Llama performs worst (CER = 0.756). The study argues VLMs offer a practical, annotation-free alternative to multi-stage pipelines in low-resource, unstructured environments.

Problem

Traditional YOLO+OCR pipelines for License Plate Recognition (LPR) suffer from: (1) high annotation burden requiring thousands of labeled bounding boxes, (2) cascading error propagation across detection and OCR stages, (3) poor generalization under real-world degradation (blur, glare, occlusion, non-standard formats), and (4) computational requirements that limit edge deployment. No prior work had evaluated frontier VLMs zero-shot on Nigerian plates, which feature non-Western regional formats and are captured under highly unconstrained conditions.

Method

A dataset of 88 real-world Nigerian license plate images was curated from a larger corpus collected in Kano State, covering four challenge categories: clean plates, degraded plates (blur, occlusion, glare), multi-plate scenes, and non-standard formats. All images were captured with consumer smartphones with no synthetic augmentation. Each of the five VLMs was queried via the Roboflow Visual Prompting Playground using a single, fixed prompt instructing the model to locate plates and return alphanumeric content in comma-separated format (expected pattern: three letters + three digits + two letters, e.g., ABC123XY). Outputs were normalized by stripping hyphens/spaces and discarding non-plate text. Performance was measured with Character Error Rate:

\[\text{CER} = \frac{S + D + I}{N}\]

where \(S\), \(D\), \(I\) are character-level substitutions, deletions, and insertions, and \(N\) is ground-truth length. A Python script computed CER for all 88 image–model pairs automatically.

Key Contributions

  • First systematic zero-shot VLM evaluation on Nigerian license plates under real-world unconstrained conditions.
  • Quantitative CER comparison of five major proprietary/open-weight VLMs (Gemini, Qwen, GPT-4o, Claude, Llama) on a common 88-image benchmark.
  • Empirical challenge to developer benchmark claims: Gemini and Qwen validate their advertised capabilities; GPT-4o, Claude 4 Sonnet, and Llama underperform their marketed strengths in OCR-specific tasks.
  • Qualitative breakdown of failure modes per model, including Llama's plate-detection-without-extraction behavior.
  • Practical argument for VLMs as a unified, training-free alternative to YOLO+OCR in low-resource settings.

Results

  • Gemini 2.0 Flash Exp: avg CER = 0.243; 37/88 perfect recognitions (CER = 0); 6 complete failures (CER ≥ 1).
  • Qwen2.5-VL-7B-Instruct: avg CER = 0.322; 30 perfect recognitions; 5 complete failures (fewest among all models).
  • GPT-4o: avg CER = 0.556; 21 perfect recognitions; 29 complete failures.
  • Claude 4 Sonnet: avg CER = 0.682; 30 perfect recognitions; 37 complete failures (high variance).
  • Llama 3.2 Vision 90B: avg CER = 0.756; 13 perfect recognitions; 55 complete failures (worst overall).
  • Only 2 images (Nos. 84, 86) were perfectly recognized by all five models; 3 images (Nos. 44, 53, 69) failed across all models due to extreme degradation.
  • On 28 multi-plate images, Gemini achieved avg CER = 0.308 with 3 perfect multi-plate predictions; Llama achieved 0 perfect multi-plate predictions.
  • No fine-tuning or domain-specific training was used for any model.

Limitations

  • Dataset is small (88 images) and geographically narrow (Kano State only), limiting generalizability to other Nigerian states or countries.
  • Evaluation platform (Roboflow Visual Prompting Playground) required lossy image compression (<1.8 MB), potentially degrading model inputs.
  • No latency or computational cost comparison is provided; VLM inference cost vs. YOLO+OCR is not quantified.
  • No comparison to an actual deployed YOLO+OCR baseline on the same 88 images — the YOLO+OCR argument is qualitative, not empirical on this dataset.
  • Single fixed prompt used for all models; prompt optimization per model could alter rankings.
  • Ground-truth annotation quality and inter-annotator agreement are not reported.
  • Models tested via a web UI rather than direct API, introducing potential non-determinism and rate-limit artifacts.

Relevance to Vision-Language Models

This paper provides a concrete, domain-specific stress test of frontier VLMs on a structured OCR task in a low-resource, non-Western setting — directly probing the gap between standardized benchmark performance (VQAv2, TextVQA) and real-world deployment. The finding that Qwen2.5-VL-7B-Instruct (7B parameters) approaches Gemini 2.0 Flash on CER while having the fewest complete failures is a practically significant data point for the VLM scaling and alignment research community. The study also demonstrates that zero-shot VLM prompting can collapse a two-stage detection+recognition pipeline into a single inference call, which has implications for how VLMs are positioned relative to specialized OCR systems like PaddleOCR or TextIn. For researchers tracking VLMs, this is a useful reminder that cross-modal pre-training diversity — not just model scale — appears to be the key driver of robustness on visually degraded, locale-specific text tasks.