Oriel — AI & technology worth noticing, every day.

Edge-Optimized YOLOv11n Architecture for Offline Recognition of Nigerian Sign Language Alphanumeric Gestures

Paper · https://arxiv.org/abs/2611.00025

arXiv:2611.00025v1 Announce Type: new Abstract: Deaf inclusion across sub-Saharan society faces regional hurdles, with Nigeria as the core empirical focus. Existing recognition models demand heavy computational infrastructure. However, standard mobile phones used locally rarely exceed 1 GB to 4 GB of RAM. This study addresses constraints through a lightweight YOLO11n object-detection framework. The system provides real-time Nigerian Sign Language recognition for low-resource hardware. A benchmark dataset containing 11,208 raw gesture images was established. The data spans 33 static classes collected from five signers. Partitioning isolates signers S1 through S3 for training. Signer S4 provides validation data. Signer S5 is reserved for testing. Spatial augmentations are restricted strictly to the training set. This yields 23,509 training images. The validation and test sets each maintain 1,681 images across varied environments. The framework integrates a quantization-aware compression objective. Loss functions merge with squared Frobenius-norm penalties to govern weight distortion. A Spatial-Density Occlusion Index quantifies background complexity and self-occlusion. A latency-profiling equation relates floating-point operations and memory bandwidth to chipset clock speed. Performance testing on physical Android hardware utilizes unquantized FP32 weights. Mean inference latencies span 405.5 ms to 1,759.4 ms. Measured against test data, the algorithm attains a Precision of 0.9975. Recall reaches 0.9991. Mean Average Precision is 0.9942. Outcomes support offline functionality on constrained mobile devices. Practical deployment operates through a mobile utility using CameraX. The application captures gestures in real time. Recognized signs display as text instantly.

First seen by Oriel on .

AI summary

The study presents a lightweight YOLO11n system for offline Nigerian Sign Language alphanumeric recognition on constrained Android phones, reporting 0.9942 mean average precision.

  • The benchmark contains 11,208 raw images across 33 static gesture classes from five signers, with signers separated across training, validation, and testing.
  • Training-set spatial augmentation expands the training data to 23,509 images; validation and test sets each contain 1,681 images.
  • The framework combines quantization-aware compression with squared Frobenius-norm penalties, and introduces indices for background complexity and self-occlusion.
  • On physical Android hardware using unquantized FP32 weights, mean inference latency ranges from 405.5 ms to 1,759.4 ms; Precision is 0.9975 and Recall is 0.9991.
  • A CameraX mobile utility captures gestures and displays recognized signs as text without requiring an internet connection.

#yolo #sign language recognition #edge ai #android

Generated by gpt-5.6-sol. Check the original for details.

Aliases

SourceExternal IDURL
arXiv AI Papersoai:arXiv.org:2611.00025v1https://arxiv.org/abs/2611.00025 Read discussion