EyeScopeAI

Development and internal validation of a smartphone-based, offline machine-learning model for refractive-error screening among rural high-school children in North Karnataka: a feasibility study

Anirudh Gangadharan,1 Jannatbi L. Iti2
1 Principal Investigator · 2 Co-Investigator
Gadag Institute of Medical Sciences, Gadag, Karnataka
ICMR STS Grant · 2026–2028


Background

  1. Uncorrected refractive error (URE) is the leading cause of moderate-to-severe vision impairment in children. In 2019, approximately 19 million children aged 5–15 years had such impairment globally, of whom around 67% were attributable to URE.1
  2. Myopia has risen from 23% of the global population in 2000 to 34% in 2020, and is projected to reach 50% by 2050.2 Current school-age prevalence of URE stands at 36%.
  3. Conventional screening is resource-intensive and inaccessible in rural settings. Clinical refraction requires specialist-led equipment — retinoscopes, autorefractors, phoropters — that are scarce in low-resource areas. Guardians must escort children to urban clinics, incurring time and cost barriers that delay diagnosis.
  4. Fundus-based AI models show potential but depend on expensive cameras and high-quality images, limiting their utility in field conditions.

Objectives

  1. To develop a machine-learning model that estimates the spherical equivalent (SE) of refractive error within ±0.5 D of autorefraction, using smartphone-measured visual acuity.
  2. To assess the diagnostic accuracy of the ML model.
  3. To assess the agreement between smartphone-based (EyeScopeAI) visual acuity and physician-administered Snellen visual acuity among high-school children.

Methodology

Study design. Observational cross-sectional study conducted in two rural high schools of Gadag district, North Karnataka (classes 8–10). Study period: 1 January 2026 to 30 June 2028.

Sample size. To detect a mean absolute error (MAE) of ≤0.1 D with 95% confidence, assuming σ = 0.5 D,3 using n = Z²σ²/d², the minimum required sample was 96. With a 10% dropout allowance, n = 110. Two schools were selected by lottery method and 55 participants recruited from each.

Participants. High-school children and teachers in the selected rural area willing to participate and able to follow app prompts. Children with blindness, ocular pathology (corneal opacity, dense cataract), recent ocular surgery (<6 months), or cognitive/physical inability to interact with a smartphone were excluded.

Study tools. Data were collected using a predesigned, pre-structured, and pretested questionnaire comprising: the Refractive Error Study in Children (RESC) instrument6 — a WHO-validated survey for children aged 5–15 years covering visual acuity, spectacle ownership, and barriers to use; the System Usability Scale (SUS)7 — a 10-item instrument yielding a 0–100 score where ≥68 denotes above-average usability; the Academic Stress Scale (ASS)8 — a 35-item psychometric tool quantifying academic stressors; and smartphone-based visual acuity testing together with sociodemographic profiling.

Digital visual acuity assessment. Participants underwent distance visual-acuity testing at a fixed 2 m distance. The screen was first calibrated against a known 5 cm × 5 cm reference card to compute pixels-per-inch and scale the tumbling-E optotypes. The child reported the orientation of each E; a correct response advanced to the next smaller optotype. The test terminated when the child failed two of three consecutive presentations, and the decimal visual acuity was recorded automatically.

Gold-standard refraction. Physician-administered Snellen visual acuity and spherical equivalent measured by autorefractor served as the ground-truth labels for model training.

Study pipeline: from smartphone capture and screen calibration through tumbling-E acuity testing and questionnaire to ML model training and referral decision
Figure 1. Study pipeline — from smartphone capture and screen calibration through the tumbling-E acuity test and questionnaire to ML model training, SE prediction, and referral screening.

Feature set. Thirty-one variables were used: smartphone-measured decimal visual acuity (right eye, left eye, worse eye, inter-eye difference), age, grade, sex, vision and aberration symptoms (blackboard visibility, distance face recognition, crowded-shelf and peripheral-vision difficulty, fine-task difficulty, depth perception, glare, starbursts, haloes, night-vision difficulty, dark adaptation, asthenopia, inter-ocular difference), screen-time, viewing distance, ambient lighting, sleep difficulty, classroom seating, and outdoor activity. Reference-standard measurements (Snellen acuity, pinhole acuity, autorefraction, WHO-app scores) and spectacle ownership were excluded to prevent information leakage.

Modelling algorithms. Eleven algorithms were trained: three pre-specified models (ridge regression, random forest, XGBoost) together with elastic-net, extra-trees, histogram-based gradient boosting, LightGBM, CatBoost, NGBoost, a TabNet deep-learning model, and a stacking ensemble.

Validation strategy. Five-fold cross-validation with out-of-fold prediction for every participant. Evaluation metrics: MAE, RMSE, R², proportion of predictions within ±0.5 D, AUC-ROC, sensitivity, specificity, PPV, and NPV. The deployment target is offline, on-device inference via TensorFlow Lite on low-cost Android phones; on-device deployment was not undertaken in the present feasibility study.

Software. Model development in Python (scikit-learn, XGBoost, LightGBM, CatBoost, NGBoost, PyTorch-TabNet; matplotlib for plotting). Descriptive, agreement, and diagnostic-accuracy statistics in SPSS version 21.

Statistical analysis. Data coded and entered in Microsoft Excel. Descriptive statistics reported as frequency, proportions, and mean ± SD. Categorical analysis by chi-square test. A two-sided p value of ≤0.05 was considered statistically significant.

Quality control and data security. Built-in input validation and screen-lock override during testing. Participant data were anonymised; stored with AES-256 encryption at rest and TLS in transit, with a secure linkage key for re-identification only during final analysis.

Ethical considerations. The study was conducted after Institutional Ethics Committee approval. Permission was obtained from schools and higher authorities. Informed written consent from parents or guardians, and assent from students in their language of understanding, were obtained for voluntary participation.


Results

1. Sociodemographic profile

A total of 110 children were studied. Most were aged 14–15 years (60; 54.5%), followed by 12–13 years (26; 23.6%) and 16 years (24; 21.8%). Females (57; 51.8%) and males (53; 48.2%) were comparably represented. By the modified B.G. Prasad scale, the largest groups were class IV lower-middle (40; 36.4%) and class III middle (30; 27.3%).

Table 1a. Age-group distribution (n = 110).
Age group (years)Frequency (n)Percent (%)
12–132623.6
14–156054.5
162421.8
Total110100.0
Table 1b. Sex distribution (n = 110).
CategoryFrequency (n)Percent (%)
Female5751.8
Male5348.2
Total110100.0
Table 1c. Socioeconomic status by modified B.G. Prasad scale (n = 110).
CategoryFrequency (n)Percent (%)
I — Upper10.9
II — Upper Middle2522.7
III — Middle3027.3
IV — Lower Middle4036.4
V — Lower1412.7
Total110100.0

2. Visual-acuity agreement: EyeScopeAI vs physician Snellen

Agreement between EyeScopeAI and physician Snellen acuity (worse eye) was statistically significant (Pearson χ² = 13.12, df = 1, p < 0.001). The application classified more eyes as impaired than the Snellen chart (76 vs 44); of 66 eyes recorded as normal on Snellen testing, 37 were flagged impaired by the app, indicating a conservative, sensitivity-favouring threshold. Mean decimal acuity was marginally lower with the app (0.75 ± 0.31) than with Snellen testing (0.84 ± 0.25).

Table 2a. EyeScopeAI app vs physician Snellen visual acuity (worse eye); n (row %).
AppSnellen Normal, n (%)Snellen Impaired, n (%)Totalp value
Normal29 (85.3%)5 (14.7%)34Pearson χ² = 13.12, df = 1, p < 0.001
Impaired37 (48.7%)39 (51.3%)76
Total6644110
Table 2b. Mean decimal visual acuity, app vs Snellen (mean ± SD).
Snellen (Physician)EyeScopeAI App
0.84 ± 0.250.75 ± 0.31

3. AUC-ROC curves

The referral classifiers showed high discrimination, with areas under the ROC curve of 0.991 for elastic-net, 0.985 for XGBoost, 0.975 for LightGBM, and 0.972 for the stacking ensemble.

ROC curves for the four best-performing referral models: ElasticNet AUC 0.991, XGBoost 0.985, LightGBM 0.975, Stacking 0.972
Figure 2. ROC curves of the four best-performing referral models (worse-eye, 5-fold CV). ElasticNet achieved the highest AUC of 0.991.

4. Screening recommendation vs autorefractor (gold standard)

Against autorefraction, the elastic-net screening model correctly identified all 14 children requiring referral and misclassified 5 of 96 children not requiring referral, yielding a sensitivity of 100%, specificity of 94.8%, PPV of 73.7%, and NPV of 100% (Pearson χ² = 76.83, df = 1, p < 0.001). The mean worse-eye spherical equivalent was identical between methods (autorefraction −0.33 ± 0.92 D; predicted −0.33 ± 0.72 D), with strong agreement (Eta = 0.939; Eta² = 0.881).

Table 4a. EyeScopeAI (elastic-net) screening recommendation vs autorefractor spherical equivalent; n (row %).
Predicted screenAutorefractor Normal, n (%)Autorefractor Impaired, n (%)Totalp value
Normal91 (100%)0 (0%)91Pearson χ² = 76.83, df = 1, p < 0.001
Impaired5 (26.3%)14 (73.7%)19
Total9614110

Sensitivity 100%, Specificity 94.8%, PPV 73.7%, NPV 100%.

Table 4b. Mean worse-eye spherical equivalent, autorefraction vs EyeScopeAI prediction (mean ± SD).
AutorefractorEyeScopeAI (ElasticNet predicted SE)
−0.33 ± 0.92 D−0.33 ± 0.72 D

5. Model performance — 5-fold cross-validation (n = 110)

Across 11 algorithms, random forest provided the most accurate worse-eye spherical-equivalent estimate (MAE 0.364 D; 84.5% of predictions within ±0.5 D; R² 0.50). For the referral decision, elastic-net achieved the highest sensitivity (100%) while tree-ensemble models offered higher specificity.

Table 5a. Worse-eye spherical-equivalent estimation by model (5-fold CV).
ModelMAERMSEWithin ±0.5 D
RandomForest ★0.3640.6510.49684.5%
NGBoost0.3760.6130.55383.6%
XGBoost0.3780.6550.49079.1%
CatBoost0.3840.6850.44380.0%
Stacking0.4040.7000.41775.5%
ExtraTrees0.4190.8130.21482.7%
TabNet0.4630.944−0.05980.0%
ElasticNet0.4810.7610.31266.4%
HistGBR0.4940.7410.34661.8%
LightGBM0.5200.7580.31759.1%
Ridge0.5490.8150.21159.1%

★ Best estimation model by MAE and proportion within ±0.5 D.

Table 5b. Right-eye (OD) spherical-equivalent estimation by model.
ModelMAERMSEWithin ±0.5 D
RandomForest ★0.3050.6420.42187.3%
CatBoost0.3100.6290.44488.2%
NGBoost0.3130.6400.42587.3%
XGBoost0.3260.6320.43984.5%
Stacking0.3390.6450.41584.5%
ExtraTrees0.3410.7520.20688.2%
ElasticNet0.4190.7130.28674.5%
TabNet0.4391.093−0.67884.5%
HistGBR0.4500.6790.35167.3%
LightGBM0.4590.6860.33867.3%
Ridge0.4810.7540.20266.4%
Table 5c. Left-eye (OS) spherical-equivalent estimation by model.
ModelMAERMSEWithin ±0.5 D
RandomForest ★0.2970.5170.63087.3%
NGBoost0.2950.4700.69486.4%
XGBoost0.2960.5030.65083.6%
Stacking0.3240.5380.60083.6%
CatBoost0.3260.5520.57983.6%
ExtraTrees0.3550.6510.41382.7%
TabNet0.3460.6210.46681.8%
ElasticNet0.4360.6400.43469.1%
LightGBM0.4700.6780.36466.4%
HistGBR0.4640.6750.36962.7%
Ridge0.5080.6990.32360.9%
Table 5d. Referral screening performance by model (worse eye).
ModelSens.Spec.PPVNPVAUCTPFPFNTN
ElasticNet ★100%94.8%0.7371.0000.991145091
LightGBM92.9%90.6%0.5910.9890.975139187
HistGBR92.9%93.8%0.6840.9890.969136190
Stacking92.9%97.9%0.8670.9890.972132194
Ridge85.7%89.6%0.5450.9770.9691210286
TabNet85.7%97.9%0.8570.9790.913122294
RandomForest78.6%97.9%0.8460.9690.950112394
CatBoost78.6%100%1.0000.9700.927110396
XGBoost78.6%96.9%0.7860.9690.985113393
ExtraTrees71.4%97.9%0.8330.9590.968102494
NGBoost71.4%96.9%0.7690.9590.968103493

★ Best referral model by sensitivity and AUC. Referral criterion: worse-eye SE ≤ −0.75 D, ≥ +2.0 D, or cylinder ≤ −1.0 D.


Discussion

In this feasibility study, an offline smartphone-based machine-learning model estimated the spherical equivalent of refractive error within ±0.5 D of autorefraction in the majority of children and, when applied as a referral screen, identified those requiring ophthalmic evaluation with high sensitivity. The best-performing estimation model (random forest) achieved an MAE of 0.36 D with 84.5% of predictions within ±0.5 D, whereas the referral classifier (elastic-net) attained a sensitivity of 100% and an NPV of 100% against the gold standard. These findings indicate that lightweight, on-device AI can extend refractive-error screening to schools through non-specialist administrators without specialist equipment or internet connectivity.

The accuracy of spherical-equivalent estimation was comparable to previously reported ML models. Du et al. — using ocular biometric inputs to predict cycloplegic SE in Chinese school children — reported an MAE of 0.37–0.44 D with 77–83% within ±0.5 D.14 Our model achieved a similar MAE (0.36 D) and a marginally higher proportion within ±0.5 D (84.5%), despite relying solely on smartphone-measured visual acuity and questionnaire responses rather than on biometric measurements such as axial length. The lower R² (0.50 vs 0.89–0.93 in biometry-based models) was expected, as visual acuity carries less direct optical information than ocular biometry; the clinically relevant ±0.5 D agreement target was nonetheless met.

The EyeScopeAI application showed moderate agreement with physician Snellen acuity (χ² = 13.12, p < 0.001), tending to classify more eyes as impaired. A comparable pattern was reported by Raffa et al., whose "Smart Optometry" application detected subnormal visual acuity with a sensitivity of 89.3% but showed systematic differences from conventional charts.13 This conservative behaviour — favouring sensitivity over specificity — is desirable in a screening context where missing a child with genuine visual deficit carries greater cost than a false alarm.

For the referral decision, the model achieved an AUC of 0.991 with perfect sensitivity, exceeding the diagnostic performance reported for several smartphone-based screening tools. The proportion of children meeting referral criteria (12.7%) was consistent with the prevalence of refractive error reported among Indian school children.12 The non-cycloplegic threshold of −0.75 D adopted here corresponds to the standard cycloplegic definition of −0.50 D for myopia in Indian children9 and to the optimal non-cycloplegic referral cut-off for the 13–15-year age group.10

By embedding visual-acuity testing, a brief questionnaire, and automated referral logic within a single offline application, the workflow can be delivered by schoolteachers or accredited social health activists during routine school hours, reducing dependence on specialist personnel and urban clinics. This aligns with the objectives of the National Programme for Control of Blindness and Visual Impairment.

Strengths include the use of autorefraction as an objective reference standard, comparison of multiple contemporary algorithms within a cross-validated framework reported in accordance with TRIPOD and STARD recommendations, and the generation of out-of-fold predictions that minimise optimistic bias. Limitations include internal validation within a single district, a modest sample, and a small number of referral-positive children — the apparently perfect sensitivity should therefore be interpreted with caution. Refraction was assessed without cycloplegia, and only distance acuity was measured. External and temporal validation in independent, prospectively recruited cohorts is required before programmatic recommendation.


Conclusion


Comparable Studies

Table 6. Summary of comparable studies.
ReferenceMethod / ClassifierPopulationKey performance
Raffa et al. (2022)13Smartphone VA app (Smart Optometry)Children <18 y, Saudi ArabiaSensitivity 89.3% for subnormal VA
Du et al. (2023)14ML (biometry-based SE prediction)School children, ChinaMAE 0.37–0.44 D; 77–83% within ±0.5 D
Gopalakrishnan et al. (2021)9Open-field autorefraction (threshold)Children 5–15 y, South IndiaSE ≤ −0.75 D non-cycloplegic ≡ −0.50 D cycloplegic
Present studyML (app VA + questionnaire)High-school children, North KarnatakaRF: MAE 0.36 D, 84.5% within ±0.5 D; referral (elastic-net) sensitivity 100%, specificity 94.8%, AUC 0.991

References

  1. Yang Z, Jin G, Li Z, et al. Global disease burden of uncorrected refractive error among adolescents from 1990 to 2019. BMC Public Health. 2021;21(1):1–10.
  2. Holden BA, Fricke TR, Wilson DA, et al. Global prevalence of myopia and high myopia and temporal trends from 2000 through 2050. Ophthalmology. 2016;123(5):1036–42.
  3. Das S, Mitra K, Mandal M. Sample size calculation: Basic principles. Indian J Anaesth. 2016;60(9):1–7.
  4. Rajabpour M, Kangari H, Pesudovs K, et al. Refractive error and vision related quality of life. BMC Ophthalmol. 2024;24(1):1–6.
  5. Harman NB. The Definition of Blindness. BMJ. 1926;1(3412):907–8.
  6. Negrel AD, Maul E, Pokharel GP, Zhao J, Ellwein LB. Refractive error study in children: sampling and measurement methods for a multi-country survey. Am J Ophthalmol. 2000;129(4):421–6.
  7. Brooke J. SUS: A "Quick and Dirty" Usability Scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL, eds. Usability Evaluation in Industry. London: Taylor & Francis; 1996:189–94.
  8. Kohn JP, Frazer GH. An Academic Stress Scale: Identification and Rated Importance of Academic Stressors. Psychol Rep. 1986;59(2):415–26.
  9. Gopalakrishnan A, Hussaindeen JR, Sivaraman V, et al. The Sankara Nethralaya Tamil Nadu Essilor Myopia (STEM) Study — defining a threshold for non-cycloplegic myopia prevalence in children. J Clin Med. 2021;10(6):1215.
  10. Lyu P, Shi J, Wang J, et al. Optimizing myopia screening referral guidelines for children aged 4 to 18 based on non-cycloplegic indicators. BMC Ophthalmol. 2025;25(1):561.
  11. Negrel AD, Maul E, Pokharel GP, Zhao J, Ellwein LB. Refractive error study in children: sampling and measurement methods for a multi-country survey. Am J Ophthalmol. 2000;129(4):421–6.
  12. Murthy GVS, Gupta SK, Ellwein LB, et al. Refractive error in children in an urban population in New Delhi. Invest Ophthalmol Vis Sci. 2002;43(3):623–31.
  13. Raffa LH, Balbaid NT, Ageel MM. "Smart Optometry" phone-based application as a visual acuity testing tool among pediatric population. Saudi Med J. 2022;43(8):946–53.
  14. Du B, Wang Q, Luo Y, et al. Prediction of spherical equivalent difference before and after cycloplegia in school-age children with machine learning algorithms. Front Public Health. 2023;11:1096330.

Funded by the Indian Council of Medical Research (ICMR) Short-Term Studentship (STS) Grant. Ethics approval obtained from the Institutional Ethics Committee, Gadag Institute of Medical Sciences. The authors declare no conflicts of interest.