About MedSign

How to use

Allow camera access. Sign one word at a time, then press Stop to generate English. Delete word removes one word; Clear All starts over. Resume keeps the words for correction. Say generates Kokoro speech and plays it in your browser. Done returns Home.

Use your mouse or point and hold inside a button for 0.8 seconds, then move away.

Supported words

CHEST PAIN DAY TWO WORSE DIABETES YES MEDICINE NOW NO BRING

Where processing happens

Your camera images and landmarks stay in this browser. English generation and Kokoro speech also run here. No camera frames, words or speech text are sent to an inference server. Your first translation downloads about 1.1 GB of model files; Kokoro adds about 100 MB. Use desktop Chrome or Edge with sufficient memory. Browser generation uses quantized weights and greedy decoding, so results can differ from the laptop's full-precision beam search. Your laptop can stay off. History stays in this tab's session storage.

First load downloads browser software and models. Use a recent Chrome or Edge browser. Performance depends on the visitor's device.

Prototype limits

Recognition can be wrong. Generated English can add or omit meaning. Compare it with your signs. Results are generated, unreviewed statements.