About MedSign
How to use
Allow camera access. Sign one word at a time, then press Stop to generate English.
Delete word removes one word; Clear All starts over. Resume keeps the words for correction.
Say generates Kokoro speech and plays it in your browser. Done returns Home.
Use your mouse or point and hold inside a button for 0.8 seconds, then move away.
Supported words
CHEST PAIN DAY TWO WORSE DIABETES YES MEDICINE NOW NO BRING
Where processing happens
Your camera images and landmarks stay in this browser.
English generation and Kokoro speech also run here. No camera frames, words or speech text
are sent to an inference server. Your first translation downloads about 1.1 GB of model files; Kokoro adds about 100 MB.
Use desktop Chrome or Edge with sufficient memory. Browser generation uses quantized weights and greedy decoding,
so results can differ from the laptop's full-precision beam search. Your laptop can stay off.
History stays in this tab's session storage.
First load downloads browser software and models.
Use a recent Chrome or Edge browser. Performance depends on the visitor's device.
Prototype limits
Recognition can be wrong. Generated English can add or omit meaning.
Compare it with your signs. Results are generated, unreviewed statements.