This uses the Azure fromDefaultMicrophoneInput along with the fromAuthorisationToken function to authenticate with Azure and initialise a SpeechRecognizer.
When a user clicks the “Start Listening” button on the app UI, a function called streamSpeechFromBrowser is called. This app uses the Cognitive Services Speech service, which allows us to transcribe audible speech into readable, searchable text. This app uses just the audio, so it will only prompt for microphone permissions. It allows us to prompt the user for permission to use their microphone and or camera and, once allowed, get a stream of data from their media devices. The getUserMedia() API has been in browsers for a while. You can see and clone the code for the entire project on github, it is open source, and I’d be delighted if you used it to create your own wearable tech projects, especially if they can help make someone’s day better! Instructions on how to set up the app and its various dependencies are in there too. The web app is built with HTML, CSS and JS, it will run on your phone or your computer and just requires an internet connection and a microphone. The wearable part is a 32 by 8 display of neopixels (very small LEDs) connected to an Adafruit Feather Huzzah (a small, wifi enabled microprocessor) which is powered by a rechargeable USB battery.Ī flexible display attached to an Adafruit Feather Huzzah connected to a USB battery and a phone displaying the app How Does it work? The app uses the Ably Javascript SDK along with their MQTT broker to send messages from the app to the wearable hardware. It also contains a virtual representation of the hardware display to visualise what the hardware display will be showing. When it receives text back, the web app can display it to the user. The demo consists of a web app, which is used to capture microphone data and send it to Azure Cognitive Services. So began my journey to build a wearable live captioning demo. What if I could send text to the display from my phone’s microphone? It could update the mask display to show what I am saying! The display is incredibly small, flexible, breathable and has very low power consumption. It is a face mask with a wearable LED display inside.
0 kommentar(er)
