The previous implementation was very very hacky and used a bookmarklet alongside uglified messenger classes from 2 years ago to monitor a chat, it was also only for image messages.
The new release is a browser extension for chrome & firefox that you run on an alt facebook account on messenger that can monitor for new chat & image messages + video monitoring if in a call.
You can create a group chat and use a special method (instructions in the readme) to force the Glasses to be aware of the new group which allows for Hey Meta send a message/photo to _____ (ChatGPT, Perplexity or whatever you name the chat)
There are settings in the UI to change the AI chat provider, model and whether or not to generate and send audio via a text to speech provider (OpenAI, 11labs or Minimax)
I've also added video monitoring: you call the group chat and can have the extension to monitor the video output and send a photo to one of the providers every second (or a custom internal)
With the original project I did get an interview with the Reality Labs team but I ended up rescinding from the process for various reasons.
But, let me know what you think!
Planned features are listed under issues with the feature prefix: https://github.com/dcrebbin/meta-vision-api/issues
