There’s a blog post out today you might want to look at:
https://techcommunity.microsoft.com/t5/microsoft-teams-blog/what-s-new-for-microsoft-teams-rooms-teams-devices-and/ba-p/3631513

Looks like the feature is now going to be called “IntelliFrame” and they’re going for a hybrid approach, so even if you don’t have the advertised OEM stuff, Teams will still be able to do it:

“In Teams Rooms outfitted with a camera capable of running advanced OEM AI features, remote attendees see an IntelliFrame view of the room’s participants. Poly, Logi, Jabra, and Neat are partners with this technology available this year.

For Teams Rooms equipped with all other existing camera types, IntelliFrame delivers an enhanced video gallery experience by leveraging the latest Microsoft-built AI models running in the Microsoft cloud, which process the video stream from the room. This experience will be available in early 2023.”

Would love to know your thoughts!

What has made me laugh/cry has been the vendor view – “Let’s do a demo of our kit” – and you’ll see a device – maybe like the one you mention – doing face detection and the vendor rep will use *cardboard cut outs of people* to “prove how well it works”. At the same time, I’ve seen customers who have added “our people” picture walls in meeting rooms which naturally, confuse these devices. Yet… they wouldn’t confuse, say, your Surface Pro, or Kinect on an XBox 360.

I’ve NOT tested the E70, but suspect because they didn’t put the cameras side-by-side, so that it could infer three dimensions, it would have the same issue; unless they are actually performing much more complex operations, such as attempting to track eye landmark movement such as blinking. I do love that the Poly E70 states it has 20 megapixel dual 4K sensors; which as 4K is 8.3 megapixels is a little confusing.. are they adding together the sensor combined count to make it sound better?

Regarding the MTR on Android – I struggled to find specifications on what each MTR on Android vendor puts inside the kit – if you have found out a good public source, I’ll gladly look. Having a collection of various ARM-based single-board computers – some with AI-coprocessors and some without, there’s a variety of options other than the Snapdragon chips.

I’ve been learning about the underlying technology – the Intel Movidius Myriad X (in the Intel NCS2 USB form) is hanging out of one of my lab devices, and are fairly useful for testing OpenCV. The Google Coral equivalent is hanging out of another lab device and represents (somewhat) of replicating the capability to do this stuff on a higher-end Snapdragon SOC. The price of these – even in USB-stick form is low enough that every Teams certified room camera should have this capability, rather than it being a premium feature; but frankly a $5 ESP32-AI MCU can perform face detection in real time using compiled code, and older ARM CPUs (32-bit or 64-bit) or 10 year old Intel x64 CPUs can do so, too.

Being equally at home in MS Teams, Zoom and Webex Room Systems I find it sometimes even hilarious to see how they watch each other, claim that there version is much better and just to see adopting the other guy’s solution when the initial dust settled.

Likewise AUDIO is similarly interesting but here the old paradigm is still valid: VC vendors mostly have no clue about audio so it is no wonder, that there is much less innovation there. Although, audio needs way less cpu juice, so would be much easier to do smart things. OK, I’ll stop here…