Zoom中的AI

智能画廊视图Smart Gallery View

Smart Gallery使用AI在Zoom Room中拍摄多个参与者的单摄像机视图,并在Gallery View中将其显示为单个流。

Zoom备受期待的智能画廊视图Smart Gallery View,从2021年起供Zoom Rooms客户使用。

broken image

新功能采用单摄像机视图,并使用人工智能将其转换为会议室中每个与会者的多个视频流,从而增强面对面的会议体验。

  Smart Gallery的目标是更密切地关注Zoom Room中的参与者群体,并向远程与会者更清晰地展示这些人,确保远程会议与会者的公平性和包容性。

 

工作原理

  Gallery View通过使用物理或“逻辑”摄像机以及Zoom所称的虚拟摄像机来工作。虚拟摄像机从视图中精确定位特定区域,并将其提取为单独的视频流。

  然后,这些单独的视频流可以拼接在一起,创建我们去年都熟悉的画廊视图(Gallery View)。

  例如,如果三个人坐在一个相邻的房间里,从家里参加会议的第四位与会者可以看到另外三位与会者在不同的画面中,就好像他们都是远程拨入的一样。

  Zoom准确地解释了Smart Gallery View对远程参与者的作用:“如果远程参与者使用Gallery视图、并排视图或缩略图视图,或者如果他们决定锁定特定视频,他们将能够从Zoom Room访问所有可用的视频源。”

  “每个Zoom Room视频源都以完全分辨率显示为不同的会议参与者。这些会议参与者以Zoom Room本身命名,后面跟着一个数字:“会议室-1(Conference Room-1)”、“会议室-2(Conference Room-2)”等。

  Smart Gallery目前在Neat、Poly、Logitech和DTEN D7设备等产品提供支持。

  用户需要使用运行5.7.0或更高版本的Zoom Rooms设备。帐户所有者或管理员可能必须为某些用户启用该功能。

  默认情况下,也可以启用智能库视图。为此,用户应登录Zoom web门户,单击房间管理,然后Zoom Rooms。然后,可以使用“Zoom Rooms位置”从帐户、位置或房间设置启用智能图库视图。

What Is Zoom Smart Gallery?

Smart Gallery is a 2021-launched Zoom feature that allows meeting participants sitting in the same office location or conference room to appear in a gallery view, just as if they were sitting in different remote locations.

You can think of Zoom Smart Gallery as the opposite of Zoom’s Immersive View. In Immersive View, participants from different locations are superimposed into a virtual location such as a gallery, a coffee shop, or a boardroom background. The experience appears to be seamlessly stitched together, and there is no jar between the participants and the virtual background.

Zoom Smart Gallery is precisely the opposite – as it makes individuals in the same location appear in a gallery view, instead of their natural office or board room environment. For example, if there are six people in the office, the Smart Gallery will have a 3×2 grid, showing each participant in one of the six boxes of the grid. The company launched Smart Gallery view in July 2021 to work with the Zoom Rooms offering.

What Are the Benefits of Zoom Smart Gallery?

The feature is purpose-built for hybrid meetings, where some participants will join in together from an office while others will be remote or WFH. Regardless of where they are, all meeting participants will be presented in a grid format. This has several benefits:

● Everyone gets an equitable experience – In a conventional hybrid meeting setup, it is obvious who is in office and who is not. WFH employees may feel self-conscious that they are unable to, or they choose not to turn up at the office, despite having every right. This reduces the level of psychological comfort and may discourage meeting participation. In contrast, Zoom Smart Gallery puts everyone on the same playing field.

● WFH employees can easily focus on the active speaker – A camera cannot capture the meeting room environment the same way as the human eye. As a result, WFH employees will see participants emphasized more than others and may not always be able to focus on the active speaker. Zoom Smart Gallery places everyone on a grid so that all participants gain from the same digital real estate.

● Multiple offices can join simultaneously – Zoom Smart Gallery isn’t just limited to one office meeting space and several WFH workers. It can accommodate video streams from up to three meeting rooms, unifying multiple in-person and remote locations. For example, suppose five employees are joining in from the office headquarters, two employees from the new store, and the accountant logging in from their home. In that case, Zoom Smart Gallery will display all of them in a grid interface for an intuitive and frictionless conversation.

How Does Zoom Smart Gallery Work?

Smart Gallery is a Zoom Rooms feature that relies on the video conferencing platform’s powerful artificial intelligence and cutting-edge hardware by Zoom’s camera and equipment partners. For example, you can access Zoom Rooms Smart Gallery with Poly Studio X30, among other devices.

Once you have compatible hardware, the feature requires an optimized meeting room layout. Depending on the layout, the camera will capture all the meeting participants together individually to create a seamless experience. It combines the hardware appliance’s physical or logical camera with a virtual camera that will actively identify a meeting participant and extract their specific video feed.

The individual video feeds of the different meeting participants are stitched together into one gallery view.

Employees logging in remotely can tell participants about and identify their actual location through the feature’s naming convention. Each tile or square in the gallery will have a label containing the name of that particular Zoom Room, followed by 1, 2, 3, etc.

How to Use Zoom Smart Gallery

To use Zoom Smart Gallery, you need to be on Zoom Rooms Appliances version 5.8.0 or higher. You also need a recent version of Zoom Rooms for desktop or Zoom Rooms Controller for a mobile device. Once these prerequisites are in place, open Camera Control on a Zoom Rooms controller and select Multi-Stream. This will enable the gallery view on your Zoom Rooms display.

The same functionality is available on Zoom Rooms for Touch under the Settings menu.

You can also set Smart Gallery as the default room view so that participants are presented in a grid immediately after joining. Sign in to the Zoom Web Portal, go to Room Management, then click Zoom Rooms. Here, you can use location hierarchy to find the room and device you need and activate the multi-stream option for that specific room.

For remote attendees, the experience will be exactly as if everyone has joined in from remote locations, and they do not need to follow any additional steps. However, not all devices may be able to render the camera feed and the active speaker stream correctly.

broken image