IIIT develops AI-powered video editing tool
The International Institute of Information Technology, Hyderabad, has developed GAZED, an artificial intelligence-powered video editing tool that combines images and videos from a static camera with those seen by a user.
GAZED, acronym for GAZe-guided EDiting technique, was developed by a team comprising Professor Vineet Gandhi of the Center for Visual Information Technology at IIIT, and his students Moneish Kumar and KL Bhanu Moorthy.
In traditional recording techniques at events such as music concerts, several cameras placed at different points are operated by trained personnel. Once the footage is captured, the video is then meticulously edited by a video editor. GAZED seeks to make things much simpler while improving the viewing experience.
While images from a single static camera are taken, the AI engine triggers multiple pan, tilt, and zoom cameras from a single video output. It is from this moment that GAZED takes on the cap of video editor and selects the best shots. The result is a rich visual experience similar to that of movie footage.
To give more authenticity to the images, the algorithm was to maintain consistency in the rhythm. This is achieved by training the algorithm to avoid cuts between the overlapping planes. He was also trained not to go for quick fire transitions. GAZED first composes virtual shots from tracks from actors or artists, then selects the best shot at each time interval by optimizing, incorporating the look and principles of cinematographic editing.
Given the COVID pandemic, GAZED should help small businesses that cannot afford expensive, state-of-the-art recording equipment.