Google AI has added one more new feature to its list that allows YouTube creators to change their video background similar to still photos. The video segmentation tool as they call it is currently available only to beta testers that include high profile-Youtubers. Bringing this feature to mobile is quite a challenging task. It is quite easy to figure out background ends, and foreground begins with a depth-sensing camera if you no need to worry about the processing time and battery.
Google AI (Artificial intelligence) Designed Training Procedure Ideal for Mobile Phones
In conventional methods, the videos are usually short with a green screen in the background. Later with the help of a computer, the green colour will be changed to the desired background with additional digital effects that involve visual graphics. But for a mobile that comes with RGB image, this involves rather a lot of complicated calculations. But the AI researchers from Google were able to overcome this obstacle. Google AI researchers fed the neural networks with tons of labelled images that included all the details of human architecture. They programmed the neural networks to focus on only the important features of humans such as head and shoulder rather than on individual parts such as eyes nostrils and nose etc. This in a way reduced the data it needed to calculate and yielded the fast, accurate segmentation engine that can is enough to be used in a video.
