What is Google Project Starline and how does it work?

(Pocket-lint) – One thing that people learned from the pandemic is that there is no substitute for being together in a room with someone. While video conferencing apps such as Zoom, Google Meet, and Microsoft Teams try to help you virtually connect with those you love and work with, the experience still feels rather limited. So, in an attempt to push the boundaries of remote collaboration, Google has come up with Project Starline.

And it’s planning to start testing this project with partners such as T-Mobile later this year.

What is Google Project Starline?

  • Early video calling system that renders in 3D, no glasses required

Google CEO Sundar Pichai took the stage at Google I/O 2021 to announce that his company kicked off a project “several years ago” that builds on different areas of computer science and relies on custom-built hardware and highly specialised equipment. Called Project Starline, it’s an early natural-feeling telepresence system that makes it seem as if the other person on a video call is sitting in front of you. Each participant sits in a booth outfitted with cameras and infrared projectors that create a realistic depiction, while spatial audio makes it seem as if the voice is coming from right in front of you and out of the person’s mouth.

POCKET-LINT VIDEO OF THE DAY

Using head tracking and a 65-inch, 8K glasses-free display, the system allows you to video call someone and experience them in hyper-realistic 3D. 

How does Google Project Starline work?

There are three components to Project Starline:

  • Cameras and depth sensors: Specialised equipment that captures a person from multiple perspectives
  • Computer science advances: Custom software, including novel compression and streaming algorithms
  • Light field display: Custom hardware that renders a realistic representation of someone in 3D

Project Starline uses high-resing cameras and custom depth sensors to capture a user’s shape and appearance from multiple perspectives, and then all that is fused by software to create an extremely detailed, real-time 3d model.

Google said it’s applying research in computer vision, machine learning, spatial audio, and real-time compression. The effect is the feeling of a person sitting across from you.  The resulting data is also huge – many gigabits per second.

So, to send this 3D imagery over existing networks, Google developed novel compression and streaming algorithms that reduce the data by a factor of more than 100. Google also developed a light field display that shows you the realistic representation of someone sitting right in front of you in three dimensions.  As you move your head and body, Google’s system can adjust the images you see in the light field display to match your perspective.

It creates a sense of volume and depth without the need for additional glasses or headsets. “You can talk naturally gesture and make eye contact,” CEO Sundar Pichai described at I/O 2021. “It’s as close as we can get to the feeling of sitting across from someone.”

When will Project Starline be available?

  • It launched in a few of Google’s offices
  • It’s been demoed with over 100 companies
  • Salesforce, T-Mobile, WeWork, and others will test it in Q4 2022

Google said it’s already spent thousands of hours testing Project Starline in its own offices. At first, there were no plans to commercially release the product for consumers. Google only said there had been excitement from enterprise partners, and it was planning to expand access to partners in healthcare and media.

As of October 2022, Ars Technica reports Google plans to start installing Project Starline prototypes in some of its corporate partners’ offices for tests later this year. Partners include Salesforce, T-Mobile, and WeWork. It also said Google has been conducting demos with over 100 companies spread across healthcare, media, and retailers.

Want to know more?

Check out Google’s blog post about Starline for more details.

Writing by Maggie Tillman.

Tags:

cex listed on couponmatrix.ukgodaddy listed on couponmatrix.ukhotpoint listed on couponmatrix.ukqvc listed on couponmatrix.ukuk-sport-imports listed on couponmatrix.ukvictorian-plumbing listed on couponmatrix.uk
cex listed on couponmatrix.ukCeX provides a quick and low-cost way to secure quality games, films, phones and electronics on a budget. As an enormous marketplace that buys, sells, trades and repairs, customers are guaranteed a great deal on all things entertainment with a CeX voucher to hand. With over 25 years’ experience and a host of stores nationwide, it’s easy to see why so many choose to shop second-hand at CeX.
godaddy listed on couponmatrix.ukIf you are looking to purchase a website domain and get it hosted at the same time, then GoDaddy is the site for you. In conjunction with us here at Groupon, if you are looking to buy something on GoDaddy, you can take advantage of some of the fantastic promotions that we have. With an exclusive GoDaddy promo code, you can save money and get a great bargain - whether you are wishing to purchase a domain or benefit from a discount on hosting. Check out our amazing GoDaddy promotions and deals here at Groupon.
hotpoint listed on couponmatrix.ukWith free nationwide delivery and guaranteed warranty across all products, Hotpoint is a no-brainer brand when it comes to you searching for new kitchen and house appliances! If you thought prices couldn’t get any lower then you’ll get a pleasant surprise when you use a Hotpoint voucher code to discount your next order. Whether you’re in need of a tumble dryer or you’re searching for a cooker, Hotpoint has the quality goods you want.
qvc listed on couponmatrix.ukSailing straight from the states, QVC has made quite an impact on British TV shopping in its over 20 years of broadcasting in the UK. Supporting the shopping channels with a wealth of fashion, beauty, jewellery and homeware items, there are hundreds of goods to keep you and your home looking fabulous. Use a QVC discount code to bring down the price of items just featured on live shows and bag new releases at sale-worthy prices.
uk-sport-imports listed on couponmatrix.ukUK Sport Imports is a leading provider of sporting goods and equipment in the UK. They offer a wide range of products for a variety of sports, including basketball, football, tennis and more. They also have a huge range of outdoor equipment, such as swimming pools, barbecues, and inflatable kayaks. UK Sport Imports is the perfect place to shop for all your sporting needs. And with a UK Sport Imports voucher code from us, you can save even more on your purchase. So don't wait any longer, head to UK Sport Imports and start shopping! At Groupon, we understand that saving money is important to our customers. That's why we work hard to find the best UK Sport Imports voucher codes and discounts codes for our customers. Sports equipment can be expensive, that’s why we want to help you save as much money as possible on your next purchase from UK Sport Imports. So be sure to check back with us often for the latest deals and discounts. If you're looking for a great deal on sporting goods and equipment, especially workout products, be sure to check out UK Sport Imports. One of their top-performing products is their barbell set, so if you’re looking for high quality workout equipment, look no further than UK Sport Imports. And with a UK Sport Imports discount code from us, you can save even more on your purchase. So what are you waiting for? Start shopping at UK Sport Imports today!
victorian-plumbing listed on couponmatrix.ukWash big-spending down the drain with the beautiful range of bathrooms and accessories from Victorian Plumbing UK. From fixtures and fittings that will add sparkle to a small space to luxury bathrooms with all the bells and whistles, a Victorian Plumbing discount code from us could make all your home improvement dreams come true. With Victorian Plumbing, you can give one of the most-used rooms in your house the special attention it deserves while keeping your budget intact.