Tango (platform)

Tango (formerly named Project Tango, while in testing) was an augmented reality computing platform, developed and authored by the Advanced Technology and Projects (ATAP), a skunkworks division of Google. It used computer vision to enable mobile devices, such as smartphones and tablets, to detect their position relative to the world around them without using GPS or other external signals. This allowed application developers to create user experiences that include indoor navigation, 3D mapping, physical space measurement, environmental recognition, augmented reality, and windows into a virtual world.

Tango
Original author(s)Google
Developer(s)Google
Initial releaseJune 5, 2014 (2014-06-05)
PlatformAndroid
Available inEnglish
TypeComputer vision
Websitedevelopers.google.com/tango/

The first product to emerge from ATAP,[1] Tango was developed by a team led by computer scientist Johnny Lee, a core contributor to Microsoft's Kinect. In an interview in June 2015, Lee said, "We're developing the hardware and software technologies to help everything and everyone understand precisely where they are, anywhere."[2]

Google produced two devices to demonstrate the Tango technology: the Peanut phone and the Yellowstone 7-inch tablet. More than 3,000 of these devices had been sold as of June 2015,[3] chiefly to researchers and software developers interested in building applications for the platform. In the summer of 2015, Qualcomm and Intel both announced that they were developing Tango reference devices as models for device manufacturers who use their mobile chipsets.[4][5]

At CES, in January 2016, Google announced a partnership with Lenovo to release a consumer smartphone during the summer of 2016 to feature Tango technology marketed at consumers, noting a less than $500 price-point and a small form factor below 6.5 inches. At the same time, both companies also announced an application incubator to get applications developed to be on the device on launch.

On 15 December 2017, Google announced that they would be ending support for Tango on March 1, 2018, in favor of ARCore.[6]

Overview

Tango was different from other contemporary 3D-sensing computer vision products, in that it was designed to run on a standalone mobile phone or tablet and was chiefly concerned with determining the device's position and orientation within the environment.

The software worked by integrating three types of functionality:

  • Motion-tracking: using visual features of the environment, in combination with accelerometer and gyroscope data, to closely track the device's movements in space
  • Area learning: storing environment data in a map that can be re-used later, shared with other Tango devices, and enhanced with metadata such as notes, instructions, or points of interest
  • Depth perception: detecting distances, sizes, and surfaces in the environment

Together, these generate data about the device in "six degrees of freedom" (3 axes of orientation plus 3 axes of position) and detailed three-dimensional information about the environment.

Project Tango was also the first project to graduate from Google X in 2012 [7]

Applications on mobile devices use Tango's C and Java APIs to access this data in real time. In addition, an API was also provided for integrating Tango with the Unity game engine; this enabled the conversion or creation of games that allow the user to interact and navigate in the game space by moving and rotating a Tango device in real space. These APIs were documented on the Google developer website.[8]

Applications

Tango enabled apps to track a device's position and orientation within a detailed 3D environment, and to recognize known environments. This allowed the creations of applications such as in-store navigation, visual measurement and mapping utilities, presentation and design tools,[9] and a variety of immersive games. At Augmented World Expo 2015,[10] Johnny Lee demonstrated a construction game that builds a virtual structure in real space, an AR showroom app that allows users to view a full-size virtual automobile and customize its features, a hybrid Nerf gun with mounted Tango screen for dodging and shooting AR monsters superimposed on reality, and a multiplayer VR app that lets multiple players converse in a virtual space where their avatar movements match their real-life movements.[11]

Tango apps are distributed through Play. Google has encouraged the development of more apps with hackathons, an app contest, and promotional discounts on the development tablet.[12]

Devices

As a platform for software developers and a model for device manufacturers, Google created two Tango devices.

The Peanut phone

"Peanut" was the first production Tango device, released in the first quarter of 2014. It was a small Android phone with a Qualcomm MSM8974 quad-core processor and additional special hardware including a fisheye motion camera, "RGB-IR" camera for color image and infrared depth detection, and Movidius Vision processing units. A high-performance accelerometer and gyroscope were added after testing several competing models in the MARS lab at the University of Minnesota.

Several hundred Peanut devices were distributed to early-access partners including university researchers in computer vision and robotics, as well as application developers and technology startups. Google stopped supporting the Peanut device in September 2015, as by then the Tango software stack had evolved beyond the versions of Android that run on the device.

The Yellowstone tablet
Google's Project Tango tablet, 2014

"Yellowstone" was a 7-inch tablet with full Tango functionality, released in June 2014, and sold as the Project Tango Tablet Development Kit.[13] It featured a 2.3 GHz quad-core Nvidia Tegra K1 processor, 128GB flash memory, 1920x1200-pixel touchscreen, 4MP color camera, fisheye-lens (motion-tracking) camera, an IR projector with RGB-IR camera for integrated depth sensing, and 4G LTE connectivity.[14][15] As of May 27, 2017, the Tango tablet is considered officially unsupported by Google.[16]

Testing by NASA

In May 2014, two Peanut phones were delivered to the International Space Station to be part of a NASA project to develop autonomous robots that navigate in a variety of environments, including outer space. The soccer-ball-sized, 18-sided polyhedral SPHERES robots were developed at the NASA Ames Research Center, adjacent to the Google campus in Mountain View, California. Andres Martinez, SPHERES manager at NASA, said "We are researching how effective [Tango's] vision-based navigation abilities are for performing localization and navigation of a mobile free flyer on ISS.[17]

Intel RealSense smartphone

Announced at Intel's Developer Forum in August 2015,[18] and offered to public through a Developer Kit since January 2016.[19] It incorporated a RealSense ZR300 camera[20] which had optical features required for Tango, such as the fisheye camera.[21]

Lenovo Phab 2 Pro

Lenovo Phab 2 Pro was the first commercial smartphone with the Tango Technology, the device was announced at the beginning of 2016, launched in August, and available for purchase in the US in November. The Phab 2 Pro had a 6.4 inch screen, a Snapdragon 652 processor, and 64 GB of internal storage, with a rear facing 16 Megapixels camera and 8 MP front camera.

Asus Zenfone AR

Asus Zenfone AR, announced at CES 2017,[22] was the second commercial smartphone with the Tango Technology. It ran Tango AR & Daydream VR on Snapdragon 821, with 6GB or 8GB of RAM and 128 or 256GB of internal memory depending on the configuration.

Collaborators and partners

In creating Project Tango, Google collaborated with developers in nine countries and several organizations including Bosch, Bsquare, CompalComm, ETH Zurich, Flyby Media, George Washington University, MMSolutions, Movidius, University of Minnesota MARS Lab,[23] JPL Computer Vision Group,[24] OLogic, OmniVision, Open Source Robotics Foundation, Paracosm, Sunny Optical Technology, PMD Technologies, Mantis Vision, Prizmiq, Intermodalics and SagivTech.

Partnerships were announced[25][26] with companies that include apelab, Autodesk, Aisle411, Bosch, Defective Studios, Durovis (Dive), Infineon, JPL, Left Field Labs, Legacy Games, Limbic, moBack, NVYVE, OmniVision, Otherworld Interactive, PMD Technologies, Sagivtech, SideKick, Speck Design, Stinkdigital, and Inuitive.

See also

References
  1. Announcement on ATAP Google+ site, 30 January 2015
  2. "Future Phones Will Understand, See the World". 3 June 2015. Retrieved 4 November 2015.
  3. "Slamdance: inside the weird virtual reality of Google's Project Tango". 29 May 2015.
  4. Qualcomm Powers Next Generation Project Tango Development Platform, 2015-05-29
  5. IDF 2015: Intel teams with Google to bring RealSense to Project Tango, 2015-08-18
  6. "Google's Project Tango is shutting down because ARCore is already here". The Verge. Retrieved 2017-12-16.
  7. "10 Bold Google X Projects Aiming for Tech Breakthroughs".
  8. https://developers.google.com/project-tango/ Google developer website.
  9. An augmented reality tool to detect design discrepancies: a comparison test with traditional methods. International Conference on Augmented Reality, Virtual Reality and Computer Graphics. 2019. doi:10.1007/978-3-030-25999-0_9.
  10. http://augmentedworldexpo.com/ Augmented World Expo 2015
  11. AWE 2015, "Mobile 3D Tracking and Perception"
  12. Google says these are the best apps for Project Tango, 2 November 2015
  13. Product announcement on ATAP Google+ page, 5 June 2014, retrieved 4 November 2015
  14. Specs on official site, retrieved 4 November 2015
  15. "Tango Tablet Development Kit User Guide | Tango | Google Developers". Google Developers. Retrieved 2016-09-11.
  16. "The launch of the Lenovo Phab 2 Pro was a major milestone for Tango, marking ..." Retrieved 2017-07-15.
  17. Google's Project Tango headed to International Space Station, 20 March 2014
  18. "Google and Intel bring RealSense to phones with Project Tango dev kit".
  19. "Intel's RealSense phone with Project Tango up for pre-order".
  20. "Intel's RealSense smartphone developer kit now available to pre-order for $399".
  21. Intel Realsense ZR300 Product Datasheet
  22. ASUS announcement at CES 2017 -YouTube
  23. http://mars.cs.umn.edu/ University of Minnesota MARS Lab
  24. NASA.gov JPL Computer Vision Group
  25. AWE 2015, "Mobile 3D Tracking and Perception"
  26. List of partners on official site, retrieved 4 November 2015
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.