Steve Mann (inventor)

Mann with three of his inventions: EyeTap Digital Eye Glass, Smartwatch, and SWIM (Sequential Wave Imprinting Machine) phenomenological augmented reality.

Many of Mann's inventions pertain to the field of computational photography.

• Chirplet transform, 1991: Mann was the first to propose and reduce to practice a signal representation based on a family of chirp signals, each associated with a coefficient, in a generalization of the wavelet transform that is now referred to as the chirplet transform.
• "Digital Eye Glass," "Eye Glass," "Glass Eye," or "Glass", 1978: a device that, when worn, causes the human eye itself to effectively become both an electronic camera and a television display.[20]
• Comparametric equations, 1993: Mann was the first to propose and implement an algorithm to estimate a camera's response function from a plurality of differently exposed images of the same subject matter. He was also the first to propose and implement an algorithm to automatically extend dynamic range in an image by combining multiple differently exposed pictures of the same subject matter.[21][22][23]
• High-dynamic-range imaging (HDR): "The first report of digitally combining multiple pictures of the same scene to improve dynamic range appears to be Mann." (Robertson et al.)[24] Mann's work on wearable computing was motivated by his early computer vision systems that helped people see better (e.g. while welding, or in other high-dynamic range situations, with dynamic range management, overlays, and augmentation as well as diminishment in both the additive and subtractive sense).[25]
• Hydraulophone: Mann invented an experimental musical instrument that uses pressurized hydraulic fluid, such as water, to make sound. The instrument is played by placing the fingers in direct contact with the sound-producing hydraulic fluid, thus giving the musician a high degree of control over the musical expression in the sound.[26]
• Integral kinematics and integral kinesiology: principles of negative derivatives (integrals) of displacement, such as absement (the area under the displacement-time curve), as embodied by hydraulophones (water-based instruments).[26] This work has been built upon by others, and also forms the basis for a new way of understanding electrical engineering.[27] See also Mann's 2014 paper, "Integral Kinematics (Time‐Integrals of Distance, Energy, etc.) and Integral Kinesiology."[28]
• Natural user interface: In the 1980s and '90s, Mann developed a number of user-interface strategies using natural interaction with the real world as an alternative to a command-line interface (CLI) or graphical user interface (GUI). Mann referred to this work as "Natural User Interfaces", "Direct User Interfaces", and "Metaphor-Free Computing"[29]
• Scratch input, an acoustic-based method of Human-Computer Interaction (HCI) that takes advantage of the characteristic sound produced when a finger nail, stick, or other object strikes or is dragged over a surface, such as a table or wall.
• Sensory Singularity, together with Marvin Minsky and Ray Kurzweil, Mann proposed the theory of the "Sensularity" Sensory Singularity and cyborg-logging.
• Surveilluminescent wand: a device for visualizing vision and seeing sight, by way of making visible the sightfield (time-reversed lightfield) of a camera or similar computer vision sensor, using time-exposure with array of surveilluminescent lights to make visible to one camera what another camera can see.[30]
• Telepointer and SixthSense, a wearable computer based on a pendant that contains a webcam and laser-based infinite depth-of-focus projector, and related technologies for gesture-based wearable computing systems.
• Video Orbits,[31] 1993: Mann was the first to produce an algorithm for automatically combining multiple pictures of the same subject matter, using algebraic projective geometry, to "stitch together" images using automatically estimated perspective correction. This is called the "Video Orbits" algorithm.[32][33][34]

Surveilluminescent wand: When moved through space in a long-exposure photograph, it makes the sightfield of a surveillance camera visible.

Mann also works in the fields of computer-mediated reality.[35] He is a strong advocate of privacy rights, for which work he was an award recipient of the Chalmers Foundation in the fine arts. His work also extends to the area of sousveillance (a term he coined for "inverse surveillance"). Mann and one of his PhD students, James Fung, together with some of his other students, have been building a cyborg community around the cyborg-logging concept.[36]

• Mann, together with Professor Ian Kerr at the University of Ottawa, has written extensively on surveillance, sousveillance, and equiveillance. "Sousveillance," a term coined by Mann, along with the concepts that he and Kerr have developed around these ideas, have created a new dialog for cyborg technologies, as well as related personal information gathering technologies like camera phones. He has created the related concept of humanistic intelligence.[37]
• In 2003, Joi Ito credited Mann with having initiated the moblogging movement by creating a system for transmission of realtime pictures, video, and text. In particular, from 1994 to 1996, Mann continuously transmitted his life's experiences, in real time, to his website for others to experience, interact with, and respond to.[38]

His CyborGLOGS ('glogs), such as the spontaneous reporting of news as everyday experience,[39] were an early predecessor of 'blogs and the concept of blogging, and earlier than that, his pre-internet-era live streaming of personal documentary and cyborg communities defined cyborg-logging as a new form of social networking.

Mann is currently collaborating with a number of researchers including Ian Kerr, Canada Research Chair in Ethics, Law & Technology, University of Ottawa, who teaches a course on "Cyborg Law" that uses Mann's book.[40] Mann, together with Kerr and others, are doing an SSHRC-funded project to study the Ethics, Law & Technology of anonymity, authentication, surveillance, and sousveillance, in addition to issues related to cyborg-law. The anonequity project is ongoing, and collaborator Kerr has also researched and lectured widely on implantable technologies.[41]