M-Labs
M-Labs (formerly known as the Milkymist project) is a company which develops, manufactures and sells open hardware devices and software. It is known for the Milkymist system-on-chip (SoC) which is a commercialized system-on-chip with free HDL source code.[1]
M-Labs technologies have been used in different programs. For example, NASA's Communication Navigation and Networking Reconfigurable Testbed (CoNNeCT) experiment which uses the memory controller that was originally developed for the Milkymist One[2][3][4] and published under the terms of the GNU General Public License (GPL).
The project was presented at several open source and hacking conferences, such as the Chaos Communication Congress,[5] FOSDEM,[6] Libre Software Meeting,[7] and Libre Graphics Meeting 2011.[8][9] It was also featured on the Make magazine blog[10] The Milkymist One board was included in their "ultimate open source hardware gift guide 2010".[11]
Milkymist SoC
The Milkymist system-on-chip uses the LatticeMico32 (LM32) core as a general purpose processor. It is a RISC 32-bit big endian CPU with a memory management unit (MMU) developed later by M-Labs contributors. It is supported by the GCC compiler and can run RTEMS and μClinux. There is also an experimental back-end for LLVM targeting this microprocessor.
The LM32 microprocessor is assisted by a texture mapping unit and a programmable floating point VLIW coprocessor, which are used by the Flickernoise video synthesis software. It is also surrounded by various peripheral cores to support every I/O device of the Milkymist One. The system-on-chip interconnect uses three bridged buses and mixes the Wishbone protocol with two custom protocols used for configuration registers and high performance DMA with the SDRAM.
The architecture of the Milkymist system-on-chip is largely documented in the project founder's Master thesis report.[4] Most components of the system-on-chip, except the LatticeMico32 core, were custom developed and placed under the GNU GPL license.
The QEMU emulator can be used to run and debug Milkymist SoC binaries[12] on another computer.
Milkymist One and Flickernoise
Manufacturer | Qi Hardware |
---|---|
Type | Video synthesizer |
Release date | December 27, 2010 (early developer kit), September 28, 2011 (final version) |
Introductory price | 380 EUR (early developer kit), 499 USD (final version) |
Operating system | RTEMS, Linux |
CPU | LatticeMico32 in a Xilinx Spartan-6 FPGA |
Memory | 128 MB DDR SDRAM |
Storage | 32 MB built-in NOR flash, memory card |
Display | SVGA up to 140 MHz pixel clock (1280x1024) |
Input | USB keyboard and mouse |
Camera | External (CVBS digitizer) |
Connectivity | DMX512, MIDI, OpenSoundControl, AC97 audio, Ethernet, RC-5 infrared, USB, GPIO |
Power | 5 W |
Dimensions | 172 × 145 × 45 mm |
Mass | 465 g |
The Milkymist One video synthesizer and reconfigurable computer is the main product released by the project. It was manufactured by Qi Hardware, a start-up founded by former Openmoko employees.[13] It was first sold at the Chaos Communication Congress in 2010,[14] as an "early developer kit" for interested hackers, open source activists, and pioneers who could tolerate the remaining software and FPGA design shortcomings. A more refined version, including case and accessories, was later sold.
The technical specifications of the Milkymist One[15] are as follows:
- Multi-standard video input (PAL/SECAM/NTSC)
- Two DMX512 (RS485) ports
- MIDI IN and MIDI OUT ports
- SVGA output, 24 bpp, up to 140 MHz pixel clock (about 1280×1024)
- AC97 audio
- Xilinx XC6SLX45 Spartan-6 FPGA supporting the open source Milkymist SoC
- 128 MB 32-bit DDR333 SDRAM
- 32 MB parallel flash
- 10/100 Ethernet
- Memory card
- Two USB host connectors
- RC-5 compatible infrared receiver
- RS-232 debug port
The design files of the printed circuit board and the CAD files of the case were released under the Creative Commons Attribution-Share Alike license.
Flickernoise is the video synthesis software that runs on the Milkymist One. It is heavily inspired by MilkDrop and uses a similar, and largely compatible, scripting language to define and program the visual effects. However, while MilkDrop is designed to run automatically in a music player, Flickernoise is focused on the interactivity of the visuals for use in live performances. The software supports the programming of visual effects that transform a live video stream coming from a camera connected to the Milkymist One, as well as input from OpenSoundControl, DMX512, and MIDI controllers.
Flickernoise runs on the RTEMS real-time operating system and uses many POSIX software libraries that were ported to this operating system, such as libpng, libjpeg, jbig2dec, OpenJPEG, FreeType, MuPDF, and liblo for OpenSoundControl support. The streamlined hardware platform and the use of a real-time operating system allow the system to have a lower response time than an equivalent PC-based setup. The user interface is based on a variant of the Genode FX toolkit.[16]
Flickernoise is also free software, released under the terms of the GNU General Public License.
ARTIQ
In May 2014, M-Labs entered a partnership with NIST to develop a next-generation open source control system for quantum information experiments.[17][18] The system, called ARTIQ (Advanced Real-Time Infrastructure for Quantum physics), is a combination of software and gateware that enables synchronized control of many devices with nanosecond-level timing resolution and sub-microsecond latency, while retaining features of high level programming languages.
Some of the ideas and code from Milkymist SoC have been reused in ARTIQ.
In 2016 M-Labs partnered with ARL and ISE to develop ARTIQ Sinara, an open source hardware and software-defined radio platform.[19]
References
- "The Register: Open-source hardware group puts out vid system-on-a-chip". The Register. Retrieved 2013-05-02.
- "JPL acknowledgement letter". Retrieved 2014-02-13.
- "Tech the Future: Open source hardware". Retrieved 2013-05-02.
- Bourdeauducq, Sebastien (June 2010). "A performance-driven SoC architecture for video synthesis". KTH. Retrieved 2011-04-22.
- "26C3 schedule". 9 January 2010. Retrieved 2011-04-22.
- "Milkymist : Pushing further the limits of electronics openness". Archived from the original on 2011-07-12. Retrieved 2011-04-22.
- "Milkymist : a free System-on-Chip for real-time video". Retrieved 2011-04-22.
- "Milkymist One video synthesizer shown at 6th Libre Graphics Meeting in Montreal". Retrieved 2011-05-14.
- "Milkymist One Shown at Libre Graphics Meeting". Archived from the original on 2011-05-19. Retrieved 2011-05-14.
- "Make: Online: Milkymist :: Interactive VJ Station". Retrieved 2011-04-22.
- "Make: Online: The Ultimate Open Source Hardware Gift Guide 2010". Retrieved 2011-04-22.
- "QEMU development mailing list". Retrieved 2011-04-22.
- "OpenMoko Layoffs Lead to New Open Hardware Venture". Retrieved 2011-04-22.
- "First Milkymist One Early Developer Kits are coming!". Retrieved 2011-04-22.
- "M-Labs official website: Milkymist One". Retrieved 2013-05-02.
- "Genode Labs: FPGA Graphics".
- "NIST: Open-Source Software for Quantum Information". NIST. 23 January 2015. Retrieved 2015-01-25.
- "M-Labs website: ARTIQ". Retrieved 2017-02-14.
- "M-Labs mirror: ARTIQ". Retrieved 2017-02-14.