For the eyes of the system we have chosen the CMOSIS CMV12000 CMOS sensor. The CMV12000 is a high sensitivity pipelined global shutter CMOS image sensor with a resolution of 4096 x 3072 pixels. Pipelining means that exposure during read out is possible. The state-of-the-art pixel design makes true correlated double sampling (CDS) possible which reduces the fixed pattern noise and dark noise significantly. The imager integrates 64 LVDS channels each running at maximum 600 Mbps resulting in a 300 fps rate at full resolution (10 bits per pixel). This combination of high speed, high resolution makes it suitable for a large number of applications in fields as broadcast, industrial, robotics, microscopy, security, etc. The flexible architecture of the Incatec Camera Platform enables diverse resolution/speed combinations, such as 4k@400fps or even FullHD at 850 fps.
At the heart of the system we use the Xilinx Kintex K160T FPGA. This high performance FPGA has sufficient performance for real-time high speed image processing, with modest power consumption. Its high speed serial connections allow the use of several independent 3G SDI connections and a fast PCIe bus simultaneously.
Instead of using an integrated solution such as the Xilinx Zynq, we chose for a Xilinx Kintex combined with a Raspberry Pi, which provides much flexibility and ease of use. The Raspberry Pi is well known, is easy to program and many program examples exist. One can build a custom user interface without having to worry about the FPGA firmware. Communication with the camera works via a standard SPI interface (reading and writing registers) which is easy to control on the Raspberry Pi.
For video input and output the SDI standard is chosen since it is well established and widely used. Standard 3G-SDI is used, but future upgrade to 6G-SDI is possible by exchanging the cable drivers and receivers. By using 4 independent inputs and 4 independent outputs a total of 12 Gigabit per second both in and out simultaneously can be achieved (24Gbit/s with 6G upgrade). This opens a wide variety of IO possibilities.
For additional IO a PCIe gen2 x4 port is added to the board. This gives an additional 20 Gigabit/s connection for future expansion in the camera; for example, to connect SSDs for recording puposes.