The Vision FPGA SoM is an iCE40 5K FPGA based System on Module that integrates a low power qVGA vision sensor, 3 axis accelerometer/Gyroscope and an I2S MEMS microphone in a small form factor (3 cm x 2 cm).

Low Power Image Sensor + FPGA: Overall power consumption will be minimized and in the 10-20mW range to enable battery powered applications.

Well-designed Host Interface: Easy to integrate into a larger system using an interrupt driven SPI host interface, programmable IO voltages to support a glueless HW interface.

Modular Design: Complexity will be localized to the SoM so that the developer can quickly integrate this device into their system using a breadboard as well as a simple API. All required components for vision/audio/motion (eg. image sensor and illumination) will be integrated so the developer doesn't have to cobble together parts. The solution will translate into a final product with minimal changes.

Flexible and Easy to Use: The Vision FPGA SoM is made to be easy to integrate mechanically and electrically. The SoM will appear like an SPI device with a SW library to support it. You will have the ability to configure the FPGA CRAM instead of having to program the Flash followed by a reset to configure the FPGA. Provide flexibility to the developer in choosing an image sensor while providing a reasonable low-cost default option.

Strong set of features: Will not be just another FPGA board clone. Require a reasonably sized SRAM to allow for temporary data storage at low power (not DRAM!) which is especially important for vision applications where multiple image frames may need to be captured/processed. Audio and IMU are commonly used together with vision and will make sense to integrate on this platform.

Image/Sound/Motion capture

Trigger on scene change/sound/motion to capture video/audio

Capture IMU readings with images for VR/AR applications

Beamform audio with vision input to pay attention to areas with motion

Low Power Edge Processing. Preserve privacy by processing data on the SoM

8 MAC units

1 Mb RAM

On-board low power qVGA monochrome global shutter imager (Pixart PAJ6100U6)

Connector for color/monochrome rolling shutter imager (Himax HMB010) Image sensor not included!

One Knowles MEMS I2S microphone, expandable to a stereo configuration.

Invensense IMU 60289 6-axis Gyro/accelerometer

4 Mb qSPI Flash for bitstream/code storage

Tri-colour LED for a user interface driven by the FPGA

Four GPIO, programmable IO voltage

4 wire SPI host interface with programmable IO voltage

Single 3.3 V operation, can supply 1.8 V and 1.2 V @100mA (max) to external devices using onboard LDO's

Vision based People detection