NVIDIA Holoscan is the AI sensor processing platform that combines hardware systems for low-latency sensor and network connectivity, optimized libraries for data processing and AI, and core microservices to run streaming, imaging, and other applications, from embedded to edge to cloud. It can be used to build streaming AI pipelines for a variety of domains, including Medical Devices, High Performance Computing at the Edge, Industrial Inspection, Robotics, and more.
The Holoscan platform consists of:
- Holoscan Reference Applications: community-driven collection of Holoscan reference applications, operators, benchmarks and tutorials
- Holoscan SDK: the Software Development Kit
- User guide (PDF)
- Development container
- Debian package (already configured on Jetson and IGX)
- Python wheel
- Conda package
- Source code
- Holoscan Deployment Stack: OpenEmbedded/Yocto layer for optimized deployment of applications developed using the Holoscan SDK
- Holoscan Sensor Bridge Software: integrate the Holoscan Sensor Bridge Device in a Holoscan Application
- Holoscan Networking: High performance networking with NVIDIA SmartNICs and NVIDIA Holoscan
- Holoscan Federated Analytics: capture and analyze metrics from Holoscan applications on a fleet of edge devices to a central cloud location
- Long Term Support: critical bug fixes and patches for high/critical software vulnerabilities, with guaranteed API stability
- NVIDIA Jetson Orin Nano (Super) Developer Kits (User Guide)
- NVIDIA Jetson AGX Orin Developer Kits (User Guide)
- NVIDIA IGX Orin Developer Kit (User guide)
- NVIDIA Clara AGX Developer Kit (User guide)
- x86 PC or Laptop with supported Nvidia GPUs (Ampere and above)
- Holoscan Sensor Bridge Reference Design and DevKits: bring your own sensor, and leverage this FPGA design to send packets over Ethernet (including RDMA support if connected to the ConnectX NIC).
- PCIe Sensor I/O Cards: transfer data in an out of Nvidia GPUs using supported PCIe cards from partners (using GPUDirect RDMA if installed on NVIDIA IGX).
- AJA Capture Cards: achieve GPUDirect RDMA through these PCIe capture cards using the AJA drivers and Holoscan operator (Documentation/Operator).
- Deltacast Capture Cards: achieve GPUDirect RDMA through these PCIe capture cards (Reference application)
- Holoscan Test Suite: support Verification and Validation testing on Holoscan Developer Kits
In previous releases, the prefix Clara was used to define Holoscan as a platform designed initially for medical devices. As Holoscan has grown, its potential to serve other areas has become apparent. Starting with version 0.4.0 of the Holoscan SDK, Holoscan is now officially built to be domain-agnostic and can be used to build sensor AI applications in multiple domains. Going forward, domain specific content will be hosted on the HoloHub repository.
