ISsues in creating an open multi vendor drone swarm training and testing

1. Yossi Cohen
DSP-IP
Open Platform
for
Drone swarm
Design & training

2. Agenda
• The need for drone swarm
• Drone swarm design requirements
• The need for open platform
• Open platform requirements

4. Drone Swarm - the need
• Price / Quantity !
• Area coverage
• Multi-location sensors
• Coordinated attacks
• Autonomous / Single operator to many drones

5. Drone Swarm – my wish list
• Cost Cost Cost !!!
• Upgrade existing drones to swarm??
• Use existing platforms
• (DVRs/ control rooms / communication)
• Best platform
• Integrate:
• multiple drone types
• components from different vendors
into a single swarm

6. Multi-vendors platform
• Company 1 – low cost <10K attack drones
• Company 2 – smarter drone for communication/control
• Company 3 –control cart / system
• Company 4 – distributed video analytics platform
• Could it all work together “Mix & Match” for the best
integrated platform?
• Create an open platform / standards for swarm integration

7. Swarm coordination simulation &
training
• Swarm training:
• Reinforced learning methods
• Hardware requirements
• Jetson nano / Jetson NX run RL models (cost of 100-400$)!!
• Low cost SoC with NPU/TPU / GPU FPGAs

8. Swarm simulation & training - NVIDIA
• Low-cost Reinforced learning platforms for drones / UAV
• NVIDIA ISAAC SIM

9. Swarm simulation & training -
Matlab
• Matlab Reinforced and UAV Toolboxes

10. Swarm training – testing &
validation
• Open interoperability tests
• Swarm coordination
• Swarm response to event

11. Video Analytics - Detection
• Pain
• Drone manufacturer doesn’t have all the tools / knowledge for
Video Analytics
• Target definition changes (new missile truck / target person)
• Solution
• Pluggable ATR server
• Server accept 3rd party analytics models with predefined API
• Accept updates (face / new missile track)

12. Video Analytics - Metadata
• How to send metadata drone-drone & Drone-controller
• Solutions
• Existing UAV video analytics protocols (STANAG /VMTI)
• NVIDIA Metadata format

13. Video Analytics - simulation
• Simulate Autonomous system environment
• Underwater
• Ships
• Missiles
• Drones/UAV
• Full Digital twin
• Behavior of enemy autonomous systems & Swarms
• Systems that accepts a 3D model of object simulate it in combat
environment and automatically creates a detector

14. Control
• Communication
• same protocols
• Same commands
• Meshed communication and relay (optional)

15. Naïve Suggestion
• Create a multi-vendor definition and interop platform
• Communication
• Control
• Video Analytics
• Training
• Make this vision happen

16. Yossi Cohen +972-54-5313092
info@dsp-ip.com
Thank you