The following are the minimum requirements to run Pickle Piper:
- Docker running on a host machine with an NVIDIA GPU
- Kafka Broker for Source and Destination Topics
- Docker Container Specifications:
- 1024MB Memory
- 2v CPU
- Standard Docker Image uses NVIDIA Container runtime that interfaces with underlying GPU on host.
Pickle Piper uses CUDA libraries that interface directly with NVIDIA GPU’s to preform inferencing, hence a NVIDIA GPU is a hard requirement for running Pickle Piper.
Supported NVIDIA GPU’s;
- Volta: Tesla V100, Tesla T4, and Titan V feature Volta architecture.
- Turing: GeForce RTX 20 series (RTX 2080 Ti, RTX 2080, RTX 2070), Quadro RTX series, and Tesla T4
- Ampere: GeForce RTX 30 series (RTX 3090, RTX 3080, RTX 3070), Quadro RTX series, and A100 GPUs.
Cloud Service Providers NVIDIA GPU Enabled Instances
Google Cloud Platform
a2-highgpu-1g or above (A100 GPU) n1-highmem-2 or above (P100, K80, T4)
AWS
p4d.3xlarge or above (EC2 P4 Instance Types) p3.2xlarge or above (EC2 P3 Instance Types) g4dn.xlarge or above (EC2 G4 Instance Types)
Azure
Standard_NV24 or above (A100 Tensor Core) Standard_NC12s_v3 or above (V100 Tensor Core) Standard_NV6 or above (T4 or K80 Tensor Core)* *AMD Radeon Instinct MI25 instances are not supported