Reference
- 训练好的深度学习模型是怎么部署的？
- PyTorch模型的加速及部署
- ahkarami/Deep-Learning-in-Production
- Accelerating Inference In TF-TRT User Guide
- tensorflow/tensorrt
- Tensorrt API Reference
- Containers: nvidia:tensorflow
- Model inference using TensorFlow and TensorRT
- Speed up TensorFlow Inference on GPUs with TensorRT
- TF20-TF-TRT-inference-from-Keras-saved-model.ipynb