You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thank you for your excellent work on the tensorrtllm_backend development! The project has been incredibly valuable.
I've noticed that the new version's Docker image size has increased significantly from approximately 12GB in the older version to 17GB in the current release. I'm curious about what factors contributed to this ~5GB increase in image size.
Questions:
What are the main components or dependencies that led to this size increase?
Are there any optimization strategies or configuration options available to reduce the image size for production deployments?
Any insights or recommendations would be greatly appreciated.
Best regards,
Alan
The text was updated successfully, but these errors were encountered:
Hi team,
Thank you for your excellent work on the tensorrtllm_backend development! The project has been incredibly valuable.
I've noticed that the new version's Docker image size has increased significantly from approximately 12GB in the older version to 17GB in the current release. I'm curious about what factors contributed to this ~5GB increase in image size.
Questions:
What are the main components or dependencies that led to this size increase?
Are there any optimization strategies or configuration options available to reduce the image size for production deployments?
Any insights or recommendations would be greatly appreciated.
Best regards,
Alan
The text was updated successfully, but these errors were encountered: