Serving TensorFlow Models with a Custom Environment

Build a custom serving environment to run TensorFlow models with extra dependencies.

August 13, 2023 · 4 min · 688 words · hoangph3

TensorFlow Serving: Handling Content Types

Explore how TensorFlow Serving handles different request content types for inference.

July 29, 2023 · 8 min · 1565 words · hoangph3

Serving TensorFlow Models with JSON Requests

Send and parse JSON prediction requests against a TensorFlow Serving model.

July 27, 2023 · 4 min · 742 words · hoangph3

Serving Custom TensorFlow Models

Package and serve a custom TensorFlow model signature with TensorFlow Serving.

July 26, 2023 · 2 min · 421 words · hoangph3

Serving Multiple TensorFlow Models with Monitoring

Serve multiple TensorFlow models simultaneously and monitor them with Prometheus and Swagger.

July 26, 2023 · 5 min · 953 words · hoangph3

Prepare and Deploy a TensorFlow Model to Tensorflow Serving

Serve tensorflow model efficiently with customized model signatures

December 6, 2022 · 9 min · 1871 words · hoangph3

Distributed Training with TensorFlow

Train TensorFlow models across multiple workers using distributed training strategies.

November 1, 2022 · 4 min · 656 words · hoangph3

Autoscaling TensorFlow Serving on Kubernetes

Set up horizontal pod autoscaling for a TensorFlow Serving deployment on Kubernetes.

September 30, 2022 · 5 min · 1011 words · hoangph3