Discussions

• 1 You must be logged in to vote

  💬

  LLMIsvc labels and annotation

  ghkdwlgns612 started Jan 27, 2026 in General

  

  

  0
• 4 You must be logged in to vote

  💬

  Is there a way to restart a deployment controlled by inference service in non disruptive manner?

  endiczek started Dec 6, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Autoscaling sklearn-v2-iris on KServe 0.16 + RawDeployment + KEDA + OpenTelemetry

  gerritvd asked Dec 23, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  KServe failing with "too many open files" error during high-traffic inference

  aayostem started Nov 14, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  A way to download models to PVC using Storage Containers.

  ernestre asked Aug 25, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Can we load a model from gcs bucket when defining a custom-predictor?

  InderjeetVishnoi started Jul 17, 2025 in General

  

  

  

  

  7
• 2 You must be logged in to vote

  🙏

  What GPUs does KServe support? Is there any restrictions

  ToviHe asked Jul 7, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Has anyone actually used ray intergration with kserve? I am facing errors using RayModel class of kserve.

  InderjeetVishnoi started Jun 23, 2025 in General

  

  

  0
• 2 You must be logged in to vote

  🙏

  Kserve InferenceService Autoscaling (KEDA) (LLMs)

  omij18 asked May 14, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Deploying DeepSeek-R1 on AWS Inferentia (Inf1/Inf2) with vLLM

  fabidick22 asked Feb 21, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  How to add environment variables to storage-initializer sidecar in InferenceService?

  kimminw00 asked Mar 22, 2025 in Q&A · Unanswered

  

  

  1
• 6 You must be logged in to vote

  🙏

  How to Include the Model in the KServe Explainer Pod for ART Metrics like 'Loss Sensitivity'?

  mglahera asked Dec 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  KServe with torchrun

  ozziemoreno asked Dec 17, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Facing issues in deploying mlflow models with Kserve

  VidhyaPandi asked Dec 5, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  why tps is low when CONCURRENCY is 10 , but server cpu and gpu water level is low

  dustin-srp started Dec 6, 2024 in General

  

  

  1
• 2 You must be logged in to vote

  💬

  Custom predictor - custom model metadata viewable from /v1/models/{model} endpoint?

  AdamFenton started Nov 22, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  How can I cite the repo?

  jaime-cespedes-sisniega asked Jul 4, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Please advise on how to customize 'kind: ClusterServingRuntime' images

  min731 asked Nov 16, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Path Based Routing

  vinayK34 asked Jul 16, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Problem with kind and CertManager: Internal error occurred: failed calling webhook "clusterservingruntime.kserve-webhook-server.validator"

  aberges-grd asked Oct 28, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  about inferencegraph ensemble vote

  asd981256 asked Sep 23, 2024 in Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  🙏

  where is the dockerfile for https://hub.docker.com/r/kserve/vllmserver image?

  uthark asked Aug 22, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Controlling Serverless InferenceService to Save Resources

  fyuan1316 asked Aug 1, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Securing inferenceservices endpoints

  AidenGoodall asked Aug 1, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Propagate headers to all steps in inference graphs

  rachitchauhan43 started Jul 5, 2022 in Ideas

  

  

  1