Ask HN: What is your LLM monitoring stack?

5 pointsaiunboxed2y ago1 comments

What do you use for tracing llm calls etc ?

1 comments

Consider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.

j / k navigate · click thread line to collapse

Ask HN: What is your LLM monitoring stack?

5 pointsaiunboxed2y ago1 comments

What do you use for tracing llm calls etc ?

1 comments

chitraa2y ago

Consider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.

j / k navigate · click thread line to collapse