Skip to content

Server-Sent Events in Slingshot

It has now become possible to test and debug requests that return Server-Sent Events, something that has become ever more important with common APIs such as those from e.g. OpenAI that support streaming of LLM responses.

Please see the following animation for a visual summary of updates:

Notable functionality

  • Visual streaming of responses in UI
  • By default automatic scrolling so it's possible to follow output
  • Can be cancelled by clicking "Stop Scroll" during streaming
  • Possibility to copy individual chunks to clipboard
  • If chunk is JSON, ability to pretty-print in UI
  • Streaming data is persisted just like buffered data