Open
Description
Nowadays we have so many LLM related service developed all use SSE to return Completion response in streaming fashion. It would be nice to have Hey to benchmark those services.
Metadata
Assignees
Labels
No labels
{{ message }}
No one assigned
No labels
No projects
No milestone
None yet
No branches or pull requests
Activity