Previously, users only saw tok/s metrics after a message completed. Now the TUI displays live streaming speed that updates throughout the response, giving immediate feedback on model performance.
Previously, users only saw tok/s metrics after a message completed. Now the TUI displays live streaming speed that updates throughout the response, giving immediate feedback on model performance.