请问HN：AWS Bedrock上的OpenAI推理速度慢
最近几天，使用AWS Bedrock进行OpenAI模型的推理速度非常慢且时常出现故障，今天的情况最为严重。首次生成的token延迟超过5分钟。这是怎么回事？
查看原文
Inference on AWS Bedrock for OpenAI models has been very slow and glitchy the last few days with today being the worst. Very long latency of over 5 minutes to first token. What's going on?