function take, K extends keyof T(
After 20 minutes it loads, but it seems strange to take this long. I put some prints in to narrow down what’s taking the time. It’s getting stuck in accelerate’s dispatch_model function, which is supposed to distribute the loaded model across GPUs. Once the memory is already on the GPU’s, it still takes forever though. Nothing in the code looks suspicious. It doesn't seem like anything intensive happens after ‘Loading checkpoint shards’ completes.
。吃瓜网对此有专业解读
To minimise this, my editor has a double-buffered internal copy of the terminal screen. When a redraw occurs it compares the new
科学决策，要坚持顶层设计和基层探索相统一。