# KeyError: "length" - load\_from\_disk Training Model on AWS SageMaker **URL:** \ **Category:** 🤗Datasets\ **Created:** [December 5, 2022, 12:38am UTC](https://discuss.huggingface.co/t/keyerror-length-load-from-disk-training-model-on-aws-sagemaker/27232 "2022-12-05T00:38:29Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![MrRobotV8](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@MrRobotV8](https://discuss.huggingface.co/u/MrRobotV8)\ **Post date:** [December 5, 2022, 12:38am UTC](https://discuss.huggingface.co/t/keyerror-length-load-from-disk-training-model-on-aws-sagemaker/27232/1 "2022-12-05T00:38:29Z")
Hello everyone! I was following the workshop by @philschmid - [MLOps - E2E](https://github.com/philschmid/huggingface-sagemaker-workshop-series/tree/main/workshop_3_mlops) Why is not working anymore? `AlgorithmError: ExecuteUserScriptError: Command "/opt/conda/bin/python3.8 train.py --epochs 3 --eval_batch_size 64 --fp16 True --learning_rate 3e-05 --model_id distilbert-base-uncased --train_batch_size 32" Traceback (most recent call last): File "train.py", line 46, in train_dataset = load_from_disk(args.training_dir) File "/opt/conda/lib/python3.8/site-packages/datasets/load.py", line 1165, in load_from_disk return Dataset.load_from_disk(dataset_path, fs, keep_in_memory=keep_in_memory) File "/opt/conda/lib/python3.8/site-packages/datasets/arrow_dataset.py", line 744, in load_from_disk dataset_info = DatasetInfo.from_dict(json.load(dataset_info_file)) File "/opt/conda/lib/python3.8/site-packages/datasets/info.py", line 267, in from_dict return cls(**{k: v for k, v in dataset_info_dict.items() if k in field_names}) File "", line 20, in __init__ File "/opt/conda/lib/python3.8/site-packages/datasets/info.py", line 143, in __post_init__ self.features = Features.fr` ---
**Author:** ![MrRobotV8](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@MrRobotV8](https://discuss.huggingface.co/u/MrRobotV8)\ **Post date:** [December 5, 2022, 1:02am UTC](https://discuss.huggingface.co/t/keyerror-length-load-from-disk-training-model-on-aws-sagemaker/27232/2 "2022-12-05T01:02:47Z")
Even changing DataSet and updating transformer version to 4.17.0 and pytorch to 1.10.2: AlgorithmError: ExecuteUserScriptError: ExitCode 1 ErrorMessage “KeyError: ‘length’” Command “/opt/conda/bin/python3.8 train.py --epochs 3 --eval\_batch\_size 64 --fp16 True --learning\_rate 3e-05 --model\_id distilbert-base-uncased --train\_batch\_size 32”, exit code: 1 ---
**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](https://discuss.huggingface.co/u/philschmid)\ **Post date:** [December 5, 2022, 9:00am UTC](https://discuss.huggingface.co/t/keyerror-length-load-from-disk-training-model-on-aws-sagemaker/27232/3 "2022-12-05T09:00:01Z")
@MrRobotV8 i think we can keep to conversation at the github issue level: [KeyError Length during training following workshop MLOps · Issue #12 · philschmid/huggingface-sagemaker-workshop-series · GitHub](https://github.com/philschmid/huggingface-sagemaker-workshop-series/issues/12) ---
**Author:** ![MrRobotV8](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@MrRobotV8](https://discuss.huggingface.co/u/MrRobotV8)\ **Post date:** [December 5, 2022, 9:22am UTC](https://discuss.huggingface.co/t/keyerror-length-load-from-disk-training-model-on-aws-sagemaker/27232/4 "2022-12-05T09:22:19Z")
Perfect! Thank you 🙂 ---
**Author:** ![dodonoghue94](https://avatars.discourse-cdn.com/v4/letter/d/8c91f0/32.png) [@dodonoghue94](https://discuss.huggingface.co/u/dodonoghue94)\ **Post date:** [May 5, 2023, 12:39pm UTC](https://discuss.huggingface.co/t/keyerror-length-load-from-disk-training-model-on-aws-sagemaker/27232/5 "2023-05-05T12:39:36Z")
I have the same error and I think it is to do with my estimator struggling to locate my “train.py” file. Does anyone else find this a bit hit and miss? I’ve had it run successfully before and have no idea what to do.