# Duplicated cache- arrow files when uploading large folder?

**URL:** <https://discuss.huggingface.co/t/duplicated-cache-arrow-files-when-uploading-large-folder/147817>\
**Category:** 🤗Datasets\
**Created:** [March 28, 2025, 11:37am UTC](https://discuss.huggingface.co/t/duplicated-cache-arrow-files-when-uploading-large-folder/147817 "2025-03-28T11:37:33Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 28, 2025, 12:25pm UTC](https://discuss.huggingface.co/t/duplicated-cache-arrow-files-when-uploading-large-folder/147817/2 "2025-03-28T12:25:08Z")

</div>

It seems like it’s okay to delete it, but if you’re worried, call lhonestq.

> [@How can I clean the dataset cache?](https://discuss.huggingface.co/t/how-can-i-clean-the-dataset-cache/73033/2):
>
> Feel free to delete the download directory. Then all the other directories are named after the datasets, and contain the cache files when you do load\_dataset() and to reload cached map() results

> **[Cache management · Hugging Face](https://huggingface.co/docs/datasets/v3.5.0/cache)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

_[View the full topic](https://discuss.huggingface.co/t/duplicated-cache-arrow-files-when-uploading-large-folder/147817)._