Upload Dockerfile

Delete Dockerfile

Rename Dockerfile-cloud to Dockerfile

Upload Dockerfile-cloud

Update README.md

Update README.md

drop length column for issues with eval without packing (#1711)

download model weights on preprocess step (#1693)

verbose failure message (#1694)

bump deepspeed for fix for grad norm compute putting tensors on different devices (#1699)

fix for when sample_packing and eval_sample_packing are different (#1695)

add back packing efficiency estimate so epochs and multi-gpu works properly (#1697)

add qwen2-72b fsdp example (#1696)

ensure explicit eval_sample_packing to avoid mismatch issues (#1692)

Create phi3-ft-fsdp.yml (#1580)

Phi-3 conversation format, example training script and perplexity metric (#1582)

add support for rpo_alpha (#1681)

re-enable DPO for tests in modal ci (#1374)

Fix the broken link in README (#1678) [skip ci]

need to add back drop_last for sampler (#1676)

cleanup the deepspeed proxy model at the end of training (#1675)

load explicit splits on datasets (#1652)

set chat_template in datasets config automatically (#1664)

use mixins for orpo and kto configs so they work with axolotl customizations (#1674)

re-enable phi for tests in modal ci (#1373)

revert multipack batch sampler changes (#1672)

handle the system role too for chat templates (#1671)

make sure the CI fails when pytest script fails (#1669)

Fix README quick start example usage model dirs (#1668)

Correct name of MixtralBlockSparseTop2MLP (L -> l) (#1667)

Fix: ensure correct handling of `val_set_size` as `float` or `int` (#1655)

fix lint issue that snuck through (#1665)

Fix Lora config error for Llama3 (#1659)

Generalizing the chat_template prompt strategy (#1660) [skip ci]

Fix Google Colab notebook 2024-05 (#1662) [skip ci]

update deps (#1663) [skip ci]

document how to use `share_strategy="no"` (#1653) [skip ci]

Switch to parallel FFD bin packing algorithm. (#1619)

support for custom messages field in sharegpt (#1651)

Update tiny-llama qlora.yml addressing eval packing error (#1638)

enable loraplus setting for dpo trainer (#1646)

allow report_to for multiple providers (#1647)

Fix llama3 chat_template (extra <|eot_id|> on last turn) (#1635)

Add KTO support (#1640)

fixes to save on fractional save_steps (#1643)

Unsloth optims for Llama (#1609)

add save_only_model option (#1634)

fix ray install (#1630)

more fixes to work with runpod + skypilot (#1629)

cloud image w/o tmux (#1628)