DATA VERSION CONTROL

Installation

Download package and install vscode extension from https://dvc.org/

Then install Google Drive or S3 (Rustfs..) supported dvc version for Python:

uv pip install dvc[gdrive]
uv pip install dvc[s3]

Usage

Example Folder Structure:

root/
├── data/inputs
│   ├── BOM.xlsx
│   ├── clientes.xlsx
│   ├── EDIs.xlsx
│   ├── originals
│   │   ├── BOM_original.xlsx
│   │   ├── coproduccion.json
│   │   ├── HdCMang.xlsx

Initialize DVC

dvc init

Track files and create .dvc file for each tracked file

dvc add data/inputs/
# Note: if the files are already tracked, remove from git using:
# git rm -r --cached data/inputs/

Track the changes with git

git add data/inputs.dvc data/.gitignore
# or add '/data/inputs/ to main .gitignore instead of the new file. 
# commit to git
git commit -am "Change on checksums / .dvc" 

Setup Remote

Then run dvc push to push or dvc pull to pull.

COMMIT THE UPDATED FILES