unsloth/scripts
Daniel Han 6f8df52cbc
Acknowledge the Colab oracle drift, and stop the diff hiding entries (#11324)
* Acknowledge the Colab oracle drift, and stop the diff hiding entries

Notebooks CI has been red since at least 2026-09-16 on

    A rule-bearing Colab oracle drifted from its committed snapshot; run
    `notebook_validator.py refresh-colab --all --snapshot-dir scripts/data`
    to acknowledge.

That is the tripwire working: any drift in pip-freeze.gpu.txt is strict by
construction, because the rules resolve a notebook's installs against it. What
it wants is an acknowledged refresh, so this is one, with the diff read rather
than waved through.

What moved: 91 pip entries (3 new, 1 removed, 87 changed), notably
transformers 5.15.0 -> 5.16.1 and datasets 4.0.0 -> 4.8.5; the base image from
Ubuntu 22.04.5 to 24.04.1; 1261 apt entries. torch did not move, and neither
did the Python line, which is why only the pip oracle tripped --strict.

The evidence that acknowledging is safe: linting all 445 notebooks in
unslothai/notebooks against the old and the new oracle gives the same 82
findings, 0 new and 0 resolved. This is upstream churn no rule resolves
differently, not a compatibility change being papered over.

Robustification, from a defect this drift exposed. colab-diff caps its lists at
50/50/80 and elides the rest with a bare count, and transformers 5.15.0 ->
5.16.1 sat past the CHANGED cap -- reading the output, that package looked
untouched. Every entry in the pip oracle is rule-bearing, so an elided one is
exactly what a reviewer may be deciding on. Added --full, and the elision now
names it instead of leaving it to be guessed at. Two tests cover both halves;
removing the flag's effect fails both. tests/notebooks: 314 passed, 2 skipped.

Not addressed here: the nine "smoke install (Colab-shaped venv, opt-in)" jobs
in the same workflow also failed. Their logs have expired, so I have not
diagnosed them and this change does not claim to fix them.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2026-09-19 00:04:01 -07:00
..
data Acknowledge the Colab oracle drift, and stop the diff hiding entries (#11324) 2026-09-19 00:04:01 -07:00
build_prequant_checkpoint.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
build_te_prequant_checkpoint.py Use Unsloth for bare Studio product references (#9732) 2026-08-26 01:55:49 -07:00
build_whisper_cpp.sh Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
check_frontend_dep_removal.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
check_new_install_scripts.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
compare_engines.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
compile_probe.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
diffusion_bench.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
diffusion_quality.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
enforce_kwargs_spacing.py Let the formatter fixed-point guard start on Windows (#11145) 2026-09-16 20:02:06 -07:00
exec_literals_baseline.json Fail CI on a new exec/eval/compile of a value that is not written out (#9999) 2026-08-30 01:00:52 -07:00
fbcache_flux_probe.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
fp8_overflow_check.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
image_speedmem_bench.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
install_gemma4_mlx.sh Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
install_qwen3_6_mlx.sh Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
install_rocm_wsl_strixhalo.sh fix(amd): turn on PyTorch's fast ROCm attention kernels on import unsloth, and drop the installers' host-wide export (#8821) 2026-09-15 06:53:48 -07:00
int8_linear_probe.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
leverage_probe.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
lint_backend_python_floor.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
lint_duplicate_definitions.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
lint_exec_literals.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
lint_no_parallel_clamp.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
lint_workflow_triggers.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
lockfile_supply_chain_audit.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
make_dmg_background.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
notebook_to_python.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
notebook_validator.py Acknowledge the Colab oracle drift, and stop the diff hiding entries (#11324) 2026-09-19 00:04:01 -07:00
nvfp4_probe.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
nvfp4_t211_probe.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
online_tokenization_ab.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
p2p_integrity_probe.py Use Unsloth branding in remaining user-facing text (#11254) 2026-09-18 01:58:29 -07:00
perf_levers_probe.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
perf_verify.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
prequant_probe.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
profile_startup.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
quant_probe.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
run_ruff_format.py Refuse to format when ruff cannot run, and stop the fixed-point guard skipping itself away in CI (#10726) 2026-09-10 06:07:15 -07:00
scan_npm_packages.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
scan_npm_packages_baseline.json scan_packages: key baseline on matched-code hash so payloads in baselined files are not auto-suppressed (#6552) 2026-07-01 04:03:59 -07:00
scan_packages.py Re-approve three unsloth-zoo exec sites, pinned, and say which reviews are which (#11318) 2026-09-18 21:08:56 -07:00
scan_packages_baseline.json Re-approve three unsloth-zoo exec sites, pinned, and say which reviews are which (#11318) 2026-09-18 21:08:56 -07:00
sd_cpp_smoke.py Studio: add image generation, editing workflows and LoRA training with Unsloth GGUFs (#6763) 2026-08-04 08:11:01 -07:00
sdpa_mask_backend_probe.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
sparse_accum_probe.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
stamp_studio_release.py Let the formatter fixed-point guard start on Windows (#11145) 2026-09-16 20:02:06 -07:00
sync_allow_scripts_pins.py Let the formatter fixed-point guard start on Windows (#11145) 2026-09-16 20:02:06 -07:00
sync_shared_ps1_helpers.py Installer: recover from and explain an unreadable llama.cpp cache on Windows (#10533) 2026-09-17 06:27:55 -07:00
uninstall.ps1 WSL installer: stop running the C# compiler on the user's Windows machine (#10978) 2026-09-15 13:28:16 -07:00
uninstall.sh Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
verify_comment_only_diff.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
verify_import_hoist.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
verify_prequant_backend.py Trim comments in tests, scripts, CI helpers and unsloth_cli (#10113) 2026-09-04 15:31:50 -07:00
video_quality.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00
virustotal_delta.py Give this work a before-and-after number, and find out the hardening already worked (#10996) 2026-09-15 11:40:42 -07:00
virustotal_scan.py Reduce comment volume across the installers, CLI, unsloth package and backend utilities (#10504) 2026-09-10 05:57:33 -07:00