Alex Jones 7b9cc973ae ci: validate community benchmark submissions on PR ... Adds the Community Benchmarks workflow: any PR touching llmfit-core/data/community/ runs scripts/validate_community_benchmarks.py, which checks JSON schema conformance (schema.json, draft-07), path/naming conventions (community/<slug>/<timestamp>-<hash>.json), file size caps, and cross-field sanity the schema can't express (tps ordering, plausible hardware bounds, submission timestamps within the feature's lifetime). Whole-directory validation, so repo integrity is re-checked on every touch; also runs on push to main. Seeds the directory with the first genuine submission (Intel Arc 140V / Core Ultra 7 258V, gemma-3 Q8 via llama-server, 3.8 tok/s) — previously attempted in #713/#716 — which also exercises the workflow on this PR. Closes the CI-validation follow-up named in #712. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>		2026-07-10 11:33:44 +01:00
..
install-openclaw-skill.sh	docs: brew official formula	2026-03-02 11:58:15 +07:00
scrape_benchmarks.py	chore: remove duplicated root data/ copies of catalog and benchmark cache	2026-07-02 21:49:07 +01:00
scrape_docker_models.py	feat: add Docker Model Runner as a runtime provider	2026-03-14 17:42:58 +00:00
scrape_hf_models.py	feat(fit): purge test-stub catalog entries; calibrate estimates from local benchmarks	2026-07-10 11:07:42 +01:00
test_api.py	feat: adding serve capabilities	2026-03-03 14:16:31 +00:00
update_models.sh	chore: remove duplicated root data/ copies of catalog and benchmark cache	2026-07-02 21:49:07 +01:00
validate_community_benchmarks.py	ci: validate community benchmark submissions on PR	2026-07-10 11:33:44 +01:00
validate_generation_scoring.py	chore: remove duplicated root data/ copies of catalog and benchmark cache	2026-07-02 21:49:07 +01:00
verify_models.py	feat: caught some unavailable models on ollama	2026-02-19 10:40:18 +00:00