13 Commits

Author SHA1 Message Date
Joey Eamigh
dac00f90db
data: 246 new 2026-04-05 18:44:40 -04:00
Joey Eamigh
2e932bc327
working model!!!!! 2026-04-05 15:37:50 -04:00
Joey Eamigh
42f8849b14
first finetune attempt 2026-04-05 12:16:16 -04:00
Joey Eamigh
7b660fe361
roll back to python 3.13 to fix everything lol 2026-03-30 21:25:46 -04:00
Joey Eamigh
8190950f1a
fix some bugs for tapt 2026-03-30 20:44:10 -04:00
Joey Eamigh
3292980d33
tapt setup 2026-03-30 19:46:20 -04:00
Joey Eamigh
1dce1ccb73
updating narrative at checkpoint resume 2026-03-30 15:20:59 -04:00
Joey Eamigh
669632af7b
tweaking checkpoint saves 2026-03-30 11:41:20 -04:00
Joey Eamigh
fe5155ab6d
pretraining config for run 2026-03-29 23:55:49 -04:00
Joey Eamigh
e5f89ffabb
caching in the pipelines 2026-03-29 21:17:50 -04:00
Joey Eamigh
99cf4a606c
thread tokenization and chunking 2026-03-29 21:03:11 -04:00
Joey Eamigh
9d41dd199f
DAPT and precleaning for DAPT 2026-03-29 20:33:39 -04:00
Joey Eamigh
a9a7d59603
DAPT/TAPT scaffolding 2026-03-29 16:12:19 -04:00