| NUM_GPUS=1 |
| MASTER_ADDR=ip-10-0-133-32 |
| MASTER_PORT=16266 |
| WORLD_SIZE=1 |
| ------ ARGS ------- |
| Namespace(found_model_name='HCPflat_large_gsrFalse_', epoch_checkpoint='epoch99.pth', model_suffix='beta', hcp_flat_path='/weka/proj-medarc/shared/HCP-Flat', batch_size=16, wandb_log=True, num_epochs=20, lr_scheduler_type='cycle', save_ckpt=False, seed=42, max_lr=0.0003, target='sex', num_workers=15, weight_decay=0.001, global_pool=True) |
| outdir /weka/proj-fmri/ckadirt/fMRI-foundation-model/src/checkpoints/HCPflat_large_gsrFalse_ |
| Loaded config.yaml from ckpt folder /weka/proj-fmri/ckadirt/fMRI-foundation-model/src/checkpoints/HCPflat_large_gsrFalse_ |
|
|
| __CONFIG__ |
| base_lr = 0.001 |
| batch_size = 32 |
| ckpt_interval = 5 |
| ckpt_saving = True |
| cls_embed = True |
| contrastive_loss_weight = 1.0 |
| datasets_to_include = HCP |
| decoder_embed_dim = 512 |
| grad_accumulation_steps = 1 |
| grad_clip = 1.0 |
| gsr = False |
| hcp_flat_path = /weka/proj-medarc/shared/HCP-Flat |
| mask_ratio = 0.75 |
| model_name = HCPflat_large_gsrFalse_ |
| no_qkv_bias = False |
| norm_pix_loss = False |
| nsd_flat_path = /weka/proj-medarc/shared/NSD-Flat |
| num_epochs = 100 |
| num_frames = 16 |
| num_samples_per_epoch = 200000 |
| num_workers = 10 |
| patch_size = 16 |
| pct_masks_to_decode = 1 |
| plotting = True |
| pred_t_dim = 8 |
| print_interval = 20 |
| probe_base_lr = 0.0003 |
| probe_batch_size = 8 |
| probe_num_epochs = 30 |
| probe_num_samples_per_epoch = 100000 |
| resume_from_ckpt = True |
| seed = 42 |
| sep_pos_embed = True |
| t_patch_size = 2 |
| test_num_samples_per_epoch = 50000 |
| test_set = False |
| trunc_init = False |
| use_contrastive_loss = False |
| wandb_log = True |
|
|
|
|
| WORLD_SIZE=1 |
| PID of this process = 1891122 |
| global_pool = True |
| gsr = False |
| Creating datasets |
| Datasets ready |
| img_size (144, 320) patch_size (16, 16) frames 16 t_patch_size 2 |
| model initialized |
| latest_checkpoint: epoch99.pth |
|
|
| Loaded checkpoint epoch99.pth from /weka/proj-fmri/ckadirt/fMRI-foundation-model/src/checkpoints/HCPflat_large_gsrFalse_ |
|
|
| Input dimension: 1024 |
| total_steps 139140 |
| wandb_config: |
| {'model_name': 'HCPflat_large_gsrFalse__HCP_FT_sex', 'batch_size': 16, 'weight_decay': 0.001, 'num_epochs': 20, 'seed': 42, 'lr_scheduler_type': 'cycle', 'save_ckpt': False, 'max_lr': 0.0003, 'target': 'sex', 'num_workers': 15} |
| wandb_id: HCPflat_large_gsrFalse__beta_sex_HCPFT_83810 |
|
|
