Running 1 job
{
    "type": "diffusion_trainer",
    "training_folder": "/data/app/output",
    "sqlite_db_path": "/data/app/aitk_db.db",
    "device": "cuda",
    "trigger_word": "windy_storm",
    "performance_log_every": 10,
    "network": {
        "type": "lora",
        "linear": 32,
        "linear_alpha": 32,
        "conv": 16,
        "conv_alpha": 16,
        "lokr_full_rank": true,
        "lokr_factor": -1,
        "network_kwargs": {
            "ignore_if_contains": []
        }
    },
    "save": {
        "dtype": "bf16",
        "save_every": 250,
        "max_step_saves_to_keep": 4,
        "save_format": "diffusers",
        "push_to_hub": false
    },
    "datasets": [
        {
            "folder_path": "/data/app/datasets/windy_storm",
            "mask_path": null,
            "mask_min_value": 0.1,
            "default_caption": "",
            "caption_ext": "txt",
            "caption_dropout_rate": 0.05,
            "cache_latents_to_disk": false,
            "is_reg": false,
            "network_weight": 1,
            "resolution": [
                512,
                768,
                1024
            ],
            "controls": [],
            "shrink_video_to_frames": true,
            "num_frames": 1,
            "do_i2v": true,
            "flip_x": false,
            "flip_y": false
        }
    ],
    "train": {
        "batch_size": 1,
        "bypass_guidance_embedding": false,
        "steps": 3000,
        "gradient_accumulation": 1,
        "train_unet": true,
        "train_text_encoder": false,
        "gradient_checkpointing": true,
        "noise_scheduler": "flowmatch",
        "optimizer": "adamw8bit",
        "timestep_type": "weighted",
        "content_or_style": "balanced",
        "optimizer_params": {
            "weight_decay": 0.0001
        },
        "unload_text_encoder": false,
        "cache_text_embeddings": false,
        "lr": 0.0001,
        "ema_config": {
            "use_ema": false,
            "ema_decay": 0.99
        },
        "skip_first_sample": false,
        "force_first_sample": false,
        "disable_sampling": false,
        "dtype": "bf16",
        "diff_output_preservation": false,
        "diff_output_preservation_multiplier": 1,
        "diff_output_preservation_class": "person",
        "switch_boundary_every": 1,
        "loss_type": "mse",
        "do_differential_guidance": true,
        "differential_guidance_scale": 3
    },
    "model": {
        "name_or_path": "Tongyi-MAI/Z-Image-Turbo",
        "quantize": true,
        "qtype": "qfloat8",
        "quantize_te": true,
        "qtype_te": "qfloat8",
        "arch": "zimage:turbo",
        "low_vram": false,
        "model_kwargs": {},
        "layer_offloading": false,
        "layer_offloading_text_encoder_percent": 1,
        "layer_offloading_transformer_percent": 1,
        "assistant_lora_path": "ostris/zimage_turbo_training_adapter/zimage_turbo_training_adapter_v2.safetensors"
    },
    "sample": {
        "sampler": "flowmatch",
        "sample_every": 300,
        "width": 512,
        "height": 512,
        "samples": [
            {
                "prompt": "windy storm, woman, dark wavy hair, voluminous texture, almond-shaped eyes, olive skin, subtle freckles, upbeat expression, crisp white cotton shirt, tailored grey blazer, golden hour lighting, blurred urban background, shallow depth of field, 8k, photorealistic."
            },
            {
                "prompt": "windy storm, woman, long dark wavy hair, intense gaze, wearing a black leather biker jacket over a black top, studio lighting, clean white background, sharp focus, high detail, masterpiece, 85mm lens."
            },
            {
                "prompt": "windy storm, woman, agile build, dark curly hair, wearing a glossy green bikini top with matching long gloves and thigh-high boots, black combat boots, standing on an urban rooftop, sunset lighting, full body shot, cinematic mood."
            },
            {
                "prompt": "windy storm, woman, eyes closed, calm expression, dark wavy hair, wearing a metallic silver sleeveless top, minimalist grey background with a circular backlight, soft rim lighting, high-end editorial photography."
            },
            {
                "prompt": "windy storm, woman, hair in two long dark braids, freckles visible, wearing a black high-neck sleeveless latex bodysuit, matching arm sleeves, neutral bright background, centered portrait, symmetrical composition."
            },
            {
                "prompt": "windy storm, woman, profile view looking over shoulder, voluminous dark wavy hair, wearing a cream-colored silk camisole, soft studio lighting with a circular halo effect, elegant mood, skin texture detail, 8k."
            }
        ],
        "neg": "",
        "seed": 42,
        "walk_seed": true,
        "guidance_scale": 1,
        "sample_steps": 8,
        "num_frames": 1,
        "fps": 1
    }
}
Using SQLite database at /data/app/aitk_db.db
Job ID: "eb93ffbf-11a3-40ae-bea2-cb43e1423559"

#############################################
# Running job: windy_storm
#############################################


Running  1 process
Loading ZImage model
Loading transformer

config.json:   0%|          | 0.00/473 [00:00<?, ?B/s]
config.json:   0%|          | 0.00/473 [00:00<?, ?B/s]
config.json: 100%|##########| 473/473 [00:00<00:00, 4.84MB/s]
config.json: 100%|##########| 473/473 [00:00<00:00, 4.84MB/s]


(…)ion_pytorch_model.safetensors.index.json: 0.00B [00:00, ?B/s]
(…)ion_pytorch_model.safetensors.index.json: 0.00B [00:00, ?B/s]
(…)ion_pytorch_model.safetensors.index.json: 49.0kB [00:00, 28.3MB/s]
(…)ion_pytorch_model.safetensors.index.json: 49.0kB [00:00, 28.3MB/s]


transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<1:34:50, 1.75MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<1:34:50, 1.75MB/s]
transformer/diffusion_pytorch_model-0000(…):   1%|          | 67.9M/9.97G [00:00<01:27, 114MB/s]  
transformer/diffusion_pytorch_model-0000(…):   1%|          | 67.9M/9.97G [00:00<01:27, 114MB/s]  
transformer/diffusion_pytorch_model-0000(…):   3%|3         | 338M/9.97G [00:00<00:20, 480MB/s] 
transformer/diffusion_pytorch_model-0000(…):   3%|3         | 338M/9.97G [00:00<00:20, 480MB/s] 
transformer/diffusion_pytorch_model-0000(…):   7%|6         | 678M/9.97G [00:01<00:09, 964MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|6         | 678M/9.97G [00:01<00:09, 964MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 879M/9.97G [00:01<00:09, 915MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 879M/9.97G [00:01<00:09, 915MB/s]
transformer/diffusion_pytorch_model-0000(…):  10%|#         | 1.01G/9.97G [00:01<00:10, 872MB/s]
transformer/diffusion_pytorch_model-0000(…):  10%|#         | 1.01G/9.97G [00:01<00:10, 872MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#2        | 1.21G/9.97G [00:01<00:08, 1.01GB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#2        | 1.21G/9.97G [00:01<00:08, 1.01GB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#3        | 1.35G/9.97G [00:01<00:08, 1.05GB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#3        | 1.35G/9.97G [00:01<00:08, 1.05GB/s]
transformer/diffusion_pytorch_model-0000(…):  15%|#4        | 1.48G/9.97G [00:01<00:09, 928MB/s] 
transformer/diffusion_pytorch_model-0000(…):  15%|#4        | 1.48G/9.97G [00:01<00:09, 928MB/s] 
transformer/diffusion_pytorch_model-0000(…):  16%|#6        | 1.62G/9.97G [00:02<00:10, 773MB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#6        | 1.62G/9.97G [00:02<00:10, 773MB/s]
transformer/diffusion_pytorch_model-0000(…):  21%|##        | 2.08G/9.97G [00:02<00:05, 1.40GB/s]
transformer/diffusion_pytorch_model-0000(…):  21%|##        | 2.08G/9.97G [00:02<00:05, 1.40GB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##2       | 2.29G/9.97G [00:02<00:05, 1.43GB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##2       | 2.29G/9.97G [00:02<00:05, 1.43GB/s]
transformer/diffusion_pytorch_model-0000(…):  25%|##4       | 2.49G/9.97G [00:02<00:05, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  25%|##4       | 2.49G/9.97G [00:02<00:05, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##6       | 2.69G/9.97G [00:02<00:05, 1.38GB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##6       | 2.69G/9.97G [00:02<00:05, 1.38GB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 2.89G/9.97G [00:02<00:05, 1.37GB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 2.89G/9.97G [00:02<00:05, 1.37GB/s]
transformer/diffusion_pytorch_model-0000(…):  31%|###1      | 3.09G/9.97G [00:03<00:05, 1.37GB/s]
transformer/diffusion_pytorch_model-0000(…):  31%|###1      | 3.09G/9.97G [00:03<00:05, 1.37GB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 3.29G/9.97G [00:03<00:04, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 3.29G/9.97G [00:03<00:04, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###5      | 3.50G/9.97G [00:03<00:05, 1.27GB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###5      | 3.50G/9.97G [00:03<00:05, 1.27GB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 3.70G/9.97G [00:03<00:05, 1.24GB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 3.70G/9.97G [00:03<00:05, 1.24GB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###9      | 3.90G/9.97G [00:03<00:04, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###9      | 3.90G/9.97G [00:03<00:04, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  41%|####1     | 4.10G/9.97G [00:03<00:04, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  41%|####1     | 4.10G/9.97G [00:03<00:04, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####2     | 4.23G/9.97G [00:03<00:04, 1.28GB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####2     | 4.23G/9.97G [00:03<00:04, 1.28GB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####3     | 4.37G/9.97G [00:04<00:04, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####3     | 4.37G/9.97G [00:04<00:04, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####5     | 4.50G/9.97G [00:04<00:05, 964MB/s] 
transformer/diffusion_pytorch_model-0000(…):  45%|####5     | 4.50G/9.97G [00:04<00:05, 964MB/s] 
transformer/diffusion_pytorch_model-0000(…):  48%|####7     | 4.77G/9.97G [00:04<00:04, 1.24GB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####7     | 4.77G/9.97G [00:04<00:04, 1.24GB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|####9     | 4.97G/9.97G [00:04<00:03, 1.27GB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|####9     | 4.97G/9.97G [00:04<00:03, 1.27GB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 5.17G/9.97G [00:04<00:03, 1.28GB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 5.17G/9.97G [00:04<00:03, 1.28GB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 5.30G/9.97G [00:04<00:03, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 5.30G/9.97G [00:04<00:03, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 5.44G/9.97G [00:04<00:03, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 5.44G/9.97G [00:04<00:03, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####6    | 5.64G/9.97G [00:05<00:03, 1.34GB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####6    | 5.64G/9.97G [00:05<00:03, 1.34GB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 5.84G/9.97G [00:05<00:03, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 5.84G/9.97G [00:05<00:03, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|#####9    | 5.97G/9.97G [00:05<00:03, 1.15GB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|#####9    | 5.97G/9.97G [00:05<00:03, 1.15GB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 6.18G/9.97G [00:05<00:03, 1.24GB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 6.18G/9.97G [00:05<00:03, 1.24GB/s]
transformer/diffusion_pytorch_model-0000(…):  64%|######3   | 6.37G/9.97G [00:05<00:02, 1.27GB/s]
transformer/diffusion_pytorch_model-0000(…):  64%|######3   | 6.37G/9.97G [00:05<00:02, 1.27GB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:05<00:03, 1.12GB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:05<00:03, 1.12GB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######6   | 6.64G/9.97G [00:06<00:03, 1.10GB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######6   | 6.64G/9.97G [00:06<00:03, 1.10GB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######7   | 6.75G/9.97G [00:06<00:02, 1.10GB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######7   | 6.75G/9.97G [00:06<00:02, 1.10GB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.89G/9.97G [00:06<00:02, 1.15GB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.89G/9.97G [00:06<00:02, 1.15GB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.09G/9.97G [00:06<00:02, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.09G/9.97G [00:06<00:02, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######2  | 7.22G/9.97G [00:06<00:02, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######2  | 7.22G/9.97G [00:06<00:02, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 7.43G/9.97G [00:06<00:01, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 7.43G/9.97G [00:06<00:01, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######6  | 7.63G/9.97G [00:06<00:01, 1.43GB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######6  | 7.63G/9.97G [00:06<00:01, 1.43GB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######8  | 7.83G/9.97G [00:06<00:01, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######8  | 7.83G/9.97G [00:06<00:01, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########  | 8.03G/9.97G [00:07<00:01, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########  | 8.03G/9.97G [00:07<00:01, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 8.23G/9.97G [00:07<00:01, 1.43GB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 8.23G/9.97G [00:07<00:01, 1.43GB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########4 | 8.43G/9.97G [00:07<00:01, 1.52GB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########4 | 8.43G/9.97G [00:07<00:01, 1.52GB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########6 | 8.63G/9.97G [00:07<00:00, 1.58GB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########6 | 8.63G/9.97G [00:07<00:00, 1.58GB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 8.83G/9.97G [00:07<00:00, 1.65GB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 8.83G/9.97G [00:07<00:00, 1.65GB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.03G/9.97G [00:07<00:00, 1.68GB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.03G/9.97G [00:07<00:00, 1.68GB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:07<00:00, 1.62GB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:07<00:00, 1.62GB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########4| 9.44G/9.97G [00:07<00:00, 1.59GB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########4| 9.44G/9.97G [00:07<00:00, 1.59GB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 9.71G/9.97G [00:07<00:00, 1.74GB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 9.71G/9.97G [00:07<00:00, 1.74GB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:08<00:00, 1.93GB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:08<00:00, 1.93GB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:08<00:00, 1.23GB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:08<00:00, 1.23GB/s]


transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<1:22:41, 2.01MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<1:22:41, 2.01MB/s]
transformer/diffusion_pytorch_model-0000(…):   1%|          | 67.9M/9.97G [00:00<01:25, 116MB/s]  
transformer/diffusion_pytorch_model-0000(…):   1%|          | 67.9M/9.97G [00:00<01:25, 116MB/s]  
transformer/diffusion_pytorch_model-0000(…):   3%|3         | 338M/9.97G [00:01<00:21, 447MB/s] 
transformer/diffusion_pytorch_model-0000(…):   3%|3         | 338M/9.97G [00:01<00:21, 447MB/s] 
transformer/diffusion_pytorch_model-0000(…):   7%|6         | 676M/9.97G [00:01<00:10, 913MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|6         | 676M/9.97G [00:01<00:10, 913MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 877M/9.97G [00:01<00:10, 868MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 877M/9.97G [00:01<00:10, 868MB/s]
transformer/diffusion_pytorch_model-0000(…):  11%|#         | 1.08G/9.97G [00:01<00:08, 1.04GB/s]
transformer/diffusion_pytorch_model-0000(…):  11%|#         | 1.08G/9.97G [00:01<00:08, 1.04GB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#2        | 1.28G/9.97G [00:01<00:09, 948MB/s] 
transformer/diffusion_pytorch_model-0000(…):  13%|#2        | 1.28G/9.97G [00:01<00:09, 948MB/s] 
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 1.41G/9.97G [00:01<00:08, 1.02GB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 1.41G/9.97G [00:01<00:08, 1.02GB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#5        | 1.55G/9.97G [00:01<00:07, 1.07GB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#5        | 1.55G/9.97G [00:01<00:07, 1.07GB/s]
transformer/diffusion_pytorch_model-0000(…):  17%|#6        | 1.68G/9.97G [00:02<00:09, 841MB/s] 
transformer/diffusion_pytorch_model-0000(…):  17%|#6        | 1.68G/9.97G [00:02<00:09, 841MB/s] 
transformer/diffusion_pytorch_model-0000(…):  18%|#8        | 1.82G/9.97G [00:02<00:11, 719MB/s]
transformer/diffusion_pytorch_model-0000(…):  18%|#8        | 1.82G/9.97G [00:02<00:11, 719MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|#9        | 1.95G/9.97G [00:02<00:10, 797MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|#9        | 1.95G/9.97G [00:02<00:10, 797MB/s]
transformer/diffusion_pytorch_model-0000(…):  21%|##        | 2.09G/9.97G [00:03<00:15, 501MB/s]
transformer/diffusion_pytorch_model-0000(…):  21%|##        | 2.09G/9.97G [00:03<00:15, 501MB/s]
transformer/diffusion_pytorch_model-0000(…):  22%|##2       | 2.22G/9.97G [00:03<00:12, 609MB/s]
transformer/diffusion_pytorch_model-0000(…):  22%|##2       | 2.22G/9.97G [00:03<00:12, 609MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##3       | 2.35G/9.97G [00:04<00:24, 309MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##3       | 2.35G/9.97G [00:04<00:24, 309MB/s]
transformer/diffusion_pytorch_model-0000(…):  25%|##4       | 2.49G/9.97G [00:05<00:31, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  25%|##4       | 2.49G/9.97G [00:05<00:31, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 2.55G/9.97G [00:05<00:34, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 2.55G/9.97G [00:05<00:34, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##6       | 2.62G/9.97G [00:05<00:37, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##6       | 2.62G/9.97G [00:05<00:37, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##6       | 2.69G/9.97G [00:06<00:38, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##6       | 2.69G/9.97G [00:06<00:38, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##7       | 2.76G/9.97G [00:06<00:40, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##7       | 2.76G/9.97G [00:06<00:40, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##8       | 2.82G/9.97G [00:07<00:40, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##8       | 2.82G/9.97G [00:07<00:40, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 2.89G/9.97G [00:07<00:40, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 2.89G/9.97G [00:07<00:40, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|##9       | 2.96G/9.97G [00:07<00:39, 176MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|##9       | 2.96G/9.97G [00:07<00:39, 176MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 3.02G/9.97G [00:08<00:39, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 3.02G/9.97G [00:08<00:39, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  31%|###       | 3.09G/9.97G [00:08<00:38, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  31%|###       | 3.09G/9.97G [00:08<00:38, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 3.16G/9.97G [00:09<00:37, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 3.16G/9.97G [00:09<00:37, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###2      | 3.23G/9.97G [00:09<00:33, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###2      | 3.23G/9.97G [00:09<00:33, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 3.29G/9.97G [00:09<00:31, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 3.29G/9.97G [00:09<00:31, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###3      | 3.36G/9.97G [00:09<00:28, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###3      | 3.36G/9.97G [00:09<00:28, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###4      | 3.43G/9.97G [00:10<00:27, 237MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###4      | 3.43G/9.97G [00:10<00:27, 237MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###5      | 3.49G/9.97G [00:10<00:26, 244MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###5      | 3.49G/9.97G [00:10<00:26, 244MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###5      | 3.56G/9.97G [00:10<00:25, 251MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###5      | 3.56G/9.97G [00:10<00:25, 251MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 3.63G/9.97G [00:10<00:24, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 3.63G/9.97G [00:10<00:24, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 3.69G/9.97G [00:11<00:24, 261MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 3.69G/9.97G [00:11<00:24, 261MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###7      | 3.76G/9.97G [00:11<00:24, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###7      | 3.76G/9.97G [00:11<00:24, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###8      | 3.83G/9.97G [00:11<00:23, 260MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###8      | 3.83G/9.97G [00:11<00:23, 260MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|###9      | 3.96G/9.97G [00:11<00:19, 306MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|###9      | 3.96G/9.97G [00:11<00:19, 306MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 4.03G/9.97G [00:12<00:20, 296MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 4.03G/9.97G [00:12<00:20, 296MB/s]
transformer/diffusion_pytorch_model-0000(…):  41%|####1     | 4.10G/9.97G [00:12<00:23, 252MB/s]
transformer/diffusion_pytorch_model-0000(…):  41%|####1     | 4.10G/9.97G [00:12<00:23, 252MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 4.16G/9.97G [00:12<00:24, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 4.16G/9.97G [00:12<00:24, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 4.30G/9.97G [00:13<00:20, 283MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 4.30G/9.97G [00:13<00:20, 283MB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####3     | 4.37G/9.97G [00:13<00:21, 263MB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####3     | 4.37G/9.97G [00:13<00:21, 263MB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####4     | 4.44G/9.97G [00:14<00:27, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####4     | 4.44G/9.97G [00:14<00:27, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####5     | 4.50G/9.97G [00:14<00:29, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####5     | 4.50G/9.97G [00:14<00:29, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####5     | 4.57G/9.97G [00:14<00:28, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####5     | 4.57G/9.97G [00:14<00:28, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####6     | 4.64G/9.97G [00:15<00:28, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####6     | 4.64G/9.97G [00:15<00:28, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 4.70G/9.97G [00:15<00:27, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 4.70G/9.97G [00:15<00:27, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####7     | 4.77G/9.97G [00:15<00:26, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####7     | 4.77G/9.97G [00:15<00:26, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 4.84G/9.97G [00:16<00:25, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 4.84G/9.97G [00:16<00:25, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####9     | 4.90G/9.97G [00:16<00:25, 201MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####9     | 4.90G/9.97G [00:16<00:25, 201MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|####9     | 4.97G/9.97G [00:16<00:25, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|####9     | 4.97G/9.97G [00:16<00:25, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####     | 5.04G/9.97G [00:17<00:24, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####     | 5.04G/9.97G [00:17<00:24, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####1    | 5.11G/9.97G [00:17<00:23, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####1    | 5.11G/9.97G [00:17<00:23, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 5.17G/9.97G [00:17<00:22, 211MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 5.17G/9.97G [00:17<00:22, 211MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####2    | 5.24G/9.97G [00:18<00:22, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####2    | 5.24G/9.97G [00:18<00:22, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 5.30G/9.97G [00:18<00:22, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 5.30G/9.97G [00:18<00:22, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  54%|#####3    | 5.37G/9.97G [00:18<00:24, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  54%|#####3    | 5.37G/9.97G [00:18<00:24, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 5.44G/9.97G [00:19<00:23, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 5.44G/9.97G [00:19<00:23, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####5    | 5.50G/9.97G [00:19<00:24, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####5    | 5.50G/9.97G [00:19<00:24, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####5    | 5.57G/9.97G [00:20<00:23, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####5    | 5.57G/9.97G [00:20<00:23, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####6    | 5.64G/9.97G [00:20<00:23, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####6    | 5.64G/9.97G [00:20<00:23, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####7    | 5.71G/9.97G [00:20<00:19, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####7    | 5.71G/9.97G [00:20<00:19, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 5.77G/9.97G [00:20<00:19, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 5.77G/9.97G [00:20<00:19, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 5.84G/9.97G [00:21<00:20, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 5.84G/9.97G [00:21<00:20, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####9    | 5.91G/9.97G [00:21<00:19, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####9    | 5.91G/9.97G [00:21<00:19, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|#####9    | 5.97G/9.97G [00:21<00:19, 203MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|#####9    | 5.97G/9.97G [00:21<00:19, 203MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######    | 6.04G/9.97G [00:22<00:19, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######    | 6.04G/9.97G [00:22<00:19, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######1   | 6.11G/9.97G [00:22<00:18, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######1   | 6.11G/9.97G [00:22<00:18, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 6.17G/9.97G [00:22<00:18, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 6.17G/9.97G [00:22<00:18, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######2   | 6.24G/9.97G [00:22<00:14, 256MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######2   | 6.24G/9.97G [00:22<00:14, 256MB/s]
transformer/diffusion_pytorch_model-0000(…):  64%|######3   | 6.38G/9.97G [00:23<00:11, 308MB/s]
transformer/diffusion_pytorch_model-0000(…):  64%|######3   | 6.38G/9.97G [00:23<00:11, 308MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 6.44G/9.97G [00:23<00:13, 265MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 6.44G/9.97G [00:23<00:13, 265MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:23<00:14, 244MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:23<00:14, 244MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######5   | 6.58G/9.97G [00:24<00:15, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######5   | 6.58G/9.97G [00:24<00:15, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######6   | 6.64G/9.97G [00:24<00:18, 184MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######6   | 6.64G/9.97G [00:24<00:18, 184MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 6.71G/9.97G [00:25<00:18, 179MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 6.71G/9.97G [00:25<00:18, 179MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######7   | 6.78G/9.97G [00:25<00:17, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######7   | 6.78G/9.97G [00:25<00:17, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######8   | 6.85G/9.97G [00:25<00:16, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######8   | 6.85G/9.97G [00:25<00:16, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.91G/9.97G [00:26<00:15, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.91G/9.97G [00:26<00:15, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 6.98G/9.97G [00:26<00:15, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 6.98G/9.97G [00:26<00:15, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######   | 7.05G/9.97G [00:26<00:15, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######   | 7.05G/9.97G [00:26<00:15, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.11G/9.97G [00:27<00:14, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.11G/9.97G [00:27<00:14, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######1  | 7.18G/9.97G [00:27<00:14, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######1  | 7.18G/9.97G [00:27<00:14, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 7.25G/9.97G [00:28<00:14, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 7.25G/9.97G [00:28<00:14, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######3  | 7.32G/9.97G [00:28<00:14, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######3  | 7.32G/9.97G [00:28<00:14, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 7.38G/9.97G [00:28<00:13, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 7.38G/9.97G [00:28<00:13, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######4  | 7.45G/9.97G [00:29<00:15, 167MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######4  | 7.45G/9.97G [00:29<00:15, 167MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######5  | 7.52G/9.97G [00:29<00:14, 167MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######5  | 7.52G/9.97G [00:29<00:14, 167MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######6  | 7.58G/9.97G [00:29<00:13, 175MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######6  | 7.58G/9.97G [00:29<00:13, 175MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######6  | 7.63G/9.97G [00:30<00:14, 161MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######6  | 7.63G/9.97G [00:30<00:14, 161MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 7.70G/9.97G [00:30<00:14, 159MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 7.70G/9.97G [00:30<00:14, 159MB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######7  | 7.77G/9.97G [00:31<00:12, 170MB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######7  | 7.77G/9.97G [00:31<00:12, 170MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######8  | 7.83G/9.97G [00:31<00:12, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######8  | 7.83G/9.97G [00:31<00:12, 177MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######9  | 7.90G/9.97G [00:31<00:11, 182MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######9  | 7.90G/9.97G [00:31<00:11, 182MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|########  | 8.03G/9.97G [00:32<00:07, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|########  | 8.03G/9.97G [00:32<00:07, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 8.10G/9.97G [00:32<00:07, 246MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 8.10G/9.97G [00:32<00:07, 246MB/s]
transformer/diffusion_pytorch_model-0000(…):  82%|########1 | 8.16G/9.97G [00:32<00:07, 244MB/s]
transformer/diffusion_pytorch_model-0000(…):  82%|########1 | 8.16G/9.97G [00:32<00:07, 244MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 8.23G/9.97G [00:32<00:07, 248MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 8.23G/9.97G [00:32<00:07, 248MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########3 | 8.30G/9.97G [00:33<00:06, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########3 | 8.30G/9.97G [00:33<00:06, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########3 | 8.36G/9.97G [00:33<00:06, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########3 | 8.36G/9.97G [00:33<00:06, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########4 | 8.43G/9.97G [00:33<00:06, 236MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########4 | 8.43G/9.97G [00:33<00:06, 236MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########5 | 8.50G/9.97G [00:34<00:06, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########5 | 8.50G/9.97G [00:34<00:06, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 8.57G/9.97G [00:34<00:05, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 8.57G/9.97G [00:34<00:05, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########6 | 8.63G/9.97G [00:34<00:05, 241MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########6 | 8.63G/9.97G [00:34<00:05, 241MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 8.70G/9.97G [00:34<00:05, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 8.70G/9.97G [00:34<00:05, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  88%|########7 | 8.77G/9.97G [00:35<00:05, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  88%|########7 | 8.77G/9.97G [00:35<00:05, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 8.83G/9.97G [00:35<00:04, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 8.83G/9.97G [00:35<00:04, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########9 | 8.90G/9.97G [00:35<00:04, 238MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########9 | 8.90G/9.97G [00:35<00:04, 238MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 8.97G/9.97G [00:36<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 8.97G/9.97G [00:36<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.03G/9.97G [00:36<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.03G/9.97G [00:36<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 9.10G/9.97G [00:36<00:03, 225MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 9.10G/9.97G [00:36<00:03, 225MB/s]
transformer/diffusion_pytorch_model-0000(…):  92%|#########1| 9.17G/9.97G [00:36<00:03, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  92%|#########1| 9.17G/9.97G [00:36<00:03, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:37<00:03, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:37<00:03, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########3| 9.30G/9.97G [00:37<00:02, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########3| 9.30G/9.97G [00:37<00:02, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########3| 9.37G/9.97G [00:37<00:02, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########3| 9.37G/9.97G [00:37<00:02, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########5| 9.50G/9.97G [00:38<00:01, 287MB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########5| 9.50G/9.97G [00:38<00:01, 287MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 9.57G/9.97G [00:38<00:01, 333MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 9.57G/9.97G [00:38<00:01, 333MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########6| 9.64G/9.97G [00:38<00:01, 312MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########6| 9.64G/9.97G [00:38<00:01, 312MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 9.71G/9.97G [00:38<00:00, 295MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 9.71G/9.97G [00:38<00:00, 295MB/s]
transformer/diffusion_pytorch_model-0000(…):  98%|#########7| 9.77G/9.97G [00:39<00:00, 280MB/s]
transformer/diffusion_pytorch_model-0000(…):  98%|#########7| 9.77G/9.97G [00:39<00:00, 280MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 9.84G/9.97G [00:39<00:00, 270MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 9.84G/9.97G [00:39<00:00, 270MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########9| 9.91G/9.97G [00:39<00:00, 263MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########9| 9.91G/9.97G [00:39<00:00, 263MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 256MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 256MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 250MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 250MB/s]


transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/4.67G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/4.67G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 925k/4.67G [00:00<32:52, 2.37MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 925k/4.67G [00:00<32:52, 2.37MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 2.41M/4.67G [00:00<21:44, 3.58MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 2.41M/4.67G [00:00<21:44, 3.58MB/s]
transformer/diffusion_pytorch_model-0000(…):   3%|2         | 136M/4.67G [00:01<00:23, 191MB/s]  
transformer/diffusion_pytorch_model-0000(…):   3%|2         | 136M/4.67G [00:01<00:23, 191MB/s]  
transformer/diffusion_pytorch_model-0000(…):   4%|4         | 204M/4.67G [00:01<00:17, 249MB/s]
transformer/diffusion_pytorch_model-0000(…):   4%|4         | 204M/4.67G [00:01<00:17, 249MB/s]
transformer/diffusion_pytorch_model-0000(…):   6%|5         | 271M/4.67G [00:01<00:20, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):   6%|5         | 271M/4.67G [00:01<00:20, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|7         | 338M/4.67G [00:02<00:24, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|7         | 338M/4.67G [00:02<00:24, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 407M/4.67G [00:02<00:26, 161MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 407M/4.67G [00:02<00:26, 161MB/s]
transformer/diffusion_pytorch_model-0000(…):  10%|#         | 474M/4.67G [00:03<00:27, 150MB/s]
transformer/diffusion_pytorch_model-0000(…):  10%|#         | 474M/4.67G [00:03<00:27, 150MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#1        | 541M/4.67G [00:03<00:28, 146MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#1        | 541M/4.67G [00:03<00:28, 146MB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#3        | 608M/4.67G [00:04<00:28, 143MB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#3        | 608M/4.67G [00:04<00:28, 143MB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 675M/4.67G [00:04<00:26, 150MB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 675M/4.67G [00:04<00:26, 150MB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#5        | 742M/4.67G [00:04<00:24, 159MB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#5        | 742M/4.67G [00:04<00:24, 159MB/s]
transformer/diffusion_pytorch_model-0000(…):  17%|#7        | 809M/4.67G [00:05<00:22, 171MB/s]
transformer/diffusion_pytorch_model-0000(…):  17%|#7        | 809M/4.67G [00:05<00:22, 171MB/s]
transformer/diffusion_pytorch_model-0000(…):  19%|#8        | 876M/4.67G [00:05<00:21, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):  19%|#8        | 876M/4.67G [00:05<00:21, 180MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|##        | 943M/4.67G [00:05<00:20, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|##        | 943M/4.67G [00:05<00:20, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  22%|##1       | 1.01G/4.67G [00:06<00:19, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  22%|##1       | 1.01G/4.67G [00:06<00:19, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##3       | 1.08G/4.67G [00:06<00:19, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##3       | 1.08G/4.67G [00:06<00:19, 183MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##4       | 1.14G/4.67G [00:06<00:18, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##4       | 1.14G/4.67G [00:06<00:18, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 1.21G/4.67G [00:07<00:18, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 1.21G/4.67G [00:07<00:18, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##7       | 1.28G/4.67G [00:07<00:18, 187MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##7       | 1.28G/4.67G [00:07<00:18, 187MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 1.35G/4.67G [00:07<00:17, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 1.35G/4.67G [00:07<00:17, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 1.41G/4.67G [00:08<00:16, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 1.41G/4.67G [00:08<00:16, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 1.48G/4.67G [00:08<00:16, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 1.48G/4.67G [00:08<00:16, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 1.55G/4.67G [00:08<00:15, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 1.55G/4.67G [00:08<00:15, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###4      | 1.61G/4.67G [00:09<00:15, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###4      | 1.61G/4.67G [00:09<00:15, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###5      | 1.68G/4.67G [00:09<00:15, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###5      | 1.68G/4.67G [00:09<00:15, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 1.75G/4.67G [00:09<00:14, 201MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 1.75G/4.67G [00:09<00:14, 201MB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###8      | 1.82G/4.67G [00:10<00:14, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###8      | 1.82G/4.67G [00:10<00:14, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 1.88G/4.67G [00:10<00:14, 187MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 1.88G/4.67G [00:10<00:14, 187MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 1.95G/4.67G [00:11<00:14, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 1.95G/4.67G [00:11<00:14, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 2.02G/4.67G [00:11<00:13, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 2.02G/4.67G [00:11<00:13, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####4     | 2.08G/4.67G [00:11<00:13, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####4     | 2.08G/4.67G [00:11<00:13, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####6     | 2.15G/4.67G [00:12<00:12, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####6     | 2.15G/4.67G [00:12<00:12, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 2.22G/4.67G [00:12<00:12, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 2.22G/4.67G [00:12<00:12, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 2.28G/4.67G [00:12<00:11, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 2.28G/4.67G [00:12<00:11, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|#####     | 2.35G/4.67G [00:12<00:11, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|#####     | 2.35G/4.67G [00:12<00:11, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 2.42G/4.67G [00:13<00:10, 210MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 2.42G/4.67G [00:13<00:10, 210MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 2.49G/4.67G [00:13<00:10, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 2.49G/4.67G [00:13<00:10, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 2.55G/4.67G [00:13<00:10, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 2.55G/4.67G [00:13<00:10, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####6    | 2.62G/4.67G [00:14<00:09, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####6    | 2.62G/4.67G [00:14<00:09, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 2.69G/4.67G [00:14<00:09, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 2.69G/4.67G [00:14<00:09, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 2.75G/4.67G [00:14<00:08, 221MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 2.75G/4.67G [00:14<00:08, 221MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|######    | 2.82G/4.67G [00:15<00:08, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|######    | 2.82G/4.67G [00:15<00:08, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 2.89G/4.67G [00:15<00:07, 232MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 2.89G/4.67G [00:15<00:07, 232MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 2.96G/4.67G [00:15<00:08, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 2.96G/4.67G [00:15<00:08, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 3.02G/4.67G [00:16<00:08, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 3.02G/4.67G [00:16<00:08, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######6   | 3.09G/4.67G [00:16<00:07, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######6   | 3.09G/4.67G [00:16<00:07, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 3.13G/4.67G [00:16<00:07, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 3.13G/4.67G [00:16<00:07, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######8   | 3.20G/4.67G [00:16<00:07, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######8   | 3.20G/4.67G [00:16<00:07, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 3.27G/4.67G [00:17<00:06, 201MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 3.27G/4.67G [00:17<00:06, 201MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 3.33G/4.67G [00:17<00:06, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 3.33G/4.67G [00:17<00:06, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 3.40G/4.67G [00:17<00:06, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 3.40G/4.67G [00:17<00:06, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 3.47G/4.67G [00:18<00:05, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 3.47G/4.67G [00:18<00:05, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######5  | 3.53G/4.67G [00:18<00:05, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######5  | 3.53G/4.67G [00:18<00:05, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 3.60G/4.67G [00:18<00:05, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 3.60G/4.67G [00:18<00:05, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######8  | 3.67G/4.67G [00:19<00:04, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######8  | 3.67G/4.67G [00:19<00:04, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|#######9  | 3.73G/4.67G [00:19<00:04, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|#######9  | 3.73G/4.67G [00:19<00:04, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 3.80G/4.67G [00:19<00:03, 227MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 3.80G/4.67G [00:19<00:03, 227MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 3.87G/4.67G [00:20<00:03, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 3.87G/4.67G [00:20<00:03, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########4 | 3.93G/4.67G [00:20<00:03, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########4 | 3.93G/4.67G [00:20<00:03, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 4.00G/4.67G [00:20<00:02, 226MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 4.00G/4.67G [00:20<00:02, 226MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 4.07G/4.67G [00:20<00:02, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 4.07G/4.67G [00:20<00:02, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 4.14G/4.67G [00:21<00:02, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 4.14G/4.67G [00:21<00:02, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 4.20G/4.67G [00:21<00:02, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 4.20G/4.67G [00:21<00:02, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 4.27G/4.67G [00:21<00:01, 226MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 4.27G/4.67G [00:21<00:01, 226MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 4.34G/4.67G [00:22<00:01, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 4.34G/4.67G [00:22<00:01, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########4| 4.40G/4.67G [00:22<00:01, 235MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########4| 4.40G/4.67G [00:22<00:01, 235MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 4.47G/4.67G [00:22<00:00, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 4.47G/4.67G [00:22<00:00, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 4.54G/4.67G [00:22<00:00, 243MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 4.54G/4.67G [00:22<00:00, 243MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 4.61G/4.67G [00:23<00:00, 299MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 4.61G/4.67G [00:23<00:00, 299MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 288MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 288MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 201MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 201MB/s]


Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:  33%|###3      | 1/3 [00:01<00:02,  1.28s/it]
Loading checkpoint shards:  33%|###3      | 1/3 [00:01<00:02,  1.28s/it]
Loading checkpoint shards:  67%|######6   | 2/3 [00:02<00:01,  1.31s/it]
Loading checkpoint shards:  67%|######6   | 2/3 [00:02<00:01,  1.31s/it]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.01it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.01it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.07s/it]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.07s/it]

Loading assistant LoRA

zimage_turbo_training_adapter_v2.safeten(…):   0%|          | 0.00/340M [00:00<?, ?B/s]
zimage_turbo_training_adapter_v2.safeten(…):   0%|          | 0.00/340M [00:00<?, ?B/s]
zimage_turbo_training_adapter_v2.safeten(…):  17%|#6        | 56.3M/340M [00:01<00:05, 49.8MB/s]
zimage_turbo_training_adapter_v2.safeten(…):  17%|#6        | 56.3M/340M [00:01<00:05, 49.8MB/s]
zimage_turbo_training_adapter_v2.safeten(…):  54%|#####3    | 182M/340M [00:02<00:01, 96.0MB/s] 
zimage_turbo_training_adapter_v2.safeten(…):  54%|#####3    | 182M/340M [00:02<00:01, 96.0MB/s] 
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 159MB/s] 
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 159MB/s] 
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 132MB/s]
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 132MB/s]

create LoRA network. base dim (rank): 64, alpha: 64
neuron dropout: p=None, rank dropout: p=None, module dropout: p=None
create LoRA for Text Encoder: 0 modules.
create LoRA for U-Net: 276 modules.
enable LoRA for U-Net
Merging in assistant LoRA
Missing keys: []
Quantizing Transformer
 - quantizing 30 transformer blocks

  0%|          | 0/30 [00:00<?, ?it/s]
  0%|          | 0/30 [00:00<?, ?it/s]
  3%|3         | 1/30 [00:00<00:05,  5.13it/s]
  3%|3         | 1/30 [00:00<00:05,  5.13it/s]
 10%|#         | 3/30 [00:00<00:02, 10.18it/s]
 10%|#         | 3/30 [00:00<00:02, 10.18it/s]
 17%|#6        | 5/30 [00:00<00:02, 12.39it/s]
 17%|#6        | 5/30 [00:00<00:02, 12.39it/s]
 23%|##3       | 7/30 [00:00<00:01, 13.61it/s]
 23%|##3       | 7/30 [00:00<00:01, 13.61it/s]
 30%|###       | 9/30 [00:00<00:01, 13.47it/s]
 30%|###       | 9/30 [00:00<00:01, 13.47it/s]
 37%|###6      | 11/30 [00:00<00:01, 11.78it/s]
 37%|###6      | 11/30 [00:00<00:01, 11.78it/s]
 43%|####3     | 13/30 [00:01<00:01, 10.67it/s]
 43%|####3     | 13/30 [00:01<00:01, 10.67it/s]
 50%|#####     | 15/30 [00:01<00:01, 10.36it/s]
 50%|#####     | 15/30 [00:01<00:01, 10.36it/s]
 57%|#####6    | 17/30 [00:01<00:01, 10.17it/s]
 57%|#####6    | 17/30 [00:01<00:01, 10.17it/s]
 63%|######3   | 19/30 [00:01<00:01, 10.03it/s]
 63%|######3   | 19/30 [00:01<00:01, 10.03it/s]
 70%|#######   | 21/30 [00:01<00:00,  9.90it/s]
 70%|#######   | 21/30 [00:01<00:00,  9.90it/s]
 77%|#######6  | 23/30 [00:02<00:00,  9.84it/s]
 77%|#######6  | 23/30 [00:02<00:00,  9.84it/s]
 83%|########3 | 25/30 [00:02<00:00,  9.80it/s]
 83%|########3 | 25/30 [00:02<00:00,  9.80it/s]
 87%|########6 | 26/30 [00:02<00:00,  9.65it/s]
 87%|########6 | 26/30 [00:02<00:00,  9.65it/s]
 90%|######### | 27/30 [00:02<00:00,  9.52it/s]
 90%|######### | 27/30 [00:02<00:00,  9.52it/s]
 97%|#########6| 29/30 [00:02<00:00,  9.60it/s]
 97%|#########6| 29/30 [00:02<00:00,  9.60it/s]
100%|##########| 30/30 [00:02<00:00,  9.40it/s]
100%|##########| 30/30 [00:02<00:00,  9.40it/s]
100%|##########| 30/30 [00:02<00:00, 10.21it/s]
100%|##########| 30/30 [00:02<00:00, 10.21it/s]

 - quantizing extras
Text Encoder

tokenizer_config.json: 0.00B [00:00, ?B/s]
tokenizer_config.json: 0.00B [00:00, ?B/s]
tokenizer_config.json: 9.73kB [00:00, 15.7MB/s]
tokenizer_config.json: 9.73kB [00:00, 15.7MB/s]


vocab.json: 0.00B [00:00, ?B/s]
vocab.json: 0.00B [00:00, ?B/s]
vocab.json: 2.78MB [00:00, 184MB/s]
vocab.json: 2.78MB [00:00, 184MB/s]


merges.txt: 0.00B [00:00, ?B/s]
merges.txt: 0.00B [00:00, ?B/s]
merges.txt: 1.67MB [00:00, 229MB/s]
merges.txt: 1.67MB [00:00, 229MB/s]


tokenizer/tokenizer.json:   0%|          | 0.00/11.4M [00:00<?, ?B/s]
tokenizer/tokenizer.json:   0%|          | 0.00/11.4M [00:00<?, ?B/s]
tokenizer/tokenizer.json: 100%|##########| 11.4M/11.4M [00:00<00:00, 117MB/s]
tokenizer/tokenizer.json: 100%|##########| 11.4M/11.4M [00:00<00:00, 117MB/s]

`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

config.json:   0%|          | 0.00/726 [00:00<?, ?B/s]
config.json:   0%|          | 0.00/726 [00:00<?, ?B/s]
config.json: 100%|##########| 726/726 [00:00<00:00, 8.51MB/s]
config.json: 100%|##########| 726/726 [00:00<00:00, 8.51MB/s]


model.safetensors.index.json: 0.00B [00:00, ?B/s]
model.safetensors.index.json: 0.00B [00:00, ?B/s]
model.safetensors.index.json: 32.8kB [00:00, 200MB/s]
model.safetensors.index.json: 32.8kB [00:00, 200MB/s]


text_encoder/model-00001-of-00003.safete(…):   0%|          | 0.00/3.96G [00:00<?, ?B/s]
text_encoder/model-00001-of-00003.safete(…):   0%|          | 0.00/3.96G [00:00<?, ?B/s]
text_encoder/model-00001-of-00003.safete(…):   1%|1         | 40.2M/3.96G [00:00<01:13, 53.5MB/s]
text_encoder/model-00001-of-00003.safete(…):   1%|1         | 40.2M/3.96G [00:00<01:13, 53.5MB/s]
text_encoder/model-00001-of-00003.safete(…):   3%|3         | 135M/3.96G [00:00<00:20, 184MB/s]  
text_encoder/model-00001-of-00003.safete(…):   3%|3         | 135M/3.96G [00:00<00:20, 184MB/s]  
text_encoder/model-00001-of-00003.safete(…):   5%|5         | 202M/3.96G [00:01<00:14, 254MB/s]
text_encoder/model-00001-of-00003.safete(…):   5%|5         | 202M/3.96G [00:01<00:14, 254MB/s]
text_encoder/model-00001-of-00003.safete(…):   8%|8         | 336M/3.96G [00:01<00:10, 347MB/s]
text_encoder/model-00001-of-00003.safete(…):   8%|8         | 336M/3.96G [00:01<00:10, 347MB/s]
text_encoder/model-00001-of-00003.safete(…):  10%|#         | 403M/3.96G [00:01<00:09, 364MB/s]
text_encoder/model-00001-of-00003.safete(…):  10%|#         | 403M/3.96G [00:01<00:09, 364MB/s]
text_encoder/model-00001-of-00003.safete(…):  14%|#3        | 537M/3.96G [00:01<00:09, 347MB/s]
text_encoder/model-00001-of-00003.safete(…):  14%|#3        | 537M/3.96G [00:01<00:09, 347MB/s]
text_encoder/model-00001-of-00003.safete(…):  15%|#5        | 604M/3.96G [00:02<00:08, 373MB/s]
text_encoder/model-00001-of-00003.safete(…):  15%|#5        | 604M/3.96G [00:02<00:08, 373MB/s]
text_encoder/model-00001-of-00003.safete(…):  18%|#7        | 700M/3.96G [00:02<00:07, 409MB/s]
text_encoder/model-00001-of-00003.safete(…):  18%|#7        | 700M/3.96G [00:02<00:07, 409MB/s]
text_encoder/model-00001-of-00003.safete(…):  21%|##1       | 834M/3.96G [00:02<00:05, 524MB/s]
text_encoder/model-00001-of-00003.safete(…):  21%|##1       | 834M/3.96G [00:02<00:05, 524MB/s]
text_encoder/model-00001-of-00003.safete(…):  24%|##3       | 931M/3.96G [00:02<00:05, 552MB/s]
text_encoder/model-00001-of-00003.safete(…):  24%|##3       | 931M/3.96G [00:02<00:05, 552MB/s]
text_encoder/model-00001-of-00003.safete(…):  27%|##7       | 1.07G/3.96G [00:02<00:04, 666MB/s]
text_encoder/model-00001-of-00003.safete(…):  27%|##7       | 1.07G/3.96G [00:02<00:04, 666MB/s]
text_encoder/model-00001-of-00003.safete(…):  31%|###       | 1.21G/3.96G [00:02<00:03, 692MB/s]
text_encoder/model-00001-of-00003.safete(…):  31%|###       | 1.21G/3.96G [00:02<00:03, 692MB/s]
text_encoder/model-00001-of-00003.safete(…):  33%|###2      | 1.30G/3.96G [00:02<00:03, 698MB/s]
text_encoder/model-00001-of-00003.safete(…):  33%|###2      | 1.30G/3.96G [00:02<00:03, 698MB/s]
text_encoder/model-00001-of-00003.safete(…):  36%|###6      | 1.44G/3.96G [00:03<00:03, 822MB/s]
text_encoder/model-00001-of-00003.safete(…):  36%|###6      | 1.44G/3.96G [00:03<00:03, 822MB/s]
text_encoder/model-00001-of-00003.safete(…):  41%|####      | 1.61G/3.96G [00:03<00:02, 916MB/s]
text_encoder/model-00001-of-00003.safete(…):  41%|####      | 1.61G/3.96G [00:03<00:02, 916MB/s]
text_encoder/model-00001-of-00003.safete(…):  44%|####4     | 1.74G/3.96G [00:03<00:02, 900MB/s]
text_encoder/model-00001-of-00003.safete(…):  44%|####4     | 1.74G/3.96G [00:03<00:02, 900MB/s]
text_encoder/model-00001-of-00003.safete(…):  49%|####9     | 1.95G/3.96G [00:03<00:02, 933MB/s]
text_encoder/model-00001-of-00003.safete(…):  49%|####9     | 1.95G/3.96G [00:03<00:02, 933MB/s]
text_encoder/model-00001-of-00003.safete(…):  53%|#####2    | 2.08G/3.96G [00:03<00:02, 714MB/s]
text_encoder/model-00001-of-00003.safete(…):  53%|#####2    | 2.08G/3.96G [00:03<00:02, 714MB/s]
text_encoder/model-00001-of-00003.safete(…):  56%|#####5    | 2.21G/3.96G [00:03<00:02, 813MB/s]
text_encoder/model-00001-of-00003.safete(…):  56%|#####5    | 2.21G/3.96G [00:03<00:02, 813MB/s]
text_encoder/model-00001-of-00003.safete(…):  59%|#####9    | 2.35G/3.96G [00:04<00:01, 887MB/s]
text_encoder/model-00001-of-00003.safete(…):  59%|#####9    | 2.35G/3.96G [00:04<00:01, 887MB/s]
text_encoder/model-00001-of-00003.safete(…):  63%|######2   | 2.48G/3.96G [00:04<00:02, 726MB/s]
text_encoder/model-00001-of-00003.safete(…):  63%|######2   | 2.48G/3.96G [00:04<00:02, 726MB/s]
text_encoder/model-00001-of-00003.safete(…):  68%|######7   | 2.68G/3.96G [00:04<00:01, 919MB/s]
text_encoder/model-00001-of-00003.safete(…):  68%|######7   | 2.68G/3.96G [00:04<00:01, 919MB/s]
text_encoder/model-00001-of-00003.safete(…):  71%|#######1  | 2.82G/3.96G [00:04<00:01, 759MB/s]
text_encoder/model-00001-of-00003.safete(…):  71%|#######1  | 2.82G/3.96G [00:04<00:01, 759MB/s]
text_encoder/model-00001-of-00003.safete(…):  75%|#######4  | 2.95G/3.96G [00:05<00:01, 520MB/s]
text_encoder/model-00001-of-00003.safete(…):  75%|#######4  | 2.95G/3.96G [00:05<00:01, 520MB/s]
text_encoder/model-00001-of-00003.safete(…):  78%|#######7  | 3.09G/3.96G [00:05<00:01, 516MB/s]
text_encoder/model-00001-of-00003.safete(…):  78%|#######7  | 3.09G/3.96G [00:05<00:01, 516MB/s]
text_encoder/model-00001-of-00003.safete(…):  80%|#######9  | 3.15G/3.96G [00:05<00:01, 452MB/s]
text_encoder/model-00001-of-00003.safete(…):  80%|#######9  | 3.15G/3.96G [00:05<00:01, 452MB/s]
text_encoder/model-00001-of-00003.safete(…):  81%|########1 | 3.22G/3.96G [00:05<00:01, 409MB/s]
text_encoder/model-00001-of-00003.safete(…):  81%|########1 | 3.22G/3.96G [00:05<00:01, 409MB/s]
text_encoder/model-00001-of-00003.safete(…):  83%|########3 | 3.29G/3.96G [00:06<00:01, 374MB/s]
text_encoder/model-00001-of-00003.safete(…):  83%|########3 | 3.29G/3.96G [00:06<00:01, 374MB/s]
text_encoder/model-00001-of-00003.safete(…):  85%|########4 | 3.35G/3.96G [00:06<00:01, 350MB/s]
text_encoder/model-00001-of-00003.safete(…):  85%|########4 | 3.35G/3.96G [00:06<00:01, 350MB/s]
text_encoder/model-00001-of-00003.safete(…):  86%|########6 | 3.42G/3.96G [00:06<00:01, 329MB/s]
text_encoder/model-00001-of-00003.safete(…):  86%|########6 | 3.42G/3.96G [00:06<00:01, 329MB/s]
text_encoder/model-00001-of-00003.safete(…):  88%|########8 | 3.49G/3.96G [00:06<00:01, 315MB/s]
text_encoder/model-00001-of-00003.safete(…):  88%|########8 | 3.49G/3.96G [00:06<00:01, 315MB/s]
text_encoder/model-00001-of-00003.safete(…):  92%|#########1| 3.62G/3.96G [00:07<00:00, 349MB/s]
text_encoder/model-00001-of-00003.safete(…):  92%|#########1| 3.62G/3.96G [00:07<00:00, 349MB/s]
text_encoder/model-00001-of-00003.safete(…):  93%|#########3| 3.69G/3.96G [00:07<00:00, 331MB/s]
text_encoder/model-00001-of-00003.safete(…):  93%|#########3| 3.69G/3.96G [00:07<00:00, 331MB/s]
text_encoder/model-00001-of-00003.safete(…):  95%|#########4| 3.76G/3.96G [00:07<00:00, 319MB/s]
text_encoder/model-00001-of-00003.safete(…):  95%|#########4| 3.76G/3.96G [00:07<00:00, 319MB/s]
text_encoder/model-00001-of-00003.safete(…):  97%|#########6| 3.82G/3.96G [00:07<00:00, 312MB/s]
text_encoder/model-00001-of-00003.safete(…):  97%|#########6| 3.82G/3.96G [00:07<00:00, 312MB/s]
text_encoder/model-00001-of-00003.safete(…):  98%|#########8| 3.89G/3.96G [00:08<00:00, 305MB/s]
text_encoder/model-00001-of-00003.safete(…):  98%|#########8| 3.89G/3.96G [00:08<00:00, 305MB/s]
text_encoder/model-00001-of-00003.safete(…): 100%|##########| 3.96G/3.96G [00:08<00:00, 301MB/s]
text_encoder/model-00001-of-00003.safete(…): 100%|##########| 3.96G/3.96G [00:08<00:00, 301MB/s]
text_encoder/model-00001-of-00003.safete(…): 100%|##########| 3.96G/3.96G [00:08<00:00, 471MB/s]
text_encoder/model-00001-of-00003.safete(…): 100%|##########| 3.96G/3.96G [00:08<00:00, 471MB/s]


text_encoder/model-00002-of-00003.safete(…):   0%|          | 0.00/3.99G [00:00<?, ?B/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 0.00/3.99G [00:00<?, ?B/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 675k/3.99G [00:00<21:50, 3.04MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 675k/3.99G [00:00<21:50, 3.04MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 2.07M/3.99G [00:00<10:53, 6.10MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 2.07M/3.99G [00:00<10:53, 6.10MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 4.12M/3.99G [00:00<06:31, 10.2MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 4.12M/3.99G [00:00<06:31, 10.2MB/s]
text_encoder/model-00002-of-00003.safete(…):   3%|3         | 138M/3.99G [00:00<00:16, 240MB/s]  
text_encoder/model-00002-of-00003.safete(…):   3%|3         | 138M/3.99G [00:00<00:16, 240MB/s]  
text_encoder/model-00002-of-00003.safete(…):   5%|5         | 205M/3.99G [00:01<00:14, 261MB/s]
text_encoder/model-00002-of-00003.safete(…):   5%|5         | 205M/3.99G [00:01<00:14, 261MB/s]
text_encoder/model-00002-of-00003.safete(…):   7%|6         | 272M/3.99G [00:01<00:21, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):   7%|6         | 272M/3.99G [00:01<00:21, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):   9%|8         | 339M/3.99G [00:02<00:22, 159MB/s]
text_encoder/model-00002-of-00003.safete(…):   9%|8         | 339M/3.99G [00:02<00:22, 159MB/s]
text_encoder/model-00002-of-00003.safete(…):  10%|#         | 406M/3.99G [00:02<00:23, 154MB/s]
text_encoder/model-00002-of-00003.safete(…):  10%|#         | 406M/3.99G [00:02<00:23, 154MB/s]
text_encoder/model-00002-of-00003.safete(…):  12%|#1        | 474M/3.99G [00:03<00:23, 149MB/s]
text_encoder/model-00002-of-00003.safete(…):  12%|#1        | 474M/3.99G [00:03<00:23, 149MB/s]
text_encoder/model-00002-of-00003.safete(…):  14%|#3        | 541M/3.99G [00:03<00:23, 147MB/s]
text_encoder/model-00002-of-00003.safete(…):  14%|#3        | 541M/3.99G [00:03<00:23, 147MB/s]
text_encoder/model-00002-of-00003.safete(…):  15%|#5        | 608M/3.99G [00:04<00:23, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  15%|#5        | 608M/3.99G [00:04<00:23, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  17%|#6        | 675M/3.99G [00:04<00:22, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  17%|#6        | 675M/3.99G [00:04<00:22, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  19%|#8        | 742M/3.99G [00:04<00:22, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  19%|#8        | 742M/3.99G [00:04<00:22, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  20%|##        | 809M/3.99G [00:05<00:21, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  20%|##        | 809M/3.99G [00:05<00:21, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  22%|##1       | 876M/3.99G [00:05<00:21, 146MB/s]
text_encoder/model-00002-of-00003.safete(…):  22%|##1       | 876M/3.99G [00:05<00:21, 146MB/s]
text_encoder/model-00002-of-00003.safete(…):  24%|##3       | 943M/3.99G [00:06<00:21, 144MB/s]
text_encoder/model-00002-of-00003.safete(…):  24%|##3       | 943M/3.99G [00:06<00:21, 144MB/s]
text_encoder/model-00002-of-00003.safete(…):  25%|##5       | 1.01G/3.99G [00:06<00:20, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  25%|##5       | 1.01G/3.99G [00:06<00:20, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  27%|##6       | 1.08G/3.99G [00:07<00:20, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  27%|##6       | 1.08G/3.99G [00:07<00:20, 145MB/s]
text_encoder/model-00002-of-00003.safete(…):  29%|##8       | 1.14G/3.99G [00:07<00:19, 150MB/s]
text_encoder/model-00002-of-00003.safete(…):  29%|##8       | 1.14G/3.99G [00:07<00:19, 150MB/s]
text_encoder/model-00002-of-00003.safete(…):  30%|###       | 1.21G/3.99G [00:08<00:17, 158MB/s]
text_encoder/model-00002-of-00003.safete(…):  30%|###       | 1.21G/3.99G [00:08<00:17, 158MB/s]
text_encoder/model-00002-of-00003.safete(…):  32%|###2      | 1.28G/3.99G [00:08<00:16, 167MB/s]
text_encoder/model-00002-of-00003.safete(…):  32%|###2      | 1.28G/3.99G [00:08<00:16, 167MB/s]
text_encoder/model-00002-of-00003.safete(…):  34%|###3      | 1.34G/3.99G [00:08<00:15, 175MB/s]
text_encoder/model-00002-of-00003.safete(…):  34%|###3      | 1.34G/3.99G [00:08<00:15, 175MB/s]
text_encoder/model-00002-of-00003.safete(…):  35%|###5      | 1.41G/3.99G [00:09<00:14, 182MB/s]
text_encoder/model-00002-of-00003.safete(…):  35%|###5      | 1.41G/3.99G [00:09<00:14, 182MB/s]
text_encoder/model-00002-of-00003.safete(…):  37%|###7      | 1.48G/3.99G [00:09<00:13, 182MB/s]
text_encoder/model-00002-of-00003.safete(…):  37%|###7      | 1.48G/3.99G [00:09<00:13, 182MB/s]
text_encoder/model-00002-of-00003.safete(…):  39%|###8      | 1.55G/3.99G [00:09<00:13, 186MB/s]
text_encoder/model-00002-of-00003.safete(…):  39%|###8      | 1.55G/3.99G [00:09<00:13, 186MB/s]
text_encoder/model-00002-of-00003.safete(…):  40%|####      | 1.61G/3.99G [00:10<00:12, 185MB/s]
text_encoder/model-00002-of-00003.safete(…):  40%|####      | 1.61G/3.99G [00:10<00:12, 185MB/s]
text_encoder/model-00002-of-00003.safete(…):  42%|####2     | 1.68G/3.99G [00:10<00:12, 189MB/s]
text_encoder/model-00002-of-00003.safete(…):  42%|####2     | 1.68G/3.99G [00:10<00:12, 189MB/s]
text_encoder/model-00002-of-00003.safete(…):  44%|####3     | 1.75G/3.99G [00:10<00:11, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  44%|####3     | 1.75G/3.99G [00:10<00:11, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  46%|####5     | 1.81G/3.99G [00:11<00:11, 193MB/s]
text_encoder/model-00002-of-00003.safete(…):  46%|####5     | 1.81G/3.99G [00:11<00:11, 193MB/s]
text_encoder/model-00002-of-00003.safete(…):  47%|####7     | 1.88G/3.99G [00:11<00:10, 196MB/s]
text_encoder/model-00002-of-00003.safete(…):  47%|####7     | 1.88G/3.99G [00:11<00:10, 196MB/s]
text_encoder/model-00002-of-00003.safete(…):  49%|####8     | 1.95G/3.99G [00:11<00:10, 199MB/s]
text_encoder/model-00002-of-00003.safete(…):  49%|####8     | 1.95G/3.99G [00:11<00:10, 199MB/s]
text_encoder/model-00002-of-00003.safete(…):  51%|#####     | 2.02G/3.99G [00:12<00:09, 200MB/s]
text_encoder/model-00002-of-00003.safete(…):  51%|#####     | 2.02G/3.99G [00:12<00:09, 200MB/s]
text_encoder/model-00002-of-00003.safete(…):  52%|#####2    | 2.08G/3.99G [00:12<00:09, 200MB/s]
text_encoder/model-00002-of-00003.safete(…):  52%|#####2    | 2.08G/3.99G [00:12<00:09, 200MB/s]
text_encoder/model-00002-of-00003.safete(…):  54%|#####3    | 2.15G/3.99G [00:12<00:08, 205MB/s]
text_encoder/model-00002-of-00003.safete(…):  54%|#####3    | 2.15G/3.99G [00:12<00:08, 205MB/s]
text_encoder/model-00002-of-00003.safete(…):  56%|#####5    | 2.21G/3.99G [00:13<00:08, 206MB/s]
text_encoder/model-00002-of-00003.safete(…):  56%|#####5    | 2.21G/3.99G [00:13<00:08, 206MB/s]
text_encoder/model-00002-of-00003.safete(…):  57%|#####7    | 2.28G/3.99G [00:13<00:08, 203MB/s]
text_encoder/model-00002-of-00003.safete(…):  57%|#####7    | 2.28G/3.99G [00:13<00:08, 203MB/s]
text_encoder/model-00002-of-00003.safete(…):  59%|#####8    | 2.35G/3.99G [00:13<00:07, 205MB/s]
text_encoder/model-00002-of-00003.safete(…):  59%|#####8    | 2.35G/3.99G [00:13<00:07, 205MB/s]
text_encoder/model-00002-of-00003.safete(…):  61%|######    | 2.42G/3.99G [00:14<00:07, 207MB/s]
text_encoder/model-00002-of-00003.safete(…):  61%|######    | 2.42G/3.99G [00:14<00:07, 207MB/s]
text_encoder/model-00002-of-00003.safete(…):  62%|######2   | 2.48G/3.99G [00:14<00:07, 209MB/s]
text_encoder/model-00002-of-00003.safete(…):  62%|######2   | 2.48G/3.99G [00:14<00:07, 209MB/s]
text_encoder/model-00002-of-00003.safete(…):  64%|######3   | 2.55G/3.99G [00:14<00:07, 203MB/s]
text_encoder/model-00002-of-00003.safete(…):  64%|######3   | 2.55G/3.99G [00:14<00:07, 203MB/s]
text_encoder/model-00002-of-00003.safete(…):  66%|######5   | 2.62G/3.99G [00:15<00:06, 210MB/s]
text_encoder/model-00002-of-00003.safete(…):  66%|######5   | 2.62G/3.99G [00:15<00:06, 210MB/s]
text_encoder/model-00002-of-00003.safete(…):  67%|######7   | 2.68G/3.99G [00:15<00:06, 210MB/s]
text_encoder/model-00002-of-00003.safete(…):  67%|######7   | 2.68G/3.99G [00:15<00:06, 210MB/s]
text_encoder/model-00002-of-00003.safete(…):  69%|######8   | 2.75G/3.99G [00:15<00:06, 181MB/s]
text_encoder/model-00002-of-00003.safete(…):  69%|######8   | 2.75G/3.99G [00:15<00:06, 181MB/s]
text_encoder/model-00002-of-00003.safete(…):  71%|#######   | 2.82G/3.99G [00:16<00:06, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):  71%|#######   | 2.82G/3.99G [00:16<00:06, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):  72%|#######2  | 2.89G/3.99G [00:16<00:06, 182MB/s]
text_encoder/model-00002-of-00003.safete(…):  72%|#######2  | 2.89G/3.99G [00:16<00:06, 182MB/s]
text_encoder/model-00002-of-00003.safete(…):  74%|#######4  | 2.95G/3.99G [00:16<00:05, 187MB/s]
text_encoder/model-00002-of-00003.safete(…):  74%|#######4  | 2.95G/3.99G [00:16<00:05, 187MB/s]
text_encoder/model-00002-of-00003.safete(…):  76%|#######5  | 3.02G/3.99G [00:17<00:04, 196MB/s]
text_encoder/model-00002-of-00003.safete(…):  76%|#######5  | 3.02G/3.99G [00:17<00:04, 196MB/s]
text_encoder/model-00002-of-00003.safete(…):  77%|#######7  | 3.09G/3.99G [00:17<00:04, 209MB/s]
text_encoder/model-00002-of-00003.safete(…):  77%|#######7  | 3.09G/3.99G [00:17<00:04, 209MB/s]
text_encoder/model-00002-of-00003.safete(…):  78%|#######8  | 3.12G/3.99G [00:17<00:04, 193MB/s]
text_encoder/model-00002-of-00003.safete(…):  78%|#######8  | 3.12G/3.99G [00:17<00:04, 193MB/s]
text_encoder/model-00002-of-00003.safete(…):  80%|#######9  | 3.18G/3.99G [00:18<00:04, 179MB/s]
text_encoder/model-00002-of-00003.safete(…):  80%|#######9  | 3.18G/3.99G [00:18<00:04, 179MB/s]
text_encoder/model-00002-of-00003.safete(…):  83%|########3 | 3.32G/3.99G [00:18<00:02, 260MB/s]
text_encoder/model-00002-of-00003.safete(…):  83%|########3 | 3.32G/3.99G [00:18<00:02, 260MB/s]
text_encoder/model-00002-of-00003.safete(…):  85%|########4 | 3.38G/3.99G [00:18<00:02, 259MB/s]
text_encoder/model-00002-of-00003.safete(…):  85%|########4 | 3.38G/3.99G [00:18<00:02, 259MB/s]
text_encoder/model-00002-of-00003.safete(…):  87%|########6 | 3.45G/3.99G [00:18<00:02, 255MB/s]
text_encoder/model-00002-of-00003.safete(…):  87%|########6 | 3.45G/3.99G [00:18<00:02, 255MB/s]
text_encoder/model-00002-of-00003.safete(…):  88%|########8 | 3.52G/3.99G [00:19<00:01, 244MB/s]
text_encoder/model-00002-of-00003.safete(…):  88%|########8 | 3.52G/3.99G [00:19<00:01, 244MB/s]
text_encoder/model-00002-of-00003.safete(…):  92%|#########1| 3.65G/3.99G [00:19<00:01, 289MB/s]
text_encoder/model-00002-of-00003.safete(…):  92%|#########1| 3.65G/3.99G [00:19<00:01, 289MB/s]
text_encoder/model-00002-of-00003.safete(…):  93%|#########3| 3.72G/3.99G [00:19<00:00, 282MB/s]
text_encoder/model-00002-of-00003.safete(…):  93%|#########3| 3.72G/3.99G [00:19<00:00, 282MB/s]
text_encoder/model-00002-of-00003.safete(…):  95%|#########4| 3.79G/3.99G [00:20<00:00, 268MB/s]
text_encoder/model-00002-of-00003.safete(…):  95%|#########4| 3.79G/3.99G [00:20<00:00, 268MB/s]
text_encoder/model-00002-of-00003.safete(…):  97%|#########6| 3.85G/3.99G [00:20<00:00, 268MB/s]
text_encoder/model-00002-of-00003.safete(…):  97%|#########6| 3.85G/3.99G [00:20<00:00, 268MB/s]
text_encoder/model-00002-of-00003.safete(…):  98%|#########8| 3.92G/3.99G [00:20<00:00, 263MB/s]
text_encoder/model-00002-of-00003.safete(…):  98%|#########8| 3.92G/3.99G [00:20<00:00, 263MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:20<00:00, 260MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:20<00:00, 260MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:20<00:00, 190MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:20<00:00, 190MB/s]


text_encoder/model-00003-of-00003.safete(…):   0%|          | 0.00/99.6M [00:00<?, ?B/s]
text_encoder/model-00003-of-00003.safete(…):   0%|          | 0.00/99.6M [00:00<?, ?B/s]
text_encoder/model-00003-of-00003.safete(…):  38%|###7      | 37.6M/99.6M [00:00<00:00, 133MB/s]
text_encoder/model-00003-of-00003.safete(…):  38%|###7      | 37.6M/99.6M [00:00<00:00, 133MB/s]
text_encoder/model-00003-of-00003.safete(…):  58%|#####7    | 57.8M/99.6M [00:00<00:00, 144MB/s]
text_encoder/model-00003-of-00003.safete(…):  58%|#####7    | 57.8M/99.6M [00:00<00:00, 144MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 199MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 199MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 179MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 179MB/s]


Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:00<00:00, 72.55it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:00<00:00, 72.55it/s]


generation_config.json:   0%|          | 0.00/239 [00:00<?, ?B/s]
generation_config.json:   0%|          | 0.00/239 [00:00<?, ?B/s]
generation_config.json: 100%|##########| 239/239 [00:00<00:00, 2.78MB/s]
generation_config.json: 100%|##########| 239/239 [00:00<00:00, 2.78MB/s]

Quantizing Text Encoder
Loading VAE

config.json:   0%|          | 0.00/805 [00:00<?, ?B/s]
config.json:   0%|          | 0.00/805 [00:00<?, ?B/s]
config.json: 100%|##########| 805/805 [00:00<00:00, 7.29MB/s]
config.json: 100%|##########| 805/805 [00:00<00:00, 7.29MB/s]


vae/diffusion_pytorch_model.safetensors:   0%|          | 0.00/168M [00:00<?, ?B/s]
vae/diffusion_pytorch_model.safetensors:   0%|          | 0.00/168M [00:00<?, ?B/s]
vae/diffusion_pytorch_model.safetensors:  20%|#9        | 33.5M/168M [00:00<00:01, 82.9MB/s]
vae/diffusion_pytorch_model.safetensors:  20%|#9        | 33.5M/168M [00:00<00:01, 82.9MB/s]
vae/diffusion_pytorch_model.safetensors:  60%|#####9    | 101M/168M [00:00<00:00, 173MB/s]  
vae/diffusion_pytorch_model.safetensors:  60%|#####9    | 101M/168M [00:00<00:00, 173MB/s]  
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:00<00:00, 220MB/s]
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:00<00:00, 220MB/s]
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:00<00:00, 192MB/s]
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:00<00:00, 192MB/s]

Making pipe
Preparing Model
Model Loaded
create LoRA network. base dim (rank): 32, alpha: 32
neuron dropout: p=None, rank dropout: p=None, module dropout: p=None
apply LoRA to Conv2d with kernel size (3,3). dim (rank): 16, alpha: 16
create LoRA for Text Encoder: 0 modules.
create LoRA for U-Net: 240 modules.
enable LoRA for U-Net
Dataset: /data/app/datasets/windy_storm
  -  Preprocessing image dimensions

  0%|          | 0/40 [00:00<?, ?it/s]
  0%|          | 0/40 [00:00<?, ?it/s]
  8%|7         | 3/40 [00:00<00:01, 23.95it/s]
  8%|7         | 3/40 [00:00<00:01, 23.95it/s]
 15%|#5        | 6/40 [00:00<00:01, 26.70it/s]
 15%|#5        | 6/40 [00:00<00:01, 26.70it/s]
 22%|##2       | 9/40 [00:00<00:01, 27.43it/s]
 22%|##2       | 9/40 [00:00<00:01, 27.43it/s]
 30%|###       | 12/40 [00:00<00:00, 28.08it/s]
 30%|###       | 12/40 [00:00<00:00, 28.08it/s]
 38%|###7      | 15/40 [00:00<00:00, 27.87it/s]
 38%|###7      | 15/40 [00:00<00:00, 27.87it/s]
 45%|####5     | 18/40 [00:00<00:00, 27.28it/s]
 45%|####5     | 18/40 [00:00<00:00, 27.28it/s]
 52%|#####2    | 21/40 [00:00<00:00, 27.43it/s]
 52%|#####2    | 21/40 [00:00<00:00, 27.43it/s]
 60%|######    | 24/40 [00:00<00:00, 27.30it/s]
 60%|######    | 24/40 [00:00<00:00, 27.30it/s]
 68%|######7   | 27/40 [00:00<00:00, 27.64it/s]
 68%|######7   | 27/40 [00:00<00:00, 27.64it/s]
 75%|#######5  | 30/40 [00:01<00:00, 27.68it/s]
 75%|#######5  | 30/40 [00:01<00:00, 27.68it/s]
 82%|########2 | 33/40 [00:01<00:00, 27.34it/s]
 82%|########2 | 33/40 [00:01<00:00, 27.34it/s]
 90%|######### | 36/40 [00:01<00:00, 27.23it/s]
 90%|######### | 36/40 [00:01<00:00, 27.23it/s]
 98%|#########7| 39/40 [00:01<00:00, 27.18it/s]
 98%|#########7| 39/40 [00:01<00:00, 27.18it/s]
100%|##########| 40/40 [00:01<00:00, 27.28it/s]
100%|##########| 40/40 [00:01<00:00, 27.28it/s]

  -  Found 40 images
Bucket sizes for /data/app/datasets/windy_storm:
512x512: 40 files
1 buckets made
Dataset: /data/app/datasets/windy_storm
  -  Preprocessing image dimensions

  0%|          | 0/40 [00:00<?, ?it/s]
  0%|          | 0/40 [00:00<?, ?it/s]
100%|##########| 40/40 [00:00<00:00, 11029.66it/s]
100%|##########| 40/40 [00:00<00:00, 11029.66it/s]

  -  Found 40 images
Bucket sizes for /data/app/datasets/windy_storm:
768x768: 40 files
1 buckets made
Dataset: /data/app/datasets/windy_storm
  -  Preprocessing image dimensions

  0%|          | 0/40 [00:00<?, ?it/s]
  0%|          | 0/40 [00:00<?, ?it/s]
100%|##########| 40/40 [00:00<00:00, 34521.02it/s]
100%|##########| 40/40 [00:00<00:00, 34521.02it/s]

  -  Found 40 images
Bucket sizes for /data/app/datasets/windy_storm:
1024x1024: 40 files
1 buckets made
Generating baseline samples before training
Unloading assistant lora

Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:  17%|#6        | 1/6 [00:03<00:15,  3.09s/it]
Generating Images:  17%|#6        | 1/6 [00:03<00:15,  3.09s/it]
Generating Images:  33%|###3      | 2/6 [00:05<00:10,  2.71s/it]
Generating Images:  33%|###3      | 2/6 [00:05<00:10,  2.71s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.58s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.58s/it]
Generating Images:  67%|######6   | 4/6 [00:10<00:04,  2.49s/it]
Generating Images:  67%|######6   | 4/6 [00:10<00:04,  2.49s/it]
Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.44s/it]
Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.44s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.41s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.41s/it]
                                                                
                                                                

Loading assistant lora

windy_storm:   0%|          | 0/3000 [00:00<?, ?it/s]
windy_storm:   0%|          | 0/3000 [00:00<?, ?it/s]
windy_storm:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 5.115e-01]
windy_storm:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 5.115e-01]
windy_storm:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 5.115e-01]
windy_storm:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 5.115e-01]
windy_storm:   0%|          | 0/3000 [00:03<?, ?it/s, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:   0%|          | 0/3000 [00:03<?, ?it/s, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:   0%|          | 1/3000 [00:03<1:24:29,  1.69s/it, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:   0%|          | 1/3000 [00:03<1:24:29,  1.69s/it, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:   0%|          | 1/3000 [00:06<1:24:29,  1.69s/it, lr: 1.0e-04 loss: 4.632e-01]
windy_storm:   0%|          | 1/3000 [00:06<1:24:29,  1.69s/it, lr: 1.0e-04 loss: 4.632e-01]
windy_storm:   0%|          | 2/3000 [00:06<2:05:17,  2.51s/it, lr: 1.0e-04 loss: 4.632e-01]
windy_storm:   0%|          | 2/3000 [00:06<2:05:17,  2.51s/it, lr: 1.0e-04 loss: 4.632e-01]
windy_storm:   0%|          | 2/3000 [00:07<2:05:17,  2.51s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:   0%|          | 2/3000 [00:07<2:05:17,  2.51s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:   0%|          | 3/3000 [00:07<1:27:17,  1.75s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:   0%|          | 3/3000 [00:07<1:27:17,  1.75s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:   0%|          | 3/3000 [00:07<1:27:17,  1.75s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:   0%|          | 3/3000 [00:07<1:27:17,  1.75s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:   0%|          | 4/3000 [00:07<1:09:26,  1.39s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:   0%|          | 4/3000 [00:07<1:09:26,  1.39s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:   0%|          | 4/3000 [00:09<1:09:26,  1.39s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:   0%|          | 4/3000 [00:09<1:09:26,  1.39s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:   0%|          | 5/3000 [00:09<1:13:32,  1.47s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:   0%|          | 5/3000 [00:09<1:13:32,  1.47s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:   0%|          | 5/3000 [00:10<1:13:32,  1.47s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:   0%|          | 5/3000 [00:10<1:13:32,  1.47s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:   0%|          | 6/3000 [00:10<1:03:43,  1.28s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:   0%|          | 6/3000 [00:10<1:03:43,  1.28s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:   0%|          | 6/3000 [00:12<1:03:43,  1.28s/it, lr: 1.0e-04 loss: 3.654e-01]
windy_storm:   0%|          | 6/3000 [00:12<1:03:43,  1.28s/it, lr: 1.0e-04 loss: 3.654e-01]
windy_storm:   0%|          | 7/3000 [00:12<1:09:50,  1.40s/it, lr: 1.0e-04 loss: 3.654e-01]
windy_storm:   0%|          | 7/3000 [00:12<1:09:50,  1.40s/it, lr: 1.0e-04 loss: 3.654e-01]
windy_storm:   0%|          | 7/3000 [00:15<1:09:50,  1.40s/it, lr: 1.0e-04 loss: 1.198e-01]
windy_storm:   0%|          | 7/3000 [00:15<1:09:50,  1.40s/it, lr: 1.0e-04 loss: 1.198e-01]
windy_storm:   0%|          | 8/3000 [00:15<1:36:07,  1.93s/it, lr: 1.0e-04 loss: 1.198e-01]
windy_storm:   0%|          | 8/3000 [00:15<1:36:07,  1.93s/it, lr: 1.0e-04 loss: 1.198e-01]
windy_storm:   0%|          | 8/3000 [00:16<1:36:07,  1.93s/it, lr: 1.0e-04 loss: 6.213e-01]
windy_storm:   0%|          | 8/3000 [00:16<1:36:07,  1.93s/it, lr: 1.0e-04 loss: 6.213e-01]
windy_storm:   0%|          | 9/3000 [00:16<1:19:54,  1.60s/it, lr: 1.0e-04 loss: 6.213e-01]
windy_storm:   0%|          | 9/3000 [00:16<1:19:54,  1.60s/it, lr: 1.0e-04 loss: 6.213e-01]
windy_storm:   0%|          | 9/3000 [00:17<1:19:54,  1.60s/it, lr: 1.0e-04 loss: 6.282e-01]
windy_storm:   0%|          | 9/3000 [00:17<1:19:54,  1.60s/it, lr: 1.0e-04 loss: 6.282e-01]
windy_storm:   0%|          | 10/3000 [00:18<1:19:53,  1.60s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:   0%|          | 10/3000 [00:18<1:19:53,  1.60s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:   0%|          | 11/3000 [00:18<52:48,  1.06s/it, lr: 1.0e-04 loss: 6.241e-01]  
windy_storm:   0%|          | 11/3000 [00:18<52:48,  1.06s/it, lr: 1.0e-04 loss: 6.241e-01]  
windy_storm:   0%|          | 11/3000 [00:21<52:48,  1.06s/it, lr: 1.0e-04 loss: 3.968e-01]
windy_storm:   0%|          | 11/3000 [00:21<52:48,  1.06s/it, lr: 1.0e-04 loss: 3.968e-01]
windy_storm:   0%|          | 12/3000 [00:21<1:16:45,  1.54s/it, lr: 1.0e-04 loss: 3.968e-01]
windy_storm:   0%|          | 12/3000 [00:21<1:16:45,  1.54s/it, lr: 1.0e-04 loss: 3.968e-01]
windy_storm:   0%|          | 12/3000 [00:23<1:16:45,  1.54s/it, lr: 1.0e-04 loss: 5.079e-01]
windy_storm:   0%|          | 12/3000 [00:23<1:16:45,  1.54s/it, lr: 1.0e-04 loss: 5.079e-01]
windy_storm:   0%|          | 13/3000 [00:23<1:18:41,  1.58s/it, lr: 1.0e-04 loss: 5.079e-01]
windy_storm:   0%|          | 13/3000 [00:23<1:18:41,  1.58s/it, lr: 1.0e-04 loss: 5.079e-01]
windy_storm:   0%|          | 13/3000 [00:24<1:18:41,  1.58s/it, lr: 1.0e-04 loss: 7.056e-01]
windy_storm:   0%|          | 13/3000 [00:24<1:18:41,  1.58s/it, lr: 1.0e-04 loss: 7.056e-01]
windy_storm:   0%|          | 14/3000 [00:24<1:18:32,  1.58s/it, lr: 1.0e-04 loss: 7.056e-01]
windy_storm:   0%|          | 14/3000 [00:24<1:18:32,  1.58s/it, lr: 1.0e-04 loss: 7.056e-01]
windy_storm:   0%|          | 14/3000 [00:25<1:18:32,  1.58s/it, lr: 1.0e-04 loss: 6.214e-01]
windy_storm:   0%|          | 14/3000 [00:25<1:18:32,  1.58s/it, lr: 1.0e-04 loss: 6.214e-01]
windy_storm:   0%|          | 15/3000 [00:25<1:07:36,  1.36s/it, lr: 1.0e-04 loss: 6.214e-01]
windy_storm:   0%|          | 15/3000 [00:25<1:07:36,  1.36s/it, lr: 1.0e-04 loss: 6.214e-01]
windy_storm:   0%|          | 15/3000 [00:28<1:07:36,  1.36s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:   0%|          | 15/3000 [00:28<1:07:36,  1.36s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:   1%|          | 16/3000 [00:28<1:30:19,  1.82s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:   1%|          | 16/3000 [00:28<1:30:19,  1.82s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:   1%|          | 16/3000 [00:30<1:30:19,  1.82s/it, lr: 1.0e-04 loss: 7.210e-01]
windy_storm:   1%|          | 16/3000 [00:30<1:30:19,  1.82s/it, lr: 1.0e-04 loss: 7.210e-01]
windy_storm:   1%|          | 17/3000 [00:30<1:26:34,  1.74s/it, lr: 1.0e-04 loss: 7.210e-01]
windy_storm:   1%|          | 17/3000 [00:30<1:26:34,  1.74s/it, lr: 1.0e-04 loss: 7.210e-01]
windy_storm:   1%|          | 17/3000 [00:31<1:26:34,  1.74s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:   1%|          | 17/3000 [00:31<1:26:34,  1.74s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:   1%|          | 18/3000 [00:31<1:23:23,  1.68s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:   1%|          | 18/3000 [00:31<1:23:23,  1.68s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:   1%|          | 18/3000 [00:33<1:23:23,  1.68s/it, lr: 1.0e-04 loss: 4.498e-01]
windy_storm:   1%|          | 18/3000 [00:33<1:23:23,  1.68s/it, lr: 1.0e-04 loss: 4.498e-01]
windy_storm:   1%|          | 19/3000 [00:33<1:21:34,  1.64s/it, lr: 1.0e-04 loss: 4.498e-01]
windy_storm:   1%|          | 19/3000 [00:33<1:21:34,  1.64s/it, lr: 1.0e-04 loss: 4.498e-01]
windy_storm:   1%|          | 19/3000 [00:34<1:21:34,  1.64s/it, lr: 1.0e-04 loss: 6.299e-01]
windy_storm:   1%|          | 19/3000 [00:34<1:21:34,  1.64s/it, lr: 1.0e-04 loss: 6.299e-01]
windy_storm:   1%|          | 20/3000 [00:37<1:21:32,  1.64s/it, lr: 1.0e-04 loss: 3.983e-01]
windy_storm:   1%|          | 20/3000 [00:37<1:21:32,  1.64s/it, lr: 1.0e-04 loss: 3.983e-01]
windy_storm:   1%|          | 21/3000 [00:37<1:17:59,  1.57s/it, lr: 1.0e-04 loss: 3.983e-01]
windy_storm:   1%|          | 21/3000 [00:37<1:17:59,  1.57s/it, lr: 1.0e-04 loss: 3.983e-01]
windy_storm:   1%|          | 21/3000 [00:40<1:17:59,  1.57s/it, lr: 1.0e-04 loss: 6.924e-01]
windy_storm:   1%|          | 21/3000 [00:40<1:17:59,  1.57s/it, lr: 1.0e-04 loss: 6.924e-01]
windy_storm:   1%|          | 22/3000 [00:40<1:34:03,  1.90s/it, lr: 1.0e-04 loss: 6.924e-01]
windy_storm:   1%|          | 22/3000 [00:40<1:34:03,  1.90s/it, lr: 1.0e-04 loss: 6.924e-01]
windy_storm:   1%|          | 22/3000 [00:42<1:34:03,  1.90s/it, lr: 1.0e-04 loss: 6.454e-01]
windy_storm:   1%|          | 22/3000 [00:42<1:34:03,  1.90s/it, lr: 1.0e-04 loss: 6.454e-01]
windy_storm:   1%|          | 23/3000 [00:42<1:29:51,  1.81s/it, lr: 1.0e-04 loss: 6.454e-01]
windy_storm:   1%|          | 23/3000 [00:42<1:29:51,  1.81s/it, lr: 1.0e-04 loss: 6.454e-01]
windy_storm:   1%|          | 23/3000 [00:42<1:29:51,  1.81s/it, lr: 1.0e-04 loss: 6.440e-01]
windy_storm:   1%|          | 23/3000 [00:42<1:29:51,  1.81s/it, lr: 1.0e-04 loss: 6.440e-01]
windy_storm:   1%|          | 24/3000 [00:42<1:16:20,  1.54s/it, lr: 1.0e-04 loss: 6.440e-01]
windy_storm:   1%|          | 24/3000 [00:42<1:16:20,  1.54s/it, lr: 1.0e-04 loss: 6.440e-01]
windy_storm:   1%|          | 24/3000 [00:45<1:16:20,  1.54s/it, lr: 1.0e-04 loss: 4.079e-01]
windy_storm:   1%|          | 24/3000 [00:45<1:16:20,  1.54s/it, lr: 1.0e-04 loss: 4.079e-01]
windy_storm:   1%|          | 25/3000 [00:45<1:36:12,  1.94s/it, lr: 1.0e-04 loss: 4.079e-01]
windy_storm:   1%|          | 25/3000 [00:45<1:36:12,  1.94s/it, lr: 1.0e-04 loss: 4.079e-01]
windy_storm:   1%|          | 25/3000 [00:48<1:36:12,  1.94s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:   1%|          | 25/3000 [00:48<1:36:12,  1.94s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:   1%|          | 26/3000 [00:48<1:50:02,  2.22s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:   1%|          | 26/3000 [00:48<1:50:02,  2.22s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:   1%|          | 26/3000 [00:51<1:50:02,  2.22s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:   1%|          | 26/3000 [00:51<1:50:02,  2.22s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:   1%|          | 27/3000 [00:51<2:02:15,  2.47s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:   1%|          | 27/3000 [00:51<2:02:15,  2.47s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:   1%|          | 27/3000 [00:52<2:02:15,  2.47s/it, lr: 1.0e-04 loss: 5.673e-01]
windy_storm:   1%|          | 27/3000 [00:52<2:02:15,  2.47s/it, lr: 1.0e-04 loss: 5.673e-01]
windy_storm:   1%|          | 28/3000 [00:52<1:38:13,  1.98s/it, lr: 1.0e-04 loss: 5.673e-01]
windy_storm:   1%|          | 28/3000 [00:52<1:38:13,  1.98s/it, lr: 1.0e-04 loss: 5.673e-01]
windy_storm:   1%|          | 28/3000 [00:53<1:38:13,  1.98s/it, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   1%|          | 28/3000 [00:53<1:38:13,  1.98s/it, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   1%|          | 29/3000 [00:53<1:21:03,  1.64s/it, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   1%|          | 29/3000 [00:53<1:21:03,  1.64s/it, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   1%|          | 29/3000 [00:56<1:21:03,  1.64s/it, lr: 1.0e-04 loss: 1.512e-01]
windy_storm:   1%|          | 29/3000 [00:56<1:21:03,  1.64s/it, lr: 1.0e-04 loss: 1.512e-01]
windy_storm:   1%|1         | 30/3000 [00:58<1:21:02,  1.64s/it, lr: 1.0e-04 loss: 6.415e-01]
windy_storm:   1%|1         | 30/3000 [00:58<1:21:02,  1.64s/it, lr: 1.0e-04 loss: 6.415e-01]
windy_storm:   1%|1         | 31/3000 [00:58<1:01:39,  1.25s/it, lr: 1.0e-04 loss: 6.415e-01]
windy_storm:   1%|1         | 31/3000 [00:58<1:01:39,  1.25s/it, lr: 1.0e-04 loss: 6.415e-01]
windy_storm:   1%|1         | 31/3000 [00:58<1:01:39,  1.25s/it, lr: 1.0e-04 loss: 4.019e-01]
windy_storm:   1%|1         | 31/3000 [00:58<1:01:39,  1.25s/it, lr: 1.0e-04 loss: 4.019e-01]
windy_storm:   1%|1         | 32/3000 [00:58<56:19,  1.14s/it, lr: 1.0e-04 loss: 4.019e-01]  
windy_storm:   1%|1         | 32/3000 [00:58<56:19,  1.14s/it, lr: 1.0e-04 loss: 4.019e-01]  
windy_storm:   1%|1         | 32/3000 [01:01<56:19,  1.14s/it, lr: 1.0e-04 loss: 2.428e-01]
windy_storm:   1%|1         | 32/3000 [01:01<56:19,  1.14s/it, lr: 1.0e-04 loss: 2.428e-01]
windy_storm:   1%|1         | 33/3000 [01:01<1:19:07,  1.60s/it, lr: 1.0e-04 loss: 2.428e-01]
windy_storm:   1%|1         | 33/3000 [01:01<1:19:07,  1.60s/it, lr: 1.0e-04 loss: 2.428e-01]
windy_storm:   1%|1         | 33/3000 [01:03<1:19:07,  1.60s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:   1%|1         | 33/3000 [01:03<1:19:07,  1.60s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:   1%|1         | 34/3000 [01:03<1:17:49,  1.57s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:   1%|1         | 34/3000 [01:03<1:17:49,  1.57s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:   1%|1         | 34/3000 [01:04<1:17:49,  1.57s/it, lr: 1.0e-04 loss: 5.402e-01]
windy_storm:   1%|1         | 34/3000 [01:04<1:17:49,  1.57s/it, lr: 1.0e-04 loss: 5.402e-01]
windy_storm:   1%|1         | 35/3000 [01:04<1:07:15,  1.36s/it, lr: 1.0e-04 loss: 5.402e-01]
windy_storm:   1%|1         | 35/3000 [01:04<1:07:15,  1.36s/it, lr: 1.0e-04 loss: 5.402e-01]
windy_storm:   1%|1         | 35/3000 [01:05<1:07:15,  1.36s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   1%|1         | 35/3000 [01:05<1:07:15,  1.36s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   1%|1         | 36/3000 [01:05<1:10:11,  1.42s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   1%|1         | 36/3000 [01:05<1:10:11,  1.42s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   1%|1         | 36/3000 [01:07<1:10:11,  1.42s/it, lr: 1.0e-04 loss: 1.511e-01]
windy_storm:   1%|1         | 36/3000 [01:07<1:10:11,  1.42s/it, lr: 1.0e-04 loss: 1.511e-01]
windy_storm:   1%|1         | 37/3000 [01:07<1:12:33,  1.47s/it, lr: 1.0e-04 loss: 1.511e-01]
windy_storm:   1%|1         | 37/3000 [01:07<1:12:33,  1.47s/it, lr: 1.0e-04 loss: 1.511e-01]
windy_storm:   1%|1         | 37/3000 [01:10<1:12:33,  1.47s/it, lr: 1.0e-04 loss: 1.390e-01]
windy_storm:   1%|1         | 37/3000 [01:10<1:12:33,  1.47s/it, lr: 1.0e-04 loss: 1.390e-01]
windy_storm:   1%|1         | 38/3000 [01:10<1:34:27,  1.91s/it, lr: 1.0e-04 loss: 1.390e-01]
windy_storm:   1%|1         | 38/3000 [01:10<1:34:27,  1.91s/it, lr: 1.0e-04 loss: 1.390e-01]
windy_storm:   1%|1         | 38/3000 [01:13<1:34:27,  1.91s/it, lr: 1.0e-04 loss: 5.933e-01]
windy_storm:   1%|1         | 38/3000 [01:13<1:34:27,  1.91s/it, lr: 1.0e-04 loss: 5.933e-01]
windy_storm:   1%|1         | 39/3000 [01:13<1:50:07,  2.23s/it, lr: 1.0e-04 loss: 5.933e-01]
windy_storm:   1%|1         | 39/3000 [01:13<1:50:07,  2.23s/it, lr: 1.0e-04 loss: 5.933e-01]
windy_storm:   1%|1         | 39/3000 [01:16<1:50:07,  2.23s/it, lr: 1.0e-04 loss: 9.060e-02]
windy_storm:   1%|1         | 39/3000 [01:16<1:50:07,  2.23s/it, lr: 1.0e-04 loss: 9.060e-02]
windy_storm:   1%|1         | 40/3000 [01:17<1:50:05,  2.23s/it, lr: 1.0e-04 loss: 6.535e-01]
windy_storm:   1%|1         | 40/3000 [01:17<1:50:05,  2.23s/it, lr: 1.0e-04 loss: 6.535e-01]
windy_storm:   1%|1         | 41/3000 [01:18<1:19:09,  1.60s/it, lr: 1.0e-04 loss: 6.535e-01]
windy_storm:   1%|1         | 41/3000 [01:18<1:19:09,  1.60s/it, lr: 1.0e-04 loss: 6.535e-01]
windy_storm:   1%|1         | 41/3000 [01:19<1:19:09,  1.60s/it, lr: 1.0e-04 loss: 4.355e-01]
windy_storm:   1%|1         | 41/3000 [01:19<1:19:09,  1.60s/it, lr: 1.0e-04 loss: 4.355e-01]
windy_storm:   1%|1         | 42/3000 [01:19<1:18:46,  1.60s/it, lr: 1.0e-04 loss: 4.355e-01]
windy_storm:   1%|1         | 42/3000 [01:19<1:18:46,  1.60s/it, lr: 1.0e-04 loss: 4.355e-01]
windy_storm:   1%|1         | 42/3000 [01:22<1:18:46,  1.60s/it, lr: 1.0e-04 loss: 4.577e-01]
windy_storm:   1%|1         | 42/3000 [01:22<1:18:46,  1.60s/it, lr: 1.0e-04 loss: 4.577e-01]
windy_storm:   1%|1         | 43/3000 [01:22<1:36:47,  1.96s/it, lr: 1.0e-04 loss: 4.577e-01]
windy_storm:   1%|1         | 43/3000 [01:22<1:36:47,  1.96s/it, lr: 1.0e-04 loss: 4.577e-01]
windy_storm:   1%|1         | 43/3000 [01:24<1:36:47,  1.96s/it, lr: 1.0e-04 loss: 2.846e-01]
windy_storm:   1%|1         | 43/3000 [01:24<1:36:47,  1.96s/it, lr: 1.0e-04 loss: 2.846e-01]
windy_storm:   1%|1         | 44/3000 [01:24<1:31:40,  1.86s/it, lr: 1.0e-04 loss: 2.846e-01]
windy_storm:   1%|1         | 44/3000 [01:24<1:31:40,  1.86s/it, lr: 1.0e-04 loss: 2.846e-01]
windy_storm:   1%|1         | 44/3000 [01:27<1:31:40,  1.86s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:   1%|1         | 44/3000 [01:27<1:31:40,  1.86s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:   2%|1         | 45/3000 [01:27<1:47:23,  2.18s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:   2%|1         | 45/3000 [01:27<1:47:23,  2.18s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:   2%|1         | 45/3000 [01:30<1:47:23,  2.18s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:   2%|1         | 45/3000 [01:30<1:47:23,  2.18s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:   2%|1         | 46/3000 [01:30<1:57:56,  2.40s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:   2%|1         | 46/3000 [01:30<1:57:56,  2.40s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:   2%|1         | 46/3000 [01:31<1:57:56,  2.40s/it, lr: 1.0e-04 loss: 5.198e-01]
windy_storm:   2%|1         | 46/3000 [01:31<1:57:56,  2.40s/it, lr: 1.0e-04 loss: 5.198e-01]
windy_storm:   2%|1         | 47/3000 [01:31<1:46:20,  2.16s/it, lr: 1.0e-04 loss: 5.198e-01]
windy_storm:   2%|1         | 47/3000 [01:31<1:46:20,  2.16s/it, lr: 1.0e-04 loss: 5.198e-01]
windy_storm:   2%|1         | 47/3000 [01:32<1:46:20,  2.16s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:   2%|1         | 47/3000 [01:32<1:46:20,  2.16s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:   2%|1         | 48/3000 [01:32<1:27:14,  1.77s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:   2%|1         | 48/3000 [01:32<1:27:14,  1.77s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:   2%|1         | 48/3000 [01:33<1:27:14,  1.77s/it, lr: 1.0e-04 loss: 2.702e-01]
windy_storm:   2%|1         | 48/3000 [01:33<1:27:14,  1.77s/it, lr: 1.0e-04 loss: 2.702e-01]
windy_storm:   2%|1         | 49/3000 [01:33<1:12:15,  1.47s/it, lr: 1.0e-04 loss: 2.702e-01]
windy_storm:   2%|1         | 49/3000 [01:33<1:12:15,  1.47s/it, lr: 1.0e-04 loss: 2.702e-01]
windy_storm:   2%|1         | 49/3000 [01:36<1:12:15,  1.47s/it, lr: 1.0e-04 loss: 4.339e-01]
windy_storm:   2%|1         | 49/3000 [01:36<1:12:15,  1.47s/it, lr: 1.0e-04 loss: 4.339e-01]
windy_storm:   2%|1         | 50/3000 [01:36<1:12:14,  1.47s/it, lr: 1.0e-04 loss: 4.836e-01]
windy_storm:   2%|1         | 50/3000 [01:36<1:12:14,  1.47s/it, lr: 1.0e-04 loss: 4.836e-01]
windy_storm:   2%|1         | 51/3000 [01:36<47:51,  1.03it/s, lr: 1.0e-04 loss: 4.836e-01]  
windy_storm:   2%|1         | 51/3000 [01:36<47:51,  1.03it/s, lr: 1.0e-04 loss: 4.836e-01]  
windy_storm:   2%|1         | 51/3000 [01:37<47:51,  1.03it/s, lr: 1.0e-04 loss: 1.964e-01]
windy_storm:   2%|1         | 51/3000 [01:37<47:51,  1.03it/s, lr: 1.0e-04 loss: 1.964e-01]
windy_storm:   2%|1         | 52/3000 [01:37<45:22,  1.08it/s, lr: 1.0e-04 loss: 1.964e-01]
windy_storm:   2%|1         | 52/3000 [01:37<45:22,  1.08it/s, lr: 1.0e-04 loss: 1.964e-01]
windy_storm:   2%|1         | 52/3000 [01:40<45:22,  1.08it/s, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:   2%|1         | 52/3000 [01:40<45:22,  1.08it/s, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:   2%|1         | 53/3000 [01:40<1:11:06,  1.45s/it, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:   2%|1         | 53/3000 [01:40<1:11:06,  1.45s/it, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:   2%|1         | 53/3000 [01:41<1:11:06,  1.45s/it, lr: 1.0e-04 loss: 6.353e-01]
windy_storm:   2%|1         | 53/3000 [01:41<1:11:06,  1.45s/it, lr: 1.0e-04 loss: 6.353e-01]
windy_storm:   2%|1         | 54/3000 [01:41<1:05:58,  1.34s/it, lr: 1.0e-04 loss: 6.353e-01]
windy_storm:   2%|1         | 54/3000 [01:41<1:05:58,  1.34s/it, lr: 1.0e-04 loss: 6.353e-01]
windy_storm:   2%|1         | 54/3000 [01:42<1:05:58,  1.34s/it, lr: 1.0e-04 loss: 5.711e-01]
windy_storm:   2%|1         | 54/3000 [01:42<1:05:58,  1.34s/it, lr: 1.0e-04 loss: 5.711e-01]
windy_storm:   2%|1         | 55/3000 [01:42<58:45,  1.20s/it, lr: 1.0e-04 loss: 5.711e-01]  
windy_storm:   2%|1         | 55/3000 [01:42<58:45,  1.20s/it, lr: 1.0e-04 loss: 5.711e-01]  
windy_storm:   2%|1         | 55/3000 [01:43<58:45,  1.20s/it, lr: 1.0e-04 loss: 2.323e-01]
windy_storm:   2%|1         | 55/3000 [01:43<58:45,  1.20s/it, lr: 1.0e-04 loss: 2.323e-01]
windy_storm:   2%|1         | 56/3000 [01:43<52:39,  1.07s/it, lr: 1.0e-04 loss: 2.323e-01]
windy_storm:   2%|1         | 56/3000 [01:43<52:39,  1.07s/it, lr: 1.0e-04 loss: 2.323e-01]
windy_storm:   2%|1         | 56/3000 [01:46<52:39,  1.07s/it, lr: 1.0e-04 loss: 5.372e-01]
windy_storm:   2%|1         | 56/3000 [01:46<52:39,  1.07s/it, lr: 1.0e-04 loss: 5.372e-01]
windy_storm:   2%|1         | 57/3000 [01:46<1:20:00,  1.63s/it, lr: 1.0e-04 loss: 5.372e-01]
windy_storm:   2%|1         | 57/3000 [01:46<1:20:00,  1.63s/it, lr: 1.0e-04 loss: 5.372e-01]
windy_storm:   2%|1         | 57/3000 [01:47<1:20:00,  1.63s/it, lr: 1.0e-04 loss: 6.339e-01]
windy_storm:   2%|1         | 57/3000 [01:47<1:20:00,  1.63s/it, lr: 1.0e-04 loss: 6.339e-01]
windy_storm:   2%|1         | 58/3000 [01:47<1:19:21,  1.62s/it, lr: 1.0e-04 loss: 6.339e-01]
windy_storm:   2%|1         | 58/3000 [01:47<1:19:21,  1.62s/it, lr: 1.0e-04 loss: 6.339e-01]
windy_storm:   2%|1         | 58/3000 [01:50<1:19:21,  1.62s/it, lr: 1.0e-04 loss: 1.150e-01]
windy_storm:   2%|1         | 58/3000 [01:50<1:19:21,  1.62s/it, lr: 1.0e-04 loss: 1.150e-01]
windy_storm:   2%|1         | 59/3000 [01:50<1:37:57,  2.00s/it, lr: 1.0e-04 loss: 1.150e-01]
windy_storm:   2%|1         | 59/3000 [01:50<1:37:57,  2.00s/it, lr: 1.0e-04 loss: 1.150e-01]
windy_storm:   2%|1         | 59/3000 [01:51<1:37:57,  2.00s/it, lr: 1.0e-04 loss: 4.632e-01]
windy_storm:   2%|1         | 59/3000 [01:51<1:37:57,  2.00s/it, lr: 1.0e-04 loss: 4.632e-01]
windy_storm:   2%|2         | 60/3000 [01:54<1:37:55,  2.00s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:   2%|2         | 60/3000 [01:54<1:37:55,  2.00s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:   2%|2         | 61/3000 [01:54<1:26:40,  1.77s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:   2%|2         | 61/3000 [01:54<1:26:40,  1.77s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:   2%|2         | 61/3000 [01:55<1:26:40,  1.77s/it, lr: 1.0e-04 loss: 6.967e-01]
windy_storm:   2%|2         | 61/3000 [01:55<1:26:40,  1.77s/it, lr: 1.0e-04 loss: 6.967e-01]
windy_storm:   2%|2         | 62/3000 [01:55<1:15:09,  1.53s/it, lr: 1.0e-04 loss: 6.967e-01]
windy_storm:   2%|2         | 62/3000 [01:55<1:15:09,  1.53s/it, lr: 1.0e-04 loss: 6.967e-01]
windy_storm:   2%|2         | 62/3000 [01:57<1:15:09,  1.53s/it, lr: 1.0e-04 loss: 9.120e-02]
windy_storm:   2%|2         | 62/3000 [01:57<1:15:09,  1.53s/it, lr: 1.0e-04 loss: 9.120e-02]
windy_storm:   2%|2         | 63/3000 [01:57<1:15:35,  1.54s/it, lr: 1.0e-04 loss: 9.120e-02]
windy_storm:   2%|2         | 63/3000 [01:57<1:15:35,  1.54s/it, lr: 1.0e-04 loss: 9.120e-02]
windy_storm:   2%|2         | 63/3000 [01:59<1:15:35,  1.54s/it, lr: 1.0e-04 loss: 5.849e-01]
windy_storm:   2%|2         | 63/3000 [01:59<1:15:35,  1.54s/it, lr: 1.0e-04 loss: 5.849e-01]
windy_storm:   2%|2         | 64/3000 [01:59<1:34:01,  1.92s/it, lr: 1.0e-04 loss: 5.849e-01]
windy_storm:   2%|2         | 64/3000 [01:59<1:34:01,  1.92s/it, lr: 1.0e-04 loss: 5.849e-01]
windy_storm:   2%|2         | 64/3000 [02:01<1:34:01,  1.92s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:   2%|2         | 64/3000 [02:01<1:34:01,  1.92s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:   2%|2         | 65/3000 [02:01<1:29:14,  1.82s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:   2%|2         | 65/3000 [02:01<1:29:14,  1.82s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:   2%|2         | 65/3000 [02:02<1:29:14,  1.82s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:   2%|2         | 65/3000 [02:02<1:29:14,  1.82s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:   2%|2         | 66/3000 [02:02<1:14:14,  1.52s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:   2%|2         | 66/3000 [02:02<1:14:14,  1.52s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:   2%|2         | 66/3000 [02:03<1:14:14,  1.52s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:   2%|2         | 66/3000 [02:03<1:14:14,  1.52s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:   2%|2         | 67/3000 [02:03<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:   2%|2         | 67/3000 [02:03<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:   2%|2         | 67/3000 [02:06<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:   2%|2         | 67/3000 [02:06<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:   2%|2         | 68/3000 [02:06<1:29:12,  1.83s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:   2%|2         | 68/3000 [02:06<1:29:12,  1.83s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:   2%|2         | 68/3000 [02:06<1:29:12,  1.83s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:   2%|2         | 68/3000 [02:06<1:29:12,  1.83s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:   2%|2         | 69/3000 [02:06<1:13:51,  1.51s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:   2%|2         | 69/3000 [02:06<1:13:51,  1.51s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:   2%|2         | 69/3000 [02:08<1:13:51,  1.51s/it, lr: 1.0e-04 loss: 2.629e-01]
windy_storm:   2%|2         | 69/3000 [02:08<1:13:51,  1.51s/it, lr: 1.0e-04 loss: 2.629e-01]
windy_storm:   2%|2         | 70/3000 [02:09<1:13:50,  1.51s/it, lr: 1.0e-04 loss: 2.507e-01]
windy_storm:   2%|2         | 70/3000 [02:09<1:13:50,  1.51s/it, lr: 1.0e-04 loss: 2.507e-01]
windy_storm:   2%|2         | 71/3000 [02:09<49:09,  1.01s/it, lr: 1.0e-04 loss: 2.507e-01]  
windy_storm:   2%|2         | 71/3000 [02:09<49:09,  1.01s/it, lr: 1.0e-04 loss: 2.507e-01]  
windy_storm:   2%|2         | 71/3000 [02:10<49:09,  1.01s/it, lr: 1.0e-04 loss: 3.304e-01]
windy_storm:   2%|2         | 71/3000 [02:10<49:09,  1.01s/it, lr: 1.0e-04 loss: 3.304e-01]
windy_storm:   2%|2         | 72/3000 [02:10<55:06,  1.13s/it, lr: 1.0e-04 loss: 3.304e-01]
windy_storm:   2%|2         | 72/3000 [02:10<55:06,  1.13s/it, lr: 1.0e-04 loss: 3.304e-01]
windy_storm:   2%|2         | 72/3000 [02:12<55:06,  1.13s/it, lr: 1.0e-04 loss: 5.618e-01]
windy_storm:   2%|2         | 72/3000 [02:12<55:06,  1.13s/it, lr: 1.0e-04 loss: 5.618e-01]
windy_storm:   2%|2         | 73/3000 [02:12<1:00:52,  1.25s/it, lr: 1.0e-04 loss: 5.618e-01]
windy_storm:   2%|2         | 73/3000 [02:12<1:00:52,  1.25s/it, lr: 1.0e-04 loss: 5.618e-01]
windy_storm:   2%|2         | 73/3000 [02:15<1:00:52,  1.25s/it, lr: 1.0e-04 loss: 6.382e-01]
windy_storm:   2%|2         | 73/3000 [02:15<1:00:52,  1.25s/it, lr: 1.0e-04 loss: 6.382e-01]
windy_storm:   2%|2         | 74/3000 [02:15<1:23:55,  1.72s/it, lr: 1.0e-04 loss: 6.382e-01]
windy_storm:   2%|2         | 74/3000 [02:15<1:23:55,  1.72s/it, lr: 1.0e-04 loss: 6.382e-01]
windy_storm:   2%|2         | 74/3000 [02:18<1:23:55,  1.72s/it, lr: 1.0e-04 loss: 1.888e-01]
windy_storm:   2%|2         | 74/3000 [02:18<1:23:55,  1.72s/it, lr: 1.0e-04 loss: 1.888e-01]
windy_storm:   2%|2         | 75/3000 [02:18<1:40:27,  2.06s/it, lr: 1.0e-04 loss: 1.888e-01]
windy_storm:   2%|2         | 75/3000 [02:18<1:40:27,  2.06s/it, lr: 1.0e-04 loss: 1.888e-01]
windy_storm:   2%|2         | 75/3000 [02:19<1:40:27,  2.06s/it, lr: 1.0e-04 loss: 6.959e-01]
windy_storm:   2%|2         | 75/3000 [02:19<1:40:27,  2.06s/it, lr: 1.0e-04 loss: 6.959e-01]
windy_storm:   3%|2         | 76/3000 [02:19<1:33:24,  1.92s/it, lr: 1.0e-04 loss: 6.959e-01]
windy_storm:   3%|2         | 76/3000 [02:19<1:33:24,  1.92s/it, lr: 1.0e-04 loss: 6.959e-01]
windy_storm:   3%|2         | 76/3000 [02:22<1:33:24,  1.92s/it, lr: 1.0e-04 loss: 1.987e-01]
windy_storm:   3%|2         | 76/3000 [02:22<1:33:24,  1.92s/it, lr: 1.0e-04 loss: 1.987e-01]
windy_storm:   3%|2         | 77/3000 [02:22<1:47:52,  2.21s/it, lr: 1.0e-04 loss: 1.987e-01]
windy_storm:   3%|2         | 77/3000 [02:22<1:47:52,  2.21s/it, lr: 1.0e-04 loss: 1.987e-01]
windy_storm:   3%|2         | 77/3000 [02:23<1:47:52,  2.21s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:   3%|2         | 77/3000 [02:23<1:47:52,  2.21s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:   3%|2         | 78/3000 [02:23<1:27:14,  1.79s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:   3%|2         | 78/3000 [02:23<1:27:14,  1.79s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:   3%|2         | 78/3000 [02:24<1:27:14,  1.79s/it, lr: 1.0e-04 loss: 1.795e-01]
windy_storm:   3%|2         | 78/3000 [02:24<1:27:14,  1.79s/it, lr: 1.0e-04 loss: 1.795e-01]
windy_storm:   3%|2         | 79/3000 [02:24<1:12:33,  1.49s/it, lr: 1.0e-04 loss: 1.795e-01]
windy_storm:   3%|2         | 79/3000 [02:24<1:12:33,  1.49s/it, lr: 1.0e-04 loss: 1.795e-01]
windy_storm:   3%|2         | 79/3000 [02:25<1:12:33,  1.49s/it, lr: 1.0e-04 loss: 6.512e-01]
windy_storm:   3%|2         | 79/3000 [02:25<1:12:33,  1.49s/it, lr: 1.0e-04 loss: 6.512e-01]
windy_storm:   3%|2         | 80/3000 [02:28<1:12:32,  1.49s/it, lr: 1.0e-04 loss: 5.469e-01]
windy_storm:   3%|2         | 80/3000 [02:28<1:12:32,  1.49s/it, lr: 1.0e-04 loss: 5.469e-01]
windy_storm:   3%|2         | 81/3000 [02:28<1:13:20,  1.51s/it, lr: 1.0e-04 loss: 5.469e-01]
windy_storm:   3%|2         | 81/3000 [02:28<1:13:20,  1.51s/it, lr: 1.0e-04 loss: 5.469e-01]
windy_storm:   3%|2         | 81/3000 [02:29<1:13:20,  1.51s/it, lr: 1.0e-04 loss: 3.873e-01]
windy_storm:   3%|2         | 81/3000 [02:29<1:13:20,  1.51s/it, lr: 1.0e-04 loss: 3.873e-01]
windy_storm:   3%|2         | 82/3000 [02:29<1:04:25,  1.32s/it, lr: 1.0e-04 loss: 3.873e-01]
windy_storm:   3%|2         | 82/3000 [02:29<1:04:25,  1.32s/it, lr: 1.0e-04 loss: 3.873e-01]
windy_storm:   3%|2         | 82/3000 [02:31<1:04:25,  1.32s/it, lr: 1.0e-04 loss: 9.668e-02]
windy_storm:   3%|2         | 82/3000 [02:31<1:04:25,  1.32s/it, lr: 1.0e-04 loss: 9.668e-02]
windy_storm:   3%|2         | 83/3000 [02:31<1:24:55,  1.75s/it, lr: 1.0e-04 loss: 9.668e-02]
windy_storm:   3%|2         | 83/3000 [02:31<1:24:55,  1.75s/it, lr: 1.0e-04 loss: 9.668e-02]
windy_storm:   3%|2         | 83/3000 [02:33<1:24:55,  1.75s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:   3%|2         | 83/3000 [02:33<1:24:55,  1.75s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:   3%|2         | 84/3000 [02:33<1:22:43,  1.70s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:   3%|2         | 84/3000 [02:33<1:22:43,  1.70s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:   3%|2         | 84/3000 [02:36<1:22:43,  1.70s/it, lr: 1.0e-04 loss: 5.967e-01]
windy_storm:   3%|2         | 84/3000 [02:36<1:22:43,  1.70s/it, lr: 1.0e-04 loss: 5.967e-01]
windy_storm:   3%|2         | 85/3000 [02:36<1:40:14,  2.06s/it, lr: 1.0e-04 loss: 5.967e-01]
windy_storm:   3%|2         | 85/3000 [02:36<1:40:14,  2.06s/it, lr: 1.0e-04 loss: 5.967e-01]
windy_storm:   3%|2         | 85/3000 [02:37<1:40:14,  2.06s/it, lr: 1.0e-04 loss: 1.980e-01]
windy_storm:   3%|2         | 85/3000 [02:37<1:40:14,  2.06s/it, lr: 1.0e-04 loss: 1.980e-01]
windy_storm:   3%|2         | 86/3000 [02:37<1:22:10,  1.69s/it, lr: 1.0e-04 loss: 1.980e-01]
windy_storm:   3%|2         | 86/3000 [02:37<1:22:10,  1.69s/it, lr: 1.0e-04 loss: 1.980e-01]
windy_storm:   3%|2         | 86/3000 [02:38<1:22:10,  1.69s/it, lr: 1.0e-04 loss: 1.864e-01]
windy_storm:   3%|2         | 86/3000 [02:38<1:22:10,  1.69s/it, lr: 1.0e-04 loss: 1.864e-01]
windy_storm:   3%|2         | 87/3000 [02:38<1:20:47,  1.66s/it, lr: 1.0e-04 loss: 1.864e-01]
windy_storm:   3%|2         | 87/3000 [02:38<1:20:47,  1.66s/it, lr: 1.0e-04 loss: 1.864e-01]
windy_storm:   3%|2         | 87/3000 [02:41<1:20:47,  1.66s/it, lr: 1.0e-04 loss: 6.906e-02]
windy_storm:   3%|2         | 87/3000 [02:41<1:20:47,  1.66s/it, lr: 1.0e-04 loss: 6.906e-02]
windy_storm:   3%|2         | 88/3000 [02:41<1:39:47,  2.06s/it, lr: 1.0e-04 loss: 6.906e-02]
windy_storm:   3%|2         | 88/3000 [02:41<1:39:47,  2.06s/it, lr: 1.0e-04 loss: 6.906e-02]
windy_storm:   3%|2         | 88/3000 [02:44<1:39:47,  2.06s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   3%|2         | 88/3000 [02:44<1:39:47,  2.06s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   3%|2         | 89/3000 [02:44<1:52:34,  2.32s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   3%|2         | 89/3000 [02:44<1:52:34,  2.32s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   3%|2         | 89/3000 [02:47<1:52:34,  2.32s/it, lr: 1.0e-04 loss: 9.296e-02]
windy_storm:   3%|2         | 89/3000 [02:47<1:52:34,  2.32s/it, lr: 1.0e-04 loss: 9.296e-02]
windy_storm:   3%|3         | 90/3000 [02:50<1:52:32,  2.32s/it, lr: 1.0e-04 loss: 2.306e-01]
windy_storm:   3%|3         | 90/3000 [02:50<1:52:32,  2.32s/it, lr: 1.0e-04 loss: 2.306e-01]
windy_storm:   3%|3         | 91/3000 [02:50<1:34:19,  1.95s/it, lr: 1.0e-04 loss: 2.306e-01]
windy_storm:   3%|3         | 91/3000 [02:50<1:34:19,  1.95s/it, lr: 1.0e-04 loss: 2.306e-01]
windy_storm:   3%|3         | 91/3000 [02:51<1:34:19,  1.95s/it, lr: 1.0e-04 loss: 6.474e-01]
windy_storm:   3%|3         | 91/3000 [02:51<1:34:19,  1.95s/it, lr: 1.0e-04 loss: 6.474e-01]
windy_storm:   3%|3         | 92/3000 [02:51<1:20:51,  1.67s/it, lr: 1.0e-04 loss: 6.474e-01]
windy_storm:   3%|3         | 92/3000 [02:51<1:20:51,  1.67s/it, lr: 1.0e-04 loss: 6.474e-01]
windy_storm:   3%|3         | 92/3000 [02:53<1:20:51,  1.67s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:   3%|3         | 92/3000 [02:53<1:20:51,  1.67s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:   3%|3         | 93/3000 [02:53<1:19:56,  1.65s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:   3%|3         | 93/3000 [02:53<1:19:56,  1.65s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:   3%|3         | 93/3000 [02:56<1:19:56,  1.65s/it, lr: 1.0e-04 loss: 4.882e-01]
windy_storm:   3%|3         | 93/3000 [02:56<1:19:56,  1.65s/it, lr: 1.0e-04 loss: 4.882e-01]
windy_storm:   3%|3         | 94/3000 [02:56<1:37:55,  2.02s/it, lr: 1.0e-04 loss: 4.882e-01]
windy_storm:   3%|3         | 94/3000 [02:56<1:37:55,  2.02s/it, lr: 1.0e-04 loss: 4.882e-01]
windy_storm:   3%|3         | 94/3000 [02:57<1:37:55,  2.02s/it, lr: 1.0e-04 loss: 3.726e-01]
windy_storm:   3%|3         | 94/3000 [02:57<1:37:55,  2.02s/it, lr: 1.0e-04 loss: 3.726e-01]
windy_storm:   3%|3         | 95/3000 [02:57<1:34:05,  1.94s/it, lr: 1.0e-04 loss: 3.726e-01]
windy_storm:   3%|3         | 95/3000 [02:57<1:34:05,  1.94s/it, lr: 1.0e-04 loss: 3.726e-01]
windy_storm:   3%|3         | 95/3000 [02:59<1:34:05,  1.94s/it, lr: 1.0e-04 loss: 2.401e-01]
windy_storm:   3%|3         | 95/3000 [02:59<1:34:05,  1.94s/it, lr: 1.0e-04 loss: 2.401e-01]
windy_storm:   3%|3         | 96/3000 [02:59<1:29:19,  1.85s/it, lr: 1.0e-04 loss: 2.401e-01]
windy_storm:   3%|3         | 96/3000 [02:59<1:29:19,  1.85s/it, lr: 1.0e-04 loss: 2.401e-01]
windy_storm:   3%|3         | 96/3000 [03:01<1:29:19,  1.85s/it, lr: 1.0e-04 loss: 6.575e-01]
windy_storm:   3%|3         | 96/3000 [03:01<1:29:19,  1.85s/it, lr: 1.0e-04 loss: 6.575e-01]
windy_storm:   3%|3         | 97/3000 [03:01<1:25:33,  1.77s/it, lr: 1.0e-04 loss: 6.575e-01]
windy_storm:   3%|3         | 97/3000 [03:01<1:25:33,  1.77s/it, lr: 1.0e-04 loss: 6.575e-01]
windy_storm:   3%|3         | 97/3000 [03:01<1:25:33,  1.77s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:   3%|3         | 97/3000 [03:01<1:25:33,  1.77s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:   3%|3         | 98/3000 [03:01<1:12:09,  1.49s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:   3%|3         | 98/3000 [03:01<1:12:09,  1.49s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:   3%|3         | 98/3000 [03:02<1:12:09,  1.49s/it, lr: 1.0e-04 loss: 5.503e-01]
windy_storm:   3%|3         | 98/3000 [03:02<1:12:09,  1.49s/it, lr: 1.0e-04 loss: 5.503e-01]
windy_storm:   3%|3         | 99/3000 [03:02<1:02:07,  1.28s/it, lr: 1.0e-04 loss: 5.503e-01]
windy_storm:   3%|3         | 99/3000 [03:02<1:02:07,  1.28s/it, lr: 1.0e-04 loss: 5.503e-01]
windy_storm:   3%|3         | 99/3000 [03:05<1:02:07,  1.28s/it, lr: 1.0e-04 loss: 2.925e-01]
windy_storm:   3%|3         | 99/3000 [03:05<1:02:07,  1.28s/it, lr: 1.0e-04 loss: 2.925e-01]
windy_storm:   3%|3         | 100/3000 [03:08<1:02:05,  1.28s/it, lr: 1.0e-04 loss: 7.464e-02]
windy_storm:   3%|3         | 100/3000 [03:08<1:02:05,  1.28s/it, lr: 1.0e-04 loss: 7.464e-02]
windy_storm:   3%|3         | 101/3000 [03:08<1:07:16,  1.39s/it, lr: 1.0e-04 loss: 7.464e-02]
windy_storm:   3%|3         | 101/3000 [03:08<1:07:16,  1.39s/it, lr: 1.0e-04 loss: 7.464e-02]
windy_storm:   3%|3         | 101/3000 [03:11<1:07:16,  1.39s/it, lr: 1.0e-04 loss: 4.467e-01]
windy_storm:   3%|3         | 101/3000 [03:11<1:07:16,  1.39s/it, lr: 1.0e-04 loss: 4.467e-01]
windy_storm:   3%|3         | 102/3000 [03:11<1:26:43,  1.80s/it, lr: 1.0e-04 loss: 4.467e-01]
windy_storm:   3%|3         | 102/3000 [03:11<1:26:43,  1.80s/it, lr: 1.0e-04 loss: 4.467e-01]
windy_storm:   3%|3         | 102/3000 [03:12<1:26:43,  1.80s/it, lr: 1.0e-04 loss: 2.466e-01]
windy_storm:   3%|3         | 102/3000 [03:12<1:26:43,  1.80s/it, lr: 1.0e-04 loss: 2.466e-01]
windy_storm:   3%|3         | 103/3000 [03:12<1:14:32,  1.54s/it, lr: 1.0e-04 loss: 2.466e-01]
windy_storm:   3%|3         | 103/3000 [03:12<1:14:32,  1.54s/it, lr: 1.0e-04 loss: 2.466e-01]
windy_storm:   3%|3         | 103/3000 [03:13<1:14:32,  1.54s/it, lr: 1.0e-04 loss: 1.507e-01]
windy_storm:   3%|3         | 103/3000 [03:13<1:14:32,  1.54s/it, lr: 1.0e-04 loss: 1.507e-01]
windy_storm:   3%|3         | 104/3000 [03:13<1:04:23,  1.33s/it, lr: 1.0e-04 loss: 1.507e-01]
windy_storm:   3%|3         | 104/3000 [03:13<1:04:23,  1.33s/it, lr: 1.0e-04 loss: 1.507e-01]
windy_storm:   3%|3         | 104/3000 [03:14<1:04:23,  1.33s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   3%|3         | 104/3000 [03:14<1:04:23,  1.33s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   4%|3         | 105/3000 [03:14<1:07:47,  1.41s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   4%|3         | 105/3000 [03:14<1:07:47,  1.41s/it, lr: 1.0e-04 loss: 3.823e-01]
windy_storm:   4%|3         | 105/3000 [03:17<1:07:47,  1.41s/it, lr: 1.0e-04 loss: 2.440e-01]
windy_storm:   4%|3         | 105/3000 [03:17<1:07:47,  1.41s/it, lr: 1.0e-04 loss: 2.440e-01]
windy_storm:   4%|3         | 106/3000 [03:17<1:29:00,  1.85s/it, lr: 1.0e-04 loss: 2.440e-01]
windy_storm:   4%|3         | 106/3000 [03:17<1:29:00,  1.85s/it, lr: 1.0e-04 loss: 2.440e-01]
windy_storm:   4%|3         | 106/3000 [03:20<1:29:00,  1.85s/it, lr: 1.0e-04 loss: 3.890e-01]
windy_storm:   4%|3         | 106/3000 [03:20<1:29:00,  1.85s/it, lr: 1.0e-04 loss: 3.890e-01]
windy_storm:   4%|3         | 107/3000 [03:20<1:44:08,  2.16s/it, lr: 1.0e-04 loss: 3.890e-01]
windy_storm:   4%|3         | 107/3000 [03:20<1:44:08,  2.16s/it, lr: 1.0e-04 loss: 3.890e-01]
windy_storm:   4%|3         | 107/3000 [03:21<1:44:08,  2.16s/it, lr: 1.0e-04 loss: 6.702e-01]
windy_storm:   4%|3         | 107/3000 [03:21<1:44:08,  2.16s/it, lr: 1.0e-04 loss: 6.702e-01]
windy_storm:   4%|3         | 108/3000 [03:21<1:28:16,  1.83s/it, lr: 1.0e-04 loss: 6.702e-01]
windy_storm:   4%|3         | 108/3000 [03:21<1:28:16,  1.83s/it, lr: 1.0e-04 loss: 6.702e-01]
windy_storm:   4%|3         | 108/3000 [03:23<1:28:16,  1.83s/it, lr: 1.0e-04 loss: 1.269e-01]
windy_storm:   4%|3         | 108/3000 [03:23<1:28:16,  1.83s/it, lr: 1.0e-04 loss: 1.269e-01]
windy_storm:   4%|3         | 109/3000 [03:23<1:24:22,  1.75s/it, lr: 1.0e-04 loss: 1.269e-01]
windy_storm:   4%|3         | 109/3000 [03:23<1:24:22,  1.75s/it, lr: 1.0e-04 loss: 1.269e-01]
windy_storm:   4%|3         | 109/3000 [03:24<1:24:22,  1.75s/it, lr: 1.0e-04 loss: 6.722e-01]
windy_storm:   4%|3         | 109/3000 [03:24<1:24:22,  1.75s/it, lr: 1.0e-04 loss: 6.722e-01]
windy_storm:   4%|3         | 110/3000 [03:26<1:24:21,  1.75s/it, lr: 1.0e-04 loss: 1.158e-01]
windy_storm:   4%|3         | 110/3000 [03:26<1:24:21,  1.75s/it, lr: 1.0e-04 loss: 1.158e-01]
windy_storm:   4%|3         | 111/3000 [03:26<1:03:16,  1.31s/it, lr: 1.0e-04 loss: 1.158e-01]
windy_storm:   4%|3         | 111/3000 [03:26<1:03:16,  1.31s/it, lr: 1.0e-04 loss: 1.158e-01]
windy_storm:   4%|3         | 111/3000 [03:27<1:03:16,  1.31s/it, lr: 1.0e-04 loss: 3.938e-01]
windy_storm:   4%|3         | 111/3000 [03:27<1:03:16,  1.31s/it, lr: 1.0e-04 loss: 3.938e-01]
windy_storm:   4%|3         | 112/3000 [03:27<56:42,  1.18s/it, lr: 1.0e-04 loss: 3.938e-01]  
windy_storm:   4%|3         | 112/3000 [03:27<56:42,  1.18s/it, lr: 1.0e-04 loss: 3.938e-01]  
windy_storm:   4%|3         | 112/3000 [03:28<56:42,  1.18s/it, lr: 1.0e-04 loss: 5.737e-01]
windy_storm:   4%|3         | 112/3000 [03:28<56:42,  1.18s/it, lr: 1.0e-04 loss: 5.737e-01]
windy_storm:   4%|3         | 113/3000 [03:28<1:01:14,  1.27s/it, lr: 1.0e-04 loss: 5.737e-01]
windy_storm:   4%|3         | 113/3000 [03:28<1:01:14,  1.27s/it, lr: 1.0e-04 loss: 5.737e-01]
windy_storm:   4%|3         | 113/3000 [03:30<1:01:14,  1.27s/it, lr: 1.0e-04 loss: 8.612e-02]
windy_storm:   4%|3         | 113/3000 [03:30<1:01:14,  1.27s/it, lr: 1.0e-04 loss: 8.612e-02]
windy_storm:   4%|3         | 114/3000 [03:30<1:05:12,  1.36s/it, lr: 1.0e-04 loss: 8.612e-02]
windy_storm:   4%|3         | 114/3000 [03:30<1:05:12,  1.36s/it, lr: 1.0e-04 loss: 8.612e-02]
windy_storm:   4%|3         | 114/3000 [03:31<1:05:12,  1.36s/it, lr: 1.0e-04 loss: 6.250e-01]
windy_storm:   4%|3         | 114/3000 [03:31<1:05:12,  1.36s/it, lr: 1.0e-04 loss: 6.250e-01]
windy_storm:   4%|3         | 115/3000 [03:31<57:06,  1.19s/it, lr: 1.0e-04 loss: 6.250e-01]  
windy_storm:   4%|3         | 115/3000 [03:31<57:06,  1.19s/it, lr: 1.0e-04 loss: 6.250e-01]  
windy_storm:   4%|3         | 115/3000 [03:31<57:06,  1.19s/it, lr: 1.0e-04 loss: 5.229e-01]
windy_storm:   4%|3         | 115/3000 [03:31<57:06,  1.19s/it, lr: 1.0e-04 loss: 5.229e-01]
windy_storm:   4%|3         | 116/3000 [03:31<51:04,  1.06s/it, lr: 1.0e-04 loss: 5.229e-01]
windy_storm:   4%|3         | 116/3000 [03:31<51:04,  1.06s/it, lr: 1.0e-04 loss: 5.229e-01]
windy_storm:   4%|3         | 116/3000 [03:32<51:04,  1.06s/it, lr: 1.0e-04 loss: 2.338e-01]
windy_storm:   4%|3         | 116/3000 [03:32<51:04,  1.06s/it, lr: 1.0e-04 loss: 2.338e-01]
windy_storm:   4%|3         | 117/3000 [03:32<47:45,  1.01it/s, lr: 1.0e-04 loss: 2.338e-01]
windy_storm:   4%|3         | 117/3000 [03:32<47:45,  1.01it/s, lr: 1.0e-04 loss: 2.338e-01]
windy_storm:   4%|3         | 117/3000 [03:34<47:45,  1.01it/s, lr: 1.0e-04 loss: 6.791e-01]
windy_storm:   4%|3         | 117/3000 [03:34<47:45,  1.01it/s, lr: 1.0e-04 loss: 6.791e-01]
windy_storm:   4%|3         | 118/3000 [03:34<56:01,  1.17s/it, lr: 1.0e-04 loss: 6.791e-01]
windy_storm:   4%|3         | 118/3000 [03:34<56:01,  1.17s/it, lr: 1.0e-04 loss: 6.791e-01]
windy_storm:   4%|3         | 118/3000 [03:35<56:01,  1.17s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:   4%|3         | 118/3000 [03:35<56:01,  1.17s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:   4%|3         | 119/3000 [03:35<1:01:12,  1.27s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:   4%|3         | 119/3000 [03:35<1:01:12,  1.27s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:   4%|3         | 119/3000 [03:37<1:01:12,  1.27s/it, lr: 1.0e-04 loss: 6.718e-01]
windy_storm:   4%|3         | 119/3000 [03:37<1:01:12,  1.27s/it, lr: 1.0e-04 loss: 6.718e-01]
windy_storm:   4%|4         | 120/3000 [03:39<1:01:11,  1.27s/it, lr: 1.0e-04 loss: 2.510e-01]
windy_storm:   4%|4         | 120/3000 [03:39<1:01:11,  1.27s/it, lr: 1.0e-04 loss: 2.510e-01]
windy_storm:   4%|4         | 121/3000 [03:39<52:53,  1.10s/it, lr: 1.0e-04 loss: 2.510e-01]  
windy_storm:   4%|4         | 121/3000 [03:39<52:53,  1.10s/it, lr: 1.0e-04 loss: 2.510e-01]  
windy_storm:   4%|4         | 121/3000 [03:41<52:53,  1.10s/it, lr: 1.0e-04 loss: 4.302e-02]
windy_storm:   4%|4         | 121/3000 [03:41<52:53,  1.10s/it, lr: 1.0e-04 loss: 4.302e-02]
windy_storm:   4%|4         | 122/3000 [03:41<58:19,  1.22s/it, lr: 1.0e-04 loss: 4.302e-02]
windy_storm:   4%|4         | 122/3000 [03:41<58:19,  1.22s/it, lr: 1.0e-04 loss: 4.302e-02]
windy_storm:   4%|4         | 122/3000 [03:42<58:19,  1.22s/it, lr: 1.0e-04 loss: 1.059e-01]
windy_storm:   4%|4         | 122/3000 [03:42<58:19,  1.22s/it, lr: 1.0e-04 loss: 1.059e-01]
windy_storm:   4%|4         | 123/3000 [03:42<53:23,  1.11s/it, lr: 1.0e-04 loss: 1.059e-01]
windy_storm:   4%|4         | 123/3000 [03:42<53:23,  1.11s/it, lr: 1.0e-04 loss: 1.059e-01]
windy_storm:   4%|4         | 123/3000 [03:42<53:23,  1.11s/it, lr: 1.0e-04 loss: 3.594e-01]
windy_storm:   4%|4         | 123/3000 [03:42<53:23,  1.11s/it, lr: 1.0e-04 loss: 3.594e-01]
windy_storm:   4%|4         | 124/3000 [03:42<48:51,  1.02s/it, lr: 1.0e-04 loss: 3.594e-01]
windy_storm:   4%|4         | 124/3000 [03:42<48:51,  1.02s/it, lr: 1.0e-04 loss: 3.594e-01]
windy_storm:   4%|4         | 124/3000 [03:45<48:51,  1.02s/it, lr: 1.0e-04 loss: 4.230e-01]
windy_storm:   4%|4         | 124/3000 [03:45<48:51,  1.02s/it, lr: 1.0e-04 loss: 4.230e-01]
windy_storm:   4%|4         | 125/3000 [03:45<1:14:31,  1.56s/it, lr: 1.0e-04 loss: 4.230e-01]
windy_storm:   4%|4         | 125/3000 [03:45<1:14:31,  1.56s/it, lr: 1.0e-04 loss: 4.230e-01]
windy_storm:   4%|4         | 125/3000 [03:48<1:14:31,  1.56s/it, lr: 1.0e-04 loss: 6.772e-01]
windy_storm:   4%|4         | 125/3000 [03:48<1:14:31,  1.56s/it, lr: 1.0e-04 loss: 6.772e-01]
windy_storm:   4%|4         | 126/3000 [03:48<1:34:42,  1.98s/it, lr: 1.0e-04 loss: 6.772e-01]
windy_storm:   4%|4         | 126/3000 [03:48<1:34:42,  1.98s/it, lr: 1.0e-04 loss: 6.772e-01]
windy_storm:   4%|4         | 126/3000 [03:50<1:34:42,  1.98s/it, lr: 1.0e-04 loss: 4.710e-01]
windy_storm:   4%|4         | 126/3000 [03:50<1:34:42,  1.98s/it, lr: 1.0e-04 loss: 4.710e-01]
windy_storm:   4%|4         | 127/3000 [03:50<1:29:02,  1.86s/it, lr: 1.0e-04 loss: 4.710e-01]
windy_storm:   4%|4         | 127/3000 [03:50<1:29:02,  1.86s/it, lr: 1.0e-04 loss: 4.710e-01]
windy_storm:   4%|4         | 127/3000 [03:51<1:29:02,  1.86s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:   4%|4         | 127/3000 [03:51<1:29:02,  1.86s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:   4%|4         | 128/3000 [03:51<1:24:50,  1.77s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:   4%|4         | 128/3000 [03:51<1:24:50,  1.77s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:   4%|4         | 128/3000 [03:53<1:24:50,  1.77s/it, lr: 1.0e-04 loss: 4.383e-01]
windy_storm:   4%|4         | 128/3000 [03:53<1:24:50,  1.77s/it, lr: 1.0e-04 loss: 4.383e-01]
windy_storm:   4%|4         | 129/3000 [03:53<1:21:27,  1.70s/it, lr: 1.0e-04 loss: 4.383e-01]
windy_storm:   4%|4         | 129/3000 [03:53<1:21:27,  1.70s/it, lr: 1.0e-04 loss: 4.383e-01]
windy_storm:   4%|4         | 129/3000 [03:56<1:21:27,  1.70s/it, lr: 1.0e-04 loss: 5.666e-01]
windy_storm:   4%|4         | 129/3000 [03:56<1:21:27,  1.70s/it, lr: 1.0e-04 loss: 5.666e-01]
windy_storm:   4%|4         | 130/3000 [03:57<1:21:25,  1.70s/it, lr: 1.0e-04 loss: 2.290e-01]
windy_storm:   4%|4         | 130/3000 [03:57<1:21:25,  1.70s/it, lr: 1.0e-04 loss: 2.290e-01]
windy_storm:   4%|4         | 131/3000 [03:57<52:29,  1.10s/it, lr: 1.0e-04 loss: 2.290e-01]  
windy_storm:   4%|4         | 131/3000 [03:57<52:29,  1.10s/it, lr: 1.0e-04 loss: 2.290e-01]  
windy_storm:   4%|4         | 131/3000 [03:57<52:29,  1.10s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:   4%|4         | 131/3000 [03:57<52:29,  1.10s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:   4%|4         | 132/3000 [03:57<48:33,  1.02s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:   4%|4         | 132/3000 [03:57<48:33,  1.02s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:   4%|4         | 132/3000 [03:59<48:33,  1.02s/it, lr: 1.0e-04 loss: 3.460e-01]
windy_storm:   4%|4         | 132/3000 [03:59<48:33,  1.02s/it, lr: 1.0e-04 loss: 3.460e-01]
windy_storm:   4%|4         | 133/3000 [03:59<55:24,  1.16s/it, lr: 1.0e-04 loss: 3.460e-01]
windy_storm:   4%|4         | 133/3000 [03:59<55:24,  1.16s/it, lr: 1.0e-04 loss: 3.460e-01]
windy_storm:   4%|4         | 133/3000 [04:00<55:24,  1.16s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:   4%|4         | 133/3000 [04:00<55:24,  1.16s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:   4%|4         | 134/3000 [04:00<50:06,  1.05s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:   4%|4         | 134/3000 [04:00<50:06,  1.05s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:   4%|4         | 134/3000 [04:01<50:06,  1.05s/it, lr: 1.0e-04 loss: 6.819e-01]
windy_storm:   4%|4         | 134/3000 [04:01<50:06,  1.05s/it, lr: 1.0e-04 loss: 6.819e-01]
windy_storm:   4%|4         | 135/3000 [04:01<58:55,  1.23s/it, lr: 1.0e-04 loss: 6.819e-01]
windy_storm:   4%|4         | 135/3000 [04:01<58:55,  1.23s/it, lr: 1.0e-04 loss: 6.819e-01]
windy_storm:   4%|4         | 135/3000 [04:02<58:55,  1.23s/it, lr: 1.0e-04 loss: 3.310e-01]
windy_storm:   4%|4         | 135/3000 [04:02<58:55,  1.23s/it, lr: 1.0e-04 loss: 3.310e-01]
windy_storm:   5%|4         | 136/3000 [04:02<53:06,  1.11s/it, lr: 1.0e-04 loss: 3.310e-01]
windy_storm:   5%|4         | 136/3000 [04:02<53:06,  1.11s/it, lr: 1.0e-04 loss: 3.310e-01]
windy_storm:   5%|4         | 136/3000 [04:03<53:06,  1.11s/it, lr: 1.0e-04 loss: 2.512e-01]
windy_storm:   5%|4         | 136/3000 [04:03<53:06,  1.11s/it, lr: 1.0e-04 loss: 2.512e-01]
windy_storm:   5%|4         | 137/3000 [04:03<47:52,  1.00s/it, lr: 1.0e-04 loss: 2.512e-01]
windy_storm:   5%|4         | 137/3000 [04:03<47:52,  1.00s/it, lr: 1.0e-04 loss: 2.512e-01]
windy_storm:   5%|4         | 137/3000 [04:06<47:52,  1.00s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:   5%|4         | 137/3000 [04:06<47:52,  1.00s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:   5%|4         | 138/3000 [04:06<1:15:28,  1.58s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:   5%|4         | 138/3000 [04:06<1:15:28,  1.58s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:   5%|4         | 138/3000 [04:08<1:15:28,  1.58s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:   5%|4         | 138/3000 [04:08<1:15:28,  1.58s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:   5%|4         | 139/3000 [04:08<1:14:56,  1.57s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:   5%|4         | 139/3000 [04:08<1:14:56,  1.57s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:   5%|4         | 139/3000 [04:10<1:14:56,  1.57s/it, lr: 1.0e-04 loss: 5.561e-01]
windy_storm:   5%|4         | 139/3000 [04:10<1:14:56,  1.57s/it, lr: 1.0e-04 loss: 5.561e-01]
windy_storm:   5%|4         | 140/3000 [04:11<1:14:54,  1.57s/it, lr: 1.0e-04 loss: 3.974e-01]
windy_storm:   5%|4         | 140/3000 [04:11<1:14:54,  1.57s/it, lr: 1.0e-04 loss: 3.974e-01]
windy_storm:   5%|4         | 141/3000 [04:11<48:54,  1.03s/it, lr: 1.0e-04 loss: 3.974e-01]  
windy_storm:   5%|4         | 141/3000 [04:11<48:54,  1.03s/it, lr: 1.0e-04 loss: 3.974e-01]  
windy_storm:   5%|4         | 141/3000 [04:12<48:54,  1.03s/it, lr: 1.0e-04 loss: 2.194e-01]
windy_storm:   5%|4         | 141/3000 [04:12<48:54,  1.03s/it, lr: 1.0e-04 loss: 2.194e-01]
windy_storm:   5%|4         | 142/3000 [04:12<46:19,  1.03it/s, lr: 1.0e-04 loss: 2.194e-01]
windy_storm:   5%|4         | 142/3000 [04:12<46:19,  1.03it/s, lr: 1.0e-04 loss: 2.194e-01]
windy_storm:   5%|4         | 142/3000 [04:15<46:19,  1.03it/s, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   5%|4         | 142/3000 [04:15<46:19,  1.03it/s, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   5%|4         | 143/3000 [04:15<1:11:10,  1.49s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   5%|4         | 143/3000 [04:15<1:11:10,  1.49s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:   5%|4         | 143/3000 [04:17<1:11:10,  1.49s/it, lr: 1.0e-04 loss: 2.460e-01]
windy_storm:   5%|4         | 143/3000 [04:17<1:11:10,  1.49s/it, lr: 1.0e-04 loss: 2.460e-01]
windy_storm:   5%|4         | 144/3000 [04:17<1:12:05,  1.51s/it, lr: 1.0e-04 loss: 2.460e-01]
windy_storm:   5%|4         | 144/3000 [04:17<1:12:05,  1.51s/it, lr: 1.0e-04 loss: 2.460e-01]
windy_storm:   5%|4         | 144/3000 [04:18<1:12:05,  1.51s/it, lr: 1.0e-04 loss: 6.703e-01]
windy_storm:   5%|4         | 144/3000 [04:18<1:12:05,  1.51s/it, lr: 1.0e-04 loss: 6.703e-01]
windy_storm:   5%|4         | 145/3000 [04:18<1:12:29,  1.52s/it, lr: 1.0e-04 loss: 6.703e-01]
windy_storm:   5%|4         | 145/3000 [04:18<1:12:29,  1.52s/it, lr: 1.0e-04 loss: 6.703e-01]
windy_storm:   5%|4         | 145/3000 [04:20<1:12:29,  1.52s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   5%|4         | 145/3000 [04:20<1:12:29,  1.52s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   5%|4         | 146/3000 [04:20<1:13:06,  1.54s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   5%|4         | 146/3000 [04:20<1:13:06,  1.54s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   5%|4         | 146/3000 [04:21<1:13:06,  1.54s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:   5%|4         | 146/3000 [04:21<1:13:06,  1.54s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:   5%|4         | 147/3000 [04:21<1:14:19,  1.56s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:   5%|4         | 147/3000 [04:21<1:14:19,  1.56s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:   5%|4         | 147/3000 [04:23<1:14:19,  1.56s/it, lr: 1.0e-04 loss: 3.402e-02]
windy_storm:   5%|4         | 147/3000 [04:23<1:14:19,  1.56s/it, lr: 1.0e-04 loss: 3.402e-02]
windy_storm:   5%|4         | 148/3000 [04:23<1:14:14,  1.56s/it, lr: 1.0e-04 loss: 3.402e-02]
windy_storm:   5%|4         | 148/3000 [04:23<1:14:14,  1.56s/it, lr: 1.0e-04 loss: 3.402e-02]
windy_storm:   5%|4         | 148/3000 [04:25<1:14:14,  1.56s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:   5%|4         | 148/3000 [04:25<1:14:14,  1.56s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:   5%|4         | 149/3000 [04:25<1:15:36,  1.59s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:   5%|4         | 149/3000 [04:25<1:15:36,  1.59s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:   5%|4         | 149/3000 [04:28<1:15:36,  1.59s/it, lr: 1.0e-04 loss: 8.903e-02]
windy_storm:   5%|4         | 149/3000 [04:28<1:15:36,  1.59s/it, lr: 1.0e-04 loss: 8.903e-02]
windy_storm:   5%|5         | 150/3000 [04:29<1:15:34,  1.59s/it, lr: 1.0e-04 loss: 1.413e-01]
windy_storm:   5%|5         | 150/3000 [04:29<1:15:34,  1.59s/it, lr: 1.0e-04 loss: 1.413e-01]
windy_storm:   5%|5         | 151/3000 [04:29<58:14,  1.23s/it, lr: 1.0e-04 loss: 1.413e-01]  
windy_storm:   5%|5         | 151/3000 [04:29<58:14,  1.23s/it, lr: 1.0e-04 loss: 1.413e-01]  
windy_storm:   5%|5         | 151/3000 [04:30<58:14,  1.23s/it, lr: 1.0e-04 loss: 4.741e-01]
windy_storm:   5%|5         | 151/3000 [04:30<58:14,  1.23s/it, lr: 1.0e-04 loss: 4.741e-01]
windy_storm:   5%|5         | 152/3000 [04:30<53:22,  1.12s/it, lr: 1.0e-04 loss: 4.741e-01]
windy_storm:   5%|5         | 152/3000 [04:30<53:22,  1.12s/it, lr: 1.0e-04 loss: 4.741e-01]
windy_storm:   5%|5         | 152/3000 [04:32<53:22,  1.12s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:   5%|5         | 152/3000 [04:32<53:22,  1.12s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:   5%|5         | 153/3000 [04:32<58:58,  1.24s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:   5%|5         | 153/3000 [04:32<58:58,  1.24s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:   5%|5         | 153/3000 [04:32<58:58,  1.24s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:   5%|5         | 153/3000 [04:32<58:58,  1.24s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:   5%|5         | 154/3000 [04:32<52:19,  1.10s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:   5%|5         | 154/3000 [04:32<52:19,  1.10s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:   5%|5         | 154/3000 [04:35<52:19,  1.10s/it, lr: 1.0e-04 loss: 5.390e-01]
windy_storm:   5%|5         | 154/3000 [04:35<52:19,  1.10s/it, lr: 1.0e-04 loss: 5.390e-01]
windy_storm:   5%|5         | 155/3000 [04:35<1:16:09,  1.61s/it, lr: 1.0e-04 loss: 5.390e-01]
windy_storm:   5%|5         | 155/3000 [04:35<1:16:09,  1.61s/it, lr: 1.0e-04 loss: 5.390e-01]
windy_storm:   5%|5         | 155/3000 [04:37<1:16:09,  1.61s/it, lr: 1.0e-04 loss: 1.506e-01]
windy_storm:   5%|5         | 155/3000 [04:37<1:16:09,  1.61s/it, lr: 1.0e-04 loss: 1.506e-01]
windy_storm:   5%|5         | 156/3000 [04:37<1:15:39,  1.60s/it, lr: 1.0e-04 loss: 1.506e-01]
windy_storm:   5%|5         | 156/3000 [04:37<1:15:39,  1.60s/it, lr: 1.0e-04 loss: 1.506e-01]
windy_storm:   5%|5         | 156/3000 [04:40<1:15:39,  1.60s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:   5%|5         | 156/3000 [04:40<1:15:39,  1.60s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:   5%|5         | 157/3000 [04:40<1:34:32,  2.00s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:   5%|5         | 157/3000 [04:40<1:34:32,  2.00s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:   5%|5         | 157/3000 [04:40<1:34:32,  2.00s/it, lr: 1.0e-04 loss: 6.086e-01]
windy_storm:   5%|5         | 157/3000 [04:40<1:34:32,  2.00s/it, lr: 1.0e-04 loss: 6.086e-01]
windy_storm:   5%|5         | 158/3000 [04:40<1:17:29,  1.64s/it, lr: 1.0e-04 loss: 6.086e-01]
windy_storm:   5%|5         | 158/3000 [04:40<1:17:29,  1.64s/it, lr: 1.0e-04 loss: 6.086e-01]
windy_storm:   5%|5         | 158/3000 [04:43<1:17:29,  1.64s/it, lr: 1.0e-04 loss: 1.025e-01]
windy_storm:   5%|5         | 158/3000 [04:43<1:17:29,  1.64s/it, lr: 1.0e-04 loss: 1.025e-01]
windy_storm:   5%|5         | 159/3000 [04:43<1:35:02,  2.01s/it, lr: 1.0e-04 loss: 1.025e-01]
windy_storm:   5%|5         | 159/3000 [04:43<1:35:02,  2.01s/it, lr: 1.0e-04 loss: 1.025e-01]
windy_storm:   5%|5         | 159/3000 [04:44<1:35:02,  2.01s/it, lr: 1.0e-04 loss: 6.145e-01]
windy_storm:   5%|5         | 159/3000 [04:44<1:35:02,  2.01s/it, lr: 1.0e-04 loss: 6.145e-01]
windy_storm:   5%|5         | 160/3000 [04:46<1:35:00,  2.01s/it, lr: 1.0e-04 loss: 4.800e-01]
windy_storm:   5%|5         | 160/3000 [04:46<1:35:00,  2.01s/it, lr: 1.0e-04 loss: 4.800e-01]
windy_storm:   5%|5         | 161/3000 [04:46<1:07:56,  1.44s/it, lr: 1.0e-04 loss: 4.800e-01]
windy_storm:   5%|5         | 161/3000 [04:46<1:07:56,  1.44s/it, lr: 1.0e-04 loss: 4.800e-01]
windy_storm:   5%|5         | 161/3000 [04:49<1:07:56,  1.44s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:   5%|5         | 161/3000 [04:49<1:07:56,  1.44s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:   5%|5         | 162/3000 [04:49<1:28:34,  1.87s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:   5%|5         | 162/3000 [04:49<1:28:34,  1.87s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:   5%|5         | 162/3000 [04:52<1:28:34,  1.87s/it, lr: 1.0e-04 loss: 5.865e-01]
windy_storm:   5%|5         | 162/3000 [04:52<1:28:34,  1.87s/it, lr: 1.0e-04 loss: 5.865e-01]
windy_storm:   5%|5         | 163/3000 [04:52<1:41:31,  2.15s/it, lr: 1.0e-04 loss: 5.865e-01]
windy_storm:   5%|5         | 163/3000 [04:52<1:41:31,  2.15s/it, lr: 1.0e-04 loss: 5.865e-01]
windy_storm:   5%|5         | 163/3000 [04:53<1:41:31,  2.15s/it, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:   5%|5         | 163/3000 [04:53<1:41:31,  2.15s/it, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:   5%|5         | 164/3000 [04:53<1:24:25,  1.79s/it, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:   5%|5         | 164/3000 [04:53<1:24:25,  1.79s/it, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:   5%|5         | 164/3000 [04:53<1:24:25,  1.79s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:   5%|5         | 164/3000 [04:53<1:24:25,  1.79s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:   6%|5         | 165/3000 [04:53<1:10:59,  1.50s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:   6%|5         | 165/3000 [04:53<1:10:59,  1.50s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:   6%|5         | 165/3000 [04:55<1:10:59,  1.50s/it, lr: 1.0e-04 loss: 5.060e-01]
windy_storm:   6%|5         | 165/3000 [04:55<1:10:59,  1.50s/it, lr: 1.0e-04 loss: 5.060e-01]
windy_storm:   6%|5         | 166/3000 [04:55<1:11:55,  1.52s/it, lr: 1.0e-04 loss: 5.060e-01]
windy_storm:   6%|5         | 166/3000 [04:55<1:11:55,  1.52s/it, lr: 1.0e-04 loss: 5.060e-01]
windy_storm:   6%|5         | 166/3000 [04:56<1:11:55,  1.52s/it, lr: 1.0e-04 loss: 2.964e-01]
windy_storm:   6%|5         | 166/3000 [04:56<1:11:55,  1.52s/it, lr: 1.0e-04 loss: 2.964e-01]
windy_storm:   6%|5         | 167/3000 [04:56<1:01:18,  1.30s/it, lr: 1.0e-04 loss: 2.964e-01]
windy_storm:   6%|5         | 167/3000 [04:56<1:01:18,  1.30s/it, lr: 1.0e-04 loss: 2.964e-01]
windy_storm:   6%|5         | 167/3000 [04:57<1:01:18,  1.30s/it, lr: 1.0e-04 loss: 6.642e-01]
windy_storm:   6%|5         | 167/3000 [04:57<1:01:18,  1.30s/it, lr: 1.0e-04 loss: 6.642e-01]
windy_storm:   6%|5         | 168/3000 [04:57<1:05:03,  1.38s/it, lr: 1.0e-04 loss: 6.642e-01]
windy_storm:   6%|5         | 168/3000 [04:57<1:05:03,  1.38s/it, lr: 1.0e-04 loss: 6.642e-01]
windy_storm:   6%|5         | 168/3000 [05:00<1:05:03,  1.38s/it, lr: 1.0e-04 loss: 3.265e-01]
windy_storm:   6%|5         | 168/3000 [05:00<1:05:03,  1.38s/it, lr: 1.0e-04 loss: 3.265e-01]
windy_storm:   6%|5         | 169/3000 [05:00<1:26:07,  1.83s/it, lr: 1.0e-04 loss: 3.265e-01]
windy_storm:   6%|5         | 169/3000 [05:00<1:26:07,  1.83s/it, lr: 1.0e-04 loss: 3.265e-01]
windy_storm:   6%|5         | 169/3000 [05:01<1:26:07,  1.83s/it, lr: 1.0e-04 loss: 2.781e-01]
windy_storm:   6%|5         | 169/3000 [05:01<1:26:07,  1.83s/it, lr: 1.0e-04 loss: 2.781e-01]
windy_storm:   6%|5         | 170/3000 [05:03<1:26:05,  1.83s/it, lr: 1.0e-04 loss: 6.086e-02]
windy_storm:   6%|5         | 170/3000 [05:03<1:26:05,  1.83s/it, lr: 1.0e-04 loss: 6.086e-02]
windy_storm:   6%|5         | 171/3000 [05:03<1:03:37,  1.35s/it, lr: 1.0e-04 loss: 6.086e-02]
windy_storm:   6%|5         | 171/3000 [05:03<1:03:37,  1.35s/it, lr: 1.0e-04 loss: 6.086e-02]
windy_storm:   6%|5         | 171/3000 [05:06<1:03:37,  1.35s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:   6%|5         | 171/3000 [05:06<1:03:37,  1.35s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:   6%|5         | 172/3000 [05:06<1:21:49,  1.74s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:   6%|5         | 172/3000 [05:06<1:21:49,  1.74s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:   6%|5         | 172/3000 [05:07<1:21:49,  1.74s/it, lr: 1.0e-04 loss: 1.186e-01]
windy_storm:   6%|5         | 172/3000 [05:07<1:21:49,  1.74s/it, lr: 1.0e-04 loss: 1.186e-01]
windy_storm:   6%|5         | 173/3000 [05:07<1:19:29,  1.69s/it, lr: 1.0e-04 loss: 1.186e-01]
windy_storm:   6%|5         | 173/3000 [05:07<1:19:29,  1.69s/it, lr: 1.0e-04 loss: 1.186e-01]
windy_storm:   6%|5         | 173/3000 [05:08<1:19:29,  1.69s/it, lr: 1.0e-04 loss: 1.361e-01]
windy_storm:   6%|5         | 173/3000 [05:08<1:19:29,  1.69s/it, lr: 1.0e-04 loss: 1.361e-01]
windy_storm:   6%|5         | 174/3000 [05:08<1:08:17,  1.45s/it, lr: 1.0e-04 loss: 1.361e-01]
windy_storm:   6%|5         | 174/3000 [05:08<1:08:17,  1.45s/it, lr: 1.0e-04 loss: 1.361e-01]
windy_storm:   6%|5         | 174/3000 [05:09<1:08:17,  1.45s/it, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   6%|5         | 174/3000 [05:09<1:08:17,  1.45s/it, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   6%|5         | 175/3000 [05:09<1:02:50,  1.33s/it, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   6%|5         | 175/3000 [05:09<1:02:50,  1.33s/it, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   6%|5         | 175/3000 [05:12<1:02:50,  1.33s/it, lr: 1.0e-04 loss: 2.928e-02]
windy_storm:   6%|5         | 175/3000 [05:12<1:02:50,  1.33s/it, lr: 1.0e-04 loss: 2.928e-02]
windy_storm:   6%|5         | 176/3000 [05:12<1:24:13,  1.79s/it, lr: 1.0e-04 loss: 2.928e-02]
windy_storm:   6%|5         | 176/3000 [05:12<1:24:13,  1.79s/it, lr: 1.0e-04 loss: 2.928e-02]
windy_storm:   6%|5         | 176/3000 [05:13<1:24:13,  1.79s/it, lr: 1.0e-04 loss: 3.731e-01]
windy_storm:   6%|5         | 176/3000 [05:13<1:24:13,  1.79s/it, lr: 1.0e-04 loss: 3.731e-01]
windy_storm:   6%|5         | 177/3000 [05:13<1:10:12,  1.49s/it, lr: 1.0e-04 loss: 3.731e-01]
windy_storm:   6%|5         | 177/3000 [05:13<1:10:12,  1.49s/it, lr: 1.0e-04 loss: 3.731e-01]
windy_storm:   6%|5         | 177/3000 [05:13<1:10:12,  1.49s/it, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:   6%|5         | 177/3000 [05:13<1:10:12,  1.49s/it, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:   6%|5         | 178/3000 [05:13<1:00:03,  1.28s/it, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:   6%|5         | 178/3000 [05:13<1:00:03,  1.28s/it, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:   6%|5         | 178/3000 [05:16<1:00:03,  1.28s/it, lr: 1.0e-04 loss: 7.549e-02]
windy_storm:   6%|5         | 178/3000 [05:16<1:00:03,  1.28s/it, lr: 1.0e-04 loss: 7.549e-02]
windy_storm:   6%|5         | 179/3000 [05:16<1:23:46,  1.78s/it, lr: 1.0e-04 loss: 7.549e-02]
windy_storm:   6%|5         | 179/3000 [05:16<1:23:46,  1.78s/it, lr: 1.0e-04 loss: 7.549e-02]
windy_storm:   6%|5         | 179/3000 [05:19<1:23:46,  1.78s/it, lr: 1.0e-04 loss: 6.070e-01]
windy_storm:   6%|5         | 179/3000 [05:19<1:23:46,  1.78s/it, lr: 1.0e-04 loss: 6.070e-01]
windy_storm:   6%|6         | 180/3000 [05:22<1:23:44,  1.78s/it, lr: 1.0e-04 loss: 5.890e-01]
windy_storm:   6%|6         | 180/3000 [05:22<1:23:44,  1.78s/it, lr: 1.0e-04 loss: 5.890e-01]
windy_storm:   6%|6         | 181/3000 [05:22<1:17:51,  1.66s/it, lr: 1.0e-04 loss: 5.890e-01]
windy_storm:   6%|6         | 181/3000 [05:22<1:17:51,  1.66s/it, lr: 1.0e-04 loss: 5.890e-01]
windy_storm:   6%|6         | 181/3000 [05:25<1:17:51,  1.66s/it, lr: 1.0e-04 loss: 1.466e-01]
windy_storm:   6%|6         | 181/3000 [05:25<1:17:51,  1.66s/it, lr: 1.0e-04 loss: 1.466e-01]
windy_storm:   6%|6         | 182/3000 [05:25<1:32:17,  1.97s/it, lr: 1.0e-04 loss: 1.466e-01]
windy_storm:   6%|6         | 182/3000 [05:25<1:32:17,  1.97s/it, lr: 1.0e-04 loss: 1.466e-01]
windy_storm:   6%|6         | 182/3000 [05:27<1:32:17,  1.97s/it, lr: 1.0e-04 loss: 5.556e-01]
windy_storm:   6%|6         | 182/3000 [05:27<1:32:17,  1.97s/it, lr: 1.0e-04 loss: 5.556e-01]
windy_storm:   6%|6         | 183/3000 [05:27<1:27:32,  1.86s/it, lr: 1.0e-04 loss: 5.556e-01]
windy_storm:   6%|6         | 183/3000 [05:27<1:27:32,  1.86s/it, lr: 1.0e-04 loss: 5.556e-01]
windy_storm:   6%|6         | 183/3000 [05:30<1:27:32,  1.86s/it, lr: 1.0e-04 loss: 8.355e-02]
windy_storm:   6%|6         | 183/3000 [05:30<1:27:32,  1.86s/it, lr: 1.0e-04 loss: 8.355e-02]
windy_storm:   6%|6         | 184/3000 [05:30<1:41:48,  2.17s/it, lr: 1.0e-04 loss: 8.355e-02]
windy_storm:   6%|6         | 184/3000 [05:30<1:41:48,  2.17s/it, lr: 1.0e-04 loss: 8.355e-02]
windy_storm:   6%|6         | 184/3000 [05:33<1:41:48,  2.17s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:   6%|6         | 184/3000 [05:33<1:41:48,  2.17s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:   6%|6         | 185/3000 [05:33<1:51:36,  2.38s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:   6%|6         | 185/3000 [05:33<1:51:36,  2.38s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:   6%|6         | 185/3000 [05:34<1:51:36,  2.38s/it, lr: 1.0e-04 loss: 1.354e-01]
windy_storm:   6%|6         | 185/3000 [05:34<1:51:36,  2.38s/it, lr: 1.0e-04 loss: 1.354e-01]
windy_storm:   6%|6         | 186/3000 [05:34<1:40:54,  2.15s/it, lr: 1.0e-04 loss: 1.354e-01]
windy_storm:   6%|6         | 186/3000 [05:34<1:40:54,  2.15s/it, lr: 1.0e-04 loss: 1.354e-01]
windy_storm:   6%|6         | 186/3000 [05:37<1:40:54,  2.15s/it, lr: 1.0e-04 loss: 4.126e-01]
windy_storm:   6%|6         | 186/3000 [05:37<1:40:54,  2.15s/it, lr: 1.0e-04 loss: 4.126e-01]
windy_storm:   6%|6         | 187/3000 [05:37<1:51:11,  2.37s/it, lr: 1.0e-04 loss: 4.126e-01]
windy_storm:   6%|6         | 187/3000 [05:37<1:51:11,  2.37s/it, lr: 1.0e-04 loss: 4.126e-01]
windy_storm:   6%|6         | 187/3000 [05:39<1:51:11,  2.37s/it, lr: 1.0e-04 loss: 3.536e-01]
windy_storm:   6%|6         | 187/3000 [05:39<1:51:11,  2.37s/it, lr: 1.0e-04 loss: 3.536e-01]
windy_storm:   6%|6         | 188/3000 [05:39<1:40:00,  2.13s/it, lr: 1.0e-04 loss: 3.536e-01]
windy_storm:   6%|6         | 188/3000 [05:39<1:40:00,  2.13s/it, lr: 1.0e-04 loss: 3.536e-01]
windy_storm:   6%|6         | 188/3000 [05:40<1:40:00,  2.13s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:   6%|6         | 188/3000 [05:40<1:40:00,  2.13s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:   6%|6         | 189/3000 [05:40<1:21:05,  1.73s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:   6%|6         | 189/3000 [05:40<1:21:05,  1.73s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:   6%|6         | 189/3000 [05:41<1:21:05,  1.73s/it, lr: 1.0e-04 loss: 2.066e-01]
windy_storm:   6%|6         | 189/3000 [05:41<1:21:05,  1.73s/it, lr: 1.0e-04 loss: 2.066e-01]
windy_storm:   6%|6         | 190/3000 [05:42<1:21:04,  1.73s/it, lr: 1.0e-04 loss: 6.271e-01]
windy_storm:   6%|6         | 190/3000 [05:42<1:21:04,  1.73s/it, lr: 1.0e-04 loss: 6.271e-01]
windy_storm:   6%|6         | 191/3000 [05:42<52:46,  1.13s/it, lr: 1.0e-04 loss: 6.271e-01]  
windy_storm:   6%|6         | 191/3000 [05:42<52:46,  1.13s/it, lr: 1.0e-04 loss: 6.271e-01]  
windy_storm:   6%|6         | 191/3000 [05:45<52:46,  1.13s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:   6%|6         | 191/3000 [05:45<52:46,  1.13s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:   6%|6         | 192/3000 [05:45<1:14:27,  1.59s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:   6%|6         | 192/3000 [05:45<1:14:27,  1.59s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:   6%|6         | 192/3000 [05:45<1:14:27,  1.59s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:   6%|6         | 192/3000 [05:45<1:14:27,  1.59s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:   6%|6         | 193/3000 [05:45<1:04:39,  1.38s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:   6%|6         | 193/3000 [05:45<1:04:39,  1.38s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:   6%|6         | 193/3000 [05:48<1:04:39,  1.38s/it, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:   6%|6         | 193/3000 [05:48<1:04:39,  1.38s/it, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:   6%|6         | 194/3000 [05:48<1:24:33,  1.81s/it, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:   6%|6         | 194/3000 [05:48<1:24:33,  1.81s/it, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:   6%|6         | 194/3000 [05:51<1:24:33,  1.81s/it, lr: 1.0e-04 loss: 4.450e-02]
windy_storm:   6%|6         | 194/3000 [05:51<1:24:33,  1.81s/it, lr: 1.0e-04 loss: 4.450e-02]
windy_storm:   6%|6         | 195/3000 [05:51<1:40:16,  2.14s/it, lr: 1.0e-04 loss: 4.450e-02]
windy_storm:   6%|6         | 195/3000 [05:51<1:40:16,  2.14s/it, lr: 1.0e-04 loss: 4.450e-02]
windy_storm:   6%|6         | 195/3000 [05:52<1:40:16,  2.14s/it, lr: 1.0e-04 loss: 6.984e-01]
windy_storm:   6%|6         | 195/3000 [05:52<1:40:16,  2.14s/it, lr: 1.0e-04 loss: 6.984e-01]
windy_storm:   7%|6         | 196/3000 [05:52<1:22:37,  1.77s/it, lr: 1.0e-04 loss: 6.984e-01]
windy_storm:   7%|6         | 196/3000 [05:52<1:22:37,  1.77s/it, lr: 1.0e-04 loss: 6.984e-01]
windy_storm:   7%|6         | 196/3000 [05:54<1:22:37,  1.77s/it, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:   7%|6         | 196/3000 [05:54<1:22:37,  1.77s/it, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:   7%|6         | 197/3000 [05:54<1:20:11,  1.72s/it, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:   7%|6         | 197/3000 [05:54<1:20:11,  1.72s/it, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:   7%|6         | 197/3000 [05:55<1:20:11,  1.72s/it, lr: 1.0e-04 loss: 3.478e-02]
windy_storm:   7%|6         | 197/3000 [05:55<1:20:11,  1.72s/it, lr: 1.0e-04 loss: 3.478e-02]
windy_storm:   7%|6         | 198/3000 [05:55<1:18:15,  1.68s/it, lr: 1.0e-04 loss: 3.478e-02]
windy_storm:   7%|6         | 198/3000 [05:55<1:18:15,  1.68s/it, lr: 1.0e-04 loss: 3.478e-02]
windy_storm:   7%|6         | 198/3000 [05:57<1:18:15,  1.68s/it, lr: 1.0e-04 loss: 5.774e-01]
windy_storm:   7%|6         | 198/3000 [05:57<1:18:15,  1.68s/it, lr: 1.0e-04 loss: 5.774e-01]
windy_storm:   7%|6         | 199/3000 [05:57<1:16:47,  1.64s/it, lr: 1.0e-04 loss: 5.774e-01]
windy_storm:   7%|6         | 199/3000 [05:57<1:16:47,  1.64s/it, lr: 1.0e-04 loss: 5.774e-01]
windy_storm:   7%|6         | 199/3000 [06:00<1:16:47,  1.64s/it, lr: 1.0e-04 loss: 4.947e-01]
windy_storm:   7%|6         | 199/3000 [06:00<1:16:47,  1.64s/it, lr: 1.0e-04 loss: 4.947e-01]
windy_storm:   7%|6         | 200/3000 [06:01<1:16:45,  1.64s/it, lr: 1.0e-04 loss: 4.342e-01]
windy_storm:   7%|6         | 200/3000 [06:01<1:16:45,  1.64s/it, lr: 1.0e-04 loss: 4.342e-01]
windy_storm:   7%|6         | 201/3000 [06:01<49:44,  1.07s/it, lr: 1.0e-04 loss: 4.342e-01]  
windy_storm:   7%|6         | 201/3000 [06:01<49:44,  1.07s/it, lr: 1.0e-04 loss: 4.342e-01]  
windy_storm:   7%|6         | 201/3000 [06:01<49:44,  1.07s/it, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:   7%|6         | 201/3000 [06:01<49:44,  1.07s/it, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:   7%|6         | 202/3000 [06:01<46:27,  1.00it/s, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:   7%|6         | 202/3000 [06:01<46:27,  1.00it/s, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:   7%|6         | 202/3000 [06:04<46:27,  1.00it/s, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:   7%|6         | 202/3000 [06:04<46:27,  1.00it/s, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:   7%|6         | 203/3000 [06:05<1:12:42,  1.56s/it, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:   7%|6         | 203/3000 [06:05<1:12:42,  1.56s/it, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:   7%|6         | 203/3000 [06:06<1:12:42,  1.56s/it, lr: 1.0e-04 loss: 3.682e-01]
windy_storm:   7%|6         | 203/3000 [06:06<1:12:42,  1.56s/it, lr: 1.0e-04 loss: 3.682e-01]
windy_storm:   7%|6         | 204/3000 [06:06<1:12:58,  1.57s/it, lr: 1.0e-04 loss: 3.682e-01]
windy_storm:   7%|6         | 204/3000 [06:06<1:12:58,  1.57s/it, lr: 1.0e-04 loss: 3.682e-01]
windy_storm:   7%|6         | 204/3000 [06:08<1:12:58,  1.57s/it, lr: 1.0e-04 loss: 2.294e-01]
windy_storm:   7%|6         | 204/3000 [06:08<1:12:58,  1.57s/it, lr: 1.0e-04 loss: 2.294e-01]
windy_storm:   7%|6         | 205/3000 [06:08<1:12:47,  1.56s/it, lr: 1.0e-04 loss: 2.294e-01]
windy_storm:   7%|6         | 205/3000 [06:08<1:12:47,  1.56s/it, lr: 1.0e-04 loss: 2.294e-01]
windy_storm:   7%|6         | 205/3000 [06:11<1:12:47,  1.56s/it, lr: 1.0e-04 loss: 3.989e-01]
windy_storm:   7%|6         | 205/3000 [06:11<1:12:47,  1.56s/it, lr: 1.0e-04 loss: 3.989e-01]
windy_storm:   7%|6         | 206/3000 [06:11<1:31:54,  1.97s/it, lr: 1.0e-04 loss: 3.989e-01]
windy_storm:   7%|6         | 206/3000 [06:11<1:31:54,  1.97s/it, lr: 1.0e-04 loss: 3.989e-01]
windy_storm:   7%|6         | 206/3000 [06:14<1:31:54,  1.97s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:   7%|6         | 206/3000 [06:14<1:31:54,  1.97s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:   7%|6         | 207/3000 [06:14<1:44:32,  2.25s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:   7%|6         | 207/3000 [06:14<1:44:32,  2.25s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:   7%|6         | 207/3000 [06:14<1:44:32,  2.25s/it, lr: 1.0e-04 loss: 4.068e-01]
windy_storm:   7%|6         | 207/3000 [06:14<1:44:32,  2.25s/it, lr: 1.0e-04 loss: 4.068e-01]
windy_storm:   7%|6         | 208/3000 [06:14<1:24:23,  1.81s/it, lr: 1.0e-04 loss: 4.068e-01]
windy_storm:   7%|6         | 208/3000 [06:14<1:24:23,  1.81s/it, lr: 1.0e-04 loss: 4.068e-01]
windy_storm:   7%|6         | 208/3000 [06:15<1:24:23,  1.81s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:   7%|6         | 208/3000 [06:15<1:24:23,  1.81s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:   7%|6         | 209/3000 [06:15<1:10:55,  1.52s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:   7%|6         | 209/3000 [06:15<1:10:55,  1.52s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:   7%|6         | 209/3000 [06:17<1:10:55,  1.52s/it, lr: 1.0e-04 loss: 1.414e-01]
windy_storm:   7%|6         | 209/3000 [06:17<1:10:55,  1.52s/it, lr: 1.0e-04 loss: 1.414e-01]
windy_storm:   7%|7         | 210/3000 [06:18<1:10:54,  1.52s/it, lr: 1.0e-04 loss: 4.981e-01]
windy_storm:   7%|7         | 210/3000 [06:18<1:10:54,  1.52s/it, lr: 1.0e-04 loss: 4.981e-01]
windy_storm:   7%|7         | 211/3000 [06:18<47:08,  1.01s/it, lr: 1.0e-04 loss: 4.981e-01]  
windy_storm:   7%|7         | 211/3000 [06:18<47:08,  1.01s/it, lr: 1.0e-04 loss: 4.981e-01]  
windy_storm:   7%|7         | 211/3000 [06:21<47:08,  1.01s/it, lr: 1.0e-04 loss: 3.863e-02]
windy_storm:   7%|7         | 211/3000 [06:21<47:08,  1.01s/it, lr: 1.0e-04 loss: 3.863e-02]
windy_storm:   7%|7         | 212/3000 [06:21<1:10:02,  1.51s/it, lr: 1.0e-04 loss: 3.863e-02]
windy_storm:   7%|7         | 212/3000 [06:21<1:10:02,  1.51s/it, lr: 1.0e-04 loss: 3.863e-02]
windy_storm:   7%|7         | 212/3000 [06:24<1:10:02,  1.51s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:   7%|7         | 212/3000 [06:24<1:10:02,  1.51s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:   7%|7         | 213/3000 [06:24<1:26:42,  1.87s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:   7%|7         | 213/3000 [06:24<1:26:42,  1.87s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:   7%|7         | 213/3000 [06:24<1:26:42,  1.87s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:   7%|7         | 213/3000 [06:24<1:26:42,  1.87s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:   7%|7         | 214/3000 [06:24<1:13:32,  1.58s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:   7%|7         | 214/3000 [06:24<1:13:32,  1.58s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:   7%|7         | 214/3000 [06:26<1:13:32,  1.58s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:   7%|7         | 214/3000 [06:26<1:13:32,  1.58s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:   7%|7         | 215/3000 [06:26<1:13:30,  1.58s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:   7%|7         | 215/3000 [06:26<1:13:30,  1.58s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:   7%|7         | 215/3000 [06:29<1:13:30,  1.58s/it, lr: 1.0e-04 loss: 6.511e-01]
windy_storm:   7%|7         | 215/3000 [06:29<1:13:30,  1.58s/it, lr: 1.0e-04 loss: 6.511e-01]
windy_storm:   7%|7         | 216/3000 [06:29<1:32:20,  1.99s/it, lr: 1.0e-04 loss: 6.511e-01]
windy_storm:   7%|7         | 216/3000 [06:29<1:32:20,  1.99s/it, lr: 1.0e-04 loss: 6.511e-01]
windy_storm:   7%|7         | 216/3000 [06:30<1:32:20,  1.99s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:   7%|7         | 216/3000 [06:30<1:32:20,  1.99s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:   7%|7         | 217/3000 [06:30<1:19:54,  1.72s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:   7%|7         | 217/3000 [06:30<1:19:54,  1.72s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:   7%|7         | 217/3000 [06:33<1:19:54,  1.72s/it, lr: 1.0e-04 loss: 5.183e-01]
windy_storm:   7%|7         | 217/3000 [06:33<1:19:54,  1.72s/it, lr: 1.0e-04 loss: 5.183e-01]
windy_storm:   7%|7         | 218/3000 [06:33<1:36:17,  2.08s/it, lr: 1.0e-04 loss: 5.183e-01]
windy_storm:   7%|7         | 218/3000 [06:33<1:36:17,  2.08s/it, lr: 1.0e-04 loss: 5.183e-01]
windy_storm:   7%|7         | 218/3000 [06:34<1:36:17,  2.08s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:   7%|7         | 218/3000 [06:34<1:36:17,  2.08s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:   7%|7         | 219/3000 [06:34<1:29:11,  1.92s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:   7%|7         | 219/3000 [06:34<1:29:11,  1.92s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:   7%|7         | 219/3000 [06:37<1:29:11,  1.92s/it, lr: 1.0e-04 loss: 6.117e-01]
windy_storm:   7%|7         | 219/3000 [06:37<1:29:11,  1.92s/it, lr: 1.0e-04 loss: 6.117e-01]
windy_storm:   7%|7         | 220/3000 [06:41<1:29:10,  1.92s/it, lr: 1.0e-04 loss: 6.808e-01]
windy_storm:   7%|7         | 220/3000 [06:41<1:29:10,  1.92s/it, lr: 1.0e-04 loss: 6.808e-01]
windy_storm:   7%|7         | 221/3000 [06:41<1:20:21,  1.74s/it, lr: 1.0e-04 loss: 6.808e-01]
windy_storm:   7%|7         | 221/3000 [06:41<1:20:21,  1.74s/it, lr: 1.0e-04 loss: 6.808e-01]
windy_storm:   7%|7         | 221/3000 [06:44<1:20:21,  1.74s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:   7%|7         | 221/3000 [06:44<1:20:21,  1.74s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:   7%|7         | 222/3000 [06:44<1:34:51,  2.05s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:   7%|7         | 222/3000 [06:44<1:34:51,  2.05s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:   7%|7         | 222/3000 [06:44<1:34:51,  2.05s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:   7%|7         | 222/3000 [06:44<1:34:51,  2.05s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:   7%|7         | 223/3000 [06:44<1:20:08,  1.73s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:   7%|7         | 223/3000 [06:44<1:20:08,  1.73s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:   7%|7         | 223/3000 [06:45<1:20:08,  1.73s/it, lr: 1.0e-04 loss: 4.057e-01]
windy_storm:   7%|7         | 223/3000 [06:45<1:20:08,  1.73s/it, lr: 1.0e-04 loss: 4.057e-01]
windy_storm:   7%|7         | 224/3000 [06:45<1:08:47,  1.49s/it, lr: 1.0e-04 loss: 4.057e-01]
windy_storm:   7%|7         | 224/3000 [06:45<1:08:47,  1.49s/it, lr: 1.0e-04 loss: 4.057e-01]
windy_storm:   7%|7         | 224/3000 [06:46<1:08:47,  1.49s/it, lr: 1.0e-04 loss: 5.323e-01]
windy_storm:   7%|7         | 224/3000 [06:46<1:08:47,  1.49s/it, lr: 1.0e-04 loss: 5.323e-01]
windy_storm:   8%|7         | 225/3000 [06:46<1:00:09,  1.30s/it, lr: 1.0e-04 loss: 5.323e-01]
windy_storm:   8%|7         | 225/3000 [06:46<1:00:09,  1.30s/it, lr: 1.0e-04 loss: 5.323e-01]
windy_storm:   8%|7         | 225/3000 [06:48<1:00:09,  1.30s/it, lr: 1.0e-04 loss: 1.228e-01]
windy_storm:   8%|7         | 225/3000 [06:48<1:00:09,  1.30s/it, lr: 1.0e-04 loss: 1.228e-01]
windy_storm:   8%|7         | 226/3000 [06:48<1:03:40,  1.38s/it, lr: 1.0e-04 loss: 1.228e-01]
windy_storm:   8%|7         | 226/3000 [06:48<1:03:40,  1.38s/it, lr: 1.0e-04 loss: 1.228e-01]
windy_storm:   8%|7         | 226/3000 [06:49<1:03:40,  1.38s/it, lr: 1.0e-04 loss: 1.753e-01]
windy_storm:   8%|7         | 226/3000 [06:49<1:03:40,  1.38s/it, lr: 1.0e-04 loss: 1.753e-01]
windy_storm:   8%|7         | 227/3000 [06:49<1:06:40,  1.44s/it, lr: 1.0e-04 loss: 1.753e-01]
windy_storm:   8%|7         | 227/3000 [06:49<1:06:40,  1.44s/it, lr: 1.0e-04 loss: 1.753e-01]
windy_storm:   8%|7         | 227/3000 [06:50<1:06:40,  1.44s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:   8%|7         | 227/3000 [06:50<1:06:40,  1.44s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:   8%|7         | 228/3000 [06:50<57:26,  1.24s/it, lr: 1.0e-04 loss: 1.684e-01]  
windy_storm:   8%|7         | 228/3000 [06:50<57:26,  1.24s/it, lr: 1.0e-04 loss: 1.684e-01]  
windy_storm:   8%|7         | 228/3000 [06:51<57:26,  1.24s/it, lr: 1.0e-04 loss: 6.189e-01]
windy_storm:   8%|7         | 228/3000 [06:51<57:26,  1.24s/it, lr: 1.0e-04 loss: 6.189e-01]
windy_storm:   8%|7         | 229/3000 [06:51<51:42,  1.12s/it, lr: 1.0e-04 loss: 6.189e-01]
windy_storm:   8%|7         | 229/3000 [06:51<51:42,  1.12s/it, lr: 1.0e-04 loss: 6.189e-01]
windy_storm:   8%|7         | 229/3000 [06:53<51:42,  1.12s/it, lr: 1.0e-04 loss: 1.110e-01]
windy_storm:   8%|7         | 229/3000 [06:53<51:42,  1.12s/it, lr: 1.0e-04 loss: 1.110e-01]
windy_storm:   8%|7         | 230/3000 [06:56<51:41,  1.12s/it, lr: 1.0e-04 loss: 5.215e-01]
windy_storm:   8%|7         | 230/3000 [06:56<51:41,  1.12s/it, lr: 1.0e-04 loss: 5.215e-01]
windy_storm:   8%|7         | 231/3000 [06:56<1:00:10,  1.30s/it, lr: 1.0e-04 loss: 5.215e-01]
windy_storm:   8%|7         | 231/3000 [06:56<1:00:10,  1.30s/it, lr: 1.0e-04 loss: 5.215e-01]
windy_storm:   8%|7         | 231/3000 [06:57<1:00:10,  1.30s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:   8%|7         | 231/3000 [06:57<1:00:10,  1.30s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:   8%|7         | 232/3000 [06:57<1:03:18,  1.37s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:   8%|7         | 232/3000 [06:57<1:03:18,  1.37s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:   8%|7         | 232/3000 [06:58<1:03:18,  1.37s/it, lr: 1.0e-04 loss: 6.182e-01]
windy_storm:   8%|7         | 232/3000 [06:58<1:03:18,  1.37s/it, lr: 1.0e-04 loss: 6.182e-01]
windy_storm:   8%|7         | 233/3000 [06:58<56:05,  1.22s/it, lr: 1.0e-04 loss: 6.182e-01]  
windy_storm:   8%|7         | 233/3000 [06:58<56:05,  1.22s/it, lr: 1.0e-04 loss: 6.182e-01]  
windy_storm:   8%|7         | 233/3000 [07:01<56:05,  1.22s/it, lr: 1.0e-04 loss: 3.293e-01]
windy_storm:   8%|7         | 233/3000 [07:01<56:05,  1.22s/it, lr: 1.0e-04 loss: 3.293e-01]
windy_storm:   8%|7         | 234/3000 [07:01<1:17:52,  1.69s/it, lr: 1.0e-04 loss: 3.293e-01]
windy_storm:   8%|7         | 234/3000 [07:01<1:17:52,  1.69s/it, lr: 1.0e-04 loss: 3.293e-01]
windy_storm:   8%|7         | 234/3000 [07:04<1:17:52,  1.69s/it, lr: 1.0e-04 loss: 6.517e-01]
windy_storm:   8%|7         | 234/3000 [07:04<1:17:52,  1.69s/it, lr: 1.0e-04 loss: 6.517e-01]
windy_storm:   8%|7         | 235/3000 [07:04<1:35:12,  2.07s/it, lr: 1.0e-04 loss: 6.517e-01]
windy_storm:   8%|7         | 235/3000 [07:04<1:35:12,  2.07s/it, lr: 1.0e-04 loss: 6.517e-01]
windy_storm:   8%|7         | 235/3000 [07:05<1:35:12,  2.07s/it, lr: 1.0e-04 loss: 1.766e-02]
windy_storm:   8%|7         | 235/3000 [07:05<1:35:12,  2.07s/it, lr: 1.0e-04 loss: 1.766e-02]
windy_storm:   8%|7         | 236/3000 [07:05<1:18:00,  1.69s/it, lr: 1.0e-04 loss: 1.766e-02]
windy_storm:   8%|7         | 236/3000 [07:05<1:18:00,  1.69s/it, lr: 1.0e-04 loss: 1.766e-02]
windy_storm:   8%|7         | 236/3000 [07:06<1:18:00,  1.69s/it, lr: 1.0e-04 loss: 5.510e-01]
windy_storm:   8%|7         | 236/3000 [07:06<1:18:00,  1.69s/it, lr: 1.0e-04 loss: 5.510e-01]
windy_storm:   8%|7         | 237/3000 [07:06<1:16:30,  1.66s/it, lr: 1.0e-04 loss: 5.510e-01]
windy_storm:   8%|7         | 237/3000 [07:06<1:16:30,  1.66s/it, lr: 1.0e-04 loss: 5.510e-01]
windy_storm:   8%|7         | 237/3000 [07:09<1:16:30,  1.66s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:   8%|7         | 237/3000 [07:09<1:16:30,  1.66s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:   8%|7         | 238/3000 [07:09<1:34:04,  2.04s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:   8%|7         | 238/3000 [07:09<1:34:04,  2.04s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:   8%|7         | 238/3000 [07:11<1:34:04,  2.04s/it, lr: 1.0e-04 loss: 6.652e-01]
windy_storm:   8%|7         | 238/3000 [07:11<1:34:04,  2.04s/it, lr: 1.0e-04 loss: 6.652e-01]
windy_storm:   8%|7         | 239/3000 [07:11<1:27:52,  1.91s/it, lr: 1.0e-04 loss: 6.652e-01]
windy_storm:   8%|7         | 239/3000 [07:11<1:27:52,  1.91s/it, lr: 1.0e-04 loss: 6.652e-01]
windy_storm:   8%|7         | 239/3000 [07:13<1:27:52,  1.91s/it, lr: 1.0e-04 loss: 6.162e-01]
windy_storm:   8%|7         | 239/3000 [07:13<1:27:52,  1.91s/it, lr: 1.0e-04 loss: 6.162e-01]
windy_storm:   8%|8         | 240/3000 [07:16<1:27:50,  1.91s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   8%|8         | 240/3000 [07:16<1:27:50,  1.91s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   8%|8         | 241/3000 [07:16<1:18:26,  1.71s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   8%|8         | 241/3000 [07:16<1:18:26,  1.71s/it, lr: 1.0e-04 loss: 6.295e-01]
windy_storm:   8%|8         | 241/3000 [07:17<1:18:26,  1.71s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:   8%|8         | 241/3000 [07:17<1:18:26,  1.71s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:   8%|8         | 242/3000 [07:17<1:17:10,  1.68s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:   8%|8         | 242/3000 [07:17<1:17:10,  1.68s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:   8%|8         | 242/3000 [07:19<1:17:10,  1.68s/it, lr: 1.0e-04 loss: 2.177e-02]
windy_storm:   8%|8         | 242/3000 [07:19<1:17:10,  1.68s/it, lr: 1.0e-04 loss: 2.177e-02]
windy_storm:   8%|8         | 243/3000 [07:19<1:15:54,  1.65s/it, lr: 1.0e-04 loss: 2.177e-02]
windy_storm:   8%|8         | 243/3000 [07:19<1:15:54,  1.65s/it, lr: 1.0e-04 loss: 2.177e-02]
windy_storm:   8%|8         | 243/3000 [07:20<1:15:54,  1.65s/it, lr: 1.0e-04 loss: 8.167e-02]
windy_storm:   8%|8         | 243/3000 [07:20<1:15:54,  1.65s/it, lr: 1.0e-04 loss: 8.167e-02]
windy_storm:   8%|8         | 244/3000 [07:20<1:09:20,  1.51s/it, lr: 1.0e-04 loss: 8.167e-02]
windy_storm:   8%|8         | 244/3000 [07:20<1:09:20,  1.51s/it, lr: 1.0e-04 loss: 8.167e-02]
windy_storm:   8%|8         | 244/3000 [07:23<1:09:20,  1.51s/it, lr: 1.0e-04 loss: 5.714e-01]
windy_storm:   8%|8         | 244/3000 [07:23<1:09:20,  1.51s/it, lr: 1.0e-04 loss: 5.714e-01]
windy_storm:   8%|8         | 245/3000 [07:23<1:27:30,  1.91s/it, lr: 1.0e-04 loss: 5.714e-01]
windy_storm:   8%|8         | 245/3000 [07:23<1:27:30,  1.91s/it, lr: 1.0e-04 loss: 5.714e-01]
windy_storm:   8%|8         | 245/3000 [07:24<1:27:30,  1.91s/it, lr: 1.0e-04 loss: 6.363e-01]
windy_storm:   8%|8         | 245/3000 [07:24<1:27:30,  1.91s/it, lr: 1.0e-04 loss: 6.363e-01]
windy_storm:   8%|8         | 246/3000 [07:24<1:12:35,  1.58s/it, lr: 1.0e-04 loss: 6.363e-01]
windy_storm:   8%|8         | 246/3000 [07:24<1:12:35,  1.58s/it, lr: 1.0e-04 loss: 6.363e-01]
windy_storm:   8%|8         | 246/3000 [07:25<1:12:35,  1.58s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:   8%|8         | 246/3000 [07:25<1:12:35,  1.58s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:   8%|8         | 247/3000 [07:25<1:02:26,  1.36s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:   8%|8         | 247/3000 [07:25<1:02:26,  1.36s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:   8%|8         | 247/3000 [07:26<1:02:26,  1.36s/it, lr: 1.0e-04 loss: 6.385e-01]
windy_storm:   8%|8         | 247/3000 [07:26<1:02:26,  1.36s/it, lr: 1.0e-04 loss: 6.385e-01]
windy_storm:   8%|8         | 248/3000 [07:26<1:05:23,  1.43s/it, lr: 1.0e-04 loss: 6.385e-01]
windy_storm:   8%|8         | 248/3000 [07:26<1:05:23,  1.43s/it, lr: 1.0e-04 loss: 6.385e-01]
windy_storm:   8%|8         | 248/3000 [07:29<1:05:23,  1.43s/it, lr: 1.0e-04 loss: 8.097e-02]
windy_storm:   8%|8         | 248/3000 [07:29<1:05:23,  1.43s/it, lr: 1.0e-04 loss: 8.097e-02]
windy_storm:   8%|8         | 249/3000 [07:29<1:26:35,  1.89s/it, lr: 1.0e-04 loss: 8.097e-02]
windy_storm:   8%|8         | 249/3000 [07:29<1:26:35,  1.89s/it, lr: 1.0e-04 loss: 8.097e-02]
windy_storm:   8%|8         | 249/3000 [07:31<1:26:35,  1.89s/it, lr: 1.0e-04 loss: 6.523e-01]
windy_storm:   8%|8         | 249/3000 [07:31<1:26:35,  1.89s/it, lr: 1.0e-04 loss: 6.523e-01]
Saving at step 250
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000000250.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt

windy_storm:   8%|8         | 250/3000 [07:34<1:26:33,  1.89s/it, lr: 1.0e-04 loss: 7.430e-02]
windy_storm:   8%|8         | 250/3000 [07:34<1:26:33,  1.89s/it, lr: 1.0e-04 loss: 7.430e-02]
windy_storm:   8%|8         | 251/3000 [07:34<1:20:51,  1.76s/it, lr: 1.0e-04 loss: 7.430e-02]
windy_storm:   8%|8         | 251/3000 [07:34<1:20:51,  1.76s/it, lr: 1.0e-04 loss: 7.430e-02]
windy_storm:   8%|8         | 251/3000 [07:37<1:20:51,  1.76s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:   8%|8         | 251/3000 [07:37<1:20:51,  1.76s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:   8%|8         | 252/3000 [07:37<1:34:48,  2.07s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:   8%|8         | 252/3000 [07:37<1:34:48,  2.07s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:   8%|8         | 252/3000 [07:40<1:34:48,  2.07s/it, lr: 1.0e-04 loss: 5.452e-01]
windy_storm:   8%|8         | 252/3000 [07:40<1:34:48,  2.07s/it, lr: 1.0e-04 loss: 5.452e-01]
windy_storm:   8%|8         | 253/3000 [07:40<1:45:21,  2.30s/it, lr: 1.0e-04 loss: 5.452e-01]
windy_storm:   8%|8         | 253/3000 [07:40<1:45:21,  2.30s/it, lr: 1.0e-04 loss: 5.452e-01]
windy_storm:   8%|8         | 253/3000 [07:42<1:45:21,  2.30s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:   8%|8         | 253/3000 [07:42<1:45:21,  2.30s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:   8%|8         | 254/3000 [07:42<1:35:37,  2.09s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:   8%|8         | 254/3000 [07:42<1:35:37,  2.09s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:   8%|8         | 254/3000 [07:43<1:35:37,  2.09s/it, lr: 1.0e-04 loss: 2.626e-01]
windy_storm:   8%|8         | 254/3000 [07:43<1:35:37,  2.09s/it, lr: 1.0e-04 loss: 2.626e-01]
windy_storm:   8%|8         | 255/3000 [07:43<1:29:02,  1.95s/it, lr: 1.0e-04 loss: 2.626e-01]
windy_storm:   8%|8         | 255/3000 [07:43<1:29:02,  1.95s/it, lr: 1.0e-04 loss: 2.626e-01]
windy_storm:   8%|8         | 255/3000 [07:45<1:29:02,  1.95s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:   8%|8         | 255/3000 [07:45<1:29:02,  1.95s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:   9%|8         | 256/3000 [07:45<1:24:18,  1.84s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:   9%|8         | 256/3000 [07:45<1:24:18,  1.84s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:   9%|8         | 256/3000 [07:46<1:24:18,  1.84s/it, lr: 1.0e-04 loss: 2.090e-01]
windy_storm:   9%|8         | 256/3000 [07:46<1:24:18,  1.84s/it, lr: 1.0e-04 loss: 2.090e-01]
windy_storm:   9%|8         | 257/3000 [07:46<1:21:02,  1.77s/it, lr: 1.0e-04 loss: 2.090e-01]
windy_storm:   9%|8         | 257/3000 [07:46<1:21:02,  1.77s/it, lr: 1.0e-04 loss: 2.090e-01]
windy_storm:   9%|8         | 257/3000 [07:47<1:21:02,  1.77s/it, lr: 1.0e-04 loss: 2.091e-01]
windy_storm:   9%|8         | 257/3000 [07:47<1:21:02,  1.77s/it, lr: 1.0e-04 loss: 2.091e-01]
windy_storm:   9%|8         | 258/3000 [07:47<1:08:17,  1.49s/it, lr: 1.0e-04 loss: 2.091e-01]
windy_storm:   9%|8         | 258/3000 [07:47<1:08:17,  1.49s/it, lr: 1.0e-04 loss: 2.091e-01]
windy_storm:   9%|8         | 258/3000 [07:48<1:08:17,  1.49s/it, lr: 1.0e-04 loss: 4.174e-01]
windy_storm:   9%|8         | 258/3000 [07:48<1:08:17,  1.49s/it, lr: 1.0e-04 loss: 4.174e-01]
windy_storm:   9%|8         | 259/3000 [07:48<58:24,  1.28s/it, lr: 1.0e-04 loss: 4.174e-01]  
windy_storm:   9%|8         | 259/3000 [07:48<58:24,  1.28s/it, lr: 1.0e-04 loss: 4.174e-01]  
windy_storm:   9%|8         | 259/3000 [07:51<58:24,  1.28s/it, lr: 1.0e-04 loss: 9.566e-02]
windy_storm:   9%|8         | 259/3000 [07:51<58:24,  1.28s/it, lr: 1.0e-04 loss: 9.566e-02]
windy_storm:   9%|8         | 260/3000 [07:52<58:23,  1.28s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:   9%|8         | 260/3000 [07:52<58:23,  1.28s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:   9%|8         | 261/3000 [07:52<48:12,  1.06s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:   9%|8         | 261/3000 [07:52<48:12,  1.06s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:   9%|8         | 261/3000 [07:54<48:12,  1.06s/it, lr: 1.0e-04 loss: 5.142e-01]
windy_storm:   9%|8         | 261/3000 [07:54<48:12,  1.06s/it, lr: 1.0e-04 loss: 5.142e-01]
windy_storm:   9%|8         | 262/3000 [07:54<54:07,  1.19s/it, lr: 1.0e-04 loss: 5.142e-01]
windy_storm:   9%|8         | 262/3000 [07:54<54:07,  1.19s/it, lr: 1.0e-04 loss: 5.142e-01]
windy_storm:   9%|8         | 262/3000 [07:55<54:07,  1.19s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:   9%|8         | 262/3000 [07:55<54:07,  1.19s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:   9%|8         | 263/3000 [07:55<51:54,  1.14s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:   9%|8         | 263/3000 [07:55<51:54,  1.14s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:   9%|8         | 263/3000 [07:58<51:54,  1.14s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:   9%|8         | 263/3000 [07:58<51:54,  1.14s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:   9%|8         | 264/3000 [07:58<1:14:56,  1.64s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:   9%|8         | 264/3000 [07:58<1:14:56,  1.64s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:   9%|8         | 264/3000 [08:00<1:14:56,  1.64s/it, lr: 1.0e-04 loss: 1.565e-01]
windy_storm:   9%|8         | 264/3000 [08:00<1:14:56,  1.64s/it, lr: 1.0e-04 loss: 1.565e-01]
windy_storm:   9%|8         | 265/3000 [08:00<1:14:09,  1.63s/it, lr: 1.0e-04 loss: 1.565e-01]
windy_storm:   9%|8         | 265/3000 [08:00<1:14:09,  1.63s/it, lr: 1.0e-04 loss: 1.565e-01]
windy_storm:   9%|8         | 265/3000 [08:01<1:14:09,  1.63s/it, lr: 1.0e-04 loss: 2.503e-01]
windy_storm:   9%|8         | 265/3000 [08:01<1:14:09,  1.63s/it, lr: 1.0e-04 loss: 2.503e-01]
windy_storm:   9%|8         | 266/3000 [08:01<1:13:19,  1.61s/it, lr: 1.0e-04 loss: 2.503e-01]
windy_storm:   9%|8         | 266/3000 [08:01<1:13:19,  1.61s/it, lr: 1.0e-04 loss: 2.503e-01]
windy_storm:   9%|8         | 266/3000 [08:02<1:13:19,  1.61s/it, lr: 1.0e-04 loss: 4.907e-01]
windy_storm:   9%|8         | 266/3000 [08:02<1:13:19,  1.61s/it, lr: 1.0e-04 loss: 4.907e-01]
windy_storm:   9%|8         | 267/3000 [08:02<1:02:52,  1.38s/it, lr: 1.0e-04 loss: 4.907e-01]
windy_storm:   9%|8         | 267/3000 [08:02<1:02:52,  1.38s/it, lr: 1.0e-04 loss: 4.907e-01]
windy_storm:   9%|8         | 267/3000 [08:04<1:02:52,  1.38s/it, lr: 1.0e-04 loss: 2.248e-01]
windy_storm:   9%|8         | 267/3000 [08:04<1:02:52,  1.38s/it, lr: 1.0e-04 loss: 2.248e-01]
windy_storm:   9%|8         | 268/3000 [08:04<1:05:57,  1.45s/it, lr: 1.0e-04 loss: 2.248e-01]
windy_storm:   9%|8         | 268/3000 [08:04<1:05:57,  1.45s/it, lr: 1.0e-04 loss: 2.248e-01]
windy_storm:   9%|8         | 268/3000 [08:05<1:05:57,  1.45s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:   9%|8         | 268/3000 [08:05<1:05:57,  1.45s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:   9%|8         | 269/3000 [08:05<1:07:45,  1.49s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:   9%|8         | 269/3000 [08:05<1:07:45,  1.49s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:   9%|8         | 269/3000 [08:06<1:07:45,  1.49s/it, lr: 1.0e-04 loss: 5.666e-01]
windy_storm:   9%|8         | 269/3000 [08:06<1:07:45,  1.49s/it, lr: 1.0e-04 loss: 5.666e-01]
windy_storm:   9%|9         | 270/3000 [08:07<1:07:43,  1.49s/it, lr: 1.0e-04 loss: 5.747e-01]
windy_storm:   9%|9         | 270/3000 [08:07<1:07:43,  1.49s/it, lr: 1.0e-04 loss: 5.747e-01]
windy_storm:   9%|9         | 271/3000 [08:07<45:20,  1.00it/s, lr: 1.0e-04 loss: 5.747e-01]  
windy_storm:   9%|9         | 271/3000 [08:07<45:20,  1.00it/s, lr: 1.0e-04 loss: 5.747e-01]  
windy_storm:   9%|9         | 271/3000 [08:08<45:20,  1.00it/s, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   9%|9         | 271/3000 [08:08<45:20,  1.00it/s, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   9%|9         | 272/3000 [08:08<42:41,  1.07it/s, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   9%|9         | 272/3000 [08:08<42:41,  1.07it/s, lr: 1.0e-04 loss: 2.975e-01]
windy_storm:   9%|9         | 272/3000 [08:11<42:41,  1.07it/s, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   9%|9         | 272/3000 [08:11<42:41,  1.07it/s, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   9%|9         | 273/3000 [08:11<1:06:36,  1.47s/it, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   9%|9         | 273/3000 [08:11<1:06:36,  1.47s/it, lr: 1.0e-04 loss: 6.604e-01]
windy_storm:   9%|9         | 273/3000 [08:12<1:06:36,  1.47s/it, lr: 1.0e-04 loss: 3.229e-01]
windy_storm:   9%|9         | 273/3000 [08:12<1:06:36,  1.47s/it, lr: 1.0e-04 loss: 3.229e-01]
windy_storm:   9%|9         | 274/3000 [08:12<1:08:05,  1.50s/it, lr: 1.0e-04 loss: 3.229e-01]
windy_storm:   9%|9         | 274/3000 [08:12<1:08:05,  1.50s/it, lr: 1.0e-04 loss: 3.229e-01]
windy_storm:   9%|9         | 274/3000 [08:14<1:08:05,  1.50s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:   9%|9         | 274/3000 [08:14<1:08:05,  1.50s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:   9%|9         | 275/3000 [08:14<1:08:59,  1.52s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:   9%|9         | 275/3000 [08:14<1:08:59,  1.52s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:   9%|9         | 275/3000 [08:14<1:08:59,  1.52s/it, lr: 1.0e-04 loss: 4.834e-01]
windy_storm:   9%|9         | 275/3000 [08:14<1:08:59,  1.52s/it, lr: 1.0e-04 loss: 4.834e-01]
windy_storm:   9%|9         | 276/3000 [08:14<59:07,  1.30s/it, lr: 1.0e-04 loss: 4.834e-01]  
windy_storm:   9%|9         | 276/3000 [08:14<59:07,  1.30s/it, lr: 1.0e-04 loss: 4.834e-01]  
windy_storm:   9%|9         | 276/3000 [08:18<59:07,  1.30s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:   9%|9         | 276/3000 [08:18<59:07,  1.30s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:   9%|9         | 277/3000 [08:18<1:23:03,  1.83s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:   9%|9         | 277/3000 [08:18<1:23:03,  1.83s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:   9%|9         | 277/3000 [08:18<1:23:03,  1.83s/it, lr: 1.0e-04 loss: 3.337e-01]
windy_storm:   9%|9         | 277/3000 [08:18<1:23:03,  1.83s/it, lr: 1.0e-04 loss: 3.337e-01]
windy_storm:   9%|9         | 278/3000 [08:18<1:09:41,  1.54s/it, lr: 1.0e-04 loss: 3.337e-01]
windy_storm:   9%|9         | 278/3000 [08:18<1:09:41,  1.54s/it, lr: 1.0e-04 loss: 3.337e-01]
windy_storm:   9%|9         | 278/3000 [08:19<1:09:41,  1.54s/it, lr: 1.0e-04 loss: 6.750e-01]
windy_storm:   9%|9         | 278/3000 [08:19<1:09:41,  1.54s/it, lr: 1.0e-04 loss: 6.750e-01]
windy_storm:   9%|9         | 279/3000 [08:19<59:30,  1.31s/it, lr: 1.0e-04 loss: 6.750e-01]  
windy_storm:   9%|9         | 279/3000 [08:19<59:30,  1.31s/it, lr: 1.0e-04 loss: 6.750e-01]  
windy_storm:   9%|9         | 279/3000 [08:21<59:30,  1.31s/it, lr: 1.0e-04 loss: 5.384e-02]
windy_storm:   9%|9         | 279/3000 [08:21<59:30,  1.31s/it, lr: 1.0e-04 loss: 5.384e-02]
windy_storm:   9%|9         | 280/3000 [08:22<59:28,  1.31s/it, lr: 1.0e-04 loss: 5.955e-01]
windy_storm:   9%|9         | 280/3000 [08:22<59:28,  1.31s/it, lr: 1.0e-04 loss: 5.955e-01]
windy_storm:   9%|9         | 281/3000 [08:22<48:24,  1.07s/it, lr: 1.0e-04 loss: 5.955e-01]
windy_storm:   9%|9         | 281/3000 [08:22<48:24,  1.07s/it, lr: 1.0e-04 loss: 5.955e-01]
windy_storm:   9%|9         | 281/3000 [08:25<48:24,  1.07s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:   9%|9         | 281/3000 [08:25<48:24,  1.07s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:   9%|9         | 282/3000 [08:25<1:09:31,  1.53s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:   9%|9         | 282/3000 [08:25<1:09:31,  1.53s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:   9%|9         | 282/3000 [08:26<1:09:31,  1.53s/it, lr: 1.0e-04 loss: 6.436e-01]
windy_storm:   9%|9         | 282/3000 [08:26<1:09:31,  1.53s/it, lr: 1.0e-04 loss: 6.436e-01]
windy_storm:   9%|9         | 283/3000 [08:26<1:00:22,  1.33s/it, lr: 1.0e-04 loss: 6.436e-01]
windy_storm:   9%|9         | 283/3000 [08:26<1:00:22,  1.33s/it, lr: 1.0e-04 loss: 6.436e-01]
windy_storm:   9%|9         | 283/3000 [08:28<1:00:22,  1.33s/it, lr: 1.0e-04 loss: 1.589e-01]
windy_storm:   9%|9         | 283/3000 [08:28<1:00:22,  1.33s/it, lr: 1.0e-04 loss: 1.589e-01]
windy_storm:   9%|9         | 284/3000 [08:28<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 1.589e-01]
windy_storm:   9%|9         | 284/3000 [08:28<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 1.589e-01]
windy_storm:   9%|9         | 284/3000 [08:31<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 5.026e-02]
windy_storm:   9%|9         | 284/3000 [08:31<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 5.026e-02]
windy_storm:  10%|9         | 285/3000 [08:31<1:23:22,  1.84s/it, lr: 1.0e-04 loss: 5.026e-02]
windy_storm:  10%|9         | 285/3000 [08:31<1:23:22,  1.84s/it, lr: 1.0e-04 loss: 5.026e-02]
windy_storm:  10%|9         | 285/3000 [08:31<1:23:22,  1.84s/it, lr: 1.0e-04 loss: 5.816e-01]
windy_storm:  10%|9         | 285/3000 [08:31<1:23:22,  1.84s/it, lr: 1.0e-04 loss: 5.816e-01]
windy_storm:  10%|9         | 286/3000 [08:31<1:10:24,  1.56s/it, lr: 1.0e-04 loss: 5.816e-01]
windy_storm:  10%|9         | 286/3000 [08:31<1:10:24,  1.56s/it, lr: 1.0e-04 loss: 5.816e-01]
windy_storm:  10%|9         | 286/3000 [08:32<1:10:24,  1.56s/it, lr: 1.0e-04 loss: 6.298e-01]
windy_storm:  10%|9         | 286/3000 [08:32<1:10:24,  1.56s/it, lr: 1.0e-04 loss: 6.298e-01]
windy_storm:  10%|9         | 287/3000 [08:32<1:00:14,  1.33s/it, lr: 1.0e-04 loss: 6.298e-01]
windy_storm:  10%|9         | 287/3000 [08:32<1:00:14,  1.33s/it, lr: 1.0e-04 loss: 6.298e-01]
windy_storm:  10%|9         | 287/3000 [08:34<1:00:14,  1.33s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  10%|9         | 287/3000 [08:34<1:00:14,  1.33s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  10%|9         | 288/3000 [08:34<1:03:40,  1.41s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  10%|9         | 288/3000 [08:34<1:03:40,  1.41s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  10%|9         | 288/3000 [08:35<1:03:40,  1.41s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  10%|9         | 288/3000 [08:35<1:03:40,  1.41s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  10%|9         | 289/3000 [08:35<1:05:45,  1.46s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  10%|9         | 289/3000 [08:35<1:05:45,  1.46s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  10%|9         | 289/3000 [08:38<1:05:45,  1.46s/it, lr: 1.0e-04 loss: 7.664e-02]
windy_storm:  10%|9         | 289/3000 [08:38<1:05:45,  1.46s/it, lr: 1.0e-04 loss: 7.664e-02]
windy_storm:  10%|9         | 290/3000 [08:39<1:05:44,  1.46s/it, lr: 1.0e-04 loss: 3.768e-01]
windy_storm:  10%|9         | 290/3000 [08:39<1:05:44,  1.46s/it, lr: 1.0e-04 loss: 3.768e-01]
windy_storm:  10%|9         | 291/3000 [08:39<46:42,  1.03s/it, lr: 1.0e-04 loss: 3.768e-01]  
windy_storm:  10%|9         | 291/3000 [08:39<46:42,  1.03s/it, lr: 1.0e-04 loss: 3.768e-01]  
windy_storm:  10%|9         | 291/3000 [08:40<46:42,  1.03s/it, lr: 1.0e-04 loss: 6.933e-01]
windy_storm:  10%|9         | 291/3000 [08:40<46:42,  1.03s/it, lr: 1.0e-04 loss: 6.933e-01]
windy_storm:  10%|9         | 292/3000 [08:40<44:31,  1.01it/s, lr: 1.0e-04 loss: 6.933e-01]
windy_storm:  10%|9         | 292/3000 [08:40<44:31,  1.01it/s, lr: 1.0e-04 loss: 6.933e-01]
windy_storm:  10%|9         | 292/3000 [08:42<44:31,  1.01it/s, lr: 1.0e-04 loss: 4.664e-02]
windy_storm:  10%|9         | 292/3000 [08:42<44:31,  1.01it/s, lr: 1.0e-04 loss: 4.664e-02]
windy_storm:  10%|9         | 293/3000 [08:42<51:30,  1.14s/it, lr: 1.0e-04 loss: 4.664e-02]
windy_storm:  10%|9         | 293/3000 [08:42<51:30,  1.14s/it, lr: 1.0e-04 loss: 4.664e-02]
windy_storm:  10%|9         | 293/3000 [08:44<51:30,  1.14s/it, lr: 1.0e-04 loss: 3.936e-01]
windy_storm:  10%|9         | 293/3000 [08:44<51:30,  1.14s/it, lr: 1.0e-04 loss: 3.936e-01]
windy_storm:  10%|9         | 294/3000 [08:44<57:08,  1.27s/it, lr: 1.0e-04 loss: 3.936e-01]
windy_storm:  10%|9         | 294/3000 [08:44<57:08,  1.27s/it, lr: 1.0e-04 loss: 3.936e-01]
windy_storm:  10%|9         | 294/3000 [08:47<57:08,  1.27s/it, lr: 1.0e-04 loss: 6.337e-01]
windy_storm:  10%|9         | 294/3000 [08:47<57:08,  1.27s/it, lr: 1.0e-04 loss: 6.337e-01]
windy_storm:  10%|9         | 295/3000 [08:47<1:19:18,  1.76s/it, lr: 1.0e-04 loss: 6.337e-01]
windy_storm:  10%|9         | 295/3000 [08:47<1:19:18,  1.76s/it, lr: 1.0e-04 loss: 6.337e-01]
windy_storm:  10%|9         | 295/3000 [08:48<1:19:18,  1.76s/it, lr: 1.0e-04 loss: 5.293e-01]
windy_storm:  10%|9         | 295/3000 [08:48<1:19:18,  1.76s/it, lr: 1.0e-04 loss: 5.293e-01]
windy_storm:  10%|9         | 296/3000 [08:48<1:17:03,  1.71s/it, lr: 1.0e-04 loss: 5.293e-01]
windy_storm:  10%|9         | 296/3000 [08:48<1:17:03,  1.71s/it, lr: 1.0e-04 loss: 5.293e-01]
windy_storm:  10%|9         | 296/3000 [08:51<1:17:03,  1.71s/it, lr: 1.0e-04 loss: 3.807e-02]
windy_storm:  10%|9         | 296/3000 [08:51<1:17:03,  1.71s/it, lr: 1.0e-04 loss: 3.807e-02]
windy_storm:  10%|9         | 297/3000 [08:51<1:33:26,  2.07s/it, lr: 1.0e-04 loss: 3.807e-02]
windy_storm:  10%|9         | 297/3000 [08:51<1:33:26,  2.07s/it, lr: 1.0e-04 loss: 3.807e-02]
windy_storm:  10%|9         | 297/3000 [08:52<1:33:26,  2.07s/it, lr: 1.0e-04 loss: 4.041e-01]
windy_storm:  10%|9         | 297/3000 [08:52<1:33:26,  2.07s/it, lr: 1.0e-04 loss: 4.041e-01]
windy_storm:  10%|9         | 298/3000 [08:52<1:16:10,  1.69s/it, lr: 1.0e-04 loss: 4.041e-01]
windy_storm:  10%|9         | 298/3000 [08:52<1:16:10,  1.69s/it, lr: 1.0e-04 loss: 4.041e-01]
windy_storm:  10%|9         | 298/3000 [08:53<1:16:10,  1.69s/it, lr: 1.0e-04 loss: 3.358e-01]
windy_storm:  10%|9         | 298/3000 [08:53<1:16:10,  1.69s/it, lr: 1.0e-04 loss: 3.358e-01]
windy_storm:  10%|9         | 299/3000 [08:53<1:14:32,  1.66s/it, lr: 1.0e-04 loss: 3.358e-01]
windy_storm:  10%|9         | 299/3000 [08:53<1:14:32,  1.66s/it, lr: 1.0e-04 loss: 3.358e-01]
windy_storm:  10%|9         | 299/3000 [08:54<1:14:32,  1.66s/it, lr: 1.0e-04 loss: 7.098e-01]
windy_storm:  10%|9         | 299/3000 [08:54<1:14:32,  1.66s/it, lr: 1.0e-04 loss: 7.098e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.41s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.41s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.42s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.42s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.40s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.40s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.43s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.43s/it]


Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.40s/it]
Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.40s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.39s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.39s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  10%|#         | 300/3000 [08:55<1:14:30,  1.66s/it, lr: 1.0e-04 loss: 2.391e-01]
windy_storm:  10%|#         | 300/3000 [08:55<1:14:30,  1.66s/it, lr: 1.0e-04 loss: 2.391e-01]
windy_storm:  10%|#         | 301/3000 [08:55<48:55,  1.09s/it, lr: 1.0e-04 loss: 2.391e-01]  
windy_storm:  10%|#         | 301/3000 [08:55<48:55,  1.09s/it, lr: 1.0e-04 loss: 2.391e-01]  
windy_storm:  10%|#         | 301/3000 [08:57<48:55,  1.09s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:  10%|#         | 301/3000 [08:57<48:55,  1.09s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:  10%|#         | 302/3000 [08:57<54:21,  1.21s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:  10%|#         | 302/3000 [08:57<54:21,  1.21s/it, lr: 1.0e-04 loss: 5.411e-01]
windy_storm:  10%|#         | 302/3000 [08:57<54:21,  1.21s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  10%|#         | 302/3000 [08:57<54:21,  1.21s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  10%|#         | 303/3000 [08:57<49:52,  1.11s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  10%|#         | 303/3000 [08:57<49:52,  1.11s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  10%|#         | 303/3000 [08:58<49:52,  1.11s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  10%|#         | 303/3000 [08:58<49:52,  1.11s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  10%|#         | 304/3000 [08:58<47:17,  1.05s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  10%|#         | 304/3000 [08:58<47:17,  1.05s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  10%|#         | 304/3000 [08:59<47:17,  1.05s/it, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  10%|#         | 304/3000 [08:59<47:17,  1.05s/it, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  10%|#         | 305/3000 [08:59<43:33,  1.03it/s, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  10%|#         | 305/3000 [08:59<43:33,  1.03it/s, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  10%|#         | 305/3000 [09:00<43:33,  1.03it/s, lr: 1.0e-04 loss: 2.548e-01]
windy_storm:  10%|#         | 305/3000 [09:00<43:33,  1.03it/s, lr: 1.0e-04 loss: 2.548e-01]
windy_storm:  10%|#         | 306/3000 [09:00<41:06,  1.09it/s, lr: 1.0e-04 loss: 2.548e-01]
windy_storm:  10%|#         | 306/3000 [09:00<41:06,  1.09it/s, lr: 1.0e-04 loss: 2.548e-01]
windy_storm:  10%|#         | 306/3000 [09:03<41:06,  1.09it/s, lr: 1.0e-04 loss: 1.723e-01]
windy_storm:  10%|#         | 306/3000 [09:03<41:06,  1.09it/s, lr: 1.0e-04 loss: 1.723e-01]
windy_storm:  10%|#         | 307/3000 [09:03<1:08:20,  1.52s/it, lr: 1.0e-04 loss: 1.723e-01]
windy_storm:  10%|#         | 307/3000 [09:03<1:08:20,  1.52s/it, lr: 1.0e-04 loss: 1.723e-01]
windy_storm:  10%|#         | 307/3000 [09:04<1:08:20,  1.52s/it, lr: 1.0e-04 loss: 6.878e-01]
windy_storm:  10%|#         | 307/3000 [09:04<1:08:20,  1.52s/it, lr: 1.0e-04 loss: 6.878e-01]
windy_storm:  10%|#         | 308/3000 [09:04<59:14,  1.32s/it, lr: 1.0e-04 loss: 6.878e-01]  
windy_storm:  10%|#         | 308/3000 [09:04<59:14,  1.32s/it, lr: 1.0e-04 loss: 6.878e-01]  
windy_storm:  10%|#         | 308/3000 [09:07<59:14,  1.32s/it, lr: 1.0e-04 loss: 3.997e-01]
windy_storm:  10%|#         | 308/3000 [09:07<59:14,  1.32s/it, lr: 1.0e-04 loss: 3.997e-01]
windy_storm:  10%|#         | 309/3000 [09:07<1:20:29,  1.79s/it, lr: 1.0e-04 loss: 3.997e-01]
windy_storm:  10%|#         | 309/3000 [09:07<1:20:29,  1.79s/it, lr: 1.0e-04 loss: 3.997e-01]
windy_storm:  10%|#         | 309/3000 [09:08<1:20:29,  1.79s/it, lr: 1.0e-04 loss: 8.641e-02]
windy_storm:  10%|#         | 309/3000 [09:08<1:20:29,  1.79s/it, lr: 1.0e-04 loss: 8.641e-02]
windy_storm:  10%|#         | 310/3000 [09:10<1:20:27,  1.79s/it, lr: 1.0e-04 loss: 5.957e-01]
windy_storm:  10%|#         | 310/3000 [09:10<1:20:27,  1.79s/it, lr: 1.0e-04 loss: 5.957e-01]
windy_storm:  10%|#         | 311/3000 [09:10<59:48,  1.33s/it, lr: 1.0e-04 loss: 5.957e-01]  
windy_storm:  10%|#         | 311/3000 [09:10<59:48,  1.33s/it, lr: 1.0e-04 loss: 5.957e-01]  
windy_storm:  10%|#         | 311/3000 [09:11<59:48,  1.33s/it, lr: 1.0e-04 loss: 2.400e-01]
windy_storm:  10%|#         | 311/3000 [09:11<59:48,  1.33s/it, lr: 1.0e-04 loss: 2.400e-01]
windy_storm:  10%|#         | 312/3000 [09:11<1:02:36,  1.40s/it, lr: 1.0e-04 loss: 2.400e-01]
windy_storm:  10%|#         | 312/3000 [09:11<1:02:36,  1.40s/it, lr: 1.0e-04 loss: 2.400e-01]
windy_storm:  10%|#         | 312/3000 [09:14<1:02:36,  1.40s/it, lr: 1.0e-04 loss: 1.676e-01]
windy_storm:  10%|#         | 312/3000 [09:14<1:02:36,  1.40s/it, lr: 1.0e-04 loss: 1.676e-01]
windy_storm:  10%|#         | 313/3000 [09:14<1:22:30,  1.84s/it, lr: 1.0e-04 loss: 1.676e-01]
windy_storm:  10%|#         | 313/3000 [09:14<1:22:30,  1.84s/it, lr: 1.0e-04 loss: 1.676e-01]
windy_storm:  10%|#         | 313/3000 [09:16<1:22:30,  1.84s/it, lr: 1.0e-04 loss: 1.780e-01]
windy_storm:  10%|#         | 313/3000 [09:16<1:22:30,  1.84s/it, lr: 1.0e-04 loss: 1.780e-01]
windy_storm:  10%|#         | 314/3000 [09:16<1:19:25,  1.77s/it, lr: 1.0e-04 loss: 1.780e-01]
windy_storm:  10%|#         | 314/3000 [09:16<1:19:25,  1.77s/it, lr: 1.0e-04 loss: 1.780e-01]
windy_storm:  10%|#         | 314/3000 [09:17<1:19:25,  1.77s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  10%|#         | 314/3000 [09:17<1:19:25,  1.77s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  10%|#         | 315/3000 [09:17<1:07:27,  1.51s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  10%|#         | 315/3000 [09:17<1:07:27,  1.51s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  10%|#         | 315/3000 [09:18<1:07:27,  1.51s/it, lr: 1.0e-04 loss: 2.019e-01]
windy_storm:  10%|#         | 315/3000 [09:18<1:07:27,  1.51s/it, lr: 1.0e-04 loss: 2.019e-01]
windy_storm:  11%|#         | 316/3000 [09:18<1:08:25,  1.53s/it, lr: 1.0e-04 loss: 2.019e-01]
windy_storm:  11%|#         | 316/3000 [09:18<1:08:25,  1.53s/it, lr: 1.0e-04 loss: 2.019e-01]
windy_storm:  11%|#         | 316/3000 [09:19<1:08:25,  1.53s/it, lr: 1.0e-04 loss: 5.047e-01]
windy_storm:  11%|#         | 316/3000 [09:19<1:08:25,  1.53s/it, lr: 1.0e-04 loss: 5.047e-01]
windy_storm:  11%|#         | 317/3000 [09:19<59:13,  1.32s/it, lr: 1.0e-04 loss: 5.047e-01]  
windy_storm:  11%|#         | 317/3000 [09:19<59:13,  1.32s/it, lr: 1.0e-04 loss: 5.047e-01]  
windy_storm:  11%|#         | 317/3000 [09:20<59:13,  1.32s/it, lr: 1.0e-04 loss: 5.870e-01]
windy_storm:  11%|#         | 317/3000 [09:20<59:13,  1.32s/it, lr: 1.0e-04 loss: 5.870e-01]
windy_storm:  11%|#         | 318/3000 [09:20<53:27,  1.20s/it, lr: 1.0e-04 loss: 5.870e-01]
windy_storm:  11%|#         | 318/3000 [09:20<53:27,  1.20s/it, lr: 1.0e-04 loss: 5.870e-01]
windy_storm:  11%|#         | 318/3000 [09:23<53:27,  1.20s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  11%|#         | 318/3000 [09:23<53:27,  1.20s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  11%|#         | 319/3000 [09:23<1:17:11,  1.73s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  11%|#         | 319/3000 [09:23<1:17:11,  1.73s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  11%|#         | 319/3000 [09:26<1:17:11,  1.73s/it, lr: 1.0e-04 loss: 5.168e-01]
windy_storm:  11%|#         | 319/3000 [09:26<1:17:11,  1.73s/it, lr: 1.0e-04 loss: 5.168e-01]
windy_storm:  11%|#         | 320/3000 [09:29<1:17:10,  1.73s/it, lr: 1.0e-04 loss: 7.256e-01]
windy_storm:  11%|#         | 320/3000 [09:29<1:17:10,  1.73s/it, lr: 1.0e-04 loss: 7.256e-01]
windy_storm:  11%|#         | 321/3000 [09:29<1:12:28,  1.62s/it, lr: 1.0e-04 loss: 7.256e-01]
windy_storm:  11%|#         | 321/3000 [09:29<1:12:28,  1.62s/it, lr: 1.0e-04 loss: 7.256e-01]
windy_storm:  11%|#         | 321/3000 [09:32<1:12:28,  1.62s/it, lr: 1.0e-04 loss: 3.044e-01]
windy_storm:  11%|#         | 321/3000 [09:32<1:12:28,  1.62s/it, lr: 1.0e-04 loss: 3.044e-01]
windy_storm:  11%|#         | 322/3000 [09:32<1:27:36,  1.96s/it, lr: 1.0e-04 loss: 3.044e-01]
windy_storm:  11%|#         | 322/3000 [09:32<1:27:36,  1.96s/it, lr: 1.0e-04 loss: 3.044e-01]
windy_storm:  11%|#         | 322/3000 [09:35<1:27:36,  1.96s/it, lr: 1.0e-04 loss: 1.137e-01]
windy_storm:  11%|#         | 322/3000 [09:35<1:27:36,  1.96s/it, lr: 1.0e-04 loss: 1.137e-01]
windy_storm:  11%|#         | 323/3000 [09:35<1:38:46,  2.21s/it, lr: 1.0e-04 loss: 1.137e-01]
windy_storm:  11%|#         | 323/3000 [09:35<1:38:46,  2.21s/it, lr: 1.0e-04 loss: 1.137e-01]
windy_storm:  11%|#         | 323/3000 [09:36<1:38:46,  2.21s/it, lr: 1.0e-04 loss: 6.741e-01]
windy_storm:  11%|#         | 323/3000 [09:36<1:38:46,  2.21s/it, lr: 1.0e-04 loss: 6.741e-01]
windy_storm:  11%|#         | 324/3000 [09:36<1:21:51,  1.84s/it, lr: 1.0e-04 loss: 6.741e-01]
windy_storm:  11%|#         | 324/3000 [09:36<1:21:51,  1.84s/it, lr: 1.0e-04 loss: 6.741e-01]
windy_storm:  11%|#         | 324/3000 [09:39<1:21:51,  1.84s/it, lr: 1.0e-04 loss: 6.176e-01]
windy_storm:  11%|#         | 324/3000 [09:39<1:21:51,  1.84s/it, lr: 1.0e-04 loss: 6.176e-01]
windy_storm:  11%|#         | 325/3000 [09:39<1:35:13,  2.14s/it, lr: 1.0e-04 loss: 6.176e-01]
windy_storm:  11%|#         | 325/3000 [09:39<1:35:13,  2.14s/it, lr: 1.0e-04 loss: 6.176e-01]
windy_storm:  11%|#         | 325/3000 [09:42<1:35:13,  2.14s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  11%|#         | 325/3000 [09:42<1:35:13,  2.14s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  11%|#         | 326/3000 [09:42<1:45:09,  2.36s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  11%|#         | 326/3000 [09:42<1:45:09,  2.36s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  11%|#         | 326/3000 [09:45<1:45:09,  2.36s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  11%|#         | 326/3000 [09:45<1:45:09,  2.36s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  11%|#         | 327/3000 [09:45<1:53:54,  2.56s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  11%|#         | 327/3000 [09:45<1:53:54,  2.56s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  11%|#         | 327/3000 [09:46<1:53:54,  2.56s/it, lr: 1.0e-04 loss: 2.023e-01]
windy_storm:  11%|#         | 327/3000 [09:46<1:53:54,  2.56s/it, lr: 1.0e-04 loss: 2.023e-01]
windy_storm:  11%|#         | 328/3000 [09:46<1:40:50,  2.26s/it, lr: 1.0e-04 loss: 2.023e-01]
windy_storm:  11%|#         | 328/3000 [09:46<1:40:50,  2.26s/it, lr: 1.0e-04 loss: 2.023e-01]
windy_storm:  11%|#         | 328/3000 [09:48<1:40:50,  2.26s/it, lr: 1.0e-04 loss: 1.741e-01]
windy_storm:  11%|#         | 328/3000 [09:48<1:40:50,  2.26s/it, lr: 1.0e-04 loss: 1.741e-01]
windy_storm:  11%|#         | 329/3000 [09:48<1:31:51,  2.06s/it, lr: 1.0e-04 loss: 1.741e-01]
windy_storm:  11%|#         | 329/3000 [09:48<1:31:51,  2.06s/it, lr: 1.0e-04 loss: 1.741e-01]
windy_storm:  11%|#         | 329/3000 [09:49<1:31:51,  2.06s/it, lr: 1.0e-04 loss: 2.962e-01]
windy_storm:  11%|#         | 329/3000 [09:49<1:31:51,  2.06s/it, lr: 1.0e-04 loss: 2.962e-01]
windy_storm:  11%|#1        | 330/3000 [09:50<1:31:49,  2.06s/it, lr: 1.0e-04 loss: 2.498e-01]
windy_storm:  11%|#1        | 330/3000 [09:50<1:31:49,  2.06s/it, lr: 1.0e-04 loss: 2.498e-01]
windy_storm:  11%|#1        | 331/3000 [09:50<57:44,  1.30s/it, lr: 1.0e-04 loss: 2.498e-01]  
windy_storm:  11%|#1        | 331/3000 [09:50<57:44,  1.30s/it, lr: 1.0e-04 loss: 2.498e-01]  
windy_storm:  11%|#1        | 331/3000 [09:53<57:44,  1.30s/it, lr: 1.0e-04 loss: 6.897e-01]
windy_storm:  11%|#1        | 331/3000 [09:53<57:44,  1.30s/it, lr: 1.0e-04 loss: 6.897e-01]
windy_storm:  11%|#1        | 332/3000 [09:53<1:16:19,  1.72s/it, lr: 1.0e-04 loss: 6.897e-01]
windy_storm:  11%|#1        | 332/3000 [09:53<1:16:19,  1.72s/it, lr: 1.0e-04 loss: 6.897e-01]
windy_storm:  11%|#1        | 332/3000 [09:55<1:16:19,  1.72s/it, lr: 1.0e-04 loss: 2.445e-01]
windy_storm:  11%|#1        | 332/3000 [09:55<1:16:19,  1.72s/it, lr: 1.0e-04 loss: 2.445e-01]
windy_storm:  11%|#1        | 333/3000 [09:56<1:30:28,  2.04s/it, lr: 1.0e-04 loss: 2.445e-01]
windy_storm:  11%|#1        | 333/3000 [09:56<1:30:28,  2.04s/it, lr: 1.0e-04 loss: 2.445e-01]
windy_storm:  11%|#1        | 333/3000 [09:58<1:30:28,  2.04s/it, lr: 1.0e-04 loss: 4.676e-01]
windy_storm:  11%|#1        | 333/3000 [09:58<1:30:28,  2.04s/it, lr: 1.0e-04 loss: 4.676e-01]
windy_storm:  11%|#1        | 334/3000 [09:59<1:42:15,  2.30s/it, lr: 1.0e-04 loss: 4.676e-01]
windy_storm:  11%|#1        | 334/3000 [09:59<1:42:15,  2.30s/it, lr: 1.0e-04 loss: 4.676e-01]
windy_storm:  11%|#1        | 334/3000 [10:01<1:42:15,  2.30s/it, lr: 1.0e-04 loss: 9.834e-02]
windy_storm:  11%|#1        | 334/3000 [10:01<1:42:15,  2.30s/it, lr: 1.0e-04 loss: 9.834e-02]
windy_storm:  11%|#1        | 335/3000 [10:01<1:49:59,  2.48s/it, lr: 1.0e-04 loss: 9.834e-02]
windy_storm:  11%|#1        | 335/3000 [10:01<1:49:59,  2.48s/it, lr: 1.0e-04 loss: 9.834e-02]
windy_storm:  11%|#1        | 335/3000 [10:03<1:49:59,  2.48s/it, lr: 1.0e-04 loss: 5.540e-01]
windy_storm:  11%|#1        | 335/3000 [10:03<1:49:59,  2.48s/it, lr: 1.0e-04 loss: 5.540e-01]
windy_storm:  11%|#1        | 336/3000 [10:03<1:38:15,  2.21s/it, lr: 1.0e-04 loss: 5.540e-01]
windy_storm:  11%|#1        | 336/3000 [10:03<1:38:15,  2.21s/it, lr: 1.0e-04 loss: 5.540e-01]
windy_storm:  11%|#1        | 336/3000 [10:06<1:38:15,  2.21s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  11%|#1        | 336/3000 [10:06<1:38:15,  2.21s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  11%|#1        | 337/3000 [10:06<1:48:32,  2.45s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  11%|#1        | 337/3000 [10:06<1:48:32,  2.45s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  11%|#1        | 337/3000 [10:07<1:48:32,  2.45s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:  11%|#1        | 337/3000 [10:07<1:48:32,  2.45s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:  11%|#1        | 338/3000 [10:07<1:26:35,  1.95s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:  11%|#1        | 338/3000 [10:07<1:26:35,  1.95s/it, lr: 1.0e-04 loss: 2.116e-01]
windy_storm:  11%|#1        | 338/3000 [10:08<1:26:35,  1.95s/it, lr: 1.0e-04 loss: 1.369e-01]
windy_storm:  11%|#1        | 338/3000 [10:08<1:26:35,  1.95s/it, lr: 1.0e-04 loss: 1.369e-01]
windy_storm:  11%|#1        | 339/3000 [10:08<1:12:54,  1.64s/it, lr: 1.0e-04 loss: 1.369e-01]
windy_storm:  11%|#1        | 339/3000 [10:08<1:12:54,  1.64s/it, lr: 1.0e-04 loss: 1.369e-01]
windy_storm:  11%|#1        | 339/3000 [10:09<1:12:54,  1.64s/it, lr: 1.0e-04 loss: 1.783e-01]
windy_storm:  11%|#1        | 339/3000 [10:09<1:12:54,  1.64s/it, lr: 1.0e-04 loss: 1.783e-01]
windy_storm:  11%|#1        | 340/3000 [10:10<1:12:52,  1.64s/it, lr: 1.0e-04 loss: 1.517e-01]
windy_storm:  11%|#1        | 340/3000 [10:10<1:12:52,  1.64s/it, lr: 1.0e-04 loss: 1.517e-01]
windy_storm:  11%|#1        | 341/3000 [10:10<57:21,  1.29s/it, lr: 1.0e-04 loss: 1.517e-01]  
windy_storm:  11%|#1        | 341/3000 [10:10<57:21,  1.29s/it, lr: 1.0e-04 loss: 1.517e-01]  
windy_storm:  11%|#1        | 341/3000 [10:12<57:21,  1.29s/it, lr: 1.0e-04 loss: 6.873e-01]
windy_storm:  11%|#1        | 341/3000 [10:12<57:21,  1.29s/it, lr: 1.0e-04 loss: 6.873e-01]
windy_storm:  11%|#1        | 342/3000 [10:12<1:00:42,  1.37s/it, lr: 1.0e-04 loss: 6.873e-01]
windy_storm:  11%|#1        | 342/3000 [10:12<1:00:42,  1.37s/it, lr: 1.0e-04 loss: 6.873e-01]
windy_storm:  11%|#1        | 342/3000 [10:15<1:00:42,  1.37s/it, lr: 1.0e-04 loss: 5.615e-01]
windy_storm:  11%|#1        | 342/3000 [10:15<1:00:42,  1.37s/it, lr: 1.0e-04 loss: 5.615e-01]
windy_storm:  11%|#1        | 343/3000 [10:15<1:18:39,  1.78s/it, lr: 1.0e-04 loss: 5.615e-01]
windy_storm:  11%|#1        | 343/3000 [10:15<1:18:39,  1.78s/it, lr: 1.0e-04 loss: 5.615e-01]
windy_storm:  11%|#1        | 343/3000 [10:18<1:18:39,  1.78s/it, lr: 1.0e-04 loss: 6.893e-01]
windy_storm:  11%|#1        | 343/3000 [10:18<1:18:39,  1.78s/it, lr: 1.0e-04 loss: 6.893e-01]
windy_storm:  11%|#1        | 344/3000 [10:18<1:32:08,  2.08s/it, lr: 1.0e-04 loss: 6.893e-01]
windy_storm:  11%|#1        | 344/3000 [10:18<1:32:08,  2.08s/it, lr: 1.0e-04 loss: 6.893e-01]
windy_storm:  11%|#1        | 344/3000 [10:21<1:32:08,  2.08s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  11%|#1        | 344/3000 [10:21<1:32:08,  2.08s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  12%|#1        | 345/3000 [10:21<1:43:51,  2.35s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  12%|#1        | 345/3000 [10:21<1:43:51,  2.35s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  12%|#1        | 345/3000 [10:24<1:43:51,  2.35s/it, lr: 1.0e-04 loss: 5.593e-02]
windy_storm:  12%|#1        | 345/3000 [10:24<1:43:51,  2.35s/it, lr: 1.0e-04 loss: 5.593e-02]
windy_storm:  12%|#1        | 346/3000 [10:24<1:52:23,  2.54s/it, lr: 1.0e-04 loss: 5.593e-02]
windy_storm:  12%|#1        | 346/3000 [10:24<1:52:23,  2.54s/it, lr: 1.0e-04 loss: 5.593e-02]
windy_storm:  12%|#1        | 346/3000 [10:27<1:52:23,  2.54s/it, lr: 1.0e-04 loss: 2.120e-01]
windy_storm:  12%|#1        | 346/3000 [10:27<1:52:23,  2.54s/it, lr: 1.0e-04 loss: 2.120e-01]
windy_storm:  12%|#1        | 347/3000 [10:27<1:58:41,  2.68s/it, lr: 1.0e-04 loss: 2.120e-01]
windy_storm:  12%|#1        | 347/3000 [10:27<1:58:41,  2.68s/it, lr: 1.0e-04 loss: 2.120e-01]
windy_storm:  12%|#1        | 347/3000 [10:28<1:58:41,  2.68s/it, lr: 1.0e-04 loss: 3.727e-01]
windy_storm:  12%|#1        | 347/3000 [10:28<1:58:41,  2.68s/it, lr: 1.0e-04 loss: 3.727e-01]
windy_storm:  12%|#1        | 348/3000 [10:28<1:33:34,  2.12s/it, lr: 1.0e-04 loss: 3.727e-01]
windy_storm:  12%|#1        | 348/3000 [10:28<1:33:34,  2.12s/it, lr: 1.0e-04 loss: 3.727e-01]
windy_storm:  12%|#1        | 348/3000 [10:30<1:33:34,  2.12s/it, lr: 1.0e-04 loss: 5.254e-01]
windy_storm:  12%|#1        | 348/3000 [10:30<1:33:34,  2.12s/it, lr: 1.0e-04 loss: 5.254e-01]
windy_storm:  12%|#1        | 349/3000 [10:31<1:44:28,  2.36s/it, lr: 1.0e-04 loss: 5.254e-01]
windy_storm:  12%|#1        | 349/3000 [10:31<1:44:28,  2.36s/it, lr: 1.0e-04 loss: 5.254e-01]
windy_storm:  12%|#1        | 349/3000 [10:32<1:44:28,  2.36s/it, lr: 1.0e-04 loss: 5.196e-02]
windy_storm:  12%|#1        | 349/3000 [10:32<1:44:28,  2.36s/it, lr: 1.0e-04 loss: 5.196e-02]
windy_storm:  12%|#1        | 350/3000 [10:33<1:44:26,  2.36s/it, lr: 1.0e-04 loss: 2.174e-01]
windy_storm:  12%|#1        | 350/3000 [10:33<1:44:26,  2.36s/it, lr: 1.0e-04 loss: 2.174e-01]
windy_storm:  12%|#1        | 351/3000 [10:33<1:04:30,  1.46s/it, lr: 1.0e-04 loss: 2.174e-01]
windy_storm:  12%|#1        | 351/3000 [10:33<1:04:30,  1.46s/it, lr: 1.0e-04 loss: 2.174e-01]
windy_storm:  12%|#1        | 351/3000 [10:34<1:04:30,  1.46s/it, lr: 1.0e-04 loss: 2.932e-01]
windy_storm:  12%|#1        | 351/3000 [10:34<1:04:30,  1.46s/it, lr: 1.0e-04 loss: 2.932e-01]
windy_storm:  12%|#1        | 352/3000 [10:34<56:57,  1.29s/it, lr: 1.0e-04 loss: 2.932e-01]  
windy_storm:  12%|#1        | 352/3000 [10:34<56:57,  1.29s/it, lr: 1.0e-04 loss: 2.932e-01]  
windy_storm:  12%|#1        | 352/3000 [10:34<56:57,  1.29s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  12%|#1        | 352/3000 [10:34<56:57,  1.29s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  12%|#1        | 353/3000 [10:34<50:59,  1.16s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  12%|#1        | 353/3000 [10:34<50:59,  1.16s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  12%|#1        | 353/3000 [10:38<50:59,  1.16s/it, lr: 1.0e-04 loss: 1.606e-01]
windy_storm:  12%|#1        | 353/3000 [10:38<50:59,  1.16s/it, lr: 1.0e-04 loss: 1.606e-01]
windy_storm:  12%|#1        | 354/3000 [10:38<1:13:57,  1.68s/it, lr: 1.0e-04 loss: 1.606e-01]
windy_storm:  12%|#1        | 354/3000 [10:38<1:13:57,  1.68s/it, lr: 1.0e-04 loss: 1.606e-01]
windy_storm:  12%|#1        | 354/3000 [10:41<1:13:57,  1.68s/it, lr: 1.0e-04 loss: 3.507e-01]
windy_storm:  12%|#1        | 354/3000 [10:41<1:13:57,  1.68s/it, lr: 1.0e-04 loss: 3.507e-01]
windy_storm:  12%|#1        | 355/3000 [10:41<1:30:38,  2.06s/it, lr: 1.0e-04 loss: 3.507e-01]
windy_storm:  12%|#1        | 355/3000 [10:41<1:30:38,  2.06s/it, lr: 1.0e-04 loss: 3.507e-01]
windy_storm:  12%|#1        | 355/3000 [10:44<1:30:38,  2.06s/it, lr: 1.0e-04 loss: 5.195e-02]
windy_storm:  12%|#1        | 355/3000 [10:44<1:30:38,  2.06s/it, lr: 1.0e-04 loss: 5.195e-02]
windy_storm:  12%|#1        | 356/3000 [10:44<1:41:58,  2.31s/it, lr: 1.0e-04 loss: 5.195e-02]
windy_storm:  12%|#1        | 356/3000 [10:44<1:41:58,  2.31s/it, lr: 1.0e-04 loss: 5.195e-02]
windy_storm:  12%|#1        | 356/3000 [10:45<1:41:58,  2.31s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:  12%|#1        | 356/3000 [10:45<1:41:58,  2.31s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:  12%|#1        | 357/3000 [10:45<1:32:43,  2.11s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:  12%|#1        | 357/3000 [10:45<1:32:43,  2.11s/it, lr: 1.0e-04 loss: 4.903e-01]
windy_storm:  12%|#1        | 357/3000 [10:46<1:32:43,  2.11s/it, lr: 1.0e-04 loss: 1.773e-01]
windy_storm:  12%|#1        | 357/3000 [10:46<1:32:43,  2.11s/it, lr: 1.0e-04 loss: 1.773e-01]
windy_storm:  12%|#1        | 358/3000 [10:46<1:15:19,  1.71s/it, lr: 1.0e-04 loss: 1.773e-01]
windy_storm:  12%|#1        | 358/3000 [10:46<1:15:19,  1.71s/it, lr: 1.0e-04 loss: 1.773e-01]
windy_storm:  12%|#1        | 358/3000 [10:47<1:15:19,  1.71s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  12%|#1        | 358/3000 [10:47<1:15:19,  1.71s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  12%|#1        | 359/3000 [10:47<1:13:14,  1.66s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  12%|#1        | 359/3000 [10:47<1:13:14,  1.66s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  12%|#1        | 359/3000 [10:49<1:13:14,  1.66s/it, lr: 1.0e-04 loss: 6.084e-01]
windy_storm:  12%|#1        | 359/3000 [10:49<1:13:14,  1.66s/it, lr: 1.0e-04 loss: 6.084e-01]
windy_storm:  12%|#2        | 360/3000 [10:49<1:13:13,  1.66s/it, lr: 1.0e-04 loss: 3.881e-02]
windy_storm:  12%|#2        | 360/3000 [10:49<1:13:13,  1.66s/it, lr: 1.0e-04 loss: 3.881e-02]
windy_storm:  12%|#2        | 361/3000 [10:49<47:28,  1.08s/it, lr: 1.0e-04 loss: 3.881e-02]  
windy_storm:  12%|#2        | 361/3000 [10:49<47:28,  1.08s/it, lr: 1.0e-04 loss: 3.881e-02]  
windy_storm:  12%|#2        | 361/3000 [10:51<47:28,  1.08s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  12%|#2        | 361/3000 [10:51<47:28,  1.08s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  12%|#2        | 362/3000 [10:51<52:57,  1.20s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  12%|#2        | 362/3000 [10:51<52:57,  1.20s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  12%|#2        | 362/3000 [10:52<52:57,  1.20s/it, lr: 1.0e-04 loss: 3.433e-01]
windy_storm:  12%|#2        | 362/3000 [10:52<52:57,  1.20s/it, lr: 1.0e-04 loss: 3.433e-01]
windy_storm:  12%|#2        | 363/3000 [10:52<56:38,  1.29s/it, lr: 1.0e-04 loss: 3.433e-01]
windy_storm:  12%|#2        | 363/3000 [10:52<56:38,  1.29s/it, lr: 1.0e-04 loss: 3.433e-01]
windy_storm:  12%|#2        | 363/3000 [10:54<56:38,  1.29s/it, lr: 1.0e-04 loss: 6.925e-01]
windy_storm:  12%|#2        | 363/3000 [10:54<56:38,  1.29s/it, lr: 1.0e-04 loss: 6.925e-01]
windy_storm:  12%|#2        | 364/3000 [10:54<1:00:16,  1.37s/it, lr: 1.0e-04 loss: 6.925e-01]
windy_storm:  12%|#2        | 364/3000 [10:54<1:00:16,  1.37s/it, lr: 1.0e-04 loss: 6.925e-01]
windy_storm:  12%|#2        | 364/3000 [10:56<1:00:16,  1.37s/it, lr: 1.0e-04 loss: 4.218e-01]
windy_storm:  12%|#2        | 364/3000 [10:56<1:00:16,  1.37s/it, lr: 1.0e-04 loss: 4.218e-01]
windy_storm:  12%|#2        | 365/3000 [10:56<1:03:01,  1.44s/it, lr: 1.0e-04 loss: 4.218e-01]
windy_storm:  12%|#2        | 365/3000 [10:56<1:03:01,  1.44s/it, lr: 1.0e-04 loss: 4.218e-01]
windy_storm:  12%|#2        | 365/3000 [10:56<1:03:01,  1.44s/it, lr: 1.0e-04 loss: 2.851e-01]
windy_storm:  12%|#2        | 365/3000 [10:56<1:03:01,  1.44s/it, lr: 1.0e-04 loss: 2.851e-01]
windy_storm:  12%|#2        | 366/3000 [10:56<55:25,  1.26s/it, lr: 1.0e-04 loss: 2.851e-01]  
windy_storm:  12%|#2        | 366/3000 [10:56<55:25,  1.26s/it, lr: 1.0e-04 loss: 2.851e-01]  
windy_storm:  12%|#2        | 366/3000 [10:58<55:25,  1.26s/it, lr: 1.0e-04 loss: 5.549e-01]
windy_storm:  12%|#2        | 366/3000 [10:58<55:25,  1.26s/it, lr: 1.0e-04 loss: 5.549e-01]
windy_storm:  12%|#2        | 367/3000 [10:58<53:34,  1.22s/it, lr: 1.0e-04 loss: 5.549e-01]
windy_storm:  12%|#2        | 367/3000 [10:58<53:34,  1.22s/it, lr: 1.0e-04 loss: 5.549e-01]
windy_storm:  12%|#2        | 367/3000 [10:58<53:34,  1.22s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  12%|#2        | 367/3000 [10:58<53:34,  1.22s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  12%|#2        | 368/3000 [10:58<47:35,  1.09s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  12%|#2        | 368/3000 [10:58<47:35,  1.09s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  12%|#2        | 368/3000 [10:59<47:35,  1.09s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  12%|#2        | 368/3000 [10:59<47:35,  1.09s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  12%|#2        | 369/3000 [10:59<44:18,  1.01s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  12%|#2        | 369/3000 [10:59<44:18,  1.01s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  12%|#2        | 369/3000 [11:00<44:18,  1.01s/it, lr: 1.0e-04 loss: 1.706e-01]
windy_storm:  12%|#2        | 369/3000 [11:00<44:18,  1.01s/it, lr: 1.0e-04 loss: 1.706e-01]
windy_storm:  12%|#2        | 370/3000 [11:03<44:17,  1.01s/it, lr: 1.0e-04 loss: 4.153e-01]
windy_storm:  12%|#2        | 370/3000 [11:03<44:17,  1.01s/it, lr: 1.0e-04 loss: 4.153e-01]
windy_storm:  12%|#2        | 371/3000 [11:03<53:33,  1.22s/it, lr: 1.0e-04 loss: 4.153e-01]
windy_storm:  12%|#2        | 371/3000 [11:03<53:33,  1.22s/it, lr: 1.0e-04 loss: 4.153e-01]
windy_storm:  12%|#2        | 371/3000 [11:04<53:33,  1.22s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  12%|#2        | 371/3000 [11:04<53:33,  1.22s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  12%|#2        | 372/3000 [11:04<57:16,  1.31s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  12%|#2        | 372/3000 [11:04<57:16,  1.31s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  12%|#2        | 372/3000 [11:06<57:16,  1.31s/it, lr: 1.0e-04 loss: 7.248e-01]
windy_storm:  12%|#2        | 372/3000 [11:06<57:16,  1.31s/it, lr: 1.0e-04 loss: 7.248e-01]
windy_storm:  12%|#2        | 373/3000 [11:06<1:00:28,  1.38s/it, lr: 1.0e-04 loss: 7.248e-01]
windy_storm:  12%|#2        | 373/3000 [11:06<1:00:28,  1.38s/it, lr: 1.0e-04 loss: 7.248e-01]
windy_storm:  12%|#2        | 373/3000 [11:08<1:00:28,  1.38s/it, lr: 1.0e-04 loss: 4.039e-01]
windy_storm:  12%|#2        | 373/3000 [11:08<1:00:28,  1.38s/it, lr: 1.0e-04 loss: 4.039e-01]
windy_storm:  12%|#2        | 374/3000 [11:08<1:02:20,  1.42s/it, lr: 1.0e-04 loss: 4.039e-01]
windy_storm:  12%|#2        | 374/3000 [11:08<1:02:20,  1.42s/it, lr: 1.0e-04 loss: 4.039e-01]
windy_storm:  12%|#2        | 374/3000 [11:08<1:02:20,  1.42s/it, lr: 1.0e-04 loss: 3.504e-01]
windy_storm:  12%|#2        | 374/3000 [11:08<1:02:20,  1.42s/it, lr: 1.0e-04 loss: 3.504e-01]
windy_storm:  12%|#2        | 375/3000 [11:08<54:12,  1.24s/it, lr: 1.0e-04 loss: 3.504e-01]  
windy_storm:  12%|#2        | 375/3000 [11:08<54:12,  1.24s/it, lr: 1.0e-04 loss: 3.504e-01]  
windy_storm:  12%|#2        | 375/3000 [11:11<54:12,  1.24s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  12%|#2        | 375/3000 [11:11<54:12,  1.24s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  13%|#2        | 376/3000 [11:11<1:16:10,  1.74s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  13%|#2        | 376/3000 [11:11<1:16:10,  1.74s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  13%|#2        | 376/3000 [11:14<1:16:10,  1.74s/it, lr: 1.0e-04 loss: 3.991e-01]
windy_storm:  13%|#2        | 376/3000 [11:14<1:16:10,  1.74s/it, lr: 1.0e-04 loss: 3.991e-01]
windy_storm:  13%|#2        | 377/3000 [11:14<1:32:05,  2.11s/it, lr: 1.0e-04 loss: 3.991e-01]
windy_storm:  13%|#2        | 377/3000 [11:14<1:32:05,  2.11s/it, lr: 1.0e-04 loss: 3.991e-01]
windy_storm:  13%|#2        | 377/3000 [11:16<1:32:05,  2.11s/it, lr: 1.0e-04 loss: 5.416e-01]
windy_storm:  13%|#2        | 377/3000 [11:16<1:32:05,  2.11s/it, lr: 1.0e-04 loss: 5.416e-01]
windy_storm:  13%|#2        | 378/3000 [11:16<1:25:36,  1.96s/it, lr: 1.0e-04 loss: 5.416e-01]
windy_storm:  13%|#2        | 378/3000 [11:16<1:25:36,  1.96s/it, lr: 1.0e-04 loss: 5.416e-01]
windy_storm:  13%|#2        | 378/3000 [11:17<1:25:36,  1.96s/it, lr: 1.0e-04 loss: 1.046e-01]
windy_storm:  13%|#2        | 378/3000 [11:17<1:25:36,  1.96s/it, lr: 1.0e-04 loss: 1.046e-01]
windy_storm:  13%|#2        | 379/3000 [11:17<1:10:12,  1.61s/it, lr: 1.0e-04 loss: 1.046e-01]
windy_storm:  13%|#2        | 379/3000 [11:17<1:10:12,  1.61s/it, lr: 1.0e-04 loss: 1.046e-01]
windy_storm:  13%|#2        | 379/3000 [11:18<1:10:12,  1.61s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:  13%|#2        | 379/3000 [11:18<1:10:12,  1.61s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:  13%|#2        | 380/3000 [11:19<1:10:10,  1.61s/it, lr: 1.0e-04 loss: 4.273e-01]
windy_storm:  13%|#2        | 380/3000 [11:19<1:10:10,  1.61s/it, lr: 1.0e-04 loss: 4.273e-01]
windy_storm:  13%|#2        | 381/3000 [11:19<55:26,  1.27s/it, lr: 1.0e-04 loss: 4.273e-01]  
windy_storm:  13%|#2        | 381/3000 [11:19<55:26,  1.27s/it, lr: 1.0e-04 loss: 4.273e-01]  
windy_storm:  13%|#2        | 381/3000 [11:21<55:26,  1.27s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  13%|#2        | 381/3000 [11:21<55:26,  1.27s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  13%|#2        | 382/3000 [11:21<58:45,  1.35s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  13%|#2        | 382/3000 [11:21<58:45,  1.35s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  13%|#2        | 382/3000 [11:22<58:45,  1.35s/it, lr: 1.0e-04 loss: 9.960e-02]
windy_storm:  13%|#2        | 382/3000 [11:22<58:45,  1.35s/it, lr: 1.0e-04 loss: 9.960e-02]
windy_storm:  13%|#2        | 383/3000 [11:22<52:50,  1.21s/it, lr: 1.0e-04 loss: 9.960e-02]
windy_storm:  13%|#2        | 383/3000 [11:22<52:50,  1.21s/it, lr: 1.0e-04 loss: 9.960e-02]
windy_storm:  13%|#2        | 383/3000 [11:22<52:50,  1.21s/it, lr: 1.0e-04 loss: 3.251e-01]
windy_storm:  13%|#2        | 383/3000 [11:22<52:50,  1.21s/it, lr: 1.0e-04 loss: 3.251e-01]
windy_storm:  13%|#2        | 384/3000 [11:22<47:30,  1.09s/it, lr: 1.0e-04 loss: 3.251e-01]
windy_storm:  13%|#2        | 384/3000 [11:22<47:30,  1.09s/it, lr: 1.0e-04 loss: 3.251e-01]
windy_storm:  13%|#2        | 384/3000 [11:24<47:30,  1.09s/it, lr: 1.0e-04 loss: 6.215e-01]
windy_storm:  13%|#2        | 384/3000 [11:24<47:30,  1.09s/it, lr: 1.0e-04 loss: 6.215e-01]
windy_storm:  13%|#2        | 385/3000 [11:24<53:33,  1.23s/it, lr: 1.0e-04 loss: 6.215e-01]
windy_storm:  13%|#2        | 385/3000 [11:24<53:33,  1.23s/it, lr: 1.0e-04 loss: 6.215e-01]
windy_storm:  13%|#2        | 385/3000 [11:27<53:33,  1.23s/it, lr: 1.0e-04 loss: 4.120e-01]
windy_storm:  13%|#2        | 385/3000 [11:27<53:33,  1.23s/it, lr: 1.0e-04 loss: 4.120e-01]
windy_storm:  13%|#2        | 386/3000 [11:27<1:14:42,  1.71s/it, lr: 1.0e-04 loss: 4.120e-01]
windy_storm:  13%|#2        | 386/3000 [11:27<1:14:42,  1.71s/it, lr: 1.0e-04 loss: 4.120e-01]
windy_storm:  13%|#2        | 386/3000 [11:29<1:14:42,  1.71s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:  13%|#2        | 386/3000 [11:29<1:14:42,  1.71s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:  13%|#2        | 387/3000 [11:29<1:13:02,  1.68s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:  13%|#2        | 387/3000 [11:29<1:13:02,  1.68s/it, lr: 1.0e-04 loss: 1.377e-01]
windy_storm:  13%|#2        | 387/3000 [11:30<1:13:02,  1.68s/it, lr: 1.0e-04 loss: 5.704e-01]
windy_storm:  13%|#2        | 387/3000 [11:30<1:13:02,  1.68s/it, lr: 1.0e-04 loss: 5.704e-01]
windy_storm:  13%|#2        | 388/3000 [11:30<1:11:57,  1.65s/it, lr: 1.0e-04 loss: 5.704e-01]
windy_storm:  13%|#2        | 388/3000 [11:30<1:11:57,  1.65s/it, lr: 1.0e-04 loss: 5.704e-01]
windy_storm:  13%|#2        | 388/3000 [11:32<1:11:57,  1.65s/it, lr: 1.0e-04 loss: 6.097e-01]
windy_storm:  13%|#2        | 388/3000 [11:32<1:11:57,  1.65s/it, lr: 1.0e-04 loss: 6.097e-01]
windy_storm:  13%|#2        | 389/3000 [11:32<1:11:10,  1.64s/it, lr: 1.0e-04 loss: 6.097e-01]
windy_storm:  13%|#2        | 389/3000 [11:32<1:11:10,  1.64s/it, lr: 1.0e-04 loss: 6.097e-01]
windy_storm:  13%|#2        | 389/3000 [11:33<1:11:10,  1.64s/it, lr: 1.0e-04 loss: 2.179e-01]
windy_storm:  13%|#2        | 389/3000 [11:33<1:11:10,  1.64s/it, lr: 1.0e-04 loss: 2.179e-01]
windy_storm:  13%|#3        | 390/3000 [11:35<1:11:09,  1.64s/it, lr: 1.0e-04 loss: 6.161e-01]
windy_storm:  13%|#3        | 390/3000 [11:35<1:11:09,  1.64s/it, lr: 1.0e-04 loss: 6.161e-01]
windy_storm:  13%|#3        | 391/3000 [11:35<1:07:35,  1.55s/it, lr: 1.0e-04 loss: 6.161e-01]
windy_storm:  13%|#3        | 391/3000 [11:35<1:07:35,  1.55s/it, lr: 1.0e-04 loss: 6.161e-01]
windy_storm:  13%|#3        | 391/3000 [11:38<1:07:35,  1.55s/it, lr: 1.0e-04 loss: 3.370e-01]
windy_storm:  13%|#3        | 391/3000 [11:38<1:07:35,  1.55s/it, lr: 1.0e-04 loss: 3.370e-01]
windy_storm:  13%|#3        | 392/3000 [11:38<1:22:10,  1.89s/it, lr: 1.0e-04 loss: 3.370e-01]
windy_storm:  13%|#3        | 392/3000 [11:38<1:22:10,  1.89s/it, lr: 1.0e-04 loss: 3.370e-01]
windy_storm:  13%|#3        | 392/3000 [11:41<1:22:10,  1.89s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  13%|#3        | 392/3000 [11:41<1:22:10,  1.89s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  13%|#3        | 393/3000 [11:41<1:34:48,  2.18s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  13%|#3        | 393/3000 [11:41<1:34:48,  2.18s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  13%|#3        | 393/3000 [11:42<1:34:48,  2.18s/it, lr: 1.0e-04 loss: 2.473e-01]
windy_storm:  13%|#3        | 393/3000 [11:42<1:34:48,  2.18s/it, lr: 1.0e-04 loss: 2.473e-01]
windy_storm:  13%|#3        | 394/3000 [11:42<1:18:44,  1.81s/it, lr: 1.0e-04 loss: 2.473e-01]
windy_storm:  13%|#3        | 394/3000 [11:42<1:18:44,  1.81s/it, lr: 1.0e-04 loss: 2.473e-01]
windy_storm:  13%|#3        | 394/3000 [11:43<1:18:44,  1.81s/it, lr: 1.0e-04 loss: 4.798e-01]
windy_storm:  13%|#3        | 394/3000 [11:43<1:18:44,  1.81s/it, lr: 1.0e-04 loss: 4.798e-01]
windy_storm:  13%|#3        | 395/3000 [11:43<1:09:39,  1.60s/it, lr: 1.0e-04 loss: 4.798e-01]
windy_storm:  13%|#3        | 395/3000 [11:43<1:09:39,  1.60s/it, lr: 1.0e-04 loss: 4.798e-01]
windy_storm:  13%|#3        | 395/3000 [11:46<1:09:39,  1.60s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  13%|#3        | 395/3000 [11:46<1:09:39,  1.60s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  13%|#3        | 396/3000 [11:46<1:26:24,  1.99s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  13%|#3        | 396/3000 [11:46<1:26:24,  1.99s/it, lr: 1.0e-04 loss: 6.229e-01]
windy_storm:  13%|#3        | 396/3000 [11:49<1:26:24,  1.99s/it, lr: 1.0e-04 loss: 5.092e-01]
windy_storm:  13%|#3        | 396/3000 [11:49<1:26:24,  1.99s/it, lr: 1.0e-04 loss: 5.092e-01]
windy_storm:  13%|#3        | 397/3000 [11:49<1:39:14,  2.29s/it, lr: 1.0e-04 loss: 5.092e-01]
windy_storm:  13%|#3        | 397/3000 [11:49<1:39:14,  2.29s/it, lr: 1.0e-04 loss: 5.092e-01]
windy_storm:  13%|#3        | 397/3000 [11:50<1:39:14,  2.29s/it, lr: 1.0e-04 loss: 7.922e-02]
windy_storm:  13%|#3        | 397/3000 [11:50<1:39:14,  2.29s/it, lr: 1.0e-04 loss: 7.922e-02]
windy_storm:  13%|#3        | 398/3000 [11:50<1:19:54,  1.84s/it, lr: 1.0e-04 loss: 7.922e-02]
windy_storm:  13%|#3        | 398/3000 [11:50<1:19:54,  1.84s/it, lr: 1.0e-04 loss: 7.922e-02]
windy_storm:  13%|#3        | 398/3000 [11:51<1:19:54,  1.84s/it, lr: 1.0e-04 loss: 6.797e-01]
windy_storm:  13%|#3        | 398/3000 [11:51<1:19:54,  1.84s/it, lr: 1.0e-04 loss: 6.797e-01]
windy_storm:  13%|#3        | 399/3000 [11:51<1:05:58,  1.52s/it, lr: 1.0e-04 loss: 6.797e-01]
windy_storm:  13%|#3        | 399/3000 [11:51<1:05:58,  1.52s/it, lr: 1.0e-04 loss: 6.797e-01]
windy_storm:  13%|#3        | 399/3000 [11:54<1:05:58,  1.52s/it, lr: 1.0e-04 loss: 7.857e-02]
windy_storm:  13%|#3        | 399/3000 [11:54<1:05:58,  1.52s/it, lr: 1.0e-04 loss: 7.857e-02]
windy_storm:  13%|#3        | 400/3000 [11:55<1:05:56,  1.52s/it, lr: 1.0e-04 loss: 3.098e-01]
windy_storm:  13%|#3        | 400/3000 [11:55<1:05:56,  1.52s/it, lr: 1.0e-04 loss: 3.098e-01]
windy_storm:  13%|#3        | 401/3000 [11:55<51:27,  1.19s/it, lr: 1.0e-04 loss: 3.098e-01]  
windy_storm:  13%|#3        | 401/3000 [11:55<51:27,  1.19s/it, lr: 1.0e-04 loss: 3.098e-01]  
windy_storm:  13%|#3        | 401/3000 [11:58<51:27,  1.19s/it, lr: 1.0e-04 loss: 1.960e-01]
windy_storm:  13%|#3        | 401/3000 [11:58<51:27,  1.19s/it, lr: 1.0e-04 loss: 1.960e-01]
windy_storm:  13%|#3        | 402/3000 [11:58<1:10:02,  1.62s/it, lr: 1.0e-04 loss: 1.960e-01]
windy_storm:  13%|#3        | 402/3000 [11:58<1:10:02,  1.62s/it, lr: 1.0e-04 loss: 1.960e-01]
windy_storm:  13%|#3        | 402/3000 [11:59<1:10:02,  1.62s/it, lr: 1.0e-04 loss: 4.298e-01]
windy_storm:  13%|#3        | 402/3000 [11:59<1:10:02,  1.62s/it, lr: 1.0e-04 loss: 4.298e-01]
windy_storm:  13%|#3        | 403/3000 [11:59<1:01:03,  1.41s/it, lr: 1.0e-04 loss: 4.298e-01]
windy_storm:  13%|#3        | 403/3000 [11:59<1:01:03,  1.41s/it, lr: 1.0e-04 loss: 4.298e-01]
windy_storm:  13%|#3        | 403/3000 [12:00<1:01:03,  1.41s/it, lr: 1.0e-04 loss: 5.804e-01]
windy_storm:  13%|#3        | 403/3000 [12:00<1:01:03,  1.41s/it, lr: 1.0e-04 loss: 5.804e-01]
windy_storm:  13%|#3        | 404/3000 [12:00<53:39,  1.24s/it, lr: 1.0e-04 loss: 5.804e-01]  
windy_storm:  13%|#3        | 404/3000 [12:00<53:39,  1.24s/it, lr: 1.0e-04 loss: 5.804e-01]  
windy_storm:  13%|#3        | 404/3000 [12:02<53:39,  1.24s/it, lr: 1.0e-04 loss: 3.665e-01]
windy_storm:  13%|#3        | 404/3000 [12:02<53:39,  1.24s/it, lr: 1.0e-04 loss: 3.665e-01]
windy_storm:  14%|#3        | 405/3000 [12:02<58:04,  1.34s/it, lr: 1.0e-04 loss: 3.665e-01]
windy_storm:  14%|#3        | 405/3000 [12:02<58:04,  1.34s/it, lr: 1.0e-04 loss: 3.665e-01]
windy_storm:  14%|#3        | 405/3000 [12:03<58:04,  1.34s/it, lr: 1.0e-04 loss: 5.793e-01]
windy_storm:  14%|#3        | 405/3000 [12:03<58:04,  1.34s/it, lr: 1.0e-04 loss: 5.793e-01]
windy_storm:  14%|#3        | 406/3000 [12:03<1:01:15,  1.42s/it, lr: 1.0e-04 loss: 5.793e-01]
windy_storm:  14%|#3        | 406/3000 [12:03<1:01:15,  1.42s/it, lr: 1.0e-04 loss: 5.793e-01]
windy_storm:  14%|#3        | 406/3000 [12:05<1:01:15,  1.42s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  14%|#3        | 406/3000 [12:05<1:01:15,  1.42s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  14%|#3        | 407/3000 [12:05<1:03:08,  1.46s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  14%|#3        | 407/3000 [12:05<1:03:08,  1.46s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  14%|#3        | 407/3000 [12:06<1:03:08,  1.46s/it, lr: 1.0e-04 loss: 4.006e-01]
windy_storm:  14%|#3        | 407/3000 [12:06<1:03:08,  1.46s/it, lr: 1.0e-04 loss: 4.006e-01]
windy_storm:  14%|#3        | 408/3000 [12:06<1:06:47,  1.55s/it, lr: 1.0e-04 loss: 4.006e-01]
windy_storm:  14%|#3        | 408/3000 [12:06<1:06:47,  1.55s/it, lr: 1.0e-04 loss: 4.006e-01]
windy_storm:  14%|#3        | 408/3000 [12:09<1:06:47,  1.55s/it, lr: 1.0e-04 loss: 6.832e-01]
windy_storm:  14%|#3        | 408/3000 [12:09<1:06:47,  1.55s/it, lr: 1.0e-04 loss: 6.832e-01]
windy_storm:  14%|#3        | 409/3000 [12:10<1:25:52,  1.99s/it, lr: 1.0e-04 loss: 6.832e-01]
windy_storm:  14%|#3        | 409/3000 [12:10<1:25:52,  1.99s/it, lr: 1.0e-04 loss: 6.832e-01]
windy_storm:  14%|#3        | 409/3000 [12:10<1:25:52,  1.99s/it, lr: 1.0e-04 loss: 1.434e-01]
windy_storm:  14%|#3        | 409/3000 [12:10<1:25:52,  1.99s/it, lr: 1.0e-04 loss: 1.434e-01]
windy_storm:  14%|#3        | 410/3000 [12:13<1:25:50,  1.99s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  14%|#3        | 410/3000 [12:13<1:25:50,  1.99s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  14%|#3        | 411/3000 [12:13<1:15:59,  1.76s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  14%|#3        | 411/3000 [12:13<1:15:59,  1.76s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  14%|#3        | 411/3000 [12:16<1:15:59,  1.76s/it, lr: 1.0e-04 loss: 8.715e-02]
windy_storm:  14%|#3        | 411/3000 [12:16<1:15:59,  1.76s/it, lr: 1.0e-04 loss: 8.715e-02]
windy_storm:  14%|#3        | 412/3000 [12:16<1:29:36,  2.08s/it, lr: 1.0e-04 loss: 8.715e-02]
windy_storm:  14%|#3        | 412/3000 [12:16<1:29:36,  2.08s/it, lr: 1.0e-04 loss: 8.715e-02]
windy_storm:  14%|#3        | 412/3000 [12:19<1:29:36,  2.08s/it, lr: 1.0e-04 loss: 4.009e-01]
windy_storm:  14%|#3        | 412/3000 [12:19<1:29:36,  2.08s/it, lr: 1.0e-04 loss: 4.009e-01]
windy_storm:  14%|#3        | 413/3000 [12:19<1:39:41,  2.31s/it, lr: 1.0e-04 loss: 4.009e-01]
windy_storm:  14%|#3        | 413/3000 [12:19<1:39:41,  2.31s/it, lr: 1.0e-04 loss: 4.009e-01]
windy_storm:  14%|#3        | 413/3000 [12:20<1:39:41,  2.31s/it, lr: 1.0e-04 loss: 2.046e-01]
windy_storm:  14%|#3        | 413/3000 [12:20<1:39:41,  2.31s/it, lr: 1.0e-04 loss: 2.046e-01]
windy_storm:  14%|#3        | 414/3000 [12:20<1:22:22,  1.91s/it, lr: 1.0e-04 loss: 2.046e-01]
windy_storm:  14%|#3        | 414/3000 [12:20<1:22:22,  1.91s/it, lr: 1.0e-04 loss: 2.046e-01]
windy_storm:  14%|#3        | 414/3000 [12:23<1:22:22,  1.91s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm:  14%|#3        | 414/3000 [12:23<1:22:22,  1.91s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm:  14%|#3        | 415/3000 [12:23<1:35:35,  2.22s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm:  14%|#3        | 415/3000 [12:23<1:35:35,  2.22s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm:  14%|#3        | 415/3000 [12:25<1:35:35,  2.22s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  14%|#3        | 415/3000 [12:25<1:35:35,  2.22s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  14%|#3        | 416/3000 [12:25<1:27:39,  2.04s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  14%|#3        | 416/3000 [12:25<1:27:39,  2.04s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  14%|#3        | 416/3000 [12:26<1:27:39,  2.04s/it, lr: 1.0e-04 loss: 1.516e-01]
windy_storm:  14%|#3        | 416/3000 [12:26<1:27:39,  2.04s/it, lr: 1.0e-04 loss: 1.516e-01]
windy_storm:  14%|#3        | 417/3000 [12:26<1:22:05,  1.91s/it, lr: 1.0e-04 loss: 1.516e-01]
windy_storm:  14%|#3        | 417/3000 [12:26<1:22:05,  1.91s/it, lr: 1.0e-04 loss: 1.516e-01]
windy_storm:  14%|#3        | 417/3000 [12:28<1:22:05,  1.91s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  14%|#3        | 417/3000 [12:28<1:22:05,  1.91s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  14%|#3        | 418/3000 [12:28<1:17:57,  1.81s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  14%|#3        | 418/3000 [12:28<1:17:57,  1.81s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  14%|#3        | 418/3000 [12:29<1:17:57,  1.81s/it, lr: 1.0e-04 loss: 6.879e-01]
windy_storm:  14%|#3        | 418/3000 [12:29<1:17:57,  1.81s/it, lr: 1.0e-04 loss: 6.879e-01]
windy_storm:  14%|#3        | 419/3000 [12:29<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 6.879e-01]
windy_storm:  14%|#3        | 419/3000 [12:29<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 6.879e-01]
windy_storm:  14%|#3        | 419/3000 [12:29<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 1.928e-01]
windy_storm:  14%|#3        | 419/3000 [12:29<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 1.928e-01]
windy_storm:  14%|#4        | 420/3000 [12:33<1:05:18,  1.52s/it, lr: 1.0e-04 loss: 5.987e-01]
windy_storm:  14%|#4        | 420/3000 [12:33<1:05:18,  1.52s/it, lr: 1.0e-04 loss: 5.987e-01]
windy_storm:  14%|#4        | 421/3000 [12:33<1:06:02,  1.54s/it, lr: 1.0e-04 loss: 5.987e-01]
windy_storm:  14%|#4        | 421/3000 [12:33<1:06:02,  1.54s/it, lr: 1.0e-04 loss: 5.987e-01]
windy_storm:  14%|#4        | 421/3000 [12:33<1:06:02,  1.54s/it, lr: 1.0e-04 loss: 7.262e-01]
windy_storm:  14%|#4        | 421/3000 [12:33<1:06:02,  1.54s/it, lr: 1.0e-04 loss: 7.262e-01]
windy_storm:  14%|#4        | 422/3000 [12:33<57:54,  1.35s/it, lr: 1.0e-04 loss: 7.262e-01]  
windy_storm:  14%|#4        | 422/3000 [12:33<57:54,  1.35s/it, lr: 1.0e-04 loss: 7.262e-01]  
windy_storm:  14%|#4        | 422/3000 [12:35<57:54,  1.35s/it, lr: 1.0e-04 loss: 1.076e-01]
windy_storm:  14%|#4        | 422/3000 [12:35<57:54,  1.35s/it, lr: 1.0e-04 loss: 1.076e-01]
windy_storm:  14%|#4        | 423/3000 [12:35<1:00:30,  1.41s/it, lr: 1.0e-04 loss: 1.076e-01]
windy_storm:  14%|#4        | 423/3000 [12:35<1:00:30,  1.41s/it, lr: 1.0e-04 loss: 1.076e-01]
windy_storm:  14%|#4        | 423/3000 [12:36<1:00:30,  1.41s/it, lr: 1.0e-04 loss: 5.246e-01]
windy_storm:  14%|#4        | 423/3000 [12:36<1:00:30,  1.41s/it, lr: 1.0e-04 loss: 5.246e-01]
windy_storm:  14%|#4        | 424/3000 [12:36<53:11,  1.24s/it, lr: 1.0e-04 loss: 5.246e-01]  
windy_storm:  14%|#4        | 424/3000 [12:36<53:11,  1.24s/it, lr: 1.0e-04 loss: 5.246e-01]  
windy_storm:  14%|#4        | 424/3000 [12:39<53:11,  1.24s/it, lr: 1.0e-04 loss: 3.351e-01]
windy_storm:  14%|#4        | 424/3000 [12:39<53:11,  1.24s/it, lr: 1.0e-04 loss: 3.351e-01]
windy_storm:  14%|#4        | 425/3000 [12:39<1:13:18,  1.71s/it, lr: 1.0e-04 loss: 3.351e-01]
windy_storm:  14%|#4        | 425/3000 [12:39<1:13:18,  1.71s/it, lr: 1.0e-04 loss: 3.351e-01]
windy_storm:  14%|#4        | 425/3000 [12:42<1:13:18,  1.71s/it, lr: 1.0e-04 loss: 7.545e-02]
windy_storm:  14%|#4        | 425/3000 [12:42<1:13:18,  1.71s/it, lr: 1.0e-04 loss: 7.545e-02]
windy_storm:  14%|#4        | 426/3000 [12:42<1:28:25,  2.06s/it, lr: 1.0e-04 loss: 7.545e-02]
windy_storm:  14%|#4        | 426/3000 [12:42<1:28:25,  2.06s/it, lr: 1.0e-04 loss: 7.545e-02]
windy_storm:  14%|#4        | 426/3000 [12:45<1:28:25,  2.06s/it, lr: 1.0e-04 loss: 4.219e-02]
windy_storm:  14%|#4        | 426/3000 [12:45<1:28:25,  2.06s/it, lr: 1.0e-04 loss: 4.219e-02]
windy_storm:  14%|#4        | 427/3000 [12:45<1:39:54,  2.33s/it, lr: 1.0e-04 loss: 4.219e-02]
windy_storm:  14%|#4        | 427/3000 [12:45<1:39:54,  2.33s/it, lr: 1.0e-04 loss: 4.219e-02]
windy_storm:  14%|#4        | 427/3000 [12:48<1:39:54,  2.33s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm:  14%|#4        | 427/3000 [12:48<1:39:54,  2.33s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm:  14%|#4        | 428/3000 [12:48<1:47:59,  2.52s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm:  14%|#4        | 428/3000 [12:48<1:47:59,  2.52s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm:  14%|#4        | 428/3000 [12:51<1:47:59,  2.52s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  14%|#4        | 428/3000 [12:51<1:47:59,  2.52s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  14%|#4        | 429/3000 [12:51<1:53:49,  2.66s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  14%|#4        | 429/3000 [12:51<1:53:49,  2.66s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  14%|#4        | 429/3000 [12:53<1:53:49,  2.66s/it, lr: 1.0e-04 loss: 6.203e-01]
windy_storm:  14%|#4        | 429/3000 [12:53<1:53:49,  2.66s/it, lr: 1.0e-04 loss: 6.203e-01]
windy_storm:  14%|#4        | 430/3000 [12:54<1:53:46,  2.66s/it, lr: 1.0e-04 loss: 8.388e-02]
windy_storm:  14%|#4        | 430/3000 [12:54<1:53:46,  2.66s/it, lr: 1.0e-04 loss: 8.388e-02]
windy_storm:  14%|#4        | 431/3000 [12:54<1:09:06,  1.61s/it, lr: 1.0e-04 loss: 8.388e-02]
windy_storm:  14%|#4        | 431/3000 [12:54<1:09:06,  1.61s/it, lr: 1.0e-04 loss: 8.388e-02]
windy_storm:  14%|#4        | 431/3000 [12:55<1:09:06,  1.61s/it, lr: 1.0e-04 loss: 4.777e-01]
windy_storm:  14%|#4        | 431/3000 [12:55<1:09:06,  1.61s/it, lr: 1.0e-04 loss: 4.777e-01]
windy_storm:  14%|#4        | 432/3000 [12:55<1:00:04,  1.40s/it, lr: 1.0e-04 loss: 4.777e-01]
windy_storm:  14%|#4        | 432/3000 [12:55<1:00:04,  1.40s/it, lr: 1.0e-04 loss: 4.777e-01]
windy_storm:  14%|#4        | 432/3000 [12:57<1:00:04,  1.40s/it, lr: 1.0e-04 loss: 6.952e-01]
windy_storm:  14%|#4        | 432/3000 [12:57<1:00:04,  1.40s/it, lr: 1.0e-04 loss: 6.952e-01]
windy_storm:  14%|#4        | 433/3000 [12:57<1:01:52,  1.45s/it, lr: 1.0e-04 loss: 6.952e-01]
windy_storm:  14%|#4        | 433/3000 [12:57<1:01:52,  1.45s/it, lr: 1.0e-04 loss: 6.952e-01]
windy_storm:  14%|#4        | 433/3000 [12:57<1:01:52,  1.45s/it, lr: 1.0e-04 loss: 2.675e-01]
windy_storm:  14%|#4        | 433/3000 [12:57<1:01:52,  1.45s/it, lr: 1.0e-04 loss: 2.675e-01]
windy_storm:  14%|#4        | 434/3000 [12:57<54:27,  1.27s/it, lr: 1.0e-04 loss: 2.675e-01]  
windy_storm:  14%|#4        | 434/3000 [12:57<54:27,  1.27s/it, lr: 1.0e-04 loss: 2.675e-01]  
windy_storm:  14%|#4        | 434/3000 [12:58<54:27,  1.27s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  14%|#4        | 434/3000 [12:58<54:27,  1.27s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  14%|#4        | 435/3000 [12:58<51:28,  1.20s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  14%|#4        | 435/3000 [12:58<51:28,  1.20s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  14%|#4        | 435/3000 [13:01<51:28,  1.20s/it, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  14%|#4        | 435/3000 [13:01<51:28,  1.20s/it, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  15%|#4        | 436/3000 [13:01<1:13:11,  1.71s/it, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  15%|#4        | 436/3000 [13:01<1:13:11,  1.71s/it, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  15%|#4        | 436/3000 [13:03<1:13:11,  1.71s/it, lr: 1.0e-04 loss: 3.676e-02]
windy_storm:  15%|#4        | 436/3000 [13:03<1:13:11,  1.71s/it, lr: 1.0e-04 loss: 3.676e-02]
windy_storm:  15%|#4        | 437/3000 [13:03<1:10:57,  1.66s/it, lr: 1.0e-04 loss: 3.676e-02]
windy_storm:  15%|#4        | 437/3000 [13:03<1:10:57,  1.66s/it, lr: 1.0e-04 loss: 3.676e-02]
windy_storm:  15%|#4        | 437/3000 [13:04<1:10:57,  1.66s/it, lr: 1.0e-04 loss: 6.689e-01]
windy_storm:  15%|#4        | 437/3000 [13:04<1:10:57,  1.66s/it, lr: 1.0e-04 loss: 6.689e-01]
windy_storm:  15%|#4        | 438/3000 [13:04<1:00:27,  1.42s/it, lr: 1.0e-04 loss: 6.689e-01]
windy_storm:  15%|#4        | 438/3000 [13:04<1:00:27,  1.42s/it, lr: 1.0e-04 loss: 6.689e-01]
windy_storm:  15%|#4        | 438/3000 [13:07<1:00:27,  1.42s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  15%|#4        | 438/3000 [13:07<1:00:27,  1.42s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  15%|#4        | 439/3000 [13:07<1:20:09,  1.88s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  15%|#4        | 439/3000 [13:07<1:20:09,  1.88s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  15%|#4        | 439/3000 [13:07<1:20:09,  1.88s/it, lr: 1.0e-04 loss: 3.858e-01]
windy_storm:  15%|#4        | 439/3000 [13:07<1:20:09,  1.88s/it, lr: 1.0e-04 loss: 3.858e-01]
windy_storm:  15%|#4        | 440/3000 [13:09<1:20:07,  1.88s/it, lr: 1.0e-04 loss: 2.915e-01]
windy_storm:  15%|#4        | 440/3000 [13:09<1:20:07,  1.88s/it, lr: 1.0e-04 loss: 2.915e-01]
windy_storm:  15%|#4        | 441/3000 [13:09<58:51,  1.38s/it, lr: 1.0e-04 loss: 2.915e-01]  
windy_storm:  15%|#4        | 441/3000 [13:09<58:51,  1.38s/it, lr: 1.0e-04 loss: 2.915e-01]  
windy_storm:  15%|#4        | 441/3000 [13:10<58:51,  1.38s/it, lr: 1.0e-04 loss: 2.397e-01]
windy_storm:  15%|#4        | 441/3000 [13:10<58:51,  1.38s/it, lr: 1.0e-04 loss: 2.397e-01]
windy_storm:  15%|#4        | 442/3000 [13:10<52:11,  1.22s/it, lr: 1.0e-04 loss: 2.397e-01]
windy_storm:  15%|#4        | 442/3000 [13:10<52:11,  1.22s/it, lr: 1.0e-04 loss: 2.397e-01]
windy_storm:  15%|#4        | 442/3000 [13:11<52:11,  1.22s/it, lr: 1.0e-04 loss: 1.525e-01]
windy_storm:  15%|#4        | 442/3000 [13:11<52:11,  1.22s/it, lr: 1.0e-04 loss: 1.525e-01]
windy_storm:  15%|#4        | 443/3000 [13:11<47:00,  1.10s/it, lr: 1.0e-04 loss: 1.525e-01]
windy_storm:  15%|#4        | 443/3000 [13:11<47:00,  1.10s/it, lr: 1.0e-04 loss: 1.525e-01]
windy_storm:  15%|#4        | 443/3000 [13:13<47:00,  1.10s/it, lr: 1.0e-04 loss: 1.718e-01]
windy_storm:  15%|#4        | 443/3000 [13:13<47:00,  1.10s/it, lr: 1.0e-04 loss: 1.718e-01]
windy_storm:  15%|#4        | 444/3000 [13:13<1:07:57,  1.60s/it, lr: 1.0e-04 loss: 1.718e-01]
windy_storm:  15%|#4        | 444/3000 [13:13<1:07:57,  1.60s/it, lr: 1.0e-04 loss: 1.718e-01]
windy_storm:  15%|#4        | 444/3000 [13:14<1:07:57,  1.60s/it, lr: 1.0e-04 loss: 5.491e-01]
windy_storm:  15%|#4        | 444/3000 [13:14<1:07:57,  1.60s/it, lr: 1.0e-04 loss: 5.491e-01]
windy_storm:  15%|#4        | 445/3000 [13:14<58:41,  1.38s/it, lr: 1.0e-04 loss: 5.491e-01]  
windy_storm:  15%|#4        | 445/3000 [13:14<58:41,  1.38s/it, lr: 1.0e-04 loss: 5.491e-01]  
windy_storm:  15%|#4        | 445/3000 [13:16<58:41,  1.38s/it, lr: 1.0e-04 loss: 3.194e-02]
windy_storm:  15%|#4        | 445/3000 [13:16<58:41,  1.38s/it, lr: 1.0e-04 loss: 3.194e-02]
windy_storm:  15%|#4        | 446/3000 [13:16<1:01:07,  1.44s/it, lr: 1.0e-04 loss: 3.194e-02]
windy_storm:  15%|#4        | 446/3000 [13:16<1:01:07,  1.44s/it, lr: 1.0e-04 loss: 3.194e-02]
windy_storm:  15%|#4        | 446/3000 [13:17<1:01:07,  1.44s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  15%|#4        | 446/3000 [13:17<1:01:07,  1.44s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  15%|#4        | 447/3000 [13:17<1:02:23,  1.47s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  15%|#4        | 447/3000 [13:17<1:02:23,  1.47s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  15%|#4        | 447/3000 [13:20<1:02:23,  1.47s/it, lr: 1.0e-04 loss: 1.983e-01]
windy_storm:  15%|#4        | 447/3000 [13:20<1:02:23,  1.47s/it, lr: 1.0e-04 loss: 1.983e-01]
windy_storm:  15%|#4        | 448/3000 [13:20<1:20:16,  1.89s/it, lr: 1.0e-04 loss: 1.983e-01]
windy_storm:  15%|#4        | 448/3000 [13:20<1:20:16,  1.89s/it, lr: 1.0e-04 loss: 1.983e-01]
windy_storm:  15%|#4        | 448/3000 [13:21<1:20:16,  1.89s/it, lr: 1.0e-04 loss: 3.598e-01]
windy_storm:  15%|#4        | 448/3000 [13:21<1:20:16,  1.89s/it, lr: 1.0e-04 loss: 3.598e-01]
windy_storm:  15%|#4        | 449/3000 [13:21<1:09:47,  1.64s/it, lr: 1.0e-04 loss: 3.598e-01]
windy_storm:  15%|#4        | 449/3000 [13:21<1:09:47,  1.64s/it, lr: 1.0e-04 loss: 3.598e-01]
windy_storm:  15%|#4        | 449/3000 [13:23<1:09:47,  1.64s/it, lr: 1.0e-04 loss: 4.504e-01]
windy_storm:  15%|#4        | 449/3000 [13:23<1:09:47,  1.64s/it, lr: 1.0e-04 loss: 4.504e-01]
windy_storm:  15%|#5        | 450/3000 [13:25<1:09:46,  1.64s/it, lr: 1.0e-04 loss: 1.522e-01]
windy_storm:  15%|#5        | 450/3000 [13:25<1:09:46,  1.64s/it, lr: 1.0e-04 loss: 1.522e-01]
windy_storm:  15%|#5        | 451/3000 [13:25<52:58,  1.25s/it, lr: 1.0e-04 loss: 1.522e-01]  
windy_storm:  15%|#5        | 451/3000 [13:25<52:58,  1.25s/it, lr: 1.0e-04 loss: 1.522e-01]  
windy_storm:  15%|#5        | 451/3000 [13:27<52:58,  1.25s/it, lr: 1.0e-04 loss: 3.058e-01]
windy_storm:  15%|#5        | 451/3000 [13:27<52:58,  1.25s/it, lr: 1.0e-04 loss: 3.058e-01]
windy_storm:  15%|#5        | 452/3000 [13:27<1:10:21,  1.66s/it, lr: 1.0e-04 loss: 3.058e-01]
windy_storm:  15%|#5        | 452/3000 [13:27<1:10:21,  1.66s/it, lr: 1.0e-04 loss: 3.058e-01]
windy_storm:  15%|#5        | 452/3000 [13:30<1:10:21,  1.66s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  15%|#5        | 452/3000 [13:30<1:10:21,  1.66s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  15%|#5        | 453/3000 [13:30<1:24:59,  2.00s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  15%|#5        | 453/3000 [13:30<1:24:59,  2.00s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  15%|#5        | 453/3000 [13:32<1:24:59,  2.00s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:  15%|#5        | 453/3000 [13:32<1:24:59,  2.00s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:  15%|#5        | 454/3000 [13:32<1:19:41,  1.88s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:  15%|#5        | 454/3000 [13:32<1:19:41,  1.88s/it, lr: 1.0e-04 loss: 2.392e-01]
windy_storm:  15%|#5        | 454/3000 [13:33<1:19:41,  1.88s/it, lr: 1.0e-04 loss: 4.576e-01]
windy_storm:  15%|#5        | 454/3000 [13:33<1:19:41,  1.88s/it, lr: 1.0e-04 loss: 4.576e-01]
windy_storm:  15%|#5        | 455/3000 [13:34<1:15:44,  1.79s/it, lr: 1.0e-04 loss: 4.576e-01]
windy_storm:  15%|#5        | 455/3000 [13:34<1:15:44,  1.79s/it, lr: 1.0e-04 loss: 4.576e-01]
windy_storm:  15%|#5        | 455/3000 [13:36<1:15:44,  1.79s/it, lr: 1.0e-04 loss: 8.375e-02]
windy_storm:  15%|#5        | 455/3000 [13:36<1:15:44,  1.79s/it, lr: 1.0e-04 loss: 8.375e-02]
windy_storm:  15%|#5        | 456/3000 [13:36<1:30:09,  2.13s/it, lr: 1.0e-04 loss: 8.375e-02]
windy_storm:  15%|#5        | 456/3000 [13:36<1:30:09,  2.13s/it, lr: 1.0e-04 loss: 8.375e-02]
windy_storm:  15%|#5        | 456/3000 [13:39<1:30:09,  2.13s/it, lr: 1.0e-04 loss: 6.852e-01]
windy_storm:  15%|#5        | 456/3000 [13:39<1:30:09,  2.13s/it, lr: 1.0e-04 loss: 6.852e-01]
windy_storm:  15%|#5        | 457/3000 [13:39<1:39:46,  2.35s/it, lr: 1.0e-04 loss: 6.852e-01]
windy_storm:  15%|#5        | 457/3000 [13:39<1:39:46,  2.35s/it, lr: 1.0e-04 loss: 6.852e-01]
windy_storm:  15%|#5        | 457/3000 [13:40<1:39:46,  2.35s/it, lr: 1.0e-04 loss: 4.688e-01]
windy_storm:  15%|#5        | 457/3000 [13:40<1:39:46,  2.35s/it, lr: 1.0e-04 loss: 4.688e-01]
windy_storm:  15%|#5        | 458/3000 [13:40<1:20:44,  1.91s/it, lr: 1.0e-04 loss: 4.688e-01]
windy_storm:  15%|#5        | 458/3000 [13:40<1:20:44,  1.91s/it, lr: 1.0e-04 loss: 4.688e-01]
windy_storm:  15%|#5        | 458/3000 [13:43<1:20:44,  1.91s/it, lr: 1.0e-04 loss: 5.621e-01]
windy_storm:  15%|#5        | 458/3000 [13:43<1:20:44,  1.91s/it, lr: 1.0e-04 loss: 5.621e-01]
windy_storm:  15%|#5        | 459/3000 [13:43<1:33:03,  2.20s/it, lr: 1.0e-04 loss: 5.621e-01]
windy_storm:  15%|#5        | 459/3000 [13:43<1:33:03,  2.20s/it, lr: 1.0e-04 loss: 5.621e-01]
windy_storm:  15%|#5        | 459/3000 [13:46<1:33:03,  2.20s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  15%|#5        | 459/3000 [13:46<1:33:03,  2.20s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  15%|#5        | 460/3000 [13:48<1:33:00,  2.20s/it, lr: 1.0e-04 loss: 1.729e-01]
windy_storm:  15%|#5        | 460/3000 [13:48<1:33:00,  2.20s/it, lr: 1.0e-04 loss: 1.729e-01]
windy_storm:  15%|#5        | 461/3000 [13:48<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 1.729e-01]
windy_storm:  15%|#5        | 461/3000 [13:48<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 1.729e-01]
windy_storm:  15%|#5        | 461/3000 [13:49<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 5.555e-01]
windy_storm:  15%|#5        | 461/3000 [13:49<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 5.555e-01]
windy_storm:  15%|#5        | 462/3000 [13:49<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 5.555e-01]
windy_storm:  15%|#5        | 462/3000 [13:49<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 5.555e-01]
windy_storm:  15%|#5        | 462/3000 [13:50<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 5.186e-01]
windy_storm:  15%|#5        | 462/3000 [13:50<1:05:43,  1.55s/it, lr: 1.0e-04 loss: 5.186e-01]
windy_storm:  15%|#5        | 463/3000 [13:50<59:30,  1.41s/it, lr: 1.0e-04 loss: 5.186e-01]  
windy_storm:  15%|#5        | 463/3000 [13:50<59:30,  1.41s/it, lr: 1.0e-04 loss: 5.186e-01]  
windy_storm:  15%|#5        | 463/3000 [13:53<59:30,  1.41s/it, lr: 1.0e-04 loss: 4.837e-01]
windy_storm:  15%|#5        | 463/3000 [13:53<59:30,  1.41s/it, lr: 1.0e-04 loss: 4.837e-01]
windy_storm:  15%|#5        | 464/3000 [13:53<1:16:16,  1.80s/it, lr: 1.0e-04 loss: 4.837e-01]
windy_storm:  15%|#5        | 464/3000 [13:53<1:16:16,  1.80s/it, lr: 1.0e-04 loss: 4.837e-01]
windy_storm:  15%|#5        | 464/3000 [13:56<1:16:16,  1.80s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  15%|#5        | 464/3000 [13:56<1:16:16,  1.80s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  16%|#5        | 465/3000 [13:56<1:30:16,  2.14s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  16%|#5        | 465/3000 [13:56<1:30:16,  2.14s/it, lr: 1.0e-04 loss: 5.467e-01]
windy_storm:  16%|#5        | 465/3000 [13:59<1:30:16,  2.14s/it, lr: 1.0e-04 loss: 4.181e-01]
windy_storm:  16%|#5        | 465/3000 [13:59<1:30:16,  2.14s/it, lr: 1.0e-04 loss: 4.181e-01]
windy_storm:  16%|#5        | 466/3000 [13:59<1:39:33,  2.36s/it, lr: 1.0e-04 loss: 4.181e-01]
windy_storm:  16%|#5        | 466/3000 [13:59<1:39:33,  2.36s/it, lr: 1.0e-04 loss: 4.181e-01]
windy_storm:  16%|#5        | 466/3000 [14:02<1:39:33,  2.36s/it, lr: 1.0e-04 loss: 5.998e-01]
windy_storm:  16%|#5        | 466/3000 [14:02<1:39:33,  2.36s/it, lr: 1.0e-04 loss: 5.998e-01]
windy_storm:  16%|#5        | 467/3000 [14:02<1:47:22,  2.54s/it, lr: 1.0e-04 loss: 5.998e-01]
windy_storm:  16%|#5        | 467/3000 [14:02<1:47:22,  2.54s/it, lr: 1.0e-04 loss: 5.998e-01]
windy_storm:  16%|#5        | 467/3000 [14:04<1:47:22,  2.54s/it, lr: 1.0e-04 loss: 6.626e-01]
windy_storm:  16%|#5        | 467/3000 [14:04<1:47:22,  2.54s/it, lr: 1.0e-04 loss: 6.626e-01]
windy_storm:  16%|#5        | 468/3000 [14:04<1:35:26,  2.26s/it, lr: 1.0e-04 loss: 6.626e-01]
windy_storm:  16%|#5        | 468/3000 [14:04<1:35:26,  2.26s/it, lr: 1.0e-04 loss: 6.626e-01]
windy_storm:  16%|#5        | 468/3000 [14:06<1:35:26,  2.26s/it, lr: 1.0e-04 loss: 2.031e-01]
windy_storm:  16%|#5        | 468/3000 [14:06<1:35:26,  2.26s/it, lr: 1.0e-04 loss: 2.031e-01]
windy_storm:  16%|#5        | 469/3000 [14:06<1:43:36,  2.46s/it, lr: 1.0e-04 loss: 2.031e-01]
windy_storm:  16%|#5        | 469/3000 [14:06<1:43:36,  2.46s/it, lr: 1.0e-04 loss: 2.031e-01]
windy_storm:  16%|#5        | 469/3000 [14:07<1:43:36,  2.46s/it, lr: 1.0e-04 loss: 1.411e-01]
windy_storm:  16%|#5        | 469/3000 [14:07<1:43:36,  2.46s/it, lr: 1.0e-04 loss: 1.411e-01]
windy_storm:  16%|#5        | 470/3000 [14:09<1:43:33,  2.46s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  16%|#5        | 470/3000 [14:09<1:43:33,  2.46s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  16%|#5        | 471/3000 [14:09<1:11:27,  1.70s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  16%|#5        | 471/3000 [14:09<1:11:27,  1.70s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  16%|#5        | 471/3000 [14:12<1:11:27,  1.70s/it, lr: 1.0e-04 loss: 5.714e-02]
windy_storm:  16%|#5        | 471/3000 [14:12<1:11:27,  1.70s/it, lr: 1.0e-04 loss: 5.714e-02]
windy_storm:  16%|#5        | 472/3000 [14:12<1:24:55,  2.02s/it, lr: 1.0e-04 loss: 5.714e-02]
windy_storm:  16%|#5        | 472/3000 [14:12<1:24:55,  2.02s/it, lr: 1.0e-04 loss: 5.714e-02]
windy_storm:  16%|#5        | 472/3000 [14:13<1:24:55,  2.02s/it, lr: 1.0e-04 loss: 3.604e-01]
windy_storm:  16%|#5        | 472/3000 [14:13<1:24:55,  2.02s/it, lr: 1.0e-04 loss: 3.604e-01]
windy_storm:  16%|#5        | 473/3000 [14:13<1:11:13,  1.69s/it, lr: 1.0e-04 loss: 3.604e-01]
windy_storm:  16%|#5        | 473/3000 [14:13<1:11:13,  1.69s/it, lr: 1.0e-04 loss: 3.604e-01]
windy_storm:  16%|#5        | 473/3000 [14:14<1:11:13,  1.69s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  16%|#5        | 473/3000 [14:14<1:11:13,  1.69s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  16%|#5        | 474/3000 [14:14<1:09:41,  1.66s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  16%|#5        | 474/3000 [14:14<1:09:41,  1.66s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  16%|#5        | 474/3000 [14:16<1:09:41,  1.66s/it, lr: 1.0e-04 loss: 3.669e-01]
windy_storm:  16%|#5        | 474/3000 [14:16<1:09:41,  1.66s/it, lr: 1.0e-04 loss: 3.669e-01]
windy_storm:  16%|#5        | 475/3000 [14:16<1:08:29,  1.63s/it, lr: 1.0e-04 loss: 3.669e-01]
windy_storm:  16%|#5        | 475/3000 [14:16<1:08:29,  1.63s/it, lr: 1.0e-04 loss: 3.669e-01]
windy_storm:  16%|#5        | 475/3000 [14:17<1:08:29,  1.63s/it, lr: 1.0e-04 loss: 3.689e-01]
windy_storm:  16%|#5        | 475/3000 [14:17<1:08:29,  1.63s/it, lr: 1.0e-04 loss: 3.689e-01]
windy_storm:  16%|#5        | 476/3000 [14:17<1:01:34,  1.46s/it, lr: 1.0e-04 loss: 3.689e-01]
windy_storm:  16%|#5        | 476/3000 [14:17<1:01:34,  1.46s/it, lr: 1.0e-04 loss: 3.689e-01]
windy_storm:  16%|#5        | 476/3000 [14:20<1:01:34,  1.46s/it, lr: 1.0e-04 loss: 2.020e-02]
windy_storm:  16%|#5        | 476/3000 [14:20<1:01:34,  1.46s/it, lr: 1.0e-04 loss: 2.020e-02]
windy_storm:  16%|#5        | 477/3000 [14:20<1:20:04,  1.90s/it, lr: 1.0e-04 loss: 2.020e-02]
windy_storm:  16%|#5        | 477/3000 [14:20<1:20:04,  1.90s/it, lr: 1.0e-04 loss: 2.020e-02]
windy_storm:  16%|#5        | 477/3000 [14:21<1:20:04,  1.90s/it, lr: 1.0e-04 loss: 6.600e-01]
windy_storm:  16%|#5        | 477/3000 [14:21<1:20:04,  1.90s/it, lr: 1.0e-04 loss: 6.600e-01]
windy_storm:  16%|#5        | 478/3000 [14:21<1:16:05,  1.81s/it, lr: 1.0e-04 loss: 6.600e-01]
windy_storm:  16%|#5        | 478/3000 [14:21<1:16:05,  1.81s/it, lr: 1.0e-04 loss: 6.600e-01]
windy_storm:  16%|#5        | 478/3000 [14:23<1:16:05,  1.81s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  16%|#5        | 478/3000 [14:23<1:16:05,  1.81s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  16%|#5        | 479/3000 [14:23<1:12:15,  1.72s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  16%|#5        | 479/3000 [14:23<1:12:15,  1.72s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  16%|#5        | 479/3000 [14:26<1:12:15,  1.72s/it, lr: 1.0e-04 loss: 2.310e-01]
windy_storm:  16%|#5        | 479/3000 [14:26<1:12:15,  1.72s/it, lr: 1.0e-04 loss: 2.310e-01]
windy_storm:  16%|#6        | 480/3000 [14:28<1:12:13,  1.72s/it, lr: 1.0e-04 loss: 3.131e-01]
windy_storm:  16%|#6        | 480/3000 [14:28<1:12:13,  1.72s/it, lr: 1.0e-04 loss: 3.131e-01]
windy_storm:  16%|#6        | 481/3000 [14:28<54:10,  1.29s/it, lr: 1.0e-04 loss: 3.131e-01]  
windy_storm:  16%|#6        | 481/3000 [14:28<54:10,  1.29s/it, lr: 1.0e-04 loss: 3.131e-01]  
windy_storm:  16%|#6        | 481/3000 [14:29<54:10,  1.29s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  16%|#6        | 481/3000 [14:29<54:10,  1.29s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  16%|#6        | 482/3000 [14:29<49:17,  1.17s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  16%|#6        | 482/3000 [14:29<49:17,  1.17s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  16%|#6        | 482/3000 [14:32<49:17,  1.17s/it, lr: 1.0e-04 loss: 6.595e-01]
windy_storm:  16%|#6        | 482/3000 [14:32<49:17,  1.17s/it, lr: 1.0e-04 loss: 6.595e-01]
windy_storm:  16%|#6        | 483/3000 [14:32<1:08:28,  1.63s/it, lr: 1.0e-04 loss: 6.595e-01]
windy_storm:  16%|#6        | 483/3000 [14:32<1:08:28,  1.63s/it, lr: 1.0e-04 loss: 6.595e-01]
windy_storm:  16%|#6        | 483/3000 [14:33<1:08:28,  1.63s/it, lr: 1.0e-04 loss: 4.594e-01]
windy_storm:  16%|#6        | 483/3000 [14:33<1:08:28,  1.63s/it, lr: 1.0e-04 loss: 4.594e-01]
windy_storm:  16%|#6        | 484/3000 [14:33<1:08:02,  1.62s/it, lr: 1.0e-04 loss: 4.594e-01]
windy_storm:  16%|#6        | 484/3000 [14:33<1:08:02,  1.62s/it, lr: 1.0e-04 loss: 4.594e-01]
windy_storm:  16%|#6        | 484/3000 [14:34<1:08:02,  1.62s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  16%|#6        | 484/3000 [14:34<1:08:02,  1.62s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  16%|#6        | 485/3000 [14:34<58:38,  1.40s/it, lr: 1.0e-04 loss: 2.011e-01]  
windy_storm:  16%|#6        | 485/3000 [14:34<58:38,  1.40s/it, lr: 1.0e-04 loss: 2.011e-01]  
windy_storm:  16%|#6        | 485/3000 [14:37<58:38,  1.40s/it, lr: 1.0e-04 loss: 5.097e-01]
windy_storm:  16%|#6        | 485/3000 [14:37<58:38,  1.40s/it, lr: 1.0e-04 loss: 5.097e-01]
windy_storm:  16%|#6        | 486/3000 [14:37<1:18:36,  1.88s/it, lr: 1.0e-04 loss: 5.097e-01]
windy_storm:  16%|#6        | 486/3000 [14:37<1:18:36,  1.88s/it, lr: 1.0e-04 loss: 5.097e-01]
windy_storm:  16%|#6        | 486/3000 [14:39<1:18:36,  1.88s/it, lr: 1.0e-04 loss: 2.436e-02]
windy_storm:  16%|#6        | 486/3000 [14:39<1:18:36,  1.88s/it, lr: 1.0e-04 loss: 2.436e-02]
windy_storm:  16%|#6        | 487/3000 [14:39<1:15:10,  1.79s/it, lr: 1.0e-04 loss: 2.436e-02]
windy_storm:  16%|#6        | 487/3000 [14:39<1:15:10,  1.79s/it, lr: 1.0e-04 loss: 2.436e-02]
windy_storm:  16%|#6        | 487/3000 [14:42<1:15:10,  1.79s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  16%|#6        | 487/3000 [14:42<1:15:10,  1.79s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  16%|#6        | 488/3000 [14:42<1:30:00,  2.15s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  16%|#6        | 488/3000 [14:42<1:30:00,  2.15s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  16%|#6        | 488/3000 [14:45<1:30:00,  2.15s/it, lr: 1.0e-04 loss: 7.187e-01]
windy_storm:  16%|#6        | 488/3000 [14:45<1:30:00,  2.15s/it, lr: 1.0e-04 loss: 7.187e-01]
windy_storm:  16%|#6        | 489/3000 [14:45<1:39:52,  2.39s/it, lr: 1.0e-04 loss: 7.187e-01]
windy_storm:  16%|#6        | 489/3000 [14:45<1:39:52,  2.39s/it, lr: 1.0e-04 loss: 7.187e-01]
windy_storm:  16%|#6        | 489/3000 [14:46<1:39:52,  2.39s/it, lr: 1.0e-04 loss: 6.411e-01]
windy_storm:  16%|#6        | 489/3000 [14:46<1:39:52,  2.39s/it, lr: 1.0e-04 loss: 6.411e-01]
windy_storm:  16%|#6        | 490/3000 [14:47<1:39:50,  2.39s/it, lr: 1.0e-04 loss: 6.350e-01]
windy_storm:  16%|#6        | 490/3000 [14:47<1:39:50,  2.39s/it, lr: 1.0e-04 loss: 6.350e-01]
windy_storm:  16%|#6        | 491/3000 [14:47<1:09:19,  1.66s/it, lr: 1.0e-04 loss: 6.350e-01]
windy_storm:  16%|#6        | 491/3000 [14:47<1:09:19,  1.66s/it, lr: 1.0e-04 loss: 6.350e-01]
windy_storm:  16%|#6        | 491/3000 [14:50<1:09:19,  1.66s/it, lr: 1.0e-04 loss: 2.305e-01]
windy_storm:  16%|#6        | 491/3000 [14:50<1:09:19,  1.66s/it, lr: 1.0e-04 loss: 2.305e-01]
windy_storm:  16%|#6        | 492/3000 [14:50<1:23:14,  1.99s/it, lr: 1.0e-04 loss: 2.305e-01]
windy_storm:  16%|#6        | 492/3000 [14:50<1:23:14,  1.99s/it, lr: 1.0e-04 loss: 2.305e-01]
windy_storm:  16%|#6        | 492/3000 [14:52<1:23:14,  1.99s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  16%|#6        | 492/3000 [14:52<1:23:14,  1.99s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  16%|#6        | 493/3000 [14:52<1:18:28,  1.88s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  16%|#6        | 493/3000 [14:52<1:18:28,  1.88s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  16%|#6        | 493/3000 [14:55<1:18:28,  1.88s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  16%|#6        | 493/3000 [14:55<1:18:28,  1.88s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  16%|#6        | 494/3000 [14:55<1:31:22,  2.19s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  16%|#6        | 494/3000 [14:55<1:31:22,  2.19s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  16%|#6        | 494/3000 [14:56<1:31:22,  2.19s/it, lr: 1.0e-04 loss: 3.517e-01]
windy_storm:  16%|#6        | 494/3000 [14:56<1:31:22,  2.19s/it, lr: 1.0e-04 loss: 3.517e-01]
windy_storm:  16%|#6        | 495/3000 [14:56<1:14:48,  1.79s/it, lr: 1.0e-04 loss: 3.517e-01]
windy_storm:  16%|#6        | 495/3000 [14:56<1:14:48,  1.79s/it, lr: 1.0e-04 loss: 3.517e-01]
windy_storm:  16%|#6        | 495/3000 [14:59<1:14:48,  1.79s/it, lr: 1.0e-04 loss: 1.766e-01]
windy_storm:  16%|#6        | 495/3000 [14:59<1:14:48,  1.79s/it, lr: 1.0e-04 loss: 1.766e-01]
windy_storm:  17%|#6        | 496/3000 [14:59<1:28:36,  2.12s/it, lr: 1.0e-04 loss: 1.766e-01]
windy_storm:  17%|#6        | 496/3000 [14:59<1:28:36,  2.12s/it, lr: 1.0e-04 loss: 1.766e-01]
windy_storm:  17%|#6        | 496/3000 [15:02<1:28:36,  2.12s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  17%|#6        | 496/3000 [15:02<1:28:36,  2.12s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  17%|#6        | 497/3000 [15:02<1:39:22,  2.38s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  17%|#6        | 497/3000 [15:02<1:39:22,  2.38s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  17%|#6        | 497/3000 [15:03<1:39:22,  2.38s/it, lr: 1.0e-04 loss: 1.041e-01]
windy_storm:  17%|#6        | 497/3000 [15:03<1:39:22,  2.38s/it, lr: 1.0e-04 loss: 1.041e-01]
windy_storm:  17%|#6        | 498/3000 [15:03<1:29:40,  2.15s/it, lr: 1.0e-04 loss: 1.041e-01]
windy_storm:  17%|#6        | 498/3000 [15:03<1:29:40,  2.15s/it, lr: 1.0e-04 loss: 1.041e-01]
windy_storm:  17%|#6        | 498/3000 [15:06<1:29:40,  2.15s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  17%|#6        | 498/3000 [15:06<1:29:40,  2.15s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  17%|#6        | 499/3000 [15:06<1:39:26,  2.39s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  17%|#6        | 499/3000 [15:06<1:39:26,  2.39s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  17%|#6        | 499/3000 [15:08<1:39:26,  2.39s/it, lr: 1.0e-04 loss: 6.972e-01]
windy_storm:  17%|#6        | 499/3000 [15:08<1:39:26,  2.39s/it, lr: 1.0e-04 loss: 6.972e-01]
Saving at step 500
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000000500.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt

windy_storm:  17%|#6        | 500/3000 [15:11<1:39:23,  2.39s/it, lr: 1.0e-04 loss: 2.105e-01]
windy_storm:  17%|#6        | 500/3000 [15:11<1:39:23,  2.39s/it, lr: 1.0e-04 loss: 2.105e-01]
windy_storm:  17%|#6        | 501/3000 [15:11<1:24:17,  2.02s/it, lr: 1.0e-04 loss: 2.105e-01]
windy_storm:  17%|#6        | 501/3000 [15:11<1:24:17,  2.02s/it, lr: 1.0e-04 loss: 2.105e-01]
windy_storm:  17%|#6        | 501/3000 [15:13<1:24:17,  2.02s/it, lr: 1.0e-04 loss: 2.231e-01]
windy_storm:  17%|#6        | 501/3000 [15:13<1:24:17,  2.02s/it, lr: 1.0e-04 loss: 2.231e-01]
windy_storm:  17%|#6        | 502/3000 [15:13<1:19:43,  1.91s/it, lr: 1.0e-04 loss: 2.231e-01]
windy_storm:  17%|#6        | 502/3000 [15:13<1:19:43,  1.91s/it, lr: 1.0e-04 loss: 2.231e-01]
windy_storm:  17%|#6        | 502/3000 [15:16<1:19:43,  1.91s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  17%|#6        | 502/3000 [15:16<1:19:43,  1.91s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  17%|#6        | 503/3000 [15:16<1:31:24,  2.20s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  17%|#6        | 503/3000 [15:16<1:31:24,  2.20s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  17%|#6        | 503/3000 [15:17<1:31:24,  2.20s/it, lr: 1.0e-04 loss: 8.651e-02]
windy_storm:  17%|#6        | 503/3000 [15:17<1:31:24,  2.20s/it, lr: 1.0e-04 loss: 8.651e-02]
windy_storm:  17%|#6        | 504/3000 [15:17<1:24:29,  2.03s/it, lr: 1.0e-04 loss: 8.651e-02]
windy_storm:  17%|#6        | 504/3000 [15:17<1:24:29,  2.03s/it, lr: 1.0e-04 loss: 8.651e-02]
windy_storm:  17%|#6        | 504/3000 [15:18<1:24:29,  2.03s/it, lr: 1.0e-04 loss: 6.091e-01]
windy_storm:  17%|#6        | 504/3000 [15:18<1:24:29,  2.03s/it, lr: 1.0e-04 loss: 6.091e-01]
windy_storm:  17%|#6        | 505/3000 [15:18<1:10:22,  1.69s/it, lr: 1.0e-04 loss: 6.091e-01]
windy_storm:  17%|#6        | 505/3000 [15:18<1:10:22,  1.69s/it, lr: 1.0e-04 loss: 6.091e-01]
windy_storm:  17%|#6        | 505/3000 [15:20<1:10:22,  1.69s/it, lr: 1.0e-04 loss: 1.630e-01]
windy_storm:  17%|#6        | 505/3000 [15:20<1:10:22,  1.69s/it, lr: 1.0e-04 loss: 1.630e-01]
windy_storm:  17%|#6        | 506/3000 [15:20<1:08:43,  1.65s/it, lr: 1.0e-04 loss: 1.630e-01]
windy_storm:  17%|#6        | 506/3000 [15:20<1:08:43,  1.65s/it, lr: 1.0e-04 loss: 1.630e-01]
windy_storm:  17%|#6        | 506/3000 [15:21<1:08:43,  1.65s/it, lr: 1.0e-04 loss: 2.335e-01]
windy_storm:  17%|#6        | 506/3000 [15:21<1:08:43,  1.65s/it, lr: 1.0e-04 loss: 2.335e-01]
windy_storm:  17%|#6        | 507/3000 [15:21<1:07:57,  1.64s/it, lr: 1.0e-04 loss: 2.335e-01]
windy_storm:  17%|#6        | 507/3000 [15:21<1:07:57,  1.64s/it, lr: 1.0e-04 loss: 2.335e-01]
windy_storm:  17%|#6        | 507/3000 [15:22<1:07:57,  1.64s/it, lr: 1.0e-04 loss: 3.590e-01]
windy_storm:  17%|#6        | 507/3000 [15:22<1:07:57,  1.64s/it, lr: 1.0e-04 loss: 3.590e-01]
windy_storm:  17%|#6        | 508/3000 [15:22<57:14,  1.38s/it, lr: 1.0e-04 loss: 3.590e-01]  
windy_storm:  17%|#6        | 508/3000 [15:22<57:14,  1.38s/it, lr: 1.0e-04 loss: 3.590e-01]  
windy_storm:  17%|#6        | 508/3000 [15:25<57:14,  1.38s/it, lr: 1.0e-04 loss: 6.366e-01]
windy_storm:  17%|#6        | 508/3000 [15:25<57:14,  1.38s/it, lr: 1.0e-04 loss: 6.366e-01]
windy_storm:  17%|#6        | 509/3000 [15:25<1:17:02,  1.86s/it, lr: 1.0e-04 loss: 6.366e-01]
windy_storm:  17%|#6        | 509/3000 [15:25<1:17:02,  1.86s/it, lr: 1.0e-04 loss: 6.366e-01]
windy_storm:  17%|#6        | 509/3000 [15:28<1:17:02,  1.86s/it, lr: 1.0e-04 loss: 4.881e-01]
windy_storm:  17%|#6        | 509/3000 [15:28<1:17:02,  1.86s/it, lr: 1.0e-04 loss: 4.881e-01]
windy_storm:  17%|#7        | 510/3000 [15:29<1:17:00,  1.86s/it, lr: 1.0e-04 loss: 3.086e-01]
windy_storm:  17%|#7        | 510/3000 [15:29<1:17:00,  1.86s/it, lr: 1.0e-04 loss: 3.086e-01]
windy_storm:  17%|#7        | 511/3000 [15:29<56:37,  1.37s/it, lr: 1.0e-04 loss: 3.086e-01]  
windy_storm:  17%|#7        | 511/3000 [15:29<56:37,  1.37s/it, lr: 1.0e-04 loss: 3.086e-01]  
windy_storm:  17%|#7        | 511/3000 [15:30<56:37,  1.37s/it, lr: 1.0e-04 loss: 3.423e-01]
windy_storm:  17%|#7        | 511/3000 [15:30<56:37,  1.37s/it, lr: 1.0e-04 loss: 3.423e-01]
windy_storm:  17%|#7        | 512/3000 [15:30<50:22,  1.21s/it, lr: 1.0e-04 loss: 3.423e-01]
windy_storm:  17%|#7        | 512/3000 [15:30<50:22,  1.21s/it, lr: 1.0e-04 loss: 3.423e-01]
windy_storm:  17%|#7        | 512/3000 [15:33<50:22,  1.21s/it, lr: 1.0e-04 loss: 2.366e-01]
windy_storm:  17%|#7        | 512/3000 [15:33<50:22,  1.21s/it, lr: 1.0e-04 loss: 2.366e-01]
windy_storm:  17%|#7        | 513/3000 [15:33<1:10:25,  1.70s/it, lr: 1.0e-04 loss: 2.366e-01]
windy_storm:  17%|#7        | 513/3000 [15:33<1:10:25,  1.70s/it, lr: 1.0e-04 loss: 2.366e-01]
windy_storm:  17%|#7        | 513/3000 [15:36<1:10:25,  1.70s/it, lr: 1.0e-04 loss: 6.267e-01]
windy_storm:  17%|#7        | 513/3000 [15:36<1:10:25,  1.70s/it, lr: 1.0e-04 loss: 6.267e-01]
windy_storm:  17%|#7        | 514/3000 [15:36<1:24:18,  2.03s/it, lr: 1.0e-04 loss: 6.267e-01]
windy_storm:  17%|#7        | 514/3000 [15:36<1:24:18,  2.03s/it, lr: 1.0e-04 loss: 6.267e-01]
windy_storm:  17%|#7        | 514/3000 [15:39<1:24:18,  2.03s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  17%|#7        | 514/3000 [15:39<1:24:18,  2.03s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  17%|#7        | 515/3000 [15:39<1:34:38,  2.29s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  17%|#7        | 515/3000 [15:39<1:34:38,  2.29s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  17%|#7        | 515/3000 [15:41<1:34:38,  2.29s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  17%|#7        | 515/3000 [15:41<1:34:38,  2.29s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  17%|#7        | 516/3000 [15:41<1:26:02,  2.08s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  17%|#7        | 516/3000 [15:41<1:26:02,  2.08s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  17%|#7        | 516/3000 [15:41<1:26:02,  2.08s/it, lr: 1.0e-04 loss: 6.434e-01]
windy_storm:  17%|#7        | 516/3000 [15:41<1:26:02,  2.08s/it, lr: 1.0e-04 loss: 6.434e-01]
windy_storm:  17%|#7        | 517/3000 [15:41<1:10:05,  1.69s/it, lr: 1.0e-04 loss: 6.434e-01]
windy_storm:  17%|#7        | 517/3000 [15:41<1:10:05,  1.69s/it, lr: 1.0e-04 loss: 6.434e-01]
windy_storm:  17%|#7        | 517/3000 [15:42<1:10:05,  1.69s/it, lr: 1.0e-04 loss: 5.261e-01]
windy_storm:  17%|#7        | 517/3000 [15:42<1:10:05,  1.69s/it, lr: 1.0e-04 loss: 5.261e-01]
windy_storm:  17%|#7        | 518/3000 [15:42<58:26,  1.41s/it, lr: 1.0e-04 loss: 5.261e-01]  
windy_storm:  17%|#7        | 518/3000 [15:42<58:26,  1.41s/it, lr: 1.0e-04 loss: 5.261e-01]  
windy_storm:  17%|#7        | 518/3000 [15:44<58:26,  1.41s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  17%|#7        | 518/3000 [15:44<58:26,  1.41s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  17%|#7        | 519/3000 [15:44<59:35,  1.44s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  17%|#7        | 519/3000 [15:44<59:35,  1.44s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  17%|#7        | 519/3000 [15:47<59:35,  1.44s/it, lr: 1.0e-04 loss: 3.777e-01]
windy_storm:  17%|#7        | 519/3000 [15:47<59:35,  1.44s/it, lr: 1.0e-04 loss: 3.777e-01]
windy_storm:  17%|#7        | 520/3000 [15:47<59:34,  1.44s/it, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  17%|#7        | 520/3000 [15:47<59:34,  1.44s/it, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  17%|#7        | 521/3000 [15:47<39:33,  1.04it/s, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  17%|#7        | 521/3000 [15:47<39:33,  1.04it/s, lr: 1.0e-04 loss: 6.939e-01]
windy_storm:  17%|#7        | 521/3000 [15:49<39:33,  1.04it/s, lr: 1.0e-04 loss: 5.646e-02]
windy_storm:  17%|#7        | 521/3000 [15:49<39:33,  1.04it/s, lr: 1.0e-04 loss: 5.646e-02]
windy_storm:  17%|#7        | 522/3000 [15:49<45:42,  1.11s/it, lr: 1.0e-04 loss: 5.646e-02]
windy_storm:  17%|#7        | 522/3000 [15:49<45:42,  1.11s/it, lr: 1.0e-04 loss: 5.646e-02]
windy_storm:  17%|#7        | 522/3000 [15:51<45:42,  1.11s/it, lr: 1.0e-04 loss: 2.791e-01]
windy_storm:  17%|#7        | 522/3000 [15:51<45:42,  1.11s/it, lr: 1.0e-04 loss: 2.791e-01]
windy_storm:  17%|#7        | 523/3000 [15:51<50:49,  1.23s/it, lr: 1.0e-04 loss: 2.791e-01]
windy_storm:  17%|#7        | 523/3000 [15:51<50:49,  1.23s/it, lr: 1.0e-04 loss: 2.791e-01]
windy_storm:  17%|#7        | 523/3000 [15:52<50:49,  1.23s/it, lr: 1.0e-04 loss: 5.514e-01]
windy_storm:  17%|#7        | 523/3000 [15:52<50:49,  1.23s/it, lr: 1.0e-04 loss: 5.514e-01]
windy_storm:  17%|#7        | 524/3000 [15:52<54:49,  1.33s/it, lr: 1.0e-04 loss: 5.514e-01]
windy_storm:  17%|#7        | 524/3000 [15:52<54:49,  1.33s/it, lr: 1.0e-04 loss: 5.514e-01]
windy_storm:  17%|#7        | 524/3000 [15:54<54:49,  1.33s/it, lr: 1.0e-04 loss: 6.140e-02]
windy_storm:  17%|#7        | 524/3000 [15:54<54:49,  1.33s/it, lr: 1.0e-04 loss: 6.140e-02]
windy_storm:  18%|#7        | 525/3000 [15:54<57:43,  1.40s/it, lr: 1.0e-04 loss: 6.140e-02]
windy_storm:  18%|#7        | 525/3000 [15:54<57:43,  1.40s/it, lr: 1.0e-04 loss: 6.140e-02]
windy_storm:  18%|#7        | 525/3000 [15:55<57:43,  1.40s/it, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  18%|#7        | 525/3000 [15:55<57:43,  1.40s/it, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  18%|#7        | 526/3000 [15:55<1:00:01,  1.46s/it, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  18%|#7        | 526/3000 [15:55<1:00:01,  1.46s/it, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  18%|#7        | 526/3000 [15:58<1:00:01,  1.46s/it, lr: 1.0e-04 loss: 2.178e-01]
windy_storm:  18%|#7        | 526/3000 [15:58<1:00:01,  1.46s/it, lr: 1.0e-04 loss: 2.178e-01]
windy_storm:  18%|#7        | 527/3000 [15:58<1:19:46,  1.94s/it, lr: 1.0e-04 loss: 2.178e-01]
windy_storm:  18%|#7        | 527/3000 [15:58<1:19:46,  1.94s/it, lr: 1.0e-04 loss: 2.178e-01]
windy_storm:  18%|#7        | 527/3000 [16:00<1:19:46,  1.94s/it, lr: 1.0e-04 loss: 4.166e-01]
windy_storm:  18%|#7        | 527/3000 [16:00<1:19:46,  1.94s/it, lr: 1.0e-04 loss: 4.166e-01]
windy_storm:  18%|#7        | 528/3000 [16:00<1:15:27,  1.83s/it, lr: 1.0e-04 loss: 4.166e-01]
windy_storm:  18%|#7        | 528/3000 [16:00<1:15:27,  1.83s/it, lr: 1.0e-04 loss: 4.166e-01]
windy_storm:  18%|#7        | 528/3000 [16:02<1:15:27,  1.83s/it, lr: 1.0e-04 loss: 5.407e-01]
windy_storm:  18%|#7        | 528/3000 [16:02<1:15:27,  1.83s/it, lr: 1.0e-04 loss: 5.407e-01]
windy_storm:  18%|#7        | 529/3000 [16:02<1:12:37,  1.76s/it, lr: 1.0e-04 loss: 5.407e-01]
windy_storm:  18%|#7        | 529/3000 [16:02<1:12:37,  1.76s/it, lr: 1.0e-04 loss: 5.407e-01]
windy_storm:  18%|#7        | 529/3000 [16:02<1:12:37,  1.76s/it, lr: 1.0e-04 loss: 6.795e-01]
windy_storm:  18%|#7        | 529/3000 [16:02<1:12:37,  1.76s/it, lr: 1.0e-04 loss: 6.795e-01]
windy_storm:  18%|#7        | 530/3000 [16:03<1:12:35,  1.76s/it, lr: 1.0e-04 loss: 2.219e-01]
windy_storm:  18%|#7        | 530/3000 [16:03<1:12:35,  1.76s/it, lr: 1.0e-04 loss: 2.219e-01]
windy_storm:  18%|#7        | 531/3000 [16:03<47:10,  1.15s/it, lr: 1.0e-04 loss: 2.219e-01]  
windy_storm:  18%|#7        | 531/3000 [16:03<47:10,  1.15s/it, lr: 1.0e-04 loss: 2.219e-01]  
windy_storm:  18%|#7        | 531/3000 [16:06<47:10,  1.15s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  18%|#7        | 531/3000 [16:06<47:10,  1.15s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  18%|#7        | 532/3000 [16:06<1:06:04,  1.61s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  18%|#7        | 532/3000 [16:06<1:06:04,  1.61s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  18%|#7        | 532/3000 [16:09<1:06:04,  1.61s/it, lr: 1.0e-04 loss: 1.512e-01]
windy_storm:  18%|#7        | 532/3000 [16:09<1:06:04,  1.61s/it, lr: 1.0e-04 loss: 1.512e-01]
windy_storm:  18%|#7        | 533/3000 [16:09<1:21:09,  1.97s/it, lr: 1.0e-04 loss: 1.512e-01]
windy_storm:  18%|#7        | 533/3000 [16:09<1:21:09,  1.97s/it, lr: 1.0e-04 loss: 1.512e-01]
windy_storm:  18%|#7        | 533/3000 [16:10<1:21:09,  1.97s/it, lr: 1.0e-04 loss: 3.844e-01]
windy_storm:  18%|#7        | 533/3000 [16:10<1:21:09,  1.97s/it, lr: 1.0e-04 loss: 3.844e-01]
windy_storm:  18%|#7        | 534/3000 [16:10<1:07:41,  1.65s/it, lr: 1.0e-04 loss: 3.844e-01]
windy_storm:  18%|#7        | 534/3000 [16:10<1:07:41,  1.65s/it, lr: 1.0e-04 loss: 3.844e-01]
windy_storm:  18%|#7        | 534/3000 [16:13<1:07:41,  1.65s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  18%|#7        | 534/3000 [16:13<1:07:41,  1.65s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  18%|#7        | 535/3000 [16:13<1:22:39,  2.01s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  18%|#7        | 535/3000 [16:13<1:22:39,  2.01s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  18%|#7        | 535/3000 [16:14<1:22:39,  2.01s/it, lr: 1.0e-04 loss: 6.658e-01]
windy_storm:  18%|#7        | 535/3000 [16:14<1:22:39,  2.01s/it, lr: 1.0e-04 loss: 6.658e-01]
windy_storm:  18%|#7        | 536/3000 [16:14<1:08:05,  1.66s/it, lr: 1.0e-04 loss: 6.658e-01]
windy_storm:  18%|#7        | 536/3000 [16:14<1:08:05,  1.66s/it, lr: 1.0e-04 loss: 6.658e-01]
windy_storm:  18%|#7        | 536/3000 [16:15<1:08:05,  1.66s/it, lr: 1.0e-04 loss: 6.001e-01]
windy_storm:  18%|#7        | 536/3000 [16:15<1:08:05,  1.66s/it, lr: 1.0e-04 loss: 6.001e-01]
windy_storm:  18%|#7        | 537/3000 [16:15<1:07:31,  1.64s/it, lr: 1.0e-04 loss: 6.001e-01]
windy_storm:  18%|#7        | 537/3000 [16:15<1:07:31,  1.64s/it, lr: 1.0e-04 loss: 6.001e-01]
windy_storm:  18%|#7        | 537/3000 [16:17<1:07:31,  1.64s/it, lr: 1.0e-04 loss: 7.474e-01]
windy_storm:  18%|#7        | 537/3000 [16:17<1:07:31,  1.64s/it, lr: 1.0e-04 loss: 7.474e-01]
windy_storm:  18%|#7        | 538/3000 [16:17<1:06:55,  1.63s/it, lr: 1.0e-04 loss: 7.474e-01]
windy_storm:  18%|#7        | 538/3000 [16:17<1:06:55,  1.63s/it, lr: 1.0e-04 loss: 7.474e-01]
windy_storm:  18%|#7        | 538/3000 [16:18<1:06:55,  1.63s/it, lr: 1.0e-04 loss: 4.856e-02]
windy_storm:  18%|#7        | 538/3000 [16:18<1:06:55,  1.63s/it, lr: 1.0e-04 loss: 4.856e-02]
windy_storm:  18%|#7        | 539/3000 [16:18<57:07,  1.39s/it, lr: 1.0e-04 loss: 4.856e-02]  
windy_storm:  18%|#7        | 539/3000 [16:18<57:07,  1.39s/it, lr: 1.0e-04 loss: 4.856e-02]  
windy_storm:  18%|#7        | 539/3000 [16:19<57:07,  1.39s/it, lr: 1.0e-04 loss: 1.869e-01]
windy_storm:  18%|#7        | 539/3000 [16:19<57:07,  1.39s/it, lr: 1.0e-04 loss: 1.869e-01]
windy_storm:  18%|#8        | 540/3000 [16:22<57:06,  1.39s/it, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  18%|#8        | 540/3000 [16:22<57:06,  1.39s/it, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  18%|#8        | 541/3000 [16:22<59:38,  1.46s/it, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  18%|#8        | 541/3000 [16:22<59:38,  1.46s/it, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  18%|#8        | 541/3000 [16:23<59:38,  1.46s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  18%|#8        | 541/3000 [16:23<59:38,  1.46s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  18%|#8        | 542/3000 [16:23<53:18,  1.30s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  18%|#8        | 542/3000 [16:23<53:18,  1.30s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  18%|#8        | 542/3000 [16:26<53:18,  1.30s/it, lr: 1.0e-04 loss: 3.117e-01]
windy_storm:  18%|#8        | 542/3000 [16:26<53:18,  1.30s/it, lr: 1.0e-04 loss: 3.117e-01]
windy_storm:  18%|#8        | 543/3000 [16:26<1:10:51,  1.73s/it, lr: 1.0e-04 loss: 3.117e-01]
windy_storm:  18%|#8        | 543/3000 [16:26<1:10:51,  1.73s/it, lr: 1.0e-04 loss: 3.117e-01]
windy_storm:  18%|#8        | 543/3000 [16:29<1:10:51,  1.73s/it, lr: 1.0e-04 loss: 1.268e-01]
windy_storm:  18%|#8        | 543/3000 [16:29<1:10:51,  1.73s/it, lr: 1.0e-04 loss: 1.268e-01]
windy_storm:  18%|#8        | 544/3000 [16:29<1:25:17,  2.08s/it, lr: 1.0e-04 loss: 1.268e-01]
windy_storm:  18%|#8        | 544/3000 [16:29<1:25:17,  2.08s/it, lr: 1.0e-04 loss: 1.268e-01]
windy_storm:  18%|#8        | 544/3000 [16:32<1:25:17,  2.08s/it, lr: 1.0e-04 loss: 5.604e-01]
windy_storm:  18%|#8        | 544/3000 [16:32<1:25:17,  2.08s/it, lr: 1.0e-04 loss: 5.604e-01]
windy_storm:  18%|#8        | 545/3000 [16:32<1:36:01,  2.35s/it, lr: 1.0e-04 loss: 5.604e-01]
windy_storm:  18%|#8        | 545/3000 [16:32<1:36:01,  2.35s/it, lr: 1.0e-04 loss: 5.604e-01]
windy_storm:  18%|#8        | 545/3000 [16:33<1:36:01,  2.35s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:  18%|#8        | 545/3000 [16:33<1:36:01,  2.35s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:  18%|#8        | 546/3000 [16:33<1:18:18,  1.91s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:  18%|#8        | 546/3000 [16:33<1:18:18,  1.91s/it, lr: 1.0e-04 loss: 5.951e-01]
windy_storm:  18%|#8        | 546/3000 [16:35<1:18:18,  1.91s/it, lr: 1.0e-04 loss: 1.715e-01]
windy_storm:  18%|#8        | 546/3000 [16:35<1:18:18,  1.91s/it, lr: 1.0e-04 loss: 1.715e-01]
windy_storm:  18%|#8        | 547/3000 [16:35<1:14:38,  1.83s/it, lr: 1.0e-04 loss: 1.715e-01]
windy_storm:  18%|#8        | 547/3000 [16:35<1:14:38,  1.83s/it, lr: 1.0e-04 loss: 1.715e-01]
windy_storm:  18%|#8        | 547/3000 [16:36<1:14:38,  1.83s/it, lr: 1.0e-04 loss: 4.483e-01]
windy_storm:  18%|#8        | 547/3000 [16:36<1:14:38,  1.83s/it, lr: 1.0e-04 loss: 4.483e-01]
windy_storm:  18%|#8        | 548/3000 [16:36<1:02:43,  1.53s/it, lr: 1.0e-04 loss: 4.483e-01]
windy_storm:  18%|#8        | 548/3000 [16:36<1:02:43,  1.53s/it, lr: 1.0e-04 loss: 4.483e-01]
windy_storm:  18%|#8        | 548/3000 [16:37<1:02:43,  1.53s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  18%|#8        | 548/3000 [16:37<1:02:43,  1.53s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  18%|#8        | 549/3000 [16:37<1:03:33,  1.56s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  18%|#8        | 549/3000 [16:37<1:03:33,  1.56s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  18%|#8        | 549/3000 [16:38<1:03:33,  1.56s/it, lr: 1.0e-04 loss: 1.155e-01]
windy_storm:  18%|#8        | 549/3000 [16:38<1:03:33,  1.56s/it, lr: 1.0e-04 loss: 1.155e-01]
windy_storm:  18%|#8        | 550/3000 [16:40<1:03:31,  1.56s/it, lr: 1.0e-04 loss: 4.337e-01]
windy_storm:  18%|#8        | 550/3000 [16:40<1:03:31,  1.56s/it, lr: 1.0e-04 loss: 4.337e-01]
windy_storm:  18%|#8        | 551/3000 [16:40<48:59,  1.20s/it, lr: 1.0e-04 loss: 4.337e-01]  
windy_storm:  18%|#8        | 551/3000 [16:40<48:59,  1.20s/it, lr: 1.0e-04 loss: 4.337e-01]  
windy_storm:  18%|#8        | 551/3000 [16:43<48:59,  1.20s/it, lr: 1.0e-04 loss: 2.882e-01]
windy_storm:  18%|#8        | 551/3000 [16:43<48:59,  1.20s/it, lr: 1.0e-04 loss: 2.882e-01]
windy_storm:  18%|#8        | 552/3000 [16:43<1:07:24,  1.65s/it, lr: 1.0e-04 loss: 2.882e-01]
windy_storm:  18%|#8        | 552/3000 [16:43<1:07:24,  1.65s/it, lr: 1.0e-04 loss: 2.882e-01]
windy_storm:  18%|#8        | 552/3000 [16:43<1:07:24,  1.65s/it, lr: 1.0e-04 loss: 2.048e-01]
windy_storm:  18%|#8        | 552/3000 [16:43<1:07:24,  1.65s/it, lr: 1.0e-04 loss: 2.048e-01]
windy_storm:  18%|#8        | 553/3000 [16:43<57:59,  1.42s/it, lr: 1.0e-04 loss: 2.048e-01]  
windy_storm:  18%|#8        | 553/3000 [16:43<57:59,  1.42s/it, lr: 1.0e-04 loss: 2.048e-01]  
windy_storm:  18%|#8        | 553/3000 [16:44<57:59,  1.42s/it, lr: 1.0e-04 loss: 7.471e-01]
windy_storm:  18%|#8        | 553/3000 [16:44<57:59,  1.42s/it, lr: 1.0e-04 loss: 7.471e-01]
windy_storm:  18%|#8        | 554/3000 [16:44<53:59,  1.32s/it, lr: 1.0e-04 loss: 7.471e-01]
windy_storm:  18%|#8        | 554/3000 [16:44<53:59,  1.32s/it, lr: 1.0e-04 loss: 7.471e-01]
windy_storm:  18%|#8        | 554/3000 [16:46<53:59,  1.32s/it, lr: 1.0e-04 loss: 6.432e-01]
windy_storm:  18%|#8        | 554/3000 [16:46<53:59,  1.32s/it, lr: 1.0e-04 loss: 6.432e-01]
windy_storm:  18%|#8        | 555/3000 [16:46<57:03,  1.40s/it, lr: 1.0e-04 loss: 6.432e-01]
windy_storm:  18%|#8        | 555/3000 [16:46<57:03,  1.40s/it, lr: 1.0e-04 loss: 6.432e-01]
windy_storm:  18%|#8        | 555/3000 [16:49<57:03,  1.40s/it, lr: 1.0e-04 loss: 5.640e-01]
windy_storm:  18%|#8        | 555/3000 [16:49<57:03,  1.40s/it, lr: 1.0e-04 loss: 5.640e-01]
windy_storm:  19%|#8        | 556/3000 [16:49<1:15:07,  1.84s/it, lr: 1.0e-04 loss: 5.640e-01]
windy_storm:  19%|#8        | 556/3000 [16:49<1:15:07,  1.84s/it, lr: 1.0e-04 loss: 5.640e-01]
windy_storm:  19%|#8        | 556/3000 [16:50<1:15:07,  1.84s/it, lr: 1.0e-04 loss: 5.691e-01]
windy_storm:  19%|#8        | 556/3000 [16:50<1:15:07,  1.84s/it, lr: 1.0e-04 loss: 5.691e-01]
windy_storm:  19%|#8        | 557/3000 [16:50<1:02:21,  1.53s/it, lr: 1.0e-04 loss: 5.691e-01]
windy_storm:  19%|#8        | 557/3000 [16:50<1:02:21,  1.53s/it, lr: 1.0e-04 loss: 5.691e-01]
windy_storm:  19%|#8        | 557/3000 [16:51<1:02:21,  1.53s/it, lr: 1.0e-04 loss: 1.779e-01]
windy_storm:  19%|#8        | 557/3000 [16:51<1:02:21,  1.53s/it, lr: 1.0e-04 loss: 1.779e-01]
windy_storm:  19%|#8        | 558/3000 [16:51<53:59,  1.33s/it, lr: 1.0e-04 loss: 1.779e-01]  
windy_storm:  19%|#8        | 558/3000 [16:51<53:59,  1.33s/it, lr: 1.0e-04 loss: 1.779e-01]  
windy_storm:  19%|#8        | 558/3000 [16:52<53:59,  1.33s/it, lr: 1.0e-04 loss: 5.251e-01]
windy_storm:  19%|#8        | 558/3000 [16:52<53:59,  1.33s/it, lr: 1.0e-04 loss: 5.251e-01]
windy_storm:  19%|#8        | 559/3000 [16:52<56:49,  1.40s/it, lr: 1.0e-04 loss: 5.251e-01]
windy_storm:  19%|#8        | 559/3000 [16:52<56:49,  1.40s/it, lr: 1.0e-04 loss: 5.251e-01]
windy_storm:  19%|#8        | 559/3000 [16:55<56:49,  1.40s/it, lr: 1.0e-04 loss: 1.116e-01]
windy_storm:  19%|#8        | 559/3000 [16:55<56:49,  1.40s/it, lr: 1.0e-04 loss: 1.116e-01]
windy_storm:  19%|#8        | 560/3000 [16:58<56:48,  1.40s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  19%|#8        | 560/3000 [16:58<56:48,  1.40s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  19%|#8        | 561/3000 [16:58<59:03,  1.45s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  19%|#8        | 561/3000 [16:58<59:03,  1.45s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  19%|#8        | 561/3000 [17:00<59:03,  1.45s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  19%|#8        | 561/3000 [17:00<59:03,  1.45s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  19%|#8        | 562/3000 [17:00<1:00:06,  1.48s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  19%|#8        | 562/3000 [17:00<1:00:06,  1.48s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  19%|#8        | 562/3000 [17:01<1:00:06,  1.48s/it, lr: 1.0e-04 loss: 5.697e-01]
windy_storm:  19%|#8        | 562/3000 [17:01<1:00:06,  1.48s/it, lr: 1.0e-04 loss: 5.697e-01]
windy_storm:  19%|#8        | 563/3000 [17:01<1:01:00,  1.50s/it, lr: 1.0e-04 loss: 5.697e-01]
windy_storm:  19%|#8        | 563/3000 [17:01<1:01:00,  1.50s/it, lr: 1.0e-04 loss: 5.697e-01]
windy_storm:  19%|#8        | 563/3000 [17:02<1:01:00,  1.50s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  19%|#8        | 563/3000 [17:02<1:01:00,  1.50s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  19%|#8        | 564/3000 [17:02<52:55,  1.30s/it, lr: 1.0e-04 loss: 1.904e-01]  
windy_storm:  19%|#8        | 564/3000 [17:02<52:55,  1.30s/it, lr: 1.0e-04 loss: 1.904e-01]  
windy_storm:  19%|#8        | 564/3000 [17:04<52:55,  1.30s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:  19%|#8        | 564/3000 [17:04<52:55,  1.30s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:  19%|#8        | 565/3000 [17:04<56:00,  1.38s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:  19%|#8        | 565/3000 [17:04<56:00,  1.38s/it, lr: 1.0e-04 loss: 4.318e-01]
windy_storm:  19%|#8        | 565/3000 [17:04<56:00,  1.38s/it, lr: 1.0e-04 loss: 5.228e-01]
windy_storm:  19%|#8        | 565/3000 [17:04<56:00,  1.38s/it, lr: 1.0e-04 loss: 5.228e-01]
windy_storm:  19%|#8        | 566/3000 [17:04<49:30,  1.22s/it, lr: 1.0e-04 loss: 5.228e-01]
windy_storm:  19%|#8        | 566/3000 [17:04<49:30,  1.22s/it, lr: 1.0e-04 loss: 5.228e-01]
windy_storm:  19%|#8        | 566/3000 [17:05<49:30,  1.22s/it, lr: 1.0e-04 loss: 6.013e-01]
windy_storm:  19%|#8        | 566/3000 [17:05<49:30,  1.22s/it, lr: 1.0e-04 loss: 6.013e-01]
windy_storm:  19%|#8        | 567/3000 [17:05<46:54,  1.16s/it, lr: 1.0e-04 loss: 6.013e-01]
windy_storm:  19%|#8        | 567/3000 [17:05<46:54,  1.16s/it, lr: 1.0e-04 loss: 6.013e-01]
windy_storm:  19%|#8        | 567/3000 [17:07<46:54,  1.16s/it, lr: 1.0e-04 loss: 3.990e-01]
windy_storm:  19%|#8        | 567/3000 [17:07<46:54,  1.16s/it, lr: 1.0e-04 loss: 3.990e-01]
windy_storm:  19%|#8        | 568/3000 [17:07<51:46,  1.28s/it, lr: 1.0e-04 loss: 3.990e-01]
windy_storm:  19%|#8        | 568/3000 [17:07<51:46,  1.28s/it, lr: 1.0e-04 loss: 3.990e-01]
windy_storm:  19%|#8        | 568/3000 [17:08<51:46,  1.28s/it, lr: 1.0e-04 loss: 5.439e-02]
windy_storm:  19%|#8        | 568/3000 [17:08<51:46,  1.28s/it, lr: 1.0e-04 loss: 5.439e-02]
windy_storm:  19%|#8        | 569/3000 [17:08<46:18,  1.14s/it, lr: 1.0e-04 loss: 5.439e-02]
windy_storm:  19%|#8        | 569/3000 [17:08<46:18,  1.14s/it, lr: 1.0e-04 loss: 5.439e-02]
windy_storm:  19%|#8        | 569/3000 [17:09<46:18,  1.14s/it, lr: 1.0e-04 loss: 5.862e-01]
windy_storm:  19%|#8        | 569/3000 [17:09<46:18,  1.14s/it, lr: 1.0e-04 loss: 5.862e-01]
windy_storm:  19%|#9        | 570/3000 [17:09<46:16,  1.14s/it, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  19%|#9        | 570/3000 [17:09<46:16,  1.14s/it, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  19%|#9        | 571/3000 [17:09<31:56,  1.27it/s, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  19%|#9        | 571/3000 [17:09<31:56,  1.27it/s, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  19%|#9        | 571/3000 [17:12<31:56,  1.27it/s, lr: 1.0e-04 loss: 2.781e-01]
windy_storm:  19%|#9        | 571/3000 [17:12<31:56,  1.27it/s, lr: 1.0e-04 loss: 2.781e-01]
windy_storm:  19%|#9        | 572/3000 [17:12<53:52,  1.33s/it, lr: 1.0e-04 loss: 2.781e-01]
windy_storm:  19%|#9        | 572/3000 [17:12<53:52,  1.33s/it, lr: 1.0e-04 loss: 2.781e-01]
windy_storm:  19%|#9        | 572/3000 [17:13<53:52,  1.33s/it, lr: 1.0e-04 loss: 4.652e-01]
windy_storm:  19%|#9        | 572/3000 [17:13<53:52,  1.33s/it, lr: 1.0e-04 loss: 4.652e-01]
windy_storm:  19%|#9        | 573/3000 [17:13<47:55,  1.18s/it, lr: 1.0e-04 loss: 4.652e-01]
windy_storm:  19%|#9        | 573/3000 [17:13<47:55,  1.18s/it, lr: 1.0e-04 loss: 4.652e-01]
windy_storm:  19%|#9        | 573/3000 [17:16<47:55,  1.18s/it, lr: 1.0e-04 loss: 1.722e-01]
windy_storm:  19%|#9        | 573/3000 [17:16<47:55,  1.18s/it, lr: 1.0e-04 loss: 1.722e-01]
windy_storm:  19%|#9        | 574/3000 [17:16<1:07:18,  1.66s/it, lr: 1.0e-04 loss: 1.722e-01]
windy_storm:  19%|#9        | 574/3000 [17:16<1:07:18,  1.66s/it, lr: 1.0e-04 loss: 1.722e-01]
windy_storm:  19%|#9        | 574/3000 [17:17<1:07:18,  1.66s/it, lr: 1.0e-04 loss: 5.623e-01]
windy_storm:  19%|#9        | 574/3000 [17:17<1:07:18,  1.66s/it, lr: 1.0e-04 loss: 5.623e-01]
windy_storm:  19%|#9        | 575/3000 [17:17<57:15,  1.42s/it, lr: 1.0e-04 loss: 5.623e-01]  
windy_storm:  19%|#9        | 575/3000 [17:17<57:15,  1.42s/it, lr: 1.0e-04 loss: 5.623e-01]  
windy_storm:  19%|#9        | 575/3000 [17:18<57:15,  1.42s/it, lr: 1.0e-04 loss: 6.920e-01]
windy_storm:  19%|#9        | 575/3000 [17:18<57:15,  1.42s/it, lr: 1.0e-04 loss: 6.920e-01]
windy_storm:  19%|#9        | 576/3000 [17:18<50:24,  1.25s/it, lr: 1.0e-04 loss: 6.920e-01]
windy_storm:  19%|#9        | 576/3000 [17:18<50:24,  1.25s/it, lr: 1.0e-04 loss: 6.920e-01]
windy_storm:  19%|#9        | 576/3000 [17:19<50:24,  1.25s/it, lr: 1.0e-04 loss: 4.322e-01]
windy_storm:  19%|#9        | 576/3000 [17:19<50:24,  1.25s/it, lr: 1.0e-04 loss: 4.322e-01]
windy_storm:  19%|#9        | 577/3000 [17:19<54:44,  1.36s/it, lr: 1.0e-04 loss: 4.322e-01]
windy_storm:  19%|#9        | 577/3000 [17:19<54:44,  1.36s/it, lr: 1.0e-04 loss: 4.322e-01]
windy_storm:  19%|#9        | 577/3000 [17:22<54:44,  1.36s/it, lr: 1.0e-04 loss: 1.600e-01]
windy_storm:  19%|#9        | 577/3000 [17:22<54:44,  1.36s/it, lr: 1.0e-04 loss: 1.600e-01]
windy_storm:  19%|#9        | 578/3000 [17:22<1:13:31,  1.82s/it, lr: 1.0e-04 loss: 1.600e-01]
windy_storm:  19%|#9        | 578/3000 [17:22<1:13:31,  1.82s/it, lr: 1.0e-04 loss: 1.600e-01]
windy_storm:  19%|#9        | 578/3000 [17:23<1:13:31,  1.82s/it, lr: 1.0e-04 loss: 6.266e-01]
windy_storm:  19%|#9        | 578/3000 [17:23<1:13:31,  1.82s/it, lr: 1.0e-04 loss: 6.266e-01]
windy_storm:  19%|#9        | 579/3000 [17:23<1:00:37,  1.50s/it, lr: 1.0e-04 loss: 6.266e-01]
windy_storm:  19%|#9        | 579/3000 [17:23<1:00:37,  1.50s/it, lr: 1.0e-04 loss: 6.266e-01]
windy_storm:  19%|#9        | 579/3000 [17:24<1:00:37,  1.50s/it, lr: 1.0e-04 loss: 3.074e-01]
windy_storm:  19%|#9        | 579/3000 [17:24<1:00:37,  1.50s/it, lr: 1.0e-04 loss: 3.074e-01]
windy_storm:  19%|#9        | 580/3000 [17:26<1:00:36,  1.50s/it, lr: 1.0e-04 loss: 6.214e-01]
windy_storm:  19%|#9        | 580/3000 [17:26<1:00:36,  1.50s/it, lr: 1.0e-04 loss: 6.214e-01]
windy_storm:  19%|#9        | 581/3000 [17:26<49:13,  1.22s/it, lr: 1.0e-04 loss: 6.214e-01]  
windy_storm:  19%|#9        | 581/3000 [17:26<49:13,  1.22s/it, lr: 1.0e-04 loss: 6.214e-01]  
windy_storm:  19%|#9        | 581/3000 [17:26<49:13,  1.22s/it, lr: 1.0e-04 loss: 9.116e-02]
windy_storm:  19%|#9        | 581/3000 [17:26<49:13,  1.22s/it, lr: 1.0e-04 loss: 9.116e-02]
windy_storm:  19%|#9        | 582/3000 [17:26<44:37,  1.11s/it, lr: 1.0e-04 loss: 9.116e-02]
windy_storm:  19%|#9        | 582/3000 [17:26<44:37,  1.11s/it, lr: 1.0e-04 loss: 9.116e-02]
windy_storm:  19%|#9        | 582/3000 [17:28<44:37,  1.11s/it, lr: 1.0e-04 loss: 4.512e-01]
windy_storm:  19%|#9        | 582/3000 [17:28<44:37,  1.11s/it, lr: 1.0e-04 loss: 4.512e-01]
windy_storm:  19%|#9        | 583/3000 [17:28<49:47,  1.24s/it, lr: 1.0e-04 loss: 4.512e-01]
windy_storm:  19%|#9        | 583/3000 [17:28<49:47,  1.24s/it, lr: 1.0e-04 loss: 4.512e-01]
windy_storm:  19%|#9        | 583/3000 [17:29<49:47,  1.24s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  19%|#9        | 583/3000 [17:29<49:47,  1.24s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  19%|#9        | 584/3000 [17:29<53:38,  1.33s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  19%|#9        | 584/3000 [17:29<53:38,  1.33s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  19%|#9        | 584/3000 [17:32<53:38,  1.33s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  19%|#9        | 584/3000 [17:32<53:38,  1.33s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  20%|#9        | 585/3000 [17:32<1:11:56,  1.79s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  20%|#9        | 585/3000 [17:32<1:11:56,  1.79s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  20%|#9        | 585/3000 [17:35<1:11:56,  1.79s/it, lr: 1.0e-04 loss: 6.534e-01]
windy_storm:  20%|#9        | 585/3000 [17:35<1:11:56,  1.79s/it, lr: 1.0e-04 loss: 6.534e-01]
windy_storm:  20%|#9        | 586/3000 [17:35<1:24:55,  2.11s/it, lr: 1.0e-04 loss: 6.534e-01]
windy_storm:  20%|#9        | 586/3000 [17:35<1:24:55,  2.11s/it, lr: 1.0e-04 loss: 6.534e-01]
windy_storm:  20%|#9        | 586/3000 [17:38<1:24:55,  2.11s/it, lr: 1.0e-04 loss: 6.885e-01]
windy_storm:  20%|#9        | 586/3000 [17:38<1:24:55,  2.11s/it, lr: 1.0e-04 loss: 6.885e-01]
windy_storm:  20%|#9        | 587/3000 [17:38<1:35:05,  2.36s/it, lr: 1.0e-04 loss: 6.885e-01]
windy_storm:  20%|#9        | 587/3000 [17:38<1:35:05,  2.36s/it, lr: 1.0e-04 loss: 6.885e-01]
windy_storm:  20%|#9        | 587/3000 [17:40<1:35:05,  2.36s/it, lr: 1.0e-04 loss: 6.646e-01]
windy_storm:  20%|#9        | 587/3000 [17:40<1:35:05,  2.36s/it, lr: 1.0e-04 loss: 6.646e-01]
windy_storm:  20%|#9        | 588/3000 [17:40<1:25:57,  2.14s/it, lr: 1.0e-04 loss: 6.646e-01]
windy_storm:  20%|#9        | 588/3000 [17:40<1:25:57,  2.14s/it, lr: 1.0e-04 loss: 6.646e-01]
windy_storm:  20%|#9        | 588/3000 [17:43<1:25:57,  2.14s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:  20%|#9        | 588/3000 [17:43<1:25:57,  2.14s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:  20%|#9        | 589/3000 [17:43<1:35:40,  2.38s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:  20%|#9        | 589/3000 [17:43<1:35:40,  2.38s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:  20%|#9        | 589/3000 [17:45<1:35:40,  2.38s/it, lr: 1.0e-04 loss: 2.591e-01]
windy_storm:  20%|#9        | 589/3000 [17:45<1:35:40,  2.38s/it, lr: 1.0e-04 loss: 2.591e-01]
windy_storm:  20%|#9        | 590/3000 [17:46<1:35:37,  2.38s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:  20%|#9        | 590/3000 [17:46<1:35:37,  2.38s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:  20%|#9        | 591/3000 [17:46<1:06:24,  1.65s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:  20%|#9        | 591/3000 [17:46<1:06:24,  1.65s/it, lr: 1.0e-04 loss: 1.238e-01]
windy_storm:  20%|#9        | 591/3000 [17:47<1:06:24,  1.65s/it, lr: 1.0e-04 loss: 6.525e-01]
windy_storm:  20%|#9        | 591/3000 [17:47<1:06:24,  1.65s/it, lr: 1.0e-04 loss: 6.525e-01]
windy_storm:  20%|#9        | 592/3000 [17:47<57:18,  1.43s/it, lr: 1.0e-04 loss: 6.525e-01]  
windy_storm:  20%|#9        | 592/3000 [17:47<57:18,  1.43s/it, lr: 1.0e-04 loss: 6.525e-01]  
windy_storm:  20%|#9        | 592/3000 [17:50<57:18,  1.43s/it, lr: 1.0e-04 loss: 2.027e-01]
windy_storm:  20%|#9        | 592/3000 [17:50<57:18,  1.43s/it, lr: 1.0e-04 loss: 2.027e-01]
windy_storm:  20%|#9        | 593/3000 [17:50<1:14:02,  1.85s/it, lr: 1.0e-04 loss: 2.027e-01]
windy_storm:  20%|#9        | 593/3000 [17:50<1:14:02,  1.85s/it, lr: 1.0e-04 loss: 2.027e-01]
windy_storm:  20%|#9        | 593/3000 [17:51<1:14:02,  1.85s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  20%|#9        | 593/3000 [17:51<1:14:02,  1.85s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  20%|#9        | 594/3000 [17:51<1:02:53,  1.57s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  20%|#9        | 594/3000 [17:51<1:02:53,  1.57s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  20%|#9        | 594/3000 [17:54<1:02:53,  1.57s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  20%|#9        | 594/3000 [17:54<1:02:53,  1.57s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  20%|#9        | 595/3000 [17:54<1:20:10,  2.00s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  20%|#9        | 595/3000 [17:54<1:20:10,  2.00s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  20%|#9        | 595/3000 [17:55<1:20:10,  2.00s/it, lr: 1.0e-04 loss: 7.148e-01]
windy_storm:  20%|#9        | 595/3000 [17:55<1:20:10,  2.00s/it, lr: 1.0e-04 loss: 7.148e-01]
windy_storm:  20%|#9        | 596/3000 [17:55<1:06:45,  1.67s/it, lr: 1.0e-04 loss: 7.148e-01]
windy_storm:  20%|#9        | 596/3000 [17:55<1:06:45,  1.67s/it, lr: 1.0e-04 loss: 7.148e-01]
windy_storm:  20%|#9        | 596/3000 [17:55<1:06:45,  1.67s/it, lr: 1.0e-04 loss: 2.858e-01]
windy_storm:  20%|#9        | 596/3000 [17:55<1:06:45,  1.67s/it, lr: 1.0e-04 loss: 2.858e-01]
windy_storm:  20%|#9        | 597/3000 [17:55<57:07,  1.43s/it, lr: 1.0e-04 loss: 2.858e-01]  
windy_storm:  20%|#9        | 597/3000 [17:55<57:07,  1.43s/it, lr: 1.0e-04 loss: 2.858e-01]  
windy_storm:  20%|#9        | 597/3000 [17:58<57:07,  1.43s/it, lr: 1.0e-04 loss: 5.466e-01]
windy_storm:  20%|#9        | 597/3000 [17:58<57:07,  1.43s/it, lr: 1.0e-04 loss: 5.466e-01]
windy_storm:  20%|#9        | 598/3000 [17:58<1:15:11,  1.88s/it, lr: 1.0e-04 loss: 5.466e-01]
windy_storm:  20%|#9        | 598/3000 [17:58<1:15:11,  1.88s/it, lr: 1.0e-04 loss: 5.466e-01]
windy_storm:  20%|#9        | 598/3000 [17:59<1:15:11,  1.88s/it, lr: 1.0e-04 loss: 4.621e-01]
windy_storm:  20%|#9        | 598/3000 [17:59<1:15:11,  1.88s/it, lr: 1.0e-04 loss: 4.621e-01]
windy_storm:  20%|#9        | 599/3000 [17:59<1:02:46,  1.57s/it, lr: 1.0e-04 loss: 4.621e-01]
windy_storm:  20%|#9        | 599/3000 [17:59<1:02:46,  1.57s/it, lr: 1.0e-04 loss: 4.621e-01]
windy_storm:  20%|#9        | 599/3000 [18:01<1:02:46,  1.57s/it, lr: 1.0e-04 loss: 6.663e-01]
windy_storm:  20%|#9        | 599/3000 [18:01<1:02:46,  1.57s/it, lr: 1.0e-04 loss: 6.663e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.47s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.47s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.50s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.50s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.47s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.47s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.45s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.45s/it]


Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.43s/it]
Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.43s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.42s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.42s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  20%|##        | 600/3000 [18:02<1:02:44,  1.57s/it, lr: 1.0e-04 loss: 2.095e-01]
windy_storm:  20%|##        | 600/3000 [18:02<1:02:44,  1.57s/it, lr: 1.0e-04 loss: 2.095e-01]
windy_storm:  20%|##        | 601/3000 [18:02<41:48,  1.05s/it, lr: 1.0e-04 loss: 2.095e-01]  
windy_storm:  20%|##        | 601/3000 [18:02<41:48,  1.05s/it, lr: 1.0e-04 loss: 2.095e-01]  
windy_storm:  20%|##        | 601/3000 [18:05<41:48,  1.05s/it, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  20%|##        | 601/3000 [18:05<41:48,  1.05s/it, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  20%|##        | 602/3000 [18:05<1:00:44,  1.52s/it, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  20%|##        | 602/3000 [18:05<1:00:44,  1.52s/it, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  20%|##        | 602/3000 [18:08<1:00:44,  1.52s/it, lr: 1.0e-04 loss: 3.646e-01]
windy_storm:  20%|##        | 602/3000 [18:08<1:00:44,  1.52s/it, lr: 1.0e-04 loss: 3.646e-01]
windy_storm:  20%|##        | 603/3000 [18:08<1:15:36,  1.89s/it, lr: 1.0e-04 loss: 3.646e-01]
windy_storm:  20%|##        | 603/3000 [18:08<1:15:36,  1.89s/it, lr: 1.0e-04 loss: 3.646e-01]
windy_storm:  20%|##        | 603/3000 [18:10<1:15:36,  1.89s/it, lr: 1.0e-04 loss: 1.848e-01]
windy_storm:  20%|##        | 603/3000 [18:10<1:15:36,  1.89s/it, lr: 1.0e-04 loss: 1.848e-01]
windy_storm:  20%|##        | 604/3000 [18:10<1:12:32,  1.82s/it, lr: 1.0e-04 loss: 1.848e-01]
windy_storm:  20%|##        | 604/3000 [18:10<1:12:32,  1.82s/it, lr: 1.0e-04 loss: 1.848e-01]
windy_storm:  20%|##        | 604/3000 [18:13<1:12:32,  1.82s/it, lr: 1.0e-04 loss: 6.545e-01]
windy_storm:  20%|##        | 604/3000 [18:13<1:12:32,  1.82s/it, lr: 1.0e-04 loss: 6.545e-01]
windy_storm:  20%|##        | 605/3000 [18:13<1:26:10,  2.16s/it, lr: 1.0e-04 loss: 6.545e-01]
windy_storm:  20%|##        | 605/3000 [18:13<1:26:10,  2.16s/it, lr: 1.0e-04 loss: 6.545e-01]
windy_storm:  20%|##        | 605/3000 [18:16<1:26:10,  2.16s/it, lr: 1.0e-04 loss: 6.836e-01]
windy_storm:  20%|##        | 605/3000 [18:16<1:26:10,  2.16s/it, lr: 1.0e-04 loss: 6.836e-01]
windy_storm:  20%|##        | 606/3000 [18:16<1:36:03,  2.41s/it, lr: 1.0e-04 loss: 6.836e-01]
windy_storm:  20%|##        | 606/3000 [18:16<1:36:03,  2.41s/it, lr: 1.0e-04 loss: 6.836e-01]
windy_storm:  20%|##        | 606/3000 [18:19<1:36:03,  2.41s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  20%|##        | 606/3000 [18:19<1:36:03,  2.41s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  20%|##        | 607/3000 [18:19<1:43:23,  2.59s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  20%|##        | 607/3000 [18:19<1:43:23,  2.59s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  20%|##        | 607/3000 [18:20<1:43:23,  2.59s/it, lr: 1.0e-04 loss: 2.745e-01]
windy_storm:  20%|##        | 607/3000 [18:20<1:43:23,  2.59s/it, lr: 1.0e-04 loss: 2.745e-01]
windy_storm:  20%|##        | 608/3000 [18:20<1:31:55,  2.31s/it, lr: 1.0e-04 loss: 2.745e-01]
windy_storm:  20%|##        | 608/3000 [18:20<1:31:55,  2.31s/it, lr: 1.0e-04 loss: 2.745e-01]
windy_storm:  20%|##        | 608/3000 [18:24<1:31:55,  2.31s/it, lr: 1.0e-04 loss: 6.350e-02]
windy_storm:  20%|##        | 608/3000 [18:24<1:31:55,  2.31s/it, lr: 1.0e-04 loss: 6.350e-02]
windy_storm:  20%|##        | 609/3000 [18:24<1:40:40,  2.53s/it, lr: 1.0e-04 loss: 6.350e-02]
windy_storm:  20%|##        | 609/3000 [18:24<1:40:40,  2.53s/it, lr: 1.0e-04 loss: 6.350e-02]
windy_storm:  20%|##        | 609/3000 [18:25<1:40:40,  2.53s/it, lr: 1.0e-04 loss: 3.068e-01]
windy_storm:  20%|##        | 609/3000 [18:25<1:40:40,  2.53s/it, lr: 1.0e-04 loss: 3.068e-01]
windy_storm:  20%|##        | 610/3000 [18:26<1:40:37,  2.53s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  20%|##        | 610/3000 [18:26<1:40:37,  2.53s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  20%|##        | 611/3000 [18:26<1:01:40,  1.55s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  20%|##        | 611/3000 [18:26<1:01:40,  1.55s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  20%|##        | 611/3000 [18:29<1:01:40,  1.55s/it, lr: 1.0e-04 loss: 3.281e-01]
windy_storm:  20%|##        | 611/3000 [18:29<1:01:40,  1.55s/it, lr: 1.0e-04 loss: 3.281e-01]
windy_storm:  20%|##        | 612/3000 [18:29<1:16:23,  1.92s/it, lr: 1.0e-04 loss: 3.281e-01]
windy_storm:  20%|##        | 612/3000 [18:29<1:16:23,  1.92s/it, lr: 1.0e-04 loss: 3.281e-01]
windy_storm:  20%|##        | 612/3000 [18:30<1:16:23,  1.92s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  20%|##        | 612/3000 [18:30<1:16:23,  1.92s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  20%|##        | 613/3000 [18:30<1:06:57,  1.68s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  20%|##        | 613/3000 [18:30<1:06:57,  1.68s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  20%|##        | 613/3000 [18:32<1:06:57,  1.68s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  20%|##        | 613/3000 [18:32<1:06:57,  1.68s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  20%|##        | 614/3000 [18:32<1:06:02,  1.66s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  20%|##        | 614/3000 [18:32<1:06:02,  1.66s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  20%|##        | 614/3000 [18:35<1:06:02,  1.66s/it, lr: 1.0e-04 loss: 2.969e-02]
windy_storm:  20%|##        | 614/3000 [18:35<1:06:02,  1.66s/it, lr: 1.0e-04 loss: 2.969e-02]
windy_storm:  20%|##        | 615/3000 [18:35<1:20:21,  2.02s/it, lr: 1.0e-04 loss: 2.969e-02]
windy_storm:  20%|##        | 615/3000 [18:35<1:20:21,  2.02s/it, lr: 1.0e-04 loss: 2.969e-02]
windy_storm:  20%|##        | 615/3000 [18:36<1:20:21,  2.02s/it, lr: 1.0e-04 loss: 5.136e-01]
windy_storm:  20%|##        | 615/3000 [18:36<1:20:21,  2.02s/it, lr: 1.0e-04 loss: 5.136e-01]
windy_storm:  21%|##        | 616/3000 [18:36<1:15:30,  1.90s/it, lr: 1.0e-04 loss: 5.136e-01]
windy_storm:  21%|##        | 616/3000 [18:36<1:15:30,  1.90s/it, lr: 1.0e-04 loss: 5.136e-01]
windy_storm:  21%|##        | 616/3000 [18:37<1:15:30,  1.90s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  21%|##        | 616/3000 [18:37<1:15:30,  1.90s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  21%|##        | 617/3000 [18:37<1:03:11,  1.59s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  21%|##        | 617/3000 [18:37<1:03:11,  1.59s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  21%|##        | 617/3000 [18:38<1:03:11,  1.59s/it, lr: 1.0e-04 loss: 1.694e-01]
windy_storm:  21%|##        | 617/3000 [18:38<1:03:11,  1.59s/it, lr: 1.0e-04 loss: 1.694e-01]
windy_storm:  21%|##        | 618/3000 [18:38<53:37,  1.35s/it, lr: 1.0e-04 loss: 1.694e-01]  
windy_storm:  21%|##        | 618/3000 [18:38<53:37,  1.35s/it, lr: 1.0e-04 loss: 1.694e-01]  
windy_storm:  21%|##        | 618/3000 [18:39<53:37,  1.35s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  21%|##        | 618/3000 [18:39<53:37,  1.35s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  21%|##        | 619/3000 [18:39<47:27,  1.20s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  21%|##        | 619/3000 [18:39<47:27,  1.20s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  21%|##        | 619/3000 [18:40<47:27,  1.20s/it, lr: 1.0e-04 loss: 2.503e-01]
windy_storm:  21%|##        | 619/3000 [18:40<47:27,  1.20s/it, lr: 1.0e-04 loss: 2.503e-01]
windy_storm:  21%|##        | 620/3000 [18:41<47:26,  1.20s/it, lr: 1.0e-04 loss: 1.885e-01]
windy_storm:  21%|##        | 620/3000 [18:41<47:26,  1.20s/it, lr: 1.0e-04 loss: 1.885e-01]
windy_storm:  21%|##        | 621/3000 [18:41<33:23,  1.19it/s, lr: 1.0e-04 loss: 1.885e-01]
windy_storm:  21%|##        | 621/3000 [18:41<33:23,  1.19it/s, lr: 1.0e-04 loss: 1.885e-01]
windy_storm:  21%|##        | 621/3000 [18:44<33:23,  1.19it/s, lr: 1.0e-04 loss: 4.654e-01]
windy_storm:  21%|##        | 621/3000 [18:44<33:23,  1.19it/s, lr: 1.0e-04 loss: 4.654e-01]
windy_storm:  21%|##        | 622/3000 [18:44<53:49,  1.36s/it, lr: 1.0e-04 loss: 4.654e-01]
windy_storm:  21%|##        | 622/3000 [18:44<53:49,  1.36s/it, lr: 1.0e-04 loss: 4.654e-01]
windy_storm:  21%|##        | 622/3000 [18:46<53:49,  1.36s/it, lr: 1.0e-04 loss: 1.746e-01]
windy_storm:  21%|##        | 622/3000 [18:46<53:49,  1.36s/it, lr: 1.0e-04 loss: 1.746e-01]
windy_storm:  21%|##        | 623/3000 [18:46<56:15,  1.42s/it, lr: 1.0e-04 loss: 1.746e-01]
windy_storm:  21%|##        | 623/3000 [18:46<56:15,  1.42s/it, lr: 1.0e-04 loss: 1.746e-01]
windy_storm:  21%|##        | 623/3000 [18:47<56:15,  1.42s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  21%|##        | 623/3000 [18:47<56:15,  1.42s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  21%|##        | 624/3000 [18:47<58:00,  1.47s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  21%|##        | 624/3000 [18:47<58:00,  1.47s/it, lr: 1.0e-04 loss: 5.723e-01]
windy_storm:  21%|##        | 624/3000 [18:50<58:00,  1.47s/it, lr: 1.0e-04 loss: 3.692e-01]
windy_storm:  21%|##        | 624/3000 [18:50<58:00,  1.47s/it, lr: 1.0e-04 loss: 3.692e-01]
windy_storm:  21%|##        | 625/3000 [18:50<1:15:18,  1.90s/it, lr: 1.0e-04 loss: 3.692e-01]
windy_storm:  21%|##        | 625/3000 [18:50<1:15:18,  1.90s/it, lr: 1.0e-04 loss: 3.692e-01]
windy_storm:  21%|##        | 625/3000 [18:51<1:15:18,  1.90s/it, lr: 1.0e-04 loss: 5.903e-01]
windy_storm:  21%|##        | 625/3000 [18:51<1:15:18,  1.90s/it, lr: 1.0e-04 loss: 5.903e-01]
windy_storm:  21%|##        | 626/3000 [18:51<1:02:18,  1.57s/it, lr: 1.0e-04 loss: 5.903e-01]
windy_storm:  21%|##        | 626/3000 [18:51<1:02:18,  1.57s/it, lr: 1.0e-04 loss: 5.903e-01]
windy_storm:  21%|##        | 626/3000 [18:54<1:02:18,  1.57s/it, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:  21%|##        | 626/3000 [18:54<1:02:18,  1.57s/it, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:  21%|##        | 627/3000 [18:54<1:19:50,  2.02s/it, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:  21%|##        | 627/3000 [18:54<1:19:50,  2.02s/it, lr: 1.0e-04 loss: 6.199e-01]
windy_storm:  21%|##        | 627/3000 [18:56<1:19:50,  2.02s/it, lr: 1.0e-04 loss: 6.378e-01]
windy_storm:  21%|##        | 627/3000 [18:56<1:19:50,  2.02s/it, lr: 1.0e-04 loss: 6.378e-01]
windy_storm:  21%|##        | 628/3000 [18:56<1:14:26,  1.88s/it, lr: 1.0e-04 loss: 6.378e-01]
windy_storm:  21%|##        | 628/3000 [18:56<1:14:26,  1.88s/it, lr: 1.0e-04 loss: 6.378e-01]
windy_storm:  21%|##        | 628/3000 [18:56<1:14:26,  1.88s/it, lr: 1.0e-04 loss: 2.735e-01]
windy_storm:  21%|##        | 628/3000 [18:56<1:14:26,  1.88s/it, lr: 1.0e-04 loss: 2.735e-01]
windy_storm:  21%|##        | 629/3000 [18:56<1:01:29,  1.56s/it, lr: 1.0e-04 loss: 2.735e-01]
windy_storm:  21%|##        | 629/3000 [18:56<1:01:29,  1.56s/it, lr: 1.0e-04 loss: 2.735e-01]
windy_storm:  21%|##        | 629/3000 [18:57<1:01:29,  1.56s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  21%|##        | 629/3000 [18:57<1:01:29,  1.56s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  21%|##1       | 630/3000 [18:58<1:01:28,  1.56s/it, lr: 1.0e-04 loss: 2.625e-01]
windy_storm:  21%|##1       | 630/3000 [18:58<1:01:28,  1.56s/it, lr: 1.0e-04 loss: 2.625e-01]
windy_storm:  21%|##1       | 631/3000 [18:58<40:20,  1.02s/it, lr: 1.0e-04 loss: 2.625e-01]  
windy_storm:  21%|##1       | 631/3000 [18:58<40:20,  1.02s/it, lr: 1.0e-04 loss: 2.625e-01]  
windy_storm:  21%|##1       | 631/3000 [19:01<40:20,  1.02s/it, lr: 1.0e-04 loss: 1.028e-01]
windy_storm:  21%|##1       | 631/3000 [19:01<40:20,  1.02s/it, lr: 1.0e-04 loss: 1.028e-01]
windy_storm:  21%|##1       | 632/3000 [19:01<59:19,  1.50s/it, lr: 1.0e-04 loss: 1.028e-01]
windy_storm:  21%|##1       | 632/3000 [19:01<59:19,  1.50s/it, lr: 1.0e-04 loss: 1.028e-01]
windy_storm:  21%|##1       | 632/3000 [19:04<59:19,  1.50s/it, lr: 1.0e-04 loss: 2.219e-01]
windy_storm:  21%|##1       | 632/3000 [19:04<59:19,  1.50s/it, lr: 1.0e-04 loss: 2.219e-01]
windy_storm:  21%|##1       | 633/3000 [19:04<1:14:19,  1.88s/it, lr: 1.0e-04 loss: 2.219e-01]
windy_storm:  21%|##1       | 633/3000 [19:04<1:14:19,  1.88s/it, lr: 1.0e-04 loss: 2.219e-01]
windy_storm:  21%|##1       | 633/3000 [19:05<1:14:19,  1.88s/it, lr: 1.0e-04 loss: 1.948e-01]
windy_storm:  21%|##1       | 633/3000 [19:05<1:14:19,  1.88s/it, lr: 1.0e-04 loss: 1.948e-01]
windy_storm:  21%|##1       | 634/3000 [19:05<1:11:09,  1.80s/it, lr: 1.0e-04 loss: 1.948e-01]
windy_storm:  21%|##1       | 634/3000 [19:05<1:11:09,  1.80s/it, lr: 1.0e-04 loss: 1.948e-01]
windy_storm:  21%|##1       | 634/3000 [19:07<1:11:09,  1.80s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  21%|##1       | 634/3000 [19:07<1:11:09,  1.80s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  21%|##1       | 635/3000 [19:07<1:08:32,  1.74s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  21%|##1       | 635/3000 [19:07<1:08:32,  1.74s/it, lr: 1.0e-04 loss: 6.087e-01]
windy_storm:  21%|##1       | 635/3000 [19:09<1:08:32,  1.74s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  21%|##1       | 635/3000 [19:09<1:08:32,  1.74s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  21%|##1       | 636/3000 [19:09<1:06:44,  1.69s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  21%|##1       | 636/3000 [19:09<1:06:44,  1.69s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  21%|##1       | 636/3000 [19:09<1:06:44,  1.69s/it, lr: 1.0e-04 loss: 5.573e-01]
windy_storm:  21%|##1       | 636/3000 [19:09<1:06:44,  1.69s/it, lr: 1.0e-04 loss: 5.573e-01]
windy_storm:  21%|##1       | 637/3000 [19:09<56:16,  1.43s/it, lr: 1.0e-04 loss: 5.573e-01]  
windy_storm:  21%|##1       | 637/3000 [19:09<56:16,  1.43s/it, lr: 1.0e-04 loss: 5.573e-01]  
windy_storm:  21%|##1       | 637/3000 [19:11<56:16,  1.43s/it, lr: 1.0e-04 loss: 4.338e-01]
windy_storm:  21%|##1       | 637/3000 [19:11<56:16,  1.43s/it, lr: 1.0e-04 loss: 4.338e-01]
windy_storm:  21%|##1       | 638/3000 [19:11<57:54,  1.47s/it, lr: 1.0e-04 loss: 4.338e-01]
windy_storm:  21%|##1       | 638/3000 [19:11<57:54,  1.47s/it, lr: 1.0e-04 loss: 4.338e-01]
windy_storm:  21%|##1       | 638/3000 [19:12<57:54,  1.47s/it, lr: 1.0e-04 loss: 4.074e-01]
windy_storm:  21%|##1       | 638/3000 [19:12<57:54,  1.47s/it, lr: 1.0e-04 loss: 4.074e-01]
windy_storm:  21%|##1       | 639/3000 [19:12<49:35,  1.26s/it, lr: 1.0e-04 loss: 4.074e-01]
windy_storm:  21%|##1       | 639/3000 [19:12<49:35,  1.26s/it, lr: 1.0e-04 loss: 4.074e-01]
windy_storm:  21%|##1       | 639/3000 [19:15<49:35,  1.26s/it, lr: 1.0e-04 loss: 1.486e-01]
windy_storm:  21%|##1       | 639/3000 [19:15<49:35,  1.26s/it, lr: 1.0e-04 loss: 1.486e-01]
windy_storm:  21%|##1       | 640/3000 [19:16<49:34,  1.26s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  21%|##1       | 640/3000 [19:16<49:34,  1.26s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  21%|##1       | 641/3000 [19:16<42:41,  1.09s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  21%|##1       | 641/3000 [19:16<42:41,  1.09s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  21%|##1       | 641/3000 [19:18<42:41,  1.09s/it, lr: 1.0e-04 loss: 1.480e-01]
windy_storm:  21%|##1       | 641/3000 [19:18<42:41,  1.09s/it, lr: 1.0e-04 loss: 1.480e-01]
windy_storm:  21%|##1       | 642/3000 [19:18<47:33,  1.21s/it, lr: 1.0e-04 loss: 1.480e-01]
windy_storm:  21%|##1       | 642/3000 [19:18<47:33,  1.21s/it, lr: 1.0e-04 loss: 1.480e-01]
windy_storm:  21%|##1       | 642/3000 [19:19<47:33,  1.21s/it, lr: 1.0e-04 loss: 3.431e-02]
windy_storm:  21%|##1       | 642/3000 [19:19<47:33,  1.21s/it, lr: 1.0e-04 loss: 3.431e-02]
windy_storm:  21%|##1       | 643/3000 [19:19<42:58,  1.09s/it, lr: 1.0e-04 loss: 3.431e-02]
windy_storm:  21%|##1       | 643/3000 [19:19<42:58,  1.09s/it, lr: 1.0e-04 loss: 3.431e-02]
windy_storm:  21%|##1       | 643/3000 [19:20<42:58,  1.09s/it, lr: 1.0e-04 loss: 4.711e-01]
windy_storm:  21%|##1       | 643/3000 [19:20<42:58,  1.09s/it, lr: 1.0e-04 loss: 4.711e-01]
windy_storm:  21%|##1       | 644/3000 [19:20<48:12,  1.23s/it, lr: 1.0e-04 loss: 4.711e-01]
windy_storm:  21%|##1       | 644/3000 [19:20<48:12,  1.23s/it, lr: 1.0e-04 loss: 4.711e-01]
windy_storm:  21%|##1       | 644/3000 [19:22<48:12,  1.23s/it, lr: 1.0e-04 loss: 7.038e-01]
windy_storm:  21%|##1       | 644/3000 [19:22<48:12,  1.23s/it, lr: 1.0e-04 loss: 7.038e-01]
windy_storm:  22%|##1       | 645/3000 [19:22<51:57,  1.32s/it, lr: 1.0e-04 loss: 7.038e-01]
windy_storm:  22%|##1       | 645/3000 [19:22<51:57,  1.32s/it, lr: 1.0e-04 loss: 7.038e-01]
windy_storm:  22%|##1       | 645/3000 [19:23<51:57,  1.32s/it, lr: 1.0e-04 loss: 2.028e-01]
windy_storm:  22%|##1       | 645/3000 [19:23<51:57,  1.32s/it, lr: 1.0e-04 loss: 2.028e-01]
windy_storm:  22%|##1       | 646/3000 [19:23<54:32,  1.39s/it, lr: 1.0e-04 loss: 2.028e-01]
windy_storm:  22%|##1       | 646/3000 [19:23<54:32,  1.39s/it, lr: 1.0e-04 loss: 2.028e-01]
windy_storm:  22%|##1       | 646/3000 [19:24<54:32,  1.39s/it, lr: 1.0e-04 loss: 2.762e-01]
windy_storm:  22%|##1       | 646/3000 [19:24<54:32,  1.39s/it, lr: 1.0e-04 loss: 2.762e-01]
windy_storm:  22%|##1       | 647/3000 [19:24<47:25,  1.21s/it, lr: 1.0e-04 loss: 2.762e-01]
windy_storm:  22%|##1       | 647/3000 [19:24<47:25,  1.21s/it, lr: 1.0e-04 loss: 2.762e-01]
windy_storm:  22%|##1       | 647/3000 [19:25<47:25,  1.21s/it, lr: 1.0e-04 loss: 5.493e-01]
windy_storm:  22%|##1       | 647/3000 [19:25<47:25,  1.21s/it, lr: 1.0e-04 loss: 5.493e-01]
windy_storm:  22%|##1       | 648/3000 [19:25<42:26,  1.08s/it, lr: 1.0e-04 loss: 5.493e-01]
windy_storm:  22%|##1       | 648/3000 [19:25<42:26,  1.08s/it, lr: 1.0e-04 loss: 5.493e-01]
windy_storm:  22%|##1       | 648/3000 [19:27<42:26,  1.08s/it, lr: 1.0e-04 loss: 2.198e-01]
windy_storm:  22%|##1       | 648/3000 [19:27<42:26,  1.08s/it, lr: 1.0e-04 loss: 2.198e-01]
windy_storm:  22%|##1       | 649/3000 [19:27<47:53,  1.22s/it, lr: 1.0e-04 loss: 2.198e-01]
windy_storm:  22%|##1       | 649/3000 [19:27<47:53,  1.22s/it, lr: 1.0e-04 loss: 2.198e-01]
windy_storm:  22%|##1       | 649/3000 [19:29<47:53,  1.22s/it, lr: 1.0e-04 loss: 1.196e-01]
windy_storm:  22%|##1       | 649/3000 [19:29<47:53,  1.22s/it, lr: 1.0e-04 loss: 1.196e-01]
windy_storm:  22%|##1       | 650/3000 [19:31<47:52,  1.22s/it, lr: 1.0e-04 loss: 5.857e-01]
windy_storm:  22%|##1       | 650/3000 [19:31<47:52,  1.22s/it, lr: 1.0e-04 loss: 5.857e-01]
windy_storm:  22%|##1       | 651/3000 [19:31<40:02,  1.02s/it, lr: 1.0e-04 loss: 5.857e-01]
windy_storm:  22%|##1       | 651/3000 [19:31<40:02,  1.02s/it, lr: 1.0e-04 loss: 5.857e-01]
windy_storm:  22%|##1       | 651/3000 [19:32<40:02,  1.02s/it, lr: 1.0e-04 loss: 5.990e-01]
windy_storm:  22%|##1       | 651/3000 [19:32<40:02,  1.02s/it, lr: 1.0e-04 loss: 5.990e-01]
windy_storm:  22%|##1       | 652/3000 [19:32<37:31,  1.04it/s, lr: 1.0e-04 loss: 5.990e-01]
windy_storm:  22%|##1       | 652/3000 [19:32<37:31,  1.04it/s, lr: 1.0e-04 loss: 5.990e-01]
windy_storm:  22%|##1       | 652/3000 [19:35<37:31,  1.04it/s, lr: 1.0e-04 loss: 6.249e-01]
windy_storm:  22%|##1       | 652/3000 [19:35<37:31,  1.04it/s, lr: 1.0e-04 loss: 6.249e-01]
windy_storm:  22%|##1       | 653/3000 [19:35<58:26,  1.49s/it, lr: 1.0e-04 loss: 6.249e-01]
windy_storm:  22%|##1       | 653/3000 [19:35<58:26,  1.49s/it, lr: 1.0e-04 loss: 6.249e-01]
windy_storm:  22%|##1       | 653/3000 [19:38<58:26,  1.49s/it, lr: 1.0e-04 loss: 2.283e-01]
windy_storm:  22%|##1       | 653/3000 [19:38<58:26,  1.49s/it, lr: 1.0e-04 loss: 2.283e-01]
windy_storm:  22%|##1       | 654/3000 [19:38<1:14:59,  1.92s/it, lr: 1.0e-04 loss: 2.283e-01]
windy_storm:  22%|##1       | 654/3000 [19:38<1:14:59,  1.92s/it, lr: 1.0e-04 loss: 2.283e-01]
windy_storm:  22%|##1       | 654/3000 [19:39<1:14:59,  1.92s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  22%|##1       | 654/3000 [19:39<1:14:59,  1.92s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  22%|##1       | 655/3000 [19:39<1:03:03,  1.61s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  22%|##1       | 655/3000 [19:39<1:03:03,  1.61s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  22%|##1       | 655/3000 [19:40<1:03:03,  1.61s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  22%|##1       | 655/3000 [19:40<1:03:03,  1.61s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  22%|##1       | 656/3000 [19:40<1:02:47,  1.61s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  22%|##1       | 656/3000 [19:40<1:02:47,  1.61s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  22%|##1       | 656/3000 [19:41<1:02:47,  1.61s/it, lr: 1.0e-04 loss: 9.266e-02]
windy_storm:  22%|##1       | 656/3000 [19:41<1:02:47,  1.61s/it, lr: 1.0e-04 loss: 9.266e-02]
windy_storm:  22%|##1       | 657/3000 [19:41<53:57,  1.38s/it, lr: 1.0e-04 loss: 9.266e-02]  
windy_storm:  22%|##1       | 657/3000 [19:41<53:57,  1.38s/it, lr: 1.0e-04 loss: 9.266e-02]  
windy_storm:  22%|##1       | 657/3000 [19:43<53:57,  1.38s/it, lr: 1.0e-04 loss: 4.698e-01]
windy_storm:  22%|##1       | 657/3000 [19:43<53:57,  1.38s/it, lr: 1.0e-04 loss: 4.698e-01]
windy_storm:  22%|##1       | 658/3000 [19:43<55:51,  1.43s/it, lr: 1.0e-04 loss: 4.698e-01]
windy_storm:  22%|##1       | 658/3000 [19:43<55:51,  1.43s/it, lr: 1.0e-04 loss: 4.698e-01]
windy_storm:  22%|##1       | 658/3000 [19:44<55:51,  1.43s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  22%|##1       | 658/3000 [19:44<55:51,  1.43s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  22%|##1       | 659/3000 [19:44<57:14,  1.47s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  22%|##1       | 659/3000 [19:44<57:14,  1.47s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  22%|##1       | 659/3000 [19:47<57:14,  1.47s/it, lr: 1.0e-04 loss: 6.851e-02]
windy_storm:  22%|##1       | 659/3000 [19:47<57:14,  1.47s/it, lr: 1.0e-04 loss: 6.851e-02]
windy_storm:  22%|##2       | 660/3000 [19:50<57:13,  1.47s/it, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  22%|##2       | 660/3000 [19:50<57:13,  1.47s/it, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  22%|##2       | 661/3000 [19:50<57:12,  1.47s/it, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  22%|##2       | 661/3000 [19:50<57:12,  1.47s/it, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  22%|##2       | 661/3000 [19:51<57:12,  1.47s/it, lr: 1.0e-04 loss: 6.292e-01]
windy_storm:  22%|##2       | 661/3000 [19:51<57:12,  1.47s/it, lr: 1.0e-04 loss: 6.292e-01]
windy_storm:  22%|##2       | 662/3000 [19:51<50:12,  1.29s/it, lr: 1.0e-04 loss: 6.292e-01]
windy_storm:  22%|##2       | 662/3000 [19:51<50:12,  1.29s/it, lr: 1.0e-04 loss: 6.292e-01]
windy_storm:  22%|##2       | 662/3000 [19:54<50:12,  1.29s/it, lr: 1.0e-04 loss: 3.406e-01]
windy_storm:  22%|##2       | 662/3000 [19:54<50:12,  1.29s/it, lr: 1.0e-04 loss: 3.406e-01]
windy_storm:  22%|##2       | 663/3000 [19:54<1:07:50,  1.74s/it, lr: 1.0e-04 loss: 3.406e-01]
windy_storm:  22%|##2       | 663/3000 [19:54<1:07:50,  1.74s/it, lr: 1.0e-04 loss: 3.406e-01]
windy_storm:  22%|##2       | 663/3000 [19:57<1:07:50,  1.74s/it, lr: 1.0e-04 loss: 3.556e-01]
windy_storm:  22%|##2       | 663/3000 [19:57<1:07:50,  1.74s/it, lr: 1.0e-04 loss: 3.556e-01]
windy_storm:  22%|##2       | 664/3000 [19:57<1:21:28,  2.09s/it, lr: 1.0e-04 loss: 3.556e-01]
windy_storm:  22%|##2       | 664/3000 [19:57<1:21:28,  2.09s/it, lr: 1.0e-04 loss: 3.556e-01]
windy_storm:  22%|##2       | 664/3000 [19:59<1:21:28,  2.09s/it, lr: 1.0e-04 loss: 2.934e-01]
windy_storm:  22%|##2       | 664/3000 [19:59<1:21:28,  2.09s/it, lr: 1.0e-04 loss: 2.934e-01]
windy_storm:  22%|##2       | 665/3000 [19:59<1:16:08,  1.96s/it, lr: 1.0e-04 loss: 2.934e-01]
windy_storm:  22%|##2       | 665/3000 [19:59<1:16:08,  1.96s/it, lr: 1.0e-04 loss: 2.934e-01]
windy_storm:  22%|##2       | 665/3000 [19:59<1:16:08,  1.96s/it, lr: 1.0e-04 loss: 4.988e-01]
windy_storm:  22%|##2       | 665/3000 [19:59<1:16:08,  1.96s/it, lr: 1.0e-04 loss: 4.988e-01]
windy_storm:  22%|##2       | 666/3000 [19:59<1:02:50,  1.62s/it, lr: 1.0e-04 loss: 4.988e-01]
windy_storm:  22%|##2       | 666/3000 [19:59<1:02:50,  1.62s/it, lr: 1.0e-04 loss: 4.988e-01]
windy_storm:  22%|##2       | 666/3000 [20:00<1:02:50,  1.62s/it, lr: 1.0e-04 loss: 9.918e-02]
windy_storm:  22%|##2       | 666/3000 [20:00<1:02:50,  1.62s/it, lr: 1.0e-04 loss: 9.918e-02]
windy_storm:  22%|##2       | 667/3000 [20:00<56:38,  1.46s/it, lr: 1.0e-04 loss: 9.918e-02]  
windy_storm:  22%|##2       | 667/3000 [20:00<56:38,  1.46s/it, lr: 1.0e-04 loss: 9.918e-02]  
windy_storm:  22%|##2       | 667/3000 [20:01<56:38,  1.46s/it, lr: 1.0e-04 loss: 2.537e-01]
windy_storm:  22%|##2       | 667/3000 [20:01<56:38,  1.46s/it, lr: 1.0e-04 loss: 2.537e-01]
windy_storm:  22%|##2       | 668/3000 [20:01<49:32,  1.27s/it, lr: 1.0e-04 loss: 2.537e-01]
windy_storm:  22%|##2       | 668/3000 [20:01<49:32,  1.27s/it, lr: 1.0e-04 loss: 2.537e-01]
windy_storm:  22%|##2       | 668/3000 [20:04<49:32,  1.27s/it, lr: 1.0e-04 loss: 9.614e-02]
windy_storm:  22%|##2       | 668/3000 [20:04<49:32,  1.27s/it, lr: 1.0e-04 loss: 9.614e-02]
windy_storm:  22%|##2       | 669/3000 [20:04<1:09:48,  1.80s/it, lr: 1.0e-04 loss: 9.614e-02]
windy_storm:  22%|##2       | 669/3000 [20:04<1:09:48,  1.80s/it, lr: 1.0e-04 loss: 9.614e-02]
windy_storm:  22%|##2       | 669/3000 [20:05<1:09:48,  1.80s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  22%|##2       | 669/3000 [20:05<1:09:48,  1.80s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  22%|##2       | 670/3000 [20:08<1:09:47,  1.80s/it, lr: 1.0e-04 loss: 3.977e-01]
windy_storm:  22%|##2       | 670/3000 [20:08<1:09:47,  1.80s/it, lr: 1.0e-04 loss: 3.977e-01]
windy_storm:  22%|##2       | 671/3000 [20:08<1:04:52,  1.67s/it, lr: 1.0e-04 loss: 3.977e-01]
windy_storm:  22%|##2       | 671/3000 [20:08<1:04:52,  1.67s/it, lr: 1.0e-04 loss: 3.977e-01]
windy_storm:  22%|##2       | 671/3000 [20:09<1:04:52,  1.67s/it, lr: 1.0e-04 loss: 1.628e-01]
windy_storm:  22%|##2       | 671/3000 [20:09<1:04:52,  1.67s/it, lr: 1.0e-04 loss: 1.628e-01]
windy_storm:  22%|##2       | 672/3000 [20:09<56:49,  1.46s/it, lr: 1.0e-04 loss: 1.628e-01]  
windy_storm:  22%|##2       | 672/3000 [20:09<56:49,  1.46s/it, lr: 1.0e-04 loss: 1.628e-01]  
windy_storm:  22%|##2       | 672/3000 [20:12<56:49,  1.46s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  22%|##2       | 672/3000 [20:12<56:49,  1.46s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  22%|##2       | 673/3000 [20:12<1:11:59,  1.86s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  22%|##2       | 673/3000 [20:12<1:11:59,  1.86s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  22%|##2       | 673/3000 [20:14<1:11:59,  1.86s/it, lr: 1.0e-04 loss: 1.853e-01]
windy_storm:  22%|##2       | 673/3000 [20:14<1:11:59,  1.86s/it, lr: 1.0e-04 loss: 1.853e-01]
windy_storm:  22%|##2       | 674/3000 [20:14<1:09:00,  1.78s/it, lr: 1.0e-04 loss: 1.853e-01]
windy_storm:  22%|##2       | 674/3000 [20:14<1:09:00,  1.78s/it, lr: 1.0e-04 loss: 1.853e-01]
windy_storm:  22%|##2       | 674/3000 [20:15<1:09:00,  1.78s/it, lr: 1.0e-04 loss: 5.519e-01]
windy_storm:  22%|##2       | 674/3000 [20:15<1:09:00,  1.78s/it, lr: 1.0e-04 loss: 5.519e-01]
windy_storm:  22%|##2       | 675/3000 [20:15<1:07:08,  1.73s/it, lr: 1.0e-04 loss: 5.519e-01]
windy_storm:  22%|##2       | 675/3000 [20:15<1:07:08,  1.73s/it, lr: 1.0e-04 loss: 5.519e-01]
windy_storm:  22%|##2       | 675/3000 [20:17<1:07:08,  1.73s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  22%|##2       | 675/3000 [20:17<1:07:08,  1.73s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  23%|##2       | 676/3000 [20:17<1:05:29,  1.69s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  23%|##2       | 676/3000 [20:17<1:05:29,  1.69s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  23%|##2       | 676/3000 [20:20<1:05:29,  1.69s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  23%|##2       | 676/3000 [20:20<1:05:29,  1.69s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  23%|##2       | 677/3000 [20:20<1:19:16,  2.05s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  23%|##2       | 677/3000 [20:20<1:19:16,  2.05s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  23%|##2       | 677/3000 [20:23<1:19:16,  2.05s/it, lr: 1.0e-04 loss: 2.357e-01]
windy_storm:  23%|##2       | 677/3000 [20:23<1:19:16,  2.05s/it, lr: 1.0e-04 loss: 2.357e-01]
windy_storm:  23%|##2       | 678/3000 [20:23<1:29:57,  2.32s/it, lr: 1.0e-04 loss: 2.357e-01]
windy_storm:  23%|##2       | 678/3000 [20:23<1:29:57,  2.32s/it, lr: 1.0e-04 loss: 2.357e-01]
windy_storm:  23%|##2       | 678/3000 [20:26<1:29:57,  2.32s/it, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  23%|##2       | 678/3000 [20:26<1:29:57,  2.32s/it, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  23%|##2       | 679/3000 [20:26<1:36:38,  2.50s/it, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  23%|##2       | 679/3000 [20:26<1:36:38,  2.50s/it, lr: 1.0e-04 loss: 4.667e-01]
windy_storm:  23%|##2       | 679/3000 [20:27<1:36:38,  2.50s/it, lr: 1.0e-04 loss: 6.896e-02]
windy_storm:  23%|##2       | 679/3000 [20:27<1:36:38,  2.50s/it, lr: 1.0e-04 loss: 6.896e-02]
windy_storm:  23%|##2       | 680/3000 [20:30<1:36:36,  2.50s/it, lr: 1.0e-04 loss: 3.541e-01]
windy_storm:  23%|##2       | 680/3000 [20:30<1:36:36,  2.50s/it, lr: 1.0e-04 loss: 3.541e-01]
windy_storm:  23%|##2       | 681/3000 [20:30<1:19:17,  2.05s/it, lr: 1.0e-04 loss: 3.541e-01]
windy_storm:  23%|##2       | 681/3000 [20:30<1:19:17,  2.05s/it, lr: 1.0e-04 loss: 3.541e-01]
windy_storm:  23%|##2       | 681/3000 [20:31<1:19:17,  2.05s/it, lr: 1.0e-04 loss: 6.279e-02]
windy_storm:  23%|##2       | 681/3000 [20:31<1:19:17,  2.05s/it, lr: 1.0e-04 loss: 6.279e-02]
windy_storm:  23%|##2       | 682/3000 [20:31<1:07:40,  1.75s/it, lr: 1.0e-04 loss: 6.279e-02]
windy_storm:  23%|##2       | 682/3000 [20:31<1:07:40,  1.75s/it, lr: 1.0e-04 loss: 6.279e-02]
windy_storm:  23%|##2       | 682/3000 [20:32<1:07:40,  1.75s/it, lr: 1.0e-04 loss: 4.287e-01]
windy_storm:  23%|##2       | 682/3000 [20:32<1:07:40,  1.75s/it, lr: 1.0e-04 loss: 4.287e-01]
windy_storm:  23%|##2       | 683/3000 [20:32<58:13,  1.51s/it, lr: 1.0e-04 loss: 4.287e-01]  
windy_storm:  23%|##2       | 683/3000 [20:32<58:13,  1.51s/it, lr: 1.0e-04 loss: 4.287e-01]  
windy_storm:  23%|##2       | 683/3000 [20:35<58:13,  1.51s/it, lr: 1.0e-04 loss: 4.017e-01]
windy_storm:  23%|##2       | 683/3000 [20:35<58:13,  1.51s/it, lr: 1.0e-04 loss: 4.017e-01]
windy_storm:  23%|##2       | 684/3000 [20:35<1:13:49,  1.91s/it, lr: 1.0e-04 loss: 4.017e-01]
windy_storm:  23%|##2       | 684/3000 [20:35<1:13:49,  1.91s/it, lr: 1.0e-04 loss: 4.017e-01]
windy_storm:  23%|##2       | 684/3000 [20:38<1:13:49,  1.91s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  23%|##2       | 684/3000 [20:38<1:13:49,  1.91s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  23%|##2       | 685/3000 [20:38<1:24:37,  2.19s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  23%|##2       | 685/3000 [20:38<1:24:37,  2.19s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  23%|##2       | 685/3000 [20:39<1:24:37,  2.19s/it, lr: 1.0e-04 loss: 6.201e-01]
windy_storm:  23%|##2       | 685/3000 [20:39<1:24:37,  2.19s/it, lr: 1.0e-04 loss: 6.201e-01]
windy_storm:  23%|##2       | 686/3000 [20:39<1:08:47,  1.78s/it, lr: 1.0e-04 loss: 6.201e-01]
windy_storm:  23%|##2       | 686/3000 [20:39<1:08:47,  1.78s/it, lr: 1.0e-04 loss: 6.201e-01]
windy_storm:  23%|##2       | 686/3000 [20:39<1:08:47,  1.78s/it, lr: 1.0e-04 loss: 8.506e-02]
windy_storm:  23%|##2       | 686/3000 [20:39<1:08:47,  1.78s/it, lr: 1.0e-04 loss: 8.506e-02]
windy_storm:  23%|##2       | 687/3000 [20:39<58:05,  1.51s/it, lr: 1.0e-04 loss: 8.506e-02]  
windy_storm:  23%|##2       | 687/3000 [20:39<58:05,  1.51s/it, lr: 1.0e-04 loss: 8.506e-02]  
windy_storm:  23%|##2       | 687/3000 [20:41<58:05,  1.51s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  23%|##2       | 687/3000 [20:41<58:05,  1.51s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  23%|##2       | 688/3000 [20:41<58:27,  1.52s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  23%|##2       | 688/3000 [20:41<58:27,  1.52s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  23%|##2       | 688/3000 [20:44<58:27,  1.52s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  23%|##2       | 688/3000 [20:44<58:27,  1.52s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  23%|##2       | 689/3000 [20:44<1:15:08,  1.95s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  23%|##2       | 689/3000 [20:44<1:15:08,  1.95s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  23%|##2       | 689/3000 [20:45<1:15:08,  1.95s/it, lr: 1.0e-04 loss: 5.499e-01]
windy_storm:  23%|##2       | 689/3000 [20:45<1:15:08,  1.95s/it, lr: 1.0e-04 loss: 5.499e-01]
windy_storm:  23%|##3       | 690/3000 [20:46<1:15:06,  1.95s/it, lr: 1.0e-04 loss: 9.248e-02]
windy_storm:  23%|##3       | 690/3000 [20:46<1:15:06,  1.95s/it, lr: 1.0e-04 loss: 9.248e-02]
windy_storm:  23%|##3       | 691/3000 [20:46<54:14,  1.41s/it, lr: 1.0e-04 loss: 9.248e-02]  
windy_storm:  23%|##3       | 691/3000 [20:46<54:14,  1.41s/it, lr: 1.0e-04 loss: 9.248e-02]  
windy_storm:  23%|##3       | 691/3000 [20:48<54:14,  1.41s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  23%|##3       | 691/3000 [20:48<54:14,  1.41s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  23%|##3       | 692/3000 [20:48<55:49,  1.45s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  23%|##3       | 692/3000 [20:48<55:49,  1.45s/it, lr: 1.0e-04 loss: 4.905e-01]
windy_storm:  23%|##3       | 692/3000 [20:51<55:49,  1.45s/it, lr: 1.0e-04 loss: 2.422e-01]
windy_storm:  23%|##3       | 692/3000 [20:51<55:49,  1.45s/it, lr: 1.0e-04 loss: 2.422e-01]
windy_storm:  23%|##3       | 693/3000 [20:51<1:11:02,  1.85s/it, lr: 1.0e-04 loss: 2.422e-01]
windy_storm:  23%|##3       | 693/3000 [20:51<1:11:02,  1.85s/it, lr: 1.0e-04 loss: 2.422e-01]
windy_storm:  23%|##3       | 693/3000 [20:52<1:11:02,  1.85s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  23%|##3       | 693/3000 [20:52<1:11:02,  1.85s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  23%|##3       | 694/3000 [20:52<1:00:12,  1.57s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  23%|##3       | 694/3000 [20:52<1:00:12,  1.57s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  23%|##3       | 694/3000 [20:53<1:00:12,  1.57s/it, lr: 1.0e-04 loss: 2.700e-01]
windy_storm:  23%|##3       | 694/3000 [20:53<1:00:12,  1.57s/it, lr: 1.0e-04 loss: 2.700e-01]
windy_storm:  23%|##3       | 695/3000 [20:53<53:53,  1.40s/it, lr: 1.0e-04 loss: 2.700e-01]  
windy_storm:  23%|##3       | 695/3000 [20:53<53:53,  1.40s/it, lr: 1.0e-04 loss: 2.700e-01]  
windy_storm:  23%|##3       | 695/3000 [20:55<53:53,  1.40s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  23%|##3       | 695/3000 [20:55<53:53,  1.40s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  23%|##3       | 696/3000 [20:55<1:09:51,  1.82s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  23%|##3       | 696/3000 [20:55<1:09:51,  1.82s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  23%|##3       | 696/3000 [20:56<1:09:51,  1.82s/it, lr: 1.0e-04 loss: 1.631e-01]
windy_storm:  23%|##3       | 696/3000 [20:56<1:09:51,  1.82s/it, lr: 1.0e-04 loss: 1.631e-01]
windy_storm:  23%|##3       | 697/3000 [20:56<58:39,  1.53s/it, lr: 1.0e-04 loss: 1.631e-01]  
windy_storm:  23%|##3       | 697/3000 [20:56<58:39,  1.53s/it, lr: 1.0e-04 loss: 1.631e-01]  
windy_storm:  23%|##3       | 697/3000 [20:58<58:39,  1.53s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  23%|##3       | 697/3000 [20:58<58:39,  1.53s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  23%|##3       | 698/3000 [20:58<58:58,  1.54s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  23%|##3       | 698/3000 [20:58<58:58,  1.54s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  23%|##3       | 698/3000 [20:59<58:58,  1.54s/it, lr: 1.0e-04 loss: 5.177e-01]
windy_storm:  23%|##3       | 698/3000 [20:59<58:58,  1.54s/it, lr: 1.0e-04 loss: 5.177e-01]
windy_storm:  23%|##3       | 699/3000 [20:59<59:19,  1.55s/it, lr: 1.0e-04 loss: 5.177e-01]
windy_storm:  23%|##3       | 699/3000 [20:59<59:19,  1.55s/it, lr: 1.0e-04 loss: 5.177e-01]
windy_storm:  23%|##3       | 699/3000 [21:02<59:19,  1.55s/it, lr: 1.0e-04 loss: 5.954e-01]
windy_storm:  23%|##3       | 699/3000 [21:02<59:19,  1.55s/it, lr: 1.0e-04 loss: 5.954e-01]
windy_storm:  23%|##3       | 700/3000 [21:05<59:18,  1.55s/it, lr: 1.0e-04 loss: 6.779e-01]
windy_storm:  23%|##3       | 700/3000 [21:05<59:18,  1.55s/it, lr: 1.0e-04 loss: 6.779e-01]
windy_storm:  23%|##3       | 701/3000 [21:05<57:41,  1.51s/it, lr: 1.0e-04 loss: 6.779e-01]
windy_storm:  23%|##3       | 701/3000 [21:05<57:41,  1.51s/it, lr: 1.0e-04 loss: 6.779e-01]
windy_storm:  23%|##3       | 701/3000 [21:06<57:41,  1.51s/it, lr: 1.0e-04 loss: 2.260e-01]
windy_storm:  23%|##3       | 701/3000 [21:06<57:41,  1.51s/it, lr: 1.0e-04 loss: 2.260e-01]
windy_storm:  23%|##3       | 702/3000 [21:06<51:05,  1.33s/it, lr: 1.0e-04 loss: 2.260e-01]
windy_storm:  23%|##3       | 702/3000 [21:06<51:05,  1.33s/it, lr: 1.0e-04 loss: 2.260e-01]
windy_storm:  23%|##3       | 702/3000 [21:07<51:05,  1.33s/it, lr: 1.0e-04 loss: 4.239e-01]
windy_storm:  23%|##3       | 702/3000 [21:07<51:05,  1.33s/it, lr: 1.0e-04 loss: 4.239e-01]
windy_storm:  23%|##3       | 703/3000 [21:07<45:59,  1.20s/it, lr: 1.0e-04 loss: 4.239e-01]
windy_storm:  23%|##3       | 703/3000 [21:07<45:59,  1.20s/it, lr: 1.0e-04 loss: 4.239e-01]
windy_storm:  23%|##3       | 703/3000 [21:08<45:59,  1.20s/it, lr: 1.0e-04 loss: 4.996e-01]
windy_storm:  23%|##3       | 703/3000 [21:08<45:59,  1.20s/it, lr: 1.0e-04 loss: 4.996e-01]
windy_storm:  23%|##3       | 704/3000 [21:08<49:01,  1.28s/it, lr: 1.0e-04 loss: 4.996e-01]
windy_storm:  23%|##3       | 704/3000 [21:08<49:01,  1.28s/it, lr: 1.0e-04 loss: 4.996e-01]
windy_storm:  23%|##3       | 704/3000 [21:10<49:01,  1.28s/it, lr: 1.0e-04 loss: 5.713e-01]
windy_storm:  23%|##3       | 704/3000 [21:10<49:01,  1.28s/it, lr: 1.0e-04 loss: 5.713e-01]
windy_storm:  24%|##3       | 705/3000 [21:10<52:16,  1.37s/it, lr: 1.0e-04 loss: 5.713e-01]
windy_storm:  24%|##3       | 705/3000 [21:10<52:16,  1.37s/it, lr: 1.0e-04 loss: 5.713e-01]
windy_storm:  24%|##3       | 705/3000 [21:11<52:16,  1.37s/it, lr: 1.0e-04 loss: 2.437e-01]
windy_storm:  24%|##3       | 705/3000 [21:11<52:16,  1.37s/it, lr: 1.0e-04 loss: 2.437e-01]
windy_storm:  24%|##3       | 706/3000 [21:11<46:16,  1.21s/it, lr: 1.0e-04 loss: 2.437e-01]
windy_storm:  24%|##3       | 706/3000 [21:11<46:16,  1.21s/it, lr: 1.0e-04 loss: 2.437e-01]
windy_storm:  24%|##3       | 706/3000 [21:14<46:16,  1.21s/it, lr: 1.0e-04 loss: 6.129e-01]
windy_storm:  24%|##3       | 706/3000 [21:14<46:16,  1.21s/it, lr: 1.0e-04 loss: 6.129e-01]
windy_storm:  24%|##3       | 707/3000 [21:14<1:05:05,  1.70s/it, lr: 1.0e-04 loss: 6.129e-01]
windy_storm:  24%|##3       | 707/3000 [21:14<1:05:05,  1.70s/it, lr: 1.0e-04 loss: 6.129e-01]
windy_storm:  24%|##3       | 707/3000 [21:15<1:05:05,  1.70s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  24%|##3       | 707/3000 [21:15<1:05:05,  1.70s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  24%|##3       | 708/3000 [21:15<55:02,  1.44s/it, lr: 1.0e-04 loss: 2.476e-01]  
windy_storm:  24%|##3       | 708/3000 [21:15<55:02,  1.44s/it, lr: 1.0e-04 loss: 2.476e-01]  
windy_storm:  24%|##3       | 708/3000 [21:16<55:02,  1.44s/it, lr: 1.0e-04 loss: 2.003e-01]
windy_storm:  24%|##3       | 708/3000 [21:16<55:02,  1.44s/it, lr: 1.0e-04 loss: 2.003e-01]
windy_storm:  24%|##3       | 709/3000 [21:16<58:28,  1.53s/it, lr: 1.0e-04 loss: 2.003e-01]
windy_storm:  24%|##3       | 709/3000 [21:16<58:28,  1.53s/it, lr: 1.0e-04 loss: 2.003e-01]
windy_storm:  24%|##3       | 709/3000 [21:17<58:28,  1.53s/it, lr: 1.0e-04 loss: 1.174e-01]
windy_storm:  24%|##3       | 709/3000 [21:17<58:28,  1.53s/it, lr: 1.0e-04 loss: 1.174e-01]
windy_storm:  24%|##3       | 710/3000 [21:20<58:27,  1.53s/it, lr: 1.0e-04 loss: 2.801e-01]
windy_storm:  24%|##3       | 710/3000 [21:20<58:27,  1.53s/it, lr: 1.0e-04 loss: 2.801e-01]
windy_storm:  24%|##3       | 711/3000 [21:20<57:43,  1.51s/it, lr: 1.0e-04 loss: 2.801e-01]
windy_storm:  24%|##3       | 711/3000 [21:20<57:43,  1.51s/it, lr: 1.0e-04 loss: 2.801e-01]
windy_storm:  24%|##3       | 711/3000 [21:23<57:43,  1.51s/it, lr: 1.0e-04 loss: 2.848e-01]
windy_storm:  24%|##3       | 711/3000 [21:23<57:43,  1.51s/it, lr: 1.0e-04 loss: 2.848e-01]
windy_storm:  24%|##3       | 712/3000 [21:23<1:11:22,  1.87s/it, lr: 1.0e-04 loss: 2.848e-01]
windy_storm:  24%|##3       | 712/3000 [21:23<1:11:22,  1.87s/it, lr: 1.0e-04 loss: 2.848e-01]
windy_storm:  24%|##3       | 712/3000 [21:24<1:11:22,  1.87s/it, lr: 1.0e-04 loss: 3.000e-01]
windy_storm:  24%|##3       | 712/3000 [21:24<1:11:22,  1.87s/it, lr: 1.0e-04 loss: 3.000e-01]
windy_storm:  24%|##3       | 713/3000 [21:24<1:00:24,  1.58s/it, lr: 1.0e-04 loss: 3.000e-01]
windy_storm:  24%|##3       | 713/3000 [21:24<1:00:24,  1.58s/it, lr: 1.0e-04 loss: 3.000e-01]
windy_storm:  24%|##3       | 713/3000 [21:25<1:00:24,  1.58s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  24%|##3       | 713/3000 [21:25<1:00:24,  1.58s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  24%|##3       | 714/3000 [21:25<1:00:01,  1.58s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  24%|##3       | 714/3000 [21:25<1:00:01,  1.58s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  24%|##3       | 714/3000 [21:28<1:00:01,  1.58s/it, lr: 1.0e-04 loss: 5.597e-01]
windy_storm:  24%|##3       | 714/3000 [21:28<1:00:01,  1.58s/it, lr: 1.0e-04 loss: 5.597e-01]
windy_storm:  24%|##3       | 715/3000 [21:28<1:14:55,  1.97s/it, lr: 1.0e-04 loss: 5.597e-01]
windy_storm:  24%|##3       | 715/3000 [21:28<1:14:55,  1.97s/it, lr: 1.0e-04 loss: 5.597e-01]
windy_storm:  24%|##3       | 715/3000 [21:30<1:14:55,  1.97s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  24%|##3       | 715/3000 [21:30<1:14:55,  1.97s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  24%|##3       | 716/3000 [21:30<1:09:52,  1.84s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  24%|##3       | 716/3000 [21:30<1:09:52,  1.84s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  24%|##3       | 716/3000 [21:31<1:09:52,  1.84s/it, lr: 1.0e-04 loss: 7.118e-01]
windy_storm:  24%|##3       | 716/3000 [21:31<1:09:52,  1.84s/it, lr: 1.0e-04 loss: 7.118e-01]
windy_storm:  24%|##3       | 717/3000 [21:31<1:07:01,  1.76s/it, lr: 1.0e-04 loss: 7.118e-01]
windy_storm:  24%|##3       | 717/3000 [21:31<1:07:01,  1.76s/it, lr: 1.0e-04 loss: 7.118e-01]
windy_storm:  24%|##3       | 717/3000 [21:34<1:07:01,  1.76s/it, lr: 1.0e-04 loss: 6.763e-01]
windy_storm:  24%|##3       | 717/3000 [21:34<1:07:01,  1.76s/it, lr: 1.0e-04 loss: 6.763e-01]
windy_storm:  24%|##3       | 718/3000 [21:34<1:19:37,  2.09s/it, lr: 1.0e-04 loss: 6.763e-01]
windy_storm:  24%|##3       | 718/3000 [21:34<1:19:37,  2.09s/it, lr: 1.0e-04 loss: 6.763e-01]
windy_storm:  24%|##3       | 718/3000 [21:35<1:19:37,  2.09s/it, lr: 1.0e-04 loss: 6.278e-01]
windy_storm:  24%|##3       | 718/3000 [21:35<1:19:37,  2.09s/it, lr: 1.0e-04 loss: 6.278e-01]
windy_storm:  24%|##3       | 719/3000 [21:35<1:04:40,  1.70s/it, lr: 1.0e-04 loss: 6.278e-01]
windy_storm:  24%|##3       | 719/3000 [21:35<1:04:40,  1.70s/it, lr: 1.0e-04 loss: 6.278e-01]
windy_storm:  24%|##3       | 719/3000 [21:37<1:04:40,  1.70s/it, lr: 1.0e-04 loss: 2.990e-01]
windy_storm:  24%|##3       | 719/3000 [21:37<1:04:40,  1.70s/it, lr: 1.0e-04 loss: 2.990e-01]
windy_storm:  24%|##4       | 720/3000 [21:38<1:04:39,  1.70s/it, lr: 1.0e-04 loss: 6.224e-01]
windy_storm:  24%|##4       | 720/3000 [21:38<1:04:39,  1.70s/it, lr: 1.0e-04 loss: 6.224e-01]
windy_storm:  24%|##4       | 721/3000 [21:38<41:41,  1.10s/it, lr: 1.0e-04 loss: 6.224e-01]  
windy_storm:  24%|##4       | 721/3000 [21:38<41:41,  1.10s/it, lr: 1.0e-04 loss: 6.224e-01]  
windy_storm:  24%|##4       | 721/3000 [21:41<41:41,  1.10s/it, lr: 1.0e-04 loss: 4.908e-01]
windy_storm:  24%|##4       | 721/3000 [21:41<41:41,  1.10s/it, lr: 1.0e-04 loss: 4.908e-01]
windy_storm:  24%|##4       | 722/3000 [21:41<1:01:30,  1.62s/it, lr: 1.0e-04 loss: 4.908e-01]
windy_storm:  24%|##4       | 722/3000 [21:41<1:01:30,  1.62s/it, lr: 1.0e-04 loss: 4.908e-01]
windy_storm:  24%|##4       | 722/3000 [21:43<1:01:30,  1.62s/it, lr: 1.0e-04 loss: 3.142e-01]
windy_storm:  24%|##4       | 722/3000 [21:43<1:01:30,  1.62s/it, lr: 1.0e-04 loss: 3.142e-01]
windy_storm:  24%|##4       | 723/3000 [21:43<1:00:44,  1.60s/it, lr: 1.0e-04 loss: 3.142e-01]
windy_storm:  24%|##4       | 723/3000 [21:43<1:00:44,  1.60s/it, lr: 1.0e-04 loss: 3.142e-01]
windy_storm:  24%|##4       | 723/3000 [21:43<1:00:44,  1.60s/it, lr: 1.0e-04 loss: 1.218e-01]
windy_storm:  24%|##4       | 723/3000 [21:43<1:00:44,  1.60s/it, lr: 1.0e-04 loss: 1.218e-01]
windy_storm:  24%|##4       | 724/3000 [21:43<52:42,  1.39s/it, lr: 1.0e-04 loss: 1.218e-01]  
windy_storm:  24%|##4       | 724/3000 [21:43<52:42,  1.39s/it, lr: 1.0e-04 loss: 1.218e-01]  
windy_storm:  24%|##4       | 724/3000 [21:44<52:42,  1.39s/it, lr: 1.0e-04 loss: 3.184e-01]
windy_storm:  24%|##4       | 724/3000 [21:44<52:42,  1.39s/it, lr: 1.0e-04 loss: 3.184e-01]
windy_storm:  24%|##4       | 725/3000 [21:44<45:50,  1.21s/it, lr: 1.0e-04 loss: 3.184e-01]
windy_storm:  24%|##4       | 725/3000 [21:44<45:50,  1.21s/it, lr: 1.0e-04 loss: 3.184e-01]
windy_storm:  24%|##4       | 725/3000 [21:45<45:50,  1.21s/it, lr: 1.0e-04 loss: 7.245e-01]
windy_storm:  24%|##4       | 725/3000 [21:45<45:50,  1.21s/it, lr: 1.0e-04 loss: 7.245e-01]
windy_storm:  24%|##4       | 726/3000 [21:45<41:00,  1.08s/it, lr: 1.0e-04 loss: 7.245e-01]
windy_storm:  24%|##4       | 726/3000 [21:45<41:00,  1.08s/it, lr: 1.0e-04 loss: 7.245e-01]
windy_storm:  24%|##4       | 726/3000 [21:46<41:00,  1.08s/it, lr: 1.0e-04 loss: 4.582e-01]
windy_storm:  24%|##4       | 726/3000 [21:46<41:00,  1.08s/it, lr: 1.0e-04 loss: 4.582e-01]
windy_storm:  24%|##4       | 727/3000 [21:46<38:01,  1.00s/it, lr: 1.0e-04 loss: 4.582e-01]
windy_storm:  24%|##4       | 727/3000 [21:46<38:01,  1.00s/it, lr: 1.0e-04 loss: 4.582e-01]
windy_storm:  24%|##4       | 727/3000 [21:47<38:01,  1.00s/it, lr: 1.0e-04 loss: 4.549e-01]
windy_storm:  24%|##4       | 727/3000 [21:47<38:01,  1.00s/it, lr: 1.0e-04 loss: 4.549e-01]
windy_storm:  24%|##4       | 728/3000 [21:47<43:58,  1.16s/it, lr: 1.0e-04 loss: 4.549e-01]
windy_storm:  24%|##4       | 728/3000 [21:47<43:58,  1.16s/it, lr: 1.0e-04 loss: 4.549e-01]
windy_storm:  24%|##4       | 728/3000 [21:49<43:58,  1.16s/it, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  24%|##4       | 728/3000 [21:49<43:58,  1.16s/it, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  24%|##4       | 729/3000 [21:49<47:56,  1.27s/it, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  24%|##4       | 729/3000 [21:49<47:56,  1.27s/it, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  24%|##4       | 729/3000 [21:52<47:56,  1.27s/it, lr: 1.0e-04 loss: 6.059e-01]
windy_storm:  24%|##4       | 729/3000 [21:52<47:56,  1.27s/it, lr: 1.0e-04 loss: 6.059e-01]
windy_storm:  24%|##4       | 730/3000 [21:53<47:55,  1.27s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  24%|##4       | 730/3000 [21:53<47:55,  1.27s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  24%|##4       | 731/3000 [21:53<39:37,  1.05s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  24%|##4       | 731/3000 [21:53<39:37,  1.05s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  24%|##4       | 731/3000 [21:54<39:37,  1.05s/it, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  24%|##4       | 731/3000 [21:54<39:37,  1.05s/it, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  24%|##4       | 732/3000 [21:54<36:39,  1.03it/s, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  24%|##4       | 732/3000 [21:54<36:39,  1.03it/s, lr: 1.0e-04 loss: 6.279e-01]
windy_storm:  24%|##4       | 732/3000 [21:55<36:39,  1.03it/s, lr: 1.0e-04 loss: 1.568e-01]
windy_storm:  24%|##4       | 732/3000 [21:55<36:39,  1.03it/s, lr: 1.0e-04 loss: 1.568e-01]
windy_storm:  24%|##4       | 733/3000 [21:55<35:12,  1.07it/s, lr: 1.0e-04 loss: 1.568e-01]
windy_storm:  24%|##4       | 733/3000 [21:55<35:12,  1.07it/s, lr: 1.0e-04 loss: 1.568e-01]
windy_storm:  24%|##4       | 733/3000 [21:56<35:12,  1.07it/s, lr: 1.0e-04 loss: 3.533e-01]
windy_storm:  24%|##4       | 733/3000 [21:56<35:12,  1.07it/s, lr: 1.0e-04 loss: 3.533e-01]
windy_storm:  24%|##4       | 734/3000 [21:56<41:42,  1.10s/it, lr: 1.0e-04 loss: 3.533e-01]
windy_storm:  24%|##4       | 734/3000 [21:56<41:42,  1.10s/it, lr: 1.0e-04 loss: 3.533e-01]
windy_storm:  24%|##4       | 734/3000 [21:59<41:42,  1.10s/it, lr: 1.0e-04 loss: 1.433e-01]
windy_storm:  24%|##4       | 734/3000 [21:59<41:42,  1.10s/it, lr: 1.0e-04 loss: 1.433e-01]
windy_storm:  24%|##4       | 735/3000 [21:59<1:01:24,  1.63s/it, lr: 1.0e-04 loss: 1.433e-01]
windy_storm:  24%|##4       | 735/3000 [21:59<1:01:24,  1.63s/it, lr: 1.0e-04 loss: 1.433e-01]
windy_storm:  24%|##4       | 735/3000 [22:02<1:01:24,  1.63s/it, lr: 1.0e-04 loss: 1.912e-01]
windy_storm:  24%|##4       | 735/3000 [22:02<1:01:24,  1.63s/it, lr: 1.0e-04 loss: 1.912e-01]
windy_storm:  25%|##4       | 736/3000 [22:02<1:17:06,  2.04s/it, lr: 1.0e-04 loss: 1.912e-01]
windy_storm:  25%|##4       | 736/3000 [22:02<1:17:06,  2.04s/it, lr: 1.0e-04 loss: 1.912e-01]
windy_storm:  25%|##4       | 736/3000 [22:04<1:17:06,  2.04s/it, lr: 1.0e-04 loss: 5.818e-01]
windy_storm:  25%|##4       | 736/3000 [22:04<1:17:06,  2.04s/it, lr: 1.0e-04 loss: 5.818e-01]
windy_storm:  25%|##4       | 737/3000 [22:04<1:11:53,  1.91s/it, lr: 1.0e-04 loss: 5.818e-01]
windy_storm:  25%|##4       | 737/3000 [22:04<1:11:53,  1.91s/it, lr: 1.0e-04 loss: 5.818e-01]
windy_storm:  25%|##4       | 737/3000 [22:07<1:11:53,  1.91s/it, lr: 1.0e-04 loss: 5.660e-01]
windy_storm:  25%|##4       | 737/3000 [22:07<1:11:53,  1.91s/it, lr: 1.0e-04 loss: 5.660e-01]
windy_storm:  25%|##4       | 738/3000 [22:07<1:23:41,  2.22s/it, lr: 1.0e-04 loss: 5.660e-01]
windy_storm:  25%|##4       | 738/3000 [22:07<1:23:41,  2.22s/it, lr: 1.0e-04 loss: 5.660e-01]
windy_storm:  25%|##4       | 738/3000 [22:10<1:23:41,  2.22s/it, lr: 1.0e-04 loss: 2.564e-01]
windy_storm:  25%|##4       | 738/3000 [22:10<1:23:41,  2.22s/it, lr: 1.0e-04 loss: 2.564e-01]
windy_storm:  25%|##4       | 739/3000 [22:10<1:31:13,  2.42s/it, lr: 1.0e-04 loss: 2.564e-01]
windy_storm:  25%|##4       | 739/3000 [22:10<1:31:13,  2.42s/it, lr: 1.0e-04 loss: 2.564e-01]
windy_storm:  25%|##4       | 739/3000 [22:13<1:31:13,  2.42s/it, lr: 1.0e-04 loss: 4.270e-01]
windy_storm:  25%|##4       | 739/3000 [22:13<1:31:13,  2.42s/it, lr: 1.0e-04 loss: 4.270e-01]
windy_storm:  25%|##4       | 740/3000 [22:16<1:31:11,  2.42s/it, lr: 1.0e-04 loss: 1.441e-01]
windy_storm:  25%|##4       | 740/3000 [22:16<1:31:11,  2.42s/it, lr: 1.0e-04 loss: 1.441e-01]
windy_storm:  25%|##4       | 741/3000 [22:16<1:15:08,  2.00s/it, lr: 1.0e-04 loss: 1.441e-01]
windy_storm:  25%|##4       | 741/3000 [22:16<1:15:08,  2.00s/it, lr: 1.0e-04 loss: 1.441e-01]
windy_storm:  25%|##4       | 741/3000 [22:17<1:15:08,  2.00s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  25%|##4       | 741/3000 [22:17<1:15:08,  2.00s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  25%|##4       | 742/3000 [22:17<1:03:36,  1.69s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  25%|##4       | 742/3000 [22:17<1:03:36,  1.69s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  25%|##4       | 742/3000 [22:17<1:03:36,  1.69s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:  25%|##4       | 742/3000 [22:17<1:03:36,  1.69s/it, lr: 1.0e-04 loss: 2.345e-01]
windy_storm:  25%|##4       | 743/3000 [22:17<54:35,  1.45s/it, lr: 1.0e-04 loss: 2.345e-01]  
windy_storm:  25%|##4       | 743/3000 [22:17<54:35,  1.45s/it, lr: 1.0e-04 loss: 2.345e-01]  
windy_storm:  25%|##4       | 743/3000 [22:20<54:35,  1.45s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:  25%|##4       | 743/3000 [22:20<54:35,  1.45s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:  25%|##4       | 744/3000 [22:20<1:10:16,  1.87s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:  25%|##4       | 744/3000 [22:20<1:10:16,  1.87s/it, lr: 1.0e-04 loss: 5.481e-01]
windy_storm:  25%|##4       | 744/3000 [22:22<1:10:16,  1.87s/it, lr: 1.0e-04 loss: 9.333e-02]
windy_storm:  25%|##4       | 744/3000 [22:22<1:10:16,  1.87s/it, lr: 1.0e-04 loss: 9.333e-02]
windy_storm:  25%|##4       | 745/3000 [22:22<1:06:51,  1.78s/it, lr: 1.0e-04 loss: 9.333e-02]
windy_storm:  25%|##4       | 745/3000 [22:22<1:06:51,  1.78s/it, lr: 1.0e-04 loss: 9.333e-02]
windy_storm:  25%|##4       | 745/3000 [22:25<1:06:51,  1.78s/it, lr: 1.0e-04 loss: 5.216e-01]
windy_storm:  25%|##4       | 745/3000 [22:25<1:06:51,  1.78s/it, lr: 1.0e-04 loss: 5.216e-01]
windy_storm:  25%|##4       | 746/3000 [22:25<1:19:07,  2.11s/it, lr: 1.0e-04 loss: 5.216e-01]
windy_storm:  25%|##4       | 746/3000 [22:25<1:19:07,  2.11s/it, lr: 1.0e-04 loss: 5.216e-01]
windy_storm:  25%|##4       | 746/3000 [22:26<1:19:07,  2.11s/it, lr: 1.0e-04 loss: 6.165e-01]
windy_storm:  25%|##4       | 746/3000 [22:26<1:19:07,  2.11s/it, lr: 1.0e-04 loss: 6.165e-01]
windy_storm:  25%|##4       | 747/3000 [22:26<1:04:33,  1.72s/it, lr: 1.0e-04 loss: 6.165e-01]
windy_storm:  25%|##4       | 747/3000 [22:26<1:04:33,  1.72s/it, lr: 1.0e-04 loss: 6.165e-01]
windy_storm:  25%|##4       | 747/3000 [22:29<1:04:33,  1.72s/it, lr: 1.0e-04 loss: 4.416e-01]
windy_storm:  25%|##4       | 747/3000 [22:29<1:04:33,  1.72s/it, lr: 1.0e-04 loss: 4.416e-01]
windy_storm:  25%|##4       | 748/3000 [22:29<1:18:30,  2.09s/it, lr: 1.0e-04 loss: 4.416e-01]
windy_storm:  25%|##4       | 748/3000 [22:29<1:18:30,  2.09s/it, lr: 1.0e-04 loss: 4.416e-01]
windy_storm:  25%|##4       | 748/3000 [22:29<1:18:30,  2.09s/it, lr: 1.0e-04 loss: 2.364e-01]
windy_storm:  25%|##4       | 748/3000 [22:29<1:18:30,  2.09s/it, lr: 1.0e-04 loss: 2.364e-01]
windy_storm:  25%|##4       | 749/3000 [22:29<1:04:26,  1.72s/it, lr: 1.0e-04 loss: 2.364e-01]
windy_storm:  25%|##4       | 749/3000 [22:29<1:04:26,  1.72s/it, lr: 1.0e-04 loss: 2.364e-01]
windy_storm:  25%|##4       | 749/3000 [22:30<1:04:26,  1.72s/it, lr: 1.0e-04 loss: 4.026e-01]
windy_storm:  25%|##4       | 749/3000 [22:30<1:04:26,  1.72s/it, lr: 1.0e-04 loss: 4.026e-01]
Saving at step 750
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000000750.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt

windy_storm:  25%|##5       | 750/3000 [22:31<1:04:24,  1.72s/it, lr: 1.0e-04 loss: 4.171e-01]
windy_storm:  25%|##5       | 750/3000 [22:31<1:04:24,  1.72s/it, lr: 1.0e-04 loss: 4.171e-01]
windy_storm:  25%|##5       | 751/3000 [22:31<43:54,  1.17s/it, lr: 1.0e-04 loss: 4.171e-01]  
windy_storm:  25%|##5       | 751/3000 [22:31<43:54,  1.17s/it, lr: 1.0e-04 loss: 4.171e-01]  
windy_storm:  25%|##5       | 751/3000 [22:33<43:54,  1.17s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  25%|##5       | 751/3000 [22:33<43:54,  1.17s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  25%|##5       | 752/3000 [22:33<47:47,  1.28s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  25%|##5       | 752/3000 [22:33<47:47,  1.28s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  25%|##5       | 752/3000 [22:34<47:47,  1.28s/it, lr: 1.0e-04 loss: 3.929e-01]
windy_storm:  25%|##5       | 752/3000 [22:34<47:47,  1.28s/it, lr: 1.0e-04 loss: 3.929e-01]
windy_storm:  25%|##5       | 753/3000 [22:34<42:35,  1.14s/it, lr: 1.0e-04 loss: 3.929e-01]
windy_storm:  25%|##5       | 753/3000 [22:34<42:35,  1.14s/it, lr: 1.0e-04 loss: 3.929e-01]
windy_storm:  25%|##5       | 753/3000 [22:37<42:35,  1.14s/it, lr: 1.0e-04 loss: 1.664e-02]
windy_storm:  25%|##5       | 753/3000 [22:37<42:35,  1.14s/it, lr: 1.0e-04 loss: 1.664e-02]
windy_storm:  25%|##5       | 754/3000 [22:37<1:00:21,  1.61s/it, lr: 1.0e-04 loss: 1.664e-02]
windy_storm:  25%|##5       | 754/3000 [22:37<1:00:21,  1.61s/it, lr: 1.0e-04 loss: 1.664e-02]
windy_storm:  25%|##5       | 754/3000 [22:40<1:00:21,  1.61s/it, lr: 1.0e-04 loss: 5.242e-01]
windy_storm:  25%|##5       | 754/3000 [22:40<1:00:21,  1.61s/it, lr: 1.0e-04 loss: 5.242e-01]
windy_storm:  25%|##5       | 755/3000 [22:40<1:14:08,  1.98s/it, lr: 1.0e-04 loss: 5.242e-01]
windy_storm:  25%|##5       | 755/3000 [22:40<1:14:08,  1.98s/it, lr: 1.0e-04 loss: 5.242e-01]
windy_storm:  25%|##5       | 755/3000 [22:40<1:14:08,  1.98s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  25%|##5       | 755/3000 [22:40<1:14:08,  1.98s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  25%|##5       | 756/3000 [22:40<1:01:00,  1.63s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  25%|##5       | 756/3000 [22:40<1:01:00,  1.63s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  25%|##5       | 756/3000 [22:41<1:01:00,  1.63s/it, lr: 1.0e-04 loss: 4.548e-02]
windy_storm:  25%|##5       | 756/3000 [22:41<1:01:00,  1.63s/it, lr: 1.0e-04 loss: 4.548e-02]
windy_storm:  25%|##5       | 757/3000 [22:41<52:10,  1.40s/it, lr: 1.0e-04 loss: 4.548e-02]  
windy_storm:  25%|##5       | 757/3000 [22:41<52:10,  1.40s/it, lr: 1.0e-04 loss: 4.548e-02]  
windy_storm:  25%|##5       | 757/3000 [22:44<52:10,  1.40s/it, lr: 1.0e-04 loss: 6.990e-01]
windy_storm:  25%|##5       | 757/3000 [22:44<52:10,  1.40s/it, lr: 1.0e-04 loss: 6.990e-01]
windy_storm:  25%|##5       | 758/3000 [22:44<1:09:34,  1.86s/it, lr: 1.0e-04 loss: 6.990e-01]
windy_storm:  25%|##5       | 758/3000 [22:44<1:09:34,  1.86s/it, lr: 1.0e-04 loss: 6.990e-01]
windy_storm:  25%|##5       | 758/3000 [22:46<1:09:34,  1.86s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  25%|##5       | 758/3000 [22:46<1:09:34,  1.86s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  25%|##5       | 759/3000 [22:46<1:06:22,  1.78s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  25%|##5       | 759/3000 [22:46<1:06:22,  1.78s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  25%|##5       | 759/3000 [22:47<1:06:22,  1.78s/it, lr: 1.0e-04 loss: 3.268e-01]
windy_storm:  25%|##5       | 759/3000 [22:47<1:06:22,  1.78s/it, lr: 1.0e-04 loss: 3.268e-01]
windy_storm:  25%|##5       | 760/3000 [22:49<1:06:20,  1.78s/it, lr: 1.0e-04 loss: 6.392e-01]
windy_storm:  25%|##5       | 760/3000 [22:49<1:06:20,  1.78s/it, lr: 1.0e-04 loss: 6.392e-01]
windy_storm:  25%|##5       | 761/3000 [22:49<49:19,  1.32s/it, lr: 1.0e-04 loss: 6.392e-01]  
windy_storm:  25%|##5       | 761/3000 [22:49<49:19,  1.32s/it, lr: 1.0e-04 loss: 6.392e-01]  
windy_storm:  25%|##5       | 761/3000 [22:50<49:19,  1.32s/it, lr: 1.0e-04 loss: 1.642e-01]
windy_storm:  25%|##5       | 761/3000 [22:50<49:19,  1.32s/it, lr: 1.0e-04 loss: 1.642e-01]
windy_storm:  25%|##5       | 762/3000 [22:50<44:11,  1.18s/it, lr: 1.0e-04 loss: 1.642e-01]
windy_storm:  25%|##5       | 762/3000 [22:50<44:11,  1.18s/it, lr: 1.0e-04 loss: 1.642e-01]
windy_storm:  25%|##5       | 762/3000 [22:51<44:11,  1.18s/it, lr: 1.0e-04 loss: 1.346e-01]
windy_storm:  25%|##5       | 762/3000 [22:51<44:11,  1.18s/it, lr: 1.0e-04 loss: 1.346e-01]
windy_storm:  25%|##5       | 763/3000 [22:51<49:32,  1.33s/it, lr: 1.0e-04 loss: 1.346e-01]
windy_storm:  25%|##5       | 763/3000 [22:51<49:32,  1.33s/it, lr: 1.0e-04 loss: 1.346e-01]
windy_storm:  25%|##5       | 763/3000 [22:53<49:32,  1.33s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  25%|##5       | 763/3000 [22:53<49:32,  1.33s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  25%|##5       | 764/3000 [22:53<51:57,  1.39s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  25%|##5       | 764/3000 [22:53<51:57,  1.39s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  25%|##5       | 764/3000 [22:56<51:57,  1.39s/it, lr: 1.0e-04 loss: 4.448e-01]
windy_storm:  25%|##5       | 764/3000 [22:56<51:57,  1.39s/it, lr: 1.0e-04 loss: 4.448e-01]
windy_storm:  26%|##5       | 765/3000 [22:56<1:09:24,  1.86s/it, lr: 1.0e-04 loss: 4.448e-01]
windy_storm:  26%|##5       | 765/3000 [22:56<1:09:24,  1.86s/it, lr: 1.0e-04 loss: 4.448e-01]
windy_storm:  26%|##5       | 765/3000 [22:58<1:09:24,  1.86s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  26%|##5       | 765/3000 [22:58<1:09:24,  1.86s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  26%|##5       | 766/3000 [22:58<1:06:17,  1.78s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  26%|##5       | 766/3000 [22:58<1:06:17,  1.78s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  26%|##5       | 766/3000 [22:59<1:06:17,  1.78s/it, lr: 1.0e-04 loss: 4.997e-01]
windy_storm:  26%|##5       | 766/3000 [22:59<1:06:17,  1.78s/it, lr: 1.0e-04 loss: 4.997e-01]
windy_storm:  26%|##5       | 767/3000 [22:59<1:04:17,  1.73s/it, lr: 1.0e-04 loss: 4.997e-01]
windy_storm:  26%|##5       | 767/3000 [22:59<1:04:17,  1.73s/it, lr: 1.0e-04 loss: 4.997e-01]
windy_storm:  26%|##5       | 767/3000 [23:00<1:04:17,  1.73s/it, lr: 1.0e-04 loss: 6.420e-01]
windy_storm:  26%|##5       | 767/3000 [23:00<1:04:17,  1.73s/it, lr: 1.0e-04 loss: 6.420e-01]
windy_storm:  26%|##5       | 768/3000 [23:00<53:27,  1.44s/it, lr: 1.0e-04 loss: 6.420e-01]  
windy_storm:  26%|##5       | 768/3000 [23:00<53:27,  1.44s/it, lr: 1.0e-04 loss: 6.420e-01]  
windy_storm:  26%|##5       | 768/3000 [23:02<53:27,  1.44s/it, lr: 1.0e-04 loss: 6.894e-01]
windy_storm:  26%|##5       | 768/3000 [23:02<53:27,  1.44s/it, lr: 1.0e-04 loss: 6.894e-01]
windy_storm:  26%|##5       | 769/3000 [23:02<54:13,  1.46s/it, lr: 1.0e-04 loss: 6.894e-01]
windy_storm:  26%|##5       | 769/3000 [23:02<54:13,  1.46s/it, lr: 1.0e-04 loss: 6.894e-01]
windy_storm:  26%|##5       | 769/3000 [23:04<54:13,  1.46s/it, lr: 1.0e-04 loss: 6.342e-01]
windy_storm:  26%|##5       | 769/3000 [23:04<54:13,  1.46s/it, lr: 1.0e-04 loss: 6.342e-01]
windy_storm:  26%|##5       | 770/3000 [23:07<54:11,  1.46s/it, lr: 1.0e-04 loss: 1.027e-01]
windy_storm:  26%|##5       | 770/3000 [23:07<54:11,  1.46s/it, lr: 1.0e-04 loss: 1.027e-01]
windy_storm:  26%|##5       | 771/3000 [23:07<54:54,  1.48s/it, lr: 1.0e-04 loss: 1.027e-01]
windy_storm:  26%|##5       | 771/3000 [23:07<54:54,  1.48s/it, lr: 1.0e-04 loss: 1.027e-01]
windy_storm:  26%|##5       | 771/3000 [23:10<54:54,  1.48s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  26%|##5       | 771/3000 [23:10<54:54,  1.48s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  26%|##5       | 772/3000 [23:10<1:08:07,  1.83s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  26%|##5       | 772/3000 [23:10<1:08:07,  1.83s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  26%|##5       | 772/3000 [23:11<1:08:07,  1.83s/it, lr: 1.0e-04 loss: 1.451e-01]
windy_storm:  26%|##5       | 772/3000 [23:11<1:08:07,  1.83s/it, lr: 1.0e-04 loss: 1.451e-01]
windy_storm:  26%|##5       | 773/3000 [23:11<58:17,  1.57s/it, lr: 1.0e-04 loss: 1.451e-01]  
windy_storm:  26%|##5       | 773/3000 [23:11<58:17,  1.57s/it, lr: 1.0e-04 loss: 1.451e-01]  
windy_storm:  26%|##5       | 773/3000 [23:12<58:17,  1.57s/it, lr: 1.0e-04 loss: 1.613e-01]
windy_storm:  26%|##5       | 773/3000 [23:12<58:17,  1.57s/it, lr: 1.0e-04 loss: 1.613e-01]
windy_storm:  26%|##5       | 774/3000 [23:12<50:06,  1.35s/it, lr: 1.0e-04 loss: 1.613e-01]
windy_storm:  26%|##5       | 774/3000 [23:12<50:06,  1.35s/it, lr: 1.0e-04 loss: 1.613e-01]
windy_storm:  26%|##5       | 774/3000 [23:15<50:06,  1.35s/it, lr: 1.0e-04 loss: 6.976e-01]
windy_storm:  26%|##5       | 774/3000 [23:15<50:06,  1.35s/it, lr: 1.0e-04 loss: 6.976e-01]
windy_storm:  26%|##5       | 775/3000 [23:15<1:07:17,  1.81s/it, lr: 1.0e-04 loss: 6.976e-01]
windy_storm:  26%|##5       | 775/3000 [23:15<1:07:17,  1.81s/it, lr: 1.0e-04 loss: 6.976e-01]
windy_storm:  26%|##5       | 775/3000 [23:16<1:07:17,  1.81s/it, lr: 1.0e-04 loss: 3.998e-01]
windy_storm:  26%|##5       | 775/3000 [23:16<1:07:17,  1.81s/it, lr: 1.0e-04 loss: 3.998e-01]
windy_storm:  26%|##5       | 776/3000 [23:16<56:47,  1.53s/it, lr: 1.0e-04 loss: 3.998e-01]  
windy_storm:  26%|##5       | 776/3000 [23:16<56:47,  1.53s/it, lr: 1.0e-04 loss: 3.998e-01]  
windy_storm:  26%|##5       | 776/3000 [23:17<56:47,  1.53s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  26%|##5       | 776/3000 [23:17<56:47,  1.53s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  26%|##5       | 777/3000 [23:17<51:32,  1.39s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  26%|##5       | 777/3000 [23:17<51:32,  1.39s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  26%|##5       | 777/3000 [23:18<51:32,  1.39s/it, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  26%|##5       | 777/3000 [23:18<51:32,  1.39s/it, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  26%|##5       | 778/3000 [23:18<45:27,  1.23s/it, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  26%|##5       | 778/3000 [23:18<45:27,  1.23s/it, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  26%|##5       | 778/3000 [23:18<45:27,  1.23s/it, lr: 1.0e-04 loss: 6.302e-02]
windy_storm:  26%|##5       | 778/3000 [23:18<45:27,  1.23s/it, lr: 1.0e-04 loss: 6.302e-02]
windy_storm:  26%|##5       | 779/3000 [23:18<41:05,  1.11s/it, lr: 1.0e-04 loss: 6.302e-02]
windy_storm:  26%|##5       | 779/3000 [23:18<41:05,  1.11s/it, lr: 1.0e-04 loss: 6.302e-02]
windy_storm:  26%|##5       | 779/3000 [23:21<41:05,  1.11s/it, lr: 1.0e-04 loss: 5.522e-01]
windy_storm:  26%|##5       | 779/3000 [23:21<41:05,  1.11s/it, lr: 1.0e-04 loss: 5.522e-01]
windy_storm:  26%|##6       | 780/3000 [23:23<41:03,  1.11s/it, lr: 1.0e-04 loss: 2.284e-01]
windy_storm:  26%|##6       | 780/3000 [23:23<41:03,  1.11s/it, lr: 1.0e-04 loss: 2.284e-01]
windy_storm:  26%|##6       | 781/3000 [23:23<35:42,  1.04it/s, lr: 1.0e-04 loss: 2.284e-01]
windy_storm:  26%|##6       | 781/3000 [23:23<35:42,  1.04it/s, lr: 1.0e-04 loss: 2.284e-01]
windy_storm:  26%|##6       | 781/3000 [23:24<35:42,  1.04it/s, lr: 1.0e-04 loss: 3.385e-01]
windy_storm:  26%|##6       | 781/3000 [23:24<35:42,  1.04it/s, lr: 1.0e-04 loss: 3.385e-01]
windy_storm:  26%|##6       | 782/3000 [23:24<33:54,  1.09it/s, lr: 1.0e-04 loss: 3.385e-01]
windy_storm:  26%|##6       | 782/3000 [23:24<33:54,  1.09it/s, lr: 1.0e-04 loss: 3.385e-01]
windy_storm:  26%|##6       | 782/3000 [23:25<33:54,  1.09it/s, lr: 1.0e-04 loss: 5.061e-01]
windy_storm:  26%|##6       | 782/3000 [23:25<33:54,  1.09it/s, lr: 1.0e-04 loss: 5.061e-01]
windy_storm:  26%|##6       | 783/3000 [23:25<33:05,  1.12it/s, lr: 1.0e-04 loss: 5.061e-01]
windy_storm:  26%|##6       | 783/3000 [23:25<33:05,  1.12it/s, lr: 1.0e-04 loss: 5.061e-01]
windy_storm:  26%|##6       | 783/3000 [23:28<33:05,  1.12it/s, lr: 1.0e-04 loss: 5.662e-02]
windy_storm:  26%|##6       | 783/3000 [23:28<33:05,  1.12it/s, lr: 1.0e-04 loss: 5.662e-02]
windy_storm:  26%|##6       | 784/3000 [23:28<53:43,  1.45s/it, lr: 1.0e-04 loss: 5.662e-02]
windy_storm:  26%|##6       | 784/3000 [23:28<53:43,  1.45s/it, lr: 1.0e-04 loss: 5.662e-02]
windy_storm:  26%|##6       | 784/3000 [23:29<53:43,  1.45s/it, lr: 1.0e-04 loss: 4.525e-01]
windy_storm:  26%|##6       | 784/3000 [23:29<53:43,  1.45s/it, lr: 1.0e-04 loss: 4.525e-01]
windy_storm:  26%|##6       | 785/3000 [23:29<55:12,  1.50s/it, lr: 1.0e-04 loss: 4.525e-01]
windy_storm:  26%|##6       | 785/3000 [23:29<55:12,  1.50s/it, lr: 1.0e-04 loss: 4.525e-01]
windy_storm:  26%|##6       | 785/3000 [23:31<55:12,  1.50s/it, lr: 1.0e-04 loss: 2.484e-01]
windy_storm:  26%|##6       | 785/3000 [23:31<55:12,  1.50s/it, lr: 1.0e-04 loss: 2.484e-01]
windy_storm:  26%|##6       | 786/3000 [23:31<55:53,  1.51s/it, lr: 1.0e-04 loss: 2.484e-01]
windy_storm:  26%|##6       | 786/3000 [23:31<55:53,  1.51s/it, lr: 1.0e-04 loss: 2.484e-01]
windy_storm:  26%|##6       | 786/3000 [23:32<55:53,  1.51s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  26%|##6       | 786/3000 [23:32<55:53,  1.51s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  26%|##6       | 787/3000 [23:32<56:37,  1.54s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  26%|##6       | 787/3000 [23:32<56:37,  1.54s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  26%|##6       | 787/3000 [23:35<56:37,  1.54s/it, lr: 1.0e-04 loss: 2.561e-02]
windy_storm:  26%|##6       | 787/3000 [23:35<56:37,  1.54s/it, lr: 1.0e-04 loss: 2.561e-02]
windy_storm:  26%|##6       | 788/3000 [23:35<1:12:42,  1.97s/it, lr: 1.0e-04 loss: 2.561e-02]
windy_storm:  26%|##6       | 788/3000 [23:35<1:12:42,  1.97s/it, lr: 1.0e-04 loss: 2.561e-02]
windy_storm:  26%|##6       | 788/3000 [23:37<1:12:42,  1.97s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:  26%|##6       | 788/3000 [23:37<1:12:42,  1.97s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:  26%|##6       | 789/3000 [23:37<1:08:44,  1.87s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:  26%|##6       | 789/3000 [23:37<1:08:44,  1.87s/it, lr: 1.0e-04 loss: 2.286e-01]
windy_storm:  26%|##6       | 789/3000 [23:38<1:08:44,  1.87s/it, lr: 1.0e-04 loss: 3.049e-01]
windy_storm:  26%|##6       | 789/3000 [23:38<1:08:44,  1.87s/it, lr: 1.0e-04 loss: 3.049e-01]
windy_storm:  26%|##6       | 790/3000 [23:41<1:08:42,  1.87s/it, lr: 1.0e-04 loss: 4.806e-02]
windy_storm:  26%|##6       | 790/3000 [23:41<1:08:42,  1.87s/it, lr: 1.0e-04 loss: 4.806e-02]
windy_storm:  26%|##6       | 791/3000 [23:41<1:02:52,  1.71s/it, lr: 1.0e-04 loss: 4.806e-02]
windy_storm:  26%|##6       | 791/3000 [23:41<1:02:52,  1.71s/it, lr: 1.0e-04 loss: 4.806e-02]
windy_storm:  26%|##6       | 791/3000 [23:44<1:02:52,  1.71s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  26%|##6       | 791/3000 [23:44<1:02:52,  1.71s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  26%|##6       | 792/3000 [23:44<1:14:46,  2.03s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  26%|##6       | 792/3000 [23:44<1:14:46,  2.03s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  26%|##6       | 792/3000 [23:47<1:14:46,  2.03s/it, lr: 1.0e-04 loss: 5.976e-01]
windy_storm:  26%|##6       | 792/3000 [23:47<1:14:46,  2.03s/it, lr: 1.0e-04 loss: 5.976e-01]
windy_storm:  26%|##6       | 793/3000 [23:47<1:23:45,  2.28s/it, lr: 1.0e-04 loss: 5.976e-01]
windy_storm:  26%|##6       | 793/3000 [23:47<1:23:45,  2.28s/it, lr: 1.0e-04 loss: 5.976e-01]
windy_storm:  26%|##6       | 793/3000 [23:48<1:23:45,  2.28s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  26%|##6       | 793/3000 [23:48<1:23:45,  2.28s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  26%|##6       | 794/3000 [23:48<1:16:32,  2.08s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  26%|##6       | 794/3000 [23:48<1:16:32,  2.08s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  26%|##6       | 794/3000 [23:49<1:16:32,  2.08s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  26%|##6       | 794/3000 [23:49<1:16:32,  2.08s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  26%|##6       | 795/3000 [23:49<1:03:10,  1.72s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  26%|##6       | 795/3000 [23:49<1:03:10,  1.72s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  26%|##6       | 795/3000 [23:51<1:03:10,  1.72s/it, lr: 1.0e-04 loss: 2.269e-01]
windy_storm:  26%|##6       | 795/3000 [23:51<1:03:10,  1.72s/it, lr: 1.0e-04 loss: 2.269e-01]
windy_storm:  27%|##6       | 796/3000 [23:51<1:01:50,  1.68s/it, lr: 1.0e-04 loss: 2.269e-01]
windy_storm:  27%|##6       | 796/3000 [23:51<1:01:50,  1.68s/it, lr: 1.0e-04 loss: 2.269e-01]
windy_storm:  27%|##6       | 796/3000 [23:52<1:01:50,  1.68s/it, lr: 1.0e-04 loss: 6.995e-01]
windy_storm:  27%|##6       | 796/3000 [23:52<1:01:50,  1.68s/it, lr: 1.0e-04 loss: 6.995e-01]
windy_storm:  27%|##6       | 797/3000 [23:52<1:00:45,  1.65s/it, lr: 1.0e-04 loss: 6.995e-01]
windy_storm:  27%|##6       | 797/3000 [23:52<1:00:45,  1.65s/it, lr: 1.0e-04 loss: 6.995e-01]
windy_storm:  27%|##6       | 797/3000 [23:53<1:00:45,  1.65s/it, lr: 1.0e-04 loss: 2.216e-01]
windy_storm:  27%|##6       | 797/3000 [23:53<1:00:45,  1.65s/it, lr: 1.0e-04 loss: 2.216e-01]
windy_storm:  27%|##6       | 798/3000 [23:53<52:04,  1.42s/it, lr: 1.0e-04 loss: 2.216e-01]  
windy_storm:  27%|##6       | 798/3000 [23:53<52:04,  1.42s/it, lr: 1.0e-04 loss: 2.216e-01]  
windy_storm:  27%|##6       | 798/3000 [23:55<52:04,  1.42s/it, lr: 1.0e-04 loss: 2.192e-01]
windy_storm:  27%|##6       | 798/3000 [23:55<52:04,  1.42s/it, lr: 1.0e-04 loss: 2.192e-01]
windy_storm:  27%|##6       | 799/3000 [23:55<54:07,  1.48s/it, lr: 1.0e-04 loss: 2.192e-01]
windy_storm:  27%|##6       | 799/3000 [23:55<54:07,  1.48s/it, lr: 1.0e-04 loss: 2.192e-01]
windy_storm:  27%|##6       | 799/3000 [23:56<54:07,  1.48s/it, lr: 1.0e-04 loss: 5.349e-01]
windy_storm:  27%|##6       | 799/3000 [23:56<54:07,  1.48s/it, lr: 1.0e-04 loss: 5.349e-01]
windy_storm:  27%|##6       | 800/3000 [23:57<54:05,  1.48s/it, lr: 1.0e-04 loss: 3.701e-01]
windy_storm:  27%|##6       | 800/3000 [23:57<54:05,  1.48s/it, lr: 1.0e-04 loss: 3.701e-01]
windy_storm:  27%|##6       | 801/3000 [23:57<42:47,  1.17s/it, lr: 1.0e-04 loss: 3.701e-01]
windy_storm:  27%|##6       | 801/3000 [23:57<42:47,  1.17s/it, lr: 1.0e-04 loss: 3.701e-01]
windy_storm:  27%|##6       | 801/3000 [24:00<42:47,  1.17s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  27%|##6       | 801/3000 [24:00<42:47,  1.17s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  27%|##6       | 802/3000 [24:00<58:37,  1.60s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  27%|##6       | 802/3000 [24:00<58:37,  1.60s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  27%|##6       | 802/3000 [24:02<58:37,  1.60s/it, lr: 1.0e-04 loss: 7.510e-02]
windy_storm:  27%|##6       | 802/3000 [24:02<58:37,  1.60s/it, lr: 1.0e-04 loss: 7.510e-02]
windy_storm:  27%|##6       | 803/3000 [24:02<58:16,  1.59s/it, lr: 1.0e-04 loss: 7.510e-02]
windy_storm:  27%|##6       | 803/3000 [24:02<58:16,  1.59s/it, lr: 1.0e-04 loss: 7.510e-02]
windy_storm:  27%|##6       | 803/3000 [24:03<58:16,  1.59s/it, lr: 1.0e-04 loss: 1.455e-01]
windy_storm:  27%|##6       | 803/3000 [24:03<58:16,  1.59s/it, lr: 1.0e-04 loss: 1.455e-01]
windy_storm:  27%|##6       | 804/3000 [24:03<59:47,  1.63s/it, lr: 1.0e-04 loss: 1.455e-01]
windy_storm:  27%|##6       | 804/3000 [24:03<59:47,  1.63s/it, lr: 1.0e-04 loss: 1.455e-01]
windy_storm:  27%|##6       | 804/3000 [24:04<59:47,  1.63s/it, lr: 1.0e-04 loss: 2.056e-01]
windy_storm:  27%|##6       | 804/3000 [24:04<59:47,  1.63s/it, lr: 1.0e-04 loss: 2.056e-01]
windy_storm:  27%|##6       | 805/3000 [24:04<50:56,  1.39s/it, lr: 1.0e-04 loss: 2.056e-01]
windy_storm:  27%|##6       | 805/3000 [24:04<50:56,  1.39s/it, lr: 1.0e-04 loss: 2.056e-01]
windy_storm:  27%|##6       | 805/3000 [24:07<50:56,  1.39s/it, lr: 1.0e-04 loss: 6.766e-01]
windy_storm:  27%|##6       | 805/3000 [24:07<50:56,  1.39s/it, lr: 1.0e-04 loss: 6.766e-01]
windy_storm:  27%|##6       | 806/3000 [24:07<1:07:29,  1.85s/it, lr: 1.0e-04 loss: 6.766e-01]
windy_storm:  27%|##6       | 806/3000 [24:07<1:07:29,  1.85s/it, lr: 1.0e-04 loss: 6.766e-01]
windy_storm:  27%|##6       | 806/3000 [24:08<1:07:29,  1.85s/it, lr: 1.0e-04 loss: 6.178e-01]
windy_storm:  27%|##6       | 806/3000 [24:08<1:07:29,  1.85s/it, lr: 1.0e-04 loss: 6.178e-01]
windy_storm:  27%|##6       | 807/3000 [24:08<56:41,  1.55s/it, lr: 1.0e-04 loss: 6.178e-01]  
windy_storm:  27%|##6       | 807/3000 [24:08<56:41,  1.55s/it, lr: 1.0e-04 loss: 6.178e-01]  
windy_storm:  27%|##6       | 807/3000 [24:10<56:41,  1.55s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  27%|##6       | 807/3000 [24:10<56:41,  1.55s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  27%|##6       | 808/3000 [24:10<57:12,  1.57s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  27%|##6       | 808/3000 [24:10<57:12,  1.57s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  27%|##6       | 808/3000 [24:11<57:12,  1.57s/it, lr: 1.0e-04 loss: 1.488e-01]
windy_storm:  27%|##6       | 808/3000 [24:11<57:12,  1.57s/it, lr: 1.0e-04 loss: 1.488e-01]
windy_storm:  27%|##6       | 809/3000 [24:11<57:06,  1.56s/it, lr: 1.0e-04 loss: 1.488e-01]
windy_storm:  27%|##6       | 809/3000 [24:11<57:06,  1.56s/it, lr: 1.0e-04 loss: 1.488e-01]
windy_storm:  27%|##6       | 809/3000 [24:13<57:06,  1.56s/it, lr: 1.0e-04 loss: 1.615e-01]
windy_storm:  27%|##6       | 809/3000 [24:13<57:06,  1.56s/it, lr: 1.0e-04 loss: 1.615e-01]
windy_storm:  27%|##7       | 810/3000 [24:13<57:05,  1.56s/it, lr: 1.0e-04 loss: 2.026e-01]
windy_storm:  27%|##7       | 810/3000 [24:13<57:05,  1.56s/it, lr: 1.0e-04 loss: 2.026e-01]
windy_storm:  27%|##7       | 811/3000 [24:13<37:26,  1.03s/it, lr: 1.0e-04 loss: 2.026e-01]
windy_storm:  27%|##7       | 811/3000 [24:13<37:26,  1.03s/it, lr: 1.0e-04 loss: 2.026e-01]
windy_storm:  27%|##7       | 811/3000 [24:15<37:26,  1.03s/it, lr: 1.0e-04 loss: 1.677e-01]
windy_storm:  27%|##7       | 811/3000 [24:15<37:26,  1.03s/it, lr: 1.0e-04 loss: 1.677e-01]
windy_storm:  27%|##7       | 812/3000 [24:15<42:28,  1.16s/it, lr: 1.0e-04 loss: 1.677e-01]
windy_storm:  27%|##7       | 812/3000 [24:15<42:28,  1.16s/it, lr: 1.0e-04 loss: 1.677e-01]
windy_storm:  27%|##7       | 812/3000 [24:18<42:28,  1.16s/it, lr: 1.0e-04 loss: 5.920e-01]
windy_storm:  27%|##7       | 812/3000 [24:18<42:28,  1.16s/it, lr: 1.0e-04 loss: 5.920e-01]
windy_storm:  27%|##7       | 813/3000 [24:18<1:00:06,  1.65s/it, lr: 1.0e-04 loss: 5.920e-01]
windy_storm:  27%|##7       | 813/3000 [24:18<1:00:06,  1.65s/it, lr: 1.0e-04 loss: 5.920e-01]
windy_storm:  27%|##7       | 813/3000 [24:20<1:00:06,  1.65s/it, lr: 1.0e-04 loss: 1.959e-01]
windy_storm:  27%|##7       | 813/3000 [24:20<1:00:06,  1.65s/it, lr: 1.0e-04 loss: 1.959e-01]
windy_storm:  27%|##7       | 814/3000 [24:20<59:29,  1.63s/it, lr: 1.0e-04 loss: 1.959e-01]  
windy_storm:  27%|##7       | 814/3000 [24:20<59:29,  1.63s/it, lr: 1.0e-04 loss: 1.959e-01]  
windy_storm:  27%|##7       | 814/3000 [24:20<59:29,  1.63s/it, lr: 1.0e-04 loss: 2.943e-01]
windy_storm:  27%|##7       | 814/3000 [24:20<59:29,  1.63s/it, lr: 1.0e-04 loss: 2.943e-01]
windy_storm:  27%|##7       | 815/3000 [24:20<50:32,  1.39s/it, lr: 1.0e-04 loss: 2.943e-01]
windy_storm:  27%|##7       | 815/3000 [24:20<50:32,  1.39s/it, lr: 1.0e-04 loss: 2.943e-01]
windy_storm:  27%|##7       | 815/3000 [24:22<50:32,  1.39s/it, lr: 1.0e-04 loss: 6.971e-01]
windy_storm:  27%|##7       | 815/3000 [24:22<50:32,  1.39s/it, lr: 1.0e-04 loss: 6.971e-01]
windy_storm:  27%|##7       | 816/3000 [24:22<52:14,  1.44s/it, lr: 1.0e-04 loss: 6.971e-01]
windy_storm:  27%|##7       | 816/3000 [24:22<52:14,  1.44s/it, lr: 1.0e-04 loss: 6.971e-01]
windy_storm:  27%|##7       | 816/3000 [24:25<52:14,  1.44s/it, lr: 1.0e-04 loss: 1.539e-01]
windy_storm:  27%|##7       | 816/3000 [24:25<52:14,  1.44s/it, lr: 1.0e-04 loss: 1.539e-01]
windy_storm:  27%|##7       | 817/3000 [24:25<1:09:05,  1.90s/it, lr: 1.0e-04 loss: 1.539e-01]
windy_storm:  27%|##7       | 817/3000 [24:25<1:09:05,  1.90s/it, lr: 1.0e-04 loss: 1.539e-01]
windy_storm:  27%|##7       | 817/3000 [24:26<1:09:05,  1.90s/it, lr: 1.0e-04 loss: 5.166e-01]
windy_storm:  27%|##7       | 817/3000 [24:26<1:09:05,  1.90s/it, lr: 1.0e-04 loss: 5.166e-01]
windy_storm:  27%|##7       | 818/3000 [24:26<56:42,  1.56s/it, lr: 1.0e-04 loss: 5.166e-01]  
windy_storm:  27%|##7       | 818/3000 [24:26<56:42,  1.56s/it, lr: 1.0e-04 loss: 5.166e-01]  
windy_storm:  27%|##7       | 818/3000 [24:29<56:42,  1.56s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  27%|##7       | 818/3000 [24:29<56:42,  1.56s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  27%|##7       | 819/3000 [24:29<1:12:07,  1.98s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  27%|##7       | 819/3000 [24:29<1:12:07,  1.98s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  27%|##7       | 819/3000 [24:30<1:12:07,  1.98s/it, lr: 1.0e-04 loss: 4.202e-01]
windy_storm:  27%|##7       | 819/3000 [24:30<1:12:07,  1.98s/it, lr: 1.0e-04 loss: 4.202e-01]
windy_storm:  27%|##7       | 820/3000 [24:33<1:12:05,  1.98s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  27%|##7       | 820/3000 [24:33<1:12:05,  1.98s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  27%|##7       | 821/3000 [24:33<1:04:04,  1.76s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  27%|##7       | 821/3000 [24:33<1:04:04,  1.76s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  27%|##7       | 821/3000 [24:36<1:04:04,  1.76s/it, lr: 1.0e-04 loss: 2.990e-02]
windy_storm:  27%|##7       | 821/3000 [24:36<1:04:04,  1.76s/it, lr: 1.0e-04 loss: 2.990e-02]
windy_storm:  27%|##7       | 822/3000 [24:36<1:14:39,  2.06s/it, lr: 1.0e-04 loss: 2.990e-02]
windy_storm:  27%|##7       | 822/3000 [24:36<1:14:39,  2.06s/it, lr: 1.0e-04 loss: 2.990e-02]
windy_storm:  27%|##7       | 822/3000 [24:38<1:14:39,  2.06s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  27%|##7       | 822/3000 [24:38<1:14:39,  2.06s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  27%|##7       | 823/3000 [24:38<1:10:08,  1.93s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  27%|##7       | 823/3000 [24:38<1:10:08,  1.93s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  27%|##7       | 823/3000 [24:41<1:10:08,  1.93s/it, lr: 1.0e-04 loss: 8.180e-02]
windy_storm:  27%|##7       | 823/3000 [24:41<1:10:08,  1.93s/it, lr: 1.0e-04 loss: 8.180e-02]
windy_storm:  27%|##7       | 824/3000 [24:41<1:19:44,  2.20s/it, lr: 1.0e-04 loss: 8.180e-02]
windy_storm:  27%|##7       | 824/3000 [24:41<1:19:44,  2.20s/it, lr: 1.0e-04 loss: 8.180e-02]
windy_storm:  27%|##7       | 824/3000 [24:42<1:19:44,  2.20s/it, lr: 1.0e-04 loss: 2.548e-02]
windy_storm:  27%|##7       | 824/3000 [24:42<1:19:44,  2.20s/it, lr: 1.0e-04 loss: 2.548e-02]
windy_storm:  28%|##7       | 825/3000 [24:42<1:05:46,  1.81s/it, lr: 1.0e-04 loss: 2.548e-02]
windy_storm:  28%|##7       | 825/3000 [24:42<1:05:46,  1.81s/it, lr: 1.0e-04 loss: 2.548e-02]
windy_storm:  28%|##7       | 825/3000 [24:45<1:05:46,  1.81s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  28%|##7       | 825/3000 [24:45<1:05:46,  1.81s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  28%|##7       | 826/3000 [24:45<1:17:22,  2.14s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  28%|##7       | 826/3000 [24:45<1:17:22,  2.14s/it, lr: 1.0e-04 loss: 5.746e-01]
windy_storm:  28%|##7       | 826/3000 [24:46<1:17:22,  2.14s/it, lr: 1.0e-04 loss: 9.814e-02]
windy_storm:  28%|##7       | 826/3000 [24:46<1:17:22,  2.14s/it, lr: 1.0e-04 loss: 9.814e-02]
windy_storm:  28%|##7       | 827/3000 [24:46<1:11:23,  1.97s/it, lr: 1.0e-04 loss: 9.814e-02]
windy_storm:  28%|##7       | 827/3000 [24:46<1:11:23,  1.97s/it, lr: 1.0e-04 loss: 9.814e-02]
windy_storm:  28%|##7       | 827/3000 [24:48<1:11:23,  1.97s/it, lr: 1.0e-04 loss: 3.870e-01]
windy_storm:  28%|##7       | 827/3000 [24:48<1:11:23,  1.97s/it, lr: 1.0e-04 loss: 3.870e-01]
windy_storm:  28%|##7       | 828/3000 [24:48<1:07:15,  1.86s/it, lr: 1.0e-04 loss: 3.870e-01]
windy_storm:  28%|##7       | 828/3000 [24:48<1:07:15,  1.86s/it, lr: 1.0e-04 loss: 3.870e-01]
windy_storm:  28%|##7       | 828/3000 [24:51<1:07:15,  1.86s/it, lr: 1.0e-04 loss: 6.068e-01]
windy_storm:  28%|##7       | 828/3000 [24:51<1:07:15,  1.86s/it, lr: 1.0e-04 loss: 6.068e-01]
windy_storm:  28%|##7       | 829/3000 [24:51<1:18:49,  2.18s/it, lr: 1.0e-04 loss: 6.068e-01]
windy_storm:  28%|##7       | 829/3000 [24:51<1:18:49,  2.18s/it, lr: 1.0e-04 loss: 6.068e-01]
windy_storm:  28%|##7       | 829/3000 [24:51<1:18:49,  2.18s/it, lr: 1.0e-04 loss: 4.031e-01]
windy_storm:  28%|##7       | 829/3000 [24:51<1:18:49,  2.18s/it, lr: 1.0e-04 loss: 4.031e-01]
windy_storm:  28%|##7       | 830/3000 [24:55<1:18:47,  2.18s/it, lr: 1.0e-04 loss: 1.266e-01]
windy_storm:  28%|##7       | 830/3000 [24:55<1:18:47,  2.18s/it, lr: 1.0e-04 loss: 1.266e-01]
windy_storm:  28%|##7       | 831/3000 [24:55<1:08:22,  1.89s/it, lr: 1.0e-04 loss: 1.266e-01]
windy_storm:  28%|##7       | 831/3000 [24:55<1:08:22,  1.89s/it, lr: 1.0e-04 loss: 1.266e-01]
windy_storm:  28%|##7       | 831/3000 [24:55<1:08:22,  1.89s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  28%|##7       | 831/3000 [24:55<1:08:22,  1.89s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  28%|##7       | 832/3000 [24:55<58:48,  1.63s/it, lr: 1.0e-04 loss: 1.165e-01]  
windy_storm:  28%|##7       | 832/3000 [24:55<58:48,  1.63s/it, lr: 1.0e-04 loss: 1.165e-01]  
windy_storm:  28%|##7       | 832/3000 [24:58<58:48,  1.63s/it, lr: 1.0e-04 loss: 1.682e-01]
windy_storm:  28%|##7       | 832/3000 [24:58<58:48,  1.63s/it, lr: 1.0e-04 loss: 1.682e-01]
windy_storm:  28%|##7       | 833/3000 [24:58<1:11:40,  1.98s/it, lr: 1.0e-04 loss: 1.682e-01]
windy_storm:  28%|##7       | 833/3000 [24:58<1:11:40,  1.98s/it, lr: 1.0e-04 loss: 1.682e-01]
windy_storm:  28%|##7       | 833/3000 [25:01<1:11:40,  1.98s/it, lr: 1.0e-04 loss: 3.226e-01]
windy_storm:  28%|##7       | 833/3000 [25:01<1:11:40,  1.98s/it, lr: 1.0e-04 loss: 3.226e-01]
windy_storm:  28%|##7       | 834/3000 [25:01<1:21:33,  2.26s/it, lr: 1.0e-04 loss: 3.226e-01]
windy_storm:  28%|##7       | 834/3000 [25:01<1:21:33,  2.26s/it, lr: 1.0e-04 loss: 3.226e-01]
windy_storm:  28%|##7       | 834/3000 [25:02<1:21:33,  2.26s/it, lr: 1.0e-04 loss: 6.388e-01]
windy_storm:  28%|##7       | 834/3000 [25:02<1:21:33,  2.26s/it, lr: 1.0e-04 loss: 6.388e-01]
windy_storm:  28%|##7       | 835/3000 [25:02<1:06:26,  1.84s/it, lr: 1.0e-04 loss: 6.388e-01]
windy_storm:  28%|##7       | 835/3000 [25:02<1:06:26,  1.84s/it, lr: 1.0e-04 loss: 6.388e-01]
windy_storm:  28%|##7       | 835/3000 [25:03<1:06:26,  1.84s/it, lr: 1.0e-04 loss: 5.346e-01]
windy_storm:  28%|##7       | 835/3000 [25:03<1:06:26,  1.84s/it, lr: 1.0e-04 loss: 5.346e-01]
windy_storm:  28%|##7       | 836/3000 [25:03<55:11,  1.53s/it, lr: 1.0e-04 loss: 5.346e-01]  
windy_storm:  28%|##7       | 836/3000 [25:03<55:11,  1.53s/it, lr: 1.0e-04 loss: 5.346e-01]  
windy_storm:  28%|##7       | 836/3000 [25:04<55:11,  1.53s/it, lr: 1.0e-04 loss: 5.848e-01]
windy_storm:  28%|##7       | 836/3000 [25:04<55:11,  1.53s/it, lr: 1.0e-04 loss: 5.848e-01]
windy_storm:  28%|##7       | 837/3000 [25:04<55:42,  1.55s/it, lr: 1.0e-04 loss: 5.848e-01]
windy_storm:  28%|##7       | 837/3000 [25:04<55:42,  1.55s/it, lr: 1.0e-04 loss: 5.848e-01]
windy_storm:  28%|##7       | 837/3000 [25:07<55:42,  1.55s/it, lr: 1.0e-04 loss: 3.555e-01]
windy_storm:  28%|##7       | 837/3000 [25:07<55:42,  1.55s/it, lr: 1.0e-04 loss: 3.555e-01]
windy_storm:  28%|##7       | 838/3000 [25:07<1:10:08,  1.95s/it, lr: 1.0e-04 loss: 3.555e-01]
windy_storm:  28%|##7       | 838/3000 [25:07<1:10:08,  1.95s/it, lr: 1.0e-04 loss: 3.555e-01]
windy_storm:  28%|##7       | 838/3000 [25:10<1:10:08,  1.95s/it, lr: 1.0e-04 loss: 5.453e-01]
windy_storm:  28%|##7       | 838/3000 [25:10<1:10:08,  1.95s/it, lr: 1.0e-04 loss: 5.453e-01]
windy_storm:  28%|##7       | 839/3000 [25:10<1:21:16,  2.26s/it, lr: 1.0e-04 loss: 5.453e-01]
windy_storm:  28%|##7       | 839/3000 [25:10<1:21:16,  2.26s/it, lr: 1.0e-04 loss: 5.453e-01]
windy_storm:  28%|##7       | 839/3000 [25:12<1:21:16,  2.26s/it, lr: 1.0e-04 loss: 4.803e-01]
windy_storm:  28%|##7       | 839/3000 [25:12<1:21:16,  2.26s/it, lr: 1.0e-04 loss: 4.803e-01]
windy_storm:  28%|##8       | 840/3000 [25:15<1:21:13,  2.26s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  28%|##8       | 840/3000 [25:15<1:21:13,  2.26s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  28%|##8       | 841/3000 [25:15<1:08:51,  1.91s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  28%|##8       | 841/3000 [25:15<1:08:51,  1.91s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  28%|##8       | 841/3000 [25:16<1:08:51,  1.91s/it, lr: 1.0e-04 loss: 6.068e-02]
windy_storm:  28%|##8       | 841/3000 [25:16<1:08:51,  1.91s/it, lr: 1.0e-04 loss: 6.068e-02]
windy_storm:  28%|##8       | 842/3000 [25:16<59:13,  1.65s/it, lr: 1.0e-04 loss: 6.068e-02]  
windy_storm:  28%|##8       | 842/3000 [25:16<59:13,  1.65s/it, lr: 1.0e-04 loss: 6.068e-02]  
windy_storm:  28%|##8       | 842/3000 [25:17<59:13,  1.65s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  28%|##8       | 842/3000 [25:17<59:13,  1.65s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  28%|##8       | 843/3000 [25:17<50:59,  1.42s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  28%|##8       | 843/3000 [25:17<50:59,  1.42s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  28%|##8       | 843/3000 [25:19<50:59,  1.42s/it, lr: 1.0e-04 loss: 2.823e-01]
windy_storm:  28%|##8       | 843/3000 [25:19<50:59,  1.42s/it, lr: 1.0e-04 loss: 2.823e-01]
windy_storm:  28%|##8       | 844/3000 [25:19<52:39,  1.47s/it, lr: 1.0e-04 loss: 2.823e-01]
windy_storm:  28%|##8       | 844/3000 [25:19<52:39,  1.47s/it, lr: 1.0e-04 loss: 2.823e-01]
windy_storm:  28%|##8       | 844/3000 [25:20<52:39,  1.47s/it, lr: 1.0e-04 loss: 4.932e-01]
windy_storm:  28%|##8       | 844/3000 [25:20<52:39,  1.47s/it, lr: 1.0e-04 loss: 4.932e-01]
windy_storm:  28%|##8       | 845/3000 [25:20<56:01,  1.56s/it, lr: 1.0e-04 loss: 4.932e-01]
windy_storm:  28%|##8       | 845/3000 [25:20<56:01,  1.56s/it, lr: 1.0e-04 loss: 4.932e-01]
windy_storm:  28%|##8       | 845/3000 [25:21<56:01,  1.56s/it, lr: 1.0e-04 loss: 6.890e-02]
windy_storm:  28%|##8       | 845/3000 [25:21<56:01,  1.56s/it, lr: 1.0e-04 loss: 6.890e-02]
windy_storm:  28%|##8       | 846/3000 [25:21<47:59,  1.34s/it, lr: 1.0e-04 loss: 6.890e-02]
windy_storm:  28%|##8       | 846/3000 [25:21<47:59,  1.34s/it, lr: 1.0e-04 loss: 6.890e-02]
windy_storm:  28%|##8       | 846/3000 [25:24<47:59,  1.34s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  28%|##8       | 846/3000 [25:24<47:59,  1.34s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  28%|##8       | 847/3000 [25:24<1:05:25,  1.82s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  28%|##8       | 847/3000 [25:24<1:05:25,  1.82s/it, lr: 1.0e-04 loss: 2.079e-01]
windy_storm:  28%|##8       | 847/3000 [25:26<1:05:25,  1.82s/it, lr: 1.0e-04 loss: 5.536e-01]
windy_storm:  28%|##8       | 847/3000 [25:26<1:05:25,  1.82s/it, lr: 1.0e-04 loss: 5.536e-01]
windy_storm:  28%|##8       | 848/3000 [25:26<1:02:40,  1.75s/it, lr: 1.0e-04 loss: 5.536e-01]
windy_storm:  28%|##8       | 848/3000 [25:26<1:02:40,  1.75s/it, lr: 1.0e-04 loss: 5.536e-01]
windy_storm:  28%|##8       | 848/3000 [25:27<1:02:40,  1.75s/it, lr: 1.0e-04 loss: 2.816e-01]
windy_storm:  28%|##8       | 848/3000 [25:27<1:02:40,  1.75s/it, lr: 1.0e-04 loss: 2.816e-01]
windy_storm:  28%|##8       | 849/3000 [25:27<1:00:28,  1.69s/it, lr: 1.0e-04 loss: 2.816e-01]
windy_storm:  28%|##8       | 849/3000 [25:27<1:00:28,  1.69s/it, lr: 1.0e-04 loss: 2.816e-01]
windy_storm:  28%|##8       | 849/3000 [25:29<1:00:28,  1.69s/it, lr: 1.0e-04 loss: 6.325e-01]
windy_storm:  28%|##8       | 849/3000 [25:29<1:00:28,  1.69s/it, lr: 1.0e-04 loss: 6.325e-01]
windy_storm:  28%|##8       | 850/3000 [25:32<1:00:27,  1.69s/it, lr: 1.0e-04 loss: 4.533e-01]
windy_storm:  28%|##8       | 850/3000 [25:32<1:00:27,  1.69s/it, lr: 1.0e-04 loss: 4.533e-01]
windy_storm:  28%|##8       | 851/3000 [25:32<57:34,  1.61s/it, lr: 1.0e-04 loss: 4.533e-01]  
windy_storm:  28%|##8       | 851/3000 [25:32<57:34,  1.61s/it, lr: 1.0e-04 loss: 4.533e-01]  
windy_storm:  28%|##8       | 851/3000 [25:34<57:34,  1.61s/it, lr: 1.0e-04 loss: 1.559e-01]
windy_storm:  28%|##8       | 851/3000 [25:34<57:34,  1.61s/it, lr: 1.0e-04 loss: 1.559e-01]
windy_storm:  28%|##8       | 852/3000 [25:34<57:24,  1.60s/it, lr: 1.0e-04 loss: 1.559e-01]
windy_storm:  28%|##8       | 852/3000 [25:34<57:24,  1.60s/it, lr: 1.0e-04 loss: 1.559e-01]
windy_storm:  28%|##8       | 852/3000 [25:34<57:24,  1.60s/it, lr: 1.0e-04 loss: 3.201e-01]
windy_storm:  28%|##8       | 852/3000 [25:34<57:24,  1.60s/it, lr: 1.0e-04 loss: 3.201e-01]
windy_storm:  28%|##8       | 853/3000 [25:34<49:37,  1.39s/it, lr: 1.0e-04 loss: 3.201e-01]
windy_storm:  28%|##8       | 853/3000 [25:34<49:37,  1.39s/it, lr: 1.0e-04 loss: 3.201e-01]
windy_storm:  28%|##8       | 853/3000 [25:37<49:37,  1.39s/it, lr: 1.0e-04 loss: 1.002e-01]
windy_storm:  28%|##8       | 853/3000 [25:37<49:37,  1.39s/it, lr: 1.0e-04 loss: 1.002e-01]
windy_storm:  28%|##8       | 854/3000 [25:37<1:05:36,  1.83s/it, lr: 1.0e-04 loss: 1.002e-01]
windy_storm:  28%|##8       | 854/3000 [25:37<1:05:36,  1.83s/it, lr: 1.0e-04 loss: 1.002e-01]
windy_storm:  28%|##8       | 854/3000 [25:40<1:05:36,  1.83s/it, lr: 1.0e-04 loss: 4.205e-01]
windy_storm:  28%|##8       | 854/3000 [25:40<1:05:36,  1.83s/it, lr: 1.0e-04 loss: 4.205e-01]
windy_storm:  28%|##8       | 855/3000 [25:40<1:17:06,  2.16s/it, lr: 1.0e-04 loss: 4.205e-01]
windy_storm:  28%|##8       | 855/3000 [25:40<1:17:06,  2.16s/it, lr: 1.0e-04 loss: 4.205e-01]
windy_storm:  28%|##8       | 855/3000 [25:41<1:17:06,  2.16s/it, lr: 1.0e-04 loss: 8.924e-02]
windy_storm:  28%|##8       | 855/3000 [25:41<1:17:06,  2.16s/it, lr: 1.0e-04 loss: 8.924e-02]
windy_storm:  29%|##8       | 856/3000 [25:41<1:03:33,  1.78s/it, lr: 1.0e-04 loss: 8.924e-02]
windy_storm:  29%|##8       | 856/3000 [25:41<1:03:33,  1.78s/it, lr: 1.0e-04 loss: 8.924e-02]
windy_storm:  29%|##8       | 856/3000 [25:43<1:03:33,  1.78s/it, lr: 1.0e-04 loss: 5.373e-02]
windy_storm:  29%|##8       | 856/3000 [25:43<1:03:33,  1.78s/it, lr: 1.0e-04 loss: 5.373e-02]
windy_storm:  29%|##8       | 857/3000 [25:43<1:01:39,  1.73s/it, lr: 1.0e-04 loss: 5.373e-02]
windy_storm:  29%|##8       | 857/3000 [25:43<1:01:39,  1.73s/it, lr: 1.0e-04 loss: 5.373e-02]
windy_storm:  29%|##8       | 857/3000 [25:44<1:01:39,  1.73s/it, lr: 1.0e-04 loss: 4.913e-01]
windy_storm:  29%|##8       | 857/3000 [25:44<1:01:39,  1.73s/it, lr: 1.0e-04 loss: 4.913e-01]
windy_storm:  29%|##8       | 858/3000 [25:44<51:41,  1.45s/it, lr: 1.0e-04 loss: 4.913e-01]  
windy_storm:  29%|##8       | 858/3000 [25:44<51:41,  1.45s/it, lr: 1.0e-04 loss: 4.913e-01]  
windy_storm:  29%|##8       | 858/3000 [25:45<51:41,  1.45s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  29%|##8       | 858/3000 [25:45<51:41,  1.45s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  29%|##8       | 859/3000 [25:45<47:05,  1.32s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  29%|##8       | 859/3000 [25:45<47:05,  1.32s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  29%|##8       | 859/3000 [25:45<47:05,  1.32s/it, lr: 1.0e-04 loss: 7.354e-02]
windy_storm:  29%|##8       | 859/3000 [25:45<47:05,  1.32s/it, lr: 1.0e-04 loss: 7.354e-02]
windy_storm:  29%|##8       | 860/3000 [25:46<47:04,  1.32s/it, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  29%|##8       | 860/3000 [25:46<47:04,  1.32s/it, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  29%|##8       | 861/3000 [25:46<32:21,  1.10it/s, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  29%|##8       | 861/3000 [25:46<32:21,  1.10it/s, lr: 1.0e-04 loss: 5.548e-01]
windy_storm:  29%|##8       | 861/3000 [25:49<32:21,  1.10it/s, lr: 1.0e-04 loss: 2.267e-01]
windy_storm:  29%|##8       | 861/3000 [25:49<32:21,  1.10it/s, lr: 1.0e-04 loss: 2.267e-01]
windy_storm:  29%|##8       | 862/3000 [25:49<50:59,  1.43s/it, lr: 1.0e-04 loss: 2.267e-01]
windy_storm:  29%|##8       | 862/3000 [25:49<50:59,  1.43s/it, lr: 1.0e-04 loss: 2.267e-01]
windy_storm:  29%|##8       | 862/3000 [25:50<50:59,  1.43s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:  29%|##8       | 862/3000 [25:50<50:59,  1.43s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:  29%|##8       | 863/3000 [25:50<44:45,  1.26s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:  29%|##8       | 863/3000 [25:50<44:45,  1.26s/it, lr: 1.0e-04 loss: 3.793e-01]
windy_storm:  29%|##8       | 863/3000 [25:51<44:45,  1.26s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  29%|##8       | 863/3000 [25:51<44:45,  1.26s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  29%|##8       | 864/3000 [25:51<40:34,  1.14s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  29%|##8       | 864/3000 [25:51<40:34,  1.14s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  29%|##8       | 864/3000 [25:52<40:34,  1.14s/it, lr: 1.0e-04 loss: 6.710e-01]
windy_storm:  29%|##8       | 864/3000 [25:52<40:34,  1.14s/it, lr: 1.0e-04 loss: 6.710e-01]
windy_storm:  29%|##8       | 865/3000 [25:52<45:02,  1.27s/it, lr: 1.0e-04 loss: 6.710e-01]
windy_storm:  29%|##8       | 865/3000 [25:52<45:02,  1.27s/it, lr: 1.0e-04 loss: 6.710e-01]
windy_storm:  29%|##8       | 865/3000 [25:54<45:02,  1.27s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  29%|##8       | 865/3000 [25:54<45:02,  1.27s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  29%|##8       | 866/3000 [25:54<48:05,  1.35s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  29%|##8       | 866/3000 [25:54<48:05,  1.35s/it, lr: 1.0e-04 loss: 3.192e-01]
windy_storm:  29%|##8       | 866/3000 [25:55<48:05,  1.35s/it, lr: 1.0e-04 loss: 5.889e-01]
windy_storm:  29%|##8       | 866/3000 [25:55<48:05,  1.35s/it, lr: 1.0e-04 loss: 5.889e-01]
windy_storm:  29%|##8       | 867/3000 [25:55<42:39,  1.20s/it, lr: 1.0e-04 loss: 5.889e-01]
windy_storm:  29%|##8       | 867/3000 [25:55<42:39,  1.20s/it, lr: 1.0e-04 loss: 5.889e-01]
windy_storm:  29%|##8       | 867/3000 [25:58<42:39,  1.20s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  29%|##8       | 867/3000 [25:58<42:39,  1.20s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  29%|##8       | 868/3000 [25:58<1:00:39,  1.71s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  29%|##8       | 868/3000 [25:58<1:00:39,  1.71s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  29%|##8       | 868/3000 [25:59<1:00:39,  1.71s/it, lr: 1.0e-04 loss: 7.508e-02]
windy_storm:  29%|##8       | 868/3000 [25:59<1:00:39,  1.71s/it, lr: 1.0e-04 loss: 7.508e-02]
windy_storm:  29%|##8       | 869/3000 [25:59<59:24,  1.67s/it, lr: 1.0e-04 loss: 7.508e-02]  
windy_storm:  29%|##8       | 869/3000 [25:59<59:24,  1.67s/it, lr: 1.0e-04 loss: 7.508e-02]  
windy_storm:  29%|##8       | 869/3000 [26:02<59:24,  1.67s/it, lr: 1.0e-04 loss: 6.949e-01]
windy_storm:  29%|##8       | 869/3000 [26:02<59:24,  1.67s/it, lr: 1.0e-04 loss: 6.949e-01]
windy_storm:  29%|##9       | 870/3000 [26:05<59:22,  1.67s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  29%|##9       | 870/3000 [26:05<59:22,  1.67s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  29%|##9       | 871/3000 [26:05<56:11,  1.58s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  29%|##9       | 871/3000 [26:05<56:11,  1.58s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  29%|##9       | 871/3000 [26:08<56:11,  1.58s/it, lr: 1.0e-04 loss: 7.627e-02]
windy_storm:  29%|##9       | 871/3000 [26:08<56:11,  1.58s/it, lr: 1.0e-04 loss: 7.627e-02]
windy_storm:  29%|##9       | 872/3000 [26:08<1:09:35,  1.96s/it, lr: 1.0e-04 loss: 7.627e-02]
windy_storm:  29%|##9       | 872/3000 [26:08<1:09:35,  1.96s/it, lr: 1.0e-04 loss: 7.627e-02]
windy_storm:  29%|##9       | 872/3000 [26:11<1:09:35,  1.96s/it, lr: 1.0e-04 loss: 3.313e-01]
windy_storm:  29%|##9       | 872/3000 [26:11<1:09:35,  1.96s/it, lr: 1.0e-04 loss: 3.313e-01]
windy_storm:  29%|##9       | 873/3000 [26:11<1:18:45,  2.22s/it, lr: 1.0e-04 loss: 3.313e-01]
windy_storm:  29%|##9       | 873/3000 [26:11<1:18:45,  2.22s/it, lr: 1.0e-04 loss: 3.313e-01]
windy_storm:  29%|##9       | 873/3000 [26:14<1:18:45,  2.22s/it, lr: 1.0e-04 loss: 1.457e-01]
windy_storm:  29%|##9       | 873/3000 [26:14<1:18:45,  2.22s/it, lr: 1.0e-04 loss: 1.457e-01]
windy_storm:  29%|##9       | 874/3000 [26:14<1:25:37,  2.42s/it, lr: 1.0e-04 loss: 1.457e-01]
windy_storm:  29%|##9       | 874/3000 [26:14<1:25:37,  2.42s/it, lr: 1.0e-04 loss: 1.457e-01]
windy_storm:  29%|##9       | 874/3000 [26:17<1:25:37,  2.42s/it, lr: 1.0e-04 loss: 5.076e-01]
windy_storm:  29%|##9       | 874/3000 [26:17<1:25:37,  2.42s/it, lr: 1.0e-04 loss: 5.076e-01]
windy_storm:  29%|##9       | 875/3000 [26:17<1:31:30,  2.58s/it, lr: 1.0e-04 loss: 5.076e-01]
windy_storm:  29%|##9       | 875/3000 [26:17<1:31:30,  2.58s/it, lr: 1.0e-04 loss: 5.076e-01]
windy_storm:  29%|##9       | 875/3000 [26:19<1:31:30,  2.58s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  29%|##9       | 875/3000 [26:19<1:31:30,  2.58s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  29%|##9       | 876/3000 [26:19<1:21:26,  2.30s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  29%|##9       | 876/3000 [26:19<1:21:26,  2.30s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  29%|##9       | 876/3000 [26:20<1:21:26,  2.30s/it, lr: 1.0e-04 loss: 5.981e-01]
windy_storm:  29%|##9       | 876/3000 [26:20<1:21:26,  2.30s/it, lr: 1.0e-04 loss: 5.981e-01]
windy_storm:  29%|##9       | 877/3000 [26:20<1:14:16,  2.10s/it, lr: 1.0e-04 loss: 5.981e-01]
windy_storm:  29%|##9       | 877/3000 [26:20<1:14:16,  2.10s/it, lr: 1.0e-04 loss: 5.981e-01]
windy_storm:  29%|##9       | 877/3000 [26:22<1:14:16,  2.10s/it, lr: 1.0e-04 loss: 5.258e-01]
windy_storm:  29%|##9       | 877/3000 [26:22<1:14:16,  2.10s/it, lr: 1.0e-04 loss: 5.258e-01]
windy_storm:  29%|##9       | 878/3000 [26:22<1:08:44,  1.94s/it, lr: 1.0e-04 loss: 5.258e-01]
windy_storm:  29%|##9       | 878/3000 [26:22<1:08:44,  1.94s/it, lr: 1.0e-04 loss: 5.258e-01]
windy_storm:  29%|##9       | 878/3000 [26:25<1:08:44,  1.94s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  29%|##9       | 878/3000 [26:25<1:08:44,  1.94s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  29%|##9       | 879/3000 [26:25<1:19:53,  2.26s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  29%|##9       | 879/3000 [26:25<1:19:53,  2.26s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  29%|##9       | 879/3000 [26:28<1:19:53,  2.26s/it, lr: 1.0e-04 loss: 1.719e-01]
windy_storm:  29%|##9       | 879/3000 [26:28<1:19:53,  2.26s/it, lr: 1.0e-04 loss: 1.719e-01]
windy_storm:  29%|##9       | 880/3000 [26:29<1:19:51,  2.26s/it, lr: 1.0e-04 loss: 7.263e-01]
windy_storm:  29%|##9       | 880/3000 [26:29<1:19:51,  2.26s/it, lr: 1.0e-04 loss: 7.263e-01]
windy_storm:  29%|##9       | 881/3000 [26:29<50:03,  1.42s/it, lr: 1.0e-04 loss: 7.263e-01]  
windy_storm:  29%|##9       | 881/3000 [26:29<50:03,  1.42s/it, lr: 1.0e-04 loss: 7.263e-01]  
windy_storm:  29%|##9       | 881/3000 [26:30<50:03,  1.42s/it, lr: 1.0e-04 loss: 2.860e-01]
windy_storm:  29%|##9       | 881/3000 [26:30<50:03,  1.42s/it, lr: 1.0e-04 loss: 2.860e-01]
windy_storm:  29%|##9       | 882/3000 [26:30<44:30,  1.26s/it, lr: 1.0e-04 loss: 2.860e-01]
windy_storm:  29%|##9       | 882/3000 [26:30<44:30,  1.26s/it, lr: 1.0e-04 loss: 2.860e-01]
windy_storm:  29%|##9       | 882/3000 [26:30<44:30,  1.26s/it, lr: 1.0e-04 loss: 5.388e-01]
windy_storm:  29%|##9       | 882/3000 [26:30<44:30,  1.26s/it, lr: 1.0e-04 loss: 5.388e-01]
windy_storm:  29%|##9       | 883/3000 [26:30<40:00,  1.13s/it, lr: 1.0e-04 loss: 5.388e-01]
windy_storm:  29%|##9       | 883/3000 [26:30<40:00,  1.13s/it, lr: 1.0e-04 loss: 5.388e-01]
windy_storm:  29%|##9       | 883/3000 [26:31<40:00,  1.13s/it, lr: 1.0e-04 loss: 6.522e-01]
windy_storm:  29%|##9       | 883/3000 [26:31<40:00,  1.13s/it, lr: 1.0e-04 loss: 6.522e-01]
windy_storm:  29%|##9       | 884/3000 [26:31<37:06,  1.05s/it, lr: 1.0e-04 loss: 6.522e-01]
windy_storm:  29%|##9       | 884/3000 [26:31<37:06,  1.05s/it, lr: 1.0e-04 loss: 6.522e-01]
windy_storm:  29%|##9       | 884/3000 [26:33<37:06,  1.05s/it, lr: 1.0e-04 loss: 5.329e-01]
windy_storm:  29%|##9       | 884/3000 [26:33<37:06,  1.05s/it, lr: 1.0e-04 loss: 5.329e-01]
windy_storm:  30%|##9       | 885/3000 [26:33<42:03,  1.19s/it, lr: 1.0e-04 loss: 5.329e-01]
windy_storm:  30%|##9       | 885/3000 [26:33<42:03,  1.19s/it, lr: 1.0e-04 loss: 5.329e-01]
windy_storm:  30%|##9       | 885/3000 [26:34<42:03,  1.19s/it, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  30%|##9       | 885/3000 [26:34<42:03,  1.19s/it, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  30%|##9       | 886/3000 [26:35<47:47,  1.36s/it, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  30%|##9       | 886/3000 [26:35<47:47,  1.36s/it, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  30%|##9       | 886/3000 [26:35<47:47,  1.36s/it, lr: 1.0e-04 loss: 3.269e-01]
windy_storm:  30%|##9       | 886/3000 [26:35<47:47,  1.36s/it, lr: 1.0e-04 loss: 3.269e-01]
windy_storm:  30%|##9       | 887/3000 [26:35<42:23,  1.20s/it, lr: 1.0e-04 loss: 3.269e-01]
windy_storm:  30%|##9       | 887/3000 [26:35<42:23,  1.20s/it, lr: 1.0e-04 loss: 3.269e-01]
windy_storm:  30%|##9       | 887/3000 [26:38<42:23,  1.20s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  30%|##9       | 887/3000 [26:38<42:23,  1.20s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  30%|##9       | 888/3000 [26:38<1:01:05,  1.74s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  30%|##9       | 888/3000 [26:38<1:01:05,  1.74s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  30%|##9       | 888/3000 [26:40<1:01:05,  1.74s/it, lr: 1.0e-04 loss: 2.892e-01]
windy_storm:  30%|##9       | 888/3000 [26:40<1:01:05,  1.74s/it, lr: 1.0e-04 loss: 2.892e-01]
windy_storm:  30%|##9       | 889/3000 [26:40<59:52,  1.70s/it, lr: 1.0e-04 loss: 2.892e-01]  
windy_storm:  30%|##9       | 889/3000 [26:40<59:52,  1.70s/it, lr: 1.0e-04 loss: 2.892e-01]  
windy_storm:  30%|##9       | 889/3000 [26:42<59:52,  1.70s/it, lr: 1.0e-04 loss: 5.277e-01]
windy_storm:  30%|##9       | 889/3000 [26:42<59:52,  1.70s/it, lr: 1.0e-04 loss: 5.277e-01]
windy_storm:  30%|##9       | 890/3000 [26:42<59:51,  1.70s/it, lr: 1.0e-04 loss: 2.471e-01]
windy_storm:  30%|##9       | 890/3000 [26:42<59:51,  1.70s/it, lr: 1.0e-04 loss: 2.471e-01]
windy_storm:  30%|##9       | 891/3000 [26:42<39:08,  1.11s/it, lr: 1.0e-04 loss: 2.471e-01]
windy_storm:  30%|##9       | 891/3000 [26:42<39:08,  1.11s/it, lr: 1.0e-04 loss: 2.471e-01]
windy_storm:  30%|##9       | 891/3000 [26:45<39:08,  1.11s/it, lr: 1.0e-04 loss: 2.332e-01]
windy_storm:  30%|##9       | 891/3000 [26:45<39:08,  1.11s/it, lr: 1.0e-04 loss: 2.332e-01]
windy_storm:  30%|##9       | 892/3000 [26:45<55:04,  1.57s/it, lr: 1.0e-04 loss: 2.332e-01]
windy_storm:  30%|##9       | 892/3000 [26:45<55:04,  1.57s/it, lr: 1.0e-04 loss: 2.332e-01]
windy_storm:  30%|##9       | 892/3000 [26:46<55:04,  1.57s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:  30%|##9       | 892/3000 [26:46<55:04,  1.57s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:  30%|##9       | 893/3000 [26:46<47:42,  1.36s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:  30%|##9       | 893/3000 [26:46<47:42,  1.36s/it, lr: 1.0e-04 loss: 6.426e-01]
windy_storm:  30%|##9       | 893/3000 [26:49<47:42,  1.36s/it, lr: 1.0e-04 loss: 5.912e-01]
windy_storm:  30%|##9       | 893/3000 [26:49<47:42,  1.36s/it, lr: 1.0e-04 loss: 5.912e-01]
windy_storm:  30%|##9       | 894/3000 [26:49<1:03:20,  1.80s/it, lr: 1.0e-04 loss: 5.912e-01]
windy_storm:  30%|##9       | 894/3000 [26:49<1:03:20,  1.80s/it, lr: 1.0e-04 loss: 5.912e-01]
windy_storm:  30%|##9       | 894/3000 [26:50<1:03:20,  1.80s/it, lr: 1.0e-04 loss: 6.754e-01]
windy_storm:  30%|##9       | 894/3000 [26:50<1:03:20,  1.80s/it, lr: 1.0e-04 loss: 6.754e-01]
windy_storm:  30%|##9       | 895/3000 [26:50<53:06,  1.51s/it, lr: 1.0e-04 loss: 6.754e-01]  
windy_storm:  30%|##9       | 895/3000 [26:50<53:06,  1.51s/it, lr: 1.0e-04 loss: 6.754e-01]  
windy_storm:  30%|##9       | 895/3000 [26:53<53:06,  1.51s/it, lr: 1.0e-04 loss: 8.365e-02]
windy_storm:  30%|##9       | 895/3000 [26:53<53:06,  1.51s/it, lr: 1.0e-04 loss: 8.365e-02]
windy_storm:  30%|##9       | 896/3000 [26:53<1:08:09,  1.94s/it, lr: 1.0e-04 loss: 8.365e-02]
windy_storm:  30%|##9       | 896/3000 [26:53<1:08:09,  1.94s/it, lr: 1.0e-04 loss: 8.365e-02]
windy_storm:  30%|##9       | 896/3000 [26:55<1:08:09,  1.94s/it, lr: 1.0e-04 loss: 4.026e-01]
windy_storm:  30%|##9       | 896/3000 [26:55<1:08:09,  1.94s/it, lr: 1.0e-04 loss: 4.026e-01]
windy_storm:  30%|##9       | 897/3000 [26:55<1:04:43,  1.85s/it, lr: 1.0e-04 loss: 4.026e-01]
windy_storm:  30%|##9       | 897/3000 [26:55<1:04:43,  1.85s/it, lr: 1.0e-04 loss: 4.026e-01]
windy_storm:  30%|##9       | 897/3000 [26:56<1:04:43,  1.85s/it, lr: 1.0e-04 loss: 2.492e-01]
windy_storm:  30%|##9       | 897/3000 [26:56<1:04:43,  1.85s/it, lr: 1.0e-04 loss: 2.492e-01]
windy_storm:  30%|##9       | 898/3000 [26:56<1:02:16,  1.78s/it, lr: 1.0e-04 loss: 2.492e-01]
windy_storm:  30%|##9       | 898/3000 [26:56<1:02:16,  1.78s/it, lr: 1.0e-04 loss: 2.492e-01]
windy_storm:  30%|##9       | 898/3000 [26:59<1:02:16,  1.78s/it, lr: 1.0e-04 loss: 1.561e-01]
windy_storm:  30%|##9       | 898/3000 [26:59<1:02:16,  1.78s/it, lr: 1.0e-04 loss: 1.561e-01]
windy_storm:  30%|##9       | 899/3000 [26:59<1:15:19,  2.15s/it, lr: 1.0e-04 loss: 1.561e-01]
windy_storm:  30%|##9       | 899/3000 [26:59<1:15:19,  2.15s/it, lr: 1.0e-04 loss: 1.561e-01]
windy_storm:  30%|##9       | 899/3000 [27:02<1:15:19,  2.15s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  30%|##9       | 899/3000 [27:02<1:15:19,  2.15s/it, lr: 1.0e-04 loss: 1.438e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.48s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.48s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.47s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.47s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.44s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.44s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.42s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.42s/it]


Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.41s/it]
Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.41s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.40s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.40s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  30%|###       | 900/3000 [27:04<1:15:16,  2.15s/it, lr: 1.0e-04 loss: 6.435e-01]
windy_storm:  30%|###       | 900/3000 [27:04<1:15:16,  2.15s/it, lr: 1.0e-04 loss: 6.435e-01]
windy_storm:  30%|###       | 901/3000 [27:04<53:37,  1.53s/it, lr: 1.0e-04 loss: 6.435e-01]  
windy_storm:  30%|###       | 901/3000 [27:04<53:37,  1.53s/it, lr: 1.0e-04 loss: 6.435e-01]  
windy_storm:  30%|###       | 901/3000 [27:05<53:37,  1.53s/it, lr: 1.0e-04 loss: 5.130e-01]
windy_storm:  30%|###       | 901/3000 [27:05<53:37,  1.53s/it, lr: 1.0e-04 loss: 5.130e-01]
windy_storm:  30%|###       | 902/3000 [27:05<53:57,  1.54s/it, lr: 1.0e-04 loss: 5.130e-01]
windy_storm:  30%|###       | 902/3000 [27:05<53:57,  1.54s/it, lr: 1.0e-04 loss: 5.130e-01]
windy_storm:  30%|###       | 902/3000 [27:07<53:57,  1.54s/it, lr: 1.0e-04 loss: 4.366e-01]
windy_storm:  30%|###       | 902/3000 [27:07<53:57,  1.54s/it, lr: 1.0e-04 loss: 4.366e-01]
windy_storm:  30%|###       | 903/3000 [27:07<54:10,  1.55s/it, lr: 1.0e-04 loss: 4.366e-01]
windy_storm:  30%|###       | 903/3000 [27:07<54:10,  1.55s/it, lr: 1.0e-04 loss: 4.366e-01]
windy_storm:  30%|###       | 903/3000 [27:10<54:10,  1.55s/it, lr: 1.0e-04 loss: 6.719e-01]
windy_storm:  30%|###       | 903/3000 [27:10<54:10,  1.55s/it, lr: 1.0e-04 loss: 6.719e-01]
windy_storm:  30%|###       | 904/3000 [27:10<1:07:36,  1.94s/it, lr: 1.0e-04 loss: 6.719e-01]
windy_storm:  30%|###       | 904/3000 [27:10<1:07:36,  1.94s/it, lr: 1.0e-04 loss: 6.719e-01]
windy_storm:  30%|###       | 904/3000 [27:13<1:07:36,  1.94s/it, lr: 1.0e-04 loss: 4.395e-01]
windy_storm:  30%|###       | 904/3000 [27:13<1:07:36,  1.94s/it, lr: 1.0e-04 loss: 4.395e-01]
windy_storm:  30%|###       | 905/3000 [27:13<1:16:55,  2.20s/it, lr: 1.0e-04 loss: 4.395e-01]
windy_storm:  30%|###       | 905/3000 [27:13<1:16:55,  2.20s/it, lr: 1.0e-04 loss: 4.395e-01]
windy_storm:  30%|###       | 905/3000 [27:14<1:16:55,  2.20s/it, lr: 1.0e-04 loss: 9.921e-02]
windy_storm:  30%|###       | 905/3000 [27:14<1:16:55,  2.20s/it, lr: 1.0e-04 loss: 9.921e-02]
windy_storm:  30%|###       | 906/3000 [27:14<1:10:48,  2.03s/it, lr: 1.0e-04 loss: 9.921e-02]
windy_storm:  30%|###       | 906/3000 [27:14<1:10:48,  2.03s/it, lr: 1.0e-04 loss: 9.921e-02]
windy_storm:  30%|###       | 906/3000 [27:15<1:10:48,  2.03s/it, lr: 1.0e-04 loss: 4.784e-01]
windy_storm:  30%|###       | 906/3000 [27:15<1:10:48,  2.03s/it, lr: 1.0e-04 loss: 4.784e-01]
windy_storm:  30%|###       | 907/3000 [27:15<58:39,  1.68s/it, lr: 1.0e-04 loss: 4.784e-01]  
windy_storm:  30%|###       | 907/3000 [27:15<58:39,  1.68s/it, lr: 1.0e-04 loss: 4.784e-01]  
windy_storm:  30%|###       | 907/3000 [27:17<58:39,  1.68s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  30%|###       | 907/3000 [27:17<58:39,  1.68s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  30%|###       | 908/3000 [27:17<57:38,  1.65s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  30%|###       | 908/3000 [27:17<57:38,  1.65s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  30%|###       | 908/3000 [27:18<57:38,  1.65s/it, lr: 1.0e-04 loss: 2.992e-01]
windy_storm:  30%|###       | 908/3000 [27:18<57:38,  1.65s/it, lr: 1.0e-04 loss: 2.992e-01]
windy_storm:  30%|###       | 909/3000 [27:18<48:31,  1.39s/it, lr: 1.0e-04 loss: 2.992e-01]
windy_storm:  30%|###       | 909/3000 [27:18<48:31,  1.39s/it, lr: 1.0e-04 loss: 2.992e-01]
windy_storm:  30%|###       | 909/3000 [27:21<48:31,  1.39s/it, lr: 1.0e-04 loss: 4.777e-01]
windy_storm:  30%|###       | 909/3000 [27:21<48:31,  1.39s/it, lr: 1.0e-04 loss: 4.777e-01]
windy_storm:  30%|###       | 910/3000 [27:21<48:29,  1.39s/it, lr: 1.0e-04 loss: 6.546e-02]
windy_storm:  30%|###       | 910/3000 [27:21<48:29,  1.39s/it, lr: 1.0e-04 loss: 6.546e-02]
windy_storm:  30%|###       | 911/3000 [27:21<32:55,  1.06it/s, lr: 1.0e-04 loss: 6.546e-02]
windy_storm:  30%|###       | 911/3000 [27:21<32:55,  1.06it/s, lr: 1.0e-04 loss: 6.546e-02]
windy_storm:  30%|###       | 911/3000 [27:23<32:55,  1.06it/s, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  30%|###       | 911/3000 [27:23<32:55,  1.06it/s, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  30%|###       | 912/3000 [27:23<38:28,  1.11s/it, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  30%|###       | 912/3000 [27:23<38:28,  1.11s/it, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  30%|###       | 912/3000 [27:26<38:28,  1.11s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  30%|###       | 912/3000 [27:26<38:28,  1.11s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  30%|###       | 913/3000 [27:26<56:06,  1.61s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  30%|###       | 913/3000 [27:26<56:06,  1.61s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  30%|###       | 913/3000 [27:28<56:06,  1.61s/it, lr: 1.0e-04 loss: 3.258e-01]
windy_storm:  30%|###       | 913/3000 [27:28<56:06,  1.61s/it, lr: 1.0e-04 loss: 3.258e-01]
windy_storm:  30%|###       | 914/3000 [27:28<55:52,  1.61s/it, lr: 1.0e-04 loss: 3.258e-01]
windy_storm:  30%|###       | 914/3000 [27:28<55:52,  1.61s/it, lr: 1.0e-04 loss: 3.258e-01]
windy_storm:  30%|###       | 914/3000 [27:31<55:52,  1.61s/it, lr: 1.0e-04 loss: 4.568e-01]
windy_storm:  30%|###       | 914/3000 [27:31<55:52,  1.61s/it, lr: 1.0e-04 loss: 4.568e-01]
windy_storm:  30%|###       | 915/3000 [27:31<1:08:44,  1.98s/it, lr: 1.0e-04 loss: 4.568e-01]
windy_storm:  30%|###       | 915/3000 [27:31<1:08:44,  1.98s/it, lr: 1.0e-04 loss: 4.568e-01]
windy_storm:  30%|###       | 915/3000 [27:32<1:08:44,  1.98s/it, lr: 1.0e-04 loss: 5.917e-01]
windy_storm:  30%|###       | 915/3000 [27:32<1:08:44,  1.98s/it, lr: 1.0e-04 loss: 5.917e-01]
windy_storm:  31%|###       | 916/3000 [27:32<1:04:29,  1.86s/it, lr: 1.0e-04 loss: 5.917e-01]
windy_storm:  31%|###       | 916/3000 [27:32<1:04:29,  1.86s/it, lr: 1.0e-04 loss: 5.917e-01]
windy_storm:  31%|###       | 916/3000 [27:35<1:04:29,  1.86s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  31%|###       | 916/3000 [27:35<1:04:29,  1.86s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  31%|###       | 917/3000 [27:35<1:15:23,  2.17s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  31%|###       | 917/3000 [27:35<1:15:23,  2.17s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  31%|###       | 917/3000 [27:38<1:15:23,  2.17s/it, lr: 1.0e-04 loss: 1.659e-01]
windy_storm:  31%|###       | 917/3000 [27:38<1:15:23,  2.17s/it, lr: 1.0e-04 loss: 1.659e-01]
windy_storm:  31%|###       | 918/3000 [27:38<1:23:51,  2.42s/it, lr: 1.0e-04 loss: 1.659e-01]
windy_storm:  31%|###       | 918/3000 [27:38<1:23:51,  2.42s/it, lr: 1.0e-04 loss: 1.659e-01]
windy_storm:  31%|###       | 918/3000 [27:39<1:23:51,  2.42s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  31%|###       | 918/3000 [27:39<1:23:51,  2.42s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  31%|###       | 919/3000 [27:39<1:06:57,  1.93s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  31%|###       | 919/3000 [27:39<1:06:57,  1.93s/it, lr: 1.0e-04 loss: 1.047e-01]
windy_storm:  31%|###       | 919/3000 [27:40<1:06:57,  1.93s/it, lr: 1.0e-04 loss: 1.131e-01]
windy_storm:  31%|###       | 919/3000 [27:40<1:06:57,  1.93s/it, lr: 1.0e-04 loss: 1.131e-01]
windy_storm:  31%|###       | 920/3000 [27:41<1:06:55,  1.93s/it, lr: 1.0e-04 loss: 6.538e-01]
windy_storm:  31%|###       | 920/3000 [27:41<1:06:55,  1.93s/it, lr: 1.0e-04 loss: 6.538e-01]
windy_storm:  31%|###       | 921/3000 [27:41<48:55,  1.41s/it, lr: 1.0e-04 loss: 6.538e-01]  
windy_storm:  31%|###       | 921/3000 [27:41<48:55,  1.41s/it, lr: 1.0e-04 loss: 6.538e-01]  
windy_storm:  31%|###       | 921/3000 [27:42<48:55,  1.41s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  31%|###       | 921/3000 [27:42<48:55,  1.41s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  31%|###       | 922/3000 [27:42<43:49,  1.27s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  31%|###       | 922/3000 [27:42<43:49,  1.27s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  31%|###       | 922/3000 [27:43<43:49,  1.27s/it, lr: 1.0e-04 loss: 3.651e-01]
windy_storm:  31%|###       | 922/3000 [27:43<43:49,  1.27s/it, lr: 1.0e-04 loss: 3.651e-01]
windy_storm:  31%|###       | 923/3000 [27:43<39:21,  1.14s/it, lr: 1.0e-04 loss: 3.651e-01]
windy_storm:  31%|###       | 923/3000 [27:43<39:21,  1.14s/it, lr: 1.0e-04 loss: 3.651e-01]
windy_storm:  31%|###       | 923/3000 [27:44<39:21,  1.14s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:  31%|###       | 923/3000 [27:44<39:21,  1.14s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:  31%|###       | 924/3000 [27:44<35:47,  1.03s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:  31%|###       | 924/3000 [27:44<35:47,  1.03s/it, lr: 1.0e-04 loss: 4.484e-01]
windy_storm:  31%|###       | 924/3000 [27:45<35:47,  1.03s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  31%|###       | 924/3000 [27:45<35:47,  1.03s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  31%|###       | 925/3000 [27:45<41:02,  1.19s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  31%|###       | 925/3000 [27:45<41:02,  1.19s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  31%|###       | 925/3000 [27:47<41:02,  1.19s/it, lr: 1.0e-04 loss: 4.263e-02]
windy_storm:  31%|###       | 925/3000 [27:47<41:02,  1.19s/it, lr: 1.0e-04 loss: 4.263e-02]
windy_storm:  31%|###       | 926/3000 [27:47<44:39,  1.29s/it, lr: 1.0e-04 loss: 4.263e-02]
windy_storm:  31%|###       | 926/3000 [27:47<44:39,  1.29s/it, lr: 1.0e-04 loss: 4.263e-02]
windy_storm:  31%|###       | 926/3000 [27:50<44:39,  1.29s/it, lr: 1.0e-04 loss: 7.544e-02]
windy_storm:  31%|###       | 926/3000 [27:50<44:39,  1.29s/it, lr: 1.0e-04 loss: 7.544e-02]
windy_storm:  31%|###       | 927/3000 [27:50<1:02:41,  1.81s/it, lr: 1.0e-04 loss: 7.544e-02]
windy_storm:  31%|###       | 927/3000 [27:50<1:02:41,  1.81s/it, lr: 1.0e-04 loss: 7.544e-02]
windy_storm:  31%|###       | 927/3000 [27:51<1:02:41,  1.81s/it, lr: 1.0e-04 loss: 4.945e-01]
windy_storm:  31%|###       | 927/3000 [27:51<1:02:41,  1.81s/it, lr: 1.0e-04 loss: 4.945e-01]
windy_storm:  31%|###       | 928/3000 [27:51<52:43,  1.53s/it, lr: 1.0e-04 loss: 4.945e-01]  
windy_storm:  31%|###       | 928/3000 [27:51<52:43,  1.53s/it, lr: 1.0e-04 loss: 4.945e-01]  
windy_storm:  31%|###       | 928/3000 [27:52<52:43,  1.53s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  31%|###       | 928/3000 [27:52<52:43,  1.53s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  31%|###       | 929/3000 [27:52<53:16,  1.54s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  31%|###       | 929/3000 [27:52<53:16,  1.54s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  31%|###       | 929/3000 [27:55<53:16,  1.54s/it, lr: 1.0e-04 loss: 3.517e-01]
windy_storm:  31%|###       | 929/3000 [27:55<53:16,  1.54s/it, lr: 1.0e-04 loss: 3.517e-01]
windy_storm:  31%|###1      | 930/3000 [27:57<53:14,  1.54s/it, lr: 1.0e-04 loss: 3.038e-01]
windy_storm:  31%|###1      | 930/3000 [27:57<53:14,  1.54s/it, lr: 1.0e-04 loss: 3.038e-01]
windy_storm:  31%|###1      | 931/3000 [27:57<41:09,  1.19s/it, lr: 1.0e-04 loss: 3.038e-01]
windy_storm:  31%|###1      | 931/3000 [27:57<41:09,  1.19s/it, lr: 1.0e-04 loss: 3.038e-01]
windy_storm:  31%|###1      | 931/3000 [28:00<41:09,  1.19s/it, lr: 1.0e-04 loss: 7.013e-01]
windy_storm:  31%|###1      | 931/3000 [28:00<41:09,  1.19s/it, lr: 1.0e-04 loss: 7.013e-01]
windy_storm:  31%|###1      | 932/3000 [28:00<56:31,  1.64s/it, lr: 1.0e-04 loss: 7.013e-01]
windy_storm:  31%|###1      | 932/3000 [28:00<56:31,  1.64s/it, lr: 1.0e-04 loss: 7.013e-01]
windy_storm:  31%|###1      | 932/3000 [28:03<56:31,  1.64s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  31%|###1      | 932/3000 [28:03<56:31,  1.64s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  31%|###1      | 933/3000 [28:03<1:08:47,  2.00s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  31%|###1      | 933/3000 [28:03<1:08:47,  2.00s/it, lr: 1.0e-04 loss: 3.647e-01]
windy_storm:  31%|###1      | 933/3000 [28:04<1:08:47,  2.00s/it, lr: 1.0e-04 loss: 1.053e-01]
windy_storm:  31%|###1      | 933/3000 [28:04<1:08:47,  2.00s/it, lr: 1.0e-04 loss: 1.053e-01]
windy_storm:  31%|###1      | 934/3000 [28:04<1:04:52,  1.88s/it, lr: 1.0e-04 loss: 1.053e-01]
windy_storm:  31%|###1      | 934/3000 [28:04<1:04:52,  1.88s/it, lr: 1.0e-04 loss: 1.053e-01]
windy_storm:  31%|###1      | 934/3000 [28:07<1:04:52,  1.88s/it, lr: 1.0e-04 loss: 4.139e-01]
windy_storm:  31%|###1      | 934/3000 [28:07<1:04:52,  1.88s/it, lr: 1.0e-04 loss: 4.139e-01]
windy_storm:  31%|###1      | 935/3000 [28:07<1:15:37,  2.20s/it, lr: 1.0e-04 loss: 4.139e-01]
windy_storm:  31%|###1      | 935/3000 [28:07<1:15:37,  2.20s/it, lr: 1.0e-04 loss: 4.139e-01]
windy_storm:  31%|###1      | 935/3000 [28:09<1:15:37,  2.20s/it, lr: 1.0e-04 loss: 5.830e-02]
windy_storm:  31%|###1      | 935/3000 [28:09<1:15:37,  2.20s/it, lr: 1.0e-04 loss: 5.830e-02]
windy_storm:  31%|###1      | 936/3000 [28:09<1:09:39,  2.02s/it, lr: 1.0e-04 loss: 5.830e-02]
windy_storm:  31%|###1      | 936/3000 [28:09<1:09:39,  2.02s/it, lr: 1.0e-04 loss: 5.830e-02]
windy_storm:  31%|###1      | 936/3000 [28:12<1:09:39,  2.02s/it, lr: 1.0e-04 loss: 2.974e-01]
windy_storm:  31%|###1      | 936/3000 [28:12<1:09:39,  2.02s/it, lr: 1.0e-04 loss: 2.974e-01]
windy_storm:  31%|###1      | 937/3000 [28:12<1:19:25,  2.31s/it, lr: 1.0e-04 loss: 2.974e-01]
windy_storm:  31%|###1      | 937/3000 [28:12<1:19:25,  2.31s/it, lr: 1.0e-04 loss: 2.974e-01]
windy_storm:  31%|###1      | 937/3000 [28:13<1:19:25,  2.31s/it, lr: 1.0e-04 loss: 1.873e-01]
windy_storm:  31%|###1      | 937/3000 [28:13<1:19:25,  2.31s/it, lr: 1.0e-04 loss: 1.873e-01]
windy_storm:  31%|###1      | 938/3000 [28:13<1:04:25,  1.87s/it, lr: 1.0e-04 loss: 1.873e-01]
windy_storm:  31%|###1      | 938/3000 [28:13<1:04:25,  1.87s/it, lr: 1.0e-04 loss: 1.873e-01]
windy_storm:  31%|###1      | 938/3000 [28:16<1:04:25,  1.87s/it, lr: 1.0e-04 loss: 5.019e-01]
windy_storm:  31%|###1      | 938/3000 [28:16<1:04:25,  1.87s/it, lr: 1.0e-04 loss: 5.019e-01]
windy_storm:  31%|###1      | 939/3000 [28:16<1:15:46,  2.21s/it, lr: 1.0e-04 loss: 5.019e-01]
windy_storm:  31%|###1      | 939/3000 [28:16<1:15:46,  2.21s/it, lr: 1.0e-04 loss: 5.019e-01]
windy_storm:  31%|###1      | 939/3000 [28:17<1:15:46,  2.21s/it, lr: 1.0e-04 loss: 6.127e-01]
windy_storm:  31%|###1      | 939/3000 [28:17<1:15:46,  2.21s/it, lr: 1.0e-04 loss: 6.127e-01]
windy_storm:  31%|###1      | 940/3000 [28:18<1:15:44,  2.21s/it, lr: 1.0e-04 loss: 6.036e-01]
windy_storm:  31%|###1      | 940/3000 [28:18<1:15:44,  2.21s/it, lr: 1.0e-04 loss: 6.036e-01]
windy_storm:  31%|###1      | 941/3000 [28:18<49:06,  1.43s/it, lr: 1.0e-04 loss: 6.036e-01]  
windy_storm:  31%|###1      | 941/3000 [28:18<49:06,  1.43s/it, lr: 1.0e-04 loss: 6.036e-01]  
windy_storm:  31%|###1      | 941/3000 [28:19<49:06,  1.43s/it, lr: 1.0e-04 loss: 1.074e-01]
windy_storm:  31%|###1      | 941/3000 [28:19<49:06,  1.43s/it, lr: 1.0e-04 loss: 1.074e-01]
windy_storm:  31%|###1      | 942/3000 [28:19<43:56,  1.28s/it, lr: 1.0e-04 loss: 1.074e-01]
windy_storm:  31%|###1      | 942/3000 [28:19<43:56,  1.28s/it, lr: 1.0e-04 loss: 1.074e-01]
windy_storm:  31%|###1      | 942/3000 [28:21<43:56,  1.28s/it, lr: 1.0e-04 loss: 4.955e-01]
windy_storm:  31%|###1      | 942/3000 [28:21<43:56,  1.28s/it, lr: 1.0e-04 loss: 4.955e-01]
windy_storm:  31%|###1      | 943/3000 [28:21<46:37,  1.36s/it, lr: 1.0e-04 loss: 4.955e-01]
windy_storm:  31%|###1      | 943/3000 [28:21<46:37,  1.36s/it, lr: 1.0e-04 loss: 4.955e-01]
windy_storm:  31%|###1      | 943/3000 [28:22<46:37,  1.36s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  31%|###1      | 943/3000 [28:22<46:37,  1.36s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  31%|###1      | 944/3000 [28:22<41:10,  1.20s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  31%|###1      | 944/3000 [28:22<41:10,  1.20s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  31%|###1      | 944/3000 [28:25<41:10,  1.20s/it, lr: 1.0e-04 loss: 4.380e-01]
windy_storm:  31%|###1      | 944/3000 [28:25<41:10,  1.20s/it, lr: 1.0e-04 loss: 4.380e-01]
windy_storm:  32%|###1      | 945/3000 [28:25<58:31,  1.71s/it, lr: 1.0e-04 loss: 4.380e-01]
windy_storm:  32%|###1      | 945/3000 [28:25<58:31,  1.71s/it, lr: 1.0e-04 loss: 4.380e-01]
windy_storm:  32%|###1      | 945/3000 [28:28<58:31,  1.71s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  32%|###1      | 945/3000 [28:28<58:31,  1.71s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  32%|###1      | 946/3000 [28:28<1:11:20,  2.08s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  32%|###1      | 946/3000 [28:28<1:11:20,  2.08s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  32%|###1      | 946/3000 [28:29<1:11:20,  2.08s/it, lr: 1.0e-04 loss: 5.667e-01]
windy_storm:  32%|###1      | 946/3000 [28:29<1:11:20,  2.08s/it, lr: 1.0e-04 loss: 5.667e-01]
windy_storm:  32%|###1      | 947/3000 [28:29<58:52,  1.72s/it, lr: 1.0e-04 loss: 5.667e-01]  
windy_storm:  32%|###1      | 947/3000 [28:29<58:52,  1.72s/it, lr: 1.0e-04 loss: 5.667e-01]  
windy_storm:  32%|###1      | 947/3000 [28:29<58:52,  1.72s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:  32%|###1      | 947/3000 [28:29<58:52,  1.72s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:  32%|###1      | 948/3000 [28:29<49:57,  1.46s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:  32%|###1      | 948/3000 [28:29<49:57,  1.46s/it, lr: 1.0e-04 loss: 1.562e-01]
windy_storm:  32%|###1      | 948/3000 [28:30<49:57,  1.46s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  32%|###1      | 948/3000 [28:30<49:57,  1.46s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  32%|###1      | 949/3000 [28:30<43:33,  1.27s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  32%|###1      | 949/3000 [28:30<43:33,  1.27s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  32%|###1      | 949/3000 [28:33<43:33,  1.27s/it, lr: 1.0e-04 loss: 5.669e-01]
windy_storm:  32%|###1      | 949/3000 [28:33<43:33,  1.27s/it, lr: 1.0e-04 loss: 5.669e-01]
windy_storm:  32%|###1      | 950/3000 [28:36<43:32,  1.27s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  32%|###1      | 950/3000 [28:36<43:32,  1.27s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  32%|###1      | 951/3000 [28:36<46:52,  1.37s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  32%|###1      | 951/3000 [28:36<46:52,  1.37s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  32%|###1      | 951/3000 [28:37<46:52,  1.37s/it, lr: 1.0e-04 loss: 2.396e-01]
windy_storm:  32%|###1      | 951/3000 [28:37<46:52,  1.37s/it, lr: 1.0e-04 loss: 2.396e-01]
windy_storm:  32%|###1      | 952/3000 [28:37<42:18,  1.24s/it, lr: 1.0e-04 loss: 2.396e-01]
windy_storm:  32%|###1      | 952/3000 [28:37<42:18,  1.24s/it, lr: 1.0e-04 loss: 2.396e-01]
windy_storm:  32%|###1      | 952/3000 [28:38<42:18,  1.24s/it, lr: 1.0e-04 loss: 3.438e-01]
windy_storm:  32%|###1      | 952/3000 [28:38<42:18,  1.24s/it, lr: 1.0e-04 loss: 3.438e-01]
windy_storm:  32%|###1      | 953/3000 [28:38<38:38,  1.13s/it, lr: 1.0e-04 loss: 3.438e-01]
windy_storm:  32%|###1      | 953/3000 [28:38<38:38,  1.13s/it, lr: 1.0e-04 loss: 3.438e-01]
windy_storm:  32%|###1      | 953/3000 [28:39<38:38,  1.13s/it, lr: 1.0e-04 loss: 4.926e-01]
windy_storm:  32%|###1      | 953/3000 [28:39<38:38,  1.13s/it, lr: 1.0e-04 loss: 4.926e-01]
windy_storm:  32%|###1      | 954/3000 [28:40<44:16,  1.30s/it, lr: 1.0e-04 loss: 4.926e-01]
windy_storm:  32%|###1      | 954/3000 [28:40<44:16,  1.30s/it, lr: 1.0e-04 loss: 4.926e-01]
windy_storm:  32%|###1      | 954/3000 [28:42<44:16,  1.30s/it, lr: 1.0e-04 loss: 6.548e-01]
windy_storm:  32%|###1      | 954/3000 [28:42<44:16,  1.30s/it, lr: 1.0e-04 loss: 6.548e-01]
windy_storm:  32%|###1      | 955/3000 [28:42<59:43,  1.75s/it, lr: 1.0e-04 loss: 6.548e-01]
windy_storm:  32%|###1      | 955/3000 [28:42<59:43,  1.75s/it, lr: 1.0e-04 loss: 6.548e-01]
windy_storm:  32%|###1      | 955/3000 [28:44<59:43,  1.75s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  32%|###1      | 955/3000 [28:44<59:43,  1.75s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  32%|###1      | 956/3000 [28:44<58:08,  1.71s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  32%|###1      | 956/3000 [28:44<58:08,  1.71s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  32%|###1      | 956/3000 [28:45<58:08,  1.71s/it, lr: 1.0e-04 loss: 6.348e-01]
windy_storm:  32%|###1      | 956/3000 [28:45<58:08,  1.71s/it, lr: 1.0e-04 loss: 6.348e-01]
windy_storm:  32%|###1      | 957/3000 [28:45<49:30,  1.45s/it, lr: 1.0e-04 loss: 6.348e-01]
windy_storm:  32%|###1      | 957/3000 [28:45<49:30,  1.45s/it, lr: 1.0e-04 loss: 6.348e-01]
windy_storm:  32%|###1      | 957/3000 [28:46<49:30,  1.45s/it, lr: 1.0e-04 loss: 1.825e-01]
windy_storm:  32%|###1      | 957/3000 [28:46<49:30,  1.45s/it, lr: 1.0e-04 loss: 1.825e-01]
windy_storm:  32%|###1      | 958/3000 [28:46<50:41,  1.49s/it, lr: 1.0e-04 loss: 1.825e-01]
windy_storm:  32%|###1      | 958/3000 [28:46<50:41,  1.49s/it, lr: 1.0e-04 loss: 1.825e-01]
windy_storm:  32%|###1      | 958/3000 [28:47<50:41,  1.49s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  32%|###1      | 958/3000 [28:47<50:41,  1.49s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  32%|###1      | 959/3000 [28:47<43:41,  1.28s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  32%|###1      | 959/3000 [28:47<43:41,  1.28s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  32%|###1      | 959/3000 [28:48<43:41,  1.28s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:  32%|###1      | 959/3000 [28:48<43:41,  1.28s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:  32%|###2      | 960/3000 [28:49<43:40,  1.28s/it, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  32%|###2      | 960/3000 [28:49<43:40,  1.28s/it, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  32%|###2      | 961/3000 [28:49<29:35,  1.15it/s, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  32%|###2      | 961/3000 [28:49<29:35,  1.15it/s, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  32%|###2      | 961/3000 [28:51<29:35,  1.15it/s, lr: 1.0e-04 loss: 1.249e-01]
windy_storm:  32%|###2      | 961/3000 [28:51<29:35,  1.15it/s, lr: 1.0e-04 loss: 1.249e-01]
windy_storm:  32%|###2      | 962/3000 [28:51<35:47,  1.05s/it, lr: 1.0e-04 loss: 1.249e-01]
windy_storm:  32%|###2      | 962/3000 [28:51<35:47,  1.05s/it, lr: 1.0e-04 loss: 1.249e-01]
windy_storm:  32%|###2      | 962/3000 [28:54<35:47,  1.05s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  32%|###2      | 962/3000 [28:54<35:47,  1.05s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  32%|###2      | 963/3000 [28:54<53:16,  1.57s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  32%|###2      | 963/3000 [28:54<53:16,  1.57s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  32%|###2      | 963/3000 [28:55<53:16,  1.57s/it, lr: 1.0e-04 loss: 1.946e-02]
windy_storm:  32%|###2      | 963/3000 [28:55<53:16,  1.57s/it, lr: 1.0e-04 loss: 1.946e-02]
windy_storm:  32%|###2      | 964/3000 [28:55<46:28,  1.37s/it, lr: 1.0e-04 loss: 1.946e-02]
windy_storm:  32%|###2      | 964/3000 [28:55<46:28,  1.37s/it, lr: 1.0e-04 loss: 1.946e-02]
windy_storm:  32%|###2      | 964/3000 [28:56<46:28,  1.37s/it, lr: 1.0e-04 loss: 7.005e-01]
windy_storm:  32%|###2      | 964/3000 [28:56<46:28,  1.37s/it, lr: 1.0e-04 loss: 7.005e-01]
windy_storm:  32%|###2      | 965/3000 [28:56<41:20,  1.22s/it, lr: 1.0e-04 loss: 7.005e-01]
windy_storm:  32%|###2      | 965/3000 [28:56<41:20,  1.22s/it, lr: 1.0e-04 loss: 7.005e-01]
windy_storm:  32%|###2      | 965/3000 [28:57<41:20,  1.22s/it, lr: 1.0e-04 loss: 5.219e-01]
windy_storm:  32%|###2      | 965/3000 [28:57<41:20,  1.22s/it, lr: 1.0e-04 loss: 5.219e-01]
windy_storm:  32%|###2      | 966/3000 [28:57<45:03,  1.33s/it, lr: 1.0e-04 loss: 5.219e-01]
windy_storm:  32%|###2      | 966/3000 [28:57<45:03,  1.33s/it, lr: 1.0e-04 loss: 5.219e-01]
windy_storm:  32%|###2      | 966/3000 [28:58<45:03,  1.33s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:  32%|###2      | 966/3000 [28:58<45:03,  1.33s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:  32%|###2      | 967/3000 [28:58<43:18,  1.28s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:  32%|###2      | 967/3000 [28:58<43:18,  1.28s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:  32%|###2      | 967/3000 [28:59<43:18,  1.28s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  32%|###2      | 967/3000 [28:59<43:18,  1.28s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  32%|###2      | 968/3000 [28:59<38:47,  1.15s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  32%|###2      | 968/3000 [28:59<38:47,  1.15s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  32%|###2      | 968/3000 [29:00<38:47,  1.15s/it, lr: 1.0e-04 loss: 5.096e-01]
windy_storm:  32%|###2      | 968/3000 [29:00<38:47,  1.15s/it, lr: 1.0e-04 loss: 5.096e-01]
windy_storm:  32%|###2      | 969/3000 [29:00<35:06,  1.04s/it, lr: 1.0e-04 loss: 5.096e-01]
windy_storm:  32%|###2      | 969/3000 [29:00<35:06,  1.04s/it, lr: 1.0e-04 loss: 5.096e-01]
windy_storm:  32%|###2      | 969/3000 [29:01<35:06,  1.04s/it, lr: 1.0e-04 loss: 6.828e-01]
windy_storm:  32%|###2      | 969/3000 [29:01<35:06,  1.04s/it, lr: 1.0e-04 loss: 6.828e-01]
windy_storm:  32%|###2      | 970/3000 [29:04<35:05,  1.04s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  32%|###2      | 970/3000 [29:04<35:05,  1.04s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  32%|###2      | 971/3000 [29:04<41:49,  1.24s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  32%|###2      | 971/3000 [29:04<41:49,  1.24s/it, lr: 1.0e-04 loss: 2.885e-01]
windy_storm:  32%|###2      | 971/3000 [29:05<41:49,  1.24s/it, lr: 1.0e-04 loss: 6.299e-02]
windy_storm:  32%|###2      | 971/3000 [29:05<41:49,  1.24s/it, lr: 1.0e-04 loss: 6.299e-02]
windy_storm:  32%|###2      | 972/3000 [29:05<44:34,  1.32s/it, lr: 1.0e-04 loss: 6.299e-02]
windy_storm:  32%|###2      | 972/3000 [29:05<44:34,  1.32s/it, lr: 1.0e-04 loss: 6.299e-02]
windy_storm:  32%|###2      | 972/3000 [29:07<44:34,  1.32s/it, lr: 1.0e-04 loss: 6.394e-01]
windy_storm:  32%|###2      | 972/3000 [29:07<44:34,  1.32s/it, lr: 1.0e-04 loss: 6.394e-01]
windy_storm:  32%|###2      | 973/3000 [29:07<46:25,  1.37s/it, lr: 1.0e-04 loss: 6.394e-01]
windy_storm:  32%|###2      | 973/3000 [29:07<46:25,  1.37s/it, lr: 1.0e-04 loss: 6.394e-01]
windy_storm:  32%|###2      | 973/3000 [29:10<46:25,  1.37s/it, lr: 1.0e-04 loss: 8.969e-02]
windy_storm:  32%|###2      | 973/3000 [29:10<46:25,  1.37s/it, lr: 1.0e-04 loss: 8.969e-02]
windy_storm:  32%|###2      | 974/3000 [29:10<1:00:54,  1.80s/it, lr: 1.0e-04 loss: 8.969e-02]
windy_storm:  32%|###2      | 974/3000 [29:10<1:00:54,  1.80s/it, lr: 1.0e-04 loss: 8.969e-02]
windy_storm:  32%|###2      | 974/3000 [29:13<1:00:54,  1.80s/it, lr: 1.0e-04 loss: 3.952e-01]
windy_storm:  32%|###2      | 974/3000 [29:13<1:00:54,  1.80s/it, lr: 1.0e-04 loss: 3.952e-01]
windy_storm:  32%|###2      | 975/3000 [29:13<1:12:31,  2.15s/it, lr: 1.0e-04 loss: 3.952e-01]
windy_storm:  32%|###2      | 975/3000 [29:13<1:12:31,  2.15s/it, lr: 1.0e-04 loss: 3.952e-01]
windy_storm:  32%|###2      | 975/3000 [29:16<1:12:31,  2.15s/it, lr: 1.0e-04 loss: 4.662e-01]
windy_storm:  32%|###2      | 975/3000 [29:16<1:12:31,  2.15s/it, lr: 1.0e-04 loss: 4.662e-01]
windy_storm:  33%|###2      | 976/3000 [29:16<1:19:58,  2.37s/it, lr: 1.0e-04 loss: 4.662e-01]
windy_storm:  33%|###2      | 976/3000 [29:16<1:19:58,  2.37s/it, lr: 1.0e-04 loss: 4.662e-01]
windy_storm:  33%|###2      | 976/3000 [29:19<1:19:58,  2.37s/it, lr: 1.0e-04 loss: 2.155e-01]
windy_storm:  33%|###2      | 976/3000 [29:19<1:19:58,  2.37s/it, lr: 1.0e-04 loss: 2.155e-01]
windy_storm:  33%|###2      | 977/3000 [29:19<1:26:07,  2.55s/it, lr: 1.0e-04 loss: 2.155e-01]
windy_storm:  33%|###2      | 977/3000 [29:19<1:26:07,  2.55s/it, lr: 1.0e-04 loss: 2.155e-01]
windy_storm:  33%|###2      | 977/3000 [29:20<1:26:07,  2.55s/it, lr: 1.0e-04 loss: 6.807e-01]
windy_storm:  33%|###2      | 977/3000 [29:20<1:26:07,  2.55s/it, lr: 1.0e-04 loss: 6.807e-01]
windy_storm:  33%|###2      | 978/3000 [29:20<1:08:55,  2.05s/it, lr: 1.0e-04 loss: 6.807e-01]
windy_storm:  33%|###2      | 978/3000 [29:20<1:08:55,  2.05s/it, lr: 1.0e-04 loss: 6.807e-01]
windy_storm:  33%|###2      | 978/3000 [29:23<1:08:55,  2.05s/it, lr: 1.0e-04 loss: 3.880e-02]
windy_storm:  33%|###2      | 978/3000 [29:23<1:08:55,  2.05s/it, lr: 1.0e-04 loss: 3.880e-02]
windy_storm:  33%|###2      | 979/3000 [29:23<1:18:30,  2.33s/it, lr: 1.0e-04 loss: 3.880e-02]
windy_storm:  33%|###2      | 979/3000 [29:23<1:18:30,  2.33s/it, lr: 1.0e-04 loss: 3.880e-02]
windy_storm:  33%|###2      | 979/3000 [29:23<1:18:30,  2.33s/it, lr: 1.0e-04 loss: 1.822e-01]
windy_storm:  33%|###2      | 979/3000 [29:23<1:18:30,  2.33s/it, lr: 1.0e-04 loss: 1.822e-01]
windy_storm:  33%|###2      | 980/3000 [29:24<1:18:28,  2.33s/it, lr: 1.0e-04 loss: 1.050e-01]
windy_storm:  33%|###2      | 980/3000 [29:24<1:18:28,  2.33s/it, lr: 1.0e-04 loss: 1.050e-01]
windy_storm:  33%|###2      | 981/3000 [29:24<50:49,  1.51s/it, lr: 1.0e-04 loss: 1.050e-01]  
windy_storm:  33%|###2      | 981/3000 [29:24<50:49,  1.51s/it, lr: 1.0e-04 loss: 1.050e-01]  
windy_storm:  33%|###2      | 981/3000 [29:26<50:49,  1.51s/it, lr: 1.0e-04 loss: 1.298e-01]
windy_storm:  33%|###2      | 981/3000 [29:26<50:49,  1.51s/it, lr: 1.0e-04 loss: 1.298e-01]
windy_storm:  33%|###2      | 982/3000 [29:26<51:15,  1.52s/it, lr: 1.0e-04 loss: 1.298e-01]
windy_storm:  33%|###2      | 982/3000 [29:26<51:15,  1.52s/it, lr: 1.0e-04 loss: 1.298e-01]
windy_storm:  33%|###2      | 982/3000 [29:28<51:15,  1.52s/it, lr: 1.0e-04 loss: 3.284e-01]
windy_storm:  33%|###2      | 982/3000 [29:28<51:15,  1.52s/it, lr: 1.0e-04 loss: 3.284e-01]
windy_storm:  33%|###2      | 983/3000 [29:28<51:26,  1.53s/it, lr: 1.0e-04 loss: 3.284e-01]
windy_storm:  33%|###2      | 983/3000 [29:28<51:26,  1.53s/it, lr: 1.0e-04 loss: 3.284e-01]
windy_storm:  33%|###2      | 983/3000 [29:31<51:26,  1.53s/it, lr: 1.0e-04 loss: 3.068e-01]
windy_storm:  33%|###2      | 983/3000 [29:31<51:26,  1.53s/it, lr: 1.0e-04 loss: 3.068e-01]
windy_storm:  33%|###2      | 984/3000 [29:31<1:04:53,  1.93s/it, lr: 1.0e-04 loss: 3.068e-01]
windy_storm:  33%|###2      | 984/3000 [29:31<1:04:53,  1.93s/it, lr: 1.0e-04 loss: 3.068e-01]
windy_storm:  33%|###2      | 984/3000 [29:32<1:04:53,  1.93s/it, lr: 1.0e-04 loss: 5.235e-01]
windy_storm:  33%|###2      | 984/3000 [29:32<1:04:53,  1.93s/it, lr: 1.0e-04 loss: 5.235e-01]
windy_storm:  33%|###2      | 985/3000 [29:32<1:01:39,  1.84s/it, lr: 1.0e-04 loss: 5.235e-01]
windy_storm:  33%|###2      | 985/3000 [29:32<1:01:39,  1.84s/it, lr: 1.0e-04 loss: 5.235e-01]
windy_storm:  33%|###2      | 985/3000 [29:35<1:01:39,  1.84s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  33%|###2      | 985/3000 [29:35<1:01:39,  1.84s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  33%|###2      | 986/3000 [29:35<1:11:57,  2.14s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  33%|###2      | 986/3000 [29:35<1:11:57,  2.14s/it, lr: 1.0e-04 loss: 5.572e-01]
windy_storm:  33%|###2      | 986/3000 [29:38<1:11:57,  2.14s/it, lr: 1.0e-04 loss: 4.998e-01]
windy_storm:  33%|###2      | 986/3000 [29:38<1:11:57,  2.14s/it, lr: 1.0e-04 loss: 4.998e-01]
windy_storm:  33%|###2      | 987/3000 [29:38<1:20:19,  2.39s/it, lr: 1.0e-04 loss: 4.998e-01]
windy_storm:  33%|###2      | 987/3000 [29:38<1:20:19,  2.39s/it, lr: 1.0e-04 loss: 4.998e-01]
windy_storm:  33%|###2      | 987/3000 [29:41<1:20:19,  2.39s/it, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  33%|###2      | 987/3000 [29:41<1:20:19,  2.39s/it, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  33%|###2      | 988/3000 [29:41<1:25:31,  2.55s/it, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  33%|###2      | 988/3000 [29:41<1:25:31,  2.55s/it, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  33%|###2      | 988/3000 [29:42<1:25:31,  2.55s/it, lr: 1.0e-04 loss: 3.863e-01]
windy_storm:  33%|###2      | 988/3000 [29:42<1:25:31,  2.55s/it, lr: 1.0e-04 loss: 3.863e-01]
windy_storm:  33%|###2      | 989/3000 [29:42<1:07:47,  2.02s/it, lr: 1.0e-04 loss: 3.863e-01]
windy_storm:  33%|###2      | 989/3000 [29:42<1:07:47,  2.02s/it, lr: 1.0e-04 loss: 3.863e-01]
windy_storm:  33%|###2      | 989/3000 [29:45<1:07:47,  2.02s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  33%|###2      | 989/3000 [29:45<1:07:47,  2.02s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  33%|###3      | 990/3000 [29:48<1:07:45,  2.02s/it, lr: 1.0e-04 loss: 1.949e-01]
windy_storm:  33%|###3      | 990/3000 [29:48<1:07:45,  2.02s/it, lr: 1.0e-04 loss: 1.949e-01]
windy_storm:  33%|###3      | 991/3000 [29:48<59:49,  1.79s/it, lr: 1.0e-04 loss: 1.949e-01]  
windy_storm:  33%|###3      | 991/3000 [29:48<59:49,  1.79s/it, lr: 1.0e-04 loss: 1.949e-01]  
windy_storm:  33%|###3      | 991/3000 [29:49<59:49,  1.79s/it, lr: 1.0e-04 loss: 6.067e-02]
windy_storm:  33%|###3      | 991/3000 [29:49<59:49,  1.79s/it, lr: 1.0e-04 loss: 6.067e-02]
windy_storm:  33%|###3      | 992/3000 [29:49<57:57,  1.73s/it, lr: 1.0e-04 loss: 6.067e-02]
windy_storm:  33%|###3      | 992/3000 [29:49<57:57,  1.73s/it, lr: 1.0e-04 loss: 6.067e-02]
windy_storm:  33%|###3      | 992/3000 [29:50<57:57,  1.73s/it, lr: 1.0e-04 loss: 3.783e-01]
windy_storm:  33%|###3      | 992/3000 [29:50<57:57,  1.73s/it, lr: 1.0e-04 loss: 3.783e-01]
windy_storm:  33%|###3      | 993/3000 [29:50<49:32,  1.48s/it, lr: 1.0e-04 loss: 3.783e-01]
windy_storm:  33%|###3      | 993/3000 [29:50<49:32,  1.48s/it, lr: 1.0e-04 loss: 3.783e-01]
windy_storm:  33%|###3      | 993/3000 [29:52<49:32,  1.48s/it, lr: 1.0e-04 loss: 4.081e-01]
windy_storm:  33%|###3      | 993/3000 [29:52<49:32,  1.48s/it, lr: 1.0e-04 loss: 4.081e-01]
windy_storm:  33%|###3      | 994/3000 [29:52<50:22,  1.51s/it, lr: 1.0e-04 loss: 4.081e-01]
windy_storm:  33%|###3      | 994/3000 [29:52<50:22,  1.51s/it, lr: 1.0e-04 loss: 4.081e-01]
windy_storm:  33%|###3      | 994/3000 [29:53<50:22,  1.51s/it, lr: 1.0e-04 loss: 3.730e-01]
windy_storm:  33%|###3      | 994/3000 [29:53<50:22,  1.51s/it, lr: 1.0e-04 loss: 3.730e-01]
windy_storm:  33%|###3      | 995/3000 [29:53<46:03,  1.38s/it, lr: 1.0e-04 loss: 3.730e-01]
windy_storm:  33%|###3      | 995/3000 [29:53<46:03,  1.38s/it, lr: 1.0e-04 loss: 3.730e-01]
windy_storm:  33%|###3      | 995/3000 [29:56<46:03,  1.38s/it, lr: 1.0e-04 loss: 4.724e-01]
windy_storm:  33%|###3      | 995/3000 [29:56<46:03,  1.38s/it, lr: 1.0e-04 loss: 4.724e-01]
windy_storm:  33%|###3      | 996/3000 [29:56<1:01:39,  1.85s/it, lr: 1.0e-04 loss: 4.724e-01]
windy_storm:  33%|###3      | 996/3000 [29:56<1:01:39,  1.85s/it, lr: 1.0e-04 loss: 4.724e-01]
windy_storm:  33%|###3      | 996/3000 [29:57<1:01:39,  1.85s/it, lr: 1.0e-04 loss: 5.670e-01]
windy_storm:  33%|###3      | 996/3000 [29:57<1:01:39,  1.85s/it, lr: 1.0e-04 loss: 5.670e-01]
windy_storm:  33%|###3      | 997/3000 [29:57<58:47,  1.76s/it, lr: 1.0e-04 loss: 5.670e-01]  
windy_storm:  33%|###3      | 997/3000 [29:57<58:47,  1.76s/it, lr: 1.0e-04 loss: 5.670e-01]  
windy_storm:  33%|###3      | 997/3000 [30:00<58:47,  1.76s/it, lr: 1.0e-04 loss: 5.581e-01]
windy_storm:  33%|###3      | 997/3000 [30:00<58:47,  1.76s/it, lr: 1.0e-04 loss: 5.581e-01]
windy_storm:  33%|###3      | 998/3000 [30:00<1:10:28,  2.11s/it, lr: 1.0e-04 loss: 5.581e-01]
windy_storm:  33%|###3      | 998/3000 [30:00<1:10:28,  2.11s/it, lr: 1.0e-04 loss: 5.581e-01]
windy_storm:  33%|###3      | 998/3000 [30:01<1:10:28,  2.11s/it, lr: 1.0e-04 loss: 5.788e-01]
windy_storm:  33%|###3      | 998/3000 [30:01<1:10:28,  2.11s/it, lr: 1.0e-04 loss: 5.788e-01]
windy_storm:  33%|###3      | 999/3000 [30:01<57:16,  1.72s/it, lr: 1.0e-04 loss: 5.788e-01]  
windy_storm:  33%|###3      | 999/3000 [30:01<57:16,  1.72s/it, lr: 1.0e-04 loss: 5.788e-01]  
windy_storm:  33%|###3      | 999/3000 [30:04<57:16,  1.72s/it, lr: 1.0e-04 loss: 5.401e-01]
windy_storm:  33%|###3      | 999/3000 [30:04<57:16,  1.72s/it, lr: 1.0e-04 loss: 5.401e-01]
Saving at step 1000
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000001000.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt

windy_storm:  33%|###3      | 1000/3000 [30:06<57:15,  1.72s/it, lr: 1.0e-04 loss: 2.852e-01]
windy_storm:  33%|###3      | 1000/3000 [30:06<57:15,  1.72s/it, lr: 1.0e-04 loss: 2.852e-01]
windy_storm:  33%|###3      | 1001/3000 [30:06<44:53,  1.35s/it, lr: 1.0e-04 loss: 2.852e-01]
windy_storm:  33%|###3      | 1001/3000 [30:06<44:53,  1.35s/it, lr: 1.0e-04 loss: 2.852e-01]
windy_storm:  33%|###3      | 1001/3000 [30:07<44:53,  1.35s/it, lr: 1.0e-04 loss: 3.771e-01]
windy_storm:  33%|###3      | 1001/3000 [30:07<44:53,  1.35s/it, lr: 1.0e-04 loss: 3.771e-01]
windy_storm:  33%|###3      | 1002/3000 [30:07<46:42,  1.40s/it, lr: 1.0e-04 loss: 3.771e-01]
windy_storm:  33%|###3      | 1002/3000 [30:07<46:42,  1.40s/it, lr: 1.0e-04 loss: 3.771e-01]
windy_storm:  33%|###3      | 1002/3000 [30:08<46:42,  1.40s/it, lr: 1.0e-04 loss: 2.115e-01]
windy_storm:  33%|###3      | 1002/3000 [30:08<46:42,  1.40s/it, lr: 1.0e-04 loss: 2.115e-01]
windy_storm:  33%|###3      | 1003/3000 [30:08<41:06,  1.23s/it, lr: 1.0e-04 loss: 2.115e-01]
windy_storm:  33%|###3      | 1003/3000 [30:08<41:06,  1.23s/it, lr: 1.0e-04 loss: 2.115e-01]
windy_storm:  33%|###3      | 1003/3000 [30:10<41:06,  1.23s/it, lr: 1.0e-04 loss: 6.781e-01]
windy_storm:  33%|###3      | 1003/3000 [30:10<41:06,  1.23s/it, lr: 1.0e-04 loss: 6.781e-01]
windy_storm:  33%|###3      | 1004/3000 [30:10<44:16,  1.33s/it, lr: 1.0e-04 loss: 6.781e-01]
windy_storm:  33%|###3      | 1004/3000 [30:10<44:16,  1.33s/it, lr: 1.0e-04 loss: 6.781e-01]
windy_storm:  33%|###3      | 1004/3000 [30:11<44:16,  1.33s/it, lr: 1.0e-04 loss: 4.336e-01]
windy_storm:  33%|###3      | 1004/3000 [30:11<44:16,  1.33s/it, lr: 1.0e-04 loss: 4.336e-01]
windy_storm:  34%|###3      | 1005/3000 [30:11<39:32,  1.19s/it, lr: 1.0e-04 loss: 4.336e-01]
windy_storm:  34%|###3      | 1005/3000 [30:11<39:32,  1.19s/it, lr: 1.0e-04 loss: 4.336e-01]
windy_storm:  34%|###3      | 1005/3000 [30:14<39:32,  1.19s/it, lr: 1.0e-04 loss: 2.682e-02]
windy_storm:  34%|###3      | 1005/3000 [30:14<39:32,  1.19s/it, lr: 1.0e-04 loss: 2.682e-02]
windy_storm:  34%|###3      | 1006/3000 [30:14<56:21,  1.70s/it, lr: 1.0e-04 loss: 2.682e-02]
windy_storm:  34%|###3      | 1006/3000 [30:14<56:21,  1.70s/it, lr: 1.0e-04 loss: 2.682e-02]
windy_storm:  34%|###3      | 1006/3000 [30:15<56:21,  1.70s/it, lr: 1.0e-04 loss: 5.882e-01]
windy_storm:  34%|###3      | 1006/3000 [30:15<56:21,  1.70s/it, lr: 1.0e-04 loss: 5.882e-01]
windy_storm:  34%|###3      | 1007/3000 [30:15<54:58,  1.66s/it, lr: 1.0e-04 loss: 5.882e-01]
windy_storm:  34%|###3      | 1007/3000 [30:15<54:58,  1.66s/it, lr: 1.0e-04 loss: 5.882e-01]
windy_storm:  34%|###3      | 1007/3000 [30:17<54:58,  1.66s/it, lr: 1.0e-04 loss: 3.903e-01]
windy_storm:  34%|###3      | 1007/3000 [30:17<54:58,  1.66s/it, lr: 1.0e-04 loss: 3.903e-01]
windy_storm:  34%|###3      | 1008/3000 [30:17<54:16,  1.63s/it, lr: 1.0e-04 loss: 3.903e-01]
windy_storm:  34%|###3      | 1008/3000 [30:17<54:16,  1.63s/it, lr: 1.0e-04 loss: 3.903e-01]
windy_storm:  34%|###3      | 1008/3000 [30:20<54:16,  1.63s/it, lr: 1.0e-04 loss: 5.893e-01]
windy_storm:  34%|###3      | 1008/3000 [30:20<54:16,  1.63s/it, lr: 1.0e-04 loss: 5.893e-01]
windy_storm:  34%|###3      | 1009/3000 [30:20<1:07:01,  2.02s/it, lr: 1.0e-04 loss: 5.893e-01]
windy_storm:  34%|###3      | 1009/3000 [30:20<1:07:01,  2.02s/it, lr: 1.0e-04 loss: 5.893e-01]
windy_storm:  34%|###3      | 1009/3000 [30:20<1:07:01,  2.02s/it, lr: 1.0e-04 loss: 5.303e-01]
windy_storm:  34%|###3      | 1009/3000 [30:20<1:07:01,  2.02s/it, lr: 1.0e-04 loss: 5.303e-01]
windy_storm:  34%|###3      | 1010/3000 [30:23<1:06:59,  2.02s/it, lr: 1.0e-04 loss: 5.967e-01]
windy_storm:  34%|###3      | 1010/3000 [30:23<1:06:59,  2.02s/it, lr: 1.0e-04 loss: 5.967e-01]
windy_storm:  34%|###3      | 1011/3000 [30:23<59:10,  1.78s/it, lr: 1.0e-04 loss: 5.967e-01]  
windy_storm:  34%|###3      | 1011/3000 [30:23<59:10,  1.78s/it, lr: 1.0e-04 loss: 5.967e-01]  
windy_storm:  34%|###3      | 1011/3000 [30:25<59:10,  1.78s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  34%|###3      | 1011/3000 [30:25<59:10,  1.78s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  34%|###3      | 1012/3000 [30:25<57:19,  1.73s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  34%|###3      | 1012/3000 [30:25<57:19,  1.73s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  34%|###3      | 1012/3000 [30:26<57:19,  1.73s/it, lr: 1.0e-04 loss: 6.269e-01]
windy_storm:  34%|###3      | 1012/3000 [30:26<57:19,  1.73s/it, lr: 1.0e-04 loss: 6.269e-01]
windy_storm:  34%|###3      | 1013/3000 [30:26<51:00,  1.54s/it, lr: 1.0e-04 loss: 6.269e-01]
windy_storm:  34%|###3      | 1013/3000 [30:26<51:00,  1.54s/it, lr: 1.0e-04 loss: 6.269e-01]
windy_storm:  34%|###3      | 1013/3000 [30:27<51:00,  1.54s/it, lr: 1.0e-04 loss: 2.661e-01]
windy_storm:  34%|###3      | 1013/3000 [30:27<51:00,  1.54s/it, lr: 1.0e-04 loss: 2.661e-01]
windy_storm:  34%|###3      | 1014/3000 [30:27<43:59,  1.33s/it, lr: 1.0e-04 loss: 2.661e-01]
windy_storm:  34%|###3      | 1014/3000 [30:27<43:59,  1.33s/it, lr: 1.0e-04 loss: 2.661e-01]
windy_storm:  34%|###3      | 1014/3000 [30:28<43:59,  1.33s/it, lr: 1.0e-04 loss: 6.655e-01]
windy_storm:  34%|###3      | 1014/3000 [30:28<43:59,  1.33s/it, lr: 1.0e-04 loss: 6.655e-01]
windy_storm:  34%|###3      | 1015/3000 [30:28<39:20,  1.19s/it, lr: 1.0e-04 loss: 6.655e-01]
windy_storm:  34%|###3      | 1015/3000 [30:28<39:20,  1.19s/it, lr: 1.0e-04 loss: 6.655e-01]
windy_storm:  34%|###3      | 1015/3000 [30:28<39:20,  1.19s/it, lr: 1.0e-04 loss: 3.662e-01]
windy_storm:  34%|###3      | 1015/3000 [30:28<39:20,  1.19s/it, lr: 1.0e-04 loss: 3.662e-01]
windy_storm:  34%|###3      | 1016/3000 [30:28<35:57,  1.09s/it, lr: 1.0e-04 loss: 3.662e-01]
windy_storm:  34%|###3      | 1016/3000 [30:28<35:57,  1.09s/it, lr: 1.0e-04 loss: 3.662e-01]
windy_storm:  34%|###3      | 1016/3000 [30:29<35:57,  1.09s/it, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  34%|###3      | 1016/3000 [30:29<35:57,  1.09s/it, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  34%|###3      | 1017/3000 [30:29<32:49,  1.01it/s, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  34%|###3      | 1017/3000 [30:29<32:49,  1.01it/s, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  34%|###3      | 1017/3000 [30:31<32:49,  1.01it/s, lr: 1.0e-04 loss: 5.681e-01]
windy_storm:  34%|###3      | 1017/3000 [30:31<32:49,  1.01it/s, lr: 1.0e-04 loss: 5.681e-01]
windy_storm:  34%|###3      | 1018/3000 [30:31<38:27,  1.16s/it, lr: 1.0e-04 loss: 5.681e-01]
windy_storm:  34%|###3      | 1018/3000 [30:31<38:27,  1.16s/it, lr: 1.0e-04 loss: 5.681e-01]
windy_storm:  34%|###3      | 1018/3000 [30:32<38:27,  1.16s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  34%|###3      | 1018/3000 [30:32<38:27,  1.16s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  34%|###3      | 1019/3000 [30:32<42:33,  1.29s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  34%|###3      | 1019/3000 [30:32<42:33,  1.29s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  34%|###3      | 1019/3000 [30:35<42:33,  1.29s/it, lr: 1.0e-04 loss: 2.998e-01]
windy_storm:  34%|###3      | 1019/3000 [30:35<42:33,  1.29s/it, lr: 1.0e-04 loss: 2.998e-01]
windy_storm:  34%|###4      | 1020/3000 [30:37<42:31,  1.29s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm:  34%|###4      | 1020/3000 [30:37<42:31,  1.29s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm:  34%|###4      | 1021/3000 [30:37<34:58,  1.06s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm:  34%|###4      | 1021/3000 [30:37<34:58,  1.06s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm:  34%|###4      | 1021/3000 [30:38<34:58,  1.06s/it, lr: 1.0e-04 loss: 9.405e-02]
windy_storm:  34%|###4      | 1021/3000 [30:38<34:58,  1.06s/it, lr: 1.0e-04 loss: 9.405e-02]
windy_storm:  34%|###4      | 1022/3000 [30:39<39:13,  1.19s/it, lr: 1.0e-04 loss: 9.405e-02]
windy_storm:  34%|###4      | 1022/3000 [30:39<39:13,  1.19s/it, lr: 1.0e-04 loss: 9.405e-02]
windy_storm:  34%|###4      | 1022/3000 [30:40<39:13,  1.19s/it, lr: 1.0e-04 loss: 1.256e-01]
windy_storm:  34%|###4      | 1022/3000 [30:40<39:13,  1.19s/it, lr: 1.0e-04 loss: 1.256e-01]
windy_storm:  34%|###4      | 1023/3000 [30:40<42:39,  1.29s/it, lr: 1.0e-04 loss: 1.256e-01]
windy_storm:  34%|###4      | 1023/3000 [30:40<42:39,  1.29s/it, lr: 1.0e-04 loss: 1.256e-01]
windy_storm:  34%|###4      | 1023/3000 [30:41<42:39,  1.29s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  34%|###4      | 1023/3000 [30:41<42:39,  1.29s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  34%|###4      | 1024/3000 [30:41<37:49,  1.15s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  34%|###4      | 1024/3000 [30:41<37:49,  1.15s/it, lr: 1.0e-04 loss: 4.306e-01]
windy_storm:  34%|###4      | 1024/3000 [30:42<37:49,  1.15s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  34%|###4      | 1024/3000 [30:42<37:49,  1.15s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  34%|###4      | 1025/3000 [30:42<34:43,  1.05s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  34%|###4      | 1025/3000 [30:42<34:43,  1.05s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  34%|###4      | 1025/3000 [30:43<34:43,  1.05s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  34%|###4      | 1025/3000 [30:43<34:43,  1.05s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  34%|###4      | 1026/3000 [30:43<39:17,  1.19s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  34%|###4      | 1026/3000 [30:43<39:17,  1.19s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  34%|###4      | 1026/3000 [30:46<39:17,  1.19s/it, lr: 1.0e-04 loss: 5.584e-01]
windy_storm:  34%|###4      | 1026/3000 [30:46<39:17,  1.19s/it, lr: 1.0e-04 loss: 5.584e-01]
windy_storm:  34%|###4      | 1027/3000 [30:46<57:24,  1.75s/it, lr: 1.0e-04 loss: 5.584e-01]
windy_storm:  34%|###4      | 1027/3000 [30:46<57:24,  1.75s/it, lr: 1.0e-04 loss: 5.584e-01]
windy_storm:  34%|###4      | 1027/3000 [30:49<57:24,  1.75s/it, lr: 1.0e-04 loss: 6.225e-01]
windy_storm:  34%|###4      | 1027/3000 [30:49<57:24,  1.75s/it, lr: 1.0e-04 loss: 6.225e-01]
windy_storm:  34%|###4      | 1028/3000 [30:49<1:09:26,  2.11s/it, lr: 1.0e-04 loss: 6.225e-01]
windy_storm:  34%|###4      | 1028/3000 [30:49<1:09:26,  2.11s/it, lr: 1.0e-04 loss: 6.225e-01]
windy_storm:  34%|###4      | 1028/3000 [30:51<1:09:26,  2.11s/it, lr: 1.0e-04 loss: 1.400e-01]
windy_storm:  34%|###4      | 1028/3000 [30:51<1:09:26,  2.11s/it, lr: 1.0e-04 loss: 1.400e-01]
windy_storm:  34%|###4      | 1029/3000 [30:51<1:03:54,  1.95s/it, lr: 1.0e-04 loss: 1.400e-01]
windy_storm:  34%|###4      | 1029/3000 [30:51<1:03:54,  1.95s/it, lr: 1.0e-04 loss: 1.400e-01]
windy_storm:  34%|###4      | 1029/3000 [30:52<1:03:54,  1.95s/it, lr: 1.0e-04 loss: 5.066e-01]
windy_storm:  34%|###4      | 1029/3000 [30:52<1:03:54,  1.95s/it, lr: 1.0e-04 loss: 5.066e-01]
windy_storm:  34%|###4      | 1030/3000 [30:53<1:03:53,  1.95s/it, lr: 1.0e-04 loss: 4.757e-01]
windy_storm:  34%|###4      | 1030/3000 [30:53<1:03:53,  1.95s/it, lr: 1.0e-04 loss: 4.757e-01]
windy_storm:  34%|###4      | 1031/3000 [30:53<40:21,  1.23s/it, lr: 1.0e-04 loss: 4.757e-01]  
windy_storm:  34%|###4      | 1031/3000 [30:53<40:21,  1.23s/it, lr: 1.0e-04 loss: 4.757e-01]  
windy_storm:  34%|###4      | 1031/3000 [30:54<40:21,  1.23s/it, lr: 1.0e-04 loss: 5.982e-01]
windy_storm:  34%|###4      | 1031/3000 [30:54<40:21,  1.23s/it, lr: 1.0e-04 loss: 5.982e-01]
windy_storm:  34%|###4      | 1032/3000 [30:54<36:40,  1.12s/it, lr: 1.0e-04 loss: 5.982e-01]
windy_storm:  34%|###4      | 1032/3000 [30:54<36:40,  1.12s/it, lr: 1.0e-04 loss: 5.982e-01]
windy_storm:  34%|###4      | 1032/3000 [30:57<36:40,  1.12s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  34%|###4      | 1032/3000 [30:57<36:40,  1.12s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  34%|###4      | 1033/3000 [30:57<52:18,  1.60s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  34%|###4      | 1033/3000 [30:57<52:18,  1.60s/it, lr: 1.0e-04 loss: 3.920e-01]
windy_storm:  34%|###4      | 1033/3000 [30:58<52:18,  1.60s/it, lr: 1.0e-04 loss: 1.217e-01]
windy_storm:  34%|###4      | 1033/3000 [30:58<52:18,  1.60s/it, lr: 1.0e-04 loss: 1.217e-01]
windy_storm:  34%|###4      | 1034/3000 [30:58<45:24,  1.39s/it, lr: 1.0e-04 loss: 1.217e-01]
windy_storm:  34%|###4      | 1034/3000 [30:58<45:24,  1.39s/it, lr: 1.0e-04 loss: 1.217e-01]
windy_storm:  34%|###4      | 1034/3000 [31:01<45:24,  1.39s/it, lr: 1.0e-04 loss: 1.822e-01]
windy_storm:  34%|###4      | 1034/3000 [31:01<45:24,  1.39s/it, lr: 1.0e-04 loss: 1.822e-01]
windy_storm:  34%|###4      | 1035/3000 [31:01<59:21,  1.81s/it, lr: 1.0e-04 loss: 1.822e-01]
windy_storm:  34%|###4      | 1035/3000 [31:01<59:21,  1.81s/it, lr: 1.0e-04 loss: 1.822e-01]
windy_storm:  34%|###4      | 1035/3000 [31:04<59:21,  1.81s/it, lr: 1.0e-04 loss: 5.760e-01]
windy_storm:  34%|###4      | 1035/3000 [31:04<59:21,  1.81s/it, lr: 1.0e-04 loss: 5.760e-01]
windy_storm:  35%|###4      | 1036/3000 [31:04<1:10:29,  2.15s/it, lr: 1.0e-04 loss: 5.760e-01]
windy_storm:  35%|###4      | 1036/3000 [31:04<1:10:29,  2.15s/it, lr: 1.0e-04 loss: 5.760e-01]
windy_storm:  35%|###4      | 1036/3000 [31:05<1:10:29,  2.15s/it, lr: 1.0e-04 loss: 3.290e-01]
windy_storm:  35%|###4      | 1036/3000 [31:05<1:10:29,  2.15s/it, lr: 1.0e-04 loss: 3.290e-01]
windy_storm:  35%|###4      | 1037/3000 [31:05<57:50,  1.77s/it, lr: 1.0e-04 loss: 3.290e-01]  
windy_storm:  35%|###4      | 1037/3000 [31:05<57:50,  1.77s/it, lr: 1.0e-04 loss: 3.290e-01]  
windy_storm:  35%|###4      | 1037/3000 [31:06<57:50,  1.77s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:  35%|###4      | 1037/3000 [31:06<57:50,  1.77s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:  35%|###4      | 1038/3000 [31:06<56:06,  1.72s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:  35%|###4      | 1038/3000 [31:06<56:06,  1.72s/it, lr: 1.0e-04 loss: 2.067e-01]
windy_storm:  35%|###4      | 1038/3000 [31:08<56:06,  1.72s/it, lr: 1.0e-04 loss: 5.441e-01]
windy_storm:  35%|###4      | 1038/3000 [31:08<56:06,  1.72s/it, lr: 1.0e-04 loss: 5.441e-01]
windy_storm:  35%|###4      | 1039/3000 [31:08<54:47,  1.68s/it, lr: 1.0e-04 loss: 5.441e-01]
windy_storm:  35%|###4      | 1039/3000 [31:08<54:47,  1.68s/it, lr: 1.0e-04 loss: 5.441e-01]
windy_storm:  35%|###4      | 1039/3000 [31:08<54:47,  1.68s/it, lr: 1.0e-04 loss: 5.688e-01]
windy_storm:  35%|###4      | 1039/3000 [31:08<54:47,  1.68s/it, lr: 1.0e-04 loss: 5.688e-01]
windy_storm:  35%|###4      | 1040/3000 [31:09<54:46,  1.68s/it, lr: 1.0e-04 loss: 4.293e-01]
windy_storm:  35%|###4      | 1040/3000 [31:09<54:46,  1.68s/it, lr: 1.0e-04 loss: 4.293e-01]
windy_storm:  35%|###4      | 1041/3000 [31:09<37:15,  1.14s/it, lr: 1.0e-04 loss: 4.293e-01]
windy_storm:  35%|###4      | 1041/3000 [31:09<37:15,  1.14s/it, lr: 1.0e-04 loss: 4.293e-01]
windy_storm:  35%|###4      | 1041/3000 [31:10<37:15,  1.14s/it, lr: 1.0e-04 loss: 1.680e-01]
windy_storm:  35%|###4      | 1041/3000 [31:10<37:15,  1.14s/it, lr: 1.0e-04 loss: 1.680e-01]
windy_storm:  35%|###4      | 1042/3000 [31:10<34:17,  1.05s/it, lr: 1.0e-04 loss: 1.680e-01]
windy_storm:  35%|###4      | 1042/3000 [31:10<34:17,  1.05s/it, lr: 1.0e-04 loss: 1.680e-01]
windy_storm:  35%|###4      | 1042/3000 [31:13<34:17,  1.05s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  35%|###4      | 1042/3000 [31:13<34:17,  1.05s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  35%|###4      | 1043/3000 [31:13<50:14,  1.54s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  35%|###4      | 1043/3000 [31:13<50:14,  1.54s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  35%|###4      | 1043/3000 [31:14<50:14,  1.54s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  35%|###4      | 1043/3000 [31:14<50:14,  1.54s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  35%|###4      | 1044/3000 [31:14<43:10,  1.32s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  35%|###4      | 1044/3000 [31:14<43:10,  1.32s/it, lr: 1.0e-04 loss: 3.915e-01]
windy_storm:  35%|###4      | 1044/3000 [31:17<43:10,  1.32s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  35%|###4      | 1044/3000 [31:17<43:10,  1.32s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  35%|###4      | 1045/3000 [31:17<58:29,  1.80s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  35%|###4      | 1045/3000 [31:17<58:29,  1.80s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  35%|###4      | 1045/3000 [31:19<58:29,  1.80s/it, lr: 1.0e-04 loss: 3.978e-01]
windy_storm:  35%|###4      | 1045/3000 [31:19<58:29,  1.80s/it, lr: 1.0e-04 loss: 3.978e-01]
windy_storm:  35%|###4      | 1046/3000 [31:19<56:36,  1.74s/it, lr: 1.0e-04 loss: 3.978e-01]
windy_storm:  35%|###4      | 1046/3000 [31:19<56:36,  1.74s/it, lr: 1.0e-04 loss: 3.978e-01]
windy_storm:  35%|###4      | 1046/3000 [31:20<56:36,  1.74s/it, lr: 1.0e-04 loss: 6.539e-01]
windy_storm:  35%|###4      | 1046/3000 [31:20<56:36,  1.74s/it, lr: 1.0e-04 loss: 6.539e-01]
windy_storm:  35%|###4      | 1047/3000 [31:20<54:34,  1.68s/it, lr: 1.0e-04 loss: 6.539e-01]
windy_storm:  35%|###4      | 1047/3000 [31:20<54:34,  1.68s/it, lr: 1.0e-04 loss: 6.539e-01]
windy_storm:  35%|###4      | 1047/3000 [31:23<54:34,  1.68s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  35%|###4      | 1047/3000 [31:23<54:34,  1.68s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  35%|###4      | 1048/3000 [31:23<1:06:46,  2.05s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  35%|###4      | 1048/3000 [31:23<1:06:46,  2.05s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  35%|###4      | 1048/3000 [31:25<1:06:46,  2.05s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:  35%|###4      | 1048/3000 [31:25<1:06:46,  2.05s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:  35%|###4      | 1049/3000 [31:25<1:02:23,  1.92s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:  35%|###4      | 1049/3000 [31:25<1:02:23,  1.92s/it, lr: 1.0e-04 loss: 4.271e-01]
windy_storm:  35%|###4      | 1049/3000 [31:28<1:02:23,  1.92s/it, lr: 1.0e-04 loss: 5.371e-01]
windy_storm:  35%|###4      | 1049/3000 [31:28<1:02:23,  1.92s/it, lr: 1.0e-04 loss: 5.371e-01]
windy_storm:  35%|###5      | 1050/3000 [31:28<1:02:21,  1.92s/it, lr: 1.0e-04 loss: 4.742e-01]
windy_storm:  35%|###5      | 1050/3000 [31:28<1:02:21,  1.92s/it, lr: 1.0e-04 loss: 4.742e-01]
windy_storm:  35%|###5      | 1051/3000 [31:28<39:57,  1.23s/it, lr: 1.0e-04 loss: 4.742e-01]  
windy_storm:  35%|###5      | 1051/3000 [31:28<39:57,  1.23s/it, lr: 1.0e-04 loss: 4.742e-01]  
windy_storm:  35%|###5      | 1051/3000 [31:29<39:57,  1.23s/it, lr: 1.0e-04 loss: 4.391e-01]
windy_storm:  35%|###5      | 1051/3000 [31:29<39:57,  1.23s/it, lr: 1.0e-04 loss: 4.391e-01]
windy_storm:  35%|###5      | 1052/3000 [31:29<36:42,  1.13s/it, lr: 1.0e-04 loss: 4.391e-01]
windy_storm:  35%|###5      | 1052/3000 [31:29<36:42,  1.13s/it, lr: 1.0e-04 loss: 4.391e-01]
windy_storm:  35%|###5      | 1052/3000 [31:32<36:42,  1.13s/it, lr: 1.0e-04 loss: 6.810e-01]
windy_storm:  35%|###5      | 1052/3000 [31:32<36:42,  1.13s/it, lr: 1.0e-04 loss: 6.810e-01]
windy_storm:  35%|###5      | 1053/3000 [31:32<51:58,  1.60s/it, lr: 1.0e-04 loss: 6.810e-01]
windy_storm:  35%|###5      | 1053/3000 [31:32<51:58,  1.60s/it, lr: 1.0e-04 loss: 6.810e-01]
windy_storm:  35%|###5      | 1053/3000 [31:34<51:58,  1.60s/it, lr: 1.0e-04 loss: 1.136e-01]
windy_storm:  35%|###5      | 1053/3000 [31:34<51:58,  1.60s/it, lr: 1.0e-04 loss: 1.136e-01]
windy_storm:  35%|###5      | 1054/3000 [31:34<53:20,  1.64s/it, lr: 1.0e-04 loss: 1.136e-01]
windy_storm:  35%|###5      | 1054/3000 [31:34<53:20,  1.64s/it, lr: 1.0e-04 loss: 1.136e-01]
windy_storm:  35%|###5      | 1054/3000 [31:37<53:20,  1.64s/it, lr: 1.0e-04 loss: 2.517e-01]
windy_storm:  35%|###5      | 1054/3000 [31:37<53:20,  1.64s/it, lr: 1.0e-04 loss: 2.517e-01]
windy_storm:  35%|###5      | 1055/3000 [31:37<1:05:49,  2.03s/it, lr: 1.0e-04 loss: 2.517e-01]
windy_storm:  35%|###5      | 1055/3000 [31:37<1:05:49,  2.03s/it, lr: 1.0e-04 loss: 2.517e-01]
windy_storm:  35%|###5      | 1055/3000 [31:39<1:05:49,  2.03s/it, lr: 1.0e-04 loss: 5.820e-01]
windy_storm:  35%|###5      | 1055/3000 [31:39<1:05:49,  2.03s/it, lr: 1.0e-04 loss: 5.820e-01]
windy_storm:  35%|###5      | 1056/3000 [31:39<1:01:51,  1.91s/it, lr: 1.0e-04 loss: 5.820e-01]
windy_storm:  35%|###5      | 1056/3000 [31:39<1:01:51,  1.91s/it, lr: 1.0e-04 loss: 5.820e-01]
windy_storm:  35%|###5      | 1056/3000 [31:42<1:01:51,  1.91s/it, lr: 1.0e-04 loss: 1.721e-01]
windy_storm:  35%|###5      | 1056/3000 [31:42<1:01:51,  1.91s/it, lr: 1.0e-04 loss: 1.721e-01]
windy_storm:  35%|###5      | 1057/3000 [31:42<1:11:37,  2.21s/it, lr: 1.0e-04 loss: 1.721e-01]
windy_storm:  35%|###5      | 1057/3000 [31:42<1:11:37,  2.21s/it, lr: 1.0e-04 loss: 1.721e-01]
windy_storm:  35%|###5      | 1057/3000 [31:43<1:11:37,  2.21s/it, lr: 1.0e-04 loss: 6.322e-01]
windy_storm:  35%|###5      | 1057/3000 [31:43<1:11:37,  2.21s/it, lr: 1.0e-04 loss: 6.322e-01]
windy_storm:  35%|###5      | 1058/3000 [31:43<1:05:25,  2.02s/it, lr: 1.0e-04 loss: 6.322e-01]
windy_storm:  35%|###5      | 1058/3000 [31:43<1:05:25,  2.02s/it, lr: 1.0e-04 loss: 6.322e-01]
windy_storm:  35%|###5      | 1058/3000 [31:44<1:05:25,  2.02s/it, lr: 1.0e-04 loss: 7.140e-01]
windy_storm:  35%|###5      | 1058/3000 [31:44<1:05:25,  2.02s/it, lr: 1.0e-04 loss: 7.140e-01]
windy_storm:  35%|###5      | 1059/3000 [31:44<53:13,  1.65s/it, lr: 1.0e-04 loss: 7.140e-01]  
windy_storm:  35%|###5      | 1059/3000 [31:44<53:13,  1.65s/it, lr: 1.0e-04 loss: 7.140e-01]  
windy_storm:  35%|###5      | 1059/3000 [31:45<53:13,  1.65s/it, lr: 1.0e-04 loss: 5.609e-01]
windy_storm:  35%|###5      | 1059/3000 [31:45<53:13,  1.65s/it, lr: 1.0e-04 loss: 5.609e-01]
windy_storm:  35%|###5      | 1060/3000 [31:47<53:11,  1.65s/it, lr: 1.0e-04 loss: 3.901e-02]
windy_storm:  35%|###5      | 1060/3000 [31:47<53:11,  1.65s/it, lr: 1.0e-04 loss: 3.901e-02]
windy_storm:  35%|###5      | 1061/3000 [31:47<40:24,  1.25s/it, lr: 1.0e-04 loss: 3.901e-02]
windy_storm:  35%|###5      | 1061/3000 [31:47<40:24,  1.25s/it, lr: 1.0e-04 loss: 3.901e-02]
windy_storm:  35%|###5      | 1061/3000 [31:50<40:24,  1.25s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  35%|###5      | 1061/3000 [31:50<40:24,  1.25s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  35%|###5      | 1062/3000 [31:50<54:08,  1.68s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  35%|###5      | 1062/3000 [31:50<54:08,  1.68s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  35%|###5      | 1062/3000 [31:51<54:08,  1.68s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  35%|###5      | 1062/3000 [31:51<54:08,  1.68s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  35%|###5      | 1063/3000 [31:51<46:59,  1.46s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  35%|###5      | 1063/3000 [31:51<46:59,  1.46s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  35%|###5      | 1063/3000 [31:52<46:59,  1.46s/it, lr: 1.0e-04 loss: 5.835e-01]
windy_storm:  35%|###5      | 1063/3000 [31:52<46:59,  1.46s/it, lr: 1.0e-04 loss: 5.835e-01]
windy_storm:  35%|###5      | 1064/3000 [31:52<48:19,  1.50s/it, lr: 1.0e-04 loss: 5.835e-01]
windy_storm:  35%|###5      | 1064/3000 [31:52<48:19,  1.50s/it, lr: 1.0e-04 loss: 5.835e-01]
windy_storm:  35%|###5      | 1064/3000 [31:55<48:19,  1.50s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  35%|###5      | 1064/3000 [31:55<48:19,  1.50s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  36%|###5      | 1065/3000 [31:56<1:02:16,  1.93s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  36%|###5      | 1065/3000 [31:56<1:02:16,  1.93s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  36%|###5      | 1065/3000 [31:57<1:02:16,  1.93s/it, lr: 1.0e-04 loss: 2.023e-01]
windy_storm:  36%|###5      | 1065/3000 [31:57<1:02:16,  1.93s/it, lr: 1.0e-04 loss: 2.023e-01]
windy_storm:  36%|###5      | 1066/3000 [31:57<58:53,  1.83s/it, lr: 1.0e-04 loss: 2.023e-01]  
windy_storm:  36%|###5      | 1066/3000 [31:57<58:53,  1.83s/it, lr: 1.0e-04 loss: 2.023e-01]  
windy_storm:  36%|###5      | 1066/3000 [32:00<58:53,  1.83s/it, lr: 1.0e-04 loss: 5.707e-01]
windy_storm:  36%|###5      | 1066/3000 [32:00<58:53,  1.83s/it, lr: 1.0e-04 loss: 5.707e-01]
windy_storm:  36%|###5      | 1067/3000 [32:00<1:10:12,  2.18s/it, lr: 1.0e-04 loss: 5.707e-01]
windy_storm:  36%|###5      | 1067/3000 [32:00<1:10:12,  2.18s/it, lr: 1.0e-04 loss: 5.707e-01]
windy_storm:  36%|###5      | 1067/3000 [32:01<1:10:12,  2.18s/it, lr: 1.0e-04 loss: 5.505e-01]
windy_storm:  36%|###5      | 1067/3000 [32:01<1:10:12,  2.18s/it, lr: 1.0e-04 loss: 5.505e-01]
windy_storm:  36%|###5      | 1068/3000 [32:01<57:27,  1.78s/it, lr: 1.0e-04 loss: 5.505e-01]  
windy_storm:  36%|###5      | 1068/3000 [32:01<57:27,  1.78s/it, lr: 1.0e-04 loss: 5.505e-01]  
windy_storm:  36%|###5      | 1068/3000 [32:03<57:27,  1.78s/it, lr: 1.0e-04 loss: 6.058e-02]
windy_storm:  36%|###5      | 1068/3000 [32:03<57:27,  1.78s/it, lr: 1.0e-04 loss: 6.058e-02]
windy_storm:  36%|###5      | 1069/3000 [32:03<55:44,  1.73s/it, lr: 1.0e-04 loss: 6.058e-02]
windy_storm:  36%|###5      | 1069/3000 [32:03<55:44,  1.73s/it, lr: 1.0e-04 loss: 6.058e-02]
windy_storm:  36%|###5      | 1069/3000 [32:06<55:44,  1.73s/it, lr: 1.0e-04 loss: 1.945e-01]
windy_storm:  36%|###5      | 1069/3000 [32:06<55:44,  1.73s/it, lr: 1.0e-04 loss: 1.945e-01]
windy_storm:  36%|###5      | 1070/3000 [32:09<55:42,  1.73s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  36%|###5      | 1070/3000 [32:09<55:42,  1.73s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  36%|###5      | 1071/3000 [32:09<52:04,  1.62s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  36%|###5      | 1071/3000 [32:09<52:04,  1.62s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  36%|###5      | 1071/3000 [32:10<52:04,  1.62s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  36%|###5      | 1071/3000 [32:10<52:04,  1.62s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  36%|###5      | 1072/3000 [32:10<51:42,  1.61s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  36%|###5      | 1072/3000 [32:10<51:42,  1.61s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  36%|###5      | 1072/3000 [32:13<51:42,  1.61s/it, lr: 1.0e-04 loss: 6.368e-01]
windy_storm:  36%|###5      | 1072/3000 [32:13<51:42,  1.61s/it, lr: 1.0e-04 loss: 6.368e-01]
windy_storm:  36%|###5      | 1073/3000 [32:13<1:02:55,  1.96s/it, lr: 1.0e-04 loss: 6.368e-01]
windy_storm:  36%|###5      | 1073/3000 [32:13<1:02:55,  1.96s/it, lr: 1.0e-04 loss: 6.368e-01]
windy_storm:  36%|###5      | 1073/3000 [32:14<1:02:55,  1.96s/it, lr: 1.0e-04 loss: 2.809e-01]
windy_storm:  36%|###5      | 1073/3000 [32:14<1:02:55,  1.96s/it, lr: 1.0e-04 loss: 2.809e-01]
windy_storm:  36%|###5      | 1074/3000 [32:14<52:32,  1.64s/it, lr: 1.0e-04 loss: 2.809e-01]  
windy_storm:  36%|###5      | 1074/3000 [32:14<52:32,  1.64s/it, lr: 1.0e-04 loss: 2.809e-01]  
windy_storm:  36%|###5      | 1074/3000 [32:17<52:32,  1.64s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  36%|###5      | 1074/3000 [32:17<52:32,  1.64s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  36%|###5      | 1075/3000 [32:17<1:04:23,  2.01s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  36%|###5      | 1075/3000 [32:17<1:04:23,  2.01s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  36%|###5      | 1075/3000 [32:20<1:04:23,  2.01s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  36%|###5      | 1075/3000 [32:20<1:04:23,  2.01s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  36%|###5      | 1076/3000 [32:20<1:13:40,  2.30s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  36%|###5      | 1076/3000 [32:20<1:13:40,  2.30s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  36%|###5      | 1076/3000 [32:21<1:13:40,  2.30s/it, lr: 1.0e-04 loss: 4.326e-01]
windy_storm:  36%|###5      | 1076/3000 [32:21<1:13:40,  2.30s/it, lr: 1.0e-04 loss: 4.326e-01]
windy_storm:  36%|###5      | 1077/3000 [32:21<1:07:04,  2.09s/it, lr: 1.0e-04 loss: 4.326e-01]
windy_storm:  36%|###5      | 1077/3000 [32:21<1:07:04,  2.09s/it, lr: 1.0e-04 loss: 4.326e-01]
windy_storm:  36%|###5      | 1077/3000 [32:22<1:07:04,  2.09s/it, lr: 1.0e-04 loss: 3.020e-01]
windy_storm:  36%|###5      | 1077/3000 [32:22<1:07:04,  2.09s/it, lr: 1.0e-04 loss: 3.020e-01]
windy_storm:  36%|###5      | 1078/3000 [32:22<54:35,  1.70s/it, lr: 1.0e-04 loss: 3.020e-01]  
windy_storm:  36%|###5      | 1078/3000 [32:22<54:35,  1.70s/it, lr: 1.0e-04 loss: 3.020e-01]  
windy_storm:  36%|###5      | 1078/3000 [32:24<54:35,  1.70s/it, lr: 1.0e-04 loss: 4.833e-01]
windy_storm:  36%|###5      | 1078/3000 [32:24<54:35,  1.70s/it, lr: 1.0e-04 loss: 4.833e-01]
windy_storm:  36%|###5      | 1079/3000 [32:24<53:19,  1.67s/it, lr: 1.0e-04 loss: 4.833e-01]
windy_storm:  36%|###5      | 1079/3000 [32:24<53:19,  1.67s/it, lr: 1.0e-04 loss: 4.833e-01]
windy_storm:  36%|###5      | 1079/3000 [32:27<53:19,  1.67s/it, lr: 1.0e-04 loss: 3.326e-01]
windy_storm:  36%|###5      | 1079/3000 [32:27<53:19,  1.67s/it, lr: 1.0e-04 loss: 3.326e-01]
windy_storm:  36%|###6      | 1080/3000 [32:29<53:17,  1.67s/it, lr: 1.0e-04 loss: 6.124e-01]
windy_storm:  36%|###6      | 1080/3000 [32:29<53:17,  1.67s/it, lr: 1.0e-04 loss: 6.124e-01]
windy_storm:  36%|###6      | 1081/3000 [32:29<40:34,  1.27s/it, lr: 1.0e-04 loss: 6.124e-01]
windy_storm:  36%|###6      | 1081/3000 [32:29<40:34,  1.27s/it, lr: 1.0e-04 loss: 6.124e-01]
windy_storm:  36%|###6      | 1081/3000 [32:32<40:34,  1.27s/it, lr: 1.0e-04 loss: 4.099e-01]
windy_storm:  36%|###6      | 1081/3000 [32:32<40:34,  1.27s/it, lr: 1.0e-04 loss: 4.099e-01]
windy_storm:  36%|###6      | 1082/3000 [32:32<54:36,  1.71s/it, lr: 1.0e-04 loss: 4.099e-01]
windy_storm:  36%|###6      | 1082/3000 [32:32<54:36,  1.71s/it, lr: 1.0e-04 loss: 4.099e-01]
windy_storm:  36%|###6      | 1082/3000 [32:33<54:36,  1.71s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  36%|###6      | 1082/3000 [32:33<54:36,  1.71s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  36%|###6      | 1083/3000 [32:33<46:55,  1.47s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  36%|###6      | 1083/3000 [32:33<46:55,  1.47s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  36%|###6      | 1083/3000 [32:34<46:55,  1.47s/it, lr: 1.0e-04 loss: 5.940e-02]
windy_storm:  36%|###6      | 1083/3000 [32:34<46:55,  1.47s/it, lr: 1.0e-04 loss: 5.940e-02]
windy_storm:  36%|###6      | 1084/3000 [32:34<47:26,  1.49s/it, lr: 1.0e-04 loss: 5.940e-02]
windy_storm:  36%|###6      | 1084/3000 [32:34<47:26,  1.49s/it, lr: 1.0e-04 loss: 5.940e-02]
windy_storm:  36%|###6      | 1084/3000 [32:36<47:26,  1.49s/it, lr: 1.0e-04 loss: 6.391e-01]
windy_storm:  36%|###6      | 1084/3000 [32:36<47:26,  1.49s/it, lr: 1.0e-04 loss: 6.391e-01]
windy_storm:  36%|###6      | 1085/3000 [32:36<48:36,  1.52s/it, lr: 1.0e-04 loss: 6.391e-01]
windy_storm:  36%|###6      | 1085/3000 [32:36<48:36,  1.52s/it, lr: 1.0e-04 loss: 6.391e-01]
windy_storm:  36%|###6      | 1085/3000 [32:39<48:36,  1.52s/it, lr: 1.0e-04 loss: 5.197e-01]
windy_storm:  36%|###6      | 1085/3000 [32:39<48:36,  1.52s/it, lr: 1.0e-04 loss: 5.197e-01]
windy_storm:  36%|###6      | 1086/3000 [32:39<1:02:27,  1.96s/it, lr: 1.0e-04 loss: 5.197e-01]
windy_storm:  36%|###6      | 1086/3000 [32:39<1:02:27,  1.96s/it, lr: 1.0e-04 loss: 5.197e-01]
windy_storm:  36%|###6      | 1086/3000 [32:40<1:02:27,  1.96s/it, lr: 1.0e-04 loss: 6.479e-01]
windy_storm:  36%|###6      | 1086/3000 [32:40<1:02:27,  1.96s/it, lr: 1.0e-04 loss: 6.479e-01]
windy_storm:  36%|###6      | 1087/3000 [32:40<51:26,  1.61s/it, lr: 1.0e-04 loss: 6.479e-01]  
windy_storm:  36%|###6      | 1087/3000 [32:40<51:26,  1.61s/it, lr: 1.0e-04 loss: 6.479e-01]  
windy_storm:  36%|###6      | 1087/3000 [32:43<51:26,  1.61s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  36%|###6      | 1087/3000 [32:43<51:26,  1.61s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  36%|###6      | 1088/3000 [32:43<1:04:08,  2.01s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  36%|###6      | 1088/3000 [32:43<1:04:08,  2.01s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  36%|###6      | 1088/3000 [32:46<1:04:08,  2.01s/it, lr: 1.0e-04 loss: 8.385e-02]
windy_storm:  36%|###6      | 1088/3000 [32:46<1:04:08,  2.01s/it, lr: 1.0e-04 loss: 8.385e-02]
windy_storm:  36%|###6      | 1089/3000 [32:46<1:12:38,  2.28s/it, lr: 1.0e-04 loss: 8.385e-02]
windy_storm:  36%|###6      | 1089/3000 [32:46<1:12:38,  2.28s/it, lr: 1.0e-04 loss: 8.385e-02]
windy_storm:  36%|###6      | 1089/3000 [32:47<1:12:38,  2.28s/it, lr: 1.0e-04 loss: 3.892e-01]
windy_storm:  36%|###6      | 1089/3000 [32:47<1:12:38,  2.28s/it, lr: 1.0e-04 loss: 3.892e-01]
windy_storm:  36%|###6      | 1090/3000 [32:49<1:12:36,  2.28s/it, lr: 1.0e-04 loss: 2.289e-01]
windy_storm:  36%|###6      | 1090/3000 [32:49<1:12:36,  2.28s/it, lr: 1.0e-04 loss: 2.289e-01]
windy_storm:  36%|###6      | 1091/3000 [32:49<51:01,  1.60s/it, lr: 1.0e-04 loss: 2.289e-01]  
windy_storm:  36%|###6      | 1091/3000 [32:49<51:01,  1.60s/it, lr: 1.0e-04 loss: 2.289e-01]  
windy_storm:  36%|###6      | 1091/3000 [32:50<51:01,  1.60s/it, lr: 1.0e-04 loss: 3.468e-01]
windy_storm:  36%|###6      | 1091/3000 [32:50<51:01,  1.60s/it, lr: 1.0e-04 loss: 3.468e-01]
windy_storm:  36%|###6      | 1092/3000 [32:50<45:01,  1.42s/it, lr: 1.0e-04 loss: 3.468e-01]
windy_storm:  36%|###6      | 1092/3000 [32:50<45:01,  1.42s/it, lr: 1.0e-04 loss: 3.468e-01]
windy_storm:  36%|###6      | 1092/3000 [32:53<45:01,  1.42s/it, lr: 1.0e-04 loss: 3.003e-01]
windy_storm:  36%|###6      | 1092/3000 [32:53<45:01,  1.42s/it, lr: 1.0e-04 loss: 3.003e-01]
windy_storm:  36%|###6      | 1093/3000 [32:53<58:17,  1.83s/it, lr: 1.0e-04 loss: 3.003e-01]
windy_storm:  36%|###6      | 1093/3000 [32:53<58:17,  1.83s/it, lr: 1.0e-04 loss: 3.003e-01]
windy_storm:  36%|###6      | 1093/3000 [32:54<58:17,  1.83s/it, lr: 1.0e-04 loss: 4.803e-01]
windy_storm:  36%|###6      | 1093/3000 [32:54<58:17,  1.83s/it, lr: 1.0e-04 loss: 4.803e-01]
windy_storm:  36%|###6      | 1094/3000 [32:54<51:56,  1.63s/it, lr: 1.0e-04 loss: 4.803e-01]
windy_storm:  36%|###6      | 1094/3000 [32:54<51:56,  1.63s/it, lr: 1.0e-04 loss: 4.803e-01]
windy_storm:  36%|###6      | 1094/3000 [32:55<51:56,  1.63s/it, lr: 1.0e-04 loss: 5.645e-01]
windy_storm:  36%|###6      | 1094/3000 [32:55<51:56,  1.63s/it, lr: 1.0e-04 loss: 5.645e-01]
windy_storm:  36%|###6      | 1095/3000 [32:55<51:13,  1.61s/it, lr: 1.0e-04 loss: 5.645e-01]
windy_storm:  36%|###6      | 1095/3000 [32:55<51:13,  1.61s/it, lr: 1.0e-04 loss: 5.645e-01]
windy_storm:  36%|###6      | 1095/3000 [32:58<51:13,  1.61s/it, lr: 1.0e-04 loss: 1.062e-01]
windy_storm:  36%|###6      | 1095/3000 [32:58<51:13,  1.61s/it, lr: 1.0e-04 loss: 1.062e-01]
windy_storm:  37%|###6      | 1096/3000 [32:58<1:03:56,  2.02s/it, lr: 1.0e-04 loss: 1.062e-01]
windy_storm:  37%|###6      | 1096/3000 [32:58<1:03:56,  2.02s/it, lr: 1.0e-04 loss: 1.062e-01]
windy_storm:  37%|###6      | 1096/3000 [33:02<1:03:56,  2.02s/it, lr: 1.0e-04 loss: 4.726e-01]
windy_storm:  37%|###6      | 1096/3000 [33:02<1:03:56,  2.02s/it, lr: 1.0e-04 loss: 4.726e-01]
windy_storm:  37%|###6      | 1097/3000 [33:02<1:13:09,  2.31s/it, lr: 1.0e-04 loss: 4.726e-01]
windy_storm:  37%|###6      | 1097/3000 [33:02<1:13:09,  2.31s/it, lr: 1.0e-04 loss: 4.726e-01]
windy_storm:  37%|###6      | 1097/3000 [33:02<1:13:09,  2.31s/it, lr: 1.0e-04 loss: 4.918e-01]
windy_storm:  37%|###6      | 1097/3000 [33:02<1:13:09,  2.31s/it, lr: 1.0e-04 loss: 4.918e-01]
windy_storm:  37%|###6      | 1098/3000 [33:02<58:51,  1.86s/it, lr: 1.0e-04 loss: 4.918e-01]  
windy_storm:  37%|###6      | 1098/3000 [33:02<58:51,  1.86s/it, lr: 1.0e-04 loss: 4.918e-01]  
windy_storm:  37%|###6      | 1098/3000 [33:03<58:51,  1.86s/it, lr: 1.0e-04 loss: 4.762e-01]
windy_storm:  37%|###6      | 1098/3000 [33:03<58:51,  1.86s/it, lr: 1.0e-04 loss: 4.762e-01]
windy_storm:  37%|###6      | 1099/3000 [33:03<48:36,  1.53s/it, lr: 1.0e-04 loss: 4.762e-01]
windy_storm:  37%|###6      | 1099/3000 [33:03<48:36,  1.53s/it, lr: 1.0e-04 loss: 4.762e-01]
windy_storm:  37%|###6      | 1099/3000 [33:04<48:36,  1.53s/it, lr: 1.0e-04 loss: 7.045e-01]
windy_storm:  37%|###6      | 1099/3000 [33:04<48:36,  1.53s/it, lr: 1.0e-04 loss: 7.045e-01]
windy_storm:  37%|###6      | 1100/3000 [33:07<48:34,  1.53s/it, lr: 1.0e-04 loss: 6.308e-01]
windy_storm:  37%|###6      | 1100/3000 [33:07<48:34,  1.53s/it, lr: 1.0e-04 loss: 6.308e-01]
windy_storm:  37%|###6      | 1101/3000 [33:07<48:03,  1.52s/it, lr: 1.0e-04 loss: 6.308e-01]
windy_storm:  37%|###6      | 1101/3000 [33:07<48:03,  1.52s/it, lr: 1.0e-04 loss: 6.308e-01]
windy_storm:  37%|###6      | 1101/3000 [33:08<48:03,  1.52s/it, lr: 1.0e-04 loss: 6.482e-01]
windy_storm:  37%|###6      | 1101/3000 [33:08<48:03,  1.52s/it, lr: 1.0e-04 loss: 6.482e-01]
windy_storm:  37%|###6      | 1102/3000 [33:08<48:33,  1.54s/it, lr: 1.0e-04 loss: 6.482e-01]
windy_storm:  37%|###6      | 1102/3000 [33:08<48:33,  1.54s/it, lr: 1.0e-04 loss: 6.482e-01]
windy_storm:  37%|###6      | 1102/3000 [33:11<48:33,  1.54s/it, lr: 1.0e-04 loss: 2.419e-01]
windy_storm:  37%|###6      | 1102/3000 [33:11<48:33,  1.54s/it, lr: 1.0e-04 loss: 2.419e-01]
windy_storm:  37%|###6      | 1103/3000 [33:11<1:00:47,  1.92s/it, lr: 1.0e-04 loss: 2.419e-01]
windy_storm:  37%|###6      | 1103/3000 [33:11<1:00:47,  1.92s/it, lr: 1.0e-04 loss: 2.419e-01]
windy_storm:  37%|###6      | 1103/3000 [33:14<1:00:47,  1.92s/it, lr: 1.0e-04 loss: 7.287e-01]
windy_storm:  37%|###6      | 1103/3000 [33:14<1:00:47,  1.92s/it, lr: 1.0e-04 loss: 7.287e-01]
windy_storm:  37%|###6      | 1104/3000 [33:15<1:10:04,  2.22s/it, lr: 1.0e-04 loss: 7.287e-01]
windy_storm:  37%|###6      | 1104/3000 [33:15<1:10:04,  2.22s/it, lr: 1.0e-04 loss: 7.287e-01]
windy_storm:  37%|###6      | 1104/3000 [33:16<1:10:04,  2.22s/it, lr: 1.0e-04 loss: 7.240e-01]
windy_storm:  37%|###6      | 1104/3000 [33:16<1:10:04,  2.22s/it, lr: 1.0e-04 loss: 7.240e-01]
windy_storm:  37%|###6      | 1105/3000 [33:16<1:04:33,  2.04s/it, lr: 1.0e-04 loss: 7.240e-01]
windy_storm:  37%|###6      | 1105/3000 [33:16<1:04:33,  2.04s/it, lr: 1.0e-04 loss: 7.240e-01]
windy_storm:  37%|###6      | 1105/3000 [33:19<1:04:33,  2.04s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  37%|###6      | 1105/3000 [33:19<1:04:33,  2.04s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  37%|###6      | 1106/3000 [33:19<1:13:16,  2.32s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  37%|###6      | 1106/3000 [33:19<1:13:16,  2.32s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  37%|###6      | 1106/3000 [33:20<1:13:16,  2.32s/it, lr: 1.0e-04 loss: 4.863e-01]
windy_storm:  37%|###6      | 1106/3000 [33:20<1:13:16,  2.32s/it, lr: 1.0e-04 loss: 4.863e-01]
windy_storm:  37%|###6      | 1107/3000 [33:20<59:37,  1.89s/it, lr: 1.0e-04 loss: 4.863e-01]  
windy_storm:  37%|###6      | 1107/3000 [33:20<59:37,  1.89s/it, lr: 1.0e-04 loss: 4.863e-01]  
windy_storm:  37%|###6      | 1107/3000 [33:23<59:37,  1.89s/it, lr: 1.0e-04 loss: 1.091e-01]
windy_storm:  37%|###6      | 1107/3000 [33:23<59:37,  1.89s/it, lr: 1.0e-04 loss: 1.091e-01]
windy_storm:  37%|###6      | 1108/3000 [33:23<1:11:02,  2.25s/it, lr: 1.0e-04 loss: 1.091e-01]
windy_storm:  37%|###6      | 1108/3000 [33:23<1:11:02,  2.25s/it, lr: 1.0e-04 loss: 1.091e-01]
windy_storm:  37%|###6      | 1108/3000 [33:26<1:11:02,  2.25s/it, lr: 1.0e-04 loss: 4.900e-01]
windy_storm:  37%|###6      | 1108/3000 [33:26<1:11:02,  2.25s/it, lr: 1.0e-04 loss: 4.900e-01]
windy_storm:  37%|###6      | 1109/3000 [33:26<1:18:01,  2.48s/it, lr: 1.0e-04 loss: 4.900e-01]
windy_storm:  37%|###6      | 1109/3000 [33:26<1:18:01,  2.48s/it, lr: 1.0e-04 loss: 4.900e-01]
windy_storm:  37%|###6      | 1109/3000 [33:27<1:18:01,  2.48s/it, lr: 1.0e-04 loss: 5.201e-01]
windy_storm:  37%|###6      | 1109/3000 [33:27<1:18:01,  2.48s/it, lr: 1.0e-04 loss: 5.201e-01]
windy_storm:  37%|###7      | 1110/3000 [33:30<1:17:58,  2.48s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  37%|###7      | 1110/3000 [33:30<1:17:58,  2.48s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  37%|###7      | 1111/3000 [33:30<1:04:02,  2.03s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  37%|###7      | 1111/3000 [33:30<1:04:02,  2.03s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  37%|###7      | 1111/3000 [33:31<1:04:02,  2.03s/it, lr: 1.0e-04 loss: 6.910e-01]
windy_storm:  37%|###7      | 1111/3000 [33:31<1:04:02,  2.03s/it, lr: 1.0e-04 loss: 6.910e-01]
windy_storm:  37%|###7      | 1112/3000 [33:31<1:00:06,  1.91s/it, lr: 1.0e-04 loss: 6.910e-01]
windy_storm:  37%|###7      | 1112/3000 [33:31<1:00:06,  1.91s/it, lr: 1.0e-04 loss: 6.910e-01]
windy_storm:  37%|###7      | 1112/3000 [33:33<1:00:06,  1.91s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  37%|###7      | 1112/3000 [33:33<1:00:06,  1.91s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  37%|###7      | 1113/3000 [33:33<57:25,  1.83s/it, lr: 1.0e-04 loss: 6.404e-01]  
windy_storm:  37%|###7      | 1113/3000 [33:33<57:25,  1.83s/it, lr: 1.0e-04 loss: 6.404e-01]  
windy_storm:  37%|###7      | 1113/3000 [33:34<57:25,  1.83s/it, lr: 1.0e-04 loss: 8.704e-02]
windy_storm:  37%|###7      | 1113/3000 [33:34<57:25,  1.83s/it, lr: 1.0e-04 loss: 8.704e-02]
windy_storm:  37%|###7      | 1114/3000 [33:34<48:57,  1.56s/it, lr: 1.0e-04 loss: 8.704e-02]
windy_storm:  37%|###7      | 1114/3000 [33:34<48:57,  1.56s/it, lr: 1.0e-04 loss: 8.704e-02]
windy_storm:  37%|###7      | 1114/3000 [33:35<48:57,  1.56s/it, lr: 1.0e-04 loss: 3.320e-01]
windy_storm:  37%|###7      | 1114/3000 [33:35<48:57,  1.56s/it, lr: 1.0e-04 loss: 3.320e-01]
windy_storm:  37%|###7      | 1115/3000 [33:35<42:32,  1.35s/it, lr: 1.0e-04 loss: 3.320e-01]
windy_storm:  37%|###7      | 1115/3000 [33:35<42:32,  1.35s/it, lr: 1.0e-04 loss: 3.320e-01]
windy_storm:  37%|###7      | 1115/3000 [33:36<42:32,  1.35s/it, lr: 1.0e-04 loss: 5.446e-01]
windy_storm:  37%|###7      | 1115/3000 [33:36<42:32,  1.35s/it, lr: 1.0e-04 loss: 5.446e-01]
windy_storm:  37%|###7      | 1116/3000 [33:36<44:23,  1.41s/it, lr: 1.0e-04 loss: 5.446e-01]
windy_storm:  37%|###7      | 1116/3000 [33:36<44:23,  1.41s/it, lr: 1.0e-04 loss: 5.446e-01]
windy_storm:  37%|###7      | 1116/3000 [33:38<44:23,  1.41s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  37%|###7      | 1116/3000 [33:38<44:23,  1.41s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  37%|###7      | 1117/3000 [33:38<46:02,  1.47s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  37%|###7      | 1117/3000 [33:38<46:02,  1.47s/it, lr: 1.0e-04 loss: 1.552e-01]
windy_storm:  37%|###7      | 1117/3000 [33:39<46:02,  1.47s/it, lr: 1.0e-04 loss: 1.608e-01]
windy_storm:  37%|###7      | 1117/3000 [33:39<46:02,  1.47s/it, lr: 1.0e-04 loss: 1.608e-01]
windy_storm:  37%|###7      | 1118/3000 [33:39<46:53,  1.50s/it, lr: 1.0e-04 loss: 1.608e-01]
windy_storm:  37%|###7      | 1118/3000 [33:39<46:53,  1.50s/it, lr: 1.0e-04 loss: 1.608e-01]
windy_storm:  37%|###7      | 1118/3000 [33:40<46:53,  1.50s/it, lr: 1.0e-04 loss: 2.947e-01]
windy_storm:  37%|###7      | 1118/3000 [33:40<46:53,  1.50s/it, lr: 1.0e-04 loss: 2.947e-01]
windy_storm:  37%|###7      | 1119/3000 [33:40<40:04,  1.28s/it, lr: 1.0e-04 loss: 2.947e-01]
windy_storm:  37%|###7      | 1119/3000 [33:40<40:04,  1.28s/it, lr: 1.0e-04 loss: 2.947e-01]
windy_storm:  37%|###7      | 1119/3000 [33:41<40:04,  1.28s/it, lr: 1.0e-04 loss: 8.091e-02]
windy_storm:  37%|###7      | 1119/3000 [33:41<40:04,  1.28s/it, lr: 1.0e-04 loss: 8.091e-02]
windy_storm:  37%|###7      | 1120/3000 [33:42<40:03,  1.28s/it, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  37%|###7      | 1120/3000 [33:42<40:03,  1.28s/it, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  37%|###7      | 1121/3000 [33:42<29:21,  1.07it/s, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  37%|###7      | 1121/3000 [33:42<29:21,  1.07it/s, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  37%|###7      | 1121/3000 [33:43<29:21,  1.07it/s, lr: 1.0e-04 loss: 3.443e-02]
windy_storm:  37%|###7      | 1121/3000 [33:43<29:21,  1.07it/s, lr: 1.0e-04 loss: 3.443e-02]
windy_storm:  37%|###7      | 1122/3000 [33:43<28:25,  1.10it/s, lr: 1.0e-04 loss: 3.443e-02]
windy_storm:  37%|###7      | 1122/3000 [33:43<28:25,  1.10it/s, lr: 1.0e-04 loss: 3.443e-02]
windy_storm:  37%|###7      | 1122/3000 [33:44<28:25,  1.10it/s, lr: 1.0e-04 loss: 7.350e-02]
windy_storm:  37%|###7      | 1122/3000 [33:44<28:25,  1.10it/s, lr: 1.0e-04 loss: 7.350e-02]
windy_storm:  37%|###7      | 1123/3000 [33:44<27:16,  1.15it/s, lr: 1.0e-04 loss: 7.350e-02]
windy_storm:  37%|###7      | 1123/3000 [33:44<27:16,  1.15it/s, lr: 1.0e-04 loss: 7.350e-02]
windy_storm:  37%|###7      | 1123/3000 [33:45<27:16,  1.15it/s, lr: 1.0e-04 loss: 5.496e-01]
windy_storm:  37%|###7      | 1123/3000 [33:45<27:16,  1.15it/s, lr: 1.0e-04 loss: 5.496e-01]
windy_storm:  37%|###7      | 1124/3000 [33:45<33:00,  1.06s/it, lr: 1.0e-04 loss: 5.496e-01]
windy_storm:  37%|###7      | 1124/3000 [33:45<33:00,  1.06s/it, lr: 1.0e-04 loss: 5.496e-01]
windy_storm:  37%|###7      | 1124/3000 [33:48<33:00,  1.06s/it, lr: 1.0e-04 loss: 5.429e-01]
windy_storm:  37%|###7      | 1124/3000 [33:48<33:00,  1.06s/it, lr: 1.0e-04 loss: 5.429e-01]
windy_storm:  38%|###7      | 1125/3000 [33:48<49:20,  1.58s/it, lr: 1.0e-04 loss: 5.429e-01]
windy_storm:  38%|###7      | 1125/3000 [33:48<49:20,  1.58s/it, lr: 1.0e-04 loss: 5.429e-01]
windy_storm:  38%|###7      | 1125/3000 [33:51<49:20,  1.58s/it, lr: 1.0e-04 loss: 4.107e-01]
windy_storm:  38%|###7      | 1125/3000 [33:51<49:20,  1.58s/it, lr: 1.0e-04 loss: 4.107e-01]
windy_storm:  38%|###7      | 1126/3000 [33:51<1:02:04,  1.99s/it, lr: 1.0e-04 loss: 4.107e-01]
windy_storm:  38%|###7      | 1126/3000 [33:51<1:02:04,  1.99s/it, lr: 1.0e-04 loss: 4.107e-01]
windy_storm:  38%|###7      | 1126/3000 [33:52<1:02:04,  1.99s/it, lr: 1.0e-04 loss: 3.888e-01]
windy_storm:  38%|###7      | 1126/3000 [33:52<1:02:04,  1.99s/it, lr: 1.0e-04 loss: 3.888e-01]
windy_storm:  38%|###7      | 1127/3000 [33:52<50:54,  1.63s/it, lr: 1.0e-04 loss: 3.888e-01]  
windy_storm:  38%|###7      | 1127/3000 [33:52<50:54,  1.63s/it, lr: 1.0e-04 loss: 3.888e-01]  
windy_storm:  38%|###7      | 1127/3000 [33:53<50:54,  1.63s/it, lr: 1.0e-04 loss: 5.571e-01]
windy_storm:  38%|###7      | 1127/3000 [33:53<50:54,  1.63s/it, lr: 1.0e-04 loss: 5.571e-01]
windy_storm:  38%|###7      | 1128/3000 [33:53<50:19,  1.61s/it, lr: 1.0e-04 loss: 5.571e-01]
windy_storm:  38%|###7      | 1128/3000 [33:53<50:19,  1.61s/it, lr: 1.0e-04 loss: 5.571e-01]
windy_storm:  38%|###7      | 1128/3000 [33:56<50:19,  1.61s/it, lr: 1.0e-04 loss: 4.282e-01]
windy_storm:  38%|###7      | 1128/3000 [33:56<50:19,  1.61s/it, lr: 1.0e-04 loss: 4.282e-01]
windy_storm:  38%|###7      | 1129/3000 [33:56<1:02:42,  2.01s/it, lr: 1.0e-04 loss: 4.282e-01]
windy_storm:  38%|###7      | 1129/3000 [33:56<1:02:42,  2.01s/it, lr: 1.0e-04 loss: 4.282e-01]
windy_storm:  38%|###7      | 1129/3000 [33:57<1:02:42,  2.01s/it, lr: 1.0e-04 loss: 4.969e-01]
windy_storm:  38%|###7      | 1129/3000 [33:57<1:02:42,  2.01s/it, lr: 1.0e-04 loss: 4.969e-01]
windy_storm:  38%|###7      | 1130/3000 [34:00<1:02:40,  2.01s/it, lr: 1.0e-04 loss: 5.003e-01]
windy_storm:  38%|###7      | 1130/3000 [34:00<1:02:40,  2.01s/it, lr: 1.0e-04 loss: 5.003e-01]
windy_storm:  38%|###7      | 1131/3000 [34:00<55:27,  1.78s/it, lr: 1.0e-04 loss: 5.003e-01]  
windy_storm:  38%|###7      | 1131/3000 [34:00<55:27,  1.78s/it, lr: 1.0e-04 loss: 5.003e-01]  
windy_storm:  38%|###7      | 1131/3000 [34:01<55:27,  1.78s/it, lr: 1.0e-04 loss: 5.176e-01]
windy_storm:  38%|###7      | 1131/3000 [34:01<55:27,  1.78s/it, lr: 1.0e-04 loss: 5.176e-01]
windy_storm:  38%|###7      | 1132/3000 [34:01<48:03,  1.54s/it, lr: 1.0e-04 loss: 5.176e-01]
windy_storm:  38%|###7      | 1132/3000 [34:01<48:03,  1.54s/it, lr: 1.0e-04 loss: 5.176e-01]
windy_storm:  38%|###7      | 1132/3000 [34:04<48:03,  1.54s/it, lr: 1.0e-04 loss: 2.247e-01]
windy_storm:  38%|###7      | 1132/3000 [34:04<48:03,  1.54s/it, lr: 1.0e-04 loss: 2.247e-01]
windy_storm:  38%|###7      | 1133/3000 [34:04<1:00:02,  1.93s/it, lr: 1.0e-04 loss: 2.247e-01]
windy_storm:  38%|###7      | 1133/3000 [34:04<1:00:02,  1.93s/it, lr: 1.0e-04 loss: 2.247e-01]
windy_storm:  38%|###7      | 1133/3000 [34:05<1:00:02,  1.93s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  38%|###7      | 1133/3000 [34:05<1:00:02,  1.93s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  38%|###7      | 1134/3000 [34:05<52:44,  1.70s/it, lr: 1.0e-04 loss: 5.769e-01]  
windy_storm:  38%|###7      | 1134/3000 [34:05<52:44,  1.70s/it, lr: 1.0e-04 loss: 5.769e-01]  
windy_storm:  38%|###7      | 1134/3000 [34:06<52:44,  1.70s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  38%|###7      | 1134/3000 [34:06<52:44,  1.70s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  38%|###7      | 1135/3000 [34:06<45:10,  1.45s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  38%|###7      | 1135/3000 [34:06<45:10,  1.45s/it, lr: 1.0e-04 loss: 5.448e-01]
windy_storm:  38%|###7      | 1135/3000 [34:09<45:10,  1.45s/it, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  38%|###7      | 1135/3000 [34:09<45:10,  1.45s/it, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  38%|###7      | 1136/3000 [34:09<58:28,  1.88s/it, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  38%|###7      | 1136/3000 [34:09<58:28,  1.88s/it, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  38%|###7      | 1136/3000 [34:10<58:28,  1.88s/it, lr: 1.0e-04 loss: 6.735e-01]
windy_storm:  38%|###7      | 1136/3000 [34:10<58:28,  1.88s/it, lr: 1.0e-04 loss: 6.735e-01]
windy_storm:  38%|###7      | 1137/3000 [34:10<48:58,  1.58s/it, lr: 1.0e-04 loss: 6.735e-01]
windy_storm:  38%|###7      | 1137/3000 [34:10<48:58,  1.58s/it, lr: 1.0e-04 loss: 6.735e-01]
windy_storm:  38%|###7      | 1137/3000 [34:11<48:58,  1.58s/it, lr: 1.0e-04 loss: 5.863e-01]
windy_storm:  38%|###7      | 1137/3000 [34:11<48:58,  1.58s/it, lr: 1.0e-04 loss: 5.863e-01]
windy_storm:  38%|###7      | 1138/3000 [34:11<49:14,  1.59s/it, lr: 1.0e-04 loss: 5.863e-01]
windy_storm:  38%|###7      | 1138/3000 [34:11<49:14,  1.59s/it, lr: 1.0e-04 loss: 5.863e-01]
windy_storm:  38%|###7      | 1138/3000 [34:13<49:14,  1.59s/it, lr: 1.0e-04 loss: 6.787e-01]
windy_storm:  38%|###7      | 1138/3000 [34:13<49:14,  1.59s/it, lr: 1.0e-04 loss: 6.787e-01]
windy_storm:  38%|###7      | 1139/3000 [34:13<49:22,  1.59s/it, lr: 1.0e-04 loss: 6.787e-01]
windy_storm:  38%|###7      | 1139/3000 [34:13<49:22,  1.59s/it, lr: 1.0e-04 loss: 6.787e-01]
windy_storm:  38%|###7      | 1139/3000 [34:14<49:22,  1.59s/it, lr: 1.0e-04 loss: 4.402e-02]
windy_storm:  38%|###7      | 1139/3000 [34:14<49:22,  1.59s/it, lr: 1.0e-04 loss: 4.402e-02]
windy_storm:  38%|###8      | 1140/3000 [34:17<49:21,  1.59s/it, lr: 1.0e-04 loss: 1.185e-01]
windy_storm:  38%|###8      | 1140/3000 [34:17<49:21,  1.59s/it, lr: 1.0e-04 loss: 1.185e-01]
windy_storm:  38%|###8      | 1141/3000 [34:17<48:23,  1.56s/it, lr: 1.0e-04 loss: 1.185e-01]
windy_storm:  38%|###8      | 1141/3000 [34:17<48:23,  1.56s/it, lr: 1.0e-04 loss: 1.185e-01]
windy_storm:  38%|###8      | 1141/3000 [34:18<48:23,  1.56s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  38%|###8      | 1141/3000 [34:18<48:23,  1.56s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  38%|###8      | 1142/3000 [34:18<48:46,  1.58s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  38%|###8      | 1142/3000 [34:18<48:46,  1.58s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  38%|###8      | 1142/3000 [34:20<48:46,  1.58s/it, lr: 1.0e-04 loss: 7.074e-01]
windy_storm:  38%|###8      | 1142/3000 [34:20<48:46,  1.58s/it, lr: 1.0e-04 loss: 7.074e-01]
windy_storm:  38%|###8      | 1143/3000 [34:20<48:58,  1.58s/it, lr: 1.0e-04 loss: 7.074e-01]
windy_storm:  38%|###8      | 1143/3000 [34:20<48:58,  1.58s/it, lr: 1.0e-04 loss: 7.074e-01]
windy_storm:  38%|###8      | 1143/3000 [34:22<48:58,  1.58s/it, lr: 1.0e-04 loss: 5.787e-01]
windy_storm:  38%|###8      | 1143/3000 [34:22<48:58,  1.58s/it, lr: 1.0e-04 loss: 5.787e-01]
windy_storm:  38%|###8      | 1144/3000 [34:22<49:07,  1.59s/it, lr: 1.0e-04 loss: 5.787e-01]
windy_storm:  38%|###8      | 1144/3000 [34:22<49:07,  1.59s/it, lr: 1.0e-04 loss: 5.787e-01]
windy_storm:  38%|###8      | 1144/3000 [34:24<49:07,  1.59s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  38%|###8      | 1144/3000 [34:24<49:07,  1.59s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  38%|###8      | 1145/3000 [34:24<1:00:54,  1.97s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  38%|###8      | 1145/3000 [34:24<1:00:54,  1.97s/it, lr: 1.0e-04 loss: 6.361e-01]
windy_storm:  38%|###8      | 1145/3000 [34:27<1:00:54,  1.97s/it, lr: 1.0e-04 loss: 4.359e-01]
windy_storm:  38%|###8      | 1145/3000 [34:27<1:00:54,  1.97s/it, lr: 1.0e-04 loss: 4.359e-01]
windy_storm:  38%|###8      | 1146/3000 [34:27<1:10:03,  2.27s/it, lr: 1.0e-04 loss: 4.359e-01]
windy_storm:  38%|###8      | 1146/3000 [34:27<1:10:03,  2.27s/it, lr: 1.0e-04 loss: 4.359e-01]
windy_storm:  38%|###8      | 1146/3000 [34:31<1:10:03,  2.27s/it, lr: 1.0e-04 loss: 3.808e-01]
windy_storm:  38%|###8      | 1146/3000 [34:31<1:10:03,  2.27s/it, lr: 1.0e-04 loss: 3.808e-01]
windy_storm:  38%|###8      | 1147/3000 [34:31<1:16:58,  2.49s/it, lr: 1.0e-04 loss: 3.808e-01]
windy_storm:  38%|###8      | 1147/3000 [34:31<1:16:58,  2.49s/it, lr: 1.0e-04 loss: 3.808e-01]
windy_storm:  38%|###8      | 1147/3000 [34:34<1:16:58,  2.49s/it, lr: 1.0e-04 loss: 4.461e-01]
windy_storm:  38%|###8      | 1147/3000 [34:34<1:16:58,  2.49s/it, lr: 1.0e-04 loss: 4.461e-01]
windy_storm:  38%|###8      | 1148/3000 [34:34<1:21:28,  2.64s/it, lr: 1.0e-04 loss: 4.461e-01]
windy_storm:  38%|###8      | 1148/3000 [34:34<1:21:28,  2.64s/it, lr: 1.0e-04 loss: 4.461e-01]
windy_storm:  38%|###8      | 1148/3000 [34:34<1:21:28,  2.64s/it, lr: 1.0e-04 loss: 3.348e-01]
windy_storm:  38%|###8      | 1148/3000 [34:34<1:21:28,  2.64s/it, lr: 1.0e-04 loss: 3.348e-01]
windy_storm:  38%|###8      | 1149/3000 [34:34<1:04:16,  2.08s/it, lr: 1.0e-04 loss: 3.348e-01]
windy_storm:  38%|###8      | 1149/3000 [34:34<1:04:16,  2.08s/it, lr: 1.0e-04 loss: 3.348e-01]
windy_storm:  38%|###8      | 1149/3000 [34:36<1:04:16,  2.08s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  38%|###8      | 1149/3000 [34:36<1:04:16,  2.08s/it, lr: 1.0e-04 loss: 3.102e-01]
windy_storm:  38%|###8      | 1150/3000 [34:37<1:04:14,  2.08s/it, lr: 1.0e-04 loss: 6.349e-01]
windy_storm:  38%|###8      | 1150/3000 [34:37<1:04:14,  2.08s/it, lr: 1.0e-04 loss: 6.349e-01]
windy_storm:  38%|###8      | 1151/3000 [34:37<40:13,  1.31s/it, lr: 1.0e-04 loss: 6.349e-01]  
windy_storm:  38%|###8      | 1151/3000 [34:37<40:13,  1.31s/it, lr: 1.0e-04 loss: 6.349e-01]  
windy_storm:  38%|###8      | 1151/3000 [34:37<40:13,  1.31s/it, lr: 1.0e-04 loss: 2.687e-01]
windy_storm:  38%|###8      | 1151/3000 [34:37<40:13,  1.31s/it, lr: 1.0e-04 loss: 2.687e-01]
windy_storm:  38%|###8      | 1152/3000 [34:37<36:13,  1.18s/it, lr: 1.0e-04 loss: 2.687e-01]
windy_storm:  38%|###8      | 1152/3000 [34:37<36:13,  1.18s/it, lr: 1.0e-04 loss: 2.687e-01]
windy_storm:  38%|###8      | 1152/3000 [34:39<36:13,  1.18s/it, lr: 1.0e-04 loss: 6.427e-01]
windy_storm:  38%|###8      | 1152/3000 [34:39<36:13,  1.18s/it, lr: 1.0e-04 loss: 6.427e-01]
windy_storm:  38%|###8      | 1153/3000 [34:39<39:15,  1.28s/it, lr: 1.0e-04 loss: 6.427e-01]
windy_storm:  38%|###8      | 1153/3000 [34:39<39:15,  1.28s/it, lr: 1.0e-04 loss: 6.427e-01]
windy_storm:  38%|###8      | 1153/3000 [34:41<39:15,  1.28s/it, lr: 1.0e-04 loss: 3.974e-01]
windy_storm:  38%|###8      | 1153/3000 [34:41<39:15,  1.28s/it, lr: 1.0e-04 loss: 3.974e-01]
windy_storm:  38%|###8      | 1154/3000 [34:41<41:34,  1.35s/it, lr: 1.0e-04 loss: 3.974e-01]
windy_storm:  38%|###8      | 1154/3000 [34:41<41:34,  1.35s/it, lr: 1.0e-04 loss: 3.974e-01]
windy_storm:  38%|###8      | 1154/3000 [34:41<41:34,  1.35s/it, lr: 1.0e-04 loss: 5.439e-01]
windy_storm:  38%|###8      | 1154/3000 [34:41<41:34,  1.35s/it, lr: 1.0e-04 loss: 5.439e-01]
windy_storm:  38%|###8      | 1155/3000 [34:41<36:27,  1.19s/it, lr: 1.0e-04 loss: 5.439e-01]
windy_storm:  38%|###8      | 1155/3000 [34:41<36:27,  1.19s/it, lr: 1.0e-04 loss: 5.439e-01]
windy_storm:  38%|###8      | 1155/3000 [34:42<36:27,  1.19s/it, lr: 1.0e-04 loss: 6.194e-01]
windy_storm:  38%|###8      | 1155/3000 [34:42<36:27,  1.19s/it, lr: 1.0e-04 loss: 6.194e-01]
windy_storm:  39%|###8      | 1156/3000 [34:42<33:14,  1.08s/it, lr: 1.0e-04 loss: 6.194e-01]
windy_storm:  39%|###8      | 1156/3000 [34:42<33:14,  1.08s/it, lr: 1.0e-04 loss: 6.194e-01]
windy_storm:  39%|###8      | 1156/3000 [34:43<33:14,  1.08s/it, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  39%|###8      | 1156/3000 [34:43<33:14,  1.08s/it, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  39%|###8      | 1157/3000 [34:43<30:16,  1.01it/s, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  39%|###8      | 1157/3000 [34:43<30:16,  1.01it/s, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  39%|###8      | 1157/3000 [34:44<30:16,  1.01it/s, lr: 1.0e-04 loss: 5.186e-02]
windy_storm:  39%|###8      | 1157/3000 [34:44<30:16,  1.01it/s, lr: 1.0e-04 loss: 5.186e-02]
windy_storm:  39%|###8      | 1158/3000 [34:44<35:38,  1.16s/it, lr: 1.0e-04 loss: 5.186e-02]
windy_storm:  39%|###8      | 1158/3000 [34:44<35:38,  1.16s/it, lr: 1.0e-04 loss: 5.186e-02]
windy_storm:  39%|###8      | 1158/3000 [34:45<35:38,  1.16s/it, lr: 1.0e-04 loss: 1.949e-01]
windy_storm:  39%|###8      | 1158/3000 [34:45<35:38,  1.16s/it, lr: 1.0e-04 loss: 1.949e-01]
windy_storm:  39%|###8      | 1159/3000 [34:45<31:44,  1.03s/it, lr: 1.0e-04 loss: 1.949e-01]
windy_storm:  39%|###8      | 1159/3000 [34:45<31:44,  1.03s/it, lr: 1.0e-04 loss: 1.949e-01]
windy_storm:  39%|###8      | 1159/3000 [34:48<31:44,  1.03s/it, lr: 1.0e-04 loss: 6.749e-01]
windy_storm:  39%|###8      | 1159/3000 [34:48<31:44,  1.03s/it, lr: 1.0e-04 loss: 6.749e-01]
windy_storm:  39%|###8      | 1160/3000 [34:50<31:42,  1.03s/it, lr: 1.0e-04 loss: 4.590e-02]
windy_storm:  39%|###8      | 1160/3000 [34:50<31:42,  1.03s/it, lr: 1.0e-04 loss: 4.590e-02]
windy_storm:  39%|###8      | 1161/3000 [34:50<28:17,  1.08it/s, lr: 1.0e-04 loss: 4.590e-02]
windy_storm:  39%|###8      | 1161/3000 [34:50<28:17,  1.08it/s, lr: 1.0e-04 loss: 4.590e-02]
windy_storm:  39%|###8      | 1161/3000 [34:53<28:17,  1.08it/s, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:  39%|###8      | 1161/3000 [34:53<28:17,  1.08it/s, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:  39%|###8      | 1162/3000 [34:53<44:03,  1.44s/it, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:  39%|###8      | 1162/3000 [34:53<44:03,  1.44s/it, lr: 1.0e-04 loss: 6.261e-01]
windy_storm:  39%|###8      | 1162/3000 [34:54<44:03,  1.44s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  39%|###8      | 1162/3000 [34:54<44:03,  1.44s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  39%|###8      | 1163/3000 [34:54<44:38,  1.46s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  39%|###8      | 1163/3000 [34:54<44:38,  1.46s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  39%|###8      | 1163/3000 [34:56<44:38,  1.46s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  39%|###8      | 1163/3000 [34:56<44:38,  1.46s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  39%|###8      | 1164/3000 [34:56<45:35,  1.49s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  39%|###8      | 1164/3000 [34:56<45:35,  1.49s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  39%|###8      | 1164/3000 [34:57<45:35,  1.49s/it, lr: 1.0e-04 loss: 3.865e-01]
windy_storm:  39%|###8      | 1164/3000 [34:57<45:35,  1.49s/it, lr: 1.0e-04 loss: 3.865e-01]
windy_storm:  39%|###8      | 1165/3000 [34:57<46:14,  1.51s/it, lr: 1.0e-04 loss: 3.865e-01]
windy_storm:  39%|###8      | 1165/3000 [34:57<46:14,  1.51s/it, lr: 1.0e-04 loss: 3.865e-01]
windy_storm:  39%|###8      | 1165/3000 [34:59<46:14,  1.51s/it, lr: 1.0e-04 loss: 6.220e-01]
windy_storm:  39%|###8      | 1165/3000 [34:59<46:14,  1.51s/it, lr: 1.0e-04 loss: 6.220e-01]
windy_storm:  39%|###8      | 1166/3000 [34:59<46:48,  1.53s/it, lr: 1.0e-04 loss: 6.220e-01]
windy_storm:  39%|###8      | 1166/3000 [34:59<46:48,  1.53s/it, lr: 1.0e-04 loss: 6.220e-01]
windy_storm:  39%|###8      | 1166/3000 [35:01<46:48,  1.53s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:  39%|###8      | 1166/3000 [35:01<46:48,  1.53s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:  39%|###8      | 1167/3000 [35:01<47:04,  1.54s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:  39%|###8      | 1167/3000 [35:01<47:04,  1.54s/it, lr: 1.0e-04 loss: 4.402e-01]
windy_storm:  39%|###8      | 1167/3000 [35:03<47:04,  1.54s/it, lr: 1.0e-04 loss: 6.397e-01]
windy_storm:  39%|###8      | 1167/3000 [35:03<47:04,  1.54s/it, lr: 1.0e-04 loss: 6.397e-01]
windy_storm:  39%|###8      | 1168/3000 [35:03<58:57,  1.93s/it, lr: 1.0e-04 loss: 6.397e-01]
windy_storm:  39%|###8      | 1168/3000 [35:03<58:57,  1.93s/it, lr: 1.0e-04 loss: 6.397e-01]
windy_storm:  39%|###8      | 1168/3000 [35:04<58:57,  1.93s/it, lr: 1.0e-04 loss: 5.278e-01]
windy_storm:  39%|###8      | 1168/3000 [35:04<58:57,  1.93s/it, lr: 1.0e-04 loss: 5.278e-01]
windy_storm:  39%|###8      | 1169/3000 [35:04<48:56,  1.60s/it, lr: 1.0e-04 loss: 5.278e-01]
windy_storm:  39%|###8      | 1169/3000 [35:04<48:56,  1.60s/it, lr: 1.0e-04 loss: 5.278e-01]
windy_storm:  39%|###8      | 1169/3000 [35:07<48:56,  1.60s/it, lr: 1.0e-04 loss: 5.899e-01]
windy_storm:  39%|###8      | 1169/3000 [35:07<48:56,  1.60s/it, lr: 1.0e-04 loss: 5.899e-01]
windy_storm:  39%|###9      | 1170/3000 [35:08<48:54,  1.60s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  39%|###9      | 1170/3000 [35:08<48:54,  1.60s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  39%|###9      | 1171/3000 [35:08<32:13,  1.06s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  39%|###9      | 1171/3000 [35:08<32:13,  1.06s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  39%|###9      | 1171/3000 [35:10<32:13,  1.06s/it, lr: 1.0e-04 loss: 4.195e-01]
windy_storm:  39%|###9      | 1171/3000 [35:10<32:13,  1.06s/it, lr: 1.0e-04 loss: 4.195e-01]
windy_storm:  39%|###9      | 1172/3000 [35:10<35:53,  1.18s/it, lr: 1.0e-04 loss: 4.195e-01]
windy_storm:  39%|###9      | 1172/3000 [35:10<35:53,  1.18s/it, lr: 1.0e-04 loss: 4.195e-01]
windy_storm:  39%|###9      | 1172/3000 [35:11<35:53,  1.18s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  39%|###9      | 1172/3000 [35:11<35:53,  1.18s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  39%|###9      | 1173/3000 [35:11<38:54,  1.28s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  39%|###9      | 1173/3000 [35:11<38:54,  1.28s/it, lr: 1.0e-04 loss: 1.088e-01]
windy_storm:  39%|###9      | 1173/3000 [35:12<38:54,  1.28s/it, lr: 1.0e-04 loss: 4.313e-01]
windy_storm:  39%|###9      | 1173/3000 [35:12<38:54,  1.28s/it, lr: 1.0e-04 loss: 4.313e-01]
windy_storm:  39%|###9      | 1174/3000 [35:12<35:11,  1.16s/it, lr: 1.0e-04 loss: 4.313e-01]
windy_storm:  39%|###9      | 1174/3000 [35:12<35:11,  1.16s/it, lr: 1.0e-04 loss: 4.313e-01]
windy_storm:  39%|###9      | 1174/3000 [35:13<35:11,  1.16s/it, lr: 1.0e-04 loss: 2.736e-01]
windy_storm:  39%|###9      | 1174/3000 [35:13<35:11,  1.16s/it, lr: 1.0e-04 loss: 2.736e-01]
windy_storm:  39%|###9      | 1175/3000 [35:14<38:32,  1.27s/it, lr: 1.0e-04 loss: 2.736e-01]
windy_storm:  39%|###9      | 1175/3000 [35:14<38:32,  1.27s/it, lr: 1.0e-04 loss: 2.736e-01]
windy_storm:  39%|###9      | 1175/3000 [35:15<38:32,  1.27s/it, lr: 1.0e-04 loss: 2.441e-01]
windy_storm:  39%|###9      | 1175/3000 [35:15<38:32,  1.27s/it, lr: 1.0e-04 loss: 2.441e-01]
windy_storm:  39%|###9      | 1176/3000 [35:15<42:51,  1.41s/it, lr: 1.0e-04 loss: 2.441e-01]
windy_storm:  39%|###9      | 1176/3000 [35:15<42:51,  1.41s/it, lr: 1.0e-04 loss: 2.441e-01]
windy_storm:  39%|###9      | 1176/3000 [35:18<42:51,  1.41s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  39%|###9      | 1176/3000 [35:18<42:51,  1.41s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  39%|###9      | 1177/3000 [35:18<56:41,  1.87s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  39%|###9      | 1177/3000 [35:18<56:41,  1.87s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  39%|###9      | 1177/3000 [35:20<56:41,  1.87s/it, lr: 1.0e-04 loss: 3.121e-01]
windy_storm:  39%|###9      | 1177/3000 [35:20<56:41,  1.87s/it, lr: 1.0e-04 loss: 3.121e-01]
windy_storm:  39%|###9      | 1178/3000 [35:20<54:01,  1.78s/it, lr: 1.0e-04 loss: 3.121e-01]
windy_storm:  39%|###9      | 1178/3000 [35:20<54:01,  1.78s/it, lr: 1.0e-04 loss: 3.121e-01]
windy_storm:  39%|###9      | 1178/3000 [35:21<54:01,  1.78s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  39%|###9      | 1178/3000 [35:21<54:01,  1.78s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  39%|###9      | 1179/3000 [35:21<44:51,  1.48s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  39%|###9      | 1179/3000 [35:21<44:51,  1.48s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  39%|###9      | 1179/3000 [35:22<44:51,  1.48s/it, lr: 1.0e-04 loss: 3.879e-01]
windy_storm:  39%|###9      | 1179/3000 [35:22<44:51,  1.48s/it, lr: 1.0e-04 loss: 3.879e-01]
windy_storm:  39%|###9      | 1180/3000 [35:25<44:50,  1.48s/it, lr: 1.0e-04 loss: 6.173e-01]
windy_storm:  39%|###9      | 1180/3000 [35:25<44:50,  1.48s/it, lr: 1.0e-04 loss: 6.173e-01]
windy_storm:  39%|###9      | 1181/3000 [35:25<44:57,  1.48s/it, lr: 1.0e-04 loss: 6.173e-01]
windy_storm:  39%|###9      | 1181/3000 [35:25<44:57,  1.48s/it, lr: 1.0e-04 loss: 6.173e-01]
windy_storm:  39%|###9      | 1181/3000 [35:27<44:57,  1.48s/it, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  39%|###9      | 1181/3000 [35:27<44:57,  1.48s/it, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  39%|###9      | 1182/3000 [35:27<45:26,  1.50s/it, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  39%|###9      | 1182/3000 [35:27<45:26,  1.50s/it, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  39%|###9      | 1182/3000 [35:28<45:26,  1.50s/it, lr: 1.0e-04 loss: 1.526e-01]
windy_storm:  39%|###9      | 1182/3000 [35:28<45:26,  1.50s/it, lr: 1.0e-04 loss: 1.526e-01]
windy_storm:  39%|###9      | 1183/3000 [35:28<45:46,  1.51s/it, lr: 1.0e-04 loss: 1.526e-01]
windy_storm:  39%|###9      | 1183/3000 [35:28<45:46,  1.51s/it, lr: 1.0e-04 loss: 1.526e-01]
windy_storm:  39%|###9      | 1183/3000 [35:31<45:46,  1.51s/it, lr: 1.0e-04 loss: 4.685e-01]
windy_storm:  39%|###9      | 1183/3000 [35:31<45:46,  1.51s/it, lr: 1.0e-04 loss: 4.685e-01]
windy_storm:  39%|###9      | 1184/3000 [35:31<57:06,  1.89s/it, lr: 1.0e-04 loss: 4.685e-01]
windy_storm:  39%|###9      | 1184/3000 [35:31<57:06,  1.89s/it, lr: 1.0e-04 loss: 4.685e-01]
windy_storm:  39%|###9      | 1184/3000 [35:34<57:06,  1.89s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:  39%|###9      | 1184/3000 [35:34<57:06,  1.89s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:  40%|###9      | 1185/3000 [35:34<1:06:15,  2.19s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:  40%|###9      | 1185/3000 [35:34<1:06:15,  2.19s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:  40%|###9      | 1185/3000 [35:37<1:06:15,  2.19s/it, lr: 1.0e-04 loss: 4.046e-02]
windy_storm:  40%|###9      | 1185/3000 [35:37<1:06:15,  2.19s/it, lr: 1.0e-04 loss: 4.046e-02]
windy_storm:  40%|###9      | 1186/3000 [35:37<1:12:33,  2.40s/it, lr: 1.0e-04 loss: 4.046e-02]
windy_storm:  40%|###9      | 1186/3000 [35:37<1:12:33,  2.40s/it, lr: 1.0e-04 loss: 4.046e-02]
windy_storm:  40%|###9      | 1186/3000 [35:40<1:12:33,  2.40s/it, lr: 1.0e-04 loss: 2.990e-01]
windy_storm:  40%|###9      | 1186/3000 [35:40<1:12:33,  2.40s/it, lr: 1.0e-04 loss: 2.990e-01]
windy_storm:  40%|###9      | 1187/3000 [35:40<1:16:51,  2.54s/it, lr: 1.0e-04 loss: 2.990e-01]
windy_storm:  40%|###9      | 1187/3000 [35:40<1:16:51,  2.54s/it, lr: 1.0e-04 loss: 2.990e-01]
windy_storm:  40%|###9      | 1187/3000 [35:41<1:16:51,  2.54s/it, lr: 1.0e-04 loss: 2.075e-01]
windy_storm:  40%|###9      | 1187/3000 [35:41<1:16:51,  2.54s/it, lr: 1.0e-04 loss: 2.075e-01]
windy_storm:  40%|###9      | 1188/3000 [35:41<1:01:05,  2.02s/it, lr: 1.0e-04 loss: 2.075e-01]
windy_storm:  40%|###9      | 1188/3000 [35:41<1:01:05,  2.02s/it, lr: 1.0e-04 loss: 2.075e-01]
windy_storm:  40%|###9      | 1188/3000 [35:42<1:01:05,  2.02s/it, lr: 1.0e-04 loss: 2.598e-01]
windy_storm:  40%|###9      | 1188/3000 [35:42<1:01:05,  2.02s/it, lr: 1.0e-04 loss: 2.598e-01]
windy_storm:  40%|###9      | 1189/3000 [35:42<52:28,  1.74s/it, lr: 1.0e-04 loss: 2.598e-01]  
windy_storm:  40%|###9      | 1189/3000 [35:42<52:28,  1.74s/it, lr: 1.0e-04 loss: 2.598e-01]  
windy_storm:  40%|###9      | 1189/3000 [35:43<52:28,  1.74s/it, lr: 1.0e-04 loss: 6.521e-01]
windy_storm:  40%|###9      | 1189/3000 [35:43<52:28,  1.74s/it, lr: 1.0e-04 loss: 6.521e-01]
windy_storm:  40%|###9      | 1190/3000 [35:45<52:27,  1.74s/it, lr: 1.0e-04 loss: 4.193e-02]
windy_storm:  40%|###9      | 1190/3000 [35:45<52:27,  1.74s/it, lr: 1.0e-04 loss: 4.193e-02]
windy_storm:  40%|###9      | 1191/3000 [35:45<48:29,  1.61s/it, lr: 1.0e-04 loss: 4.193e-02]
windy_storm:  40%|###9      | 1191/3000 [35:45<48:29,  1.61s/it, lr: 1.0e-04 loss: 4.193e-02]
windy_storm:  40%|###9      | 1191/3000 [35:48<48:29,  1.61s/it, lr: 1.0e-04 loss: 5.095e-01]
windy_storm:  40%|###9      | 1191/3000 [35:48<48:29,  1.61s/it, lr: 1.0e-04 loss: 5.095e-01]
windy_storm:  40%|###9      | 1192/3000 [35:48<58:05,  1.93s/it, lr: 1.0e-04 loss: 5.095e-01]
windy_storm:  40%|###9      | 1192/3000 [35:48<58:05,  1.93s/it, lr: 1.0e-04 loss: 5.095e-01]
windy_storm:  40%|###9      | 1192/3000 [35:50<58:05,  1.93s/it, lr: 1.0e-04 loss: 5.632e-01]
windy_storm:  40%|###9      | 1192/3000 [35:50<58:05,  1.93s/it, lr: 1.0e-04 loss: 5.632e-01]
windy_storm:  40%|###9      | 1193/3000 [35:50<55:08,  1.83s/it, lr: 1.0e-04 loss: 5.632e-01]
windy_storm:  40%|###9      | 1193/3000 [35:50<55:08,  1.83s/it, lr: 1.0e-04 loss: 5.632e-01]
windy_storm:  40%|###9      | 1193/3000 [35:51<55:08,  1.83s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  40%|###9      | 1193/3000 [35:51<55:08,  1.83s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  40%|###9      | 1194/3000 [35:51<53:07,  1.76s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  40%|###9      | 1194/3000 [35:51<53:07,  1.76s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  40%|###9      | 1194/3000 [35:54<53:07,  1.76s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:  40%|###9      | 1194/3000 [35:54<53:07,  1.76s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:  40%|###9      | 1195/3000 [35:54<1:02:38,  2.08s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:  40%|###9      | 1195/3000 [35:54<1:02:38,  2.08s/it, lr: 1.0e-04 loss: 4.884e-01]
windy_storm:  40%|###9      | 1195/3000 [35:55<1:02:38,  2.08s/it, lr: 1.0e-04 loss: 4.400e-01]
windy_storm:  40%|###9      | 1195/3000 [35:55<1:02:38,  2.08s/it, lr: 1.0e-04 loss: 4.400e-01]
windy_storm:  40%|###9      | 1196/3000 [35:55<51:11,  1.70s/it, lr: 1.0e-04 loss: 4.400e-01]  
windy_storm:  40%|###9      | 1196/3000 [35:55<51:11,  1.70s/it, lr: 1.0e-04 loss: 4.400e-01]  
windy_storm:  40%|###9      | 1196/3000 [35:56<51:11,  1.70s/it, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  40%|###9      | 1196/3000 [35:56<51:11,  1.70s/it, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  40%|###9      | 1197/3000 [35:56<43:58,  1.46s/it, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  40%|###9      | 1197/3000 [35:56<43:58,  1.46s/it, lr: 1.0e-04 loss: 2.554e-01]
windy_storm:  40%|###9      | 1197/3000 [35:59<43:58,  1.46s/it, lr: 1.0e-04 loss: 2.732e-01]
windy_storm:  40%|###9      | 1197/3000 [35:59<43:58,  1.46s/it, lr: 1.0e-04 loss: 2.732e-01]
windy_storm:  40%|###9      | 1198/3000 [35:59<56:13,  1.87s/it, lr: 1.0e-04 loss: 2.732e-01]
windy_storm:  40%|###9      | 1198/3000 [35:59<56:13,  1.87s/it, lr: 1.0e-04 loss: 2.732e-01]
windy_storm:  40%|###9      | 1198/3000 [36:00<56:13,  1.87s/it, lr: 1.0e-04 loss: 2.615e-01]
windy_storm:  40%|###9      | 1198/3000 [36:00<56:13,  1.87s/it, lr: 1.0e-04 loss: 2.615e-01]
windy_storm:  40%|###9      | 1199/3000 [36:00<46:14,  1.54s/it, lr: 1.0e-04 loss: 2.615e-01]
windy_storm:  40%|###9      | 1199/3000 [36:00<46:14,  1.54s/it, lr: 1.0e-04 loss: 2.615e-01]
windy_storm:  40%|###9      | 1199/3000 [36:03<46:14,  1.54s/it, lr: 1.0e-04 loss: 1.376e-01]
windy_storm:  40%|###9      | 1199/3000 [36:03<46:14,  1.54s/it, lr: 1.0e-04 loss: 1.376e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.43s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.43s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.39s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.39s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.39s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.39s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.39s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.39s/it]


Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.39s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.39s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.38s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.38s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  40%|####      | 1200/3000 [36:06<46:12,  1.54s/it, lr: 1.0e-04 loss: 2.970e-01]
windy_storm:  40%|####      | 1200/3000 [36:06<46:12,  1.54s/it, lr: 1.0e-04 loss: 2.970e-01]
windy_storm:  40%|####      | 1201/3000 [36:06<45:39,  1.52s/it, lr: 1.0e-04 loss: 2.970e-01]
windy_storm:  40%|####      | 1201/3000 [36:06<45:39,  1.52s/it, lr: 1.0e-04 loss: 2.970e-01]
windy_storm:  40%|####      | 1201/3000 [36:09<45:39,  1.52s/it, lr: 1.0e-04 loss: 2.908e-01]
windy_storm:  40%|####      | 1201/3000 [36:09<45:39,  1.52s/it, lr: 1.0e-04 loss: 2.908e-01]
windy_storm:  40%|####      | 1202/3000 [36:09<55:50,  1.86s/it, lr: 1.0e-04 loss: 2.908e-01]
windy_storm:  40%|####      | 1202/3000 [36:09<55:50,  1.86s/it, lr: 1.0e-04 loss: 2.908e-01]
windy_storm:  40%|####      | 1202/3000 [36:10<55:50,  1.86s/it, lr: 1.0e-04 loss: 5.538e-01]
windy_storm:  40%|####      | 1202/3000 [36:10<55:50,  1.86s/it, lr: 1.0e-04 loss: 5.538e-01]
windy_storm:  40%|####      | 1203/3000 [36:10<53:37,  1.79s/it, lr: 1.0e-04 loss: 5.538e-01]
windy_storm:  40%|####      | 1203/3000 [36:10<53:37,  1.79s/it, lr: 1.0e-04 loss: 5.538e-01]
windy_storm:  40%|####      | 1203/3000 [36:13<53:37,  1.79s/it, lr: 1.0e-04 loss: 3.098e-01]
windy_storm:  40%|####      | 1203/3000 [36:13<53:37,  1.79s/it, lr: 1.0e-04 loss: 3.098e-01]
windy_storm:  40%|####      | 1204/3000 [36:13<1:02:49,  2.10s/it, lr: 1.0e-04 loss: 3.098e-01]
windy_storm:  40%|####      | 1204/3000 [36:13<1:02:49,  2.10s/it, lr: 1.0e-04 loss: 3.098e-01]
windy_storm:  40%|####      | 1204/3000 [36:16<1:02:49,  2.10s/it, lr: 1.0e-04 loss: 1.622e-01]
windy_storm:  40%|####      | 1204/3000 [36:16<1:02:49,  2.10s/it, lr: 1.0e-04 loss: 1.622e-01]
windy_storm:  40%|####      | 1205/3000 [36:16<1:10:34,  2.36s/it, lr: 1.0e-04 loss: 1.622e-01]
windy_storm:  40%|####      | 1205/3000 [36:16<1:10:34,  2.36s/it, lr: 1.0e-04 loss: 1.622e-01]
windy_storm:  40%|####      | 1205/3000 [36:18<1:10:34,  2.36s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  40%|####      | 1205/3000 [36:18<1:10:34,  2.36s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  40%|####      | 1206/3000 [36:18<1:03:33,  2.13s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  40%|####      | 1206/3000 [36:18<1:03:33,  2.13s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  40%|####      | 1206/3000 [36:20<1:03:33,  2.13s/it, lr: 1.0e-04 loss: 3.585e-01]
windy_storm:  40%|####      | 1206/3000 [36:20<1:03:33,  2.13s/it, lr: 1.0e-04 loss: 3.585e-01]
windy_storm:  40%|####      | 1207/3000 [36:20<58:52,  1.97s/it, lr: 1.0e-04 loss: 3.585e-01]  
windy_storm:  40%|####      | 1207/3000 [36:20<58:52,  1.97s/it, lr: 1.0e-04 loss: 3.585e-01]  
windy_storm:  40%|####      | 1207/3000 [36:23<58:52,  1.97s/it, lr: 1.0e-04 loss: 5.862e-01]
windy_storm:  40%|####      | 1207/3000 [36:23<58:52,  1.97s/it, lr: 1.0e-04 loss: 5.862e-01]
windy_storm:  40%|####      | 1208/3000 [36:23<1:07:49,  2.27s/it, lr: 1.0e-04 loss: 5.862e-01]
windy_storm:  40%|####      | 1208/3000 [36:23<1:07:49,  2.27s/it, lr: 1.0e-04 loss: 5.862e-01]
windy_storm:  40%|####      | 1208/3000 [36:23<1:07:49,  2.27s/it, lr: 1.0e-04 loss: 2.514e-01]
windy_storm:  40%|####      | 1208/3000 [36:23<1:07:49,  2.27s/it, lr: 1.0e-04 loss: 2.514e-01]
windy_storm:  40%|####      | 1209/3000 [36:23<54:30,  1.83s/it, lr: 1.0e-04 loss: 2.514e-01]  
windy_storm:  40%|####      | 1209/3000 [36:23<54:30,  1.83s/it, lr: 1.0e-04 loss: 2.514e-01]  
windy_storm:  40%|####      | 1209/3000 [36:24<54:30,  1.83s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  40%|####      | 1209/3000 [36:24<54:30,  1.83s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  40%|####      | 1210/3000 [36:27<54:28,  1.83s/it, lr: 1.0e-04 loss: 5.027e-01]
windy_storm:  40%|####      | 1210/3000 [36:27<54:28,  1.83s/it, lr: 1.0e-04 loss: 5.027e-01]
windy_storm:  40%|####      | 1211/3000 [36:27<49:39,  1.67s/it, lr: 1.0e-04 loss: 5.027e-01]
windy_storm:  40%|####      | 1211/3000 [36:27<49:39,  1.67s/it, lr: 1.0e-04 loss: 5.027e-01]
windy_storm:  40%|####      | 1211/3000 [36:29<49:39,  1.67s/it, lr: 1.0e-04 loss: 5.378e-01]
windy_storm:  40%|####      | 1211/3000 [36:29<49:39,  1.67s/it, lr: 1.0e-04 loss: 5.378e-01]
windy_storm:  40%|####      | 1212/3000 [36:29<49:04,  1.65s/it, lr: 1.0e-04 loss: 5.378e-01]
windy_storm:  40%|####      | 1212/3000 [36:29<49:04,  1.65s/it, lr: 1.0e-04 loss: 5.378e-01]
windy_storm:  40%|####      | 1212/3000 [36:30<49:04,  1.65s/it, lr: 1.0e-04 loss: 4.703e-01]
windy_storm:  40%|####      | 1212/3000 [36:30<49:04,  1.65s/it, lr: 1.0e-04 loss: 4.703e-01]
windy_storm:  40%|####      | 1213/3000 [36:30<44:10,  1.48s/it, lr: 1.0e-04 loss: 4.703e-01]
windy_storm:  40%|####      | 1213/3000 [36:30<44:10,  1.48s/it, lr: 1.0e-04 loss: 4.703e-01]
windy_storm:  40%|####      | 1213/3000 [36:31<44:10,  1.48s/it, lr: 1.0e-04 loss: 6.244e-01]
windy_storm:  40%|####      | 1213/3000 [36:31<44:10,  1.48s/it, lr: 1.0e-04 loss: 6.244e-01]
windy_storm:  40%|####      | 1214/3000 [36:31<44:40,  1.50s/it, lr: 1.0e-04 loss: 6.244e-01]
windy_storm:  40%|####      | 1214/3000 [36:31<44:40,  1.50s/it, lr: 1.0e-04 loss: 6.244e-01]
windy_storm:  40%|####      | 1214/3000 [36:33<44:40,  1.50s/it, lr: 1.0e-04 loss: 2.193e-01]
windy_storm:  40%|####      | 1214/3000 [36:33<44:40,  1.50s/it, lr: 1.0e-04 loss: 2.193e-01]
windy_storm:  40%|####      | 1215/3000 [36:33<45:19,  1.52s/it, lr: 1.0e-04 loss: 2.193e-01]
windy_storm:  40%|####      | 1215/3000 [36:33<45:19,  1.52s/it, lr: 1.0e-04 loss: 2.193e-01]
windy_storm:  40%|####      | 1215/3000 [36:34<45:19,  1.52s/it, lr: 1.0e-04 loss: 1.839e-01]
windy_storm:  40%|####      | 1215/3000 [36:34<45:19,  1.52s/it, lr: 1.0e-04 loss: 1.839e-01]
windy_storm:  41%|####      | 1216/3000 [36:34<39:24,  1.33s/it, lr: 1.0e-04 loss: 1.839e-01]
windy_storm:  41%|####      | 1216/3000 [36:34<39:24,  1.33s/it, lr: 1.0e-04 loss: 1.839e-01]
windy_storm:  41%|####      | 1216/3000 [36:35<39:24,  1.33s/it, lr: 1.0e-04 loss: 7.307e-01]
windy_storm:  41%|####      | 1216/3000 [36:35<39:24,  1.33s/it, lr: 1.0e-04 loss: 7.307e-01]
windy_storm:  41%|####      | 1217/3000 [36:35<41:33,  1.40s/it, lr: 1.0e-04 loss: 7.307e-01]
windy_storm:  41%|####      | 1217/3000 [36:35<41:33,  1.40s/it, lr: 1.0e-04 loss: 7.307e-01]
windy_storm:  41%|####      | 1217/3000 [36:36<41:33,  1.40s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  41%|####      | 1217/3000 [36:36<41:33,  1.40s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  41%|####      | 1218/3000 [36:36<36:33,  1.23s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  41%|####      | 1218/3000 [36:36<36:33,  1.23s/it, lr: 1.0e-04 loss: 5.156e-01]
windy_storm:  41%|####      | 1218/3000 [36:37<36:33,  1.23s/it, lr: 1.0e-04 loss: 6.284e-02]
windy_storm:  41%|####      | 1218/3000 [36:37<36:33,  1.23s/it, lr: 1.0e-04 loss: 6.284e-02]
windy_storm:  41%|####      | 1219/3000 [36:37<33:01,  1.11s/it, lr: 1.0e-04 loss: 6.284e-02]
windy_storm:  41%|####      | 1219/3000 [36:37<33:01,  1.11s/it, lr: 1.0e-04 loss: 6.284e-02]
windy_storm:  41%|####      | 1219/3000 [36:40<33:01,  1.11s/it, lr: 1.0e-04 loss: 5.078e-01]
windy_storm:  41%|####      | 1219/3000 [36:40<33:01,  1.11s/it, lr: 1.0e-04 loss: 5.078e-01]
windy_storm:  41%|####      | 1220/3000 [36:41<33:00,  1.11s/it, lr: 1.0e-04 loss: 3.839e-01]
windy_storm:  41%|####      | 1220/3000 [36:41<33:00,  1.11s/it, lr: 1.0e-04 loss: 3.839e-01]
windy_storm:  41%|####      | 1221/3000 [36:41<28:11,  1.05it/s, lr: 1.0e-04 loss: 3.839e-01]
windy_storm:  41%|####      | 1221/3000 [36:41<28:11,  1.05it/s, lr: 1.0e-04 loss: 3.839e-01]
windy_storm:  41%|####      | 1221/3000 [36:42<28:11,  1.05it/s, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:  41%|####      | 1221/3000 [36:42<28:11,  1.05it/s, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:  41%|####      | 1222/3000 [36:42<26:52,  1.10it/s, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:  41%|####      | 1222/3000 [36:42<26:52,  1.10it/s, lr: 1.0e-04 loss: 3.806e-01]
windy_storm:  41%|####      | 1222/3000 [36:43<26:52,  1.10it/s, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:  41%|####      | 1222/3000 [36:43<26:52,  1.10it/s, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:  41%|####      | 1223/3000 [36:43<25:41,  1.15it/s, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:  41%|####      | 1223/3000 [36:43<25:41,  1.15it/s, lr: 1.0e-04 loss: 2.576e-01]
windy_storm:  41%|####      | 1223/3000 [36:45<25:41,  1.15it/s, lr: 1.0e-04 loss: 3.588e-01]
windy_storm:  41%|####      | 1223/3000 [36:45<25:41,  1.15it/s, lr: 1.0e-04 loss: 3.588e-01]
windy_storm:  41%|####      | 1224/3000 [36:45<31:26,  1.06s/it, lr: 1.0e-04 loss: 3.588e-01]
windy_storm:  41%|####      | 1224/3000 [36:45<31:26,  1.06s/it, lr: 1.0e-04 loss: 3.588e-01]
windy_storm:  41%|####      | 1224/3000 [36:46<31:26,  1.06s/it, lr: 1.0e-04 loss: 5.163e-01]
windy_storm:  41%|####      | 1224/3000 [36:46<31:26,  1.06s/it, lr: 1.0e-04 loss: 5.163e-01]
windy_storm:  41%|####      | 1225/3000 [36:46<35:37,  1.20s/it, lr: 1.0e-04 loss: 5.163e-01]
windy_storm:  41%|####      | 1225/3000 [36:46<35:37,  1.20s/it, lr: 1.0e-04 loss: 5.163e-01]
windy_storm:  41%|####      | 1225/3000 [36:47<35:37,  1.20s/it, lr: 1.0e-04 loss: 4.951e-01]
windy_storm:  41%|####      | 1225/3000 [36:47<35:37,  1.20s/it, lr: 1.0e-04 loss: 4.951e-01]
windy_storm:  41%|####      | 1226/3000 [36:47<32:37,  1.10s/it, lr: 1.0e-04 loss: 4.951e-01]
windy_storm:  41%|####      | 1226/3000 [36:47<32:37,  1.10s/it, lr: 1.0e-04 loss: 4.951e-01]
windy_storm:  41%|####      | 1226/3000 [36:48<32:37,  1.10s/it, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  41%|####      | 1226/3000 [36:48<32:37,  1.10s/it, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  41%|####      | 1227/3000 [36:48<29:25,  1.00it/s, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  41%|####      | 1227/3000 [36:48<29:25,  1.00it/s, lr: 1.0e-04 loss: 2.733e-01]
windy_storm:  41%|####      | 1227/3000 [36:49<29:25,  1.00it/s, lr: 1.0e-04 loss: 3.235e-02]
windy_storm:  41%|####      | 1227/3000 [36:49<29:25,  1.00it/s, lr: 1.0e-04 loss: 3.235e-02]
windy_storm:  41%|####      | 1228/3000 [36:49<35:29,  1.20s/it, lr: 1.0e-04 loss: 3.235e-02]
windy_storm:  41%|####      | 1228/3000 [36:49<35:29,  1.20s/it, lr: 1.0e-04 loss: 3.235e-02]
windy_storm:  41%|####      | 1228/3000 [36:50<35:29,  1.20s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  41%|####      | 1228/3000 [36:50<35:29,  1.20s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  41%|####      | 1229/3000 [36:50<31:30,  1.07s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  41%|####      | 1229/3000 [36:50<31:30,  1.07s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  41%|####      | 1229/3000 [36:53<31:30,  1.07s/it, lr: 1.0e-04 loss: 1.692e-01]
windy_storm:  41%|####      | 1229/3000 [36:53<31:30,  1.07s/it, lr: 1.0e-04 loss: 1.692e-01]
windy_storm:  41%|####1     | 1230/3000 [36:54<31:29,  1.07s/it, lr: 1.0e-04 loss: 4.250e-01]
windy_storm:  41%|####1     | 1230/3000 [36:54<31:29,  1.07s/it, lr: 1.0e-04 loss: 4.250e-01]
windy_storm:  41%|####1     | 1231/3000 [36:54<22:15,  1.32it/s, lr: 1.0e-04 loss: 4.250e-01]
windy_storm:  41%|####1     | 1231/3000 [36:54<22:15,  1.32it/s, lr: 1.0e-04 loss: 4.250e-01]
windy_storm:  41%|####1     | 1231/3000 [36:57<22:15,  1.32it/s, lr: 1.0e-04 loss: 2.478e-01]
windy_storm:  41%|####1     | 1231/3000 [36:57<22:15,  1.32it/s, lr: 1.0e-04 loss: 2.478e-01]
windy_storm:  41%|####1     | 1232/3000 [36:57<38:45,  1.32s/it, lr: 1.0e-04 loss: 2.478e-01]
windy_storm:  41%|####1     | 1232/3000 [36:57<38:45,  1.32s/it, lr: 1.0e-04 loss: 2.478e-01]
windy_storm:  41%|####1     | 1232/3000 [36:58<38:45,  1.32s/it, lr: 1.0e-04 loss: 4.217e-01]
windy_storm:  41%|####1     | 1232/3000 [36:58<38:45,  1.32s/it, lr: 1.0e-04 loss: 4.217e-01]
windy_storm:  41%|####1     | 1233/3000 [36:58<34:57,  1.19s/it, lr: 1.0e-04 loss: 4.217e-01]
windy_storm:  41%|####1     | 1233/3000 [36:58<34:57,  1.19s/it, lr: 1.0e-04 loss: 4.217e-01]
windy_storm:  41%|####1     | 1233/3000 [36:59<34:57,  1.19s/it, lr: 1.0e-04 loss: 4.989e-01]
windy_storm:  41%|####1     | 1233/3000 [36:59<34:57,  1.19s/it, lr: 1.0e-04 loss: 4.989e-01]
windy_storm:  41%|####1     | 1234/3000 [36:59<32:04,  1.09s/it, lr: 1.0e-04 loss: 4.989e-01]
windy_storm:  41%|####1     | 1234/3000 [36:59<32:04,  1.09s/it, lr: 1.0e-04 loss: 4.989e-01]
windy_storm:  41%|####1     | 1234/3000 [37:00<32:04,  1.09s/it, lr: 1.0e-04 loss: 6.170e-01]
windy_storm:  41%|####1     | 1234/3000 [37:00<32:04,  1.09s/it, lr: 1.0e-04 loss: 6.170e-01]
windy_storm:  41%|####1     | 1235/3000 [37:00<36:00,  1.22s/it, lr: 1.0e-04 loss: 6.170e-01]
windy_storm:  41%|####1     | 1235/3000 [37:00<36:00,  1.22s/it, lr: 1.0e-04 loss: 6.170e-01]
windy_storm:  41%|####1     | 1235/3000 [37:02<36:00,  1.22s/it, lr: 1.0e-04 loss: 9.128e-02]
windy_storm:  41%|####1     | 1235/3000 [37:02<36:00,  1.22s/it, lr: 1.0e-04 loss: 9.128e-02]
windy_storm:  41%|####1     | 1236/3000 [37:02<39:02,  1.33s/it, lr: 1.0e-04 loss: 9.128e-02]
windy_storm:  41%|####1     | 1236/3000 [37:02<39:02,  1.33s/it, lr: 1.0e-04 loss: 9.128e-02]
windy_storm:  41%|####1     | 1236/3000 [37:03<39:02,  1.33s/it, lr: 1.0e-04 loss: 5.365e-01]
windy_storm:  41%|####1     | 1236/3000 [37:03<39:02,  1.33s/it, lr: 1.0e-04 loss: 5.365e-01]
windy_storm:  41%|####1     | 1237/3000 [37:03<41:13,  1.40s/it, lr: 1.0e-04 loss: 5.365e-01]
windy_storm:  41%|####1     | 1237/3000 [37:03<41:13,  1.40s/it, lr: 1.0e-04 loss: 5.365e-01]
windy_storm:  41%|####1     | 1237/3000 [37:06<41:13,  1.40s/it, lr: 1.0e-04 loss: 2.603e-01]
windy_storm:  41%|####1     | 1237/3000 [37:06<41:13,  1.40s/it, lr: 1.0e-04 loss: 2.603e-01]
windy_storm:  41%|####1     | 1238/3000 [37:06<55:19,  1.88s/it, lr: 1.0e-04 loss: 2.603e-01]
windy_storm:  41%|####1     | 1238/3000 [37:06<55:19,  1.88s/it, lr: 1.0e-04 loss: 2.603e-01]
windy_storm:  41%|####1     | 1238/3000 [37:09<55:19,  1.88s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  41%|####1     | 1238/3000 [37:09<55:19,  1.88s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  41%|####1     | 1239/3000 [37:09<1:05:15,  2.22s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  41%|####1     | 1239/3000 [37:09<1:05:15,  2.22s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  41%|####1     | 1239/3000 [37:12<1:05:15,  2.22s/it, lr: 1.0e-04 loss: 3.396e-02]
windy_storm:  41%|####1     | 1239/3000 [37:12<1:05:15,  2.22s/it, lr: 1.0e-04 loss: 3.396e-02]
windy_storm:  41%|####1     | 1240/3000 [37:13<1:05:13,  2.22s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  41%|####1     | 1240/3000 [37:13<1:05:13,  2.22s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  41%|####1     | 1241/3000 [37:13<40:59,  1.40s/it, lr: 1.0e-04 loss: 5.908e-01]  
windy_storm:  41%|####1     | 1241/3000 [37:13<40:59,  1.40s/it, lr: 1.0e-04 loss: 5.908e-01]  
windy_storm:  41%|####1     | 1241/3000 [37:16<40:59,  1.40s/it, lr: 1.0e-04 loss: 1.382e-01]
windy_storm:  41%|####1     | 1241/3000 [37:16<40:59,  1.40s/it, lr: 1.0e-04 loss: 1.382e-01]
windy_storm:  41%|####1     | 1242/3000 [37:16<53:47,  1.84s/it, lr: 1.0e-04 loss: 1.382e-01]
windy_storm:  41%|####1     | 1242/3000 [37:16<53:47,  1.84s/it, lr: 1.0e-04 loss: 1.382e-01]
windy_storm:  41%|####1     | 1242/3000 [37:18<53:47,  1.84s/it, lr: 1.0e-04 loss: 2.928e-01]
windy_storm:  41%|####1     | 1242/3000 [37:18<53:47,  1.84s/it, lr: 1.0e-04 loss: 2.928e-01]
windy_storm:  41%|####1     | 1243/3000 [37:18<51:51,  1.77s/it, lr: 1.0e-04 loss: 2.928e-01]
windy_storm:  41%|####1     | 1243/3000 [37:18<51:51,  1.77s/it, lr: 1.0e-04 loss: 2.928e-01]
windy_storm:  41%|####1     | 1243/3000 [37:21<51:51,  1.77s/it, lr: 1.0e-04 loss: 4.485e-01]
windy_storm:  41%|####1     | 1243/3000 [37:21<51:51,  1.77s/it, lr: 1.0e-04 loss: 4.485e-01]
windy_storm:  41%|####1     | 1244/3000 [37:21<1:01:43,  2.11s/it, lr: 1.0e-04 loss: 4.485e-01]
windy_storm:  41%|####1     | 1244/3000 [37:21<1:01:43,  2.11s/it, lr: 1.0e-04 loss: 4.485e-01]
windy_storm:  41%|####1     | 1244/3000 [37:23<1:01:43,  2.11s/it, lr: 1.0e-04 loss: 5.963e-02]
windy_storm:  41%|####1     | 1244/3000 [37:23<1:01:43,  2.11s/it, lr: 1.0e-04 loss: 5.963e-02]
windy_storm:  42%|####1     | 1245/3000 [37:23<57:24,  1.96s/it, lr: 1.0e-04 loss: 5.963e-02]  
windy_storm:  42%|####1     | 1245/3000 [37:23<57:24,  1.96s/it, lr: 1.0e-04 loss: 5.963e-02]  
windy_storm:  42%|####1     | 1245/3000 [37:23<57:24,  1.96s/it, lr: 1.0e-04 loss: 6.476e-01]
windy_storm:  42%|####1     | 1245/3000 [37:23<57:24,  1.96s/it, lr: 1.0e-04 loss: 6.476e-01]
windy_storm:  42%|####1     | 1246/3000 [37:23<47:50,  1.64s/it, lr: 1.0e-04 loss: 6.476e-01]
windy_storm:  42%|####1     | 1246/3000 [37:23<47:50,  1.64s/it, lr: 1.0e-04 loss: 6.476e-01]
windy_storm:  42%|####1     | 1246/3000 [37:24<47:50,  1.64s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  42%|####1     | 1246/3000 [37:24<47:50,  1.64s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  42%|####1     | 1247/3000 [37:24<41:01,  1.40s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  42%|####1     | 1247/3000 [37:24<41:01,  1.40s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  42%|####1     | 1247/3000 [37:25<41:01,  1.40s/it, lr: 1.0e-04 loss: 6.095e-01]
windy_storm:  42%|####1     | 1247/3000 [37:25<41:01,  1.40s/it, lr: 1.0e-04 loss: 6.095e-01]
windy_storm:  42%|####1     | 1248/3000 [37:25<35:25,  1.21s/it, lr: 1.0e-04 loss: 6.095e-01]
windy_storm:  42%|####1     | 1248/3000 [37:25<35:25,  1.21s/it, lr: 1.0e-04 loss: 6.095e-01]
windy_storm:  42%|####1     | 1248/3000 [37:27<35:25,  1.21s/it, lr: 1.0e-04 loss: 6.524e-01]
windy_storm:  42%|####1     | 1248/3000 [37:27<35:25,  1.21s/it, lr: 1.0e-04 loss: 6.524e-01]
windy_storm:  42%|####1     | 1249/3000 [37:27<38:40,  1.33s/it, lr: 1.0e-04 loss: 6.524e-01]
windy_storm:  42%|####1     | 1249/3000 [37:27<38:40,  1.33s/it, lr: 1.0e-04 loss: 6.524e-01]
windy_storm:  42%|####1     | 1249/3000 [37:27<38:40,  1.33s/it, lr: 1.0e-04 loss: 6.249e-01]
windy_storm:  42%|####1     | 1249/3000 [37:27<38:40,  1.33s/it, lr: 1.0e-04 loss: 6.249e-01]
Saving at step 1250
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000001250.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000000250.safetensors

windy_storm:  42%|####1     | 1250/3000 [37:28<38:39,  1.33s/it, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  42%|####1     | 1250/3000 [37:28<38:39,  1.33s/it, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  42%|####1     | 1251/3000 [37:28<27:22,  1.07it/s, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  42%|####1     | 1251/3000 [37:28<27:22,  1.07it/s, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  42%|####1     | 1251/3000 [37:30<27:22,  1.07it/s, lr: 1.0e-04 loss: 4.932e-02]
windy_storm:  42%|####1     | 1251/3000 [37:30<27:22,  1.07it/s, lr: 1.0e-04 loss: 4.932e-02]
windy_storm:  42%|####1     | 1252/3000 [37:30<31:48,  1.09s/it, lr: 1.0e-04 loss: 4.932e-02]
windy_storm:  42%|####1     | 1252/3000 [37:30<31:48,  1.09s/it, lr: 1.0e-04 loss: 4.932e-02]
windy_storm:  42%|####1     | 1252/3000 [37:31<31:48,  1.09s/it, lr: 1.0e-04 loss: 5.624e-01]
windy_storm:  42%|####1     | 1252/3000 [37:31<31:48,  1.09s/it, lr: 1.0e-04 loss: 5.624e-01]
windy_storm:  42%|####1     | 1253/3000 [37:31<29:15,  1.00s/it, lr: 1.0e-04 loss: 5.624e-01]
windy_storm:  42%|####1     | 1253/3000 [37:31<29:15,  1.00s/it, lr: 1.0e-04 loss: 5.624e-01]
windy_storm:  42%|####1     | 1253/3000 [37:34<29:15,  1.00s/it, lr: 1.0e-04 loss: 3.374e-02]
windy_storm:  42%|####1     | 1253/3000 [37:34<29:15,  1.00s/it, lr: 1.0e-04 loss: 3.374e-02]
windy_storm:  42%|####1     | 1254/3000 [37:34<44:48,  1.54s/it, lr: 1.0e-04 loss: 3.374e-02]
windy_storm:  42%|####1     | 1254/3000 [37:34<44:48,  1.54s/it, lr: 1.0e-04 loss: 3.374e-02]
windy_storm:  42%|####1     | 1254/3000 [37:34<44:48,  1.54s/it, lr: 1.0e-04 loss: 6.223e-01]
windy_storm:  42%|####1     | 1254/3000 [37:34<44:48,  1.54s/it, lr: 1.0e-04 loss: 6.223e-01]
windy_storm:  42%|####1     | 1255/3000 [37:34<38:52,  1.34s/it, lr: 1.0e-04 loss: 6.223e-01]
windy_storm:  42%|####1     | 1255/3000 [37:34<38:52,  1.34s/it, lr: 1.0e-04 loss: 6.223e-01]
windy_storm:  42%|####1     | 1255/3000 [37:37<38:52,  1.34s/it, lr: 1.0e-04 loss: 1.201e-01]
windy_storm:  42%|####1     | 1255/3000 [37:37<38:52,  1.34s/it, lr: 1.0e-04 loss: 1.201e-01]
windy_storm:  42%|####1     | 1256/3000 [37:37<52:37,  1.81s/it, lr: 1.0e-04 loss: 1.201e-01]
windy_storm:  42%|####1     | 1256/3000 [37:37<52:37,  1.81s/it, lr: 1.0e-04 loss: 1.201e-01]
windy_storm:  42%|####1     | 1256/3000 [37:38<52:37,  1.81s/it, lr: 1.0e-04 loss: 1.652e-01]
windy_storm:  42%|####1     | 1256/3000 [37:38<52:37,  1.81s/it, lr: 1.0e-04 loss: 1.652e-01]
windy_storm:  42%|####1     | 1257/3000 [37:38<43:29,  1.50s/it, lr: 1.0e-04 loss: 1.652e-01]
windy_storm:  42%|####1     | 1257/3000 [37:38<43:29,  1.50s/it, lr: 1.0e-04 loss: 1.652e-01]
windy_storm:  42%|####1     | 1257/3000 [37:40<43:29,  1.50s/it, lr: 1.0e-04 loss: 1.516e-02]
windy_storm:  42%|####1     | 1257/3000 [37:40<43:29,  1.50s/it, lr: 1.0e-04 loss: 1.516e-02]
windy_storm:  42%|####1     | 1258/3000 [37:40<44:04,  1.52s/it, lr: 1.0e-04 loss: 1.516e-02]
windy_storm:  42%|####1     | 1258/3000 [37:40<44:04,  1.52s/it, lr: 1.0e-04 loss: 1.516e-02]
windy_storm:  42%|####1     | 1258/3000 [37:41<44:04,  1.52s/it, lr: 1.0e-04 loss: 5.343e-01]
windy_storm:  42%|####1     | 1258/3000 [37:41<44:04,  1.52s/it, lr: 1.0e-04 loss: 5.343e-01]
windy_storm:  42%|####1     | 1259/3000 [37:41<44:30,  1.53s/it, lr: 1.0e-04 loss: 5.343e-01]
windy_storm:  42%|####1     | 1259/3000 [37:41<44:30,  1.53s/it, lr: 1.0e-04 loss: 5.343e-01]
windy_storm:  42%|####1     | 1259/3000 [37:42<44:30,  1.53s/it, lr: 1.0e-04 loss: 8.773e-02]
windy_storm:  42%|####1     | 1259/3000 [37:42<44:30,  1.53s/it, lr: 1.0e-04 loss: 8.773e-02]
windy_storm:  42%|####2     | 1260/3000 [37:43<44:29,  1.53s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  42%|####2     | 1260/3000 [37:43<44:29,  1.53s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  42%|####2     | 1261/3000 [37:43<29:01,  1.00s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  42%|####2     | 1261/3000 [37:43<29:01,  1.00s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  42%|####2     | 1261/3000 [37:44<29:01,  1.00s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  42%|####2     | 1261/3000 [37:44<29:01,  1.00s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  42%|####2     | 1262/3000 [37:44<33:08,  1.14s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  42%|####2     | 1262/3000 [37:44<33:08,  1.14s/it, lr: 1.0e-04 loss: 4.656e-01]
windy_storm:  42%|####2     | 1262/3000 [37:46<33:08,  1.14s/it, lr: 1.0e-04 loss: 6.033e-01]
windy_storm:  42%|####2     | 1262/3000 [37:46<33:08,  1.14s/it, lr: 1.0e-04 loss: 6.033e-01]
windy_storm:  42%|####2     | 1263/3000 [37:46<37:45,  1.30s/it, lr: 1.0e-04 loss: 6.033e-01]
windy_storm:  42%|####2     | 1263/3000 [37:46<37:45,  1.30s/it, lr: 1.0e-04 loss: 6.033e-01]
windy_storm:  42%|####2     | 1263/3000 [37:48<37:45,  1.30s/it, lr: 1.0e-04 loss: 5.428e-01]
windy_storm:  42%|####2     | 1263/3000 [37:48<37:45,  1.30s/it, lr: 1.0e-04 loss: 5.428e-01]
windy_storm:  42%|####2     | 1264/3000 [37:48<39:49,  1.38s/it, lr: 1.0e-04 loss: 5.428e-01]
windy_storm:  42%|####2     | 1264/3000 [37:48<39:49,  1.38s/it, lr: 1.0e-04 loss: 5.428e-01]
windy_storm:  42%|####2     | 1264/3000 [37:49<39:49,  1.38s/it, lr: 1.0e-04 loss: 2.557e-01]
windy_storm:  42%|####2     | 1264/3000 [37:49<39:49,  1.38s/it, lr: 1.0e-04 loss: 2.557e-01]
windy_storm:  42%|####2     | 1265/3000 [37:49<41:15,  1.43s/it, lr: 1.0e-04 loss: 2.557e-01]
windy_storm:  42%|####2     | 1265/3000 [37:49<41:15,  1.43s/it, lr: 1.0e-04 loss: 2.557e-01]
windy_storm:  42%|####2     | 1265/3000 [37:51<41:15,  1.43s/it, lr: 1.0e-04 loss: 2.391e-01]
windy_storm:  42%|####2     | 1265/3000 [37:51<41:15,  1.43s/it, lr: 1.0e-04 loss: 2.391e-01]
windy_storm:  42%|####2     | 1266/3000 [37:51<42:31,  1.47s/it, lr: 1.0e-04 loss: 2.391e-01]
windy_storm:  42%|####2     | 1266/3000 [37:51<42:31,  1.47s/it, lr: 1.0e-04 loss: 2.391e-01]
windy_storm:  42%|####2     | 1266/3000 [37:54<42:31,  1.47s/it, lr: 1.0e-04 loss: 3.667e-01]
windy_storm:  42%|####2     | 1266/3000 [37:54<42:31,  1.47s/it, lr: 1.0e-04 loss: 3.667e-01]
windy_storm:  42%|####2     | 1267/3000 [37:54<55:13,  1.91s/it, lr: 1.0e-04 loss: 3.667e-01]
windy_storm:  42%|####2     | 1267/3000 [37:54<55:13,  1.91s/it, lr: 1.0e-04 loss: 3.667e-01]
windy_storm:  42%|####2     | 1267/3000 [37:57<55:13,  1.91s/it, lr: 1.0e-04 loss: 5.002e-01]
windy_storm:  42%|####2     | 1267/3000 [37:57<55:13,  1.91s/it, lr: 1.0e-04 loss: 5.002e-01]
windy_storm:  42%|####2     | 1268/3000 [37:57<1:03:49,  2.21s/it, lr: 1.0e-04 loss: 5.002e-01]
windy_storm:  42%|####2     | 1268/3000 [37:57<1:03:49,  2.21s/it, lr: 1.0e-04 loss: 5.002e-01]
windy_storm:  42%|####2     | 1268/3000 [37:58<1:03:49,  2.21s/it, lr: 1.0e-04 loss: 2.395e-01]
windy_storm:  42%|####2     | 1268/3000 [37:58<1:03:49,  2.21s/it, lr: 1.0e-04 loss: 2.395e-01]
windy_storm:  42%|####2     | 1269/3000 [37:58<51:57,  1.80s/it, lr: 1.0e-04 loss: 2.395e-01]  
windy_storm:  42%|####2     | 1269/3000 [37:58<51:57,  1.80s/it, lr: 1.0e-04 loss: 2.395e-01]  
windy_storm:  42%|####2     | 1269/3000 [37:58<51:57,  1.80s/it, lr: 1.0e-04 loss: 4.465e-01]
windy_storm:  42%|####2     | 1269/3000 [37:58<51:57,  1.80s/it, lr: 1.0e-04 loss: 4.465e-01]
windy_storm:  42%|####2     | 1270/3000 [37:59<51:55,  1.80s/it, lr: 1.0e-04 loss: 5.436e-01]
windy_storm:  42%|####2     | 1270/3000 [37:59<51:55,  1.80s/it, lr: 1.0e-04 loss: 5.436e-01]
windy_storm:  42%|####2     | 1271/3000 [37:59<33:07,  1.15s/it, lr: 1.0e-04 loss: 5.436e-01]
windy_storm:  42%|####2     | 1271/3000 [37:59<33:07,  1.15s/it, lr: 1.0e-04 loss: 5.436e-01]
windy_storm:  42%|####2     | 1271/3000 [38:00<33:07,  1.15s/it, lr: 1.0e-04 loss: 2.588e-01]
windy_storm:  42%|####2     | 1271/3000 [38:00<33:07,  1.15s/it, lr: 1.0e-04 loss: 2.588e-01]
windy_storm:  42%|####2     | 1272/3000 [38:00<30:14,  1.05s/it, lr: 1.0e-04 loss: 2.588e-01]
windy_storm:  42%|####2     | 1272/3000 [38:00<30:14,  1.05s/it, lr: 1.0e-04 loss: 2.588e-01]
windy_storm:  42%|####2     | 1272/3000 [38:03<30:14,  1.05s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  42%|####2     | 1272/3000 [38:03<30:14,  1.05s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  42%|####2     | 1273/3000 [38:03<44:11,  1.54s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  42%|####2     | 1273/3000 [38:03<44:11,  1.54s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  42%|####2     | 1273/3000 [38:04<44:11,  1.54s/it, lr: 1.0e-04 loss: 3.440e-01]
windy_storm:  42%|####2     | 1273/3000 [38:04<44:11,  1.54s/it, lr: 1.0e-04 loss: 3.440e-01]
windy_storm:  42%|####2     | 1274/3000 [38:04<44:28,  1.55s/it, lr: 1.0e-04 loss: 3.440e-01]
windy_storm:  42%|####2     | 1274/3000 [38:04<44:28,  1.55s/it, lr: 1.0e-04 loss: 3.440e-01]
windy_storm:  42%|####2     | 1274/3000 [38:07<44:28,  1.55s/it, lr: 1.0e-04 loss: 2.010e-01]
windy_storm:  42%|####2     | 1274/3000 [38:07<44:28,  1.55s/it, lr: 1.0e-04 loss: 2.010e-01]
windy_storm:  42%|####2     | 1275/3000 [38:07<55:37,  1.93s/it, lr: 1.0e-04 loss: 2.010e-01]
windy_storm:  42%|####2     | 1275/3000 [38:07<55:37,  1.93s/it, lr: 1.0e-04 loss: 2.010e-01]
windy_storm:  42%|####2     | 1275/3000 [38:09<55:37,  1.93s/it, lr: 1.0e-04 loss: 5.745e-01]
windy_storm:  42%|####2     | 1275/3000 [38:09<55:37,  1.93s/it, lr: 1.0e-04 loss: 5.745e-01]
windy_storm:  43%|####2     | 1276/3000 [38:09<52:31,  1.83s/it, lr: 1.0e-04 loss: 5.745e-01]
windy_storm:  43%|####2     | 1276/3000 [38:09<52:31,  1.83s/it, lr: 1.0e-04 loss: 5.745e-01]
windy_storm:  43%|####2     | 1276/3000 [38:12<52:31,  1.83s/it, lr: 1.0e-04 loss: 6.838e-01]
windy_storm:  43%|####2     | 1276/3000 [38:12<52:31,  1.83s/it, lr: 1.0e-04 loss: 6.838e-01]
windy_storm:  43%|####2     | 1277/3000 [38:12<1:02:16,  2.17s/it, lr: 1.0e-04 loss: 6.838e-01]
windy_storm:  43%|####2     | 1277/3000 [38:12<1:02:16,  2.17s/it, lr: 1.0e-04 loss: 6.838e-01]
windy_storm:  43%|####2     | 1277/3000 [38:15<1:02:16,  2.17s/it, lr: 1.0e-04 loss: 2.188e-01]
windy_storm:  43%|####2     | 1277/3000 [38:15<1:02:16,  2.17s/it, lr: 1.0e-04 loss: 2.188e-01]
windy_storm:  43%|####2     | 1278/3000 [38:15<1:09:32,  2.42s/it, lr: 1.0e-04 loss: 2.188e-01]
windy_storm:  43%|####2     | 1278/3000 [38:15<1:09:32,  2.42s/it, lr: 1.0e-04 loss: 2.188e-01]
windy_storm:  43%|####2     | 1278/3000 [38:18<1:09:32,  2.42s/it, lr: 1.0e-04 loss: 1.693e-01]
windy_storm:  43%|####2     | 1278/3000 [38:18<1:09:32,  2.42s/it, lr: 1.0e-04 loss: 1.693e-01]
windy_storm:  43%|####2     | 1279/3000 [38:18<1:13:29,  2.56s/it, lr: 1.0e-04 loss: 1.693e-01]
windy_storm:  43%|####2     | 1279/3000 [38:18<1:13:29,  2.56s/it, lr: 1.0e-04 loss: 1.693e-01]
windy_storm:  43%|####2     | 1279/3000 [38:21<1:13:29,  2.56s/it, lr: 1.0e-04 loss: 2.514e-01]
windy_storm:  43%|####2     | 1279/3000 [38:21<1:13:29,  2.56s/it, lr: 1.0e-04 loss: 2.514e-01]
windy_storm:  43%|####2     | 1280/3000 [38:22<1:13:26,  2.56s/it, lr: 1.0e-04 loss: 6.255e-02]
windy_storm:  43%|####2     | 1280/3000 [38:22<1:13:26,  2.56s/it, lr: 1.0e-04 loss: 6.255e-02]
windy_storm:  43%|####2     | 1281/3000 [38:22<50:11,  1.75s/it, lr: 1.0e-04 loss: 6.255e-02]  
windy_storm:  43%|####2     | 1281/3000 [38:22<50:11,  1.75s/it, lr: 1.0e-04 loss: 6.255e-02]  
windy_storm:  43%|####2     | 1281/3000 [38:25<50:11,  1.75s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  43%|####2     | 1281/3000 [38:25<50:11,  1.75s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  43%|####2     | 1282/3000 [38:25<59:01,  2.06s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  43%|####2     | 1282/3000 [38:25<59:01,  2.06s/it, lr: 1.0e-04 loss: 5.831e-01]
windy_storm:  43%|####2     | 1282/3000 [38:26<59:01,  2.06s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  43%|####2     | 1282/3000 [38:26<59:01,  2.06s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  43%|####2     | 1283/3000 [38:26<49:18,  1.72s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  43%|####2     | 1283/3000 [38:26<49:18,  1.72s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  43%|####2     | 1283/3000 [38:29<49:18,  1.72s/it, lr: 1.0e-04 loss: 9.748e-02]
windy_storm:  43%|####2     | 1283/3000 [38:29<49:18,  1.72s/it, lr: 1.0e-04 loss: 9.748e-02]
windy_storm:  43%|####2     | 1284/3000 [38:29<58:36,  2.05s/it, lr: 1.0e-04 loss: 9.748e-02]
windy_storm:  43%|####2     | 1284/3000 [38:29<58:36,  2.05s/it, lr: 1.0e-04 loss: 9.748e-02]
windy_storm:  43%|####2     | 1284/3000 [38:31<58:36,  2.05s/it, lr: 1.0e-04 loss: 6.450e-01]
windy_storm:  43%|####2     | 1284/3000 [38:31<58:36,  2.05s/it, lr: 1.0e-04 loss: 6.450e-01]
windy_storm:  43%|####2     | 1285/3000 [38:31<54:58,  1.92s/it, lr: 1.0e-04 loss: 6.450e-01]
windy_storm:  43%|####2     | 1285/3000 [38:31<54:58,  1.92s/it, lr: 1.0e-04 loss: 6.450e-01]
windy_storm:  43%|####2     | 1285/3000 [38:34<54:58,  1.92s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  43%|####2     | 1285/3000 [38:34<54:58,  1.92s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  43%|####2     | 1286/3000 [38:34<1:03:06,  2.21s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  43%|####2     | 1286/3000 [38:34<1:03:06,  2.21s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  43%|####2     | 1286/3000 [38:37<1:03:06,  2.21s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  43%|####2     | 1286/3000 [38:37<1:03:06,  2.21s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  43%|####2     | 1287/3000 [38:37<1:08:52,  2.41s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  43%|####2     | 1287/3000 [38:37<1:08:52,  2.41s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  43%|####2     | 1287/3000 [38:40<1:08:52,  2.41s/it, lr: 1.0e-04 loss: 4.267e-01]
windy_storm:  43%|####2     | 1287/3000 [38:40<1:08:52,  2.41s/it, lr: 1.0e-04 loss: 4.267e-01]
windy_storm:  43%|####2     | 1288/3000 [38:40<1:13:27,  2.57s/it, lr: 1.0e-04 loss: 4.267e-01]
windy_storm:  43%|####2     | 1288/3000 [38:40<1:13:27,  2.57s/it, lr: 1.0e-04 loss: 4.267e-01]
windy_storm:  43%|####2     | 1288/3000 [38:41<1:13:27,  2.57s/it, lr: 1.0e-04 loss: 3.116e-01]
windy_storm:  43%|####2     | 1288/3000 [38:41<1:13:27,  2.57s/it, lr: 1.0e-04 loss: 3.116e-01]
windy_storm:  43%|####2     | 1289/3000 [38:41<1:04:51,  2.27s/it, lr: 1.0e-04 loss: 3.116e-01]
windy_storm:  43%|####2     | 1289/3000 [38:41<1:04:51,  2.27s/it, lr: 1.0e-04 loss: 3.116e-01]
windy_storm:  43%|####2     | 1289/3000 [38:43<1:04:51,  2.27s/it, lr: 1.0e-04 loss: 2.163e-01]
windy_storm:  43%|####2     | 1289/3000 [38:43<1:04:51,  2.27s/it, lr: 1.0e-04 loss: 2.163e-01]
windy_storm:  43%|####3     | 1290/3000 [38:46<1:04:49,  2.27s/it, lr: 1.0e-04 loss: 1.116e-01]
windy_storm:  43%|####3     | 1290/3000 [38:46<1:04:49,  2.27s/it, lr: 1.0e-04 loss: 1.116e-01]
windy_storm:  43%|####3     | 1291/3000 [38:46<54:49,  1.92s/it, lr: 1.0e-04 loss: 1.116e-01]  
windy_storm:  43%|####3     | 1291/3000 [38:46<54:49,  1.92s/it, lr: 1.0e-04 loss: 1.116e-01]  
windy_storm:  43%|####3     | 1291/3000 [38:47<54:49,  1.92s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  43%|####3     | 1291/3000 [38:47<54:49,  1.92s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  43%|####3     | 1292/3000 [38:47<48:48,  1.71s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  43%|####3     | 1292/3000 [38:47<48:48,  1.71s/it, lr: 1.0e-04 loss: 5.005e-01]
windy_storm:  43%|####3     | 1292/3000 [38:47<48:48,  1.71s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm:  43%|####3     | 1292/3000 [38:47<48:48,  1.71s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm:  43%|####3     | 1293/3000 [38:47<41:42,  1.47s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm:  43%|####3     | 1293/3000 [38:47<41:42,  1.47s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm:  43%|####3     | 1293/3000 [38:48<41:42,  1.47s/it, lr: 1.0e-04 loss: 1.240e-01]
windy_storm:  43%|####3     | 1293/3000 [38:48<41:42,  1.47s/it, lr: 1.0e-04 loss: 1.240e-01]
windy_storm:  43%|####3     | 1294/3000 [38:48<36:43,  1.29s/it, lr: 1.0e-04 loss: 1.240e-01]
windy_storm:  43%|####3     | 1294/3000 [38:48<36:43,  1.29s/it, lr: 1.0e-04 loss: 1.240e-01]
windy_storm:  43%|####3     | 1294/3000 [38:51<36:43,  1.29s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  43%|####3     | 1294/3000 [38:51<36:43,  1.29s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  43%|####3     | 1295/3000 [38:51<50:25,  1.77s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  43%|####3     | 1295/3000 [38:51<50:25,  1.77s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  43%|####3     | 1295/3000 [38:54<50:25,  1.77s/it, lr: 1.0e-04 loss: 6.918e-01]
windy_storm:  43%|####3     | 1295/3000 [38:54<50:25,  1.77s/it, lr: 1.0e-04 loss: 6.918e-01]
windy_storm:  43%|####3     | 1296/3000 [38:54<59:47,  2.11s/it, lr: 1.0e-04 loss: 6.918e-01]
windy_storm:  43%|####3     | 1296/3000 [38:54<59:47,  2.11s/it, lr: 1.0e-04 loss: 6.918e-01]
windy_storm:  43%|####3     | 1296/3000 [38:56<59:47,  2.11s/it, lr: 1.0e-04 loss: 6.255e-01]
windy_storm:  43%|####3     | 1296/3000 [38:56<59:47,  2.11s/it, lr: 1.0e-04 loss: 6.255e-01]
windy_storm:  43%|####3     | 1297/3000 [38:56<55:16,  1.95s/it, lr: 1.0e-04 loss: 6.255e-01]
windy_storm:  43%|####3     | 1297/3000 [38:56<55:16,  1.95s/it, lr: 1.0e-04 loss: 6.255e-01]
windy_storm:  43%|####3     | 1297/3000 [38:57<55:16,  1.95s/it, lr: 1.0e-04 loss: 5.091e-01]
windy_storm:  43%|####3     | 1297/3000 [38:57<55:16,  1.95s/it, lr: 1.0e-04 loss: 5.091e-01]
windy_storm:  43%|####3     | 1298/3000 [38:57<45:21,  1.60s/it, lr: 1.0e-04 loss: 5.091e-01]
windy_storm:  43%|####3     | 1298/3000 [38:57<45:21,  1.60s/it, lr: 1.0e-04 loss: 5.091e-01]
windy_storm:  43%|####3     | 1298/3000 [39:00<45:21,  1.60s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  43%|####3     | 1298/3000 [39:00<45:21,  1.60s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  43%|####3     | 1299/3000 [39:00<56:30,  1.99s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  43%|####3     | 1299/3000 [39:00<56:30,  1.99s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  43%|####3     | 1299/3000 [39:03<56:30,  1.99s/it, lr: 1.0e-04 loss: 3.840e-01]
windy_storm:  43%|####3     | 1299/3000 [39:03<56:30,  1.99s/it, lr: 1.0e-04 loss: 3.840e-01]
windy_storm:  43%|####3     | 1300/3000 [39:05<56:28,  1.99s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  43%|####3     | 1300/3000 [39:05<56:28,  1.99s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  43%|####3     | 1301/3000 [39:05<49:47,  1.76s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  43%|####3     | 1301/3000 [39:05<49:47,  1.76s/it, lr: 1.0e-04 loss: 1.508e-01]
windy_storm:  43%|####3     | 1301/3000 [39:07<49:47,  1.76s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  43%|####3     | 1301/3000 [39:07<49:47,  1.76s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  43%|####3     | 1302/3000 [39:07<48:28,  1.71s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  43%|####3     | 1302/3000 [39:07<48:28,  1.71s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  43%|####3     | 1302/3000 [39:09<48:28,  1.71s/it, lr: 1.0e-04 loss: 4.918e-01]
windy_storm:  43%|####3     | 1302/3000 [39:09<48:28,  1.71s/it, lr: 1.0e-04 loss: 4.918e-01]
windy_storm:  43%|####3     | 1303/3000 [39:09<47:01,  1.66s/it, lr: 1.0e-04 loss: 4.918e-01]
windy_storm:  43%|####3     | 1303/3000 [39:09<47:01,  1.66s/it, lr: 1.0e-04 loss: 4.918e-01]
windy_storm:  43%|####3     | 1303/3000 [39:09<47:01,  1.66s/it, lr: 1.0e-04 loss: 5.281e-01]
windy_storm:  43%|####3     | 1303/3000 [39:09<47:01,  1.66s/it, lr: 1.0e-04 loss: 5.281e-01]
windy_storm:  43%|####3     | 1304/3000 [39:09<40:34,  1.44s/it, lr: 1.0e-04 loss: 5.281e-01]
windy_storm:  43%|####3     | 1304/3000 [39:09<40:34,  1.44s/it, lr: 1.0e-04 loss: 5.281e-01]
windy_storm:  43%|####3     | 1304/3000 [39:11<40:34,  1.44s/it, lr: 1.0e-04 loss: 6.643e-01]
windy_storm:  43%|####3     | 1304/3000 [39:11<40:34,  1.44s/it, lr: 1.0e-04 loss: 6.643e-01]
windy_storm:  44%|####3     | 1305/3000 [39:11<43:16,  1.53s/it, lr: 1.0e-04 loss: 6.643e-01]
windy_storm:  44%|####3     | 1305/3000 [39:11<43:16,  1.53s/it, lr: 1.0e-04 loss: 6.643e-01]
windy_storm:  44%|####3     | 1305/3000 [39:13<43:16,  1.53s/it, lr: 1.0e-04 loss: 4.756e-01]
windy_storm:  44%|####3     | 1305/3000 [39:13<43:16,  1.53s/it, lr: 1.0e-04 loss: 4.756e-01]
windy_storm:  44%|####3     | 1306/3000 [39:13<43:30,  1.54s/it, lr: 1.0e-04 loss: 4.756e-01]
windy_storm:  44%|####3     | 1306/3000 [39:13<43:30,  1.54s/it, lr: 1.0e-04 loss: 4.756e-01]
windy_storm:  44%|####3     | 1306/3000 [39:16<43:30,  1.54s/it, lr: 1.0e-04 loss: 4.885e-02]
windy_storm:  44%|####3     | 1306/3000 [39:16<43:30,  1.54s/it, lr: 1.0e-04 loss: 4.885e-02]
windy_storm:  44%|####3     | 1307/3000 [39:16<55:02,  1.95s/it, lr: 1.0e-04 loss: 4.885e-02]
windy_storm:  44%|####3     | 1307/3000 [39:16<55:02,  1.95s/it, lr: 1.0e-04 loss: 4.885e-02]
windy_storm:  44%|####3     | 1307/3000 [39:17<55:02,  1.95s/it, lr: 1.0e-04 loss: 3.263e-01]
windy_storm:  44%|####3     | 1307/3000 [39:17<55:02,  1.95s/it, lr: 1.0e-04 loss: 3.263e-01]
windy_storm:  44%|####3     | 1308/3000 [39:17<45:40,  1.62s/it, lr: 1.0e-04 loss: 3.263e-01]
windy_storm:  44%|####3     | 1308/3000 [39:17<45:40,  1.62s/it, lr: 1.0e-04 loss: 3.263e-01]
windy_storm:  44%|####3     | 1308/3000 [39:19<45:40,  1.62s/it, lr: 1.0e-04 loss: 5.172e-01]
windy_storm:  44%|####3     | 1308/3000 [39:19<45:40,  1.62s/it, lr: 1.0e-04 loss: 5.172e-01]
windy_storm:  44%|####3     | 1309/3000 [39:19<56:36,  2.01s/it, lr: 1.0e-04 loss: 5.172e-01]
windy_storm:  44%|####3     | 1309/3000 [39:19<56:36,  2.01s/it, lr: 1.0e-04 loss: 5.172e-01]
windy_storm:  44%|####3     | 1309/3000 [39:20<56:36,  2.01s/it, lr: 1.0e-04 loss: 1.698e-01]
windy_storm:  44%|####3     | 1309/3000 [39:20<56:36,  2.01s/it, lr: 1.0e-04 loss: 1.698e-01]
windy_storm:  44%|####3     | 1310/3000 [39:23<56:34,  2.01s/it, lr: 1.0e-04 loss: 5.550e-01]
windy_storm:  44%|####3     | 1310/3000 [39:23<56:34,  2.01s/it, lr: 1.0e-04 loss: 5.550e-01]
windy_storm:  44%|####3     | 1311/3000 [39:23<50:34,  1.80s/it, lr: 1.0e-04 loss: 5.550e-01]
windy_storm:  44%|####3     | 1311/3000 [39:23<50:34,  1.80s/it, lr: 1.0e-04 loss: 5.550e-01]
windy_storm:  44%|####3     | 1311/3000 [39:25<50:34,  1.80s/it, lr: 1.0e-04 loss: 2.834e-01]
windy_storm:  44%|####3     | 1311/3000 [39:25<50:34,  1.80s/it, lr: 1.0e-04 loss: 2.834e-01]
windy_storm:  44%|####3     | 1312/3000 [39:25<49:05,  1.75s/it, lr: 1.0e-04 loss: 2.834e-01]
windy_storm:  44%|####3     | 1312/3000 [39:25<49:05,  1.75s/it, lr: 1.0e-04 loss: 2.834e-01]
windy_storm:  44%|####3     | 1312/3000 [39:26<49:05,  1.75s/it, lr: 1.0e-04 loss: 1.189e-02]
windy_storm:  44%|####3     | 1312/3000 [39:26<49:05,  1.75s/it, lr: 1.0e-04 loss: 1.189e-02]
windy_storm:  44%|####3     | 1313/3000 [39:27<47:59,  1.71s/it, lr: 1.0e-04 loss: 1.189e-02]
windy_storm:  44%|####3     | 1313/3000 [39:27<47:59,  1.71s/it, lr: 1.0e-04 loss: 1.189e-02]
windy_storm:  44%|####3     | 1313/3000 [39:28<47:59,  1.71s/it, lr: 1.0e-04 loss: 8.707e-02]
windy_storm:  44%|####3     | 1313/3000 [39:28<47:59,  1.71s/it, lr: 1.0e-04 loss: 8.707e-02]
windy_storm:  44%|####3     | 1314/3000 [39:28<46:54,  1.67s/it, lr: 1.0e-04 loss: 8.707e-02]
windy_storm:  44%|####3     | 1314/3000 [39:28<46:54,  1.67s/it, lr: 1.0e-04 loss: 8.707e-02]
windy_storm:  44%|####3     | 1314/3000 [39:29<46:54,  1.67s/it, lr: 1.0e-04 loss: 6.061e-01]
windy_storm:  44%|####3     | 1314/3000 [39:29<46:54,  1.67s/it, lr: 1.0e-04 loss: 6.061e-01]
windy_storm:  44%|####3     | 1315/3000 [39:29<40:23,  1.44s/it, lr: 1.0e-04 loss: 6.061e-01]
windy_storm:  44%|####3     | 1315/3000 [39:29<40:23,  1.44s/it, lr: 1.0e-04 loss: 6.061e-01]
windy_storm:  44%|####3     | 1315/3000 [39:30<40:23,  1.44s/it, lr: 1.0e-04 loss: 6.132e-01]
windy_storm:  44%|####3     | 1315/3000 [39:30<40:23,  1.44s/it, lr: 1.0e-04 loss: 6.132e-01]
windy_storm:  44%|####3     | 1316/3000 [39:30<41:06,  1.46s/it, lr: 1.0e-04 loss: 6.132e-01]
windy_storm:  44%|####3     | 1316/3000 [39:30<41:06,  1.46s/it, lr: 1.0e-04 loss: 6.132e-01]
windy_storm:  44%|####3     | 1316/3000 [39:31<41:06,  1.46s/it, lr: 1.0e-04 loss: 1.706e-01]
windy_storm:  44%|####3     | 1316/3000 [39:31<41:06,  1.46s/it, lr: 1.0e-04 loss: 1.706e-01]
windy_storm:  44%|####3     | 1317/3000 [39:31<35:51,  1.28s/it, lr: 1.0e-04 loss: 1.706e-01]
windy_storm:  44%|####3     | 1317/3000 [39:31<35:51,  1.28s/it, lr: 1.0e-04 loss: 1.706e-01]
windy_storm:  44%|####3     | 1317/3000 [39:34<35:51,  1.28s/it, lr: 1.0e-04 loss: 5.735e-01]
windy_storm:  44%|####3     | 1317/3000 [39:34<35:51,  1.28s/it, lr: 1.0e-04 loss: 5.735e-01]
windy_storm:  44%|####3     | 1318/3000 [39:34<50:46,  1.81s/it, lr: 1.0e-04 loss: 5.735e-01]
windy_storm:  44%|####3     | 1318/3000 [39:34<50:46,  1.81s/it, lr: 1.0e-04 loss: 5.735e-01]
windy_storm:  44%|####3     | 1318/3000 [39:35<50:46,  1.81s/it, lr: 1.0e-04 loss: 6.015e-01]
windy_storm:  44%|####3     | 1318/3000 [39:35<50:46,  1.81s/it, lr: 1.0e-04 loss: 6.015e-01]
windy_storm:  44%|####3     | 1319/3000 [39:35<42:08,  1.50s/it, lr: 1.0e-04 loss: 6.015e-01]
windy_storm:  44%|####3     | 1319/3000 [39:35<42:08,  1.50s/it, lr: 1.0e-04 loss: 6.015e-01]
windy_storm:  44%|####3     | 1319/3000 [39:37<42:08,  1.50s/it, lr: 1.0e-04 loss: 1.751e-01]
windy_storm:  44%|####3     | 1319/3000 [39:37<42:08,  1.50s/it, lr: 1.0e-04 loss: 1.751e-01]
windy_storm:  44%|####4     | 1320/3000 [39:40<42:06,  1.50s/it, lr: 1.0e-04 loss: 2.983e-01]
windy_storm:  44%|####4     | 1320/3000 [39:40<42:06,  1.50s/it, lr: 1.0e-04 loss: 2.983e-01]
windy_storm:  44%|####4     | 1321/3000 [39:40<42:14,  1.51s/it, lr: 1.0e-04 loss: 2.983e-01]
windy_storm:  44%|####4     | 1321/3000 [39:40<42:14,  1.51s/it, lr: 1.0e-04 loss: 2.983e-01]
windy_storm:  44%|####4     | 1321/3000 [39:43<42:14,  1.51s/it, lr: 1.0e-04 loss: 5.656e-01]
windy_storm:  44%|####4     | 1321/3000 [39:43<42:14,  1.51s/it, lr: 1.0e-04 loss: 5.656e-01]
windy_storm:  44%|####4     | 1322/3000 [39:43<52:20,  1.87s/it, lr: 1.0e-04 loss: 5.656e-01]
windy_storm:  44%|####4     | 1322/3000 [39:43<52:20,  1.87s/it, lr: 1.0e-04 loss: 5.656e-01]
windy_storm:  44%|####4     | 1322/3000 [39:46<52:20,  1.87s/it, lr: 1.0e-04 loss: 2.688e-01]
windy_storm:  44%|####4     | 1322/3000 [39:46<52:20,  1.87s/it, lr: 1.0e-04 loss: 2.688e-01]
windy_storm:  44%|####4     | 1323/3000 [39:46<59:55,  2.14s/it, lr: 1.0e-04 loss: 2.688e-01]
windy_storm:  44%|####4     | 1323/3000 [39:46<59:55,  2.14s/it, lr: 1.0e-04 loss: 2.688e-01]
windy_storm:  44%|####4     | 1323/3000 [39:48<59:55,  2.14s/it, lr: 1.0e-04 loss: 8.631e-02]
windy_storm:  44%|####4     | 1323/3000 [39:48<59:55,  2.14s/it, lr: 1.0e-04 loss: 8.631e-02]
windy_storm:  44%|####4     | 1324/3000 [39:48<55:50,  2.00s/it, lr: 1.0e-04 loss: 8.631e-02]
windy_storm:  44%|####4     | 1324/3000 [39:48<55:50,  2.00s/it, lr: 1.0e-04 loss: 8.631e-02]
windy_storm:  44%|####4     | 1324/3000 [39:49<55:50,  2.00s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  44%|####4     | 1324/3000 [39:49<55:50,  2.00s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  44%|####4     | 1325/3000 [39:49<52:45,  1.89s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  44%|####4     | 1325/3000 [39:49<52:45,  1.89s/it, lr: 1.0e-04 loss: 2.011e-01]
windy_storm:  44%|####4     | 1325/3000 [39:52<52:45,  1.89s/it, lr: 1.0e-04 loss: 5.223e-01]
windy_storm:  44%|####4     | 1325/3000 [39:52<52:45,  1.89s/it, lr: 1.0e-04 loss: 5.223e-01]
windy_storm:  44%|####4     | 1326/3000 [39:52<1:01:53,  2.22s/it, lr: 1.0e-04 loss: 5.223e-01]
windy_storm:  44%|####4     | 1326/3000 [39:52<1:01:53,  2.22s/it, lr: 1.0e-04 loss: 5.223e-01]
windy_storm:  44%|####4     | 1326/3000 [39:54<1:01:53,  2.22s/it, lr: 1.0e-04 loss: 1.779e-01]
windy_storm:  44%|####4     | 1326/3000 [39:54<1:01:53,  2.22s/it, lr: 1.0e-04 loss: 1.779e-01]
windy_storm:  44%|####4     | 1327/3000 [39:54<56:18,  2.02s/it, lr: 1.0e-04 loss: 1.779e-01]  
windy_storm:  44%|####4     | 1327/3000 [39:54<56:18,  2.02s/it, lr: 1.0e-04 loss: 1.779e-01]  
windy_storm:  44%|####4     | 1327/3000 [39:55<56:18,  2.02s/it, lr: 1.0e-04 loss: 6.608e-01]
windy_storm:  44%|####4     | 1327/3000 [39:55<56:18,  2.02s/it, lr: 1.0e-04 loss: 6.608e-01]
windy_storm:  44%|####4     | 1328/3000 [39:55<52:32,  1.89s/it, lr: 1.0e-04 loss: 6.608e-01]
windy_storm:  44%|####4     | 1328/3000 [39:55<52:32,  1.89s/it, lr: 1.0e-04 loss: 6.608e-01]
windy_storm:  44%|####4     | 1328/3000 [39:56<52:32,  1.89s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  44%|####4     | 1328/3000 [39:56<52:32,  1.89s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  44%|####4     | 1329/3000 [39:56<43:49,  1.57s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  44%|####4     | 1329/3000 [39:56<43:49,  1.57s/it, lr: 1.0e-04 loss: 9.934e-02]
windy_storm:  44%|####4     | 1329/3000 [39:58<43:49,  1.57s/it, lr: 1.0e-04 loss: 4.955e-01]
windy_storm:  44%|####4     | 1329/3000 [39:58<43:49,  1.57s/it, lr: 1.0e-04 loss: 4.955e-01]
windy_storm:  44%|####4     | 1330/3000 [39:59<43:48,  1.57s/it, lr: 1.0e-04 loss: 1.876e-01]
windy_storm:  44%|####4     | 1330/3000 [39:59<43:48,  1.57s/it, lr: 1.0e-04 loss: 1.876e-01]
windy_storm:  44%|####4     | 1331/3000 [39:59<33:42,  1.21s/it, lr: 1.0e-04 loss: 1.876e-01]
windy_storm:  44%|####4     | 1331/3000 [39:59<33:42,  1.21s/it, lr: 1.0e-04 loss: 1.876e-01]
windy_storm:  44%|####4     | 1331/3000 [40:01<33:42,  1.21s/it, lr: 1.0e-04 loss: 4.225e-02]
windy_storm:  44%|####4     | 1331/3000 [40:01<33:42,  1.21s/it, lr: 1.0e-04 loss: 4.225e-02]
windy_storm:  44%|####4     | 1332/3000 [40:01<32:58,  1.19s/it, lr: 1.0e-04 loss: 4.225e-02]
windy_storm:  44%|####4     | 1332/3000 [40:01<32:58,  1.19s/it, lr: 1.0e-04 loss: 4.225e-02]
windy_storm:  44%|####4     | 1332/3000 [40:01<32:58,  1.19s/it, lr: 1.0e-04 loss: 3.206e-01]
windy_storm:  44%|####4     | 1332/3000 [40:01<32:58,  1.19s/it, lr: 1.0e-04 loss: 3.206e-01]
windy_storm:  44%|####4     | 1333/3000 [40:01<30:23,  1.09s/it, lr: 1.0e-04 loss: 3.206e-01]
windy_storm:  44%|####4     | 1333/3000 [40:01<30:23,  1.09s/it, lr: 1.0e-04 loss: 3.206e-01]
windy_storm:  44%|####4     | 1333/3000 [40:04<30:23,  1.09s/it, lr: 1.0e-04 loss: 1.175e-01]
windy_storm:  44%|####4     | 1333/3000 [40:04<30:23,  1.09s/it, lr: 1.0e-04 loss: 1.175e-01]
windy_storm:  44%|####4     | 1334/3000 [40:04<44:50,  1.61s/it, lr: 1.0e-04 loss: 1.175e-01]
windy_storm:  44%|####4     | 1334/3000 [40:04<44:50,  1.61s/it, lr: 1.0e-04 loss: 1.175e-01]
windy_storm:  44%|####4     | 1334/3000 [40:06<44:50,  1.61s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  44%|####4     | 1334/3000 [40:06<44:50,  1.61s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  44%|####4     | 1335/3000 [40:06<44:37,  1.61s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  44%|####4     | 1335/3000 [40:06<44:37,  1.61s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  44%|####4     | 1335/3000 [40:09<44:37,  1.61s/it, lr: 1.0e-04 loss: 4.067e-01]
windy_storm:  44%|####4     | 1335/3000 [40:09<44:37,  1.61s/it, lr: 1.0e-04 loss: 4.067e-01]
windy_storm:  45%|####4     | 1336/3000 [40:09<55:03,  1.99s/it, lr: 1.0e-04 loss: 4.067e-01]
windy_storm:  45%|####4     | 1336/3000 [40:09<55:03,  1.99s/it, lr: 1.0e-04 loss: 4.067e-01]
windy_storm:  45%|####4     | 1336/3000 [40:10<55:03,  1.99s/it, lr: 1.0e-04 loss: 4.820e-01]
windy_storm:  45%|####4     | 1336/3000 [40:10<55:03,  1.99s/it, lr: 1.0e-04 loss: 4.820e-01]
windy_storm:  45%|####4     | 1337/3000 [40:10<45:13,  1.63s/it, lr: 1.0e-04 loss: 4.820e-01]
windy_storm:  45%|####4     | 1337/3000 [40:10<45:13,  1.63s/it, lr: 1.0e-04 loss: 4.820e-01]
windy_storm:  45%|####4     | 1337/3000 [40:13<45:13,  1.63s/it, lr: 1.0e-04 loss: 6.519e-02]
windy_storm:  45%|####4     | 1337/3000 [40:13<45:13,  1.63s/it, lr: 1.0e-04 loss: 6.519e-02]
windy_storm:  45%|####4     | 1338/3000 [40:13<56:20,  2.03s/it, lr: 1.0e-04 loss: 6.519e-02]
windy_storm:  45%|####4     | 1338/3000 [40:13<56:20,  2.03s/it, lr: 1.0e-04 loss: 6.519e-02]
windy_storm:  45%|####4     | 1338/3000 [40:13<56:20,  2.03s/it, lr: 1.0e-04 loss: 7.031e-02]
windy_storm:  45%|####4     | 1338/3000 [40:13<56:20,  2.03s/it, lr: 1.0e-04 loss: 7.031e-02]
windy_storm:  45%|####4     | 1339/3000 [40:13<45:57,  1.66s/it, lr: 1.0e-04 loss: 7.031e-02]
windy_storm:  45%|####4     | 1339/3000 [40:13<45:57,  1.66s/it, lr: 1.0e-04 loss: 7.031e-02]
windy_storm:  45%|####4     | 1339/3000 [40:16<45:57,  1.66s/it, lr: 1.0e-04 loss: 2.258e-01]
windy_storm:  45%|####4     | 1339/3000 [40:16<45:57,  1.66s/it, lr: 1.0e-04 loss: 2.258e-01]
windy_storm:  45%|####4     | 1340/3000 [40:19<45:55,  1.66s/it, lr: 1.0e-04 loss: 1.509e-01]
windy_storm:  45%|####4     | 1340/3000 [40:19<45:55,  1.66s/it, lr: 1.0e-04 loss: 1.509e-01]
windy_storm:  45%|####4     | 1341/3000 [40:19<43:23,  1.57s/it, lr: 1.0e-04 loss: 1.509e-01]
windy_storm:  45%|####4     | 1341/3000 [40:19<43:23,  1.57s/it, lr: 1.0e-04 loss: 1.509e-01]
windy_storm:  45%|####4     | 1341/3000 [40:20<43:23,  1.57s/it, lr: 1.0e-04 loss: 5.210e-01]
windy_storm:  45%|####4     | 1341/3000 [40:20<43:23,  1.57s/it, lr: 1.0e-04 loss: 5.210e-01]
windy_storm:  45%|####4     | 1342/3000 [40:20<38:19,  1.39s/it, lr: 1.0e-04 loss: 5.210e-01]
windy_storm:  45%|####4     | 1342/3000 [40:20<38:19,  1.39s/it, lr: 1.0e-04 loss: 5.210e-01]
windy_storm:  45%|####4     | 1342/3000 [40:22<38:19,  1.39s/it, lr: 1.0e-04 loss: 5.600e-01]
windy_storm:  45%|####4     | 1342/3000 [40:22<38:19,  1.39s/it, lr: 1.0e-04 loss: 5.600e-01]
windy_storm:  45%|####4     | 1343/3000 [40:22<39:39,  1.44s/it, lr: 1.0e-04 loss: 5.600e-01]
windy_storm:  45%|####4     | 1343/3000 [40:22<39:39,  1.44s/it, lr: 1.0e-04 loss: 5.600e-01]
windy_storm:  45%|####4     | 1343/3000 [40:23<39:39,  1.44s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  45%|####4     | 1343/3000 [40:23<39:39,  1.44s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  45%|####4     | 1344/3000 [40:23<40:38,  1.47s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  45%|####4     | 1344/3000 [40:23<40:38,  1.47s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  45%|####4     | 1344/3000 [40:25<40:38,  1.47s/it, lr: 1.0e-04 loss: 3.558e-01]
windy_storm:  45%|####4     | 1344/3000 [40:25<40:38,  1.47s/it, lr: 1.0e-04 loss: 3.558e-01]
windy_storm:  45%|####4     | 1345/3000 [40:25<41:28,  1.50s/it, lr: 1.0e-04 loss: 3.558e-01]
windy_storm:  45%|####4     | 1345/3000 [40:25<41:28,  1.50s/it, lr: 1.0e-04 loss: 3.558e-01]
windy_storm:  45%|####4     | 1345/3000 [40:27<41:28,  1.50s/it, lr: 1.0e-04 loss: 6.331e-01]
windy_storm:  45%|####4     | 1345/3000 [40:27<41:28,  1.50s/it, lr: 1.0e-04 loss: 6.331e-01]
windy_storm:  45%|####4     | 1346/3000 [40:27<43:30,  1.58s/it, lr: 1.0e-04 loss: 6.331e-01]
windy_storm:  45%|####4     | 1346/3000 [40:27<43:30,  1.58s/it, lr: 1.0e-04 loss: 6.331e-01]
windy_storm:  45%|####4     | 1346/3000 [40:28<43:30,  1.58s/it, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  45%|####4     | 1346/3000 [40:28<43:30,  1.58s/it, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  45%|####4     | 1347/3000 [40:28<43:25,  1.58s/it, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  45%|####4     | 1347/3000 [40:28<43:25,  1.58s/it, lr: 1.0e-04 loss: 4.626e-01]
windy_storm:  45%|####4     | 1347/3000 [40:29<43:25,  1.58s/it, lr: 1.0e-04 loss: 5.147e-01]
windy_storm:  45%|####4     | 1347/3000 [40:29<43:25,  1.58s/it, lr: 1.0e-04 loss: 5.147e-01]
windy_storm:  45%|####4     | 1348/3000 [40:29<37:18,  1.36s/it, lr: 1.0e-04 loss: 5.147e-01]
windy_storm:  45%|####4     | 1348/3000 [40:29<37:18,  1.36s/it, lr: 1.0e-04 loss: 5.147e-01]
windy_storm:  45%|####4     | 1348/3000 [40:30<37:18,  1.36s/it, lr: 1.0e-04 loss: 7.282e-02]
windy_storm:  45%|####4     | 1348/3000 [40:30<37:18,  1.36s/it, lr: 1.0e-04 loss: 7.282e-02]
windy_storm:  45%|####4     | 1349/3000 [40:30<32:17,  1.17s/it, lr: 1.0e-04 loss: 7.282e-02]
windy_storm:  45%|####4     | 1349/3000 [40:30<32:17,  1.17s/it, lr: 1.0e-04 loss: 7.282e-02]
windy_storm:  45%|####4     | 1349/3000 [40:33<32:17,  1.17s/it, lr: 1.0e-04 loss: 4.889e-01]
windy_storm:  45%|####4     | 1349/3000 [40:33<32:17,  1.17s/it, lr: 1.0e-04 loss: 4.889e-01]
windy_storm:  45%|####5     | 1350/3000 [40:36<32:16,  1.17s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:  45%|####5     | 1350/3000 [40:36<32:16,  1.17s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:  45%|####5     | 1351/3000 [40:36<36:01,  1.31s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:  45%|####5     | 1351/3000 [40:36<36:01,  1.31s/it, lr: 1.0e-04 loss: 6.623e-01]
windy_storm:  45%|####5     | 1351/3000 [40:37<36:01,  1.31s/it, lr: 1.0e-04 loss: 1.486e-02]
windy_storm:  45%|####5     | 1351/3000 [40:37<36:01,  1.31s/it, lr: 1.0e-04 loss: 1.486e-02]
windy_storm:  45%|####5     | 1352/3000 [40:37<32:19,  1.18s/it, lr: 1.0e-04 loss: 1.486e-02]
windy_storm:  45%|####5     | 1352/3000 [40:37<32:19,  1.18s/it, lr: 1.0e-04 loss: 1.486e-02]
windy_storm:  45%|####5     | 1352/3000 [40:37<32:19,  1.18s/it, lr: 1.0e-04 loss: 5.730e-01]
windy_storm:  45%|####5     | 1352/3000 [40:37<32:19,  1.18s/it, lr: 1.0e-04 loss: 5.730e-01]
windy_storm:  45%|####5     | 1353/3000 [40:37<29:44,  1.08s/it, lr: 1.0e-04 loss: 5.730e-01]
windy_storm:  45%|####5     | 1353/3000 [40:37<29:44,  1.08s/it, lr: 1.0e-04 loss: 5.730e-01]
windy_storm:  45%|####5     | 1353/3000 [40:38<29:44,  1.08s/it, lr: 1.0e-04 loss: 2.165e-01]
windy_storm:  45%|####5     | 1353/3000 [40:38<29:44,  1.08s/it, lr: 1.0e-04 loss: 2.165e-01]
windy_storm:  45%|####5     | 1354/3000 [40:38<27:44,  1.01s/it, lr: 1.0e-04 loss: 2.165e-01]
windy_storm:  45%|####5     | 1354/3000 [40:38<27:44,  1.01s/it, lr: 1.0e-04 loss: 2.165e-01]
windy_storm:  45%|####5     | 1354/3000 [40:39<27:44,  1.01s/it, lr: 1.0e-04 loss: 4.665e-01]
windy_storm:  45%|####5     | 1354/3000 [40:39<27:44,  1.01s/it, lr: 1.0e-04 loss: 4.665e-01]
windy_storm:  45%|####5     | 1355/3000 [40:39<26:17,  1.04it/s, lr: 1.0e-04 loss: 4.665e-01]
windy_storm:  45%|####5     | 1355/3000 [40:39<26:17,  1.04it/s, lr: 1.0e-04 loss: 4.665e-01]
windy_storm:  45%|####5     | 1355/3000 [40:40<26:17,  1.04it/s, lr: 1.0e-04 loss: 1.833e-01]
windy_storm:  45%|####5     | 1355/3000 [40:40<26:17,  1.04it/s, lr: 1.0e-04 loss: 1.833e-01]
windy_storm:  45%|####5     | 1356/3000 [40:40<24:42,  1.11it/s, lr: 1.0e-04 loss: 1.833e-01]
windy_storm:  45%|####5     | 1356/3000 [40:40<24:42,  1.11it/s, lr: 1.0e-04 loss: 1.833e-01]
windy_storm:  45%|####5     | 1356/3000 [40:41<24:42,  1.11it/s, lr: 1.0e-04 loss: 6.820e-01]
windy_storm:  45%|####5     | 1356/3000 [40:41<24:42,  1.11it/s, lr: 1.0e-04 loss: 6.820e-01]
windy_storm:  45%|####5     | 1357/3000 [40:41<29:52,  1.09s/it, lr: 1.0e-04 loss: 6.820e-01]
windy_storm:  45%|####5     | 1357/3000 [40:41<29:52,  1.09s/it, lr: 1.0e-04 loss: 6.820e-01]
windy_storm:  45%|####5     | 1357/3000 [40:42<29:52,  1.09s/it, lr: 1.0e-04 loss: 5.304e-02]
windy_storm:  45%|####5     | 1357/3000 [40:42<29:52,  1.09s/it, lr: 1.0e-04 loss: 5.304e-02]
windy_storm:  45%|####5     | 1358/3000 [40:42<27:38,  1.01s/it, lr: 1.0e-04 loss: 5.304e-02]
windy_storm:  45%|####5     | 1358/3000 [40:42<27:38,  1.01s/it, lr: 1.0e-04 loss: 5.304e-02]
windy_storm:  45%|####5     | 1358/3000 [40:45<27:38,  1.01s/it, lr: 1.0e-04 loss: 1.745e-01]
windy_storm:  45%|####5     | 1358/3000 [40:45<27:38,  1.01s/it, lr: 1.0e-04 loss: 1.745e-01]
windy_storm:  45%|####5     | 1359/3000 [40:45<44:24,  1.62s/it, lr: 1.0e-04 loss: 1.745e-01]
windy_storm:  45%|####5     | 1359/3000 [40:45<44:24,  1.62s/it, lr: 1.0e-04 loss: 1.745e-01]
windy_storm:  45%|####5     | 1359/3000 [40:46<44:24,  1.62s/it, lr: 1.0e-04 loss: 2.827e-01]
windy_storm:  45%|####5     | 1359/3000 [40:46<44:24,  1.62s/it, lr: 1.0e-04 loss: 2.827e-01]
windy_storm:  45%|####5     | 1360/3000 [40:47<44:22,  1.62s/it, lr: 1.0e-04 loss: 4.510e-01]
windy_storm:  45%|####5     | 1360/3000 [40:47<44:22,  1.62s/it, lr: 1.0e-04 loss: 4.510e-01]
windy_storm:  45%|####5     | 1361/3000 [40:47<29:14,  1.07s/it, lr: 1.0e-04 loss: 4.510e-01]
windy_storm:  45%|####5     | 1361/3000 [40:47<29:14,  1.07s/it, lr: 1.0e-04 loss: 4.510e-01]
windy_storm:  45%|####5     | 1361/3000 [40:50<29:14,  1.07s/it, lr: 1.0e-04 loss: 1.650e-01]
windy_storm:  45%|####5     | 1361/3000 [40:50<29:14,  1.07s/it, lr: 1.0e-04 loss: 1.650e-01]
windy_storm:  45%|####5     | 1362/3000 [40:50<41:50,  1.53s/it, lr: 1.0e-04 loss: 1.650e-01]
windy_storm:  45%|####5     | 1362/3000 [40:50<41:50,  1.53s/it, lr: 1.0e-04 loss: 1.650e-01]
windy_storm:  45%|####5     | 1362/3000 [40:53<41:50,  1.53s/it, lr: 1.0e-04 loss: 5.665e-01]
windy_storm:  45%|####5     | 1362/3000 [40:53<41:50,  1.53s/it, lr: 1.0e-04 loss: 5.665e-01]
windy_storm:  45%|####5     | 1363/3000 [40:53<51:20,  1.88s/it, lr: 1.0e-04 loss: 5.665e-01]
windy_storm:  45%|####5     | 1363/3000 [40:53<51:20,  1.88s/it, lr: 1.0e-04 loss: 5.665e-01]
windy_storm:  45%|####5     | 1363/3000 [40:54<51:20,  1.88s/it, lr: 1.0e-04 loss: 6.411e-02]
windy_storm:  45%|####5     | 1363/3000 [40:54<51:20,  1.88s/it, lr: 1.0e-04 loss: 6.411e-02]
windy_storm:  45%|####5     | 1364/3000 [40:54<48:35,  1.78s/it, lr: 1.0e-04 loss: 6.411e-02]
windy_storm:  45%|####5     | 1364/3000 [40:54<48:35,  1.78s/it, lr: 1.0e-04 loss: 6.411e-02]
windy_storm:  45%|####5     | 1364/3000 [40:57<48:35,  1.78s/it, lr: 1.0e-04 loss: 1.486e-01]
windy_storm:  45%|####5     | 1364/3000 [40:57<48:35,  1.78s/it, lr: 1.0e-04 loss: 1.486e-01]
windy_storm:  46%|####5     | 1365/3000 [40:57<57:22,  2.11s/it, lr: 1.0e-04 loss: 1.486e-01]
windy_storm:  46%|####5     | 1365/3000 [40:57<57:22,  2.11s/it, lr: 1.0e-04 loss: 1.486e-01]
windy_storm:  46%|####5     | 1365/3000 [40:58<57:22,  2.11s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  46%|####5     | 1365/3000 [40:58<57:22,  2.11s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  46%|####5     | 1366/3000 [40:58<47:21,  1.74s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  46%|####5     | 1366/3000 [40:58<47:21,  1.74s/it, lr: 1.0e-04 loss: 1.531e-01]
windy_storm:  46%|####5     | 1366/3000 [41:00<47:21,  1.74s/it, lr: 1.0e-04 loss: 1.937e-01]
windy_storm:  46%|####5     | 1366/3000 [41:00<47:21,  1.74s/it, lr: 1.0e-04 loss: 1.937e-01]
windy_storm:  46%|####5     | 1367/3000 [41:00<46:11,  1.70s/it, lr: 1.0e-04 loss: 1.937e-01]
windy_storm:  46%|####5     | 1367/3000 [41:00<46:11,  1.70s/it, lr: 1.0e-04 loss: 1.937e-01]
windy_storm:  46%|####5     | 1367/3000 [41:03<46:11,  1.70s/it, lr: 1.0e-04 loss: 2.515e-02]
windy_storm:  46%|####5     | 1367/3000 [41:03<46:11,  1.70s/it, lr: 1.0e-04 loss: 2.515e-02]
windy_storm:  46%|####5     | 1368/3000 [41:03<56:32,  2.08s/it, lr: 1.0e-04 loss: 2.515e-02]
windy_storm:  46%|####5     | 1368/3000 [41:03<56:32,  2.08s/it, lr: 1.0e-04 loss: 2.515e-02]
windy_storm:  46%|####5     | 1368/3000 [41:06<56:32,  2.08s/it, lr: 1.0e-04 loss: 7.174e-02]
windy_storm:  46%|####5     | 1368/3000 [41:06<56:32,  2.08s/it, lr: 1.0e-04 loss: 7.174e-02]
windy_storm:  46%|####5     | 1369/3000 [41:06<1:03:33,  2.34s/it, lr: 1.0e-04 loss: 7.174e-02]
windy_storm:  46%|####5     | 1369/3000 [41:06<1:03:33,  2.34s/it, lr: 1.0e-04 loss: 7.174e-02]
windy_storm:  46%|####5     | 1369/3000 [41:08<1:03:33,  2.34s/it, lr: 1.0e-04 loss: 4.254e-01]
windy_storm:  46%|####5     | 1369/3000 [41:08<1:03:33,  2.34s/it, lr: 1.0e-04 loss: 4.254e-01]
windy_storm:  46%|####5     | 1370/3000 [41:11<1:03:31,  2.34s/it, lr: 1.0e-04 loss: 4.823e-01]
windy_storm:  46%|####5     | 1370/3000 [41:11<1:03:31,  2.34s/it, lr: 1.0e-04 loss: 4.823e-01]
windy_storm:  46%|####5     | 1371/3000 [41:12<53:13,  1.96s/it, lr: 1.0e-04 loss: 4.823e-01]  
windy_storm:  46%|####5     | 1371/3000 [41:12<53:13,  1.96s/it, lr: 1.0e-04 loss: 4.823e-01]  
windy_storm:  46%|####5     | 1371/3000 [41:13<53:13,  1.96s/it, lr: 1.0e-04 loss: 5.770e-01]
windy_storm:  46%|####5     | 1371/3000 [41:13<53:13,  1.96s/it, lr: 1.0e-04 loss: 5.770e-01]
windy_storm:  46%|####5     | 1372/3000 [41:13<51:44,  1.91s/it, lr: 1.0e-04 loss: 5.770e-01]
windy_storm:  46%|####5     | 1372/3000 [41:13<51:44,  1.91s/it, lr: 1.0e-04 loss: 5.770e-01]
windy_storm:  46%|####5     | 1372/3000 [41:14<51:44,  1.91s/it, lr: 1.0e-04 loss: 4.215e-01]
windy_storm:  46%|####5     | 1372/3000 [41:14<51:44,  1.91s/it, lr: 1.0e-04 loss: 4.215e-01]
windy_storm:  46%|####5     | 1373/3000 [41:14<43:38,  1.61s/it, lr: 1.0e-04 loss: 4.215e-01]
windy_storm:  46%|####5     | 1373/3000 [41:14<43:38,  1.61s/it, lr: 1.0e-04 loss: 4.215e-01]
windy_storm:  46%|####5     | 1373/3000 [41:17<43:38,  1.61s/it, lr: 1.0e-04 loss: 1.990e-01]
windy_storm:  46%|####5     | 1373/3000 [41:17<43:38,  1.61s/it, lr: 1.0e-04 loss: 1.990e-01]
windy_storm:  46%|####5     | 1374/3000 [41:17<53:56,  1.99s/it, lr: 1.0e-04 loss: 1.990e-01]
windy_storm:  46%|####5     | 1374/3000 [41:17<53:56,  1.99s/it, lr: 1.0e-04 loss: 1.990e-01]
windy_storm:  46%|####5     | 1374/3000 [41:20<53:56,  1.99s/it, lr: 1.0e-04 loss: 6.204e-01]
windy_storm:  46%|####5     | 1374/3000 [41:20<53:56,  1.99s/it, lr: 1.0e-04 loss: 6.204e-01]
windy_storm:  46%|####5     | 1375/3000 [41:20<1:01:52,  2.28s/it, lr: 1.0e-04 loss: 6.204e-01]
windy_storm:  46%|####5     | 1375/3000 [41:20<1:01:52,  2.28s/it, lr: 1.0e-04 loss: 6.204e-01]
windy_storm:  46%|####5     | 1375/3000 [41:23<1:01:52,  2.28s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  46%|####5     | 1375/3000 [41:23<1:01:52,  2.28s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  46%|####5     | 1376/3000 [41:23<1:07:37,  2.50s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  46%|####5     | 1376/3000 [41:23<1:07:37,  2.50s/it, lr: 1.0e-04 loss: 1.687e-01]
windy_storm:  46%|####5     | 1376/3000 [41:25<1:07:37,  2.50s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  46%|####5     | 1376/3000 [41:25<1:07:37,  2.50s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  46%|####5     | 1377/3000 [41:25<1:00:23,  2.23s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  46%|####5     | 1377/3000 [41:25<1:00:23,  2.23s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  46%|####5     | 1377/3000 [41:25<1:00:23,  2.23s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:  46%|####5     | 1377/3000 [41:25<1:00:23,  2.23s/it, lr: 1.0e-04 loss: 2.355e-01]
windy_storm:  46%|####5     | 1378/3000 [41:25<48:47,  1.80s/it, lr: 1.0e-04 loss: 2.355e-01]  
windy_storm:  46%|####5     | 1378/3000 [41:25<48:47,  1.80s/it, lr: 1.0e-04 loss: 2.355e-01]  
windy_storm:  46%|####5     | 1378/3000 [41:28<48:47,  1.80s/it, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  46%|####5     | 1378/3000 [41:28<48:47,  1.80s/it, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  46%|####5     | 1379/3000 [41:28<58:03,  2.15s/it, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  46%|####5     | 1379/3000 [41:28<58:03,  2.15s/it, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  46%|####5     | 1379/3000 [41:30<58:03,  2.15s/it, lr: 1.0e-04 loss: 1.899e-01]
windy_storm:  46%|####5     | 1379/3000 [41:30<58:03,  2.15s/it, lr: 1.0e-04 loss: 1.899e-01]
windy_storm:  46%|####6     | 1380/3000 [41:32<58:00,  2.15s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  46%|####6     | 1380/3000 [41:32<58:00,  2.15s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  46%|####6     | 1381/3000 [41:32<41:24,  1.53s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  46%|####6     | 1381/3000 [41:32<41:24,  1.53s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  46%|####6     | 1381/3000 [41:33<41:24,  1.53s/it, lr: 1.0e-04 loss: 2.780e-01]
windy_storm:  46%|####6     | 1381/3000 [41:33<41:24,  1.53s/it, lr: 1.0e-04 loss: 2.780e-01]
windy_storm:  46%|####6     | 1382/3000 [41:33<41:45,  1.55s/it, lr: 1.0e-04 loss: 2.780e-01]
windy_storm:  46%|####6     | 1382/3000 [41:33<41:45,  1.55s/it, lr: 1.0e-04 loss: 2.780e-01]
windy_storm:  46%|####6     | 1382/3000 [41:35<41:45,  1.55s/it, lr: 1.0e-04 loss: 4.430e-01]
windy_storm:  46%|####6     | 1382/3000 [41:35<41:45,  1.55s/it, lr: 1.0e-04 loss: 4.430e-01]
windy_storm:  46%|####6     | 1383/3000 [41:35<42:07,  1.56s/it, lr: 1.0e-04 loss: 4.430e-01]
windy_storm:  46%|####6     | 1383/3000 [41:35<42:07,  1.56s/it, lr: 1.0e-04 loss: 4.430e-01]
windy_storm:  46%|####6     | 1383/3000 [41:38<42:07,  1.56s/it, lr: 1.0e-04 loss: 1.260e-01]
windy_storm:  46%|####6     | 1383/3000 [41:38<42:07,  1.56s/it, lr: 1.0e-04 loss: 1.260e-01]
windy_storm:  46%|####6     | 1384/3000 [41:38<52:48,  1.96s/it, lr: 1.0e-04 loss: 1.260e-01]
windy_storm:  46%|####6     | 1384/3000 [41:38<52:48,  1.96s/it, lr: 1.0e-04 loss: 1.260e-01]
windy_storm:  46%|####6     | 1384/3000 [41:39<52:48,  1.96s/it, lr: 1.0e-04 loss: 3.930e-01]
windy_storm:  46%|####6     | 1384/3000 [41:39<52:48,  1.96s/it, lr: 1.0e-04 loss: 3.930e-01]
windy_storm:  46%|####6     | 1385/3000 [41:39<45:49,  1.70s/it, lr: 1.0e-04 loss: 3.930e-01]
windy_storm:  46%|####6     | 1385/3000 [41:39<45:49,  1.70s/it, lr: 1.0e-04 loss: 3.930e-01]
windy_storm:  46%|####6     | 1385/3000 [41:40<45:49,  1.70s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  46%|####6     | 1385/3000 [41:40<45:49,  1.70s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  46%|####6     | 1386/3000 [41:40<38:36,  1.44s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  46%|####6     | 1386/3000 [41:40<38:36,  1.44s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  46%|####6     | 1386/3000 [41:43<38:36,  1.44s/it, lr: 1.0e-04 loss: 6.093e-01]
windy_storm:  46%|####6     | 1386/3000 [41:43<38:36,  1.44s/it, lr: 1.0e-04 loss: 6.093e-01]
windy_storm:  46%|####6     | 1387/3000 [41:43<50:19,  1.87s/it, lr: 1.0e-04 loss: 6.093e-01]
windy_storm:  46%|####6     | 1387/3000 [41:43<50:19,  1.87s/it, lr: 1.0e-04 loss: 6.093e-01]
windy_storm:  46%|####6     | 1387/3000 [41:43<50:19,  1.87s/it, lr: 1.0e-04 loss: 4.818e-01]
windy_storm:  46%|####6     | 1387/3000 [41:43<50:19,  1.87s/it, lr: 1.0e-04 loss: 4.818e-01]
windy_storm:  46%|####6     | 1388/3000 [41:43<42:02,  1.56s/it, lr: 1.0e-04 loss: 4.818e-01]
windy_storm:  46%|####6     | 1388/3000 [41:43<42:02,  1.56s/it, lr: 1.0e-04 loss: 4.818e-01]
windy_storm:  46%|####6     | 1388/3000 [41:45<42:02,  1.56s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  46%|####6     | 1388/3000 [41:45<42:02,  1.56s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  46%|####6     | 1389/3000 [41:45<42:15,  1.57s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  46%|####6     | 1389/3000 [41:45<42:15,  1.57s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  46%|####6     | 1389/3000 [41:47<42:15,  1.57s/it, lr: 1.0e-04 loss: 5.341e-01]
windy_storm:  46%|####6     | 1389/3000 [41:47<42:15,  1.57s/it, lr: 1.0e-04 loss: 5.341e-01]
windy_storm:  46%|####6     | 1390/3000 [41:50<42:14,  1.57s/it, lr: 1.0e-04 loss: 6.317e-02]
windy_storm:  46%|####6     | 1390/3000 [41:50<42:14,  1.57s/it, lr: 1.0e-04 loss: 6.317e-02]
windy_storm:  46%|####6     | 1391/3000 [41:50<41:22,  1.54s/it, lr: 1.0e-04 loss: 6.317e-02]
windy_storm:  46%|####6     | 1391/3000 [41:50<41:22,  1.54s/it, lr: 1.0e-04 loss: 6.317e-02]
windy_storm:  46%|####6     | 1391/3000 [41:53<41:22,  1.54s/it, lr: 1.0e-04 loss: 4.326e-02]
windy_storm:  46%|####6     | 1391/3000 [41:53<41:22,  1.54s/it, lr: 1.0e-04 loss: 4.326e-02]
windy_storm:  46%|####6     | 1392/3000 [41:53<50:32,  1.89s/it, lr: 1.0e-04 loss: 4.326e-02]
windy_storm:  46%|####6     | 1392/3000 [41:53<50:32,  1.89s/it, lr: 1.0e-04 loss: 4.326e-02]
windy_storm:  46%|####6     | 1392/3000 [41:53<50:32,  1.89s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  46%|####6     | 1392/3000 [41:53<50:32,  1.89s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  46%|####6     | 1393/3000 [41:53<42:47,  1.60s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  46%|####6     | 1393/3000 [41:53<42:47,  1.60s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  46%|####6     | 1393/3000 [41:56<42:47,  1.60s/it, lr: 1.0e-04 loss: 6.252e-01]
windy_storm:  46%|####6     | 1393/3000 [41:56<42:47,  1.60s/it, lr: 1.0e-04 loss: 6.252e-01]
windy_storm:  46%|####6     | 1394/3000 [41:56<53:01,  1.98s/it, lr: 1.0e-04 loss: 6.252e-01]
windy_storm:  46%|####6     | 1394/3000 [41:56<53:01,  1.98s/it, lr: 1.0e-04 loss: 6.252e-01]
windy_storm:  46%|####6     | 1394/3000 [41:58<53:01,  1.98s/it, lr: 1.0e-04 loss: 2.744e-01]
windy_storm:  46%|####6     | 1394/3000 [41:58<53:01,  1.98s/it, lr: 1.0e-04 loss: 2.744e-01]
windy_storm:  46%|####6     | 1395/3000 [41:58<49:46,  1.86s/it, lr: 1.0e-04 loss: 2.744e-01]
windy_storm:  46%|####6     | 1395/3000 [41:58<49:46,  1.86s/it, lr: 1.0e-04 loss: 2.744e-01]
windy_storm:  46%|####6     | 1395/3000 [42:01<49:46,  1.86s/it, lr: 1.0e-04 loss: 6.760e-01]
windy_storm:  46%|####6     | 1395/3000 [42:01<49:46,  1.86s/it, lr: 1.0e-04 loss: 6.760e-01]
windy_storm:  47%|####6     | 1396/3000 [42:01<58:19,  2.18s/it, lr: 1.0e-04 loss: 6.760e-01]
windy_storm:  47%|####6     | 1396/3000 [42:01<58:19,  2.18s/it, lr: 1.0e-04 loss: 6.760e-01]
windy_storm:  47%|####6     | 1396/3000 [42:04<58:19,  2.18s/it, lr: 1.0e-04 loss: 5.944e-02]
windy_storm:  47%|####6     | 1396/3000 [42:04<58:19,  2.18s/it, lr: 1.0e-04 loss: 5.944e-02]
windy_storm:  47%|####6     | 1397/3000 [42:04<1:04:33,  2.42s/it, lr: 1.0e-04 loss: 5.944e-02]
windy_storm:  47%|####6     | 1397/3000 [42:04<1:04:33,  2.42s/it, lr: 1.0e-04 loss: 5.944e-02]
windy_storm:  47%|####6     | 1397/3000 [42:05<1:04:33,  2.42s/it, lr: 1.0e-04 loss: 2.553e-01]
windy_storm:  47%|####6     | 1397/3000 [42:05<1:04:33,  2.42s/it, lr: 1.0e-04 loss: 2.553e-01]
windy_storm:  47%|####6     | 1398/3000 [42:05<52:00,  1.95s/it, lr: 1.0e-04 loss: 2.553e-01]  
windy_storm:  47%|####6     | 1398/3000 [42:05<52:00,  1.95s/it, lr: 1.0e-04 loss: 2.553e-01]  
windy_storm:  47%|####6     | 1398/3000 [42:05<52:00,  1.95s/it, lr: 1.0e-04 loss: 6.315e-01]
windy_storm:  47%|####6     | 1398/3000 [42:05<52:00,  1.95s/it, lr: 1.0e-04 loss: 6.315e-01]
windy_storm:  47%|####6     | 1399/3000 [42:05<42:37,  1.60s/it, lr: 1.0e-04 loss: 6.315e-01]
windy_storm:  47%|####6     | 1399/3000 [42:05<42:37,  1.60s/it, lr: 1.0e-04 loss: 6.315e-01]
windy_storm:  47%|####6     | 1399/3000 [42:07<42:37,  1.60s/it, lr: 1.0e-04 loss: 3.798e-01]
windy_storm:  47%|####6     | 1399/3000 [42:07<42:37,  1.60s/it, lr: 1.0e-04 loss: 3.798e-01]
windy_storm:  47%|####6     | 1400/3000 [42:08<42:36,  1.60s/it, lr: 1.0e-04 loss: 2.963e-02]
windy_storm:  47%|####6     | 1400/3000 [42:08<42:36,  1.60s/it, lr: 1.0e-04 loss: 2.963e-02]
windy_storm:  47%|####6     | 1401/3000 [42:08<27:42,  1.04s/it, lr: 1.0e-04 loss: 2.963e-02]
windy_storm:  47%|####6     | 1401/3000 [42:08<27:42,  1.04s/it, lr: 1.0e-04 loss: 2.963e-02]
windy_storm:  47%|####6     | 1401/3000 [42:09<27:42,  1.04s/it, lr: 1.0e-04 loss: 5.690e-01]
windy_storm:  47%|####6     | 1401/3000 [42:09<27:42,  1.04s/it, lr: 1.0e-04 loss: 5.690e-01]
windy_storm:  47%|####6     | 1402/3000 [42:09<25:51,  1.03it/s, lr: 1.0e-04 loss: 5.690e-01]
windy_storm:  47%|####6     | 1402/3000 [42:09<25:51,  1.03it/s, lr: 1.0e-04 loss: 5.690e-01]
windy_storm:  47%|####6     | 1402/3000 [42:10<25:51,  1.03it/s, lr: 1.0e-04 loss: 7.802e-02]
windy_storm:  47%|####6     | 1402/3000 [42:10<25:51,  1.03it/s, lr: 1.0e-04 loss: 7.802e-02]
windy_storm:  47%|####6     | 1403/3000 [42:10<24:46,  1.07it/s, lr: 1.0e-04 loss: 7.802e-02]
windy_storm:  47%|####6     | 1403/3000 [42:10<24:46,  1.07it/s, lr: 1.0e-04 loss: 7.802e-02]
windy_storm:  47%|####6     | 1403/3000 [42:12<24:46,  1.07it/s, lr: 1.0e-04 loss: 2.706e-01]
windy_storm:  47%|####6     | 1403/3000 [42:12<24:46,  1.07it/s, lr: 1.0e-04 loss: 2.706e-01]
windy_storm:  47%|####6     | 1404/3000 [42:12<38:59,  1.47s/it, lr: 1.0e-04 loss: 2.706e-01]
windy_storm:  47%|####6     | 1404/3000 [42:12<38:59,  1.47s/it, lr: 1.0e-04 loss: 2.706e-01]
windy_storm:  47%|####6     | 1404/3000 [42:14<38:59,  1.47s/it, lr: 1.0e-04 loss: 7.519e-02]
windy_storm:  47%|####6     | 1404/3000 [42:14<38:59,  1.47s/it, lr: 1.0e-04 loss: 7.519e-02]
windy_storm:  47%|####6     | 1405/3000 [42:14<39:47,  1.50s/it, lr: 1.0e-04 loss: 7.519e-02]
windy_storm:  47%|####6     | 1405/3000 [42:14<39:47,  1.50s/it, lr: 1.0e-04 loss: 7.519e-02]
windy_storm:  47%|####6     | 1405/3000 [42:17<39:47,  1.50s/it, lr: 1.0e-04 loss: 2.226e-01]
windy_storm:  47%|####6     | 1405/3000 [42:17<39:47,  1.50s/it, lr: 1.0e-04 loss: 2.226e-01]
windy_storm:  47%|####6     | 1406/3000 [42:17<50:28,  1.90s/it, lr: 1.0e-04 loss: 2.226e-01]
windy_storm:  47%|####6     | 1406/3000 [42:17<50:28,  1.90s/it, lr: 1.0e-04 loss: 2.226e-01]
windy_storm:  47%|####6     | 1406/3000 [42:19<50:28,  1.90s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  47%|####6     | 1406/3000 [42:19<50:28,  1.90s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  47%|####6     | 1407/3000 [42:19<48:02,  1.81s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  47%|####6     | 1407/3000 [42:19<48:02,  1.81s/it, lr: 1.0e-04 loss: 5.112e-01]
windy_storm:  47%|####6     | 1407/3000 [42:21<48:02,  1.81s/it, lr: 1.0e-04 loss: 3.088e-01]
windy_storm:  47%|####6     | 1407/3000 [42:21<48:02,  1.81s/it, lr: 1.0e-04 loss: 3.088e-01]
windy_storm:  47%|####6     | 1408/3000 [42:21<56:37,  2.13s/it, lr: 1.0e-04 loss: 3.088e-01]
windy_storm:  47%|####6     | 1408/3000 [42:21<56:37,  2.13s/it, lr: 1.0e-04 loss: 3.088e-01]
windy_storm:  47%|####6     | 1408/3000 [42:23<56:37,  2.13s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  47%|####6     | 1408/3000 [42:23<56:37,  2.13s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  47%|####6     | 1409/3000 [42:23<52:11,  1.97s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  47%|####6     | 1409/3000 [42:23<52:11,  1.97s/it, lr: 1.0e-04 loss: 6.850e-01]
windy_storm:  47%|####6     | 1409/3000 [42:26<52:11,  1.97s/it, lr: 1.0e-04 loss: 4.206e-01]
windy_storm:  47%|####6     | 1409/3000 [42:26<52:11,  1.97s/it, lr: 1.0e-04 loss: 4.206e-01]
windy_storm:  47%|####6     | 1410/3000 [42:28<52:09,  1.97s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  47%|####6     | 1410/3000 [42:28<52:09,  1.97s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  47%|####7     | 1411/3000 [42:28<37:54,  1.43s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  47%|####7     | 1411/3000 [42:28<37:54,  1.43s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  47%|####7     | 1411/3000 [42:29<37:54,  1.43s/it, lr: 1.0e-04 loss: 4.198e-01]
windy_storm:  47%|####7     | 1411/3000 [42:29<37:54,  1.43s/it, lr: 1.0e-04 loss: 4.198e-01]
windy_storm:  47%|####7     | 1412/3000 [42:29<38:55,  1.47s/it, lr: 1.0e-04 loss: 4.198e-01]
windy_storm:  47%|####7     | 1412/3000 [42:29<38:55,  1.47s/it, lr: 1.0e-04 loss: 4.198e-01]
windy_storm:  47%|####7     | 1412/3000 [42:32<38:55,  1.47s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm:  47%|####7     | 1412/3000 [42:32<38:55,  1.47s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm:  47%|####7     | 1413/3000 [42:32<49:26,  1.87s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm:  47%|####7     | 1413/3000 [42:32<49:26,  1.87s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm:  47%|####7     | 1413/3000 [42:35<49:26,  1.87s/it, lr: 1.0e-04 loss: 1.927e-01]
windy_storm:  47%|####7     | 1413/3000 [42:35<49:26,  1.87s/it, lr: 1.0e-04 loss: 1.927e-01]
windy_storm:  47%|####7     | 1414/3000 [42:35<58:28,  2.21s/it, lr: 1.0e-04 loss: 1.927e-01]
windy_storm:  47%|####7     | 1414/3000 [42:35<58:28,  2.21s/it, lr: 1.0e-04 loss: 1.927e-01]
windy_storm:  47%|####7     | 1414/3000 [42:37<58:28,  2.21s/it, lr: 1.0e-04 loss: 2.691e-01]
windy_storm:  47%|####7     | 1414/3000 [42:37<58:28,  2.21s/it, lr: 1.0e-04 loss: 2.691e-01]
windy_storm:  47%|####7     | 1415/3000 [42:37<53:47,  2.04s/it, lr: 1.0e-04 loss: 2.691e-01]
windy_storm:  47%|####7     | 1415/3000 [42:37<53:47,  2.04s/it, lr: 1.0e-04 loss: 2.691e-01]
windy_storm:  47%|####7     | 1415/3000 [42:38<53:47,  2.04s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  47%|####7     | 1415/3000 [42:38<53:47,  2.04s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  47%|####7     | 1416/3000 [42:38<43:59,  1.67s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  47%|####7     | 1416/3000 [42:38<43:59,  1.67s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  47%|####7     | 1416/3000 [42:41<43:59,  1.67s/it, lr: 1.0e-04 loss: 1.879e-01]
windy_storm:  47%|####7     | 1416/3000 [42:41<43:59,  1.67s/it, lr: 1.0e-04 loss: 1.879e-01]
windy_storm:  47%|####7     | 1417/3000 [42:41<53:32,  2.03s/it, lr: 1.0e-04 loss: 1.879e-01]
windy_storm:  47%|####7     | 1417/3000 [42:41<53:32,  2.03s/it, lr: 1.0e-04 loss: 1.879e-01]
windy_storm:  47%|####7     | 1417/3000 [42:41<53:32,  2.03s/it, lr: 1.0e-04 loss: 6.541e-01]
windy_storm:  47%|####7     | 1417/3000 [42:41<53:32,  2.03s/it, lr: 1.0e-04 loss: 6.541e-01]
windy_storm:  47%|####7     | 1418/3000 [42:41<44:11,  1.68s/it, lr: 1.0e-04 loss: 6.541e-01]
windy_storm:  47%|####7     | 1418/3000 [42:41<44:11,  1.68s/it, lr: 1.0e-04 loss: 6.541e-01]
windy_storm:  47%|####7     | 1418/3000 [42:42<44:11,  1.68s/it, lr: 1.0e-04 loss: 2.300e-01]
windy_storm:  47%|####7     | 1418/3000 [42:42<44:11,  1.68s/it, lr: 1.0e-04 loss: 2.300e-01]
windy_storm:  47%|####7     | 1419/3000 [42:42<37:32,  1.42s/it, lr: 1.0e-04 loss: 2.300e-01]
windy_storm:  47%|####7     | 1419/3000 [42:42<37:32,  1.42s/it, lr: 1.0e-04 loss: 2.300e-01]
windy_storm:  47%|####7     | 1419/3000 [42:43<37:32,  1.42s/it, lr: 1.0e-04 loss: 2.511e-01]
windy_storm:  47%|####7     | 1419/3000 [42:43<37:32,  1.42s/it, lr: 1.0e-04 loss: 2.511e-01]
windy_storm:  47%|####7     | 1420/3000 [42:45<37:30,  1.42s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  47%|####7     | 1420/3000 [42:45<37:30,  1.42s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  47%|####7     | 1421/3000 [42:45<29:49,  1.13s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  47%|####7     | 1421/3000 [42:45<29:49,  1.13s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  47%|####7     | 1421/3000 [42:45<29:49,  1.13s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  47%|####7     | 1421/3000 [42:45<29:49,  1.13s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  47%|####7     | 1422/3000 [42:45<27:48,  1.06s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  47%|####7     | 1422/3000 [42:45<27:48,  1.06s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  47%|####7     | 1422/3000 [42:46<27:48,  1.06s/it, lr: 1.0e-04 loss: 5.717e-01]
windy_storm:  47%|####7     | 1422/3000 [42:46<27:48,  1.06s/it, lr: 1.0e-04 loss: 5.717e-01]
windy_storm:  47%|####7     | 1423/3000 [42:46<25:48,  1.02it/s, lr: 1.0e-04 loss: 5.717e-01]
windy_storm:  47%|####7     | 1423/3000 [42:46<25:48,  1.02it/s, lr: 1.0e-04 loss: 5.717e-01]
windy_storm:  47%|####7     | 1423/3000 [42:48<25:48,  1.02it/s, lr: 1.0e-04 loss: 1.671e-01]
windy_storm:  47%|####7     | 1423/3000 [42:48<25:48,  1.02it/s, lr: 1.0e-04 loss: 1.671e-01]
windy_storm:  47%|####7     | 1424/3000 [42:48<29:33,  1.13s/it, lr: 1.0e-04 loss: 1.671e-01]
windy_storm:  47%|####7     | 1424/3000 [42:48<29:33,  1.13s/it, lr: 1.0e-04 loss: 1.671e-01]
windy_storm:  47%|####7     | 1424/3000 [42:49<29:33,  1.13s/it, lr: 1.0e-04 loss: 4.249e-01]
windy_storm:  47%|####7     | 1424/3000 [42:49<29:33,  1.13s/it, lr: 1.0e-04 loss: 4.249e-01]
windy_storm:  48%|####7     | 1425/3000 [42:49<32:56,  1.26s/it, lr: 1.0e-04 loss: 4.249e-01]
windy_storm:  48%|####7     | 1425/3000 [42:49<32:56,  1.26s/it, lr: 1.0e-04 loss: 4.249e-01]
windy_storm:  48%|####7     | 1425/3000 [42:51<32:56,  1.26s/it, lr: 1.0e-04 loss: 5.779e-01]
windy_storm:  48%|####7     | 1425/3000 [42:51<32:56,  1.26s/it, lr: 1.0e-04 loss: 5.779e-01]
windy_storm:  48%|####7     | 1426/3000 [42:51<35:24,  1.35s/it, lr: 1.0e-04 loss: 5.779e-01]
windy_storm:  48%|####7     | 1426/3000 [42:51<35:24,  1.35s/it, lr: 1.0e-04 loss: 5.779e-01]
windy_storm:  48%|####7     | 1426/3000 [42:52<35:24,  1.35s/it, lr: 1.0e-04 loss: 6.293e-01]
windy_storm:  48%|####7     | 1426/3000 [42:52<35:24,  1.35s/it, lr: 1.0e-04 loss: 6.293e-01]
windy_storm:  48%|####7     | 1427/3000 [42:52<32:52,  1.25s/it, lr: 1.0e-04 loss: 6.293e-01]
windy_storm:  48%|####7     | 1427/3000 [42:52<32:52,  1.25s/it, lr: 1.0e-04 loss: 6.293e-01]
windy_storm:  48%|####7     | 1427/3000 [42:53<32:52,  1.25s/it, lr: 1.0e-04 loss: 8.301e-02]
windy_storm:  48%|####7     | 1427/3000 [42:53<32:52,  1.25s/it, lr: 1.0e-04 loss: 8.301e-02]
windy_storm:  48%|####7     | 1428/3000 [42:53<29:07,  1.11s/it, lr: 1.0e-04 loss: 8.301e-02]
windy_storm:  48%|####7     | 1428/3000 [42:53<29:07,  1.11s/it, lr: 1.0e-04 loss: 8.301e-02]
windy_storm:  48%|####7     | 1428/3000 [42:56<29:07,  1.11s/it, lr: 1.0e-04 loss: 4.481e-01]
windy_storm:  48%|####7     | 1428/3000 [42:56<29:07,  1.11s/it, lr: 1.0e-04 loss: 4.481e-01]
windy_storm:  48%|####7     | 1429/3000 [42:56<43:08,  1.65s/it, lr: 1.0e-04 loss: 4.481e-01]
windy_storm:  48%|####7     | 1429/3000 [42:56<43:08,  1.65s/it, lr: 1.0e-04 loss: 4.481e-01]
windy_storm:  48%|####7     | 1429/3000 [42:57<43:08,  1.65s/it, lr: 1.0e-04 loss: 5.427e-01]
windy_storm:  48%|####7     | 1429/3000 [42:57<43:08,  1.65s/it, lr: 1.0e-04 loss: 5.427e-01]
windy_storm:  48%|####7     | 1430/3000 [42:58<43:06,  1.65s/it, lr: 1.0e-04 loss: 8.065e-02]
windy_storm:  48%|####7     | 1430/3000 [42:58<43:06,  1.65s/it, lr: 1.0e-04 loss: 8.065e-02]
windy_storm:  48%|####7     | 1431/3000 [42:58<27:55,  1.07s/it, lr: 1.0e-04 loss: 8.065e-02]
windy_storm:  48%|####7     | 1431/3000 [42:58<27:55,  1.07s/it, lr: 1.0e-04 loss: 8.065e-02]
windy_storm:  48%|####7     | 1431/3000 [42:59<27:55,  1.07s/it, lr: 1.0e-04 loss: 1.895e-01]
windy_storm:  48%|####7     | 1431/3000 [42:59<27:55,  1.07s/it, lr: 1.0e-04 loss: 1.895e-01]
windy_storm:  48%|####7     | 1432/3000 [42:59<25:57,  1.01it/s, lr: 1.0e-04 loss: 1.895e-01]
windy_storm:  48%|####7     | 1432/3000 [42:59<25:57,  1.01it/s, lr: 1.0e-04 loss: 1.895e-01]
windy_storm:  48%|####7     | 1432/3000 [43:00<25:57,  1.01it/s, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  48%|####7     | 1432/3000 [43:00<25:57,  1.01it/s, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  48%|####7     | 1433/3000 [43:00<29:40,  1.14s/it, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  48%|####7     | 1433/3000 [43:00<29:40,  1.14s/it, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  48%|####7     | 1433/3000 [43:01<29:40,  1.14s/it, lr: 1.0e-04 loss: 4.452e-01]
windy_storm:  48%|####7     | 1433/3000 [43:01<29:40,  1.14s/it, lr: 1.0e-04 loss: 4.452e-01]
windy_storm:  48%|####7     | 1434/3000 [43:01<27:31,  1.05s/it, lr: 1.0e-04 loss: 4.452e-01]
windy_storm:  48%|####7     | 1434/3000 [43:01<27:31,  1.05s/it, lr: 1.0e-04 loss: 4.452e-01]
windy_storm:  48%|####7     | 1434/3000 [43:04<27:31,  1.05s/it, lr: 1.0e-04 loss: 3.613e-01]
windy_storm:  48%|####7     | 1434/3000 [43:04<27:31,  1.05s/it, lr: 1.0e-04 loss: 3.613e-01]
windy_storm:  48%|####7     | 1435/3000 [43:04<41:14,  1.58s/it, lr: 1.0e-04 loss: 3.613e-01]
windy_storm:  48%|####7     | 1435/3000 [43:04<41:14,  1.58s/it, lr: 1.0e-04 loss: 3.613e-01]
windy_storm:  48%|####7     | 1435/3000 [43:07<41:14,  1.58s/it, lr: 1.0e-04 loss: 5.226e-01]
windy_storm:  48%|####7     | 1435/3000 [43:07<41:14,  1.58s/it, lr: 1.0e-04 loss: 5.226e-01]
windy_storm:  48%|####7     | 1436/3000 [43:07<51:40,  1.98s/it, lr: 1.0e-04 loss: 5.226e-01]
windy_storm:  48%|####7     | 1436/3000 [43:07<51:40,  1.98s/it, lr: 1.0e-04 loss: 5.226e-01]
windy_storm:  48%|####7     | 1436/3000 [43:08<51:40,  1.98s/it, lr: 1.0e-04 loss: 3.508e-01]
windy_storm:  48%|####7     | 1436/3000 [43:08<51:40,  1.98s/it, lr: 1.0e-04 loss: 3.508e-01]
windy_storm:  48%|####7     | 1437/3000 [43:08<48:41,  1.87s/it, lr: 1.0e-04 loss: 3.508e-01]
windy_storm:  48%|####7     | 1437/3000 [43:08<48:41,  1.87s/it, lr: 1.0e-04 loss: 3.508e-01]
windy_storm:  48%|####7     | 1437/3000 [43:09<48:41,  1.87s/it, lr: 1.0e-04 loss: 4.707e-01]
windy_storm:  48%|####7     | 1437/3000 [43:09<48:41,  1.87s/it, lr: 1.0e-04 loss: 4.707e-01]
windy_storm:  48%|####7     | 1438/3000 [43:09<40:08,  1.54s/it, lr: 1.0e-04 loss: 4.707e-01]
windy_storm:  48%|####7     | 1438/3000 [43:09<40:08,  1.54s/it, lr: 1.0e-04 loss: 4.707e-01]
windy_storm:  48%|####7     | 1438/3000 [43:11<40:08,  1.54s/it, lr: 1.0e-04 loss: 5.914e-01]
windy_storm:  48%|####7     | 1438/3000 [43:11<40:08,  1.54s/it, lr: 1.0e-04 loss: 5.914e-01]
windy_storm:  48%|####7     | 1439/3000 [43:11<40:28,  1.56s/it, lr: 1.0e-04 loss: 5.914e-01]
windy_storm:  48%|####7     | 1439/3000 [43:11<40:28,  1.56s/it, lr: 1.0e-04 loss: 5.914e-01]
windy_storm:  48%|####7     | 1439/3000 [43:12<40:28,  1.56s/it, lr: 1.0e-04 loss: 6.545e-01]
windy_storm:  48%|####7     | 1439/3000 [43:12<40:28,  1.56s/it, lr: 1.0e-04 loss: 6.545e-01]
windy_storm:  48%|####8     | 1440/3000 [43:15<40:26,  1.56s/it, lr: 1.0e-04 loss: 7.235e-02]
windy_storm:  48%|####8     | 1440/3000 [43:15<40:26,  1.56s/it, lr: 1.0e-04 loss: 7.235e-02]
windy_storm:  48%|####8     | 1441/3000 [43:15<39:48,  1.53s/it, lr: 1.0e-04 loss: 7.235e-02]
windy_storm:  48%|####8     | 1441/3000 [43:15<39:48,  1.53s/it, lr: 1.0e-04 loss: 7.235e-02]
windy_storm:  48%|####8     | 1441/3000 [43:18<39:48,  1.53s/it, lr: 1.0e-04 loss: 1.559e-02]
windy_storm:  48%|####8     | 1441/3000 [43:18<39:48,  1.53s/it, lr: 1.0e-04 loss: 1.559e-02]
windy_storm:  48%|####8     | 1442/3000 [43:18<48:52,  1.88s/it, lr: 1.0e-04 loss: 1.559e-02]
windy_storm:  48%|####8     | 1442/3000 [43:18<48:52,  1.88s/it, lr: 1.0e-04 loss: 1.559e-02]
windy_storm:  48%|####8     | 1442/3000 [43:19<48:52,  1.88s/it, lr: 1.0e-04 loss: 6.683e-02]
windy_storm:  48%|####8     | 1442/3000 [43:19<48:52,  1.88s/it, lr: 1.0e-04 loss: 6.683e-02]
windy_storm:  48%|####8     | 1443/3000 [43:19<41:13,  1.59s/it, lr: 1.0e-04 loss: 6.683e-02]
windy_storm:  48%|####8     | 1443/3000 [43:19<41:13,  1.59s/it, lr: 1.0e-04 loss: 6.683e-02]
windy_storm:  48%|####8     | 1443/3000 [43:22<41:13,  1.59s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  48%|####8     | 1443/3000 [43:22<41:13,  1.59s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  48%|####8     | 1444/3000 [43:22<50:39,  1.95s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  48%|####8     | 1444/3000 [43:22<50:39,  1.95s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  48%|####8     | 1444/3000 [43:24<50:39,  1.95s/it, lr: 1.0e-04 loss: 7.015e-01]
windy_storm:  48%|####8     | 1444/3000 [43:24<50:39,  1.95s/it, lr: 1.0e-04 loss: 7.015e-01]
windy_storm:  48%|####8     | 1445/3000 [43:24<47:51,  1.85s/it, lr: 1.0e-04 loss: 7.015e-01]
windy_storm:  48%|####8     | 1445/3000 [43:24<47:51,  1.85s/it, lr: 1.0e-04 loss: 7.015e-01]
windy_storm:  48%|####8     | 1445/3000 [43:25<47:51,  1.85s/it, lr: 1.0e-04 loss: 1.867e-01]
windy_storm:  48%|####8     | 1445/3000 [43:25<47:51,  1.85s/it, lr: 1.0e-04 loss: 1.867e-01]
windy_storm:  48%|####8     | 1446/3000 [43:25<45:49,  1.77s/it, lr: 1.0e-04 loss: 1.867e-01]
windy_storm:  48%|####8     | 1446/3000 [43:25<45:49,  1.77s/it, lr: 1.0e-04 loss: 1.867e-01]
windy_storm:  48%|####8     | 1446/3000 [43:28<45:49,  1.77s/it, lr: 1.0e-04 loss: 5.189e-01]
windy_storm:  48%|####8     | 1446/3000 [43:28<45:49,  1.77s/it, lr: 1.0e-04 loss: 5.189e-01]
windy_storm:  48%|####8     | 1447/3000 [43:28<55:07,  2.13s/it, lr: 1.0e-04 loss: 5.189e-01]
windy_storm:  48%|####8     | 1447/3000 [43:28<55:07,  2.13s/it, lr: 1.0e-04 loss: 5.189e-01]
windy_storm:  48%|####8     | 1447/3000 [43:30<55:07,  2.13s/it, lr: 1.0e-04 loss: 5.140e-01]
windy_storm:  48%|####8     | 1447/3000 [43:30<55:07,  2.13s/it, lr: 1.0e-04 loss: 5.140e-01]
windy_storm:  48%|####8     | 1448/3000 [43:30<50:56,  1.97s/it, lr: 1.0e-04 loss: 5.140e-01]
windy_storm:  48%|####8     | 1448/3000 [43:30<50:56,  1.97s/it, lr: 1.0e-04 loss: 5.140e-01]
windy_storm:  48%|####8     | 1448/3000 [43:31<50:56,  1.97s/it, lr: 1.0e-04 loss: 6.556e-02]
windy_storm:  48%|####8     | 1448/3000 [43:31<50:56,  1.97s/it, lr: 1.0e-04 loss: 6.556e-02]
windy_storm:  48%|####8     | 1449/3000 [43:31<41:45,  1.62s/it, lr: 1.0e-04 loss: 6.556e-02]
windy_storm:  48%|####8     | 1449/3000 [43:31<41:45,  1.62s/it, lr: 1.0e-04 loss: 6.556e-02]
windy_storm:  48%|####8     | 1449/3000 [43:32<41:45,  1.62s/it, lr: 1.0e-04 loss: 3.031e-01]
windy_storm:  48%|####8     | 1449/3000 [43:32<41:45,  1.62s/it, lr: 1.0e-04 loss: 3.031e-01]
windy_storm:  48%|####8     | 1450/3000 [43:34<41:43,  1.62s/it, lr: 1.0e-04 loss: 4.240e-01]
windy_storm:  48%|####8     | 1450/3000 [43:34<41:43,  1.62s/it, lr: 1.0e-04 loss: 4.240e-01]
windy_storm:  48%|####8     | 1451/3000 [43:34<31:58,  1.24s/it, lr: 1.0e-04 loss: 4.240e-01]
windy_storm:  48%|####8     | 1451/3000 [43:34<31:58,  1.24s/it, lr: 1.0e-04 loss: 4.240e-01]
windy_storm:  48%|####8     | 1451/3000 [43:35<31:58,  1.24s/it, lr: 1.0e-04 loss: 2.699e-01]
windy_storm:  48%|####8     | 1451/3000 [43:35<31:58,  1.24s/it, lr: 1.0e-04 loss: 2.699e-01]
windy_storm:  48%|####8     | 1452/3000 [43:35<33:59,  1.32s/it, lr: 1.0e-04 loss: 2.699e-01]
windy_storm:  48%|####8     | 1452/3000 [43:35<33:59,  1.32s/it, lr: 1.0e-04 loss: 2.699e-01]
windy_storm:  48%|####8     | 1452/3000 [43:38<33:59,  1.32s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  48%|####8     | 1452/3000 [43:38<33:59,  1.32s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  48%|####8     | 1453/3000 [43:38<44:35,  1.73s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  48%|####8     | 1453/3000 [43:38<44:35,  1.73s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  48%|####8     | 1453/3000 [43:39<44:35,  1.73s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  48%|####8     | 1453/3000 [43:39<44:35,  1.73s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  48%|####8     | 1454/3000 [43:39<37:55,  1.47s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  48%|####8     | 1454/3000 [43:39<37:55,  1.47s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  48%|####8     | 1454/3000 [43:40<37:55,  1.47s/it, lr: 1.0e-04 loss: 6.930e-02]
windy_storm:  48%|####8     | 1454/3000 [43:40<37:55,  1.47s/it, lr: 1.0e-04 loss: 6.930e-02]
windy_storm:  48%|####8     | 1455/3000 [43:40<34:44,  1.35s/it, lr: 1.0e-04 loss: 6.930e-02]
windy_storm:  48%|####8     | 1455/3000 [43:40<34:44,  1.35s/it, lr: 1.0e-04 loss: 6.930e-02]
windy_storm:  48%|####8     | 1455/3000 [43:43<34:44,  1.35s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  48%|####8     | 1455/3000 [43:43<34:44,  1.35s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  49%|####8     | 1456/3000 [43:43<47:02,  1.83s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  49%|####8     | 1456/3000 [43:43<47:02,  1.83s/it, lr: 1.0e-04 loss: 2.476e-01]
windy_storm:  49%|####8     | 1456/3000 [43:46<47:02,  1.83s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:  49%|####8     | 1456/3000 [43:46<47:02,  1.83s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:  49%|####8     | 1457/3000 [43:46<55:03,  2.14s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:  49%|####8     | 1457/3000 [43:46<55:03,  2.14s/it, lr: 1.0e-04 loss: 1.358e-01]
windy_storm:  49%|####8     | 1457/3000 [43:48<55:03,  2.14s/it, lr: 1.0e-04 loss: 1.500e-01]
windy_storm:  49%|####8     | 1457/3000 [43:48<55:03,  2.14s/it, lr: 1.0e-04 loss: 1.500e-01]
windy_storm:  49%|####8     | 1458/3000 [43:48<50:49,  1.98s/it, lr: 1.0e-04 loss: 1.500e-01]
windy_storm:  49%|####8     | 1458/3000 [43:48<50:49,  1.98s/it, lr: 1.0e-04 loss: 1.500e-01]
windy_storm:  49%|####8     | 1458/3000 [43:49<50:49,  1.98s/it, lr: 1.0e-04 loss: 8.413e-02]
windy_storm:  49%|####8     | 1458/3000 [43:49<50:49,  1.98s/it, lr: 1.0e-04 loss: 8.413e-02]
windy_storm:  49%|####8     | 1459/3000 [43:49<47:51,  1.86s/it, lr: 1.0e-04 loss: 8.413e-02]
windy_storm:  49%|####8     | 1459/3000 [43:49<47:51,  1.86s/it, lr: 1.0e-04 loss: 8.413e-02]
windy_storm:  49%|####8     | 1459/3000 [43:52<47:51,  1.86s/it, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  49%|####8     | 1459/3000 [43:52<47:51,  1.86s/it, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  49%|####8     | 1460/3000 [43:53<47:49,  1.86s/it, lr: 1.0e-04 loss: 6.152e-01]
windy_storm:  49%|####8     | 1460/3000 [43:53<47:49,  1.86s/it, lr: 1.0e-04 loss: 6.152e-01]
windy_storm:  49%|####8     | 1461/3000 [43:53<30:48,  1.20s/it, lr: 1.0e-04 loss: 6.152e-01]
windy_storm:  49%|####8     | 1461/3000 [43:53<30:48,  1.20s/it, lr: 1.0e-04 loss: 6.152e-01]
windy_storm:  49%|####8     | 1461/3000 [43:55<30:48,  1.20s/it, lr: 1.0e-04 loss: 6.493e-02]
windy_storm:  49%|####8     | 1461/3000 [43:55<30:48,  1.20s/it, lr: 1.0e-04 loss: 6.493e-02]
windy_storm:  49%|####8     | 1462/3000 [43:55<33:18,  1.30s/it, lr: 1.0e-04 loss: 6.493e-02]
windy_storm:  49%|####8     | 1462/3000 [43:55<33:18,  1.30s/it, lr: 1.0e-04 loss: 6.493e-02]
windy_storm:  49%|####8     | 1462/3000 [43:58<33:18,  1.30s/it, lr: 1.0e-04 loss: 6.134e-01]
windy_storm:  49%|####8     | 1462/3000 [43:58<33:18,  1.30s/it, lr: 1.0e-04 loss: 6.134e-01]
windy_storm:  49%|####8     | 1463/3000 [43:58<44:15,  1.73s/it, lr: 1.0e-04 loss: 6.134e-01]
windy_storm:  49%|####8     | 1463/3000 [43:58<44:15,  1.73s/it, lr: 1.0e-04 loss: 6.134e-01]
windy_storm:  49%|####8     | 1463/3000 [43:59<44:15,  1.73s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  49%|####8     | 1463/3000 [43:59<44:15,  1.73s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  49%|####8     | 1464/3000 [43:59<43:17,  1.69s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  49%|####8     | 1464/3000 [43:59<43:17,  1.69s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  49%|####8     | 1464/3000 [44:01<43:17,  1.69s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  49%|####8     | 1464/3000 [44:01<43:17,  1.69s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  49%|####8     | 1465/3000 [44:01<42:36,  1.67s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  49%|####8     | 1465/3000 [44:01<42:36,  1.67s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  49%|####8     | 1465/3000 [44:01<42:36,  1.67s/it, lr: 1.0e-04 loss: 4.545e-01]
windy_storm:  49%|####8     | 1465/3000 [44:01<42:36,  1.67s/it, lr: 1.0e-04 loss: 4.545e-01]
windy_storm:  49%|####8     | 1466/3000 [44:01<35:51,  1.40s/it, lr: 1.0e-04 loss: 4.545e-01]
windy_storm:  49%|####8     | 1466/3000 [44:01<35:51,  1.40s/it, lr: 1.0e-04 loss: 4.545e-01]
windy_storm:  49%|####8     | 1466/3000 [44:02<35:51,  1.40s/it, lr: 1.0e-04 loss: 1.141e-01]
windy_storm:  49%|####8     | 1466/3000 [44:02<35:51,  1.40s/it, lr: 1.0e-04 loss: 1.141e-01]
windy_storm:  49%|####8     | 1467/3000 [44:02<31:12,  1.22s/it, lr: 1.0e-04 loss: 1.141e-01]
windy_storm:  49%|####8     | 1467/3000 [44:02<31:12,  1.22s/it, lr: 1.0e-04 loss: 1.141e-01]
windy_storm:  49%|####8     | 1467/3000 [44:04<31:12,  1.22s/it, lr: 1.0e-04 loss: 6.770e-01]
windy_storm:  49%|####8     | 1467/3000 [44:04<31:12,  1.22s/it, lr: 1.0e-04 loss: 6.770e-01]
windy_storm:  49%|####8     | 1468/3000 [44:04<33:43,  1.32s/it, lr: 1.0e-04 loss: 6.770e-01]
windy_storm:  49%|####8     | 1468/3000 [44:04<33:43,  1.32s/it, lr: 1.0e-04 loss: 6.770e-01]
windy_storm:  49%|####8     | 1468/3000 [44:05<33:43,  1.32s/it, lr: 1.0e-04 loss: 6.289e-01]
windy_storm:  49%|####8     | 1468/3000 [44:05<33:43,  1.32s/it, lr: 1.0e-04 loss: 6.289e-01]
windy_storm:  49%|####8     | 1469/3000 [44:05<31:25,  1.23s/it, lr: 1.0e-04 loss: 6.289e-01]
windy_storm:  49%|####8     | 1469/3000 [44:05<31:25,  1.23s/it, lr: 1.0e-04 loss: 6.289e-01]
windy_storm:  49%|####8     | 1469/3000 [44:08<31:25,  1.23s/it, lr: 1.0e-04 loss: 1.387e-01]
windy_storm:  49%|####8     | 1469/3000 [44:08<31:25,  1.23s/it, lr: 1.0e-04 loss: 1.387e-01]
windy_storm:  49%|####9     | 1470/3000 [44:11<31:24,  1.23s/it, lr: 1.0e-04 loss: 6.580e-02]
windy_storm:  49%|####9     | 1470/3000 [44:11<31:24,  1.23s/it, lr: 1.0e-04 loss: 6.580e-02]
windy_storm:  49%|####9     | 1471/3000 [44:11<34:45,  1.36s/it, lr: 1.0e-04 loss: 6.580e-02]
windy_storm:  49%|####9     | 1471/3000 [44:11<34:45,  1.36s/it, lr: 1.0e-04 loss: 6.580e-02]
windy_storm:  49%|####9     | 1471/3000 [44:14<34:45,  1.36s/it, lr: 1.0e-04 loss: 3.055e-01]
windy_storm:  49%|####9     | 1471/3000 [44:14<34:45,  1.36s/it, lr: 1.0e-04 loss: 3.055e-01]
windy_storm:  49%|####9     | 1472/3000 [44:14<44:44,  1.76s/it, lr: 1.0e-04 loss: 3.055e-01]
windy_storm:  49%|####9     | 1472/3000 [44:14<44:44,  1.76s/it, lr: 1.0e-04 loss: 3.055e-01]
windy_storm:  49%|####9     | 1472/3000 [44:15<44:44,  1.76s/it, lr: 1.0e-04 loss: 1.196e-01]
windy_storm:  49%|####9     | 1472/3000 [44:15<44:44,  1.76s/it, lr: 1.0e-04 loss: 1.196e-01]
windy_storm:  49%|####9     | 1473/3000 [44:15<43:41,  1.72s/it, lr: 1.0e-04 loss: 1.196e-01]
windy_storm:  49%|####9     | 1473/3000 [44:15<43:41,  1.72s/it, lr: 1.0e-04 loss: 1.196e-01]
windy_storm:  49%|####9     | 1473/3000 [44:17<43:41,  1.72s/it, lr: 1.0e-04 loss: 6.103e-01]
windy_storm:  49%|####9     | 1473/3000 [44:17<43:41,  1.72s/it, lr: 1.0e-04 loss: 6.103e-01]
windy_storm:  49%|####9     | 1474/3000 [44:17<42:50,  1.68s/it, lr: 1.0e-04 loss: 6.103e-01]
windy_storm:  49%|####9     | 1474/3000 [44:17<42:50,  1.68s/it, lr: 1.0e-04 loss: 6.103e-01]
windy_storm:  49%|####9     | 1474/3000 [44:18<42:50,  1.68s/it, lr: 1.0e-04 loss: 2.103e-01]
windy_storm:  49%|####9     | 1474/3000 [44:18<42:50,  1.68s/it, lr: 1.0e-04 loss: 2.103e-01]
windy_storm:  49%|####9     | 1475/3000 [44:18<36:43,  1.45s/it, lr: 1.0e-04 loss: 2.103e-01]
windy_storm:  49%|####9     | 1475/3000 [44:18<36:43,  1.45s/it, lr: 1.0e-04 loss: 2.103e-01]
windy_storm:  49%|####9     | 1475/3000 [44:19<36:43,  1.45s/it, lr: 1.0e-04 loss: 2.902e-01]
windy_storm:  49%|####9     | 1475/3000 [44:19<36:43,  1.45s/it, lr: 1.0e-04 loss: 2.902e-01]
windy_storm:  49%|####9     | 1476/3000 [44:19<31:56,  1.26s/it, lr: 1.0e-04 loss: 2.902e-01]
windy_storm:  49%|####9     | 1476/3000 [44:19<31:56,  1.26s/it, lr: 1.0e-04 loss: 2.902e-01]
windy_storm:  49%|####9     | 1476/3000 [44:22<31:56,  1.26s/it, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  49%|####9     | 1476/3000 [44:22<31:56,  1.26s/it, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  49%|####9     | 1477/3000 [44:22<45:04,  1.78s/it, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  49%|####9     | 1477/3000 [44:22<45:04,  1.78s/it, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  49%|####9     | 1477/3000 [44:23<45:04,  1.78s/it, lr: 1.0e-04 loss: 4.252e-01]
windy_storm:  49%|####9     | 1477/3000 [44:23<45:04,  1.78s/it, lr: 1.0e-04 loss: 4.252e-01]
windy_storm:  49%|####9     | 1478/3000 [44:23<38:03,  1.50s/it, lr: 1.0e-04 loss: 4.252e-01]
windy_storm:  49%|####9     | 1478/3000 [44:23<38:03,  1.50s/it, lr: 1.0e-04 loss: 4.252e-01]
windy_storm:  49%|####9     | 1478/3000 [44:24<38:03,  1.50s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  49%|####9     | 1478/3000 [44:24<38:03,  1.50s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  49%|####9     | 1479/3000 [44:24<39:01,  1.54s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  49%|####9     | 1479/3000 [44:24<39:01,  1.54s/it, lr: 1.0e-04 loss: 2.765e-01]
windy_storm:  49%|####9     | 1479/3000 [44:25<39:01,  1.54s/it, lr: 1.0e-04 loss: 7.581e-02]
windy_storm:  49%|####9     | 1479/3000 [44:25<39:01,  1.54s/it, lr: 1.0e-04 loss: 7.581e-02]
windy_storm:  49%|####9     | 1480/3000 [44:26<38:59,  1.54s/it, lr: 1.0e-04 loss: 3.824e-01]
windy_storm:  49%|####9     | 1480/3000 [44:26<38:59,  1.54s/it, lr: 1.0e-04 loss: 3.824e-01]
windy_storm:  49%|####9     | 1481/3000 [44:26<25:56,  1.02s/it, lr: 1.0e-04 loss: 3.824e-01]
windy_storm:  49%|####9     | 1481/3000 [44:26<25:56,  1.02s/it, lr: 1.0e-04 loss: 3.824e-01]
windy_storm:  49%|####9     | 1481/3000 [44:28<25:56,  1.02s/it, lr: 1.0e-04 loss: 6.263e-01]
windy_storm:  49%|####9     | 1481/3000 [44:28<25:56,  1.02s/it, lr: 1.0e-04 loss: 6.263e-01]
windy_storm:  49%|####9     | 1482/3000 [44:28<30:59,  1.23s/it, lr: 1.0e-04 loss: 6.263e-01]
windy_storm:  49%|####9     | 1482/3000 [44:28<30:59,  1.23s/it, lr: 1.0e-04 loss: 6.263e-01]
windy_storm:  49%|####9     | 1482/3000 [44:28<30:59,  1.23s/it, lr: 1.0e-04 loss: 3.525e-01]
windy_storm:  49%|####9     | 1482/3000 [44:28<30:59,  1.23s/it, lr: 1.0e-04 loss: 3.525e-01]
windy_storm:  49%|####9     | 1483/3000 [44:28<27:59,  1.11s/it, lr: 1.0e-04 loss: 3.525e-01]
windy_storm:  49%|####9     | 1483/3000 [44:28<27:59,  1.11s/it, lr: 1.0e-04 loss: 3.525e-01]
windy_storm:  49%|####9     | 1483/3000 [44:31<27:59,  1.11s/it, lr: 1.0e-04 loss: 5.033e-01]
windy_storm:  49%|####9     | 1483/3000 [44:31<27:59,  1.11s/it, lr: 1.0e-04 loss: 5.033e-01]
windy_storm:  49%|####9     | 1484/3000 [44:31<40:16,  1.59s/it, lr: 1.0e-04 loss: 5.033e-01]
windy_storm:  49%|####9     | 1484/3000 [44:31<40:16,  1.59s/it, lr: 1.0e-04 loss: 5.033e-01]
windy_storm:  49%|####9     | 1484/3000 [44:33<40:16,  1.59s/it, lr: 1.0e-04 loss: 2.340e-01]
windy_storm:  49%|####9     | 1484/3000 [44:33<40:16,  1.59s/it, lr: 1.0e-04 loss: 2.340e-01]
windy_storm:  50%|####9     | 1485/3000 [44:33<40:21,  1.60s/it, lr: 1.0e-04 loss: 2.340e-01]
windy_storm:  50%|####9     | 1485/3000 [44:33<40:21,  1.60s/it, lr: 1.0e-04 loss: 2.340e-01]
windy_storm:  50%|####9     | 1485/3000 [44:35<40:21,  1.60s/it, lr: 1.0e-04 loss: 4.458e-01]
windy_storm:  50%|####9     | 1485/3000 [44:35<40:21,  1.60s/it, lr: 1.0e-04 loss: 4.458e-01]
windy_storm:  50%|####9     | 1486/3000 [44:35<40:03,  1.59s/it, lr: 1.0e-04 loss: 4.458e-01]
windy_storm:  50%|####9     | 1486/3000 [44:35<40:03,  1.59s/it, lr: 1.0e-04 loss: 4.458e-01]
windy_storm:  50%|####9     | 1486/3000 [44:35<40:03,  1.59s/it, lr: 1.0e-04 loss: 5.778e-01]
windy_storm:  50%|####9     | 1486/3000 [44:35<40:03,  1.59s/it, lr: 1.0e-04 loss: 5.778e-01]
windy_storm:  50%|####9     | 1487/3000 [44:35<33:56,  1.35s/it, lr: 1.0e-04 loss: 5.778e-01]
windy_storm:  50%|####9     | 1487/3000 [44:35<33:56,  1.35s/it, lr: 1.0e-04 loss: 5.778e-01]
windy_storm:  50%|####9     | 1487/3000 [44:38<33:56,  1.35s/it, lr: 1.0e-04 loss: 1.874e-01]
windy_storm:  50%|####9     | 1487/3000 [44:38<33:56,  1.35s/it, lr: 1.0e-04 loss: 1.874e-01]
windy_storm:  50%|####9     | 1488/3000 [44:38<45:48,  1.82s/it, lr: 1.0e-04 loss: 1.874e-01]
windy_storm:  50%|####9     | 1488/3000 [44:38<45:48,  1.82s/it, lr: 1.0e-04 loss: 1.874e-01]
windy_storm:  50%|####9     | 1488/3000 [44:41<45:48,  1.82s/it, lr: 1.0e-04 loss: 1.789e-01]
windy_storm:  50%|####9     | 1488/3000 [44:41<45:48,  1.82s/it, lr: 1.0e-04 loss: 1.789e-01]
windy_storm:  50%|####9     | 1489/3000 [44:41<53:47,  2.14s/it, lr: 1.0e-04 loss: 1.789e-01]
windy_storm:  50%|####9     | 1489/3000 [44:41<53:47,  2.14s/it, lr: 1.0e-04 loss: 1.789e-01]
windy_storm:  50%|####9     | 1489/3000 [44:42<53:47,  2.14s/it, lr: 1.0e-04 loss: 2.839e-01]
windy_storm:  50%|####9     | 1489/3000 [44:42<53:47,  2.14s/it, lr: 1.0e-04 loss: 2.839e-01]
windy_storm:  50%|####9     | 1490/3000 [44:45<53:44,  2.14s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  50%|####9     | 1490/3000 [44:45<53:44,  2.14s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  50%|####9     | 1491/3000 [44:45<46:02,  1.83s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  50%|####9     | 1491/3000 [44:45<46:02,  1.83s/it, lr: 1.0e-04 loss: 6.992e-02]
windy_storm:  50%|####9     | 1491/3000 [44:48<46:02,  1.83s/it, lr: 1.0e-04 loss: 8.410e-03]
windy_storm:  50%|####9     | 1491/3000 [44:48<46:02,  1.83s/it, lr: 1.0e-04 loss: 8.410e-03]
windy_storm:  50%|####9     | 1492/3000 [44:48<53:00,  2.11s/it, lr: 1.0e-04 loss: 8.410e-03]
windy_storm:  50%|####9     | 1492/3000 [44:48<53:00,  2.11s/it, lr: 1.0e-04 loss: 8.410e-03]
windy_storm:  50%|####9     | 1492/3000 [44:49<53:00,  2.11s/it, lr: 1.0e-04 loss: 6.414e-01]
windy_storm:  50%|####9     | 1492/3000 [44:49<53:00,  2.11s/it, lr: 1.0e-04 loss: 6.414e-01]
windy_storm:  50%|####9     | 1493/3000 [44:49<49:34,  1.97s/it, lr: 1.0e-04 loss: 6.414e-01]
windy_storm:  50%|####9     | 1493/3000 [44:49<49:34,  1.97s/it, lr: 1.0e-04 loss: 6.414e-01]
windy_storm:  50%|####9     | 1493/3000 [44:52<49:34,  1.97s/it, lr: 1.0e-04 loss: 2.196e-01]
windy_storm:  50%|####9     | 1493/3000 [44:52<49:34,  1.97s/it, lr: 1.0e-04 loss: 2.196e-01]
windy_storm:  50%|####9     | 1494/3000 [44:52<56:32,  2.25s/it, lr: 1.0e-04 loss: 2.196e-01]
windy_storm:  50%|####9     | 1494/3000 [44:52<56:32,  2.25s/it, lr: 1.0e-04 loss: 2.196e-01]
windy_storm:  50%|####9     | 1494/3000 [44:53<56:32,  2.25s/it, lr: 1.0e-04 loss: 2.582e-01]
windy_storm:  50%|####9     | 1494/3000 [44:53<56:32,  2.25s/it, lr: 1.0e-04 loss: 2.582e-01]
windy_storm:  50%|####9     | 1495/3000 [44:53<48:06,  1.92s/it, lr: 1.0e-04 loss: 2.582e-01]
windy_storm:  50%|####9     | 1495/3000 [44:53<48:06,  1.92s/it, lr: 1.0e-04 loss: 2.582e-01]
windy_storm:  50%|####9     | 1495/3000 [44:54<48:06,  1.92s/it, lr: 1.0e-04 loss: 5.620e-01]
windy_storm:  50%|####9     | 1495/3000 [44:54<48:06,  1.92s/it, lr: 1.0e-04 loss: 5.620e-01]
windy_storm:  50%|####9     | 1496/3000 [44:54<39:38,  1.58s/it, lr: 1.0e-04 loss: 5.620e-01]
windy_storm:  50%|####9     | 1496/3000 [44:54<39:38,  1.58s/it, lr: 1.0e-04 loss: 5.620e-01]
windy_storm:  50%|####9     | 1496/3000 [44:55<39:38,  1.58s/it, lr: 1.0e-04 loss: 6.313e-01]
windy_storm:  50%|####9     | 1496/3000 [44:55<39:38,  1.58s/it, lr: 1.0e-04 loss: 6.313e-01]
windy_storm:  50%|####9     | 1497/3000 [44:55<34:10,  1.36s/it, lr: 1.0e-04 loss: 6.313e-01]
windy_storm:  50%|####9     | 1497/3000 [44:55<34:10,  1.36s/it, lr: 1.0e-04 loss: 6.313e-01]
windy_storm:  50%|####9     | 1497/3000 [44:57<34:10,  1.36s/it, lr: 1.0e-04 loss: 1.572e-01]
windy_storm:  50%|####9     | 1497/3000 [44:57<34:10,  1.36s/it, lr: 1.0e-04 loss: 1.572e-01]
windy_storm:  50%|####9     | 1498/3000 [44:57<35:44,  1.43s/it, lr: 1.0e-04 loss: 1.572e-01]
windy_storm:  50%|####9     | 1498/3000 [44:57<35:44,  1.43s/it, lr: 1.0e-04 loss: 1.572e-01]
windy_storm:  50%|####9     | 1498/3000 [45:00<35:44,  1.43s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  50%|####9     | 1498/3000 [45:00<35:44,  1.43s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  50%|####9     | 1499/3000 [45:00<47:25,  1.90s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  50%|####9     | 1499/3000 [45:00<47:25,  1.90s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  50%|####9     | 1499/3000 [45:00<47:25,  1.90s/it, lr: 1.0e-04 loss: 6.448e-02]
windy_storm:  50%|####9     | 1499/3000 [45:00<47:25,  1.90s/it, lr: 1.0e-04 loss: 6.448e-02]
Saving at step 1500
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000001500.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000000500.safetensors
Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:11,  2.39s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:11,  2.39s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.41s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.41s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.39s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.39s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.38s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.38s/it]


Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.38s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.38s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.38s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.38s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  50%|#####     | 1500/3000 [45:01<47:23,  1.90s/it, lr: 1.0e-04 loss: 6.406e-01]
windy_storm:  50%|#####     | 1500/3000 [45:01<47:23,  1.90s/it, lr: 1.0e-04 loss: 6.406e-01]
windy_storm:  50%|#####     | 1501/3000 [45:01<31:51,  1.28s/it, lr: 1.0e-04 loss: 6.406e-01]
windy_storm:  50%|#####     | 1501/3000 [45:01<31:51,  1.28s/it, lr: 1.0e-04 loss: 6.406e-01]
windy_storm:  50%|#####     | 1501/3000 [45:03<31:51,  1.28s/it, lr: 1.0e-04 loss: 1.575e-01]
windy_storm:  50%|#####     | 1501/3000 [45:03<31:51,  1.28s/it, lr: 1.0e-04 loss: 1.575e-01]
windy_storm:  50%|#####     | 1502/3000 [45:03<33:17,  1.33s/it, lr: 1.0e-04 loss: 1.575e-01]
windy_storm:  50%|#####     | 1502/3000 [45:03<33:17,  1.33s/it, lr: 1.0e-04 loss: 1.575e-01]
windy_storm:  50%|#####     | 1502/3000 [45:05<33:17,  1.33s/it, lr: 1.0e-04 loss: 6.186e-01]
windy_storm:  50%|#####     | 1502/3000 [45:05<33:17,  1.33s/it, lr: 1.0e-04 loss: 6.186e-01]
windy_storm:  50%|#####     | 1503/3000 [45:05<34:50,  1.40s/it, lr: 1.0e-04 loss: 6.186e-01]
windy_storm:  50%|#####     | 1503/3000 [45:05<34:50,  1.40s/it, lr: 1.0e-04 loss: 6.186e-01]
windy_storm:  50%|#####     | 1503/3000 [45:08<34:50,  1.40s/it, lr: 1.0e-04 loss: 4.728e-02]
windy_storm:  50%|#####     | 1503/3000 [45:08<34:50,  1.40s/it, lr: 1.0e-04 loss: 4.728e-02]
windy_storm:  50%|#####     | 1504/3000 [45:08<45:40,  1.83s/it, lr: 1.0e-04 loss: 4.728e-02]
windy_storm:  50%|#####     | 1504/3000 [45:08<45:40,  1.83s/it, lr: 1.0e-04 loss: 4.728e-02]
windy_storm:  50%|#####     | 1504/3000 [45:09<45:40,  1.83s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  50%|#####     | 1504/3000 [45:09<45:40,  1.83s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  50%|#####     | 1505/3000 [45:09<43:57,  1.76s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  50%|#####     | 1505/3000 [45:09<43:57,  1.76s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  50%|#####     | 1505/3000 [45:10<43:57,  1.76s/it, lr: 1.0e-04 loss: 1.134e-01]
windy_storm:  50%|#####     | 1505/3000 [45:10<43:57,  1.76s/it, lr: 1.0e-04 loss: 1.134e-01]
windy_storm:  50%|#####     | 1506/3000 [45:10<37:12,  1.49s/it, lr: 1.0e-04 loss: 1.134e-01]
windy_storm:  50%|#####     | 1506/3000 [45:10<37:12,  1.49s/it, lr: 1.0e-04 loss: 1.134e-01]
windy_storm:  50%|#####     | 1506/3000 [45:13<37:12,  1.49s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  50%|#####     | 1506/3000 [45:13<37:12,  1.49s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  50%|#####     | 1507/3000 [45:13<47:40,  1.92s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  50%|#####     | 1507/3000 [45:13<47:40,  1.92s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  50%|#####     | 1507/3000 [45:14<47:40,  1.92s/it, lr: 1.0e-04 loss: 3.648e-01]
windy_storm:  50%|#####     | 1507/3000 [45:14<47:40,  1.92s/it, lr: 1.0e-04 loss: 3.648e-01]
windy_storm:  50%|#####     | 1508/3000 [45:14<39:15,  1.58s/it, lr: 1.0e-04 loss: 3.648e-01]
windy_storm:  50%|#####     | 1508/3000 [45:14<39:15,  1.58s/it, lr: 1.0e-04 loss: 3.648e-01]
windy_storm:  50%|#####     | 1508/3000 [45:14<39:15,  1.58s/it, lr: 1.0e-04 loss: 1.523e-01]
windy_storm:  50%|#####     | 1508/3000 [45:14<39:15,  1.58s/it, lr: 1.0e-04 loss: 1.523e-01]
windy_storm:  50%|#####     | 1509/3000 [45:14<33:39,  1.35s/it, lr: 1.0e-04 loss: 1.523e-01]
windy_storm:  50%|#####     | 1509/3000 [45:14<33:39,  1.35s/it, lr: 1.0e-04 loss: 1.523e-01]
windy_storm:  50%|#####     | 1509/3000 [45:17<33:39,  1.35s/it, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:  50%|#####     | 1509/3000 [45:17<33:39,  1.35s/it, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:  50%|#####     | 1510/3000 [45:19<33:38,  1.35s/it, lr: 1.0e-04 loss: 5.869e-01]
windy_storm:  50%|#####     | 1510/3000 [45:19<33:38,  1.35s/it, lr: 1.0e-04 loss: 5.869e-01]
windy_storm:  50%|#####     | 1511/3000 [45:19<27:05,  1.09s/it, lr: 1.0e-04 loss: 5.869e-01]
windy_storm:  50%|#####     | 1511/3000 [45:19<27:05,  1.09s/it, lr: 1.0e-04 loss: 5.869e-01]
windy_storm:  50%|#####     | 1511/3000 [45:22<27:05,  1.09s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  50%|#####     | 1511/3000 [45:22<27:05,  1.09s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  50%|#####     | 1512/3000 [45:22<38:49,  1.57s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  50%|#####     | 1512/3000 [45:22<38:49,  1.57s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  50%|#####     | 1512/3000 [45:24<38:49,  1.57s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  50%|#####     | 1512/3000 [45:24<38:49,  1.57s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  50%|#####     | 1513/3000 [45:24<40:05,  1.62s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  50%|#####     | 1513/3000 [45:24<40:05,  1.62s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  50%|#####     | 1513/3000 [45:27<40:05,  1.62s/it, lr: 1.0e-04 loss: 5.822e-01]
windy_storm:  50%|#####     | 1513/3000 [45:27<40:05,  1.62s/it, lr: 1.0e-04 loss: 5.822e-01]
windy_storm:  50%|#####     | 1514/3000 [45:27<48:57,  1.98s/it, lr: 1.0e-04 loss: 5.822e-01]
windy_storm:  50%|#####     | 1514/3000 [45:27<48:57,  1.98s/it, lr: 1.0e-04 loss: 5.822e-01]
windy_storm:  50%|#####     | 1514/3000 [45:28<48:57,  1.98s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  50%|#####     | 1514/3000 [45:28<48:57,  1.98s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  50%|#####     | 1515/3000 [45:28<40:35,  1.64s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  50%|#####     | 1515/3000 [45:28<40:35,  1.64s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  50%|#####     | 1515/3000 [45:30<40:35,  1.64s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  50%|#####     | 1515/3000 [45:30<40:35,  1.64s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  51%|#####     | 1516/3000 [45:30<49:46,  2.01s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  51%|#####     | 1516/3000 [45:30<49:46,  2.01s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  51%|#####     | 1516/3000 [45:33<49:46,  2.01s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  51%|#####     | 1516/3000 [45:33<49:46,  2.01s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  51%|#####     | 1517/3000 [45:33<56:04,  2.27s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  51%|#####     | 1517/3000 [45:33<56:04,  2.27s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  51%|#####     | 1517/3000 [45:34<56:04,  2.27s/it, lr: 1.0e-04 loss: 1.032e-01]
windy_storm:  51%|#####     | 1517/3000 [45:34<56:04,  2.27s/it, lr: 1.0e-04 loss: 1.032e-01]
windy_storm:  51%|#####     | 1518/3000 [45:34<45:17,  1.83s/it, lr: 1.0e-04 loss: 1.032e-01]
windy_storm:  51%|#####     | 1518/3000 [45:34<45:17,  1.83s/it, lr: 1.0e-04 loss: 1.032e-01]
windy_storm:  51%|#####     | 1518/3000 [45:36<45:17,  1.83s/it, lr: 1.0e-04 loss: 7.125e-01]
windy_storm:  51%|#####     | 1518/3000 [45:36<45:17,  1.83s/it, lr: 1.0e-04 loss: 7.125e-01]
windy_storm:  51%|#####     | 1519/3000 [45:36<43:29,  1.76s/it, lr: 1.0e-04 loss: 7.125e-01]
windy_storm:  51%|#####     | 1519/3000 [45:36<43:29,  1.76s/it, lr: 1.0e-04 loss: 7.125e-01]
windy_storm:  51%|#####     | 1519/3000 [45:39<43:29,  1.76s/it, lr: 1.0e-04 loss: 7.103e-01]
windy_storm:  51%|#####     | 1519/3000 [45:39<43:29,  1.76s/it, lr: 1.0e-04 loss: 7.103e-01]
windy_storm:  51%|#####     | 1520/3000 [45:42<43:28,  1.76s/it, lr: 1.0e-04 loss: 5.192e-02]
windy_storm:  51%|#####     | 1520/3000 [45:42<43:28,  1.76s/it, lr: 1.0e-04 loss: 5.192e-02]
windy_storm:  51%|#####     | 1521/3000 [45:42<40:14,  1.63s/it, lr: 1.0e-04 loss: 5.192e-02]
windy_storm:  51%|#####     | 1521/3000 [45:42<40:14,  1.63s/it, lr: 1.0e-04 loss: 5.192e-02]
windy_storm:  51%|#####     | 1521/3000 [45:45<40:14,  1.63s/it, lr: 1.0e-04 loss: 6.115e-01]
windy_storm:  51%|#####     | 1521/3000 [45:45<40:14,  1.63s/it, lr: 1.0e-04 loss: 6.115e-01]
windy_storm:  51%|#####     | 1522/3000 [45:45<48:45,  1.98s/it, lr: 1.0e-04 loss: 6.115e-01]
windy_storm:  51%|#####     | 1522/3000 [45:45<48:45,  1.98s/it, lr: 1.0e-04 loss: 6.115e-01]
windy_storm:  51%|#####     | 1522/3000 [45:46<48:45,  1.98s/it, lr: 1.0e-04 loss: 4.162e-01]
windy_storm:  51%|#####     | 1522/3000 [45:46<48:45,  1.98s/it, lr: 1.0e-04 loss: 4.162e-01]
windy_storm:  51%|#####     | 1523/3000 [45:46<41:21,  1.68s/it, lr: 1.0e-04 loss: 4.162e-01]
windy_storm:  51%|#####     | 1523/3000 [45:46<41:21,  1.68s/it, lr: 1.0e-04 loss: 4.162e-01]
windy_storm:  51%|#####     | 1523/3000 [45:47<41:21,  1.68s/it, lr: 1.0e-04 loss: 5.641e-01]
windy_storm:  51%|#####     | 1523/3000 [45:47<41:21,  1.68s/it, lr: 1.0e-04 loss: 5.641e-01]
windy_storm:  51%|#####     | 1524/3000 [45:47<40:39,  1.65s/it, lr: 1.0e-04 loss: 5.641e-01]
windy_storm:  51%|#####     | 1524/3000 [45:47<40:39,  1.65s/it, lr: 1.0e-04 loss: 5.641e-01]
windy_storm:  51%|#####     | 1524/3000 [45:49<40:39,  1.65s/it, lr: 1.0e-04 loss: 6.882e-01]
windy_storm:  51%|#####     | 1524/3000 [45:49<40:39,  1.65s/it, lr: 1.0e-04 loss: 6.882e-01]
windy_storm:  51%|#####     | 1525/3000 [45:49<40:11,  1.64s/it, lr: 1.0e-04 loss: 6.882e-01]
windy_storm:  51%|#####     | 1525/3000 [45:49<40:11,  1.64s/it, lr: 1.0e-04 loss: 6.882e-01]
windy_storm:  51%|#####     | 1525/3000 [45:50<40:11,  1.64s/it, lr: 1.0e-04 loss: 4.008e-01]
windy_storm:  51%|#####     | 1525/3000 [45:50<40:11,  1.64s/it, lr: 1.0e-04 loss: 4.008e-01]
windy_storm:  51%|#####     | 1526/3000 [45:50<39:36,  1.61s/it, lr: 1.0e-04 loss: 4.008e-01]
windy_storm:  51%|#####     | 1526/3000 [45:50<39:36,  1.61s/it, lr: 1.0e-04 loss: 4.008e-01]
windy_storm:  51%|#####     | 1526/3000 [45:53<39:36,  1.61s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  51%|#####     | 1526/3000 [45:53<39:36,  1.61s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  51%|#####     | 1527/3000 [45:53<49:27,  2.01s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  51%|#####     | 1527/3000 [45:53<49:27,  2.01s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  51%|#####     | 1527/3000 [45:56<49:27,  2.01s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  51%|#####     | 1527/3000 [45:56<49:27,  2.01s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  51%|#####     | 1528/3000 [45:56<57:08,  2.33s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  51%|#####     | 1528/3000 [45:56<57:08,  2.33s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  51%|#####     | 1528/3000 [45:57<57:08,  2.33s/it, lr: 1.0e-04 loss: 1.103e-01]
windy_storm:  51%|#####     | 1528/3000 [45:57<57:08,  2.33s/it, lr: 1.0e-04 loss: 1.103e-01]
windy_storm:  51%|#####     | 1529/3000 [45:57<46:10,  1.88s/it, lr: 1.0e-04 loss: 1.103e-01]
windy_storm:  51%|#####     | 1529/3000 [45:57<46:10,  1.88s/it, lr: 1.0e-04 loss: 1.103e-01]
windy_storm:  51%|#####     | 1529/3000 [45:58<46:10,  1.88s/it, lr: 1.0e-04 loss: 5.654e-01]
windy_storm:  51%|#####     | 1529/3000 [45:58<46:10,  1.88s/it, lr: 1.0e-04 loss: 5.654e-01]
windy_storm:  51%|#####1    | 1530/3000 [46:01<46:08,  1.88s/it, lr: 1.0e-04 loss: 2.468e-01]
windy_storm:  51%|#####1    | 1530/3000 [46:01<46:08,  1.88s/it, lr: 1.0e-04 loss: 2.468e-01]
windy_storm:  51%|#####1    | 1531/3000 [46:01<41:25,  1.69s/it, lr: 1.0e-04 loss: 2.468e-01]
windy_storm:  51%|#####1    | 1531/3000 [46:01<41:25,  1.69s/it, lr: 1.0e-04 loss: 2.468e-01]
windy_storm:  51%|#####1    | 1531/3000 [46:02<41:25,  1.69s/it, lr: 1.0e-04 loss: 1.258e-01]
windy_storm:  51%|#####1    | 1531/3000 [46:02<41:25,  1.69s/it, lr: 1.0e-04 loss: 1.258e-01]
windy_storm:  51%|#####1    | 1532/3000 [46:02<35:44,  1.46s/it, lr: 1.0e-04 loss: 1.258e-01]
windy_storm:  51%|#####1    | 1532/3000 [46:02<35:44,  1.46s/it, lr: 1.0e-04 loss: 1.258e-01]
windy_storm:  51%|#####1    | 1532/3000 [46:03<35:44,  1.46s/it, lr: 1.0e-04 loss: 3.238e-01]
windy_storm:  51%|#####1    | 1532/3000 [46:03<35:44,  1.46s/it, lr: 1.0e-04 loss: 3.238e-01]
windy_storm:  51%|#####1    | 1533/3000 [46:03<31:36,  1.29s/it, lr: 1.0e-04 loss: 3.238e-01]
windy_storm:  51%|#####1    | 1533/3000 [46:03<31:36,  1.29s/it, lr: 1.0e-04 loss: 3.238e-01]
windy_storm:  51%|#####1    | 1533/3000 [46:04<31:36,  1.29s/it, lr: 1.0e-04 loss: 8.085e-02]
windy_storm:  51%|#####1    | 1533/3000 [46:04<31:36,  1.29s/it, lr: 1.0e-04 loss: 8.085e-02]
windy_storm:  51%|#####1    | 1534/3000 [46:04<33:01,  1.35s/it, lr: 1.0e-04 loss: 8.085e-02]
windy_storm:  51%|#####1    | 1534/3000 [46:04<33:01,  1.35s/it, lr: 1.0e-04 loss: 8.085e-02]
windy_storm:  51%|#####1    | 1534/3000 [46:05<33:01,  1.35s/it, lr: 1.0e-04 loss: 4.362e-01]
windy_storm:  51%|#####1    | 1534/3000 [46:05<33:01,  1.35s/it, lr: 1.0e-04 loss: 4.362e-01]
windy_storm:  51%|#####1    | 1535/3000 [46:05<29:21,  1.20s/it, lr: 1.0e-04 loss: 4.362e-01]
windy_storm:  51%|#####1    | 1535/3000 [46:05<29:21,  1.20s/it, lr: 1.0e-04 loss: 4.362e-01]
windy_storm:  51%|#####1    | 1535/3000 [46:06<29:21,  1.20s/it, lr: 1.0e-04 loss: 1.244e-01]
windy_storm:  51%|#####1    | 1535/3000 [46:06<29:21,  1.20s/it, lr: 1.0e-04 loss: 1.244e-01]
windy_storm:  51%|#####1    | 1536/3000 [46:06<26:39,  1.09s/it, lr: 1.0e-04 loss: 1.244e-01]
windy_storm:  51%|#####1    | 1536/3000 [46:06<26:39,  1.09s/it, lr: 1.0e-04 loss: 1.244e-01]
windy_storm:  51%|#####1    | 1536/3000 [46:07<26:39,  1.09s/it, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  51%|#####1    | 1536/3000 [46:07<26:39,  1.09s/it, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  51%|#####1    | 1537/3000 [46:07<29:49,  1.22s/it, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  51%|#####1    | 1537/3000 [46:07<29:49,  1.22s/it, lr: 1.0e-04 loss: 4.938e-01]
windy_storm:  51%|#####1    | 1537/3000 [46:08<29:49,  1.22s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  51%|#####1    | 1537/3000 [46:08<29:49,  1.22s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  51%|#####1    | 1538/3000 [46:08<26:56,  1.11s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  51%|#####1    | 1538/3000 [46:08<26:56,  1.11s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  51%|#####1    | 1538/3000 [46:11<26:56,  1.11s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  51%|#####1    | 1538/3000 [46:11<26:56,  1.11s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  51%|#####1    | 1539/3000 [46:11<40:22,  1.66s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  51%|#####1    | 1539/3000 [46:11<40:22,  1.66s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  51%|#####1    | 1539/3000 [46:13<40:22,  1.66s/it, lr: 1.0e-04 loss: 2.273e-01]
windy_storm:  51%|#####1    | 1539/3000 [46:13<40:22,  1.66s/it, lr: 1.0e-04 loss: 2.273e-01]
windy_storm:  51%|#####1    | 1540/3000 [46:14<40:21,  1.66s/it, lr: 1.0e-04 loss: 4.089e-02]
windy_storm:  51%|#####1    | 1540/3000 [46:14<40:21,  1.66s/it, lr: 1.0e-04 loss: 4.089e-02]
windy_storm:  51%|#####1    | 1541/3000 [46:14<30:27,  1.25s/it, lr: 1.0e-04 loss: 4.089e-02]
windy_storm:  51%|#####1    | 1541/3000 [46:14<30:27,  1.25s/it, lr: 1.0e-04 loss: 4.089e-02]
windy_storm:  51%|#####1    | 1541/3000 [46:17<30:27,  1.25s/it, lr: 1.0e-04 loss: 6.216e-02]
windy_storm:  51%|#####1    | 1541/3000 [46:17<30:27,  1.25s/it, lr: 1.0e-04 loss: 6.216e-02]
windy_storm:  51%|#####1    | 1542/3000 [46:17<41:42,  1.72s/it, lr: 1.0e-04 loss: 6.216e-02]
windy_storm:  51%|#####1    | 1542/3000 [46:17<41:42,  1.72s/it, lr: 1.0e-04 loss: 6.216e-02]
windy_storm:  51%|#####1    | 1542/3000 [46:18<41:42,  1.72s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  51%|#####1    | 1542/3000 [46:18<41:42,  1.72s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  51%|#####1    | 1543/3000 [46:18<35:57,  1.48s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  51%|#####1    | 1543/3000 [46:18<35:57,  1.48s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  51%|#####1    | 1543/3000 [46:20<35:57,  1.48s/it, lr: 1.0e-04 loss: 5.346e-01]
windy_storm:  51%|#####1    | 1543/3000 [46:20<35:57,  1.48s/it, lr: 1.0e-04 loss: 5.346e-01]
windy_storm:  51%|#####1    | 1544/3000 [46:20<36:25,  1.50s/it, lr: 1.0e-04 loss: 5.346e-01]
windy_storm:  51%|#####1    | 1544/3000 [46:20<36:25,  1.50s/it, lr: 1.0e-04 loss: 5.346e-01]
windy_storm:  51%|#####1    | 1544/3000 [46:23<36:25,  1.50s/it, lr: 1.0e-04 loss: 5.356e-01]
windy_storm:  51%|#####1    | 1544/3000 [46:23<36:25,  1.50s/it, lr: 1.0e-04 loss: 5.356e-01]
windy_storm:  52%|#####1    | 1545/3000 [46:23<45:43,  1.89s/it, lr: 1.0e-04 loss: 5.356e-01]
windy_storm:  52%|#####1    | 1545/3000 [46:23<45:43,  1.89s/it, lr: 1.0e-04 loss: 5.356e-01]
windy_storm:  52%|#####1    | 1545/3000 [46:24<45:43,  1.89s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  52%|#####1    | 1545/3000 [46:24<45:43,  1.89s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  52%|#####1    | 1546/3000 [46:24<43:29,  1.79s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  52%|#####1    | 1546/3000 [46:24<43:29,  1.79s/it, lr: 1.0e-04 loss: 6.304e-01]
windy_storm:  52%|#####1    | 1546/3000 [46:26<43:29,  1.79s/it, lr: 1.0e-04 loss: 1.163e-01]
windy_storm:  52%|#####1    | 1546/3000 [46:26<43:29,  1.79s/it, lr: 1.0e-04 loss: 1.163e-01]
windy_storm:  52%|#####1    | 1547/3000 [46:26<41:58,  1.73s/it, lr: 1.0e-04 loss: 1.163e-01]
windy_storm:  52%|#####1    | 1547/3000 [46:26<41:58,  1.73s/it, lr: 1.0e-04 loss: 1.163e-01]
windy_storm:  52%|#####1    | 1547/3000 [46:26<41:58,  1.73s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  52%|#####1    | 1547/3000 [46:26<41:58,  1.73s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  52%|#####1    | 1548/3000 [46:26<35:04,  1.45s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  52%|#####1    | 1548/3000 [46:26<35:04,  1.45s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  52%|#####1    | 1548/3000 [46:28<35:04,  1.45s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  52%|#####1    | 1548/3000 [46:28<35:04,  1.45s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  52%|#####1    | 1549/3000 [46:28<35:46,  1.48s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  52%|#####1    | 1549/3000 [46:28<35:46,  1.48s/it, lr: 1.0e-04 loss: 4.358e-01]
windy_storm:  52%|#####1    | 1549/3000 [46:30<35:46,  1.48s/it, lr: 1.0e-04 loss: 1.090e-01]
windy_storm:  52%|#####1    | 1549/3000 [46:30<35:46,  1.48s/it, lr: 1.0e-04 loss: 1.090e-01]
windy_storm:  52%|#####1    | 1550/3000 [46:33<35:45,  1.48s/it, lr: 1.0e-04 loss: 4.278e-01]
windy_storm:  52%|#####1    | 1550/3000 [46:33<35:45,  1.48s/it, lr: 1.0e-04 loss: 4.278e-01]
windy_storm:  52%|#####1    | 1551/3000 [46:33<35:51,  1.48s/it, lr: 1.0e-04 loss: 4.278e-01]
windy_storm:  52%|#####1    | 1551/3000 [46:33<35:51,  1.48s/it, lr: 1.0e-04 loss: 4.278e-01]
windy_storm:  52%|#####1    | 1551/3000 [46:34<35:51,  1.48s/it, lr: 1.0e-04 loss: 3.627e-01]
windy_storm:  52%|#####1    | 1551/3000 [46:34<35:51,  1.48s/it, lr: 1.0e-04 loss: 3.627e-01]
windy_storm:  52%|#####1    | 1552/3000 [46:34<36:20,  1.51s/it, lr: 1.0e-04 loss: 3.627e-01]
windy_storm:  52%|#####1    | 1552/3000 [46:34<36:20,  1.51s/it, lr: 1.0e-04 loss: 3.627e-01]
windy_storm:  52%|#####1    | 1552/3000 [46:37<36:20,  1.51s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  52%|#####1    | 1552/3000 [46:37<36:20,  1.51s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  52%|#####1    | 1553/3000 [46:37<45:35,  1.89s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  52%|#####1    | 1553/3000 [46:37<45:35,  1.89s/it, lr: 1.0e-04 loss: 6.083e-01]
windy_storm:  52%|#####1    | 1553/3000 [46:39<45:35,  1.89s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  52%|#####1    | 1553/3000 [46:39<45:35,  1.89s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  52%|#####1    | 1554/3000 [46:39<43:19,  1.80s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  52%|#####1    | 1554/3000 [46:39<43:19,  1.80s/it, lr: 1.0e-04 loss: 6.208e-01]
windy_storm:  52%|#####1    | 1554/3000 [46:40<43:19,  1.80s/it, lr: 1.0e-04 loss: 6.003e-01]
windy_storm:  52%|#####1    | 1554/3000 [46:40<43:19,  1.80s/it, lr: 1.0e-04 loss: 6.003e-01]
windy_storm:  52%|#####1    | 1555/3000 [46:40<38:16,  1.59s/it, lr: 1.0e-04 loss: 6.003e-01]
windy_storm:  52%|#####1    | 1555/3000 [46:40<38:16,  1.59s/it, lr: 1.0e-04 loss: 6.003e-01]
windy_storm:  52%|#####1    | 1555/3000 [46:43<38:16,  1.59s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  52%|#####1    | 1555/3000 [46:43<38:16,  1.59s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  52%|#####1    | 1556/3000 [46:43<47:20,  1.97s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  52%|#####1    | 1556/3000 [46:43<47:20,  1.97s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  52%|#####1    | 1556/3000 [46:43<47:20,  1.97s/it, lr: 1.0e-04 loss: 5.963e-01]
windy_storm:  52%|#####1    | 1556/3000 [46:43<47:20,  1.97s/it, lr: 1.0e-04 loss: 5.963e-01]
windy_storm:  52%|#####1    | 1557/3000 [46:43<38:48,  1.61s/it, lr: 1.0e-04 loss: 5.963e-01]
windy_storm:  52%|#####1    | 1557/3000 [46:43<38:48,  1.61s/it, lr: 1.0e-04 loss: 5.963e-01]
windy_storm:  52%|#####1    | 1557/3000 [46:44<38:48,  1.61s/it, lr: 1.0e-04 loss: 5.750e-01]
windy_storm:  52%|#####1    | 1557/3000 [46:44<38:48,  1.61s/it, lr: 1.0e-04 loss: 5.750e-01]
windy_storm:  52%|#####1    | 1558/3000 [46:44<33:06,  1.38s/it, lr: 1.0e-04 loss: 5.750e-01]
windy_storm:  52%|#####1    | 1558/3000 [46:44<33:06,  1.38s/it, lr: 1.0e-04 loss: 5.750e-01]
windy_storm:  52%|#####1    | 1558/3000 [46:47<33:06,  1.38s/it, lr: 1.0e-04 loss: 5.961e-01]
windy_storm:  52%|#####1    | 1558/3000 [46:47<33:06,  1.38s/it, lr: 1.0e-04 loss: 5.961e-01]
windy_storm:  52%|#####1    | 1559/3000 [46:47<43:57,  1.83s/it, lr: 1.0e-04 loss: 5.961e-01]
windy_storm:  52%|#####1    | 1559/3000 [46:47<43:57,  1.83s/it, lr: 1.0e-04 loss: 5.961e-01]
windy_storm:  52%|#####1    | 1559/3000 [46:49<43:57,  1.83s/it, lr: 1.0e-04 loss: 1.936e-01]
windy_storm:  52%|#####1    | 1559/3000 [46:49<43:57,  1.83s/it, lr: 1.0e-04 loss: 1.936e-01]
windy_storm:  52%|#####2    | 1560/3000 [46:51<43:55,  1.83s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  52%|#####2    | 1560/3000 [46:51<43:55,  1.83s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  52%|#####2    | 1561/3000 [46:51<32:28,  1.35s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  52%|#####2    | 1561/3000 [46:51<32:28,  1.35s/it, lr: 1.0e-04 loss: 2.910e-01]
windy_storm:  52%|#####2    | 1561/3000 [46:52<32:28,  1.35s/it, lr: 1.0e-04 loss: 3.894e-01]
windy_storm:  52%|#####2    | 1561/3000 [46:52<32:28,  1.35s/it, lr: 1.0e-04 loss: 3.894e-01]
windy_storm:  52%|#####2    | 1562/3000 [46:52<33:44,  1.41s/it, lr: 1.0e-04 loss: 3.894e-01]
windy_storm:  52%|#####2    | 1562/3000 [46:52<33:44,  1.41s/it, lr: 1.0e-04 loss: 3.894e-01]
windy_storm:  52%|#####2    | 1562/3000 [46:53<33:44,  1.41s/it, lr: 1.0e-04 loss: 6.121e-01]
windy_storm:  52%|#####2    | 1562/3000 [46:53<33:44,  1.41s/it, lr: 1.0e-04 loss: 6.121e-01]
windy_storm:  52%|#####2    | 1563/3000 [46:53<30:01,  1.25s/it, lr: 1.0e-04 loss: 6.121e-01]
windy_storm:  52%|#####2    | 1563/3000 [46:53<30:01,  1.25s/it, lr: 1.0e-04 loss: 6.121e-01]
windy_storm:  52%|#####2    | 1563/3000 [46:56<30:01,  1.25s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  52%|#####2    | 1563/3000 [46:56<30:01,  1.25s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  52%|#####2    | 1564/3000 [46:56<41:12,  1.72s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  52%|#####2    | 1564/3000 [46:56<41:12,  1.72s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  52%|#####2    | 1564/3000 [46:58<41:12,  1.72s/it, lr: 1.0e-04 loss: 1.658e-01]
windy_storm:  52%|#####2    | 1564/3000 [46:58<41:12,  1.72s/it, lr: 1.0e-04 loss: 1.658e-01]
windy_storm:  52%|#####2    | 1565/3000 [46:58<40:16,  1.68s/it, lr: 1.0e-04 loss: 1.658e-01]
windy_storm:  52%|#####2    | 1565/3000 [46:58<40:16,  1.68s/it, lr: 1.0e-04 loss: 1.658e-01]
windy_storm:  52%|#####2    | 1565/3000 [46:58<40:16,  1.68s/it, lr: 1.0e-04 loss: 1.133e-01]
windy_storm:  52%|#####2    | 1565/3000 [46:58<40:16,  1.68s/it, lr: 1.0e-04 loss: 1.133e-01]
windy_storm:  52%|#####2    | 1566/3000 [46:58<33:50,  1.42s/it, lr: 1.0e-04 loss: 1.133e-01]
windy_storm:  52%|#####2    | 1566/3000 [46:58<33:50,  1.42s/it, lr: 1.0e-04 loss: 1.133e-01]
windy_storm:  52%|#####2    | 1566/3000 [46:59<33:50,  1.42s/it, lr: 1.0e-04 loss: 9.618e-02]
windy_storm:  52%|#####2    | 1566/3000 [46:59<33:50,  1.42s/it, lr: 1.0e-04 loss: 9.618e-02]
windy_storm:  52%|#####2    | 1567/3000 [46:59<29:13,  1.22s/it, lr: 1.0e-04 loss: 9.618e-02]
windy_storm:  52%|#####2    | 1567/3000 [46:59<29:13,  1.22s/it, lr: 1.0e-04 loss: 9.618e-02]
windy_storm:  52%|#####2    | 1567/3000 [47:02<29:13,  1.22s/it, lr: 1.0e-04 loss: 5.679e-01]
windy_storm:  52%|#####2    | 1567/3000 [47:02<29:13,  1.22s/it, lr: 1.0e-04 loss: 5.679e-01]
windy_storm:  52%|#####2    | 1568/3000 [47:02<42:42,  1.79s/it, lr: 1.0e-04 loss: 5.679e-01]
windy_storm:  52%|#####2    | 1568/3000 [47:02<42:42,  1.79s/it, lr: 1.0e-04 loss: 5.679e-01]
windy_storm:  52%|#####2    | 1568/3000 [47:04<42:42,  1.79s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  52%|#####2    | 1568/3000 [47:04<42:42,  1.79s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  52%|#####2    | 1569/3000 [47:04<40:41,  1.71s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  52%|#####2    | 1569/3000 [47:04<40:41,  1.71s/it, lr: 1.0e-04 loss: 5.475e-01]
windy_storm:  52%|#####2    | 1569/3000 [47:07<40:41,  1.71s/it, lr: 1.0e-04 loss: 3.801e-01]
windy_storm:  52%|#####2    | 1569/3000 [47:07<40:41,  1.71s/it, lr: 1.0e-04 loss: 3.801e-01]
windy_storm:  52%|#####2    | 1570/3000 [47:07<40:39,  1.71s/it, lr: 1.0e-04 loss: 6.381e-01]
windy_storm:  52%|#####2    | 1570/3000 [47:07<40:39,  1.71s/it, lr: 1.0e-04 loss: 6.381e-01]
windy_storm:  52%|#####2    | 1571/3000 [47:07<26:10,  1.10s/it, lr: 1.0e-04 loss: 6.381e-01]
windy_storm:  52%|#####2    | 1571/3000 [47:07<26:10,  1.10s/it, lr: 1.0e-04 loss: 6.381e-01]
windy_storm:  52%|#####2    | 1571/3000 [47:09<26:10,  1.10s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  52%|#####2    | 1571/3000 [47:09<26:10,  1.10s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  52%|#####2    | 1572/3000 [47:09<28:49,  1.21s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  52%|#####2    | 1572/3000 [47:09<28:49,  1.21s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  52%|#####2    | 1572/3000 [47:11<28:49,  1.21s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  52%|#####2    | 1572/3000 [47:11<28:49,  1.21s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  52%|#####2    | 1573/3000 [47:11<31:03,  1.31s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  52%|#####2    | 1573/3000 [47:11<31:03,  1.31s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  52%|#####2    | 1573/3000 [47:12<31:03,  1.31s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  52%|#####2    | 1573/3000 [47:12<31:03,  1.31s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  52%|#####2    | 1574/3000 [47:12<32:31,  1.37s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  52%|#####2    | 1574/3000 [47:12<32:31,  1.37s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  52%|#####2    | 1574/3000 [47:15<32:31,  1.37s/it, lr: 1.0e-04 loss: 5.384e-01]
windy_storm:  52%|#####2    | 1574/3000 [47:15<32:31,  1.37s/it, lr: 1.0e-04 loss: 5.384e-01]
windy_storm:  52%|#####2    | 1575/3000 [47:15<43:03,  1.81s/it, lr: 1.0e-04 loss: 5.384e-01]
windy_storm:  52%|#####2    | 1575/3000 [47:15<43:03,  1.81s/it, lr: 1.0e-04 loss: 5.384e-01]
windy_storm:  52%|#####2    | 1575/3000 [47:18<43:03,  1.81s/it, lr: 1.0e-04 loss: 2.694e-01]
windy_storm:  52%|#####2    | 1575/3000 [47:18<43:03,  1.81s/it, lr: 1.0e-04 loss: 2.694e-01]
windy_storm:  53%|#####2    | 1576/3000 [47:18<50:54,  2.14s/it, lr: 1.0e-04 loss: 2.694e-01]
windy_storm:  53%|#####2    | 1576/3000 [47:18<50:54,  2.14s/it, lr: 1.0e-04 loss: 2.694e-01]
windy_storm:  53%|#####2    | 1576/3000 [47:21<50:54,  2.14s/it, lr: 1.0e-04 loss: 4.180e-01]
windy_storm:  53%|#####2    | 1576/3000 [47:21<50:54,  2.14s/it, lr: 1.0e-04 loss: 4.180e-01]
windy_storm:  53%|#####2    | 1577/3000 [47:21<56:33,  2.38s/it, lr: 1.0e-04 loss: 4.180e-01]
windy_storm:  53%|#####2    | 1577/3000 [47:21<56:33,  2.38s/it, lr: 1.0e-04 loss: 4.180e-01]
windy_storm:  53%|#####2    | 1577/3000 [47:24<56:33,  2.38s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  53%|#####2    | 1577/3000 [47:24<56:33,  2.38s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  53%|#####2    | 1578/3000 [47:24<1:00:16,  2.54s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  53%|#####2    | 1578/3000 [47:24<1:00:16,  2.54s/it, lr: 1.0e-04 loss: 4.999e-01]
windy_storm:  53%|#####2    | 1578/3000 [47:27<1:00:16,  2.54s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  53%|#####2    | 1578/3000 [47:27<1:00:16,  2.54s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  53%|#####2    | 1579/3000 [47:27<1:03:24,  2.68s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  53%|#####2    | 1579/3000 [47:27<1:03:24,  2.68s/it, lr: 1.0e-04 loss: 5.908e-01]
windy_storm:  53%|#####2    | 1579/3000 [47:30<1:03:24,  2.68s/it, lr: 1.0e-04 loss: 4.603e-01]
windy_storm:  53%|#####2    | 1579/3000 [47:30<1:03:24,  2.68s/it, lr: 1.0e-04 loss: 4.603e-01]
windy_storm:  53%|#####2    | 1580/3000 [47:33<1:03:22,  2.68s/it, lr: 1.0e-04 loss: 6.335e-01]
windy_storm:  53%|#####2    | 1580/3000 [47:33<1:03:22,  2.68s/it, lr: 1.0e-04 loss: 6.335e-01]
windy_storm:  53%|#####2    | 1581/3000 [47:33<50:02,  2.12s/it, lr: 1.0e-04 loss: 6.335e-01]  
windy_storm:  53%|#####2    | 1581/3000 [47:33<50:02,  2.12s/it, lr: 1.0e-04 loss: 6.335e-01]  
windy_storm:  53%|#####2    | 1581/3000 [47:36<50:02,  2.12s/it, lr: 1.0e-04 loss: 5.485e-01]
windy_storm:  53%|#####2    | 1581/3000 [47:36<50:02,  2.12s/it, lr: 1.0e-04 loss: 5.485e-01]
windy_storm:  53%|#####2    | 1582/3000 [47:36<55:01,  2.33s/it, lr: 1.0e-04 loss: 5.485e-01]
windy_storm:  53%|#####2    | 1582/3000 [47:36<55:01,  2.33s/it, lr: 1.0e-04 loss: 5.485e-01]
windy_storm:  53%|#####2    | 1582/3000 [47:37<55:01,  2.33s/it, lr: 1.0e-04 loss: 5.108e-01]
windy_storm:  53%|#####2    | 1582/3000 [47:37<55:01,  2.33s/it, lr: 1.0e-04 loss: 5.108e-01]
windy_storm:  53%|#####2    | 1583/3000 [47:37<46:48,  1.98s/it, lr: 1.0e-04 loss: 5.108e-01]
windy_storm:  53%|#####2    | 1583/3000 [47:37<46:48,  1.98s/it, lr: 1.0e-04 loss: 5.108e-01]
windy_storm:  53%|#####2    | 1583/3000 [47:40<46:48,  1.98s/it, lr: 1.0e-04 loss: 7.999e-02]
windy_storm:  53%|#####2    | 1583/3000 [47:40<46:48,  1.98s/it, lr: 1.0e-04 loss: 7.999e-02]
windy_storm:  53%|#####2    | 1584/3000 [47:40<53:04,  2.25s/it, lr: 1.0e-04 loss: 7.999e-02]
windy_storm:  53%|#####2    | 1584/3000 [47:40<53:04,  2.25s/it, lr: 1.0e-04 loss: 7.999e-02]
windy_storm:  53%|#####2    | 1584/3000 [47:43<53:04,  2.25s/it, lr: 1.0e-04 loss: 5.494e-01]
windy_storm:  53%|#####2    | 1584/3000 [47:43<53:04,  2.25s/it, lr: 1.0e-04 loss: 5.494e-01]
windy_storm:  53%|#####2    | 1585/3000 [47:43<57:50,  2.45s/it, lr: 1.0e-04 loss: 5.494e-01]
windy_storm:  53%|#####2    | 1585/3000 [47:43<57:50,  2.45s/it, lr: 1.0e-04 loss: 5.494e-01]
windy_storm:  53%|#####2    | 1585/3000 [47:46<57:50,  2.45s/it, lr: 1.0e-04 loss: 2.297e-01]
windy_storm:  53%|#####2    | 1585/3000 [47:46<57:50,  2.45s/it, lr: 1.0e-04 loss: 2.297e-01]
windy_storm:  53%|#####2    | 1586/3000 [47:46<1:00:57,  2.59s/it, lr: 1.0e-04 loss: 2.297e-01]
windy_storm:  53%|#####2    | 1586/3000 [47:46<1:00:57,  2.59s/it, lr: 1.0e-04 loss: 2.297e-01]
windy_storm:  53%|#####2    | 1586/3000 [47:48<1:00:57,  2.59s/it, lr: 1.0e-04 loss: 4.826e-01]
windy_storm:  53%|#####2    | 1586/3000 [47:48<1:00:57,  2.59s/it, lr: 1.0e-04 loss: 4.826e-01]
windy_storm:  53%|#####2    | 1587/3000 [47:48<1:03:03,  2.68s/it, lr: 1.0e-04 loss: 4.826e-01]
windy_storm:  53%|#####2    | 1587/3000 [47:48<1:03:03,  2.68s/it, lr: 1.0e-04 loss: 4.826e-01]
windy_storm:  53%|#####2    | 1587/3000 [47:49<1:03:03,  2.68s/it, lr: 1.0e-04 loss: 8.042e-02]
windy_storm:  53%|#####2    | 1587/3000 [47:49<1:03:03,  2.68s/it, lr: 1.0e-04 loss: 8.042e-02]
windy_storm:  53%|#####2    | 1588/3000 [47:49<49:39,  2.11s/it, lr: 1.0e-04 loss: 8.042e-02]  
windy_storm:  53%|#####2    | 1588/3000 [47:49<49:39,  2.11s/it, lr: 1.0e-04 loss: 8.042e-02]  
windy_storm:  53%|#####2    | 1588/3000 [47:51<49:39,  2.11s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  53%|#####2    | 1588/3000 [47:51<49:39,  2.11s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  53%|#####2    | 1589/3000 [47:51<45:44,  1.94s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  53%|#####2    | 1589/3000 [47:51<45:44,  1.94s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  53%|#####2    | 1589/3000 [47:52<45:44,  1.94s/it, lr: 1.0e-04 loss: 7.317e-01]
windy_storm:  53%|#####2    | 1589/3000 [47:52<45:44,  1.94s/it, lr: 1.0e-04 loss: 7.317e-01]
windy_storm:  53%|#####3    | 1590/3000 [47:53<45:42,  1.94s/it, lr: 1.0e-04 loss: 4.036e-01]
windy_storm:  53%|#####3    | 1590/3000 [47:53<45:42,  1.94s/it, lr: 1.0e-04 loss: 4.036e-01]
windy_storm:  53%|#####3    | 1591/3000 [47:53<33:15,  1.42s/it, lr: 1.0e-04 loss: 4.036e-01]
windy_storm:  53%|#####3    | 1591/3000 [47:53<33:15,  1.42s/it, lr: 1.0e-04 loss: 4.036e-01]
windy_storm:  53%|#####3    | 1591/3000 [47:55<33:15,  1.42s/it, lr: 1.0e-04 loss: 3.975e-03]
windy_storm:  53%|#####3    | 1591/3000 [47:55<33:15,  1.42s/it, lr: 1.0e-04 loss: 3.975e-03]
windy_storm:  53%|#####3    | 1592/3000 [47:55<34:09,  1.46s/it, lr: 1.0e-04 loss: 3.975e-03]
windy_storm:  53%|#####3    | 1592/3000 [47:55<34:09,  1.46s/it, lr: 1.0e-04 loss: 3.975e-03]
windy_storm:  53%|#####3    | 1592/3000 [47:58<34:09,  1.46s/it, lr: 1.0e-04 loss: 5.129e-01]
windy_storm:  53%|#####3    | 1592/3000 [47:58<34:09,  1.46s/it, lr: 1.0e-04 loss: 5.129e-01]
windy_storm:  53%|#####3    | 1593/3000 [47:58<43:09,  1.84s/it, lr: 1.0e-04 loss: 5.129e-01]
windy_storm:  53%|#####3    | 1593/3000 [47:58<43:09,  1.84s/it, lr: 1.0e-04 loss: 5.129e-01]
windy_storm:  53%|#####3    | 1593/3000 [48:01<43:09,  1.84s/it, lr: 1.0e-04 loss: 1.692e-01]
windy_storm:  53%|#####3    | 1593/3000 [48:01<43:09,  1.84s/it, lr: 1.0e-04 loss: 1.692e-01]
windy_storm:  53%|#####3    | 1594/3000 [48:01<49:56,  2.13s/it, lr: 1.0e-04 loss: 1.692e-01]
windy_storm:  53%|#####3    | 1594/3000 [48:01<49:56,  2.13s/it, lr: 1.0e-04 loss: 1.692e-01]
windy_storm:  53%|#####3    | 1594/3000 [48:01<49:56,  2.13s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  53%|#####3    | 1594/3000 [48:01<49:56,  2.13s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  53%|#####3    | 1595/3000 [48:01<40:56,  1.75s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  53%|#####3    | 1595/3000 [48:01<40:56,  1.75s/it, lr: 1.0e-04 loss: 4.615e-01]
windy_storm:  53%|#####3    | 1595/3000 [48:04<40:56,  1.75s/it, lr: 1.0e-04 loss: 6.231e-01]
windy_storm:  53%|#####3    | 1595/3000 [48:04<40:56,  1.75s/it, lr: 1.0e-04 loss: 6.231e-01]
windy_storm:  53%|#####3    | 1596/3000 [48:04<48:44,  2.08s/it, lr: 1.0e-04 loss: 6.231e-01]
windy_storm:  53%|#####3    | 1596/3000 [48:04<48:44,  2.08s/it, lr: 1.0e-04 loss: 6.231e-01]
windy_storm:  53%|#####3    | 1596/3000 [48:06<48:44,  2.08s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  53%|#####3    | 1596/3000 [48:06<48:44,  2.08s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  53%|#####3    | 1597/3000 [48:06<46:36,  1.99s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  53%|#####3    | 1597/3000 [48:06<46:36,  1.99s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  53%|#####3    | 1597/3000 [48:07<46:36,  1.99s/it, lr: 1.0e-04 loss: 5.170e-01]
windy_storm:  53%|#####3    | 1597/3000 [48:07<46:36,  1.99s/it, lr: 1.0e-04 loss: 5.170e-01]
windy_storm:  53%|#####3    | 1598/3000 [48:07<38:34,  1.65s/it, lr: 1.0e-04 loss: 5.170e-01]
windy_storm:  53%|#####3    | 1598/3000 [48:07<38:34,  1.65s/it, lr: 1.0e-04 loss: 5.170e-01]
windy_storm:  53%|#####3    | 1598/3000 [48:08<38:34,  1.65s/it, lr: 1.0e-04 loss: 5.537e-02]
windy_storm:  53%|#####3    | 1598/3000 [48:08<38:34,  1.65s/it, lr: 1.0e-04 loss: 5.537e-02]
windy_storm:  53%|#####3    | 1599/3000 [48:08<37:46,  1.62s/it, lr: 1.0e-04 loss: 5.537e-02]
windy_storm:  53%|#####3    | 1599/3000 [48:08<37:46,  1.62s/it, lr: 1.0e-04 loss: 5.537e-02]
windy_storm:  53%|#####3    | 1599/3000 [48:10<37:46,  1.62s/it, lr: 1.0e-04 loss: 6.188e-01]
windy_storm:  53%|#####3    | 1599/3000 [48:10<37:46,  1.62s/it, lr: 1.0e-04 loss: 6.188e-01]
windy_storm:  53%|#####3    | 1600/3000 [48:11<37:45,  1.62s/it, lr: 1.0e-04 loss: 2.839e-01]
windy_storm:  53%|#####3    | 1600/3000 [48:11<37:45,  1.62s/it, lr: 1.0e-04 loss: 2.839e-01]
windy_storm:  53%|#####3    | 1601/3000 [48:11<28:51,  1.24s/it, lr: 1.0e-04 loss: 2.839e-01]
windy_storm:  53%|#####3    | 1601/3000 [48:11<28:51,  1.24s/it, lr: 1.0e-04 loss: 2.839e-01]
windy_storm:  53%|#####3    | 1601/3000 [48:14<28:51,  1.24s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  53%|#####3    | 1601/3000 [48:14<28:51,  1.24s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  53%|#####3    | 1602/3000 [48:14<38:54,  1.67s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  53%|#####3    | 1602/3000 [48:14<38:54,  1.67s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  53%|#####3    | 1602/3000 [48:16<38:54,  1.67s/it, lr: 1.0e-04 loss: 5.100e-02]
windy_storm:  53%|#####3    | 1602/3000 [48:16<38:54,  1.67s/it, lr: 1.0e-04 loss: 5.100e-02]
windy_storm:  53%|#####3    | 1603/3000 [48:16<38:13,  1.64s/it, lr: 1.0e-04 loss: 5.100e-02]
windy_storm:  53%|#####3    | 1603/3000 [48:16<38:13,  1.64s/it, lr: 1.0e-04 loss: 5.100e-02]
windy_storm:  53%|#####3    | 1603/3000 [48:17<38:13,  1.64s/it, lr: 1.0e-04 loss: 4.071e-01]
windy_storm:  53%|#####3    | 1603/3000 [48:17<38:13,  1.64s/it, lr: 1.0e-04 loss: 4.071e-01]
windy_storm:  53%|#####3    | 1604/3000 [48:17<33:01,  1.42s/it, lr: 1.0e-04 loss: 4.071e-01]
windy_storm:  53%|#####3    | 1604/3000 [48:17<33:01,  1.42s/it, lr: 1.0e-04 loss: 4.071e-01]
windy_storm:  53%|#####3    | 1604/3000 [48:18<33:01,  1.42s/it, lr: 1.0e-04 loss: 6.353e-02]
windy_storm:  53%|#####3    | 1604/3000 [48:18<33:01,  1.42s/it, lr: 1.0e-04 loss: 6.353e-02]
windy_storm:  54%|#####3    | 1605/3000 [48:18<28:46,  1.24s/it, lr: 1.0e-04 loss: 6.353e-02]
windy_storm:  54%|#####3    | 1605/3000 [48:18<28:46,  1.24s/it, lr: 1.0e-04 loss: 6.353e-02]
windy_storm:  54%|#####3    | 1605/3000 [48:21<28:46,  1.24s/it, lr: 1.0e-04 loss: 5.617e-02]
windy_storm:  54%|#####3    | 1605/3000 [48:21<28:46,  1.24s/it, lr: 1.0e-04 loss: 5.617e-02]
windy_storm:  54%|#####3    | 1606/3000 [48:21<40:02,  1.72s/it, lr: 1.0e-04 loss: 5.617e-02]
windy_storm:  54%|#####3    | 1606/3000 [48:21<40:02,  1.72s/it, lr: 1.0e-04 loss: 5.617e-02]
windy_storm:  54%|#####3    | 1606/3000 [48:21<40:02,  1.72s/it, lr: 1.0e-04 loss: 5.974e-01]
windy_storm:  54%|#####3    | 1606/3000 [48:21<40:02,  1.72s/it, lr: 1.0e-04 loss: 5.974e-01]
windy_storm:  54%|#####3    | 1607/3000 [48:21<33:54,  1.46s/it, lr: 1.0e-04 loss: 5.974e-01]
windy_storm:  54%|#####3    | 1607/3000 [48:21<33:54,  1.46s/it, lr: 1.0e-04 loss: 5.974e-01]
windy_storm:  54%|#####3    | 1607/3000 [48:24<33:54,  1.46s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  54%|#####3    | 1607/3000 [48:24<33:54,  1.46s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  54%|#####3    | 1608/3000 [48:24<43:46,  1.89s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  54%|#####3    | 1608/3000 [48:24<43:46,  1.89s/it, lr: 1.0e-04 loss: 1.239e-01]
windy_storm:  54%|#####3    | 1608/3000 [48:27<43:46,  1.89s/it, lr: 1.0e-04 loss: 6.723e-01]
windy_storm:  54%|#####3    | 1608/3000 [48:27<43:46,  1.89s/it, lr: 1.0e-04 loss: 6.723e-01]
windy_storm:  54%|#####3    | 1609/3000 [48:27<51:00,  2.20s/it, lr: 1.0e-04 loss: 6.723e-01]
windy_storm:  54%|#####3    | 1609/3000 [48:27<51:00,  2.20s/it, lr: 1.0e-04 loss: 6.723e-01]
windy_storm:  54%|#####3    | 1609/3000 [48:28<51:00,  2.20s/it, lr: 1.0e-04 loss: 7.455e-02]
windy_storm:  54%|#####3    | 1609/3000 [48:28<51:00,  2.20s/it, lr: 1.0e-04 loss: 7.455e-02]
windy_storm:  54%|#####3    | 1610/3000 [48:31<50:57,  2.20s/it, lr: 1.0e-04 loss: 5.456e-01]
windy_storm:  54%|#####3    | 1610/3000 [48:31<50:57,  2.20s/it, lr: 1.0e-04 loss: 5.456e-01]
windy_storm:  54%|#####3    | 1611/3000 [48:31<43:32,  1.88s/it, lr: 1.0e-04 loss: 5.456e-01]
windy_storm:  54%|#####3    | 1611/3000 [48:31<43:32,  1.88s/it, lr: 1.0e-04 loss: 5.456e-01]
windy_storm:  54%|#####3    | 1611/3000 [48:33<43:32,  1.88s/it, lr: 1.0e-04 loss: 5.591e-01]
windy_storm:  54%|#####3    | 1611/3000 [48:33<43:32,  1.88s/it, lr: 1.0e-04 loss: 5.591e-01]
windy_storm:  54%|#####3    | 1612/3000 [48:33<41:52,  1.81s/it, lr: 1.0e-04 loss: 5.591e-01]
windy_storm:  54%|#####3    | 1612/3000 [48:33<41:52,  1.81s/it, lr: 1.0e-04 loss: 5.591e-01]
windy_storm:  54%|#####3    | 1612/3000 [48:34<41:52,  1.81s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  54%|#####3    | 1612/3000 [48:34<41:52,  1.81s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  54%|#####3    | 1613/3000 [48:34<35:54,  1.55s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  54%|#####3    | 1613/3000 [48:34<35:54,  1.55s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  54%|#####3    | 1613/3000 [48:35<35:54,  1.55s/it, lr: 1.0e-04 loss: 7.000e-02]
windy_storm:  54%|#####3    | 1613/3000 [48:35<35:54,  1.55s/it, lr: 1.0e-04 loss: 7.000e-02]
windy_storm:  54%|#####3    | 1614/3000 [48:35<36:03,  1.56s/it, lr: 1.0e-04 loss: 7.000e-02]
windy_storm:  54%|#####3    | 1614/3000 [48:35<36:03,  1.56s/it, lr: 1.0e-04 loss: 7.000e-02]
windy_storm:  54%|#####3    | 1614/3000 [48:37<36:03,  1.56s/it, lr: 1.0e-04 loss: 6.392e-01]
windy_storm:  54%|#####3    | 1614/3000 [48:37<36:03,  1.56s/it, lr: 1.0e-04 loss: 6.392e-01]
windy_storm:  54%|#####3    | 1615/3000 [48:37<36:13,  1.57s/it, lr: 1.0e-04 loss: 6.392e-01]
windy_storm:  54%|#####3    | 1615/3000 [48:37<36:13,  1.57s/it, lr: 1.0e-04 loss: 6.392e-01]
windy_storm:  54%|#####3    | 1615/3000 [48:38<36:13,  1.57s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  54%|#####3    | 1615/3000 [48:38<36:13,  1.57s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  54%|#####3    | 1616/3000 [48:38<31:15,  1.36s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  54%|#####3    | 1616/3000 [48:38<31:15,  1.36s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  54%|#####3    | 1616/3000 [48:41<31:15,  1.36s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  54%|#####3    | 1616/3000 [48:41<31:15,  1.36s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  54%|#####3    | 1617/3000 [48:41<42:02,  1.82s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  54%|#####3    | 1617/3000 [48:41<42:02,  1.82s/it, lr: 1.0e-04 loss: 2.161e-01]
windy_storm:  54%|#####3    | 1617/3000 [48:42<42:02,  1.82s/it, lr: 1.0e-04 loss: 6.729e-01]
windy_storm:  54%|#####3    | 1617/3000 [48:42<42:02,  1.82s/it, lr: 1.0e-04 loss: 6.729e-01]
windy_storm:  54%|#####3    | 1618/3000 [48:42<35:15,  1.53s/it, lr: 1.0e-04 loss: 6.729e-01]
windy_storm:  54%|#####3    | 1618/3000 [48:42<35:15,  1.53s/it, lr: 1.0e-04 loss: 6.729e-01]
windy_storm:  54%|#####3    | 1618/3000 [48:42<35:15,  1.53s/it, lr: 1.0e-04 loss: 4.948e-01]
windy_storm:  54%|#####3    | 1618/3000 [48:42<35:15,  1.53s/it, lr: 1.0e-04 loss: 4.948e-01]
windy_storm:  54%|#####3    | 1619/3000 [48:42<29:50,  1.30s/it, lr: 1.0e-04 loss: 4.948e-01]
windy_storm:  54%|#####3    | 1619/3000 [48:42<29:50,  1.30s/it, lr: 1.0e-04 loss: 4.948e-01]
windy_storm:  54%|#####3    | 1619/3000 [48:45<29:50,  1.30s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  54%|#####3    | 1619/3000 [48:45<29:50,  1.30s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  54%|#####4    | 1620/3000 [48:48<29:48,  1.30s/it, lr: 1.0e-04 loss: 3.159e-01]
windy_storm:  54%|#####4    | 1620/3000 [48:48<29:48,  1.30s/it, lr: 1.0e-04 loss: 3.159e-01]
windy_storm:  54%|#####4    | 1621/3000 [48:48<32:00,  1.39s/it, lr: 1.0e-04 loss: 3.159e-01]
windy_storm:  54%|#####4    | 1621/3000 [48:48<32:00,  1.39s/it, lr: 1.0e-04 loss: 3.159e-01]
windy_storm:  54%|#####4    | 1621/3000 [48:51<32:00,  1.39s/it, lr: 1.0e-04 loss: 2.905e-01]
windy_storm:  54%|#####4    | 1621/3000 [48:51<32:00,  1.39s/it, lr: 1.0e-04 loss: 2.905e-01]
windy_storm:  54%|#####4    | 1622/3000 [48:51<40:30,  1.76s/it, lr: 1.0e-04 loss: 2.905e-01]
windy_storm:  54%|#####4    | 1622/3000 [48:51<40:30,  1.76s/it, lr: 1.0e-04 loss: 2.905e-01]
windy_storm:  54%|#####4    | 1622/3000 [48:54<40:30,  1.76s/it, lr: 1.0e-04 loss: 7.177e-02]
windy_storm:  54%|#####4    | 1622/3000 [48:54<40:30,  1.76s/it, lr: 1.0e-04 loss: 7.177e-02]
windy_storm:  54%|#####4    | 1623/3000 [48:54<48:21,  2.11s/it, lr: 1.0e-04 loss: 7.177e-02]
windy_storm:  54%|#####4    | 1623/3000 [48:54<48:21,  2.11s/it, lr: 1.0e-04 loss: 7.177e-02]
windy_storm:  54%|#####4    | 1623/3000 [48:55<48:21,  2.11s/it, lr: 1.0e-04 loss: 3.416e-01]
windy_storm:  54%|#####4    | 1623/3000 [48:55<48:21,  2.11s/it, lr: 1.0e-04 loss: 3.416e-01]
windy_storm:  54%|#####4    | 1624/3000 [48:55<40:20,  1.76s/it, lr: 1.0e-04 loss: 3.416e-01]
windy_storm:  54%|#####4    | 1624/3000 [48:55<40:20,  1.76s/it, lr: 1.0e-04 loss: 3.416e-01]
windy_storm:  54%|#####4    | 1624/3000 [48:58<40:20,  1.76s/it, lr: 1.0e-04 loss: 4.686e-01]
windy_storm:  54%|#####4    | 1624/3000 [48:58<40:20,  1.76s/it, lr: 1.0e-04 loss: 4.686e-01]
windy_storm:  54%|#####4    | 1625/3000 [48:58<47:38,  2.08s/it, lr: 1.0e-04 loss: 4.686e-01]
windy_storm:  54%|#####4    | 1625/3000 [48:58<47:38,  2.08s/it, lr: 1.0e-04 loss: 4.686e-01]
windy_storm:  54%|#####4    | 1625/3000 [48:59<47:38,  2.08s/it, lr: 1.0e-04 loss: 1.127e-01]
windy_storm:  54%|#####4    | 1625/3000 [48:59<47:38,  2.08s/it, lr: 1.0e-04 loss: 1.127e-01]
windy_storm:  54%|#####4    | 1626/3000 [48:59<38:59,  1.70s/it, lr: 1.0e-04 loss: 1.127e-01]
windy_storm:  54%|#####4    | 1626/3000 [48:59<38:59,  1.70s/it, lr: 1.0e-04 loss: 1.127e-01]
windy_storm:  54%|#####4    | 1626/3000 [49:02<38:59,  1.70s/it, lr: 1.0e-04 loss: 2.565e-01]
windy_storm:  54%|#####4    | 1626/3000 [49:02<38:59,  1.70s/it, lr: 1.0e-04 loss: 2.565e-01]
windy_storm:  54%|#####4    | 1627/3000 [49:02<47:43,  2.09s/it, lr: 1.0e-04 loss: 2.565e-01]
windy_storm:  54%|#####4    | 1627/3000 [49:02<47:43,  2.09s/it, lr: 1.0e-04 loss: 2.565e-01]
windy_storm:  54%|#####4    | 1627/3000 [49:03<47:43,  2.09s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  54%|#####4    | 1627/3000 [49:03<47:43,  2.09s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  54%|#####4    | 1628/3000 [49:03<39:16,  1.72s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  54%|#####4    | 1628/3000 [49:03<39:16,  1.72s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  54%|#####4    | 1628/3000 [49:03<39:16,  1.72s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  54%|#####4    | 1628/3000 [49:03<39:16,  1.72s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  54%|#####4    | 1629/3000 [49:03<32:43,  1.43s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  54%|#####4    | 1629/3000 [49:03<32:43,  1.43s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  54%|#####4    | 1629/3000 [49:05<32:43,  1.43s/it, lr: 1.0e-04 loss: 3.779e-01]
windy_storm:  54%|#####4    | 1629/3000 [49:05<32:43,  1.43s/it, lr: 1.0e-04 loss: 3.779e-01]
windy_storm:  54%|#####4    | 1630/3000 [49:06<32:42,  1.43s/it, lr: 1.0e-04 loss: 6.929e-01]
windy_storm:  54%|#####4    | 1630/3000 [49:06<32:42,  1.43s/it, lr: 1.0e-04 loss: 6.929e-01]
windy_storm:  54%|#####4    | 1631/3000 [49:06<22:02,  1.04it/s, lr: 1.0e-04 loss: 6.929e-01]
windy_storm:  54%|#####4    | 1631/3000 [49:06<22:02,  1.04it/s, lr: 1.0e-04 loss: 6.929e-01]
windy_storm:  54%|#####4    | 1631/3000 [49:09<22:02,  1.04it/s, lr: 1.0e-04 loss: 7.250e-01]
windy_storm:  54%|#####4    | 1631/3000 [49:09<22:02,  1.04it/s, lr: 1.0e-04 loss: 7.250e-01]
windy_storm:  54%|#####4    | 1632/3000 [49:09<32:59,  1.45s/it, lr: 1.0e-04 loss: 7.250e-01]
windy_storm:  54%|#####4    | 1632/3000 [49:09<32:59,  1.45s/it, lr: 1.0e-04 loss: 7.250e-01]
windy_storm:  54%|#####4    | 1632/3000 [49:10<32:59,  1.45s/it, lr: 1.0e-04 loss: 2.491e-01]
windy_storm:  54%|#####4    | 1632/3000 [49:10<32:59,  1.45s/it, lr: 1.0e-04 loss: 2.491e-01]
windy_storm:  54%|#####4    | 1633/3000 [49:10<33:42,  1.48s/it, lr: 1.0e-04 loss: 2.491e-01]
windy_storm:  54%|#####4    | 1633/3000 [49:10<33:42,  1.48s/it, lr: 1.0e-04 loss: 2.491e-01]
windy_storm:  54%|#####4    | 1633/3000 [49:12<33:42,  1.48s/it, lr: 1.0e-04 loss: 1.353e-01]
windy_storm:  54%|#####4    | 1633/3000 [49:12<33:42,  1.48s/it, lr: 1.0e-04 loss: 1.353e-01]
windy_storm:  54%|#####4    | 1634/3000 [49:12<34:28,  1.51s/it, lr: 1.0e-04 loss: 1.353e-01]
windy_storm:  54%|#####4    | 1634/3000 [49:12<34:28,  1.51s/it, lr: 1.0e-04 loss: 1.353e-01]
windy_storm:  54%|#####4    | 1634/3000 [49:13<34:28,  1.51s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  54%|#####4    | 1634/3000 [49:13<34:28,  1.51s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  55%|#####4    | 1635/3000 [49:13<35:02,  1.54s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  55%|#####4    | 1635/3000 [49:13<35:02,  1.54s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  55%|#####4    | 1635/3000 [49:15<35:02,  1.54s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  55%|#####4    | 1635/3000 [49:15<35:02,  1.54s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  55%|#####4    | 1636/3000 [49:15<35:17,  1.55s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  55%|#####4    | 1636/3000 [49:15<35:17,  1.55s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  55%|#####4    | 1636/3000 [49:16<35:17,  1.55s/it, lr: 1.0e-04 loss: 6.310e-01]
windy_storm:  55%|#####4    | 1636/3000 [49:16<35:17,  1.55s/it, lr: 1.0e-04 loss: 6.310e-01]
windy_storm:  55%|#####4    | 1637/3000 [49:16<30:05,  1.32s/it, lr: 1.0e-04 loss: 6.310e-01]
windy_storm:  55%|#####4    | 1637/3000 [49:16<30:05,  1.32s/it, lr: 1.0e-04 loss: 6.310e-01]
windy_storm:  55%|#####4    | 1637/3000 [49:19<30:05,  1.32s/it, lr: 1.0e-04 loss: 1.739e-01]
windy_storm:  55%|#####4    | 1637/3000 [49:19<30:05,  1.32s/it, lr: 1.0e-04 loss: 1.739e-01]
windy_storm:  55%|#####4    | 1638/3000 [49:19<41:59,  1.85s/it, lr: 1.0e-04 loss: 1.739e-01]
windy_storm:  55%|#####4    | 1638/3000 [49:19<41:59,  1.85s/it, lr: 1.0e-04 loss: 1.739e-01]
windy_storm:  55%|#####4    | 1638/3000 [49:20<41:59,  1.85s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  55%|#####4    | 1638/3000 [49:20<41:59,  1.85s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  55%|#####4    | 1639/3000 [49:20<39:59,  1.76s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  55%|#####4    | 1639/3000 [49:20<39:59,  1.76s/it, lr: 1.0e-04 loss: 6.859e-01]
windy_storm:  55%|#####4    | 1639/3000 [49:23<39:59,  1.76s/it, lr: 1.0e-04 loss: 5.708e-01]
windy_storm:  55%|#####4    | 1639/3000 [49:23<39:59,  1.76s/it, lr: 1.0e-04 loss: 5.708e-01]
windy_storm:  55%|#####4    | 1640/3000 [49:25<39:57,  1.76s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:  55%|#####4    | 1640/3000 [49:25<39:57,  1.76s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:  55%|#####4    | 1641/3000 [49:25<29:53,  1.32s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:  55%|#####4    | 1641/3000 [49:25<29:53,  1.32s/it, lr: 1.0e-04 loss: 5.055e-01]
windy_storm:  55%|#####4    | 1641/3000 [49:27<29:53,  1.32s/it, lr: 1.0e-04 loss: 1.460e-01]
windy_storm:  55%|#####4    | 1641/3000 [49:27<29:53,  1.32s/it, lr: 1.0e-04 loss: 1.460e-01]
windy_storm:  55%|#####4    | 1642/3000 [49:27<31:21,  1.39s/it, lr: 1.0e-04 loss: 1.460e-01]
windy_storm:  55%|#####4    | 1642/3000 [49:27<31:21,  1.39s/it, lr: 1.0e-04 loss: 1.460e-01]
windy_storm:  55%|#####4    | 1642/3000 [49:28<31:21,  1.39s/it, lr: 1.0e-04 loss: 4.016e-01]
windy_storm:  55%|#####4    | 1642/3000 [49:28<31:21,  1.39s/it, lr: 1.0e-04 loss: 4.016e-01]
windy_storm:  55%|#####4    | 1643/3000 [49:28<32:18,  1.43s/it, lr: 1.0e-04 loss: 4.016e-01]
windy_storm:  55%|#####4    | 1643/3000 [49:28<32:18,  1.43s/it, lr: 1.0e-04 loss: 4.016e-01]
windy_storm:  55%|#####4    | 1643/3000 [49:29<32:18,  1.43s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  55%|#####4    | 1643/3000 [49:29<32:18,  1.43s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  55%|#####4    | 1644/3000 [49:29<28:35,  1.27s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  55%|#####4    | 1644/3000 [49:29<28:35,  1.27s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  55%|#####4    | 1644/3000 [49:30<28:35,  1.27s/it, lr: 1.0e-04 loss: 1.295e-01]
windy_storm:  55%|#####4    | 1644/3000 [49:30<28:35,  1.27s/it, lr: 1.0e-04 loss: 1.295e-01]
windy_storm:  55%|#####4    | 1645/3000 [49:30<30:11,  1.34s/it, lr: 1.0e-04 loss: 1.295e-01]
windy_storm:  55%|#####4    | 1645/3000 [49:30<30:11,  1.34s/it, lr: 1.0e-04 loss: 1.295e-01]
windy_storm:  55%|#####4    | 1645/3000 [49:31<30:11,  1.34s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  55%|#####4    | 1645/3000 [49:31<30:11,  1.34s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  55%|#####4    | 1646/3000 [49:31<26:34,  1.18s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  55%|#####4    | 1646/3000 [49:31<26:34,  1.18s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  55%|#####4    | 1646/3000 [49:32<26:34,  1.18s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  55%|#####4    | 1646/3000 [49:32<26:34,  1.18s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  55%|#####4    | 1647/3000 [49:32<24:14,  1.07s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  55%|#####4    | 1647/3000 [49:32<24:14,  1.07s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  55%|#####4    | 1647/3000 [49:33<24:14,  1.07s/it, lr: 1.0e-04 loss: 5.569e-01]
windy_storm:  55%|#####4    | 1647/3000 [49:33<24:14,  1.07s/it, lr: 1.0e-04 loss: 5.569e-01]
windy_storm:  55%|#####4    | 1648/3000 [49:33<22:38,  1.01s/it, lr: 1.0e-04 loss: 5.569e-01]
windy_storm:  55%|#####4    | 1648/3000 [49:33<22:38,  1.01s/it, lr: 1.0e-04 loss: 5.569e-01]
windy_storm:  55%|#####4    | 1648/3000 [49:34<22:38,  1.01s/it, lr: 1.0e-04 loss: 2.915e-01]
windy_storm:  55%|#####4    | 1648/3000 [49:34<22:38,  1.01s/it, lr: 1.0e-04 loss: 2.915e-01]
windy_storm:  55%|#####4    | 1649/3000 [49:34<21:01,  1.07it/s, lr: 1.0e-04 loss: 2.915e-01]
windy_storm:  55%|#####4    | 1649/3000 [49:34<21:01,  1.07it/s, lr: 1.0e-04 loss: 2.915e-01]
windy_storm:  55%|#####4    | 1649/3000 [49:35<21:01,  1.07it/s, lr: 1.0e-04 loss: 6.968e-01]
windy_storm:  55%|#####4    | 1649/3000 [49:35<21:01,  1.07it/s, lr: 1.0e-04 loss: 6.968e-01]
windy_storm:  55%|#####5    | 1650/3000 [49:37<21:00,  1.07it/s, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  55%|#####5    | 1650/3000 [49:37<21:00,  1.07it/s, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  55%|#####5    | 1651/3000 [49:37<19:28,  1.15it/s, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  55%|#####5    | 1651/3000 [49:37<19:28,  1.15it/s, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  55%|#####5    | 1651/3000 [49:39<19:28,  1.15it/s, lr: 1.0e-04 loss: 4.750e-01]
windy_storm:  55%|#####5    | 1651/3000 [49:39<19:28,  1.15it/s, lr: 1.0e-04 loss: 4.750e-01]
windy_storm:  55%|#####5    | 1652/3000 [49:39<24:21,  1.08s/it, lr: 1.0e-04 loss: 4.750e-01]
windy_storm:  55%|#####5    | 1652/3000 [49:39<24:21,  1.08s/it, lr: 1.0e-04 loss: 4.750e-01]
windy_storm:  55%|#####5    | 1652/3000 [49:40<24:21,  1.08s/it, lr: 1.0e-04 loss: 2.738e-01]
windy_storm:  55%|#####5    | 1652/3000 [49:40<24:21,  1.08s/it, lr: 1.0e-04 loss: 2.738e-01]
windy_storm:  55%|#####5    | 1653/3000 [49:40<27:13,  1.21s/it, lr: 1.0e-04 loss: 2.738e-01]
windy_storm:  55%|#####5    | 1653/3000 [49:40<27:13,  1.21s/it, lr: 1.0e-04 loss: 2.738e-01]
windy_storm:  55%|#####5    | 1653/3000 [49:41<27:13,  1.21s/it, lr: 1.0e-04 loss: 5.853e-01]
windy_storm:  55%|#####5    | 1653/3000 [49:41<27:13,  1.21s/it, lr: 1.0e-04 loss: 5.853e-01]
windy_storm:  55%|#####5    | 1654/3000 [49:41<24:47,  1.10s/it, lr: 1.0e-04 loss: 5.853e-01]
windy_storm:  55%|#####5    | 1654/3000 [49:41<24:47,  1.10s/it, lr: 1.0e-04 loss: 5.853e-01]
windy_storm:  55%|#####5    | 1654/3000 [49:42<24:47,  1.10s/it, lr: 1.0e-04 loss: 3.411e-02]
windy_storm:  55%|#####5    | 1654/3000 [49:42<24:47,  1.10s/it, lr: 1.0e-04 loss: 3.411e-02]
windy_storm:  55%|#####5    | 1655/3000 [49:42<23:01,  1.03s/it, lr: 1.0e-04 loss: 3.411e-02]
windy_storm:  55%|#####5    | 1655/3000 [49:42<23:01,  1.03s/it, lr: 1.0e-04 loss: 3.411e-02]
windy_storm:  55%|#####5    | 1655/3000 [49:43<23:01,  1.03s/it, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  55%|#####5    | 1655/3000 [49:43<23:01,  1.03s/it, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  55%|#####5    | 1656/3000 [49:43<21:14,  1.05it/s, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  55%|#####5    | 1656/3000 [49:43<21:14,  1.05it/s, lr: 1.0e-04 loss: 2.326e-01]
windy_storm:  55%|#####5    | 1656/3000 [49:44<21:14,  1.05it/s, lr: 1.0e-04 loss: 6.523e-01]
windy_storm:  55%|#####5    | 1656/3000 [49:44<21:14,  1.05it/s, lr: 1.0e-04 loss: 6.523e-01]
windy_storm:  55%|#####5    | 1657/3000 [49:44<25:08,  1.12s/it, lr: 1.0e-04 loss: 6.523e-01]
windy_storm:  55%|#####5    | 1657/3000 [49:44<25:08,  1.12s/it, lr: 1.0e-04 loss: 6.523e-01]
windy_storm:  55%|#####5    | 1657/3000 [49:45<25:08,  1.12s/it, lr: 1.0e-04 loss: 3.843e-02]
windy_storm:  55%|#####5    | 1657/3000 [49:45<25:08,  1.12s/it, lr: 1.0e-04 loss: 3.843e-02]
windy_storm:  55%|#####5    | 1658/3000 [49:45<22:42,  1.02s/it, lr: 1.0e-04 loss: 3.843e-02]
windy_storm:  55%|#####5    | 1658/3000 [49:45<22:42,  1.02s/it, lr: 1.0e-04 loss: 3.843e-02]
windy_storm:  55%|#####5    | 1658/3000 [49:48<22:42,  1.02s/it, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  55%|#####5    | 1658/3000 [49:48<22:42,  1.02s/it, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  55%|#####5    | 1659/3000 [49:48<35:24,  1.58s/it, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  55%|#####5    | 1659/3000 [49:48<35:24,  1.58s/it, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  55%|#####5    | 1659/3000 [49:49<35:24,  1.58s/it, lr: 1.0e-04 loss: 1.511e-01]
windy_storm:  55%|#####5    | 1659/3000 [49:49<35:24,  1.58s/it, lr: 1.0e-04 loss: 1.511e-01]
windy_storm:  55%|#####5    | 1660/3000 [49:49<35:22,  1.58s/it, lr: 1.0e-04 loss: 9.072e-02]
windy_storm:  55%|#####5    | 1660/3000 [49:49<35:22,  1.58s/it, lr: 1.0e-04 loss: 9.072e-02]
windy_storm:  55%|#####5    | 1661/3000 [49:49<23:26,  1.05s/it, lr: 1.0e-04 loss: 9.072e-02]
windy_storm:  55%|#####5    | 1661/3000 [49:49<23:26,  1.05s/it, lr: 1.0e-04 loss: 9.072e-02]
windy_storm:  55%|#####5    | 1661/3000 [49:50<23:26,  1.05s/it, lr: 1.0e-04 loss: 4.189e-02]
windy_storm:  55%|#####5    | 1661/3000 [49:50<23:26,  1.05s/it, lr: 1.0e-04 loss: 4.189e-02]
windy_storm:  55%|#####5    | 1662/3000 [49:50<22:08,  1.01it/s, lr: 1.0e-04 loss: 4.189e-02]
windy_storm:  55%|#####5    | 1662/3000 [49:50<22:08,  1.01it/s, lr: 1.0e-04 loss: 4.189e-02]
windy_storm:  55%|#####5    | 1662/3000 [49:51<22:08,  1.01it/s, lr: 1.0e-04 loss: 5.003e-01]
windy_storm:  55%|#####5    | 1662/3000 [49:51<22:08,  1.01it/s, lr: 1.0e-04 loss: 5.003e-01]
windy_storm:  55%|#####5    | 1663/3000 [49:51<20:52,  1.07it/s, lr: 1.0e-04 loss: 5.003e-01]
windy_storm:  55%|#####5    | 1663/3000 [49:51<20:52,  1.07it/s, lr: 1.0e-04 loss: 5.003e-01]
windy_storm:  55%|#####5    | 1663/3000 [49:53<20:52,  1.07it/s, lr: 1.0e-04 loss: 5.505e-01]
windy_storm:  55%|#####5    | 1663/3000 [49:53<20:52,  1.07it/s, lr: 1.0e-04 loss: 5.505e-01]
windy_storm:  55%|#####5    | 1664/3000 [49:53<24:40,  1.11s/it, lr: 1.0e-04 loss: 5.505e-01]
windy_storm:  55%|#####5    | 1664/3000 [49:53<24:40,  1.11s/it, lr: 1.0e-04 loss: 5.505e-01]
windy_storm:  55%|#####5    | 1664/3000 [49:56<24:40,  1.11s/it, lr: 1.0e-04 loss: 3.987e-01]
windy_storm:  55%|#####5    | 1664/3000 [49:56<24:40,  1.11s/it, lr: 1.0e-04 loss: 3.987e-01]
windy_storm:  56%|#####5    | 1665/3000 [49:56<37:20,  1.68s/it, lr: 1.0e-04 loss: 3.987e-01]
windy_storm:  56%|#####5    | 1665/3000 [49:56<37:20,  1.68s/it, lr: 1.0e-04 loss: 3.987e-01]
windy_storm:  56%|#####5    | 1665/3000 [49:59<37:20,  1.68s/it, lr: 1.0e-04 loss: 3.629e-01]
windy_storm:  56%|#####5    | 1665/3000 [49:59<37:20,  1.68s/it, lr: 1.0e-04 loss: 3.629e-01]
windy_storm:  56%|#####5    | 1666/3000 [49:59<45:42,  2.06s/it, lr: 1.0e-04 loss: 3.629e-01]
windy_storm:  56%|#####5    | 1666/3000 [49:59<45:42,  2.06s/it, lr: 1.0e-04 loss: 3.629e-01]
windy_storm:  56%|#####5    | 1666/3000 [50:02<45:42,  2.06s/it, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  56%|#####5    | 1666/3000 [50:02<45:42,  2.06s/it, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  56%|#####5    | 1667/3000 [50:02<51:44,  2.33s/it, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  56%|#####5    | 1667/3000 [50:02<51:44,  2.33s/it, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  56%|#####5    | 1667/3000 [50:05<51:44,  2.33s/it, lr: 1.0e-04 loss: 5.610e-01]
windy_storm:  56%|#####5    | 1667/3000 [50:05<51:44,  2.33s/it, lr: 1.0e-04 loss: 5.610e-01]
windy_storm:  56%|#####5    | 1668/3000 [50:05<55:38,  2.51s/it, lr: 1.0e-04 loss: 5.610e-01]
windy_storm:  56%|#####5    | 1668/3000 [50:05<55:38,  2.51s/it, lr: 1.0e-04 loss: 5.610e-01]
windy_storm:  56%|#####5    | 1668/3000 [50:06<55:38,  2.51s/it, lr: 1.0e-04 loss: 5.211e-01]
windy_storm:  56%|#####5    | 1668/3000 [50:06<55:38,  2.51s/it, lr: 1.0e-04 loss: 5.211e-01]
windy_storm:  56%|#####5    | 1669/3000 [50:06<49:32,  2.23s/it, lr: 1.0e-04 loss: 5.211e-01]
windy_storm:  56%|#####5    | 1669/3000 [50:06<49:32,  2.23s/it, lr: 1.0e-04 loss: 5.211e-01]
windy_storm:  56%|#####5    | 1669/3000 [50:09<49:32,  2.23s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  56%|#####5    | 1669/3000 [50:09<49:32,  2.23s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  56%|#####5    | 1670/3000 [50:10<49:29,  2.23s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  56%|#####5    | 1670/3000 [50:10<49:29,  2.23s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  56%|#####5    | 1671/3000 [50:10<30:58,  1.40s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  56%|#####5    | 1671/3000 [50:10<30:58,  1.40s/it, lr: 1.0e-04 loss: 3.241e-01]
windy_storm:  56%|#####5    | 1671/3000 [50:12<30:58,  1.40s/it, lr: 1.0e-04 loss: 4.104e-01]
windy_storm:  56%|#####5    | 1671/3000 [50:12<30:58,  1.40s/it, lr: 1.0e-04 loss: 4.104e-01]
windy_storm:  56%|#####5    | 1672/3000 [50:12<32:01,  1.45s/it, lr: 1.0e-04 loss: 4.104e-01]
windy_storm:  56%|#####5    | 1672/3000 [50:12<32:01,  1.45s/it, lr: 1.0e-04 loss: 4.104e-01]
windy_storm:  56%|#####5    | 1672/3000 [50:13<32:01,  1.45s/it, lr: 1.0e-04 loss: 2.029e-02]
windy_storm:  56%|#####5    | 1672/3000 [50:13<32:01,  1.45s/it, lr: 1.0e-04 loss: 2.029e-02]
windy_storm:  56%|#####5    | 1673/3000 [50:13<32:50,  1.49s/it, lr: 1.0e-04 loss: 2.029e-02]
windy_storm:  56%|#####5    | 1673/3000 [50:13<32:50,  1.49s/it, lr: 1.0e-04 loss: 2.029e-02]
windy_storm:  56%|#####5    | 1673/3000 [50:15<32:50,  1.49s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  56%|#####5    | 1673/3000 [50:15<32:50,  1.49s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  56%|#####5    | 1674/3000 [50:15<33:24,  1.51s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  56%|#####5    | 1674/3000 [50:15<33:24,  1.51s/it, lr: 1.0e-04 loss: 2.282e-01]
windy_storm:  56%|#####5    | 1674/3000 [50:18<33:24,  1.51s/it, lr: 1.0e-04 loss: 5.455e-01]
windy_storm:  56%|#####5    | 1674/3000 [50:18<33:24,  1.51s/it, lr: 1.0e-04 loss: 5.455e-01]
windy_storm:  56%|#####5    | 1675/3000 [50:18<42:07,  1.91s/it, lr: 1.0e-04 loss: 5.455e-01]
windy_storm:  56%|#####5    | 1675/3000 [50:18<42:07,  1.91s/it, lr: 1.0e-04 loss: 5.455e-01]
windy_storm:  56%|#####5    | 1675/3000 [50:19<42:07,  1.91s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  56%|#####5    | 1675/3000 [50:19<42:07,  1.91s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  56%|#####5    | 1676/3000 [50:19<39:56,  1.81s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  56%|#####5    | 1676/3000 [50:19<39:56,  1.81s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  56%|#####5    | 1676/3000 [50:20<39:56,  1.81s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  56%|#####5    | 1676/3000 [50:20<39:56,  1.81s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  56%|#####5    | 1677/3000 [50:20<33:10,  1.50s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  56%|#####5    | 1677/3000 [50:20<33:10,  1.50s/it, lr: 1.0e-04 loss: 1.319e-01]
windy_storm:  56%|#####5    | 1677/3000 [50:21<33:10,  1.50s/it, lr: 1.0e-04 loss: 5.706e-01]
windy_storm:  56%|#####5    | 1677/3000 [50:21<33:10,  1.50s/it, lr: 1.0e-04 loss: 5.706e-01]
windy_storm:  56%|#####5    | 1678/3000 [50:21<30:02,  1.36s/it, lr: 1.0e-04 loss: 5.706e-01]
windy_storm:  56%|#####5    | 1678/3000 [50:21<30:02,  1.36s/it, lr: 1.0e-04 loss: 5.706e-01]
windy_storm:  56%|#####5    | 1678/3000 [50:22<30:02,  1.36s/it, lr: 1.0e-04 loss: 3.013e-01]
windy_storm:  56%|#####5    | 1678/3000 [50:22<30:02,  1.36s/it, lr: 1.0e-04 loss: 3.013e-01]
windy_storm:  56%|#####5    | 1679/3000 [50:22<26:25,  1.20s/it, lr: 1.0e-04 loss: 3.013e-01]
windy_storm:  56%|#####5    | 1679/3000 [50:22<26:25,  1.20s/it, lr: 1.0e-04 loss: 3.013e-01]
windy_storm:  56%|#####5    | 1679/3000 [50:24<26:25,  1.20s/it, lr: 1.0e-04 loss: 6.371e-01]
windy_storm:  56%|#####5    | 1679/3000 [50:24<26:25,  1.20s/it, lr: 1.0e-04 loss: 6.371e-01]
windy_storm:  56%|#####6    | 1680/3000 [50:25<26:24,  1.20s/it, lr: 1.0e-04 loss: 4.841e-01]
windy_storm:  56%|#####6    | 1680/3000 [50:25<26:24,  1.20s/it, lr: 1.0e-04 loss: 4.841e-01]
windy_storm:  56%|#####6    | 1681/3000 [50:25<18:10,  1.21it/s, lr: 1.0e-04 loss: 4.841e-01]
windy_storm:  56%|#####6    | 1681/3000 [50:25<18:10,  1.21it/s, lr: 1.0e-04 loss: 4.841e-01]
windy_storm:  56%|#####6    | 1681/3000 [50:26<18:10,  1.21it/s, lr: 1.0e-04 loss: 6.230e-01]
windy_storm:  56%|#####6    | 1681/3000 [50:26<18:10,  1.21it/s, lr: 1.0e-04 loss: 6.230e-01]
windy_storm:  56%|#####6    | 1682/3000 [50:26<22:06,  1.01s/it, lr: 1.0e-04 loss: 6.230e-01]
windy_storm:  56%|#####6    | 1682/3000 [50:26<22:06,  1.01s/it, lr: 1.0e-04 loss: 6.230e-01]
windy_storm:  56%|#####6    | 1682/3000 [50:27<22:06,  1.01s/it, lr: 1.0e-04 loss: 3.245e-01]
windy_storm:  56%|#####6    | 1682/3000 [50:27<22:06,  1.01s/it, lr: 1.0e-04 loss: 3.245e-01]
windy_storm:  56%|#####6    | 1683/3000 [50:27<21:00,  1.04it/s, lr: 1.0e-04 loss: 3.245e-01]
windy_storm:  56%|#####6    | 1683/3000 [50:27<21:00,  1.04it/s, lr: 1.0e-04 loss: 3.245e-01]
windy_storm:  56%|#####6    | 1683/3000 [50:28<21:00,  1.04it/s, lr: 1.0e-04 loss: 6.171e-01]
windy_storm:  56%|#####6    | 1683/3000 [50:28<21:00,  1.04it/s, lr: 1.0e-04 loss: 6.171e-01]
windy_storm:  56%|#####6    | 1684/3000 [50:28<20:10,  1.09it/s, lr: 1.0e-04 loss: 6.171e-01]
windy_storm:  56%|#####6    | 1684/3000 [50:28<20:10,  1.09it/s, lr: 1.0e-04 loss: 6.171e-01]
windy_storm:  56%|#####6    | 1684/3000 [50:31<20:10,  1.09it/s, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  56%|#####6    | 1684/3000 [50:31<20:10,  1.09it/s, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  56%|#####6    | 1685/3000 [50:31<32:59,  1.51s/it, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  56%|#####6    | 1685/3000 [50:31<32:59,  1.51s/it, lr: 1.0e-04 loss: 4.929e-01]
windy_storm:  56%|#####6    | 1685/3000 [50:32<32:59,  1.51s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  56%|#####6    | 1685/3000 [50:32<32:59,  1.51s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  56%|#####6    | 1686/3000 [50:32<28:41,  1.31s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  56%|#####6    | 1686/3000 [50:32<28:41,  1.31s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  56%|#####6    | 1686/3000 [50:35<28:41,  1.31s/it, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  56%|#####6    | 1686/3000 [50:35<28:41,  1.31s/it, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  56%|#####6    | 1687/3000 [50:35<39:23,  1.80s/it, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  56%|#####6    | 1687/3000 [50:35<39:23,  1.80s/it, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  56%|#####6    | 1687/3000 [50:36<39:23,  1.80s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  56%|#####6    | 1687/3000 [50:36<39:23,  1.80s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  56%|#####6    | 1688/3000 [50:36<32:43,  1.50s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  56%|#####6    | 1688/3000 [50:36<32:43,  1.50s/it, lr: 1.0e-04 loss: 2.655e-01]
windy_storm:  56%|#####6    | 1688/3000 [50:36<32:43,  1.50s/it, lr: 1.0e-04 loss: 1.339e-01]
windy_storm:  56%|#####6    | 1688/3000 [50:36<32:43,  1.50s/it, lr: 1.0e-04 loss: 1.339e-01]
windy_storm:  56%|#####6    | 1689/3000 [50:36<28:00,  1.28s/it, lr: 1.0e-04 loss: 1.339e-01]
windy_storm:  56%|#####6    | 1689/3000 [50:36<28:00,  1.28s/it, lr: 1.0e-04 loss: 1.339e-01]
windy_storm:  56%|#####6    | 1689/3000 [50:37<28:00,  1.28s/it, lr: 1.0e-04 loss: 4.483e-01]
windy_storm:  56%|#####6    | 1689/3000 [50:37<28:00,  1.28s/it, lr: 1.0e-04 loss: 4.483e-01]
windy_storm:  56%|#####6    | 1690/3000 [50:39<27:59,  1.28s/it, lr: 1.0e-04 loss: 3.878e-01]
windy_storm:  56%|#####6    | 1690/3000 [50:39<27:59,  1.28s/it, lr: 1.0e-04 loss: 3.878e-01]
windy_storm:  56%|#####6    | 1691/3000 [50:39<22:52,  1.05s/it, lr: 1.0e-04 loss: 3.878e-01]
windy_storm:  56%|#####6    | 1691/3000 [50:39<22:52,  1.05s/it, lr: 1.0e-04 loss: 3.878e-01]
windy_storm:  56%|#####6    | 1691/3000 [50:42<22:52,  1.05s/it, lr: 1.0e-04 loss: 2.673e-01]
windy_storm:  56%|#####6    | 1691/3000 [50:42<22:52,  1.05s/it, lr: 1.0e-04 loss: 2.673e-01]
windy_storm:  56%|#####6    | 1692/3000 [50:42<33:24,  1.53s/it, lr: 1.0e-04 loss: 2.673e-01]
windy_storm:  56%|#####6    | 1692/3000 [50:42<33:24,  1.53s/it, lr: 1.0e-04 loss: 2.673e-01]
windy_storm:  56%|#####6    | 1692/3000 [50:43<33:24,  1.53s/it, lr: 1.0e-04 loss: 5.524e-01]
windy_storm:  56%|#####6    | 1692/3000 [50:43<33:24,  1.53s/it, lr: 1.0e-04 loss: 5.524e-01]
windy_storm:  56%|#####6    | 1693/3000 [50:43<31:03,  1.43s/it, lr: 1.0e-04 loss: 5.524e-01]
windy_storm:  56%|#####6    | 1693/3000 [50:43<31:03,  1.43s/it, lr: 1.0e-04 loss: 5.524e-01]
windy_storm:  56%|#####6    | 1693/3000 [50:46<31:03,  1.43s/it, lr: 1.0e-04 loss: 2.782e-01]
windy_storm:  56%|#####6    | 1693/3000 [50:46<31:03,  1.43s/it, lr: 1.0e-04 loss: 2.782e-01]
windy_storm:  56%|#####6    | 1694/3000 [50:46<40:03,  1.84s/it, lr: 1.0e-04 loss: 2.782e-01]
windy_storm:  56%|#####6    | 1694/3000 [50:46<40:03,  1.84s/it, lr: 1.0e-04 loss: 2.782e-01]
windy_storm:  56%|#####6    | 1694/3000 [50:49<40:03,  1.84s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  56%|#####6    | 1694/3000 [50:49<40:03,  1.84s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  56%|#####6    | 1695/3000 [50:49<47:08,  2.17s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  56%|#####6    | 1695/3000 [50:49<47:08,  2.17s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  56%|#####6    | 1695/3000 [50:50<47:08,  2.17s/it, lr: 1.0e-04 loss: 3.128e-01]
windy_storm:  56%|#####6    | 1695/3000 [50:50<47:08,  2.17s/it, lr: 1.0e-04 loss: 3.128e-01]
windy_storm:  57%|#####6    | 1696/3000 [50:50<38:49,  1.79s/it, lr: 1.0e-04 loss: 3.128e-01]
windy_storm:  57%|#####6    | 1696/3000 [50:50<38:49,  1.79s/it, lr: 1.0e-04 loss: 3.128e-01]
windy_storm:  57%|#####6    | 1696/3000 [50:51<38:49,  1.79s/it, lr: 1.0e-04 loss: 2.078e-02]
windy_storm:  57%|#####6    | 1696/3000 [50:51<38:49,  1.79s/it, lr: 1.0e-04 loss: 2.078e-02]
windy_storm:  57%|#####6    | 1697/3000 [50:51<37:37,  1.73s/it, lr: 1.0e-04 loss: 2.078e-02]
windy_storm:  57%|#####6    | 1697/3000 [50:51<37:37,  1.73s/it, lr: 1.0e-04 loss: 2.078e-02]
windy_storm:  57%|#####6    | 1697/3000 [50:54<37:37,  1.73s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:  57%|#####6    | 1697/3000 [50:54<37:37,  1.73s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:  57%|#####6    | 1698/3000 [50:54<45:44,  2.11s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:  57%|#####6    | 1698/3000 [50:54<45:44,  2.11s/it, lr: 1.0e-04 loss: 1.473e-01]
windy_storm:  57%|#####6    | 1698/3000 [50:56<45:44,  2.11s/it, lr: 1.0e-04 loss: 5.418e-01]
windy_storm:  57%|#####6    | 1698/3000 [50:56<45:44,  2.11s/it, lr: 1.0e-04 loss: 5.418e-01]
windy_storm:  57%|#####6    | 1699/3000 [50:56<42:16,  1.95s/it, lr: 1.0e-04 loss: 5.418e-01]
windy_storm:  57%|#####6    | 1699/3000 [50:56<42:16,  1.95s/it, lr: 1.0e-04 loss: 5.418e-01]
windy_storm:  57%|#####6    | 1699/3000 [50:59<42:16,  1.95s/it, lr: 1.0e-04 loss: 4.489e-01]
windy_storm:  57%|#####6    | 1699/3000 [50:59<42:16,  1.95s/it, lr: 1.0e-04 loss: 4.489e-01]
windy_storm:  57%|#####6    | 1700/3000 [51:00<42:14,  1.95s/it, lr: 1.0e-04 loss: 5.817e-01]
windy_storm:  57%|#####6    | 1700/3000 [51:00<42:14,  1.95s/it, lr: 1.0e-04 loss: 5.817e-01]
windy_storm:  57%|#####6    | 1701/3000 [51:00<27:00,  1.25s/it, lr: 1.0e-04 loss: 5.817e-01]
windy_storm:  57%|#####6    | 1701/3000 [51:00<27:00,  1.25s/it, lr: 1.0e-04 loss: 5.817e-01]
windy_storm:  57%|#####6    | 1701/3000 [51:00<27:00,  1.25s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  57%|#####6    | 1701/3000 [51:00<27:00,  1.25s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  57%|#####6    | 1702/3000 [51:00<24:50,  1.15s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  57%|#####6    | 1702/3000 [51:00<24:50,  1.15s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  57%|#####6    | 1702/3000 [51:03<24:50,  1.15s/it, lr: 1.0e-04 loss: 5.849e-02]
windy_storm:  57%|#####6    | 1702/3000 [51:03<24:50,  1.15s/it, lr: 1.0e-04 loss: 5.849e-02]
windy_storm:  57%|#####6    | 1703/3000 [51:03<35:05,  1.62s/it, lr: 1.0e-04 loss: 5.849e-02]
windy_storm:  57%|#####6    | 1703/3000 [51:03<35:05,  1.62s/it, lr: 1.0e-04 loss: 5.849e-02]
windy_storm:  57%|#####6    | 1703/3000 [51:05<35:05,  1.62s/it, lr: 1.0e-04 loss: 4.976e-01]
windy_storm:  57%|#####6    | 1703/3000 [51:05<35:05,  1.62s/it, lr: 1.0e-04 loss: 4.976e-01]
windy_storm:  57%|#####6    | 1704/3000 [51:05<34:51,  1.61s/it, lr: 1.0e-04 loss: 4.976e-01]
windy_storm:  57%|#####6    | 1704/3000 [51:05<34:51,  1.61s/it, lr: 1.0e-04 loss: 4.976e-01]
windy_storm:  57%|#####6    | 1704/3000 [51:08<34:51,  1.61s/it, lr: 1.0e-04 loss: 4.309e-01]
windy_storm:  57%|#####6    | 1704/3000 [51:08<34:51,  1.61s/it, lr: 1.0e-04 loss: 4.309e-01]
windy_storm:  57%|#####6    | 1705/3000 [51:08<43:15,  2.00s/it, lr: 1.0e-04 loss: 4.309e-01]
windy_storm:  57%|#####6    | 1705/3000 [51:08<43:15,  2.00s/it, lr: 1.0e-04 loss: 4.309e-01]
windy_storm:  57%|#####6    | 1705/3000 [51:11<43:15,  2.00s/it, lr: 1.0e-04 loss: 9.015e-02]
windy_storm:  57%|#####6    | 1705/3000 [51:11<43:15,  2.00s/it, lr: 1.0e-04 loss: 9.015e-02]
windy_storm:  57%|#####6    | 1706/3000 [51:11<48:55,  2.27s/it, lr: 1.0e-04 loss: 9.015e-02]
windy_storm:  57%|#####6    | 1706/3000 [51:11<48:55,  2.27s/it, lr: 1.0e-04 loss: 9.015e-02]
windy_storm:  57%|#####6    | 1706/3000 [51:14<48:55,  2.27s/it, lr: 1.0e-04 loss: 2.559e-01]
windy_storm:  57%|#####6    | 1706/3000 [51:14<48:55,  2.27s/it, lr: 1.0e-04 loss: 2.559e-01]
windy_storm:  57%|#####6    | 1707/3000 [51:14<53:55,  2.50s/it, lr: 1.0e-04 loss: 2.559e-01]
windy_storm:  57%|#####6    | 1707/3000 [51:14<53:55,  2.50s/it, lr: 1.0e-04 loss: 2.559e-01]
windy_storm:  57%|#####6    | 1707/3000 [51:15<53:55,  2.50s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  57%|#####6    | 1707/3000 [51:15<53:55,  2.50s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  57%|#####6    | 1708/3000 [51:15<42:55,  1.99s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  57%|#####6    | 1708/3000 [51:15<42:55,  1.99s/it, lr: 1.0e-04 loss: 4.607e-01]
windy_storm:  57%|#####6    | 1708/3000 [51:16<42:55,  1.99s/it, lr: 1.0e-04 loss: 3.923e-01]
windy_storm:  57%|#####6    | 1708/3000 [51:16<42:55,  1.99s/it, lr: 1.0e-04 loss: 3.923e-01]
windy_storm:  57%|#####6    | 1709/3000 [51:16<40:24,  1.88s/it, lr: 1.0e-04 loss: 3.923e-01]
windy_storm:  57%|#####6    | 1709/3000 [51:16<40:24,  1.88s/it, lr: 1.0e-04 loss: 3.923e-01]
windy_storm:  57%|#####6    | 1709/3000 [51:17<40:24,  1.88s/it, lr: 1.0e-04 loss: 5.760e-01]
windy_storm:  57%|#####6    | 1709/3000 [51:17<40:24,  1.88s/it, lr: 1.0e-04 loss: 5.760e-01]
windy_storm:  57%|#####6    | 1710/3000 [51:19<40:22,  1.88s/it, lr: 1.0e-04 loss: 4.843e-01]
windy_storm:  57%|#####6    | 1710/3000 [51:19<40:22,  1.88s/it, lr: 1.0e-04 loss: 4.843e-01]
windy_storm:  57%|#####7    | 1711/3000 [51:19<29:42,  1.38s/it, lr: 1.0e-04 loss: 4.843e-01]
windy_storm:  57%|#####7    | 1711/3000 [51:19<29:42,  1.38s/it, lr: 1.0e-04 loss: 4.843e-01]
windy_storm:  57%|#####7    | 1711/3000 [51:20<29:42,  1.38s/it, lr: 1.0e-04 loss: 6.120e-01]
windy_storm:  57%|#####7    | 1711/3000 [51:20<29:42,  1.38s/it, lr: 1.0e-04 loss: 6.120e-01]
windy_storm:  57%|#####7    | 1712/3000 [51:20<30:47,  1.43s/it, lr: 1.0e-04 loss: 6.120e-01]
windy_storm:  57%|#####7    | 1712/3000 [51:20<30:47,  1.43s/it, lr: 1.0e-04 loss: 6.120e-01]
windy_storm:  57%|#####7    | 1712/3000 [51:22<30:47,  1.43s/it, lr: 1.0e-04 loss: 5.641e-02]
windy_storm:  57%|#####7    | 1712/3000 [51:22<30:47,  1.43s/it, lr: 1.0e-04 loss: 5.641e-02]
windy_storm:  57%|#####7    | 1713/3000 [51:22<31:33,  1.47s/it, lr: 1.0e-04 loss: 5.641e-02]
windy_storm:  57%|#####7    | 1713/3000 [51:22<31:33,  1.47s/it, lr: 1.0e-04 loss: 5.641e-02]
windy_storm:  57%|#####7    | 1713/3000 [51:25<31:33,  1.47s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  57%|#####7    | 1713/3000 [51:25<31:33,  1.47s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  57%|#####7    | 1714/3000 [51:25<40:29,  1.89s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  57%|#####7    | 1714/3000 [51:25<40:29,  1.89s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  57%|#####7    | 1714/3000 [51:27<40:29,  1.89s/it, lr: 1.0e-04 loss: 1.716e-01]
windy_storm:  57%|#####7    | 1714/3000 [51:27<40:29,  1.89s/it, lr: 1.0e-04 loss: 1.716e-01]
windy_storm:  57%|#####7    | 1715/3000 [51:27<38:45,  1.81s/it, lr: 1.0e-04 loss: 1.716e-01]
windy_storm:  57%|#####7    | 1715/3000 [51:27<38:45,  1.81s/it, lr: 1.0e-04 loss: 1.716e-01]
windy_storm:  57%|#####7    | 1715/3000 [51:30<38:45,  1.81s/it, lr: 1.0e-04 loss: 5.199e-01]
windy_storm:  57%|#####7    | 1715/3000 [51:30<38:45,  1.81s/it, lr: 1.0e-04 loss: 5.199e-01]
windy_storm:  57%|#####7    | 1716/3000 [51:30<46:07,  2.16s/it, lr: 1.0e-04 loss: 5.199e-01]
windy_storm:  57%|#####7    | 1716/3000 [51:30<46:07,  2.16s/it, lr: 1.0e-04 loss: 5.199e-01]
windy_storm:  57%|#####7    | 1716/3000 [51:30<46:07,  2.16s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  57%|#####7    | 1716/3000 [51:30<46:07,  2.16s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  57%|#####7    | 1717/3000 [51:30<37:28,  1.75s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  57%|#####7    | 1717/3000 [51:30<37:28,  1.75s/it, lr: 1.0e-04 loss: 6.564e-01]
windy_storm:  57%|#####7    | 1717/3000 [51:31<37:28,  1.75s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  57%|#####7    | 1717/3000 [51:31<37:28,  1.75s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  57%|#####7    | 1718/3000 [51:31<31:43,  1.48s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  57%|#####7    | 1718/3000 [51:31<31:43,  1.48s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  57%|#####7    | 1718/3000 [51:32<31:43,  1.48s/it, lr: 1.0e-04 loss: 4.005e-01]
windy_storm:  57%|#####7    | 1718/3000 [51:32<31:43,  1.48s/it, lr: 1.0e-04 loss: 4.005e-01]
windy_storm:  57%|#####7    | 1719/3000 [51:32<27:09,  1.27s/it, lr: 1.0e-04 loss: 4.005e-01]
windy_storm:  57%|#####7    | 1719/3000 [51:32<27:09,  1.27s/it, lr: 1.0e-04 loss: 4.005e-01]
windy_storm:  57%|#####7    | 1719/3000 [51:35<27:09,  1.27s/it, lr: 1.0e-04 loss: 2.378e-02]
windy_storm:  57%|#####7    | 1719/3000 [51:35<27:09,  1.27s/it, lr: 1.0e-04 loss: 2.378e-02]
windy_storm:  57%|#####7    | 1720/3000 [51:36<27:08,  1.27s/it, lr: 1.0e-04 loss: 5.333e-01]
windy_storm:  57%|#####7    | 1720/3000 [51:36<27:08,  1.27s/it, lr: 1.0e-04 loss: 5.333e-01]
windy_storm:  57%|#####7    | 1721/3000 [51:36<18:43,  1.14it/s, lr: 1.0e-04 loss: 5.333e-01]
windy_storm:  57%|#####7    | 1721/3000 [51:36<18:43,  1.14it/s, lr: 1.0e-04 loss: 5.333e-01]
windy_storm:  57%|#####7    | 1721/3000 [51:39<18:43,  1.14it/s, lr: 1.0e-04 loss: 6.718e-02]
windy_storm:  57%|#####7    | 1721/3000 [51:39<18:43,  1.14it/s, lr: 1.0e-04 loss: 6.718e-02]
windy_storm:  57%|#####7    | 1722/3000 [51:39<29:36,  1.39s/it, lr: 1.0e-04 loss: 6.718e-02]
windy_storm:  57%|#####7    | 1722/3000 [51:39<29:36,  1.39s/it, lr: 1.0e-04 loss: 6.718e-02]
windy_storm:  57%|#####7    | 1722/3000 [51:41<29:36,  1.39s/it, lr: 1.0e-04 loss: 6.071e-01]
windy_storm:  57%|#####7    | 1722/3000 [51:41<29:36,  1.39s/it, lr: 1.0e-04 loss: 6.071e-01]
windy_storm:  57%|#####7    | 1723/3000 [51:41<30:48,  1.45s/it, lr: 1.0e-04 loss: 6.071e-01]
windy_storm:  57%|#####7    | 1723/3000 [51:41<30:48,  1.45s/it, lr: 1.0e-04 loss: 6.071e-01]
windy_storm:  57%|#####7    | 1723/3000 [51:41<30:48,  1.45s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  57%|#####7    | 1723/3000 [51:41<30:48,  1.45s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  57%|#####7    | 1724/3000 [51:41<26:56,  1.27s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  57%|#####7    | 1724/3000 [51:41<26:56,  1.27s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  57%|#####7    | 1724/3000 [51:42<26:56,  1.27s/it, lr: 1.0e-04 loss: 4.912e-01]
windy_storm:  57%|#####7    | 1724/3000 [51:42<26:56,  1.27s/it, lr: 1.0e-04 loss: 4.912e-01]
windy_storm:  57%|#####7    | 1725/3000 [51:42<24:20,  1.15s/it, lr: 1.0e-04 loss: 4.912e-01]
windy_storm:  57%|#####7    | 1725/3000 [51:42<24:20,  1.15s/it, lr: 1.0e-04 loss: 4.912e-01]
windy_storm:  57%|#####7    | 1725/3000 [51:44<24:20,  1.15s/it, lr: 1.0e-04 loss: 3.798e-01]
windy_storm:  57%|#####7    | 1725/3000 [51:44<24:20,  1.15s/it, lr: 1.0e-04 loss: 3.798e-01]
windy_storm:  58%|#####7    | 1726/3000 [51:44<27:00,  1.27s/it, lr: 1.0e-04 loss: 3.798e-01]
windy_storm:  58%|#####7    | 1726/3000 [51:44<27:00,  1.27s/it, lr: 1.0e-04 loss: 3.798e-01]
windy_storm:  58%|#####7    | 1726/3000 [51:45<27:00,  1.27s/it, lr: 1.0e-04 loss: 5.363e-01]
windy_storm:  58%|#####7    | 1726/3000 [51:45<27:00,  1.27s/it, lr: 1.0e-04 loss: 5.363e-01]
windy_storm:  58%|#####7    | 1727/3000 [51:45<29:00,  1.37s/it, lr: 1.0e-04 loss: 5.363e-01]
windy_storm:  58%|#####7    | 1727/3000 [51:45<29:00,  1.37s/it, lr: 1.0e-04 loss: 5.363e-01]
windy_storm:  58%|#####7    | 1727/3000 [51:48<29:00,  1.37s/it, lr: 1.0e-04 loss: 4.024e-01]
windy_storm:  58%|#####7    | 1727/3000 [51:48<29:00,  1.37s/it, lr: 1.0e-04 loss: 4.024e-01]
windy_storm:  58%|#####7    | 1728/3000 [51:48<38:54,  1.84s/it, lr: 1.0e-04 loss: 4.024e-01]
windy_storm:  58%|#####7    | 1728/3000 [51:48<38:54,  1.84s/it, lr: 1.0e-04 loss: 4.024e-01]
windy_storm:  58%|#####7    | 1728/3000 [51:49<38:54,  1.84s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  58%|#####7    | 1728/3000 [51:49<38:54,  1.84s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  58%|#####7    | 1729/3000 [51:49<32:34,  1.54s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  58%|#####7    | 1729/3000 [51:49<32:34,  1.54s/it, lr: 1.0e-04 loss: 1.023e-01]
windy_storm:  58%|#####7    | 1729/3000 [51:50<32:34,  1.54s/it, lr: 1.0e-04 loss: 9.479e-03]
windy_storm:  58%|#####7    | 1729/3000 [51:50<32:34,  1.54s/it, lr: 1.0e-04 loss: 9.479e-03]
windy_storm:  58%|#####7    | 1730/3000 [51:52<32:33,  1.54s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  58%|#####7    | 1730/3000 [51:52<32:33,  1.54s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  58%|#####7    | 1731/3000 [51:52<25:19,  1.20s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  58%|#####7    | 1731/3000 [51:52<25:19,  1.20s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  58%|#####7    | 1731/3000 [51:53<25:19,  1.20s/it, lr: 1.0e-04 loss: 1.067e-01]
windy_storm:  58%|#####7    | 1731/3000 [51:53<25:19,  1.20s/it, lr: 1.0e-04 loss: 1.067e-01]
windy_storm:  58%|#####7    | 1732/3000 [51:53<27:25,  1.30s/it, lr: 1.0e-04 loss: 1.067e-01]
windy_storm:  58%|#####7    | 1732/3000 [51:53<27:25,  1.30s/it, lr: 1.0e-04 loss: 1.067e-01]
windy_storm:  58%|#####7    | 1732/3000 [51:55<27:25,  1.30s/it, lr: 1.0e-04 loss: 4.246e-02]
windy_storm:  58%|#####7    | 1732/3000 [51:55<27:25,  1.30s/it, lr: 1.0e-04 loss: 4.246e-02]
windy_storm:  58%|#####7    | 1733/3000 [51:55<29:49,  1.41s/it, lr: 1.0e-04 loss: 4.246e-02]
windy_storm:  58%|#####7    | 1733/3000 [51:55<29:49,  1.41s/it, lr: 1.0e-04 loss: 4.246e-02]
windy_storm:  58%|#####7    | 1733/3000 [51:56<29:49,  1.41s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  58%|#####7    | 1733/3000 [51:56<29:49,  1.41s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  58%|#####7    | 1734/3000 [51:56<26:08,  1.24s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  58%|#####7    | 1734/3000 [51:56<26:08,  1.24s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  58%|#####7    | 1734/3000 [51:57<26:08,  1.24s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  58%|#####7    | 1734/3000 [51:57<26:08,  1.24s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  58%|#####7    | 1735/3000 [51:57<28:03,  1.33s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  58%|#####7    | 1735/3000 [51:57<28:03,  1.33s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  58%|#####7    | 1735/3000 [52:00<28:03,  1.33s/it, lr: 1.0e-04 loss: 3.650e-02]
windy_storm:  58%|#####7    | 1735/3000 [52:00<28:03,  1.33s/it, lr: 1.0e-04 loss: 3.650e-02]
windy_storm:  58%|#####7    | 1736/3000 [52:00<37:42,  1.79s/it, lr: 1.0e-04 loss: 3.650e-02]
windy_storm:  58%|#####7    | 1736/3000 [52:00<37:42,  1.79s/it, lr: 1.0e-04 loss: 3.650e-02]
windy_storm:  58%|#####7    | 1736/3000 [52:02<37:42,  1.79s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:  58%|#####7    | 1736/3000 [52:02<37:42,  1.79s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:  58%|#####7    | 1737/3000 [52:02<36:09,  1.72s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:  58%|#####7    | 1737/3000 [52:02<36:09,  1.72s/it, lr: 1.0e-04 loss: 6.340e-01]
windy_storm:  58%|#####7    | 1737/3000 [52:05<36:09,  1.72s/it, lr: 1.0e-04 loss: 6.422e-01]
windy_storm:  58%|#####7    | 1737/3000 [52:05<36:09,  1.72s/it, lr: 1.0e-04 loss: 6.422e-01]
windy_storm:  58%|#####7    | 1738/3000 [52:05<43:32,  2.07s/it, lr: 1.0e-04 loss: 6.422e-01]
windy_storm:  58%|#####7    | 1738/3000 [52:05<43:32,  2.07s/it, lr: 1.0e-04 loss: 6.422e-01]
windy_storm:  58%|#####7    | 1738/3000 [52:05<43:32,  2.07s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  58%|#####7    | 1738/3000 [52:05<43:32,  2.07s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  58%|#####7    | 1739/3000 [52:05<35:29,  1.69s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  58%|#####7    | 1739/3000 [52:05<35:29,  1.69s/it, lr: 1.0e-04 loss: 4.564e-01]
windy_storm:  58%|#####7    | 1739/3000 [52:07<35:29,  1.69s/it, lr: 1.0e-04 loss: 4.349e-02]
windy_storm:  58%|#####7    | 1739/3000 [52:07<35:29,  1.69s/it, lr: 1.0e-04 loss: 4.349e-02]
windy_storm:  58%|#####8    | 1740/3000 [52:08<35:27,  1.69s/it, lr: 1.0e-04 loss: 1.386e-01]
windy_storm:  58%|#####8    | 1740/3000 [52:08<35:27,  1.69s/it, lr: 1.0e-04 loss: 1.386e-01]
windy_storm:  58%|#####8    | 1741/3000 [52:08<22:53,  1.09s/it, lr: 1.0e-04 loss: 1.386e-01]
windy_storm:  58%|#####8    | 1741/3000 [52:08<22:53,  1.09s/it, lr: 1.0e-04 loss: 1.386e-01]
windy_storm:  58%|#####8    | 1741/3000 [52:09<22:53,  1.09s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  58%|#####8    | 1741/3000 [52:09<22:53,  1.09s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  58%|#####8    | 1742/3000 [52:09<21:31,  1.03s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  58%|#####8    | 1742/3000 [52:09<21:31,  1.03s/it, lr: 1.0e-04 loss: 1.104e-01]
windy_storm:  58%|#####8    | 1742/3000 [52:12<21:31,  1.03s/it, lr: 1.0e-04 loss: 1.563e-01]
windy_storm:  58%|#####8    | 1742/3000 [52:12<21:31,  1.03s/it, lr: 1.0e-04 loss: 1.563e-01]
windy_storm:  58%|#####8    | 1743/3000 [52:12<32:13,  1.54s/it, lr: 1.0e-04 loss: 1.563e-01]
windy_storm:  58%|#####8    | 1743/3000 [52:12<32:13,  1.54s/it, lr: 1.0e-04 loss: 1.563e-01]
windy_storm:  58%|#####8    | 1743/3000 [52:13<32:13,  1.54s/it, lr: 1.0e-04 loss: 2.388e-01]
windy_storm:  58%|#####8    | 1743/3000 [52:13<32:13,  1.54s/it, lr: 1.0e-04 loss: 2.388e-01]
windy_storm:  58%|#####8    | 1744/3000 [52:13<32:39,  1.56s/it, lr: 1.0e-04 loss: 2.388e-01]
windy_storm:  58%|#####8    | 1744/3000 [52:13<32:39,  1.56s/it, lr: 1.0e-04 loss: 2.388e-01]
windy_storm:  58%|#####8    | 1744/3000 [52:16<32:39,  1.56s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  58%|#####8    | 1744/3000 [52:16<32:39,  1.56s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  58%|#####8    | 1745/3000 [52:16<40:31,  1.94s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  58%|#####8    | 1745/3000 [52:16<40:31,  1.94s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  58%|#####8    | 1745/3000 [52:19<40:31,  1.94s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  58%|#####8    | 1745/3000 [52:19<40:31,  1.94s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  58%|#####8    | 1746/3000 [52:19<46:40,  2.23s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  58%|#####8    | 1746/3000 [52:19<46:40,  2.23s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  58%|#####8    | 1746/3000 [52:21<46:40,  2.23s/it, lr: 1.0e-04 loss: 4.590e-01]
windy_storm:  58%|#####8    | 1746/3000 [52:21<46:40,  2.23s/it, lr: 1.0e-04 loss: 4.590e-01]
windy_storm:  58%|#####8    | 1747/3000 [52:21<42:27,  2.03s/it, lr: 1.0e-04 loss: 4.590e-01]
windy_storm:  58%|#####8    | 1747/3000 [52:21<42:27,  2.03s/it, lr: 1.0e-04 loss: 4.590e-01]
windy_storm:  58%|#####8    | 1747/3000 [52:22<42:27,  2.03s/it, lr: 1.0e-04 loss: 6.849e-01]
windy_storm:  58%|#####8    | 1747/3000 [52:22<42:27,  2.03s/it, lr: 1.0e-04 loss: 6.849e-01]
windy_storm:  58%|#####8    | 1748/3000 [52:22<40:32,  1.94s/it, lr: 1.0e-04 loss: 6.849e-01]
windy_storm:  58%|#####8    | 1748/3000 [52:22<40:32,  1.94s/it, lr: 1.0e-04 loss: 6.849e-01]
windy_storm:  58%|#####8    | 1748/3000 [52:25<40:32,  1.94s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:  58%|#####8    | 1748/3000 [52:25<40:32,  1.94s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:  58%|#####8    | 1749/3000 [52:25<46:48,  2.24s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:  58%|#####8    | 1749/3000 [52:25<46:48,  2.24s/it, lr: 1.0e-04 loss: 1.632e-01]
windy_storm:  58%|#####8    | 1749/3000 [52:28<46:48,  2.24s/it, lr: 1.0e-04 loss: 4.882e-01]
windy_storm:  58%|#####8    | 1749/3000 [52:28<46:48,  2.24s/it, lr: 1.0e-04 loss: 4.882e-01]
Saving at step 1750
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000001750.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000000750.safetensors

windy_storm:  58%|#####8    | 1750/3000 [52:30<46:46,  2.24s/it, lr: 1.0e-04 loss: 4.984e-01]
windy_storm:  58%|#####8    | 1750/3000 [52:30<46:46,  2.24s/it, lr: 1.0e-04 loss: 4.984e-01]
windy_storm:  58%|#####8    | 1751/3000 [52:30<34:00,  1.63s/it, lr: 1.0e-04 loss: 4.984e-01]
windy_storm:  58%|#####8    | 1751/3000 [52:30<34:00,  1.63s/it, lr: 1.0e-04 loss: 4.984e-01]
windy_storm:  58%|#####8    | 1751/3000 [52:33<34:00,  1.63s/it, lr: 1.0e-04 loss: 1.619e-01]
windy_storm:  58%|#####8    | 1751/3000 [52:33<34:00,  1.63s/it, lr: 1.0e-04 loss: 1.619e-01]
windy_storm:  58%|#####8    | 1752/3000 [52:33<40:34,  1.95s/it, lr: 1.0e-04 loss: 1.619e-01]
windy_storm:  58%|#####8    | 1752/3000 [52:33<40:34,  1.95s/it, lr: 1.0e-04 loss: 1.619e-01]
windy_storm:  58%|#####8    | 1752/3000 [52:34<40:34,  1.95s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  58%|#####8    | 1752/3000 [52:34<40:34,  1.95s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  58%|#####8    | 1753/3000 [52:35<38:21,  1.85s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  58%|#####8    | 1753/3000 [52:35<38:21,  1.85s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  58%|#####8    | 1753/3000 [52:36<38:21,  1.85s/it, lr: 1.0e-04 loss: 6.237e-01]
windy_storm:  58%|#####8    | 1753/3000 [52:36<38:21,  1.85s/it, lr: 1.0e-04 loss: 6.237e-01]
windy_storm:  58%|#####8    | 1754/3000 [52:36<36:36,  1.76s/it, lr: 1.0e-04 loss: 6.237e-01]
windy_storm:  58%|#####8    | 1754/3000 [52:36<36:36,  1.76s/it, lr: 1.0e-04 loss: 6.237e-01]
windy_storm:  58%|#####8    | 1754/3000 [52:37<36:36,  1.76s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  58%|#####8    | 1754/3000 [52:37<36:36,  1.76s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  58%|#####8    | 1755/3000 [52:37<31:11,  1.50s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  58%|#####8    | 1755/3000 [52:37<31:11,  1.50s/it, lr: 1.0e-04 loss: 3.804e-01]
windy_storm:  58%|#####8    | 1755/3000 [52:38<31:11,  1.50s/it, lr: 1.0e-04 loss: 3.259e-01]
windy_storm:  58%|#####8    | 1755/3000 [52:38<31:11,  1.50s/it, lr: 1.0e-04 loss: 3.259e-01]
windy_storm:  59%|#####8    | 1756/3000 [52:38<26:45,  1.29s/it, lr: 1.0e-04 loss: 3.259e-01]
windy_storm:  59%|#####8    | 1756/3000 [52:38<26:45,  1.29s/it, lr: 1.0e-04 loss: 3.259e-01]
windy_storm:  59%|#####8    | 1756/3000 [52:38<26:45,  1.29s/it, lr: 1.0e-04 loss: 8.527e-02]
windy_storm:  59%|#####8    | 1756/3000 [52:38<26:45,  1.29s/it, lr: 1.0e-04 loss: 8.527e-02]
windy_storm:  59%|#####8    | 1757/3000 [52:38<23:36,  1.14s/it, lr: 1.0e-04 loss: 8.527e-02]
windy_storm:  59%|#####8    | 1757/3000 [52:38<23:36,  1.14s/it, lr: 1.0e-04 loss: 8.527e-02]
windy_storm:  59%|#####8    | 1757/3000 [52:41<23:36,  1.14s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  59%|#####8    | 1757/3000 [52:41<23:36,  1.14s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  59%|#####8    | 1758/3000 [52:41<34:42,  1.68s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  59%|#####8    | 1758/3000 [52:41<34:42,  1.68s/it, lr: 1.0e-04 loss: 7.106e-01]
windy_storm:  59%|#####8    | 1758/3000 [52:43<34:42,  1.68s/it, lr: 1.0e-04 loss: 4.489e-01]
windy_storm:  59%|#####8    | 1758/3000 [52:43<34:42,  1.68s/it, lr: 1.0e-04 loss: 4.489e-01]
windy_storm:  59%|#####8    | 1759/3000 [52:43<34:04,  1.65s/it, lr: 1.0e-04 loss: 4.489e-01]
windy_storm:  59%|#####8    | 1759/3000 [52:43<34:04,  1.65s/it, lr: 1.0e-04 loss: 4.489e-01]
windy_storm:  59%|#####8    | 1759/3000 [52:44<34:04,  1.65s/it, lr: 1.0e-04 loss: 2.102e-01]
windy_storm:  59%|#####8    | 1759/3000 [52:44<34:04,  1.65s/it, lr: 1.0e-04 loss: 2.102e-01]
windy_storm:  59%|#####8    | 1760/3000 [52:47<34:02,  1.65s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  59%|#####8    | 1760/3000 [52:47<34:02,  1.65s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  59%|#####8    | 1761/3000 [52:47<32:32,  1.58s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  59%|#####8    | 1761/3000 [52:47<32:32,  1.58s/it, lr: 1.0e-04 loss: 7.120e-02]
windy_storm:  59%|#####8    | 1761/3000 [52:50<32:32,  1.58s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  59%|#####8    | 1761/3000 [52:50<32:32,  1.58s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  59%|#####8    | 1762/3000 [52:50<39:35,  1.92s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  59%|#####8    | 1762/3000 [52:50<39:35,  1.92s/it, lr: 1.0e-04 loss: 3.501e-01]
windy_storm:  59%|#####8    | 1762/3000 [52:53<39:35,  1.92s/it, lr: 1.0e-04 loss: 4.332e-01]
windy_storm:  59%|#####8    | 1762/3000 [52:53<39:35,  1.92s/it, lr: 1.0e-04 loss: 4.332e-01]
windy_storm:  59%|#####8    | 1763/3000 [52:53<45:45,  2.22s/it, lr: 1.0e-04 loss: 4.332e-01]
windy_storm:  59%|#####8    | 1763/3000 [52:53<45:45,  2.22s/it, lr: 1.0e-04 loss: 4.332e-01]
windy_storm:  59%|#####8    | 1763/3000 [52:56<45:45,  2.22s/it, lr: 1.0e-04 loss: 3.161e-01]
windy_storm:  59%|#####8    | 1763/3000 [52:56<45:45,  2.22s/it, lr: 1.0e-04 loss: 3.161e-01]
windy_storm:  59%|#####8    | 1764/3000 [52:56<49:57,  2.43s/it, lr: 1.0e-04 loss: 3.161e-01]
windy_storm:  59%|#####8    | 1764/3000 [52:56<49:57,  2.43s/it, lr: 1.0e-04 loss: 3.161e-01]
windy_storm:  59%|#####8    | 1764/3000 [52:59<49:57,  2.43s/it, lr: 1.0e-04 loss: 1.590e-01]
windy_storm:  59%|#####8    | 1764/3000 [52:59<49:57,  2.43s/it, lr: 1.0e-04 loss: 1.590e-01]
windy_storm:  59%|#####8    | 1765/3000 [52:59<52:33,  2.55s/it, lr: 1.0e-04 loss: 1.590e-01]
windy_storm:  59%|#####8    | 1765/3000 [52:59<52:33,  2.55s/it, lr: 1.0e-04 loss: 1.590e-01]
windy_storm:  59%|#####8    | 1765/3000 [53:02<52:33,  2.55s/it, lr: 1.0e-04 loss: 2.524e-01]
windy_storm:  59%|#####8    | 1765/3000 [53:02<52:33,  2.55s/it, lr: 1.0e-04 loss: 2.524e-01]
windy_storm:  59%|#####8    | 1766/3000 [53:02<54:58,  2.67s/it, lr: 1.0e-04 loss: 2.524e-01]
windy_storm:  59%|#####8    | 1766/3000 [53:02<54:58,  2.67s/it, lr: 1.0e-04 loss: 2.524e-01]
windy_storm:  59%|#####8    | 1766/3000 [53:02<54:58,  2.67s/it, lr: 1.0e-04 loss: 1.392e-01]
windy_storm:  59%|#####8    | 1766/3000 [53:02<54:58,  2.67s/it, lr: 1.0e-04 loss: 1.392e-01]
windy_storm:  59%|#####8    | 1767/3000 [53:02<43:33,  2.12s/it, lr: 1.0e-04 loss: 1.392e-01]
windy_storm:  59%|#####8    | 1767/3000 [53:02<43:33,  2.12s/it, lr: 1.0e-04 loss: 1.392e-01]
windy_storm:  59%|#####8    | 1767/3000 [53:05<43:33,  2.12s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  59%|#####8    | 1767/3000 [53:05<43:33,  2.12s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  59%|#####8    | 1768/3000 [53:05<48:08,  2.34s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  59%|#####8    | 1768/3000 [53:05<48:08,  2.34s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  59%|#####8    | 1768/3000 [53:08<48:08,  2.34s/it, lr: 1.0e-04 loss: 2.792e-01]
windy_storm:  59%|#####8    | 1768/3000 [53:08<48:08,  2.34s/it, lr: 1.0e-04 loss: 2.792e-01]
windy_storm:  59%|#####8    | 1769/3000 [53:08<51:33,  2.51s/it, lr: 1.0e-04 loss: 2.792e-01]
windy_storm:  59%|#####8    | 1769/3000 [53:08<51:33,  2.51s/it, lr: 1.0e-04 loss: 2.792e-01]
windy_storm:  59%|#####8    | 1769/3000 [53:10<51:33,  2.51s/it, lr: 1.0e-04 loss: 1.846e-01]
windy_storm:  59%|#####8    | 1769/3000 [53:10<51:33,  2.51s/it, lr: 1.0e-04 loss: 1.846e-01]
windy_storm:  59%|#####8    | 1770/3000 [53:11<51:31,  2.51s/it, lr: 1.0e-04 loss: 2.258e-01]
windy_storm:  59%|#####8    | 1770/3000 [53:11<51:31,  2.51s/it, lr: 1.0e-04 loss: 2.258e-01]
windy_storm:  59%|#####9    | 1771/3000 [53:11<35:13,  1.72s/it, lr: 1.0e-04 loss: 2.258e-01]
windy_storm:  59%|#####9    | 1771/3000 [53:11<35:13,  1.72s/it, lr: 1.0e-04 loss: 2.258e-01]
windy_storm:  59%|#####9    | 1771/3000 [53:12<35:13,  1.72s/it, lr: 1.0e-04 loss: 1.111e-01]
windy_storm:  59%|#####9    | 1771/3000 [53:12<35:13,  1.72s/it, lr: 1.0e-04 loss: 1.111e-01]
windy_storm:  59%|#####9    | 1772/3000 [53:12<30:18,  1.48s/it, lr: 1.0e-04 loss: 1.111e-01]
windy_storm:  59%|#####9    | 1772/3000 [53:12<30:18,  1.48s/it, lr: 1.0e-04 loss: 1.111e-01]
windy_storm:  59%|#####9    | 1772/3000 [53:13<30:18,  1.48s/it, lr: 1.0e-04 loss: 3.134e-01]
windy_storm:  59%|#####9    | 1772/3000 [53:13<30:18,  1.48s/it, lr: 1.0e-04 loss: 3.134e-01]
windy_storm:  59%|#####9    | 1773/3000 [53:13<30:33,  1.49s/it, lr: 1.0e-04 loss: 3.134e-01]
windy_storm:  59%|#####9    | 1773/3000 [53:13<30:33,  1.49s/it, lr: 1.0e-04 loss: 3.134e-01]
windy_storm:  59%|#####9    | 1773/3000 [53:14<30:33,  1.49s/it, lr: 1.0e-04 loss: 5.417e-01]
windy_storm:  59%|#####9    | 1773/3000 [53:14<30:33,  1.49s/it, lr: 1.0e-04 loss: 5.417e-01]
windy_storm:  59%|#####9    | 1774/3000 [53:14<26:43,  1.31s/it, lr: 1.0e-04 loss: 5.417e-01]
windy_storm:  59%|#####9    | 1774/3000 [53:14<26:43,  1.31s/it, lr: 1.0e-04 loss: 5.417e-01]
windy_storm:  59%|#####9    | 1774/3000 [53:16<26:43,  1.31s/it, lr: 1.0e-04 loss: 6.002e-01]
windy_storm:  59%|#####9    | 1774/3000 [53:16<26:43,  1.31s/it, lr: 1.0e-04 loss: 6.002e-01]
windy_storm:  59%|#####9    | 1775/3000 [53:16<28:13,  1.38s/it, lr: 1.0e-04 loss: 6.002e-01]
windy_storm:  59%|#####9    | 1775/3000 [53:16<28:13,  1.38s/it, lr: 1.0e-04 loss: 6.002e-01]
windy_storm:  59%|#####9    | 1775/3000 [53:17<28:13,  1.38s/it, lr: 1.0e-04 loss: 4.925e-01]
windy_storm:  59%|#####9    | 1775/3000 [53:17<28:13,  1.38s/it, lr: 1.0e-04 loss: 4.925e-01]
windy_storm:  59%|#####9    | 1776/3000 [53:17<29:16,  1.43s/it, lr: 1.0e-04 loss: 4.925e-01]
windy_storm:  59%|#####9    | 1776/3000 [53:17<29:16,  1.43s/it, lr: 1.0e-04 loss: 4.925e-01]
windy_storm:  59%|#####9    | 1776/3000 [53:18<29:16,  1.43s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  59%|#####9    | 1776/3000 [53:18<29:16,  1.43s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  59%|#####9    | 1777/3000 [53:18<25:12,  1.24s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  59%|#####9    | 1777/3000 [53:18<25:12,  1.24s/it, lr: 1.0e-04 loss: 2.454e-01]
windy_storm:  59%|#####9    | 1777/3000 [53:19<25:12,  1.24s/it, lr: 1.0e-04 loss: 1.054e-01]
windy_storm:  59%|#####9    | 1777/3000 [53:19<25:12,  1.24s/it, lr: 1.0e-04 loss: 1.054e-01]
windy_storm:  59%|#####9    | 1778/3000 [53:19<24:00,  1.18s/it, lr: 1.0e-04 loss: 1.054e-01]
windy_storm:  59%|#####9    | 1778/3000 [53:19<24:00,  1.18s/it, lr: 1.0e-04 loss: 1.054e-01]
windy_storm:  59%|#####9    | 1778/3000 [53:21<24:00,  1.18s/it, lr: 1.0e-04 loss: 4.376e-01]
windy_storm:  59%|#####9    | 1778/3000 [53:21<24:00,  1.18s/it, lr: 1.0e-04 loss: 4.376e-01]
windy_storm:  59%|#####9    | 1779/3000 [53:21<26:18,  1.29s/it, lr: 1.0e-04 loss: 4.376e-01]
windy_storm:  59%|#####9    | 1779/3000 [53:21<26:18,  1.29s/it, lr: 1.0e-04 loss: 4.376e-01]
windy_storm:  59%|#####9    | 1779/3000 [53:22<26:18,  1.29s/it, lr: 1.0e-04 loss: 1.856e-01]
windy_storm:  59%|#####9    | 1779/3000 [53:22<26:18,  1.29s/it, lr: 1.0e-04 loss: 1.856e-01]
windy_storm:  59%|#####9    | 1780/3000 [53:23<26:16,  1.29s/it, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  59%|#####9    | 1780/3000 [53:23<26:16,  1.29s/it, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  59%|#####9    | 1781/3000 [53:23<17:43,  1.15it/s, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  59%|#####9    | 1781/3000 [53:23<17:43,  1.15it/s, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  59%|#####9    | 1781/3000 [53:24<17:43,  1.15it/s, lr: 1.0e-04 loss: 3.023e-01]
windy_storm:  59%|#####9    | 1781/3000 [53:24<17:43,  1.15it/s, lr: 1.0e-04 loss: 3.023e-01]
windy_storm:  59%|#####9    | 1782/3000 [53:24<17:22,  1.17it/s, lr: 1.0e-04 loss: 3.023e-01]
windy_storm:  59%|#####9    | 1782/3000 [53:24<17:22,  1.17it/s, lr: 1.0e-04 loss: 3.023e-01]
windy_storm:  59%|#####9    | 1782/3000 [53:25<17:22,  1.17it/s, lr: 1.0e-04 loss: 5.064e-01]
windy_storm:  59%|#####9    | 1782/3000 [53:25<17:22,  1.17it/s, lr: 1.0e-04 loss: 5.064e-01]
windy_storm:  59%|#####9    | 1783/3000 [53:25<21:05,  1.04s/it, lr: 1.0e-04 loss: 5.064e-01]
windy_storm:  59%|#####9    | 1783/3000 [53:25<21:05,  1.04s/it, lr: 1.0e-04 loss: 5.064e-01]
windy_storm:  59%|#####9    | 1783/3000 [53:28<21:05,  1.04s/it, lr: 1.0e-04 loss: 6.614e-01]
windy_storm:  59%|#####9    | 1783/3000 [53:28<21:05,  1.04s/it, lr: 1.0e-04 loss: 6.614e-01]
windy_storm:  59%|#####9    | 1784/3000 [53:28<31:22,  1.55s/it, lr: 1.0e-04 loss: 6.614e-01]
windy_storm:  59%|#####9    | 1784/3000 [53:28<31:22,  1.55s/it, lr: 1.0e-04 loss: 6.614e-01]
windy_storm:  59%|#####9    | 1784/3000 [53:30<31:22,  1.55s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  59%|#####9    | 1784/3000 [53:30<31:22,  1.55s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  60%|#####9    | 1785/3000 [53:30<31:27,  1.55s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  60%|#####9    | 1785/3000 [53:30<31:27,  1.55s/it, lr: 1.0e-04 loss: 5.487e-01]
windy_storm:  60%|#####9    | 1785/3000 [53:31<31:27,  1.55s/it, lr: 1.0e-04 loss: 3.447e-01]
windy_storm:  60%|#####9    | 1785/3000 [53:31<31:27,  1.55s/it, lr: 1.0e-04 loss: 3.447e-01]
windy_storm:  60%|#####9    | 1786/3000 [53:31<26:47,  1.32s/it, lr: 1.0e-04 loss: 3.447e-01]
windy_storm:  60%|#####9    | 1786/3000 [53:31<26:47,  1.32s/it, lr: 1.0e-04 loss: 3.447e-01]
windy_storm:  60%|#####9    | 1786/3000 [53:32<26:47,  1.32s/it, lr: 1.0e-04 loss: 6.105e-01]
windy_storm:  60%|#####9    | 1786/3000 [53:32<26:47,  1.32s/it, lr: 1.0e-04 loss: 6.105e-01]
windy_storm:  60%|#####9    | 1787/3000 [53:32<23:46,  1.18s/it, lr: 1.0e-04 loss: 6.105e-01]
windy_storm:  60%|#####9    | 1787/3000 [53:32<23:46,  1.18s/it, lr: 1.0e-04 loss: 6.105e-01]
windy_storm:  60%|#####9    | 1787/3000 [53:32<23:46,  1.18s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  60%|#####9    | 1787/3000 [53:32<23:46,  1.18s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  60%|#####9    | 1788/3000 [53:32<21:19,  1.06s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  60%|#####9    | 1788/3000 [53:32<21:19,  1.06s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  60%|#####9    | 1788/3000 [53:35<21:19,  1.06s/it, lr: 1.0e-04 loss: 5.788e-01]
windy_storm:  60%|#####9    | 1788/3000 [53:35<21:19,  1.06s/it, lr: 1.0e-04 loss: 5.788e-01]
windy_storm:  60%|#####9    | 1789/3000 [53:35<32:40,  1.62s/it, lr: 1.0e-04 loss: 5.788e-01]
windy_storm:  60%|#####9    | 1789/3000 [53:35<32:40,  1.62s/it, lr: 1.0e-04 loss: 5.788e-01]
windy_storm:  60%|#####9    | 1789/3000 [53:38<32:40,  1.62s/it, lr: 1.0e-04 loss: 8.129e-02]
windy_storm:  60%|#####9    | 1789/3000 [53:38<32:40,  1.62s/it, lr: 1.0e-04 loss: 8.129e-02]
windy_storm:  60%|#####9    | 1790/3000 [53:39<32:38,  1.62s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  60%|#####9    | 1790/3000 [53:39<32:38,  1.62s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  60%|#####9    | 1791/3000 [53:39<21:27,  1.07s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  60%|#####9    | 1791/3000 [53:39<21:27,  1.07s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  60%|#####9    | 1791/3000 [53:41<21:27,  1.07s/it, lr: 1.0e-04 loss: 6.203e-01]
windy_storm:  60%|#####9    | 1791/3000 [53:41<21:27,  1.07s/it, lr: 1.0e-04 loss: 6.203e-01]
windy_storm:  60%|#####9    | 1792/3000 [53:41<25:01,  1.24s/it, lr: 1.0e-04 loss: 6.203e-01]
windy_storm:  60%|#####9    | 1792/3000 [53:41<25:01,  1.24s/it, lr: 1.0e-04 loss: 6.203e-01]
windy_storm:  60%|#####9    | 1792/3000 [53:42<25:01,  1.24s/it, lr: 1.0e-04 loss: 4.350e-01]
windy_storm:  60%|#####9    | 1792/3000 [53:42<25:01,  1.24s/it, lr: 1.0e-04 loss: 4.350e-01]
windy_storm:  60%|#####9    | 1793/3000 [53:42<26:47,  1.33s/it, lr: 1.0e-04 loss: 4.350e-01]
windy_storm:  60%|#####9    | 1793/3000 [53:42<26:47,  1.33s/it, lr: 1.0e-04 loss: 4.350e-01]
windy_storm:  60%|#####9    | 1793/3000 [53:44<26:47,  1.33s/it, lr: 1.0e-04 loss: 3.921e-02]
windy_storm:  60%|#####9    | 1793/3000 [53:44<26:47,  1.33s/it, lr: 1.0e-04 loss: 3.921e-02]
windy_storm:  60%|#####9    | 1794/3000 [53:44<28:04,  1.40s/it, lr: 1.0e-04 loss: 3.921e-02]
windy_storm:  60%|#####9    | 1794/3000 [53:44<28:04,  1.40s/it, lr: 1.0e-04 loss: 3.921e-02]
windy_storm:  60%|#####9    | 1794/3000 [53:45<28:04,  1.40s/it, lr: 1.0e-04 loss: 6.233e-01]
windy_storm:  60%|#####9    | 1794/3000 [53:45<28:04,  1.40s/it, lr: 1.0e-04 loss: 6.233e-01]
windy_storm:  60%|#####9    | 1795/3000 [53:45<29:03,  1.45s/it, lr: 1.0e-04 loss: 6.233e-01]
windy_storm:  60%|#####9    | 1795/3000 [53:45<29:03,  1.45s/it, lr: 1.0e-04 loss: 6.233e-01]
windy_storm:  60%|#####9    | 1795/3000 [53:48<29:03,  1.45s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  60%|#####9    | 1795/3000 [53:48<29:03,  1.45s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  60%|#####9    | 1796/3000 [53:48<37:26,  1.87s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  60%|#####9    | 1796/3000 [53:48<37:26,  1.87s/it, lr: 1.0e-04 loss: 3.825e-01]
windy_storm:  60%|#####9    | 1796/3000 [53:51<37:26,  1.87s/it, lr: 1.0e-04 loss: 1.135e-01]
windy_storm:  60%|#####9    | 1796/3000 [53:51<37:26,  1.87s/it, lr: 1.0e-04 loss: 1.135e-01]
windy_storm:  60%|#####9    | 1797/3000 [53:51<43:52,  2.19s/it, lr: 1.0e-04 loss: 1.135e-01]
windy_storm:  60%|#####9    | 1797/3000 [53:51<43:52,  2.19s/it, lr: 1.0e-04 loss: 1.135e-01]
windy_storm:  60%|#####9    | 1797/3000 [53:54<43:52,  2.19s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  60%|#####9    | 1797/3000 [53:54<43:52,  2.19s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  60%|#####9    | 1798/3000 [53:54<48:07,  2.40s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  60%|#####9    | 1798/3000 [53:54<48:07,  2.40s/it, lr: 1.0e-04 loss: 4.407e-01]
windy_storm:  60%|#####9    | 1798/3000 [53:57<48:07,  2.40s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  60%|#####9    | 1798/3000 [53:57<48:07,  2.40s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  60%|#####9    | 1799/3000 [53:57<51:29,  2.57s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  60%|#####9    | 1799/3000 [53:57<51:29,  2.57s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  60%|#####9    | 1799/3000 [54:01<51:29,  2.57s/it, lr: 1.0e-04 loss: 6.672e-01]
windy_storm:  60%|#####9    | 1799/3000 [54:01<51:29,  2.57s/it, lr: 1.0e-04 loss: 6.672e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.44s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.44s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.38s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.38s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.38s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.38s/it]


Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.39s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.39s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.37s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.37s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  60%|######    | 1800/3000 [54:04<51:27,  2.57s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  60%|######    | 1800/3000 [54:04<51:27,  2.57s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  60%|######    | 1801/3000 [54:04<41:17,  2.07s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  60%|######    | 1801/3000 [54:04<41:17,  2.07s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  60%|######    | 1801/3000 [54:07<41:17,  2.07s/it, lr: 1.0e-04 loss: 3.220e-01]
windy_storm:  60%|######    | 1801/3000 [54:07<41:17,  2.07s/it, lr: 1.0e-04 loss: 3.220e-01]
windy_storm:  60%|######    | 1802/3000 [54:07<45:25,  2.27s/it, lr: 1.0e-04 loss: 3.220e-01]
windy_storm:  60%|######    | 1802/3000 [54:07<45:25,  2.27s/it, lr: 1.0e-04 loss: 3.220e-01]
windy_storm:  60%|######    | 1802/3000 [54:10<45:25,  2.27s/it, lr: 1.0e-04 loss: 5.834e-01]
windy_storm:  60%|######    | 1802/3000 [54:10<45:25,  2.27s/it, lr: 1.0e-04 loss: 5.834e-01]
windy_storm:  60%|######    | 1803/3000 [54:10<49:06,  2.46s/it, lr: 1.0e-04 loss: 5.834e-01]
windy_storm:  60%|######    | 1803/3000 [54:10<49:06,  2.46s/it, lr: 1.0e-04 loss: 5.834e-01]
windy_storm:  60%|######    | 1803/3000 [54:12<49:06,  2.46s/it, lr: 1.0e-04 loss: 6.504e-01]
windy_storm:  60%|######    | 1803/3000 [54:12<49:06,  2.46s/it, lr: 1.0e-04 loss: 6.504e-01]
windy_storm:  60%|######    | 1804/3000 [54:12<51:18,  2.57s/it, lr: 1.0e-04 loss: 6.504e-01]
windy_storm:  60%|######    | 1804/3000 [54:12<51:18,  2.57s/it, lr: 1.0e-04 loss: 6.504e-01]
windy_storm:  60%|######    | 1804/3000 [54:15<51:18,  2.57s/it, lr: 1.0e-04 loss: 6.654e-01]
windy_storm:  60%|######    | 1804/3000 [54:15<51:18,  2.57s/it, lr: 1.0e-04 loss: 6.654e-01]
windy_storm:  60%|######    | 1805/3000 [54:15<53:40,  2.69s/it, lr: 1.0e-04 loss: 6.654e-01]
windy_storm:  60%|######    | 1805/3000 [54:15<53:40,  2.69s/it, lr: 1.0e-04 loss: 6.654e-01]
windy_storm:  60%|######    | 1805/3000 [54:16<53:40,  2.69s/it, lr: 1.0e-04 loss: 1.737e-01]
windy_storm:  60%|######    | 1805/3000 [54:16<53:40,  2.69s/it, lr: 1.0e-04 loss: 1.737e-01]
windy_storm:  60%|######    | 1806/3000 [54:16<42:59,  2.16s/it, lr: 1.0e-04 loss: 1.737e-01]
windy_storm:  60%|######    | 1806/3000 [54:16<42:59,  2.16s/it, lr: 1.0e-04 loss: 1.737e-01]
windy_storm:  60%|######    | 1806/3000 [54:19<42:59,  2.16s/it, lr: 1.0e-04 loss: 1.153e-01]
windy_storm:  60%|######    | 1806/3000 [54:19<42:59,  2.16s/it, lr: 1.0e-04 loss: 1.153e-01]
windy_storm:  60%|######    | 1807/3000 [54:19<47:28,  2.39s/it, lr: 1.0e-04 loss: 1.153e-01]
windy_storm:  60%|######    | 1807/3000 [54:19<47:28,  2.39s/it, lr: 1.0e-04 loss: 1.153e-01]
windy_storm:  60%|######    | 1807/3000 [54:21<47:28,  2.39s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  60%|######    | 1807/3000 [54:21<47:28,  2.39s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  60%|######    | 1808/3000 [54:21<42:34,  2.14s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  60%|######    | 1808/3000 [54:21<42:34,  2.14s/it, lr: 1.0e-04 loss: 3.615e-01]
windy_storm:  60%|######    | 1808/3000 [54:24<42:34,  2.14s/it, lr: 1.0e-04 loss: 7.933e-02]
windy_storm:  60%|######    | 1808/3000 [54:24<42:34,  2.14s/it, lr: 1.0e-04 loss: 7.933e-02]
windy_storm:  60%|######    | 1809/3000 [54:24<47:35,  2.40s/it, lr: 1.0e-04 loss: 7.933e-02]
windy_storm:  60%|######    | 1809/3000 [54:24<47:35,  2.40s/it, lr: 1.0e-04 loss: 7.933e-02]
windy_storm:  60%|######    | 1809/3000 [54:24<47:35,  2.40s/it, lr: 1.0e-04 loss: 1.898e-01]
windy_storm:  60%|######    | 1809/3000 [54:24<47:35,  2.40s/it, lr: 1.0e-04 loss: 1.898e-01]
windy_storm:  60%|######    | 1810/3000 [54:25<47:32,  2.40s/it, lr: 1.0e-04 loss: 4.668e-01]
windy_storm:  60%|######    | 1810/3000 [54:25<47:32,  2.40s/it, lr: 1.0e-04 loss: 4.668e-01]
windy_storm:  60%|######    | 1811/3000 [54:25<29:15,  1.48s/it, lr: 1.0e-04 loss: 4.668e-01]
windy_storm:  60%|######    | 1811/3000 [54:25<29:15,  1.48s/it, lr: 1.0e-04 loss: 4.668e-01]
windy_storm:  60%|######    | 1811/3000 [54:26<29:15,  1.48s/it, lr: 1.0e-04 loss: 7.596e-02]
windy_storm:  60%|######    | 1811/3000 [54:26<29:15,  1.48s/it, lr: 1.0e-04 loss: 7.596e-02]
windy_storm:  60%|######    | 1812/3000 [54:26<26:01,  1.31s/it, lr: 1.0e-04 loss: 7.596e-02]
windy_storm:  60%|######    | 1812/3000 [54:26<26:01,  1.31s/it, lr: 1.0e-04 loss: 7.596e-02]
windy_storm:  60%|######    | 1812/3000 [54:29<26:01,  1.31s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  60%|######    | 1812/3000 [54:29<26:01,  1.31s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  60%|######    | 1813/3000 [54:29<34:52,  1.76s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  60%|######    | 1813/3000 [54:29<34:52,  1.76s/it, lr: 1.0e-04 loss: 1.084e-01]
windy_storm:  60%|######    | 1813/3000 [54:31<34:52,  1.76s/it, lr: 1.0e-04 loss: 5.039e-01]
windy_storm:  60%|######    | 1813/3000 [54:31<34:52,  1.76s/it, lr: 1.0e-04 loss: 5.039e-01]
windy_storm:  60%|######    | 1814/3000 [54:31<33:53,  1.71s/it, lr: 1.0e-04 loss: 5.039e-01]
windy_storm:  60%|######    | 1814/3000 [54:31<33:53,  1.71s/it, lr: 1.0e-04 loss: 5.039e-01]
windy_storm:  60%|######    | 1814/3000 [54:32<33:53,  1.71s/it, lr: 1.0e-04 loss: 2.920e-01]
windy_storm:  60%|######    | 1814/3000 [54:32<33:53,  1.71s/it, lr: 1.0e-04 loss: 2.920e-01]
windy_storm:  60%|######    | 1815/3000 [54:32<33:09,  1.68s/it, lr: 1.0e-04 loss: 2.920e-01]
windy_storm:  60%|######    | 1815/3000 [54:32<33:09,  1.68s/it, lr: 1.0e-04 loss: 2.920e-01]
windy_storm:  60%|######    | 1815/3000 [54:33<33:09,  1.68s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  60%|######    | 1815/3000 [54:33<33:09,  1.68s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  61%|######    | 1816/3000 [54:33<28:03,  1.42s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  61%|######    | 1816/3000 [54:33<28:03,  1.42s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  61%|######    | 1816/3000 [54:35<28:03,  1.42s/it, lr: 1.0e-04 loss: 5.044e-01]
windy_storm:  61%|######    | 1816/3000 [54:35<28:03,  1.42s/it, lr: 1.0e-04 loss: 5.044e-01]
windy_storm:  61%|######    | 1817/3000 [54:35<28:59,  1.47s/it, lr: 1.0e-04 loss: 5.044e-01]
windy_storm:  61%|######    | 1817/3000 [54:35<28:59,  1.47s/it, lr: 1.0e-04 loss: 5.044e-01]
windy_storm:  61%|######    | 1817/3000 [54:38<28:59,  1.47s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  61%|######    | 1817/3000 [54:38<28:59,  1.47s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  61%|######    | 1818/3000 [54:38<37:53,  1.92s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  61%|######    | 1818/3000 [54:38<37:53,  1.92s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  61%|######    | 1818/3000 [54:38<37:53,  1.92s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  61%|######    | 1818/3000 [54:38<37:53,  1.92s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  61%|######    | 1819/3000 [54:38<31:10,  1.58s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  61%|######    | 1819/3000 [54:38<31:10,  1.58s/it, lr: 1.0e-04 loss: 2.459e-01]
windy_storm:  61%|######    | 1819/3000 [54:40<31:10,  1.58s/it, lr: 1.0e-04 loss: 6.268e-01]
windy_storm:  61%|######    | 1819/3000 [54:40<31:10,  1.58s/it, lr: 1.0e-04 loss: 6.268e-01]
windy_storm:  61%|######    | 1820/3000 [54:43<31:08,  1.58s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  61%|######    | 1820/3000 [54:43<31:08,  1.58s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  61%|######    | 1821/3000 [54:43<30:15,  1.54s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  61%|######    | 1821/3000 [54:43<30:15,  1.54s/it, lr: 1.0e-04 loss: 4.923e-01]
windy_storm:  61%|######    | 1821/3000 [54:45<30:15,  1.54s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  61%|######    | 1821/3000 [54:45<30:15,  1.54s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  61%|######    | 1822/3000 [54:45<30:19,  1.54s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  61%|######    | 1822/3000 [54:45<30:19,  1.54s/it, lr: 1.0e-04 loss: 2.462e-01]
windy_storm:  61%|######    | 1822/3000 [54:46<30:19,  1.54s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  61%|######    | 1822/3000 [54:46<30:19,  1.54s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  61%|######    | 1823/3000 [54:46<30:36,  1.56s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  61%|######    | 1823/3000 [54:46<30:36,  1.56s/it, lr: 1.0e-04 loss: 5.326e-01]
windy_storm:  61%|######    | 1823/3000 [54:47<30:36,  1.56s/it, lr: 1.0e-04 loss: 7.279e-02]
windy_storm:  61%|######    | 1823/3000 [54:47<30:36,  1.56s/it, lr: 1.0e-04 loss: 7.279e-02]
windy_storm:  61%|######    | 1824/3000 [54:47<26:42,  1.36s/it, lr: 1.0e-04 loss: 7.279e-02]
windy_storm:  61%|######    | 1824/3000 [54:47<26:42,  1.36s/it, lr: 1.0e-04 loss: 7.279e-02]
windy_storm:  61%|######    | 1824/3000 [54:50<26:42,  1.36s/it, lr: 1.0e-04 loss: 5.763e-01]
windy_storm:  61%|######    | 1824/3000 [54:50<26:42,  1.36s/it, lr: 1.0e-04 loss: 5.763e-01]
windy_storm:  61%|######    | 1825/3000 [54:50<35:23,  1.81s/it, lr: 1.0e-04 loss: 5.763e-01]
windy_storm:  61%|######    | 1825/3000 [54:50<35:23,  1.81s/it, lr: 1.0e-04 loss: 5.763e-01]
windy_storm:  61%|######    | 1825/3000 [54:51<35:23,  1.81s/it, lr: 1.0e-04 loss: 7.134e-01]
windy_storm:  61%|######    | 1825/3000 [54:51<35:23,  1.81s/it, lr: 1.0e-04 loss: 7.134e-01]
windy_storm:  61%|######    | 1826/3000 [54:51<29:54,  1.53s/it, lr: 1.0e-04 loss: 7.134e-01]
windy_storm:  61%|######    | 1826/3000 [54:51<29:54,  1.53s/it, lr: 1.0e-04 loss: 7.134e-01]
windy_storm:  61%|######    | 1826/3000 [54:52<29:54,  1.53s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  61%|######    | 1826/3000 [54:52<29:54,  1.53s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  61%|######    | 1827/3000 [54:52<30:12,  1.55s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  61%|######    | 1827/3000 [54:52<30:12,  1.55s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  61%|######    | 1827/3000 [54:55<30:12,  1.55s/it, lr: 1.0e-04 loss: 4.668e-02]
windy_storm:  61%|######    | 1827/3000 [54:55<30:12,  1.55s/it, lr: 1.0e-04 loss: 4.668e-02]
windy_storm:  61%|######    | 1828/3000 [54:55<38:59,  2.00s/it, lr: 1.0e-04 loss: 4.668e-02]
windy_storm:  61%|######    | 1828/3000 [54:55<38:59,  2.00s/it, lr: 1.0e-04 loss: 4.668e-02]
windy_storm:  61%|######    | 1828/3000 [54:56<38:59,  2.00s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  61%|######    | 1828/3000 [54:56<38:59,  2.00s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  61%|######    | 1829/3000 [54:56<32:12,  1.65s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  61%|######    | 1829/3000 [54:56<32:12,  1.65s/it, lr: 1.0e-04 loss: 6.118e-01]
windy_storm:  61%|######    | 1829/3000 [54:58<32:12,  1.65s/it, lr: 1.0e-04 loss: 2.429e-01]
windy_storm:  61%|######    | 1829/3000 [54:58<32:12,  1.65s/it, lr: 1.0e-04 loss: 2.429e-01]
windy_storm:  61%|######1   | 1830/3000 [54:59<32:10,  1.65s/it, lr: 1.0e-04 loss: 6.536e-01]
windy_storm:  61%|######1   | 1830/3000 [54:59<32:10,  1.65s/it, lr: 1.0e-04 loss: 6.536e-01]
windy_storm:  61%|######1   | 1831/3000 [54:59<20:51,  1.07s/it, lr: 1.0e-04 loss: 6.536e-01]
windy_storm:  61%|######1   | 1831/3000 [54:59<20:51,  1.07s/it, lr: 1.0e-04 loss: 6.536e-01]
windy_storm:  61%|######1   | 1831/3000 [55:00<20:51,  1.07s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  61%|######1   | 1831/3000 [55:00<20:51,  1.07s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  61%|######1   | 1832/3000 [55:00<23:15,  1.19s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  61%|######1   | 1832/3000 [55:00<23:15,  1.19s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  61%|######1   | 1832/3000 [55:03<23:15,  1.19s/it, lr: 1.0e-04 loss: 5.861e-01]
windy_storm:  61%|######1   | 1832/3000 [55:03<23:15,  1.19s/it, lr: 1.0e-04 loss: 5.861e-01]
windy_storm:  61%|######1   | 1833/3000 [55:03<32:22,  1.66s/it, lr: 1.0e-04 loss: 5.861e-01]
windy_storm:  61%|######1   | 1833/3000 [55:03<32:22,  1.66s/it, lr: 1.0e-04 loss: 5.861e-01]
windy_storm:  61%|######1   | 1833/3000 [55:05<32:22,  1.66s/it, lr: 1.0e-04 loss: 1.205e-01]
windy_storm:  61%|######1   | 1833/3000 [55:05<32:22,  1.66s/it, lr: 1.0e-04 loss: 1.205e-01]
windy_storm:  61%|######1   | 1834/3000 [55:05<31:42,  1.63s/it, lr: 1.0e-04 loss: 1.205e-01]
windy_storm:  61%|######1   | 1834/3000 [55:05<31:42,  1.63s/it, lr: 1.0e-04 loss: 1.205e-01]
windy_storm:  61%|######1   | 1834/3000 [55:08<31:42,  1.63s/it, lr: 1.0e-04 loss: 1.443e-01]
windy_storm:  61%|######1   | 1834/3000 [55:08<31:42,  1.63s/it, lr: 1.0e-04 loss: 1.443e-01]
windy_storm:  61%|######1   | 1835/3000 [55:08<38:41,  1.99s/it, lr: 1.0e-04 loss: 1.443e-01]
windy_storm:  61%|######1   | 1835/3000 [55:08<38:41,  1.99s/it, lr: 1.0e-04 loss: 1.443e-01]
windy_storm:  61%|######1   | 1835/3000 [55:09<38:41,  1.99s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  61%|######1   | 1835/3000 [55:09<38:41,  1.99s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  61%|######1   | 1836/3000 [55:09<36:24,  1.88s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  61%|######1   | 1836/3000 [55:09<36:24,  1.88s/it, lr: 1.0e-04 loss: 1.621e-01]
windy_storm:  61%|######1   | 1836/3000 [55:10<36:24,  1.88s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  61%|######1   | 1836/3000 [55:10<36:24,  1.88s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  61%|######1   | 1837/3000 [55:10<30:26,  1.57s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  61%|######1   | 1837/3000 [55:10<30:26,  1.57s/it, lr: 1.0e-04 loss: 6.008e-01]
windy_storm:  61%|######1   | 1837/3000 [55:12<30:26,  1.57s/it, lr: 1.0e-04 loss: 3.284e-02]
windy_storm:  61%|######1   | 1837/3000 [55:12<30:26,  1.57s/it, lr: 1.0e-04 loss: 3.284e-02]
windy_storm:  61%|######1   | 1838/3000 [55:12<30:29,  1.57s/it, lr: 1.0e-04 loss: 3.284e-02]
windy_storm:  61%|######1   | 1838/3000 [55:12<30:29,  1.57s/it, lr: 1.0e-04 loss: 3.284e-02]
windy_storm:  61%|######1   | 1838/3000 [55:12<30:29,  1.57s/it, lr: 1.0e-04 loss: 2.080e-01]
windy_storm:  61%|######1   | 1838/3000 [55:12<30:29,  1.57s/it, lr: 1.0e-04 loss: 2.080e-01]
windy_storm:  61%|######1   | 1839/3000 [55:12<25:45,  1.33s/it, lr: 1.0e-04 loss: 2.080e-01]
windy_storm:  61%|######1   | 1839/3000 [55:12<25:45,  1.33s/it, lr: 1.0e-04 loss: 2.080e-01]
windy_storm:  61%|######1   | 1839/3000 [55:13<25:45,  1.33s/it, lr: 1.0e-04 loss: 1.406e-01]
windy_storm:  61%|######1   | 1839/3000 [55:13<25:45,  1.33s/it, lr: 1.0e-04 loss: 1.406e-01]
windy_storm:  61%|######1   | 1840/3000 [55:14<25:44,  1.33s/it, lr: 1.0e-04 loss: 1.805e-01]
windy_storm:  61%|######1   | 1840/3000 [55:14<25:44,  1.33s/it, lr: 1.0e-04 loss: 1.805e-01]
windy_storm:  61%|######1   | 1841/3000 [55:14<17:17,  1.12it/s, lr: 1.0e-04 loss: 1.805e-01]
windy_storm:  61%|######1   | 1841/3000 [55:14<17:17,  1.12it/s, lr: 1.0e-04 loss: 1.805e-01]
windy_storm:  61%|######1   | 1841/3000 [55:15<17:17,  1.12it/s, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:  61%|######1   | 1841/3000 [55:15<17:17,  1.12it/s, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:  61%|######1   | 1842/3000 [55:15<17:42,  1.09it/s, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:  61%|######1   | 1842/3000 [55:15<17:42,  1.09it/s, lr: 1.0e-04 loss: 2.167e-01]
windy_storm:  61%|######1   | 1842/3000 [55:17<17:42,  1.09it/s, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:  61%|######1   | 1842/3000 [55:17<17:42,  1.09it/s, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:  61%|######1   | 1843/3000 [55:17<20:57,  1.09s/it, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:  61%|######1   | 1843/3000 [55:17<20:57,  1.09s/it, lr: 1.0e-04 loss: 5.791e-01]
windy_storm:  61%|######1   | 1843/3000 [55:17<20:57,  1.09s/it, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  61%|######1   | 1843/3000 [55:17<20:57,  1.09s/it, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  61%|######1   | 1844/3000 [55:17<19:13,  1.00it/s, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  61%|######1   | 1844/3000 [55:17<19:13,  1.00it/s, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  61%|######1   | 1844/3000 [55:18<19:13,  1.00it/s, lr: 1.0e-04 loss: 1.064e-02]
windy_storm:  61%|######1   | 1844/3000 [55:18<19:13,  1.00it/s, lr: 1.0e-04 loss: 1.064e-02]
windy_storm:  62%|######1   | 1845/3000 [55:18<17:58,  1.07it/s, lr: 1.0e-04 loss: 1.064e-02]
windy_storm:  62%|######1   | 1845/3000 [55:18<17:58,  1.07it/s, lr: 1.0e-04 loss: 1.064e-02]
windy_storm:  62%|######1   | 1845/3000 [55:19<17:58,  1.07it/s, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  62%|######1   | 1845/3000 [55:19<17:58,  1.07it/s, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  62%|######1   | 1846/3000 [55:19<17:17,  1.11it/s, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  62%|######1   | 1846/3000 [55:19<17:17,  1.11it/s, lr: 1.0e-04 loss: 1.901e-01]
windy_storm:  62%|######1   | 1846/3000 [55:20<17:17,  1.11it/s, lr: 1.0e-04 loss: 2.059e-01]
windy_storm:  62%|######1   | 1846/3000 [55:20<17:17,  1.11it/s, lr: 1.0e-04 loss: 2.059e-01]
windy_storm:  62%|######1   | 1847/3000 [55:20<16:51,  1.14it/s, lr: 1.0e-04 loss: 2.059e-01]
windy_storm:  62%|######1   | 1847/3000 [55:20<16:51,  1.14it/s, lr: 1.0e-04 loss: 2.059e-01]
windy_storm:  62%|######1   | 1847/3000 [55:20<16:51,  1.14it/s, lr: 1.0e-04 loss: 7.186e-01]
windy_storm:  62%|######1   | 1847/3000 [55:20<16:51,  1.14it/s, lr: 1.0e-04 loss: 7.186e-01]
windy_storm:  62%|######1   | 1848/3000 [55:20<16:14,  1.18it/s, lr: 1.0e-04 loss: 7.186e-01]
windy_storm:  62%|######1   | 1848/3000 [55:20<16:14,  1.18it/s, lr: 1.0e-04 loss: 7.186e-01]
windy_storm:  62%|######1   | 1848/3000 [55:22<16:14,  1.18it/s, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  62%|######1   | 1848/3000 [55:22<16:14,  1.18it/s, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  62%|######1   | 1849/3000 [55:22<20:19,  1.06s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  62%|######1   | 1849/3000 [55:22<20:19,  1.06s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  62%|######1   | 1849/3000 [55:23<20:19,  1.06s/it, lr: 1.0e-04 loss: 6.547e-01]
windy_storm:  62%|######1   | 1849/3000 [55:23<20:19,  1.06s/it, lr: 1.0e-04 loss: 6.547e-01]
windy_storm:  62%|######1   | 1850/3000 [55:26<20:18,  1.06s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  62%|######1   | 1850/3000 [55:26<20:18,  1.06s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  62%|######1   | 1851/3000 [55:26<24:04,  1.26s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  62%|######1   | 1851/3000 [55:26<24:04,  1.26s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  62%|######1   | 1851/3000 [55:29<24:04,  1.26s/it, lr: 1.0e-04 loss: 2.730e-01]
windy_storm:  62%|######1   | 1851/3000 [55:29<24:04,  1.26s/it, lr: 1.0e-04 loss: 2.730e-01]
windy_storm:  62%|######1   | 1852/3000 [55:29<32:08,  1.68s/it, lr: 1.0e-04 loss: 2.730e-01]
windy_storm:  62%|######1   | 1852/3000 [55:29<32:08,  1.68s/it, lr: 1.0e-04 loss: 2.730e-01]
windy_storm:  62%|######1   | 1852/3000 [55:30<32:08,  1.68s/it, lr: 1.0e-04 loss: 5.400e-01]
windy_storm:  62%|######1   | 1852/3000 [55:30<32:08,  1.68s/it, lr: 1.0e-04 loss: 5.400e-01]
windy_storm:  62%|######1   | 1853/3000 [55:30<27:29,  1.44s/it, lr: 1.0e-04 loss: 5.400e-01]
windy_storm:  62%|######1   | 1853/3000 [55:30<27:29,  1.44s/it, lr: 1.0e-04 loss: 5.400e-01]
windy_storm:  62%|######1   | 1853/3000 [55:32<27:29,  1.44s/it, lr: 1.0e-04 loss: 2.361e-01]
windy_storm:  62%|######1   | 1853/3000 [55:32<27:29,  1.44s/it, lr: 1.0e-04 loss: 2.361e-01]
windy_storm:  62%|######1   | 1854/3000 [55:32<35:02,  1.83s/it, lr: 1.0e-04 loss: 2.361e-01]
windy_storm:  62%|######1   | 1854/3000 [55:32<35:02,  1.83s/it, lr: 1.0e-04 loss: 2.361e-01]
windy_storm:  62%|######1   | 1854/3000 [55:34<35:02,  1.83s/it, lr: 1.0e-04 loss: 5.798e-01]
windy_storm:  62%|######1   | 1854/3000 [55:34<35:02,  1.83s/it, lr: 1.0e-04 loss: 5.798e-01]
windy_storm:  62%|######1   | 1855/3000 [55:34<31:16,  1.64s/it, lr: 1.0e-04 loss: 5.798e-01]
windy_storm:  62%|######1   | 1855/3000 [55:34<31:16,  1.64s/it, lr: 1.0e-04 loss: 5.798e-01]
windy_storm:  62%|######1   | 1855/3000 [55:36<31:16,  1.64s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:  62%|######1   | 1855/3000 [55:36<31:16,  1.64s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:  62%|######1   | 1856/3000 [55:36<38:02,  2.00s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:  62%|######1   | 1856/3000 [55:36<38:02,  2.00s/it, lr: 1.0e-04 loss: 4.188e-01]
windy_storm:  62%|######1   | 1856/3000 [55:38<38:02,  2.00s/it, lr: 1.0e-04 loss: 6.864e-01]
windy_storm:  62%|######1   | 1856/3000 [55:38<38:02,  2.00s/it, lr: 1.0e-04 loss: 6.864e-01]
windy_storm:  62%|######1   | 1857/3000 [55:38<35:33,  1.87s/it, lr: 1.0e-04 loss: 6.864e-01]
windy_storm:  62%|######1   | 1857/3000 [55:38<35:33,  1.87s/it, lr: 1.0e-04 loss: 6.864e-01]
windy_storm:  62%|######1   | 1857/3000 [55:40<35:33,  1.87s/it, lr: 1.0e-04 loss: 6.116e-01]
windy_storm:  62%|######1   | 1857/3000 [55:40<35:33,  1.87s/it, lr: 1.0e-04 loss: 6.116e-01]
windy_storm:  62%|######1   | 1858/3000 [55:40<33:46,  1.77s/it, lr: 1.0e-04 loss: 6.116e-01]
windy_storm:  62%|######1   | 1858/3000 [55:40<33:46,  1.77s/it, lr: 1.0e-04 loss: 6.116e-01]
windy_storm:  62%|######1   | 1858/3000 [55:41<33:46,  1.77s/it, lr: 1.0e-04 loss: 5.921e-02]
windy_storm:  62%|######1   | 1858/3000 [55:41<33:46,  1.77s/it, lr: 1.0e-04 loss: 5.921e-02]
windy_storm:  62%|######1   | 1859/3000 [55:41<32:29,  1.71s/it, lr: 1.0e-04 loss: 5.921e-02]
windy_storm:  62%|######1   | 1859/3000 [55:41<32:29,  1.71s/it, lr: 1.0e-04 loss: 5.921e-02]
windy_storm:  62%|######1   | 1859/3000 [55:42<32:29,  1.71s/it, lr: 1.0e-04 loss: 3.278e-02]
windy_storm:  62%|######1   | 1859/3000 [55:42<32:29,  1.71s/it, lr: 1.0e-04 loss: 3.278e-02]
windy_storm:  62%|######2   | 1860/3000 [55:43<32:28,  1.71s/it, lr: 1.0e-04 loss: 5.639e-01]
windy_storm:  62%|######2   | 1860/3000 [55:43<32:28,  1.71s/it, lr: 1.0e-04 loss: 5.639e-01]
windy_storm:  62%|######2   | 1861/3000 [55:43<20:51,  1.10s/it, lr: 1.0e-04 loss: 5.639e-01]
windy_storm:  62%|######2   | 1861/3000 [55:43<20:51,  1.10s/it, lr: 1.0e-04 loss: 5.639e-01]
windy_storm:  62%|######2   | 1861/3000 [55:43<20:51,  1.10s/it, lr: 1.0e-04 loss: 6.140e-01]
windy_storm:  62%|######2   | 1861/3000 [55:43<20:51,  1.10s/it, lr: 1.0e-04 loss: 6.140e-01]
windy_storm:  62%|######2   | 1862/3000 [55:43<19:29,  1.03s/it, lr: 1.0e-04 loss: 6.140e-01]
windy_storm:  62%|######2   | 1862/3000 [55:43<19:29,  1.03s/it, lr: 1.0e-04 loss: 6.140e-01]
windy_storm:  62%|######2   | 1862/3000 [55:45<19:29,  1.03s/it, lr: 1.0e-04 loss: 5.227e-01]
windy_storm:  62%|######2   | 1862/3000 [55:45<19:29,  1.03s/it, lr: 1.0e-04 loss: 5.227e-01]
windy_storm:  62%|######2   | 1863/3000 [55:45<21:48,  1.15s/it, lr: 1.0e-04 loss: 5.227e-01]
windy_storm:  62%|######2   | 1863/3000 [55:45<21:48,  1.15s/it, lr: 1.0e-04 loss: 5.227e-01]
windy_storm:  62%|######2   | 1863/3000 [55:46<21:48,  1.15s/it, lr: 1.0e-04 loss: 1.410e-01]
windy_storm:  62%|######2   | 1863/3000 [55:46<21:48,  1.15s/it, lr: 1.0e-04 loss: 1.410e-01]
windy_storm:  62%|######2   | 1864/3000 [55:46<23:50,  1.26s/it, lr: 1.0e-04 loss: 1.410e-01]
windy_storm:  62%|######2   | 1864/3000 [55:46<23:50,  1.26s/it, lr: 1.0e-04 loss: 1.410e-01]
windy_storm:  62%|######2   | 1864/3000 [55:48<23:50,  1.26s/it, lr: 1.0e-04 loss: 5.650e-01]
windy_storm:  62%|######2   | 1864/3000 [55:48<23:50,  1.26s/it, lr: 1.0e-04 loss: 5.650e-01]
windy_storm:  62%|######2   | 1865/3000 [55:48<25:27,  1.35s/it, lr: 1.0e-04 loss: 5.650e-01]
windy_storm:  62%|######2   | 1865/3000 [55:48<25:27,  1.35s/it, lr: 1.0e-04 loss: 5.650e-01]
windy_storm:  62%|######2   | 1865/3000 [55:49<25:27,  1.35s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  62%|######2   | 1865/3000 [55:49<25:27,  1.35s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  62%|######2   | 1866/3000 [55:49<22:16,  1.18s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  62%|######2   | 1866/3000 [55:49<22:16,  1.18s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  62%|######2   | 1866/3000 [55:50<22:16,  1.18s/it, lr: 1.0e-04 loss: 7.347e-02]
windy_storm:  62%|######2   | 1866/3000 [55:50<22:16,  1.18s/it, lr: 1.0e-04 loss: 7.347e-02]
windy_storm:  62%|######2   | 1867/3000 [55:50<24:15,  1.28s/it, lr: 1.0e-04 loss: 7.347e-02]
windy_storm:  62%|######2   | 1867/3000 [55:50<24:15,  1.28s/it, lr: 1.0e-04 loss: 7.347e-02]
windy_storm:  62%|######2   | 1867/3000 [55:53<24:15,  1.28s/it, lr: 1.0e-04 loss: 7.066e-02]
windy_storm:  62%|######2   | 1867/3000 [55:53<24:15,  1.28s/it, lr: 1.0e-04 loss: 7.066e-02]
windy_storm:  62%|######2   | 1868/3000 [55:53<33:38,  1.78s/it, lr: 1.0e-04 loss: 7.066e-02]
windy_storm:  62%|######2   | 1868/3000 [55:53<33:38,  1.78s/it, lr: 1.0e-04 loss: 7.066e-02]
windy_storm:  62%|######2   | 1868/3000 [55:54<33:38,  1.78s/it, lr: 1.0e-04 loss: 4.344e-01]
windy_storm:  62%|######2   | 1868/3000 [55:54<33:38,  1.78s/it, lr: 1.0e-04 loss: 4.344e-01]
windy_storm:  62%|######2   | 1869/3000 [55:54<28:14,  1.50s/it, lr: 1.0e-04 loss: 4.344e-01]
windy_storm:  62%|######2   | 1869/3000 [55:54<28:14,  1.50s/it, lr: 1.0e-04 loss: 4.344e-01]
windy_storm:  62%|######2   | 1869/3000 [55:57<28:14,  1.50s/it, lr: 1.0e-04 loss: 1.599e-01]
windy_storm:  62%|######2   | 1869/3000 [55:57<28:14,  1.50s/it, lr: 1.0e-04 loss: 1.599e-01]
windy_storm:  62%|######2   | 1870/3000 [56:00<28:13,  1.50s/it, lr: 1.0e-04 loss: 7.012e-02]
windy_storm:  62%|######2   | 1870/3000 [56:00<28:13,  1.50s/it, lr: 1.0e-04 loss: 7.012e-02]
windy_storm:  62%|######2   | 1871/3000 [56:00<28:05,  1.49s/it, lr: 1.0e-04 loss: 7.012e-02]
windy_storm:  62%|######2   | 1871/3000 [56:00<28:05,  1.49s/it, lr: 1.0e-04 loss: 7.012e-02]
windy_storm:  62%|######2   | 1871/3000 [56:02<28:05,  1.49s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  62%|######2   | 1871/3000 [56:02<28:05,  1.49s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  62%|######2   | 1872/3000 [56:02<28:15,  1.50s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  62%|######2   | 1872/3000 [56:02<28:15,  1.50s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  62%|######2   | 1872/3000 [56:03<28:15,  1.50s/it, lr: 1.0e-04 loss: 6.441e-01]
windy_storm:  62%|######2   | 1872/3000 [56:03<28:15,  1.50s/it, lr: 1.0e-04 loss: 6.441e-01]
windy_storm:  62%|######2   | 1873/3000 [56:03<28:25,  1.51s/it, lr: 1.0e-04 loss: 6.441e-01]
windy_storm:  62%|######2   | 1873/3000 [56:03<28:25,  1.51s/it, lr: 1.0e-04 loss: 6.441e-01]
windy_storm:  62%|######2   | 1873/3000 [56:06<28:25,  1.51s/it, lr: 1.0e-04 loss: 3.381e-01]
windy_storm:  62%|######2   | 1873/3000 [56:06<28:25,  1.51s/it, lr: 1.0e-04 loss: 3.381e-01]
windy_storm:  62%|######2   | 1874/3000 [56:06<35:50,  1.91s/it, lr: 1.0e-04 loss: 3.381e-01]
windy_storm:  62%|######2   | 1874/3000 [56:06<35:50,  1.91s/it, lr: 1.0e-04 loss: 3.381e-01]
windy_storm:  62%|######2   | 1874/3000 [56:09<35:50,  1.91s/it, lr: 1.0e-04 loss: 2.162e-01]
windy_storm:  62%|######2   | 1874/3000 [56:09<35:50,  1.91s/it, lr: 1.0e-04 loss: 2.162e-01]
windy_storm:  62%|######2   | 1875/3000 [56:09<41:23,  2.21s/it, lr: 1.0e-04 loss: 2.162e-01]
windy_storm:  62%|######2   | 1875/3000 [56:09<41:23,  2.21s/it, lr: 1.0e-04 loss: 2.162e-01]
windy_storm:  62%|######2   | 1875/3000 [56:10<41:23,  2.21s/it, lr: 1.0e-04 loss: 5.972e-01]
windy_storm:  62%|######2   | 1875/3000 [56:10<41:23,  2.21s/it, lr: 1.0e-04 loss: 5.972e-01]
windy_storm:  63%|######2   | 1876/3000 [56:10<33:28,  1.79s/it, lr: 1.0e-04 loss: 5.972e-01]
windy_storm:  63%|######2   | 1876/3000 [56:10<33:28,  1.79s/it, lr: 1.0e-04 loss: 5.972e-01]
windy_storm:  63%|######2   | 1876/3000 [56:13<33:28,  1.79s/it, lr: 1.0e-04 loss: 5.965e-01]
windy_storm:  63%|######2   | 1876/3000 [56:13<33:28,  1.79s/it, lr: 1.0e-04 loss: 5.965e-01]
windy_storm:  63%|######2   | 1877/3000 [56:13<39:54,  2.13s/it, lr: 1.0e-04 loss: 5.965e-01]
windy_storm:  63%|######2   | 1877/3000 [56:13<39:54,  2.13s/it, lr: 1.0e-04 loss: 5.965e-01]
windy_storm:  63%|######2   | 1877/3000 [56:14<39:54,  2.13s/it, lr: 1.0e-04 loss: 2.394e-01]
windy_storm:  63%|######2   | 1877/3000 [56:14<39:54,  2.13s/it, lr: 1.0e-04 loss: 2.394e-01]
windy_storm:  63%|######2   | 1878/3000 [56:14<36:36,  1.96s/it, lr: 1.0e-04 loss: 2.394e-01]
windy_storm:  63%|######2   | 1878/3000 [56:14<36:36,  1.96s/it, lr: 1.0e-04 loss: 2.394e-01]
windy_storm:  63%|######2   | 1878/3000 [56:16<36:36,  1.96s/it, lr: 1.0e-04 loss: 5.771e-01]
windy_storm:  63%|######2   | 1878/3000 [56:16<36:36,  1.96s/it, lr: 1.0e-04 loss: 5.771e-01]
windy_storm:  63%|######2   | 1879/3000 [56:16<34:30,  1.85s/it, lr: 1.0e-04 loss: 5.771e-01]
windy_storm:  63%|######2   | 1879/3000 [56:16<34:30,  1.85s/it, lr: 1.0e-04 loss: 5.771e-01]
windy_storm:  63%|######2   | 1879/3000 [56:19<34:30,  1.85s/it, lr: 1.0e-04 loss: 2.525e-02]
windy_storm:  63%|######2   | 1879/3000 [56:19<34:30,  1.85s/it, lr: 1.0e-04 loss: 2.525e-02]
windy_storm:  63%|######2   | 1880/3000 [56:22<34:28,  1.85s/it, lr: 1.0e-04 loss: 1.275e-01]
windy_storm:  63%|######2   | 1880/3000 [56:22<34:28,  1.85s/it, lr: 1.0e-04 loss: 1.275e-01]
windy_storm:  63%|######2   | 1881/3000 [56:22<31:24,  1.68s/it, lr: 1.0e-04 loss: 1.275e-01]
windy_storm:  63%|######2   | 1881/3000 [56:22<31:24,  1.68s/it, lr: 1.0e-04 loss: 1.275e-01]
windy_storm:  63%|######2   | 1881/3000 [56:23<31:24,  1.68s/it, lr: 1.0e-04 loss: 5.814e-01]
windy_storm:  63%|######2   | 1881/3000 [56:23<31:24,  1.68s/it, lr: 1.0e-04 loss: 5.814e-01]
windy_storm:  63%|######2   | 1882/3000 [56:23<27:23,  1.47s/it, lr: 1.0e-04 loss: 5.814e-01]
windy_storm:  63%|######2   | 1882/3000 [56:23<27:23,  1.47s/it, lr: 1.0e-04 loss: 5.814e-01]
windy_storm:  63%|######2   | 1882/3000 [56:24<27:23,  1.47s/it, lr: 1.0e-04 loss: 6.834e-01]
windy_storm:  63%|######2   | 1882/3000 [56:24<27:23,  1.47s/it, lr: 1.0e-04 loss: 6.834e-01]
windy_storm:  63%|######2   | 1883/3000 [56:24<28:34,  1.53s/it, lr: 1.0e-04 loss: 6.834e-01]
windy_storm:  63%|######2   | 1883/3000 [56:24<28:34,  1.53s/it, lr: 1.0e-04 loss: 6.834e-01]
windy_storm:  63%|######2   | 1883/3000 [56:26<28:34,  1.53s/it, lr: 1.0e-04 loss: 3.772e-01]
windy_storm:  63%|######2   | 1883/3000 [56:26<28:34,  1.53s/it, lr: 1.0e-04 loss: 3.772e-01]
windy_storm:  63%|######2   | 1884/3000 [56:26<28:43,  1.54s/it, lr: 1.0e-04 loss: 3.772e-01]
windy_storm:  63%|######2   | 1884/3000 [56:26<28:43,  1.54s/it, lr: 1.0e-04 loss: 3.772e-01]
windy_storm:  63%|######2   | 1884/3000 [56:29<28:43,  1.54s/it, lr: 1.0e-04 loss: 2.604e-01]
windy_storm:  63%|######2   | 1884/3000 [56:29<28:43,  1.54s/it, lr: 1.0e-04 loss: 2.604e-01]
windy_storm:  63%|######2   | 1885/3000 [56:29<36:09,  1.95s/it, lr: 1.0e-04 loss: 2.604e-01]
windy_storm:  63%|######2   | 1885/3000 [56:29<36:09,  1.95s/it, lr: 1.0e-04 loss: 2.604e-01]
windy_storm:  63%|######2   | 1885/3000 [56:31<36:09,  1.95s/it, lr: 1.0e-04 loss: 7.624e-02]
windy_storm:  63%|######2   | 1885/3000 [56:31<36:09,  1.95s/it, lr: 1.0e-04 loss: 7.624e-02]
windy_storm:  63%|######2   | 1886/3000 [56:31<34:06,  1.84s/it, lr: 1.0e-04 loss: 7.624e-02]
windy_storm:  63%|######2   | 1886/3000 [56:31<34:06,  1.84s/it, lr: 1.0e-04 loss: 7.624e-02]
windy_storm:  63%|######2   | 1886/3000 [56:31<34:06,  1.84s/it, lr: 1.0e-04 loss: 3.423e-02]
windy_storm:  63%|######2   | 1886/3000 [56:31<34:06,  1.84s/it, lr: 1.0e-04 loss: 3.423e-02]
windy_storm:  63%|######2   | 1887/3000 [56:31<28:34,  1.54s/it, lr: 1.0e-04 loss: 3.423e-02]
windy_storm:  63%|######2   | 1887/3000 [56:31<28:34,  1.54s/it, lr: 1.0e-04 loss: 3.423e-02]
windy_storm:  63%|######2   | 1887/3000 [56:32<28:34,  1.54s/it, lr: 1.0e-04 loss: 7.677e-02]
windy_storm:  63%|######2   | 1887/3000 [56:32<28:34,  1.54s/it, lr: 1.0e-04 loss: 7.677e-02]
windy_storm:  63%|######2   | 1888/3000 [56:32<24:39,  1.33s/it, lr: 1.0e-04 loss: 7.677e-02]
windy_storm:  63%|######2   | 1888/3000 [56:32<24:39,  1.33s/it, lr: 1.0e-04 loss: 7.677e-02]
windy_storm:  63%|######2   | 1888/3000 [56:33<24:39,  1.33s/it, lr: 1.0e-04 loss: 2.842e-01]
windy_storm:  63%|######2   | 1888/3000 [56:33<24:39,  1.33s/it, lr: 1.0e-04 loss: 2.842e-01]
windy_storm:  63%|######2   | 1889/3000 [56:33<21:31,  1.16s/it, lr: 1.0e-04 loss: 2.842e-01]
windy_storm:  63%|######2   | 1889/3000 [56:33<21:31,  1.16s/it, lr: 1.0e-04 loss: 2.842e-01]
windy_storm:  63%|######2   | 1889/3000 [56:34<21:31,  1.16s/it, lr: 1.0e-04 loss: 2.571e-01]
windy_storm:  63%|######2   | 1889/3000 [56:34<21:31,  1.16s/it, lr: 1.0e-04 loss: 2.571e-01]
windy_storm:  63%|######3   | 1890/3000 [56:35<21:30,  1.16s/it, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  63%|######3   | 1890/3000 [56:35<21:30,  1.16s/it, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  63%|######3   | 1891/3000 [56:35<18:17,  1.01it/s, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  63%|######3   | 1891/3000 [56:35<18:17,  1.01it/s, lr: 1.0e-04 loss: 5.103e-01]
windy_storm:  63%|######3   | 1891/3000 [56:38<18:17,  1.01it/s, lr: 1.0e-04 loss: 3.759e-01]
windy_storm:  63%|######3   | 1891/3000 [56:38<18:17,  1.01it/s, lr: 1.0e-04 loss: 3.759e-01]
windy_storm:  63%|######3   | 1892/3000 [56:38<26:59,  1.46s/it, lr: 1.0e-04 loss: 3.759e-01]
windy_storm:  63%|######3   | 1892/3000 [56:38<26:59,  1.46s/it, lr: 1.0e-04 loss: 3.759e-01]
windy_storm:  63%|######3   | 1892/3000 [56:40<26:59,  1.46s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  63%|######3   | 1892/3000 [56:40<26:59,  1.46s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  63%|######3   | 1893/3000 [56:40<27:30,  1.49s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  63%|######3   | 1893/3000 [56:40<27:30,  1.49s/it, lr: 1.0e-04 loss: 6.076e-01]
windy_storm:  63%|######3   | 1893/3000 [56:41<27:30,  1.49s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  63%|######3   | 1893/3000 [56:41<27:30,  1.49s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  63%|######3   | 1894/3000 [56:41<27:52,  1.51s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  63%|######3   | 1894/3000 [56:41<27:52,  1.51s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  63%|######3   | 1894/3000 [56:42<27:52,  1.51s/it, lr: 1.0e-04 loss: 1.634e-01]
windy_storm:  63%|######3   | 1894/3000 [56:42<27:52,  1.51s/it, lr: 1.0e-04 loss: 1.634e-01]
windy_storm:  63%|######3   | 1895/3000 [56:42<24:00,  1.30s/it, lr: 1.0e-04 loss: 1.634e-01]
windy_storm:  63%|######3   | 1895/3000 [56:42<24:00,  1.30s/it, lr: 1.0e-04 loss: 1.634e-01]
windy_storm:  63%|######3   | 1895/3000 [56:44<24:00,  1.30s/it, lr: 1.0e-04 loss: 1.592e-01]
windy_storm:  63%|######3   | 1895/3000 [56:44<24:00,  1.30s/it, lr: 1.0e-04 loss: 1.592e-01]
windy_storm:  63%|######3   | 1896/3000 [56:44<25:26,  1.38s/it, lr: 1.0e-04 loss: 1.592e-01]
windy_storm:  63%|######3   | 1896/3000 [56:44<25:26,  1.38s/it, lr: 1.0e-04 loss: 1.592e-01]
windy_storm:  63%|######3   | 1896/3000 [56:47<25:26,  1.38s/it, lr: 1.0e-04 loss: 5.047e-01]
windy_storm:  63%|######3   | 1896/3000 [56:47<25:26,  1.38s/it, lr: 1.0e-04 loss: 5.047e-01]
windy_storm:  63%|######3   | 1897/3000 [56:47<34:26,  1.87s/it, lr: 1.0e-04 loss: 5.047e-01]
windy_storm:  63%|######3   | 1897/3000 [56:47<34:26,  1.87s/it, lr: 1.0e-04 loss: 5.047e-01]
windy_storm:  63%|######3   | 1897/3000 [56:50<34:26,  1.87s/it, lr: 1.0e-04 loss: 3.004e-01]
windy_storm:  63%|######3   | 1897/3000 [56:50<34:26,  1.87s/it, lr: 1.0e-04 loss: 3.004e-01]
windy_storm:  63%|######3   | 1898/3000 [56:50<40:43,  2.22s/it, lr: 1.0e-04 loss: 3.004e-01]
windy_storm:  63%|######3   | 1898/3000 [56:50<40:43,  2.22s/it, lr: 1.0e-04 loss: 3.004e-01]
windy_storm:  63%|######3   | 1898/3000 [56:50<40:43,  2.22s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  63%|######3   | 1898/3000 [56:50<40:43,  2.22s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  63%|######3   | 1899/3000 [56:50<32:39,  1.78s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  63%|######3   | 1899/3000 [56:50<32:39,  1.78s/it, lr: 1.0e-04 loss: 2.601e-01]
windy_storm:  63%|######3   | 1899/3000 [56:52<32:39,  1.78s/it, lr: 1.0e-04 loss: 9.462e-02]
windy_storm:  63%|######3   | 1899/3000 [56:52<32:39,  1.78s/it, lr: 1.0e-04 loss: 9.462e-02]
windy_storm:  63%|######3   | 1900/3000 [56:55<32:37,  1.78s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  63%|######3   | 1900/3000 [56:55<32:37,  1.78s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  63%|######3   | 1901/3000 [56:55<30:09,  1.65s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  63%|######3   | 1901/3000 [56:55<30:09,  1.65s/it, lr: 1.0e-04 loss: 6.957e-01]
windy_storm:  63%|######3   | 1901/3000 [56:57<30:09,  1.65s/it, lr: 1.0e-04 loss: 2.851e-01]
windy_storm:  63%|######3   | 1901/3000 [56:57<30:09,  1.65s/it, lr: 1.0e-04 loss: 2.851e-01]
windy_storm:  63%|######3   | 1902/3000 [56:57<29:46,  1.63s/it, lr: 1.0e-04 loss: 2.851e-01]
windy_storm:  63%|######3   | 1902/3000 [56:57<29:46,  1.63s/it, lr: 1.0e-04 loss: 2.851e-01]
windy_storm:  63%|######3   | 1902/3000 [57:00<29:46,  1.63s/it, lr: 1.0e-04 loss: 1.429e-01]
windy_storm:  63%|######3   | 1902/3000 [57:00<29:46,  1.63s/it, lr: 1.0e-04 loss: 1.429e-01]
windy_storm:  63%|######3   | 1903/3000 [57:00<36:12,  1.98s/it, lr: 1.0e-04 loss: 1.429e-01]
windy_storm:  63%|######3   | 1903/3000 [57:00<36:12,  1.98s/it, lr: 1.0e-04 loss: 1.429e-01]
windy_storm:  63%|######3   | 1903/3000 [57:02<36:12,  1.98s/it, lr: 1.0e-04 loss: 4.714e-01]
windy_storm:  63%|######3   | 1903/3000 [57:02<36:12,  1.98s/it, lr: 1.0e-04 loss: 4.714e-01]
windy_storm:  63%|######3   | 1904/3000 [57:02<40:51,  2.24s/it, lr: 1.0e-04 loss: 4.714e-01]
windy_storm:  63%|######3   | 1904/3000 [57:02<40:51,  2.24s/it, lr: 1.0e-04 loss: 4.714e-01]
windy_storm:  63%|######3   | 1904/3000 [57:03<40:51,  2.24s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  63%|######3   | 1904/3000 [57:03<40:51,  2.24s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  64%|######3   | 1905/3000 [57:03<33:33,  1.84s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  64%|######3   | 1905/3000 [57:03<33:33,  1.84s/it, lr: 1.0e-04 loss: 6.661e-01]
windy_storm:  64%|######3   | 1905/3000 [57:06<33:33,  1.84s/it, lr: 1.0e-04 loss: 2.154e-01]
windy_storm:  64%|######3   | 1905/3000 [57:06<33:33,  1.84s/it, lr: 1.0e-04 loss: 2.154e-01]
windy_storm:  64%|######3   | 1906/3000 [57:06<39:02,  2.14s/it, lr: 1.0e-04 loss: 2.154e-01]
windy_storm:  64%|######3   | 1906/3000 [57:06<39:02,  2.14s/it, lr: 1.0e-04 loss: 2.154e-01]
windy_storm:  64%|######3   | 1906/3000 [57:07<39:02,  2.14s/it, lr: 1.0e-04 loss: 6.547e-01]
windy_storm:  64%|######3   | 1906/3000 [57:07<39:02,  2.14s/it, lr: 1.0e-04 loss: 6.547e-01]
windy_storm:  64%|######3   | 1907/3000 [57:07<32:00,  1.76s/it, lr: 1.0e-04 loss: 6.547e-01]
windy_storm:  64%|######3   | 1907/3000 [57:07<32:00,  1.76s/it, lr: 1.0e-04 loss: 6.547e-01]
windy_storm:  64%|######3   | 1907/3000 [57:09<32:00,  1.76s/it, lr: 1.0e-04 loss: 3.883e-01]
windy_storm:  64%|######3   | 1907/3000 [57:09<32:00,  1.76s/it, lr: 1.0e-04 loss: 3.883e-01]
windy_storm:  64%|######3   | 1908/3000 [57:09<31:02,  1.71s/it, lr: 1.0e-04 loss: 3.883e-01]
windy_storm:  64%|######3   | 1908/3000 [57:09<31:02,  1.71s/it, lr: 1.0e-04 loss: 3.883e-01]
windy_storm:  64%|######3   | 1908/3000 [57:11<31:02,  1.71s/it, lr: 1.0e-04 loss: 1.489e-01]
windy_storm:  64%|######3   | 1908/3000 [57:11<31:02,  1.71s/it, lr: 1.0e-04 loss: 1.489e-01]
windy_storm:  64%|######3   | 1909/3000 [57:11<37:28,  2.06s/it, lr: 1.0e-04 loss: 1.489e-01]
windy_storm:  64%|######3   | 1909/3000 [57:11<37:28,  2.06s/it, lr: 1.0e-04 loss: 1.489e-01]
windy_storm:  64%|######3   | 1909/3000 [57:13<37:28,  2.06s/it, lr: 1.0e-04 loss: 2.501e-01]
windy_storm:  64%|######3   | 1909/3000 [57:13<37:28,  2.06s/it, lr: 1.0e-04 loss: 2.501e-01]
windy_storm:  64%|######3   | 1910/3000 [57:16<37:26,  2.06s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  64%|######3   | 1910/3000 [57:16<37:26,  2.06s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  64%|######3   | 1911/3000 [57:16<32:39,  1.80s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  64%|######3   | 1911/3000 [57:16<32:39,  1.80s/it, lr: 1.0e-04 loss: 6.352e-01]
windy_storm:  64%|######3   | 1911/3000 [57:19<32:39,  1.80s/it, lr: 1.0e-04 loss: 6.565e-01]
windy_storm:  64%|######3   | 1911/3000 [57:19<32:39,  1.80s/it, lr: 1.0e-04 loss: 6.565e-01]
windy_storm:  64%|######3   | 1912/3000 [57:19<37:58,  2.09s/it, lr: 1.0e-04 loss: 6.565e-01]
windy_storm:  64%|######3   | 1912/3000 [57:19<37:58,  2.09s/it, lr: 1.0e-04 loss: 6.565e-01]
windy_storm:  64%|######3   | 1912/3000 [57:20<37:58,  2.09s/it, lr: 1.0e-04 loss: 5.122e-01]
windy_storm:  64%|######3   | 1912/3000 [57:20<37:58,  2.09s/it, lr: 1.0e-04 loss: 5.122e-01]
windy_storm:  64%|######3   | 1913/3000 [57:20<35:21,  1.95s/it, lr: 1.0e-04 loss: 5.122e-01]
windy_storm:  64%|######3   | 1913/3000 [57:20<35:21,  1.95s/it, lr: 1.0e-04 loss: 5.122e-01]
windy_storm:  64%|######3   | 1913/3000 [57:23<35:21,  1.95s/it, lr: 1.0e-04 loss: 5.387e-01]
windy_storm:  64%|######3   | 1913/3000 [57:23<35:21,  1.95s/it, lr: 1.0e-04 loss: 5.387e-01]
windy_storm:  64%|######3   | 1914/3000 [57:23<40:26,  2.23s/it, lr: 1.0e-04 loss: 5.387e-01]
windy_storm:  64%|######3   | 1914/3000 [57:23<40:26,  2.23s/it, lr: 1.0e-04 loss: 5.387e-01]
windy_storm:  64%|######3   | 1914/3000 [57:25<40:26,  2.23s/it, lr: 1.0e-04 loss: 2.360e-01]
windy_storm:  64%|######3   | 1914/3000 [57:25<40:26,  2.23s/it, lr: 1.0e-04 loss: 2.360e-01]
windy_storm:  64%|######3   | 1915/3000 [57:25<37:01,  2.05s/it, lr: 1.0e-04 loss: 2.360e-01]
windy_storm:  64%|######3   | 1915/3000 [57:25<37:01,  2.05s/it, lr: 1.0e-04 loss: 2.360e-01]
windy_storm:  64%|######3   | 1915/3000 [57:26<37:01,  2.05s/it, lr: 1.0e-04 loss: 6.960e-01]
windy_storm:  64%|######3   | 1915/3000 [57:26<37:01,  2.05s/it, lr: 1.0e-04 loss: 6.960e-01]
windy_storm:  64%|######3   | 1916/3000 [57:26<34:38,  1.92s/it, lr: 1.0e-04 loss: 6.960e-01]
windy_storm:  64%|######3   | 1916/3000 [57:26<34:38,  1.92s/it, lr: 1.0e-04 loss: 6.960e-01]
windy_storm:  64%|######3   | 1916/3000 [57:28<34:38,  1.92s/it, lr: 1.0e-04 loss: 5.939e-01]
windy_storm:  64%|######3   | 1916/3000 [57:28<34:38,  1.92s/it, lr: 1.0e-04 loss: 5.939e-01]
windy_storm:  64%|######3   | 1917/3000 [57:28<32:53,  1.82s/it, lr: 1.0e-04 loss: 5.939e-01]
windy_storm:  64%|######3   | 1917/3000 [57:28<32:53,  1.82s/it, lr: 1.0e-04 loss: 5.939e-01]
windy_storm:  64%|######3   | 1917/3000 [57:31<32:53,  1.82s/it, lr: 1.0e-04 loss: 1.955e-01]
windy_storm:  64%|######3   | 1917/3000 [57:31<32:53,  1.82s/it, lr: 1.0e-04 loss: 1.955e-01]
windy_storm:  64%|######3   | 1918/3000 [57:31<38:38,  2.14s/it, lr: 1.0e-04 loss: 1.955e-01]
windy_storm:  64%|######3   | 1918/3000 [57:31<38:38,  2.14s/it, lr: 1.0e-04 loss: 1.955e-01]
windy_storm:  64%|######3   | 1918/3000 [57:32<38:38,  2.14s/it, lr: 1.0e-04 loss: 3.877e-02]
windy_storm:  64%|######3   | 1918/3000 [57:32<38:38,  2.14s/it, lr: 1.0e-04 loss: 3.877e-02]
windy_storm:  64%|######3   | 1919/3000 [57:32<31:33,  1.75s/it, lr: 1.0e-04 loss: 3.877e-02]
windy_storm:  64%|######3   | 1919/3000 [57:32<31:33,  1.75s/it, lr: 1.0e-04 loss: 3.877e-02]
windy_storm:  64%|######3   | 1919/3000 [57:35<31:33,  1.75s/it, lr: 1.0e-04 loss: 3.380e-01]
windy_storm:  64%|######3   | 1919/3000 [57:35<31:33,  1.75s/it, lr: 1.0e-04 loss: 3.380e-01]
windy_storm:  64%|######4   | 1920/3000 [57:37<31:31,  1.75s/it, lr: 1.0e-04 loss: 1.938e-01]
windy_storm:  64%|######4   | 1920/3000 [57:37<31:31,  1.75s/it, lr: 1.0e-04 loss: 1.938e-01]
windy_storm:  64%|######4   | 1921/3000 [57:37<23:28,  1.31s/it, lr: 1.0e-04 loss: 1.938e-01]
windy_storm:  64%|######4   | 1921/3000 [57:37<23:28,  1.31s/it, lr: 1.0e-04 loss: 1.938e-01]
windy_storm:  64%|######4   | 1921/3000 [57:38<23:28,  1.31s/it, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  64%|######4   | 1921/3000 [57:38<23:28,  1.31s/it, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  64%|######4   | 1922/3000 [57:38<24:40,  1.37s/it, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  64%|######4   | 1922/3000 [57:38<24:40,  1.37s/it, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  64%|######4   | 1922/3000 [57:40<24:40,  1.37s/it, lr: 1.0e-04 loss: 2.863e-01]
windy_storm:  64%|######4   | 1922/3000 [57:40<24:40,  1.37s/it, lr: 1.0e-04 loss: 2.863e-01]
windy_storm:  64%|######4   | 1923/3000 [57:40<26:42,  1.49s/it, lr: 1.0e-04 loss: 2.863e-01]
windy_storm:  64%|######4   | 1923/3000 [57:40<26:42,  1.49s/it, lr: 1.0e-04 loss: 2.863e-01]
windy_storm:  64%|######4   | 1923/3000 [57:43<26:42,  1.49s/it, lr: 1.0e-04 loss: 3.683e-01]
windy_storm:  64%|######4   | 1923/3000 [57:43<26:42,  1.49s/it, lr: 1.0e-04 loss: 3.683e-01]
windy_storm:  64%|######4   | 1924/3000 [57:43<34:07,  1.90s/it, lr: 1.0e-04 loss: 3.683e-01]
windy_storm:  64%|######4   | 1924/3000 [57:43<34:07,  1.90s/it, lr: 1.0e-04 loss: 3.683e-01]
windy_storm:  64%|######4   | 1924/3000 [57:44<34:07,  1.90s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  64%|######4   | 1924/3000 [57:44<34:07,  1.90s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  64%|######4   | 1925/3000 [57:44<28:24,  1.59s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  64%|######4   | 1925/3000 [57:44<28:24,  1.59s/it, lr: 1.0e-04 loss: 6.662e-01]
windy_storm:  64%|######4   | 1925/3000 [57:47<28:24,  1.59s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  64%|######4   | 1925/3000 [57:47<28:24,  1.59s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  64%|######4   | 1926/3000 [57:47<35:25,  1.98s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  64%|######4   | 1926/3000 [57:47<35:25,  1.98s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  64%|######4   | 1926/3000 [57:48<35:25,  1.98s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  64%|######4   | 1926/3000 [57:48<35:25,  1.98s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  64%|######4   | 1927/3000 [57:48<33:25,  1.87s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  64%|######4   | 1927/3000 [57:48<33:25,  1.87s/it, lr: 1.0e-04 loss: 6.461e-01]
windy_storm:  64%|######4   | 1927/3000 [57:50<33:25,  1.87s/it, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  64%|######4   | 1927/3000 [57:50<33:25,  1.87s/it, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  64%|######4   | 1928/3000 [57:50<31:46,  1.78s/it, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  64%|######4   | 1928/3000 [57:50<31:46,  1.78s/it, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  64%|######4   | 1928/3000 [57:51<31:46,  1.78s/it, lr: 1.0e-04 loss: 7.238e-01]
windy_storm:  64%|######4   | 1928/3000 [57:51<31:46,  1.78s/it, lr: 1.0e-04 loss: 7.238e-01]
windy_storm:  64%|######4   | 1929/3000 [57:51<30:46,  1.72s/it, lr: 1.0e-04 loss: 7.238e-01]
windy_storm:  64%|######4   | 1929/3000 [57:51<30:46,  1.72s/it, lr: 1.0e-04 loss: 7.238e-01]
windy_storm:  64%|######4   | 1929/3000 [57:54<30:46,  1.72s/it, lr: 1.0e-04 loss: 1.038e-01]
windy_storm:  64%|######4   | 1929/3000 [57:54<30:46,  1.72s/it, lr: 1.0e-04 loss: 1.038e-01]
windy_storm:  64%|######4   | 1930/3000 [57:57<30:44,  1.72s/it, lr: 1.0e-04 loss: 4.208e-01]
windy_storm:  64%|######4   | 1930/3000 [57:57<30:44,  1.72s/it, lr: 1.0e-04 loss: 4.208e-01]
windy_storm:  64%|######4   | 1931/3000 [57:57<28:44,  1.61s/it, lr: 1.0e-04 loss: 4.208e-01]
windy_storm:  64%|######4   | 1931/3000 [57:57<28:44,  1.61s/it, lr: 1.0e-04 loss: 4.208e-01]
windy_storm:  64%|######4   | 1931/3000 [58:00<28:44,  1.61s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  64%|######4   | 1931/3000 [58:00<28:44,  1.61s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  64%|######4   | 1932/3000 [58:00<34:36,  1.94s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  64%|######4   | 1932/3000 [58:00<34:36,  1.94s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  64%|######4   | 1932/3000 [58:01<34:36,  1.94s/it, lr: 1.0e-04 loss: 2.383e-01]
windy_storm:  64%|######4   | 1932/3000 [58:01<34:36,  1.94s/it, lr: 1.0e-04 loss: 2.383e-01]
windy_storm:  64%|######4   | 1933/3000 [58:01<29:27,  1.66s/it, lr: 1.0e-04 loss: 2.383e-01]
windy_storm:  64%|######4   | 1933/3000 [58:01<29:27,  1.66s/it, lr: 1.0e-04 loss: 2.383e-01]
windy_storm:  64%|######4   | 1933/3000 [58:04<29:27,  1.66s/it, lr: 1.0e-04 loss: 5.921e-01]
windy_storm:  64%|######4   | 1933/3000 [58:04<29:27,  1.66s/it, lr: 1.0e-04 loss: 5.921e-01]
windy_storm:  64%|######4   | 1934/3000 [58:04<36:01,  2.03s/it, lr: 1.0e-04 loss: 5.921e-01]
windy_storm:  64%|######4   | 1934/3000 [58:04<36:01,  2.03s/it, lr: 1.0e-04 loss: 5.921e-01]
windy_storm:  64%|######4   | 1934/3000 [58:06<36:01,  2.03s/it, lr: 1.0e-04 loss: 4.400e-01]
windy_storm:  64%|######4   | 1934/3000 [58:06<36:01,  2.03s/it, lr: 1.0e-04 loss: 4.400e-01]
windy_storm:  64%|######4   | 1935/3000 [58:06<33:47,  1.90s/it, lr: 1.0e-04 loss: 4.400e-01]
windy_storm:  64%|######4   | 1935/3000 [58:06<33:47,  1.90s/it, lr: 1.0e-04 loss: 4.400e-01]
windy_storm:  64%|######4   | 1935/3000 [58:07<33:47,  1.90s/it, lr: 1.0e-04 loss: 2.627e-01]
windy_storm:  64%|######4   | 1935/3000 [58:07<33:47,  1.90s/it, lr: 1.0e-04 loss: 2.627e-01]
windy_storm:  65%|######4   | 1936/3000 [58:07<28:19,  1.60s/it, lr: 1.0e-04 loss: 2.627e-01]
windy_storm:  65%|######4   | 1936/3000 [58:07<28:19,  1.60s/it, lr: 1.0e-04 loss: 2.627e-01]
windy_storm:  65%|######4   | 1936/3000 [58:10<28:19,  1.60s/it, lr: 1.0e-04 loss: 6.713e-01]
windy_storm:  65%|######4   | 1936/3000 [58:10<28:19,  1.60s/it, lr: 1.0e-04 loss: 6.713e-01]
windy_storm:  65%|######4   | 1937/3000 [58:10<35:08,  1.98s/it, lr: 1.0e-04 loss: 6.713e-01]
windy_storm:  65%|######4   | 1937/3000 [58:10<35:08,  1.98s/it, lr: 1.0e-04 loss: 6.713e-01]
windy_storm:  65%|######4   | 1937/3000 [58:11<35:08,  1.98s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  65%|######4   | 1937/3000 [58:11<35:08,  1.98s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  65%|######4   | 1938/3000 [58:11<30:20,  1.71s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  65%|######4   | 1938/3000 [58:11<30:20,  1.71s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  65%|######4   | 1938/3000 [58:12<30:20,  1.71s/it, lr: 1.0e-04 loss: 2.520e-01]
windy_storm:  65%|######4   | 1938/3000 [58:12<30:20,  1.71s/it, lr: 1.0e-04 loss: 2.520e-01]
windy_storm:  65%|######4   | 1939/3000 [58:12<29:35,  1.67s/it, lr: 1.0e-04 loss: 2.520e-01]
windy_storm:  65%|######4   | 1939/3000 [58:12<29:35,  1.67s/it, lr: 1.0e-04 loss: 2.520e-01]
windy_storm:  65%|######4   | 1939/3000 [58:13<29:35,  1.67s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  65%|######4   | 1939/3000 [58:13<29:35,  1.67s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  65%|######4   | 1940/3000 [58:15<29:33,  1.67s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  65%|######4   | 1940/3000 [58:15<29:33,  1.67s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  65%|######4   | 1941/3000 [58:15<22:08,  1.25s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  65%|######4   | 1941/3000 [58:15<22:08,  1.25s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  65%|######4   | 1941/3000 [58:18<22:08,  1.25s/it, lr: 1.0e-04 loss: 5.877e-02]
windy_storm:  65%|######4   | 1941/3000 [58:18<22:08,  1.25s/it, lr: 1.0e-04 loss: 5.877e-02]
windy_storm:  65%|######4   | 1942/3000 [58:18<29:45,  1.69s/it, lr: 1.0e-04 loss: 5.877e-02]
windy_storm:  65%|######4   | 1942/3000 [58:18<29:45,  1.69s/it, lr: 1.0e-04 loss: 5.877e-02]
windy_storm:  65%|######4   | 1942/3000 [58:18<29:45,  1.69s/it, lr: 1.0e-04 loss: 5.774e-02]
windy_storm:  65%|######4   | 1942/3000 [58:18<29:45,  1.69s/it, lr: 1.0e-04 loss: 5.774e-02]
windy_storm:  65%|######4   | 1943/3000 [58:18<25:45,  1.46s/it, lr: 1.0e-04 loss: 5.774e-02]
windy_storm:  65%|######4   | 1943/3000 [58:18<25:45,  1.46s/it, lr: 1.0e-04 loss: 5.774e-02]
windy_storm:  65%|######4   | 1943/3000 [58:20<25:45,  1.46s/it, lr: 1.0e-04 loss: 2.734e-01]
windy_storm:  65%|######4   | 1943/3000 [58:20<25:45,  1.46s/it, lr: 1.0e-04 loss: 2.734e-01]
windy_storm:  65%|######4   | 1944/3000 [58:20<26:14,  1.49s/it, lr: 1.0e-04 loss: 2.734e-01]
windy_storm:  65%|######4   | 1944/3000 [58:20<26:14,  1.49s/it, lr: 1.0e-04 loss: 2.734e-01]
windy_storm:  65%|######4   | 1944/3000 [58:23<26:14,  1.49s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm:  65%|######4   | 1944/3000 [58:23<26:14,  1.49s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm:  65%|######4   | 1945/3000 [58:23<33:59,  1.93s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm:  65%|######4   | 1945/3000 [58:23<33:59,  1.93s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm:  65%|######4   | 1945/3000 [58:25<33:59,  1.93s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  65%|######4   | 1945/3000 [58:25<33:59,  1.93s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  65%|######4   | 1946/3000 [58:25<32:12,  1.83s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  65%|######4   | 1946/3000 [58:25<32:12,  1.83s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  65%|######4   | 1946/3000 [58:25<32:12,  1.83s/it, lr: 1.0e-04 loss: 1.994e-02]
windy_storm:  65%|######4   | 1946/3000 [58:25<32:12,  1.83s/it, lr: 1.0e-04 loss: 1.994e-02]
windy_storm:  65%|######4   | 1947/3000 [58:25<26:47,  1.53s/it, lr: 1.0e-04 loss: 1.994e-02]
windy_storm:  65%|######4   | 1947/3000 [58:25<26:47,  1.53s/it, lr: 1.0e-04 loss: 1.994e-02]
windy_storm:  65%|######4   | 1947/3000 [58:28<26:47,  1.53s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  65%|######4   | 1947/3000 [58:28<26:47,  1.53s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  65%|######4   | 1948/3000 [58:28<33:55,  1.94s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  65%|######4   | 1948/3000 [58:28<33:55,  1.94s/it, lr: 1.0e-04 loss: 1.003e-01]
windy_storm:  65%|######4   | 1948/3000 [58:30<33:55,  1.94s/it, lr: 1.0e-04 loss: 4.633e-02]
windy_storm:  65%|######4   | 1948/3000 [58:30<33:55,  1.94s/it, lr: 1.0e-04 loss: 4.633e-02]
windy_storm:  65%|######4   | 1949/3000 [58:30<32:03,  1.83s/it, lr: 1.0e-04 loss: 4.633e-02]
windy_storm:  65%|######4   | 1949/3000 [58:30<32:03,  1.83s/it, lr: 1.0e-04 loss: 4.633e-02]
windy_storm:  65%|######4   | 1949/3000 [58:33<32:03,  1.83s/it, lr: 1.0e-04 loss: 2.895e-01]
windy_storm:  65%|######4   | 1949/3000 [58:33<32:03,  1.83s/it, lr: 1.0e-04 loss: 2.895e-01]
windy_storm:  65%|######5   | 1950/3000 [58:34<32:01,  1.83s/it, lr: 1.0e-04 loss: 5.675e-01]
windy_storm:  65%|######5   | 1950/3000 [58:34<32:01,  1.83s/it, lr: 1.0e-04 loss: 5.675e-01]
windy_storm:  65%|######5   | 1951/3000 [58:34<23:40,  1.35s/it, lr: 1.0e-04 loss: 5.675e-01]
windy_storm:  65%|######5   | 1951/3000 [58:34<23:40,  1.35s/it, lr: 1.0e-04 loss: 5.675e-01]
windy_storm:  65%|######5   | 1951/3000 [58:35<23:40,  1.35s/it, lr: 1.0e-04 loss: 4.392e-01]
windy_storm:  65%|######5   | 1951/3000 [58:35<23:40,  1.35s/it, lr: 1.0e-04 loss: 4.392e-01]
windy_storm:  65%|######5   | 1952/3000 [58:35<22:12,  1.27s/it, lr: 1.0e-04 loss: 4.392e-01]
windy_storm:  65%|######5   | 1952/3000 [58:35<22:12,  1.27s/it, lr: 1.0e-04 loss: 4.392e-01]
windy_storm:  65%|######5   | 1952/3000 [58:38<22:12,  1.27s/it, lr: 1.0e-04 loss: 6.407e-01]
windy_storm:  65%|######5   | 1952/3000 [58:38<22:12,  1.27s/it, lr: 1.0e-04 loss: 6.407e-01]
windy_storm:  65%|######5   | 1953/3000 [58:38<30:01,  1.72s/it, lr: 1.0e-04 loss: 6.407e-01]
windy_storm:  65%|######5   | 1953/3000 [58:38<30:01,  1.72s/it, lr: 1.0e-04 loss: 6.407e-01]
windy_storm:  65%|######5   | 1953/3000 [58:41<30:01,  1.72s/it, lr: 1.0e-04 loss: 1.732e-01]
windy_storm:  65%|######5   | 1953/3000 [58:41<30:01,  1.72s/it, lr: 1.0e-04 loss: 1.732e-01]
windy_storm:  65%|######5   | 1954/3000 [58:41<35:45,  2.05s/it, lr: 1.0e-04 loss: 1.732e-01]
windy_storm:  65%|######5   | 1954/3000 [58:41<35:45,  2.05s/it, lr: 1.0e-04 loss: 1.732e-01]
windy_storm:  65%|######5   | 1954/3000 [58:44<35:45,  2.05s/it, lr: 1.0e-04 loss: 3.464e-01]
windy_storm:  65%|######5   | 1954/3000 [58:44<35:45,  2.05s/it, lr: 1.0e-04 loss: 3.464e-01]
windy_storm:  65%|######5   | 1955/3000 [58:44<40:16,  2.31s/it, lr: 1.0e-04 loss: 3.464e-01]
windy_storm:  65%|######5   | 1955/3000 [58:44<40:16,  2.31s/it, lr: 1.0e-04 loss: 3.464e-01]
windy_storm:  65%|######5   | 1955/3000 [58:47<40:16,  2.31s/it, lr: 1.0e-04 loss: 1.494e-01]
windy_storm:  65%|######5   | 1955/3000 [58:47<40:16,  2.31s/it, lr: 1.0e-04 loss: 1.494e-01]
windy_storm:  65%|######5   | 1956/3000 [58:47<43:38,  2.51s/it, lr: 1.0e-04 loss: 1.494e-01]
windy_storm:  65%|######5   | 1956/3000 [58:47<43:38,  2.51s/it, lr: 1.0e-04 loss: 1.494e-01]
windy_storm:  65%|######5   | 1956/3000 [58:49<43:38,  2.51s/it, lr: 1.0e-04 loss: 4.852e-01]
windy_storm:  65%|######5   | 1956/3000 [58:49<43:38,  2.51s/it, lr: 1.0e-04 loss: 4.852e-01]
windy_storm:  65%|######5   | 1957/3000 [58:49<38:59,  2.24s/it, lr: 1.0e-04 loss: 4.852e-01]
windy_storm:  65%|######5   | 1957/3000 [58:49<38:59,  2.24s/it, lr: 1.0e-04 loss: 4.852e-01]
windy_storm:  65%|######5   | 1957/3000 [58:52<38:59,  2.24s/it, lr: 1.0e-04 loss: 2.104e-01]
windy_storm:  65%|######5   | 1957/3000 [58:52<38:59,  2.24s/it, lr: 1.0e-04 loss: 2.104e-01]
windy_storm:  65%|######5   | 1958/3000 [58:52<42:30,  2.45s/it, lr: 1.0e-04 loss: 2.104e-01]
windy_storm:  65%|######5   | 1958/3000 [58:52<42:30,  2.45s/it, lr: 1.0e-04 loss: 2.104e-01]
windy_storm:  65%|######5   | 1958/3000 [58:53<42:30,  2.45s/it, lr: 1.0e-04 loss: 6.854e-01]
windy_storm:  65%|######5   | 1958/3000 [58:53<42:30,  2.45s/it, lr: 1.0e-04 loss: 6.854e-01]
windy_storm:  65%|######5   | 1959/3000 [58:53<37:41,  2.17s/it, lr: 1.0e-04 loss: 6.854e-01]
windy_storm:  65%|######5   | 1959/3000 [58:53<37:41,  2.17s/it, lr: 1.0e-04 loss: 6.854e-01]
windy_storm:  65%|######5   | 1959/3000 [58:56<37:41,  2.17s/it, lr: 1.0e-04 loss: 5.900e-01]
windy_storm:  65%|######5   | 1959/3000 [58:56<37:41,  2.17s/it, lr: 1.0e-04 loss: 5.900e-01]
windy_storm:  65%|######5   | 1960/3000 [58:58<37:39,  2.17s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  65%|######5   | 1960/3000 [58:58<37:39,  2.17s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  65%|######5   | 1961/3000 [58:58<26:40,  1.54s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  65%|######5   | 1961/3000 [58:58<26:40,  1.54s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  65%|######5   | 1961/3000 [59:01<26:40,  1.54s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  65%|######5   | 1961/3000 [59:01<26:40,  1.54s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  65%|######5   | 1962/3000 [59:01<32:52,  1.90s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  65%|######5   | 1962/3000 [59:01<32:52,  1.90s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  65%|######5   | 1962/3000 [59:02<32:52,  1.90s/it, lr: 1.0e-04 loss: 7.498e-01]
windy_storm:  65%|######5   | 1962/3000 [59:02<32:52,  1.90s/it, lr: 1.0e-04 loss: 7.498e-01]
windy_storm:  65%|######5   | 1963/3000 [59:02<27:38,  1.60s/it, lr: 1.0e-04 loss: 7.498e-01]
windy_storm:  65%|######5   | 1963/3000 [59:02<27:38,  1.60s/it, lr: 1.0e-04 loss: 7.498e-01]
windy_storm:  65%|######5   | 1963/3000 [59:03<27:38,  1.60s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  65%|######5   | 1963/3000 [59:03<27:38,  1.60s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  65%|######5   | 1964/3000 [59:03<23:56,  1.39s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  65%|######5   | 1964/3000 [59:03<23:56,  1.39s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  65%|######5   | 1964/3000 [59:04<23:56,  1.39s/it, lr: 1.0e-04 loss: 6.371e-01]
windy_storm:  65%|######5   | 1964/3000 [59:04<23:56,  1.39s/it, lr: 1.0e-04 loss: 6.371e-01]
windy_storm:  66%|######5   | 1965/3000 [59:04<25:58,  1.51s/it, lr: 1.0e-04 loss: 6.371e-01]
windy_storm:  66%|######5   | 1965/3000 [59:04<25:58,  1.51s/it, lr: 1.0e-04 loss: 6.371e-01]
windy_storm:  66%|######5   | 1965/3000 [59:07<25:58,  1.51s/it, lr: 1.0e-04 loss: 3.097e-01]
windy_storm:  66%|######5   | 1965/3000 [59:07<25:58,  1.51s/it, lr: 1.0e-04 loss: 3.097e-01]
windy_storm:  66%|######5   | 1966/3000 [59:07<33:02,  1.92s/it, lr: 1.0e-04 loss: 3.097e-01]
windy_storm:  66%|######5   | 1966/3000 [59:07<33:02,  1.92s/it, lr: 1.0e-04 loss: 3.097e-01]
windy_storm:  66%|######5   | 1966/3000 [59:09<33:02,  1.92s/it, lr: 1.0e-04 loss: 3.557e-01]
windy_storm:  66%|######5   | 1966/3000 [59:09<33:02,  1.92s/it, lr: 1.0e-04 loss: 3.557e-01]
windy_storm:  66%|######5   | 1967/3000 [59:09<31:23,  1.82s/it, lr: 1.0e-04 loss: 3.557e-01]
windy_storm:  66%|######5   | 1967/3000 [59:09<31:23,  1.82s/it, lr: 1.0e-04 loss: 3.557e-01]
windy_storm:  66%|######5   | 1967/3000 [59:10<31:23,  1.82s/it, lr: 1.0e-04 loss: 1.458e-01]
windy_storm:  66%|######5   | 1967/3000 [59:10<31:23,  1.82s/it, lr: 1.0e-04 loss: 1.458e-01]
windy_storm:  66%|######5   | 1968/3000 [59:10<26:02,  1.51s/it, lr: 1.0e-04 loss: 1.458e-01]
windy_storm:  66%|######5   | 1968/3000 [59:10<26:02,  1.51s/it, lr: 1.0e-04 loss: 1.458e-01]
windy_storm:  66%|######5   | 1968/3000 [59:10<26:02,  1.51s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  66%|######5   | 1968/3000 [59:10<26:02,  1.51s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  66%|######5   | 1969/3000 [59:10<22:13,  1.29s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  66%|######5   | 1969/3000 [59:10<22:13,  1.29s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  66%|######5   | 1969/3000 [59:12<22:13,  1.29s/it, lr: 1.0e-04 loss: 6.730e-01]
windy_storm:  66%|######5   | 1969/3000 [59:12<22:13,  1.29s/it, lr: 1.0e-04 loss: 6.730e-01]
windy_storm:  66%|######5   | 1970/3000 [59:13<22:11,  1.29s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  66%|######5   | 1970/3000 [59:13<22:11,  1.29s/it, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  66%|######5   | 1971/3000 [59:13<15:00,  1.14it/s, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  66%|######5   | 1971/3000 [59:13<15:00,  1.14it/s, lr: 1.0e-04 loss: 1.016e-01]
windy_storm:  66%|######5   | 1971/3000 [59:16<15:00,  1.14it/s, lr: 1.0e-04 loss: 1.914e-01]
windy_storm:  66%|######5   | 1971/3000 [59:16<15:00,  1.14it/s, lr: 1.0e-04 loss: 1.914e-01]
windy_storm:  66%|######5   | 1972/3000 [59:16<23:37,  1.38s/it, lr: 1.0e-04 loss: 1.914e-01]
windy_storm:  66%|######5   | 1972/3000 [59:16<23:37,  1.38s/it, lr: 1.0e-04 loss: 1.914e-01]
windy_storm:  66%|######5   | 1972/3000 [59:16<23:37,  1.38s/it, lr: 1.0e-04 loss: 6.111e-01]
windy_storm:  66%|######5   | 1972/3000 [59:16<23:37,  1.38s/it, lr: 1.0e-04 loss: 6.111e-01]
windy_storm:  66%|######5   | 1973/3000 [59:16<21:07,  1.23s/it, lr: 1.0e-04 loss: 6.111e-01]
windy_storm:  66%|######5   | 1973/3000 [59:16<21:07,  1.23s/it, lr: 1.0e-04 loss: 6.111e-01]
windy_storm:  66%|######5   | 1973/3000 [59:18<21:07,  1.23s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  66%|######5   | 1973/3000 [59:18<21:07,  1.23s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  66%|######5   | 1974/3000 [59:18<22:46,  1.33s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  66%|######5   | 1974/3000 [59:18<22:46,  1.33s/it, lr: 1.0e-04 loss: 5.907e-01]
windy_storm:  66%|######5   | 1974/3000 [59:19<22:46,  1.33s/it, lr: 1.0e-04 loss: 1.146e-01]
windy_storm:  66%|######5   | 1974/3000 [59:19<22:46,  1.33s/it, lr: 1.0e-04 loss: 1.146e-01]
windy_storm:  66%|######5   | 1975/3000 [59:19<20:04,  1.17s/it, lr: 1.0e-04 loss: 1.146e-01]
windy_storm:  66%|######5   | 1975/3000 [59:19<20:04,  1.17s/it, lr: 1.0e-04 loss: 1.146e-01]
windy_storm:  66%|######5   | 1975/3000 [59:20<20:04,  1.17s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  66%|######5   | 1975/3000 [59:20<20:04,  1.17s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  66%|######5   | 1976/3000 [59:20<18:03,  1.06s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  66%|######5   | 1976/3000 [59:20<18:03,  1.06s/it, lr: 1.0e-04 loss: 4.572e-01]
windy_storm:  66%|######5   | 1976/3000 [59:23<18:03,  1.06s/it, lr: 1.0e-04 loss: 2.021e-01]
windy_storm:  66%|######5   | 1976/3000 [59:23<18:03,  1.06s/it, lr: 1.0e-04 loss: 2.021e-01]
windy_storm:  66%|######5   | 1977/3000 [59:23<27:44,  1.63s/it, lr: 1.0e-04 loss: 2.021e-01]
windy_storm:  66%|######5   | 1977/3000 [59:23<27:44,  1.63s/it, lr: 1.0e-04 loss: 2.021e-01]
windy_storm:  66%|######5   | 1977/3000 [59:24<27:44,  1.63s/it, lr: 1.0e-04 loss: 3.915e-02]
windy_storm:  66%|######5   | 1977/3000 [59:24<27:44,  1.63s/it, lr: 1.0e-04 loss: 3.915e-02]
windy_storm:  66%|######5   | 1978/3000 [59:24<28:19,  1.66s/it, lr: 1.0e-04 loss: 3.915e-02]
windy_storm:  66%|######5   | 1978/3000 [59:24<28:19,  1.66s/it, lr: 1.0e-04 loss: 3.915e-02]
windy_storm:  66%|######5   | 1978/3000 [59:26<28:19,  1.66s/it, lr: 1.0e-04 loss: 3.435e-01]
windy_storm:  66%|######5   | 1978/3000 [59:26<28:19,  1.66s/it, lr: 1.0e-04 loss: 3.435e-01]
windy_storm:  66%|######5   | 1979/3000 [59:26<27:55,  1.64s/it, lr: 1.0e-04 loss: 3.435e-01]
windy_storm:  66%|######5   | 1979/3000 [59:26<27:55,  1.64s/it, lr: 1.0e-04 loss: 3.435e-01]
windy_storm:  66%|######5   | 1979/3000 [59:27<27:55,  1.64s/it, lr: 1.0e-04 loss: 5.798e-01]
windy_storm:  66%|######5   | 1979/3000 [59:27<27:55,  1.64s/it, lr: 1.0e-04 loss: 5.798e-01]
windy_storm:  66%|######6   | 1980/3000 [59:28<27:53,  1.64s/it, lr: 1.0e-04 loss: 1.899e-01]
windy_storm:  66%|######6   | 1980/3000 [59:28<27:53,  1.64s/it, lr: 1.0e-04 loss: 1.899e-01]
windy_storm:  66%|######6   | 1981/3000 [59:28<18:07,  1.07s/it, lr: 1.0e-04 loss: 1.899e-01]
windy_storm:  66%|######6   | 1981/3000 [59:28<18:07,  1.07s/it, lr: 1.0e-04 loss: 1.899e-01]
windy_storm:  66%|######6   | 1981/3000 [59:31<18:07,  1.07s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  66%|######6   | 1981/3000 [59:31<18:07,  1.07s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  66%|######6   | 1982/3000 [59:31<26:03,  1.54s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  66%|######6   | 1982/3000 [59:31<26:03,  1.54s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  66%|######6   | 1982/3000 [59:32<26:03,  1.54s/it, lr: 1.0e-04 loss: 8.392e-02]
windy_storm:  66%|######6   | 1982/3000 [59:32<26:03,  1.54s/it, lr: 1.0e-04 loss: 8.392e-02]
windy_storm:  66%|######6   | 1983/3000 [59:32<22:32,  1.33s/it, lr: 1.0e-04 loss: 8.392e-02]
windy_storm:  66%|######6   | 1983/3000 [59:32<22:32,  1.33s/it, lr: 1.0e-04 loss: 8.392e-02]
windy_storm:  66%|######6   | 1983/3000 [59:35<22:32,  1.33s/it, lr: 1.0e-04 loss: 5.203e-01]
windy_storm:  66%|######6   | 1983/3000 [59:35<22:32,  1.33s/it, lr: 1.0e-04 loss: 5.203e-01]
windy_storm:  66%|######6   | 1984/3000 [59:35<30:21,  1.79s/it, lr: 1.0e-04 loss: 5.203e-01]
windy_storm:  66%|######6   | 1984/3000 [59:35<30:21,  1.79s/it, lr: 1.0e-04 loss: 5.203e-01]
windy_storm:  66%|######6   | 1984/3000 [59:37<30:21,  1.79s/it, lr: 1.0e-04 loss: 6.085e-01]
windy_storm:  66%|######6   | 1984/3000 [59:37<30:21,  1.79s/it, lr: 1.0e-04 loss: 6.085e-01]
windy_storm:  66%|######6   | 1985/3000 [59:37<29:20,  1.73s/it, lr: 1.0e-04 loss: 6.085e-01]
windy_storm:  66%|######6   | 1985/3000 [59:37<29:20,  1.73s/it, lr: 1.0e-04 loss: 6.085e-01]
windy_storm:  66%|######6   | 1985/3000 [59:37<29:20,  1.73s/it, lr: 1.0e-04 loss: 4.514e-01]
windy_storm:  66%|######6   | 1985/3000 [59:37<29:20,  1.73s/it, lr: 1.0e-04 loss: 4.514e-01]
windy_storm:  66%|######6   | 1986/3000 [59:37<25:01,  1.48s/it, lr: 1.0e-04 loss: 4.514e-01]
windy_storm:  66%|######6   | 1986/3000 [59:37<25:01,  1.48s/it, lr: 1.0e-04 loss: 4.514e-01]
windy_storm:  66%|######6   | 1986/3000 [59:38<25:01,  1.48s/it, lr: 1.0e-04 loss: 5.403e-01]
windy_storm:  66%|######6   | 1986/3000 [59:38<25:01,  1.48s/it, lr: 1.0e-04 loss: 5.403e-01]
windy_storm:  66%|######6   | 1987/3000 [59:38<21:29,  1.27s/it, lr: 1.0e-04 loss: 5.403e-01]
windy_storm:  66%|######6   | 1987/3000 [59:38<21:29,  1.27s/it, lr: 1.0e-04 loss: 5.403e-01]
windy_storm:  66%|######6   | 1987/3000 [59:39<21:29,  1.27s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  66%|######6   | 1987/3000 [59:39<21:29,  1.27s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  66%|######6   | 1988/3000 [59:39<19:05,  1.13s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  66%|######6   | 1988/3000 [59:39<19:05,  1.13s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  66%|######6   | 1988/3000 [59:41<19:05,  1.13s/it, lr: 1.0e-04 loss: 6.485e-01]
windy_storm:  66%|######6   | 1988/3000 [59:41<19:05,  1.13s/it, lr: 1.0e-04 loss: 6.485e-01]
windy_storm:  66%|######6   | 1989/3000 [59:41<21:14,  1.26s/it, lr: 1.0e-04 loss: 6.485e-01]
windy_storm:  66%|######6   | 1989/3000 [59:41<21:14,  1.26s/it, lr: 1.0e-04 loss: 6.485e-01]
windy_storm:  66%|######6   | 1989/3000 [59:41<21:14,  1.26s/it, lr: 1.0e-04 loss: 5.896e-01]
windy_storm:  66%|######6   | 1989/3000 [59:41<21:14,  1.26s/it, lr: 1.0e-04 loss: 5.896e-01]
windy_storm:  66%|######6   | 1990/3000 [59:43<21:13,  1.26s/it, lr: 1.0e-04 loss: 2.921e-01]
windy_storm:  66%|######6   | 1990/3000 [59:43<21:13,  1.26s/it, lr: 1.0e-04 loss: 2.921e-01]
windy_storm:  66%|######6   | 1991/3000 [59:43<17:42,  1.05s/it, lr: 1.0e-04 loss: 2.921e-01]
windy_storm:  66%|######6   | 1991/3000 [59:43<17:42,  1.05s/it, lr: 1.0e-04 loss: 2.921e-01]
windy_storm:  66%|######6   | 1991/3000 [59:45<17:42,  1.05s/it, lr: 1.0e-04 loss: 3.861e-01]
windy_storm:  66%|######6   | 1991/3000 [59:45<17:42,  1.05s/it, lr: 1.0e-04 loss: 3.861e-01]
windy_storm:  66%|######6   | 1992/3000 [59:45<19:57,  1.19s/it, lr: 1.0e-04 loss: 3.861e-01]
windy_storm:  66%|######6   | 1992/3000 [59:45<19:57,  1.19s/it, lr: 1.0e-04 loss: 3.861e-01]
windy_storm:  66%|######6   | 1992/3000 [59:46<19:57,  1.19s/it, lr: 1.0e-04 loss: 1.979e-01]
windy_storm:  66%|######6   | 1992/3000 [59:46<19:57,  1.19s/it, lr: 1.0e-04 loss: 1.979e-01]
windy_storm:  66%|######6   | 1993/3000 [59:46<19:23,  1.16s/it, lr: 1.0e-04 loss: 1.979e-01]
windy_storm:  66%|######6   | 1993/3000 [59:46<19:23,  1.16s/it, lr: 1.0e-04 loss: 1.979e-01]
windy_storm:  66%|######6   | 1993/3000 [59:46<19:23,  1.16s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  66%|######6   | 1993/3000 [59:46<19:23,  1.16s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  66%|######6   | 1994/3000 [59:46<17:51,  1.07s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  66%|######6   | 1994/3000 [59:46<17:51,  1.07s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  66%|######6   | 1994/3000 [59:47<17:51,  1.07s/it, lr: 1.0e-04 loss: 5.960e-01]
windy_storm:  66%|######6   | 1994/3000 [59:47<17:51,  1.07s/it, lr: 1.0e-04 loss: 5.960e-01]
windy_storm:  66%|######6   | 1995/3000 [59:47<16:46,  1.00s/it, lr: 1.0e-04 loss: 5.960e-01]
windy_storm:  66%|######6   | 1995/3000 [59:47<16:46,  1.00s/it, lr: 1.0e-04 loss: 5.960e-01]
windy_storm:  66%|######6   | 1995/3000 [59:48<16:46,  1.00s/it, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  66%|######6   | 1995/3000 [59:48<16:46,  1.00s/it, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  67%|######6   | 1996/3000 [59:48<15:55,  1.05it/s, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  67%|######6   | 1996/3000 [59:48<15:55,  1.05it/s, lr: 1.0e-04 loss: 3.601e-01]
windy_storm:  67%|######6   | 1996/3000 [59:51<15:55,  1.05it/s, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  67%|######6   | 1996/3000 [59:51<15:55,  1.05it/s, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  67%|######6   | 1997/3000 [59:51<25:53,  1.55s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  67%|######6   | 1997/3000 [59:51<25:53,  1.55s/it, lr: 1.0e-04 loss: 5.902e-01]
windy_storm:  67%|######6   | 1997/3000 [59:52<25:53,  1.55s/it, lr: 1.0e-04 loss: 5.335e-01]
windy_storm:  67%|######6   | 1997/3000 [59:52<25:53,  1.55s/it, lr: 1.0e-04 loss: 5.335e-01]
windy_storm:  67%|######6   | 1998/3000 [59:52<22:19,  1.34s/it, lr: 1.0e-04 loss: 5.335e-01]
windy_storm:  67%|######6   | 1998/3000 [59:52<22:19,  1.34s/it, lr: 1.0e-04 loss: 5.335e-01]
windy_storm:  67%|######6   | 1998/3000 [59:53<22:19,  1.34s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  67%|######6   | 1998/3000 [59:53<22:19,  1.34s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  67%|######6   | 1999/3000 [59:53<19:27,  1.17s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  67%|######6   | 1999/3000 [59:53<19:27,  1.17s/it, lr: 1.0e-04 loss: 1.373e-01]
windy_storm:  67%|######6   | 1999/3000 [59:53<19:27,  1.17s/it, lr: 1.0e-04 loss: 4.887e-01]
windy_storm:  67%|######6   | 1999/3000 [59:53<19:27,  1.17s/it, lr: 1.0e-04 loss: 4.887e-01]
Saving at step 2000
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000002000.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000001000.safetensors

windy_storm:  67%|######6   | 2000/3000 [59:55<19:26,  1.17s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  67%|######6   | 2000/3000 [59:55<19:26,  1.17s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  67%|######6   | 2001/3000 [59:55<17:17,  1.04s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  67%|######6   | 2001/3000 [59:55<17:17,  1.04s/it, lr: 1.0e-04 loss: 5.996e-01]
windy_storm:  67%|######6   | 2001/3000 [59:56<17:17,  1.04s/it, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  67%|######6   | 2001/3000 [59:56<17:17,  1.04s/it, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  67%|######6   | 2002/3000 [59:56<16:05,  1.03it/s, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  67%|######6   | 2002/3000 [59:56<16:05,  1.03it/s, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  67%|######6   | 2002/3000 [59:57<16:05,  1.03it/s, lr: 1.0e-04 loss: 2.234e-02]
windy_storm:  67%|######6   | 2002/3000 [59:57<16:05,  1.03it/s, lr: 1.0e-04 loss: 2.234e-02]
windy_storm:  67%|######6   | 2003/3000 [59:57<15:26,  1.08it/s, lr: 1.0e-04 loss: 2.234e-02]
windy_storm:  67%|######6   | 2003/3000 [59:57<15:26,  1.08it/s, lr: 1.0e-04 loss: 2.234e-02]
windy_storm:  67%|######6   | 2003/3000 [59:58<15:26,  1.08it/s, lr: 1.0e-04 loss: 4.330e-01]
windy_storm:  67%|######6   | 2003/3000 [59:58<15:26,  1.08it/s, lr: 1.0e-04 loss: 4.330e-01]
windy_storm:  67%|######6   | 2004/3000 [59:58<18:20,  1.10s/it, lr: 1.0e-04 loss: 4.330e-01]
windy_storm:  67%|######6   | 2004/3000 [59:58<18:20,  1.10s/it, lr: 1.0e-04 loss: 4.330e-01]
windy_storm:  67%|######6   | 2004/3000 [1:00:00<18:20,  1.10s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  67%|######6   | 2004/3000 [1:00:00<18:20,  1.10s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  67%|######6   | 2005/3000 [1:00:00<20:20,  1.23s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  67%|######6   | 2005/3000 [1:00:00<20:20,  1.23s/it, lr: 1.0e-04 loss: 6.336e-01]
windy_storm:  67%|######6   | 2005/3000 [1:00:03<20:20,  1.23s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  67%|######6   | 2005/3000 [1:00:03<20:20,  1.23s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  67%|######6   | 2006/3000 [1:00:03<28:41,  1.73s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  67%|######6   | 2006/3000 [1:00:03<28:41,  1.73s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  67%|######6   | 2006/3000 [1:00:05<28:41,  1.73s/it, lr: 1.0e-04 loss: 1.341e-01]
windy_storm:  67%|######6   | 2006/3000 [1:00:05<28:41,  1.73s/it, lr: 1.0e-04 loss: 1.341e-01]
windy_storm:  67%|######6   | 2007/3000 [1:00:05<27:55,  1.69s/it, lr: 1.0e-04 loss: 1.341e-01]
windy_storm:  67%|######6   | 2007/3000 [1:00:05<27:55,  1.69s/it, lr: 1.0e-04 loss: 1.341e-01]
windy_storm:  67%|######6   | 2007/3000 [1:00:05<27:55,  1.69s/it, lr: 1.0e-04 loss: 3.848e-01]
windy_storm:  67%|######6   | 2007/3000 [1:00:05<27:55,  1.69s/it, lr: 1.0e-04 loss: 3.848e-01]
windy_storm:  67%|######6   | 2008/3000 [1:00:05<23:25,  1.42s/it, lr: 1.0e-04 loss: 3.848e-01]
windy_storm:  67%|######6   | 2008/3000 [1:00:05<23:25,  1.42s/it, lr: 1.0e-04 loss: 3.848e-01]
windy_storm:  67%|######6   | 2008/3000 [1:00:06<23:25,  1.42s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  67%|######6   | 2008/3000 [1:00:06<23:25,  1.42s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  67%|######6   | 2009/3000 [1:00:06<20:29,  1.24s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  67%|######6   | 2009/3000 [1:00:06<20:29,  1.24s/it, lr: 1.0e-04 loss: 6.963e-01]
windy_storm:  67%|######6   | 2009/3000 [1:00:09<20:29,  1.24s/it, lr: 1.0e-04 loss: 2.256e-01]
windy_storm:  67%|######6   | 2009/3000 [1:00:09<20:29,  1.24s/it, lr: 1.0e-04 loss: 2.256e-01]
windy_storm:  67%|######7   | 2010/3000 [1:00:11<20:28,  1.24s/it, lr: 1.0e-04 loss: 5.945e-01]
windy_storm:  67%|######7   | 2010/3000 [1:00:11<20:28,  1.24s/it, lr: 1.0e-04 loss: 5.945e-01]
windy_storm:  67%|######7   | 2011/3000 [1:00:11<17:00,  1.03s/it, lr: 1.0e-04 loss: 5.945e-01]
windy_storm:  67%|######7   | 2011/3000 [1:00:11<17:00,  1.03s/it, lr: 1.0e-04 loss: 5.945e-01]
windy_storm:  67%|######7   | 2011/3000 [1:00:14<17:00,  1.03s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  67%|######7   | 2011/3000 [1:00:14<17:00,  1.03s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  67%|######7   | 2012/3000 [1:00:14<24:52,  1.51s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  67%|######7   | 2012/3000 [1:00:14<24:52,  1.51s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  67%|######7   | 2012/3000 [1:00:17<24:52,  1.51s/it, lr: 1.0e-04 loss: 1.162e-01]
windy_storm:  67%|######7   | 2012/3000 [1:00:17<24:52,  1.51s/it, lr: 1.0e-04 loss: 1.162e-01]
windy_storm:  67%|######7   | 2013/3000 [1:00:17<31:22,  1.91s/it, lr: 1.0e-04 loss: 1.162e-01]
windy_storm:  67%|######7   | 2013/3000 [1:00:17<31:22,  1.91s/it, lr: 1.0e-04 loss: 1.162e-01]
windy_storm:  67%|######7   | 2013/3000 [1:00:18<31:22,  1.91s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  67%|######7   | 2013/3000 [1:00:18<31:22,  1.91s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  67%|######7   | 2014/3000 [1:00:18<29:41,  1.81s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  67%|######7   | 2014/3000 [1:00:18<29:41,  1.81s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  67%|######7   | 2014/3000 [1:00:19<29:41,  1.81s/it, lr: 1.0e-04 loss: 3.418e-01]
windy_storm:  67%|######7   | 2014/3000 [1:00:19<29:41,  1.81s/it, lr: 1.0e-04 loss: 3.418e-01]
windy_storm:  67%|######7   | 2015/3000 [1:00:19<24:51,  1.51s/it, lr: 1.0e-04 loss: 3.418e-01]
windy_storm:  67%|######7   | 2015/3000 [1:00:19<24:51,  1.51s/it, lr: 1.0e-04 loss: 3.418e-01]
windy_storm:  67%|######7   | 2015/3000 [1:00:22<24:51,  1.51s/it, lr: 1.0e-04 loss: 1.892e-01]
windy_storm:  67%|######7   | 2015/3000 [1:00:22<24:51,  1.51s/it, lr: 1.0e-04 loss: 1.892e-01]
windy_storm:  67%|######7   | 2016/3000 [1:00:22<31:41,  1.93s/it, lr: 1.0e-04 loss: 1.892e-01]
windy_storm:  67%|######7   | 2016/3000 [1:00:22<31:41,  1.93s/it, lr: 1.0e-04 loss: 1.892e-01]
windy_storm:  67%|######7   | 2016/3000 [1:00:23<31:41,  1.93s/it, lr: 1.0e-04 loss: 1.124e-01]
windy_storm:  67%|######7   | 2016/3000 [1:00:23<31:41,  1.93s/it, lr: 1.0e-04 loss: 1.124e-01]
windy_storm:  67%|######7   | 2017/3000 [1:00:23<29:55,  1.83s/it, lr: 1.0e-04 loss: 1.124e-01]
windy_storm:  67%|######7   | 2017/3000 [1:00:23<29:55,  1.83s/it, lr: 1.0e-04 loss: 1.124e-01]
windy_storm:  67%|######7   | 2017/3000 [1:00:24<29:55,  1.83s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  67%|######7   | 2017/3000 [1:00:24<29:55,  1.83s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  67%|######7   | 2018/3000 [1:00:24<25:01,  1.53s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  67%|######7   | 2018/3000 [1:00:24<25:01,  1.53s/it, lr: 1.0e-04 loss: 6.131e-01]
windy_storm:  67%|######7   | 2018/3000 [1:00:27<25:01,  1.53s/it, lr: 1.0e-04 loss: 6.644e-01]
windy_storm:  67%|######7   | 2018/3000 [1:00:27<25:01,  1.53s/it, lr: 1.0e-04 loss: 6.644e-01]
windy_storm:  67%|######7   | 2019/3000 [1:00:27<31:58,  1.96s/it, lr: 1.0e-04 loss: 6.644e-01]
windy_storm:  67%|######7   | 2019/3000 [1:00:27<31:58,  1.96s/it, lr: 1.0e-04 loss: 6.644e-01]
windy_storm:  67%|######7   | 2019/3000 [1:00:30<31:58,  1.96s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  67%|######7   | 2019/3000 [1:00:30<31:58,  1.96s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  67%|######7   | 2020/3000 [1:00:31<31:56,  1.96s/it, lr: 1.0e-04 loss: 3.166e-01]
windy_storm:  67%|######7   | 2020/3000 [1:00:31<31:56,  1.96s/it, lr: 1.0e-04 loss: 3.166e-01]
windy_storm:  67%|######7   | 2021/3000 [1:00:31<20:06,  1.23s/it, lr: 1.0e-04 loss: 3.166e-01]
windy_storm:  67%|######7   | 2021/3000 [1:00:31<20:06,  1.23s/it, lr: 1.0e-04 loss: 3.166e-01]
windy_storm:  67%|######7   | 2021/3000 [1:00:32<20:06,  1.23s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  67%|######7   | 2021/3000 [1:00:32<20:06,  1.23s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  67%|######7   | 2022/3000 [1:00:32<18:25,  1.13s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  67%|######7   | 2022/3000 [1:00:32<18:25,  1.13s/it, lr: 1.0e-04 loss: 1.436e-01]
windy_storm:  67%|######7   | 2022/3000 [1:00:33<18:25,  1.13s/it, lr: 1.0e-04 loss: 4.317e-01]
windy_storm:  67%|######7   | 2022/3000 [1:00:33<18:25,  1.13s/it, lr: 1.0e-04 loss: 4.317e-01]
windy_storm:  67%|######7   | 2023/3000 [1:00:33<16:49,  1.03s/it, lr: 1.0e-04 loss: 4.317e-01]
windy_storm:  67%|######7   | 2023/3000 [1:00:33<16:49,  1.03s/it, lr: 1.0e-04 loss: 4.317e-01]
windy_storm:  67%|######7   | 2023/3000 [1:00:33<16:49,  1.03s/it, lr: 1.0e-04 loss: 1.537e-01]
windy_storm:  67%|######7   | 2023/3000 [1:00:33<16:49,  1.03s/it, lr: 1.0e-04 loss: 1.537e-01]
windy_storm:  67%|######7   | 2024/3000 [1:00:33<15:34,  1.04it/s, lr: 1.0e-04 loss: 1.537e-01]
windy_storm:  67%|######7   | 2024/3000 [1:00:33<15:34,  1.04it/s, lr: 1.0e-04 loss: 1.537e-01]
windy_storm:  67%|######7   | 2024/3000 [1:00:36<15:34,  1.04it/s, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  67%|######7   | 2024/3000 [1:00:36<15:34,  1.04it/s, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  68%|######7   | 2025/3000 [1:00:36<24:21,  1.50s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  68%|######7   | 2025/3000 [1:00:36<24:21,  1.50s/it, lr: 1.0e-04 loss: 1.904e-01]
windy_storm:  68%|######7   | 2025/3000 [1:00:38<24:21,  1.50s/it, lr: 1.0e-04 loss: 1.019e-01]
windy_storm:  68%|######7   | 2025/3000 [1:00:38<24:21,  1.50s/it, lr: 1.0e-04 loss: 1.019e-01]
windy_storm:  68%|######7   | 2026/3000 [1:00:38<24:41,  1.52s/it, lr: 1.0e-04 loss: 1.019e-01]
windy_storm:  68%|######7   | 2026/3000 [1:00:38<24:41,  1.52s/it, lr: 1.0e-04 loss: 1.019e-01]
windy_storm:  68%|######7   | 2026/3000 [1:00:41<24:41,  1.52s/it, lr: 1.0e-04 loss: 6.127e-01]
windy_storm:  68%|######7   | 2026/3000 [1:00:41<24:41,  1.52s/it, lr: 1.0e-04 loss: 6.127e-01]
windy_storm:  68%|######7   | 2027/3000 [1:00:41<31:07,  1.92s/it, lr: 1.0e-04 loss: 6.127e-01]
windy_storm:  68%|######7   | 2027/3000 [1:00:41<31:07,  1.92s/it, lr: 1.0e-04 loss: 6.127e-01]
windy_storm:  68%|######7   | 2027/3000 [1:00:44<31:07,  1.92s/it, lr: 1.0e-04 loss: 4.094e-01]
windy_storm:  68%|######7   | 2027/3000 [1:00:44<31:07,  1.92s/it, lr: 1.0e-04 loss: 4.094e-01]
windy_storm:  68%|######7   | 2028/3000 [1:00:44<36:15,  2.24s/it, lr: 1.0e-04 loss: 4.094e-01]
windy_storm:  68%|######7   | 2028/3000 [1:00:44<36:15,  2.24s/it, lr: 1.0e-04 loss: 4.094e-01]
windy_storm:  68%|######7   | 2028/3000 [1:00:45<36:15,  2.24s/it, lr: 1.0e-04 loss: 1.476e-01]
windy_storm:  68%|######7   | 2028/3000 [1:00:45<36:15,  2.24s/it, lr: 1.0e-04 loss: 1.476e-01]
windy_storm:  68%|######7   | 2029/3000 [1:00:45<33:24,  2.06s/it, lr: 1.0e-04 loss: 1.476e-01]
windy_storm:  68%|######7   | 2029/3000 [1:00:45<33:24,  2.06s/it, lr: 1.0e-04 loss: 1.476e-01]
windy_storm:  68%|######7   | 2029/3000 [1:00:48<33:24,  2.06s/it, lr: 1.0e-04 loss: 8.413e-02]
windy_storm:  68%|######7   | 2029/3000 [1:00:48<33:24,  2.06s/it, lr: 1.0e-04 loss: 8.413e-02]
windy_storm:  68%|######7   | 2030/3000 [1:00:51<33:22,  2.06s/it, lr: 1.0e-04 loss: 4.465e-01]
windy_storm:  68%|######7   | 2030/3000 [1:00:51<33:22,  2.06s/it, lr: 1.0e-04 loss: 4.465e-01]
windy_storm:  68%|######7   | 2031/3000 [1:00:51<28:52,  1.79s/it, lr: 1.0e-04 loss: 4.465e-01]
windy_storm:  68%|######7   | 2031/3000 [1:00:51<28:52,  1.79s/it, lr: 1.0e-04 loss: 4.465e-01]
windy_storm:  68%|######7   | 2031/3000 [1:00:54<28:52,  1.79s/it, lr: 1.0e-04 loss: 4.646e-01]
windy_storm:  68%|######7   | 2031/3000 [1:00:54<28:52,  1.79s/it, lr: 1.0e-04 loss: 4.646e-01]
windy_storm:  68%|######7   | 2032/3000 [1:00:54<33:33,  2.08s/it, lr: 1.0e-04 loss: 4.646e-01]
windy_storm:  68%|######7   | 2032/3000 [1:00:54<33:33,  2.08s/it, lr: 1.0e-04 loss: 4.646e-01]
windy_storm:  68%|######7   | 2032/3000 [1:00:55<33:33,  2.08s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  68%|######7   | 2032/3000 [1:00:55<33:33,  2.08s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  68%|######7   | 2033/3000 [1:00:55<27:52,  1.73s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  68%|######7   | 2033/3000 [1:00:55<27:52,  1.73s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  68%|######7   | 2033/3000 [1:00:58<27:52,  1.73s/it, lr: 1.0e-04 loss: 1.886e-02]
windy_storm:  68%|######7   | 2033/3000 [1:00:58<27:52,  1.73s/it, lr: 1.0e-04 loss: 1.886e-02]
windy_storm:  68%|######7   | 2034/3000 [1:00:58<32:56,  2.05s/it, lr: 1.0e-04 loss: 1.886e-02]
windy_storm:  68%|######7   | 2034/3000 [1:00:58<32:56,  2.05s/it, lr: 1.0e-04 loss: 1.886e-02]
windy_storm:  68%|######7   | 2034/3000 [1:00:59<32:56,  2.05s/it, lr: 1.0e-04 loss: 3.393e-01]
windy_storm:  68%|######7   | 2034/3000 [1:00:59<32:56,  2.05s/it, lr: 1.0e-04 loss: 3.393e-01]
windy_storm:  68%|######7   | 2035/3000 [1:00:59<30:49,  1.92s/it, lr: 1.0e-04 loss: 3.393e-01]
windy_storm:  68%|######7   | 2035/3000 [1:00:59<30:49,  1.92s/it, lr: 1.0e-04 loss: 3.393e-01]
windy_storm:  68%|######7   | 2035/3000 [1:01:02<30:49,  1.92s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  68%|######7   | 2035/3000 [1:01:02<30:49,  1.92s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  68%|######7   | 2036/3000 [1:01:02<35:18,  2.20s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  68%|######7   | 2036/3000 [1:01:02<35:18,  2.20s/it, lr: 1.0e-04 loss: 1.374e-01]
windy_storm:  68%|######7   | 2036/3000 [1:01:04<35:18,  2.20s/it, lr: 1.0e-04 loss: 5.807e-01]
windy_storm:  68%|######7   | 2036/3000 [1:01:04<35:18,  2.20s/it, lr: 1.0e-04 loss: 5.807e-01]
windy_storm:  68%|######7   | 2037/3000 [1:01:04<32:12,  2.01s/it, lr: 1.0e-04 loss: 5.807e-01]
windy_storm:  68%|######7   | 2037/3000 [1:01:04<32:12,  2.01s/it, lr: 1.0e-04 loss: 5.807e-01]
windy_storm:  68%|######7   | 2037/3000 [1:01:05<32:12,  2.01s/it, lr: 1.0e-04 loss: 6.235e-01]
windy_storm:  68%|######7   | 2037/3000 [1:01:05<32:12,  2.01s/it, lr: 1.0e-04 loss: 6.235e-01]
windy_storm:  68%|######7   | 2038/3000 [1:01:05<30:00,  1.87s/it, lr: 1.0e-04 loss: 6.235e-01]
windy_storm:  68%|######7   | 2038/3000 [1:01:05<30:00,  1.87s/it, lr: 1.0e-04 loss: 6.235e-01]
windy_storm:  68%|######7   | 2038/3000 [1:01:07<30:00,  1.87s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  68%|######7   | 2038/3000 [1:01:07<30:00,  1.87s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  68%|######7   | 2039/3000 [1:01:07<28:36,  1.79s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  68%|######7   | 2039/3000 [1:01:07<28:36,  1.79s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  68%|######7   | 2039/3000 [1:01:08<28:36,  1.79s/it, lr: 1.0e-04 loss: 4.582e-01]
windy_storm:  68%|######7   | 2039/3000 [1:01:08<28:36,  1.79s/it, lr: 1.0e-04 loss: 4.582e-01]
windy_storm:  68%|######8   | 2040/3000 [1:01:10<28:34,  1.79s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:  68%|######8   | 2040/3000 [1:01:10<28:34,  1.79s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:  68%|######8   | 2041/3000 [1:01:10<21:13,  1.33s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:  68%|######8   | 2041/3000 [1:01:10<21:13,  1.33s/it, lr: 1.0e-04 loss: 6.598e-01]
windy_storm:  68%|######8   | 2041/3000 [1:01:12<21:13,  1.33s/it, lr: 1.0e-04 loss: 5.899e-01]
windy_storm:  68%|######8   | 2041/3000 [1:01:12<21:13,  1.33s/it, lr: 1.0e-04 loss: 5.899e-01]
windy_storm:  68%|######8   | 2042/3000 [1:01:12<23:16,  1.46s/it, lr: 1.0e-04 loss: 5.899e-01]
windy_storm:  68%|######8   | 2042/3000 [1:01:12<23:16,  1.46s/it, lr: 1.0e-04 loss: 5.899e-01]
windy_storm:  68%|######8   | 2042/3000 [1:01:13<23:16,  1.46s/it, lr: 1.0e-04 loss: 8.781e-02]
windy_storm:  68%|######8   | 2042/3000 [1:01:13<23:16,  1.46s/it, lr: 1.0e-04 loss: 8.781e-02]
windy_storm:  68%|######8   | 2043/3000 [1:01:13<23:41,  1.48s/it, lr: 1.0e-04 loss: 8.781e-02]
windy_storm:  68%|######8   | 2043/3000 [1:01:13<23:41,  1.48s/it, lr: 1.0e-04 loss: 8.781e-02]
windy_storm:  68%|######8   | 2043/3000 [1:01:14<23:41,  1.48s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  68%|######8   | 2043/3000 [1:01:14<23:41,  1.48s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  68%|######8   | 2044/3000 [1:01:14<20:45,  1.30s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  68%|######8   | 2044/3000 [1:01:14<20:45,  1.30s/it, lr: 1.0e-04 loss: 5.200e-01]
windy_storm:  68%|######8   | 2044/3000 [1:01:17<20:45,  1.30s/it, lr: 1.0e-04 loss: 4.109e-01]
windy_storm:  68%|######8   | 2044/3000 [1:01:17<20:45,  1.30s/it, lr: 1.0e-04 loss: 4.109e-01]
windy_storm:  68%|######8   | 2045/3000 [1:01:17<28:11,  1.77s/it, lr: 1.0e-04 loss: 4.109e-01]
windy_storm:  68%|######8   | 2045/3000 [1:01:17<28:11,  1.77s/it, lr: 1.0e-04 loss: 4.109e-01]
windy_storm:  68%|######8   | 2045/3000 [1:01:18<28:11,  1.77s/it, lr: 1.0e-04 loss: 6.684e-01]
windy_storm:  68%|######8   | 2045/3000 [1:01:18<28:11,  1.77s/it, lr: 1.0e-04 loss: 6.684e-01]
windy_storm:  68%|######8   | 2046/3000 [1:01:18<23:31,  1.48s/it, lr: 1.0e-04 loss: 6.684e-01]
windy_storm:  68%|######8   | 2046/3000 [1:01:18<23:31,  1.48s/it, lr: 1.0e-04 loss: 6.684e-01]
windy_storm:  68%|######8   | 2046/3000 [1:01:19<23:31,  1.48s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  68%|######8   | 2046/3000 [1:01:19<23:31,  1.48s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  68%|######8   | 2047/3000 [1:01:19<23:49,  1.50s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  68%|######8   | 2047/3000 [1:01:19<23:49,  1.50s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  68%|######8   | 2047/3000 [1:01:20<23:49,  1.50s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  68%|######8   | 2047/3000 [1:01:20<23:49,  1.50s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  68%|######8   | 2048/3000 [1:01:20<20:12,  1.27s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  68%|######8   | 2048/3000 [1:01:20<20:12,  1.27s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  68%|######8   | 2048/3000 [1:01:22<20:12,  1.27s/it, lr: 1.0e-04 loss: 2.125e-01]
windy_storm:  68%|######8   | 2048/3000 [1:01:22<20:12,  1.27s/it, lr: 1.0e-04 loss: 2.125e-01]
windy_storm:  68%|######8   | 2049/3000 [1:01:22<21:17,  1.34s/it, lr: 1.0e-04 loss: 2.125e-01]
windy_storm:  68%|######8   | 2049/3000 [1:01:22<21:17,  1.34s/it, lr: 1.0e-04 loss: 2.125e-01]
windy_storm:  68%|######8   | 2049/3000 [1:01:24<21:17,  1.34s/it, lr: 1.0e-04 loss: 6.358e-01]
windy_storm:  68%|######8   | 2049/3000 [1:01:24<21:17,  1.34s/it, lr: 1.0e-04 loss: 6.358e-01]
windy_storm:  68%|######8   | 2050/3000 [1:01:25<21:16,  1.34s/it, lr: 1.0e-04 loss: 5.213e-01]
windy_storm:  68%|######8   | 2050/3000 [1:01:25<21:16,  1.34s/it, lr: 1.0e-04 loss: 5.213e-01]
windy_storm:  68%|######8   | 2051/3000 [1:01:25<14:29,  1.09it/s, lr: 1.0e-04 loss: 5.213e-01]
windy_storm:  68%|######8   | 2051/3000 [1:01:25<14:29,  1.09it/s, lr: 1.0e-04 loss: 5.213e-01]
windy_storm:  68%|######8   | 2051/3000 [1:01:26<14:29,  1.09it/s, lr: 1.0e-04 loss: 2.771e-01]
windy_storm:  68%|######8   | 2051/3000 [1:01:26<14:29,  1.09it/s, lr: 1.0e-04 loss: 2.771e-01]
windy_storm:  68%|######8   | 2052/3000 [1:01:26<13:52,  1.14it/s, lr: 1.0e-04 loss: 2.771e-01]
windy_storm:  68%|######8   | 2052/3000 [1:01:26<13:52,  1.14it/s, lr: 1.0e-04 loss: 2.771e-01]
windy_storm:  68%|######8   | 2052/3000 [1:01:28<13:52,  1.14it/s, lr: 1.0e-04 loss: 1.320e-01]
windy_storm:  68%|######8   | 2052/3000 [1:01:28<13:52,  1.14it/s, lr: 1.0e-04 loss: 1.320e-01]
windy_storm:  68%|######8   | 2053/3000 [1:01:28<16:41,  1.06s/it, lr: 1.0e-04 loss: 1.320e-01]
windy_storm:  68%|######8   | 2053/3000 [1:01:28<16:41,  1.06s/it, lr: 1.0e-04 loss: 1.320e-01]
windy_storm:  68%|######8   | 2053/3000 [1:01:31<16:41,  1.06s/it, lr: 1.0e-04 loss: 1.024e-01]
windy_storm:  68%|######8   | 2053/3000 [1:01:31<16:41,  1.06s/it, lr: 1.0e-04 loss: 1.024e-01]
windy_storm:  68%|######8   | 2054/3000 [1:01:31<24:38,  1.56s/it, lr: 1.0e-04 loss: 1.024e-01]
windy_storm:  68%|######8   | 2054/3000 [1:01:31<24:38,  1.56s/it, lr: 1.0e-04 loss: 1.024e-01]
windy_storm:  68%|######8   | 2054/3000 [1:01:32<24:38,  1.56s/it, lr: 1.0e-04 loss: 1.471e-01]
windy_storm:  68%|######8   | 2054/3000 [1:01:32<24:38,  1.56s/it, lr: 1.0e-04 loss: 1.471e-01]
windy_storm:  68%|######8   | 2055/3000 [1:01:32<22:11,  1.41s/it, lr: 1.0e-04 loss: 1.471e-01]
windy_storm:  68%|######8   | 2055/3000 [1:01:32<22:11,  1.41s/it, lr: 1.0e-04 loss: 1.471e-01]
windy_storm:  68%|######8   | 2055/3000 [1:01:35<22:11,  1.41s/it, lr: 1.0e-04 loss: 6.345e-01]
windy_storm:  68%|######8   | 2055/3000 [1:01:35<22:11,  1.41s/it, lr: 1.0e-04 loss: 6.345e-01]
windy_storm:  69%|######8   | 2056/3000 [1:01:35<29:14,  1.86s/it, lr: 1.0e-04 loss: 6.345e-01]
windy_storm:  69%|######8   | 2056/3000 [1:01:35<29:14,  1.86s/it, lr: 1.0e-04 loss: 6.345e-01]
windy_storm:  69%|######8   | 2056/3000 [1:01:36<29:14,  1.86s/it, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  69%|######8   | 2056/3000 [1:01:36<29:14,  1.86s/it, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  69%|######8   | 2057/3000 [1:01:36<27:45,  1.77s/it, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  69%|######8   | 2057/3000 [1:01:36<27:45,  1.77s/it, lr: 1.0e-04 loss: 2.378e-01]
windy_storm:  69%|######8   | 2057/3000 [1:01:37<27:45,  1.77s/it, lr: 1.0e-04 loss: 2.525e-01]
windy_storm:  69%|######8   | 2057/3000 [1:01:37<27:45,  1.77s/it, lr: 1.0e-04 loss: 2.525e-01]
windy_storm:  69%|######8   | 2058/3000 [1:01:37<23:05,  1.47s/it, lr: 1.0e-04 loss: 2.525e-01]
windy_storm:  69%|######8   | 2058/3000 [1:01:37<23:05,  1.47s/it, lr: 1.0e-04 loss: 2.525e-01]
windy_storm:  69%|######8   | 2058/3000 [1:01:40<23:05,  1.47s/it, lr: 1.0e-04 loss: 3.709e-02]
windy_storm:  69%|######8   | 2058/3000 [1:01:40<23:05,  1.47s/it, lr: 1.0e-04 loss: 3.709e-02]
windy_storm:  69%|######8   | 2059/3000 [1:01:40<30:01,  1.91s/it, lr: 1.0e-04 loss: 3.709e-02]
windy_storm:  69%|######8   | 2059/3000 [1:01:40<30:01,  1.91s/it, lr: 1.0e-04 loss: 3.709e-02]
windy_storm:  69%|######8   | 2059/3000 [1:01:41<30:01,  1.91s/it, lr: 1.0e-04 loss: 3.188e-01]
windy_storm:  69%|######8   | 2059/3000 [1:01:41<30:01,  1.91s/it, lr: 1.0e-04 loss: 3.188e-01]
windy_storm:  69%|######8   | 2060/3000 [1:01:43<29:59,  1.91s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  69%|######8   | 2060/3000 [1:01:43<29:59,  1.91s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  69%|######8   | 2061/3000 [1:01:43<21:49,  1.39s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  69%|######8   | 2061/3000 [1:01:43<21:49,  1.39s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  69%|######8   | 2061/3000 [1:01:46<21:49,  1.39s/it, lr: 1.0e-04 loss: 3.876e-01]
windy_storm:  69%|######8   | 2061/3000 [1:01:46<21:49,  1.39s/it, lr: 1.0e-04 loss: 3.876e-01]
windy_storm:  69%|######8   | 2062/3000 [1:01:46<27:57,  1.79s/it, lr: 1.0e-04 loss: 3.876e-01]
windy_storm:  69%|######8   | 2062/3000 [1:01:46<27:57,  1.79s/it, lr: 1.0e-04 loss: 3.876e-01]
windy_storm:  69%|######8   | 2062/3000 [1:01:47<27:57,  1.79s/it, lr: 1.0e-04 loss: 6.333e-01]
windy_storm:  69%|######8   | 2062/3000 [1:01:47<27:57,  1.79s/it, lr: 1.0e-04 loss: 6.333e-01]
windy_storm:  69%|######8   | 2063/3000 [1:01:47<23:57,  1.53s/it, lr: 1.0e-04 loss: 6.333e-01]
windy_storm:  69%|######8   | 2063/3000 [1:01:47<23:57,  1.53s/it, lr: 1.0e-04 loss: 6.333e-01]
windy_storm:  69%|######8   | 2063/3000 [1:01:48<23:57,  1.53s/it, lr: 1.0e-04 loss: 2.457e-01]
windy_storm:  69%|######8   | 2063/3000 [1:01:48<23:57,  1.53s/it, lr: 1.0e-04 loss: 2.457e-01]
windy_storm:  69%|######8   | 2064/3000 [1:01:48<23:58,  1.54s/it, lr: 1.0e-04 loss: 2.457e-01]
windy_storm:  69%|######8   | 2064/3000 [1:01:48<23:58,  1.54s/it, lr: 1.0e-04 loss: 2.457e-01]
windy_storm:  69%|######8   | 2064/3000 [1:01:49<23:58,  1.54s/it, lr: 1.0e-04 loss: 5.809e-01]
windy_storm:  69%|######8   | 2064/3000 [1:01:49<23:58,  1.54s/it, lr: 1.0e-04 loss: 5.809e-01]
windy_storm:  69%|######8   | 2065/3000 [1:01:49<20:50,  1.34s/it, lr: 1.0e-04 loss: 5.809e-01]
windy_storm:  69%|######8   | 2065/3000 [1:01:49<20:50,  1.34s/it, lr: 1.0e-04 loss: 5.809e-01]
windy_storm:  69%|######8   | 2065/3000 [1:01:52<20:50,  1.34s/it, lr: 1.0e-04 loss: 6.401e-01]
windy_storm:  69%|######8   | 2065/3000 [1:01:52<20:50,  1.34s/it, lr: 1.0e-04 loss: 6.401e-01]
windy_storm:  69%|######8   | 2066/3000 [1:01:52<27:48,  1.79s/it, lr: 1.0e-04 loss: 6.401e-01]
windy_storm:  69%|######8   | 2066/3000 [1:01:52<27:48,  1.79s/it, lr: 1.0e-04 loss: 6.401e-01]
windy_storm:  69%|######8   | 2066/3000 [1:01:55<27:48,  1.79s/it, lr: 1.0e-04 loss: 2.176e-01]
windy_storm:  69%|######8   | 2066/3000 [1:01:55<27:48,  1.79s/it, lr: 1.0e-04 loss: 2.176e-01]
windy_storm:  69%|######8   | 2067/3000 [1:01:55<32:51,  2.11s/it, lr: 1.0e-04 loss: 2.176e-01]
windy_storm:  69%|######8   | 2067/3000 [1:01:55<32:51,  2.11s/it, lr: 1.0e-04 loss: 2.176e-01]
windy_storm:  69%|######8   | 2067/3000 [1:01:58<32:51,  2.11s/it, lr: 1.0e-04 loss: 2.609e-01]
windy_storm:  69%|######8   | 2067/3000 [1:01:58<32:51,  2.11s/it, lr: 1.0e-04 loss: 2.609e-01]
windy_storm:  69%|######8   | 2068/3000 [1:01:58<37:17,  2.40s/it, lr: 1.0e-04 loss: 2.609e-01]
windy_storm:  69%|######8   | 2068/3000 [1:01:58<37:17,  2.40s/it, lr: 1.0e-04 loss: 2.609e-01]
windy_storm:  69%|######8   | 2068/3000 [1:02:01<37:17,  2.40s/it, lr: 1.0e-04 loss: 5.364e-01]
windy_storm:  69%|######8   | 2068/3000 [1:02:01<37:17,  2.40s/it, lr: 1.0e-04 loss: 5.364e-01]
windy_storm:  69%|######8   | 2069/3000 [1:02:01<39:42,  2.56s/it, lr: 1.0e-04 loss: 5.364e-01]
windy_storm:  69%|######8   | 2069/3000 [1:02:01<39:42,  2.56s/it, lr: 1.0e-04 loss: 5.364e-01]
windy_storm:  69%|######8   | 2069/3000 [1:02:04<39:42,  2.56s/it, lr: 1.0e-04 loss: 2.591e-01]
windy_storm:  69%|######8   | 2069/3000 [1:02:04<39:42,  2.56s/it, lr: 1.0e-04 loss: 2.591e-01]
windy_storm:  69%|######9   | 2070/3000 [1:02:05<39:40,  2.56s/it, lr: 1.0e-04 loss: 2.123e-01]
windy_storm:  69%|######9   | 2070/3000 [1:02:05<39:40,  2.56s/it, lr: 1.0e-04 loss: 2.123e-01]
windy_storm:  69%|######9   | 2071/3000 [1:02:05<27:05,  1.75s/it, lr: 1.0e-04 loss: 2.123e-01]
windy_storm:  69%|######9   | 2071/3000 [1:02:05<27:05,  1.75s/it, lr: 1.0e-04 loss: 2.123e-01]
windy_storm:  69%|######9   | 2071/3000 [1:02:07<27:05,  1.75s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  69%|######9   | 2071/3000 [1:02:07<27:05,  1.75s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  69%|######9   | 2072/3000 [1:02:07<26:22,  1.71s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  69%|######9   | 2072/3000 [1:02:07<26:22,  1.71s/it, lr: 1.0e-04 loss: 6.698e-01]
windy_storm:  69%|######9   | 2072/3000 [1:02:09<26:22,  1.71s/it, lr: 1.0e-04 loss: 6.759e-01]
windy_storm:  69%|######9   | 2072/3000 [1:02:09<26:22,  1.71s/it, lr: 1.0e-04 loss: 6.759e-01]
windy_storm:  69%|######9   | 2073/3000 [1:02:09<25:51,  1.67s/it, lr: 1.0e-04 loss: 6.759e-01]
windy_storm:  69%|######9   | 2073/3000 [1:02:09<25:51,  1.67s/it, lr: 1.0e-04 loss: 6.759e-01]
windy_storm:  69%|######9   | 2073/3000 [1:02:12<25:51,  1.67s/it, lr: 1.0e-04 loss: 1.551e-01]
windy_storm:  69%|######9   | 2073/3000 [1:02:12<25:51,  1.67s/it, lr: 1.0e-04 loss: 1.551e-01]
windy_storm:  69%|######9   | 2074/3000 [1:02:12<31:07,  2.02s/it, lr: 1.0e-04 loss: 1.551e-01]
windy_storm:  69%|######9   | 2074/3000 [1:02:12<31:07,  2.02s/it, lr: 1.0e-04 loss: 1.551e-01]
windy_storm:  69%|######9   | 2074/3000 [1:02:12<31:07,  2.02s/it, lr: 1.0e-04 loss: 6.306e-01]
windy_storm:  69%|######9   | 2074/3000 [1:02:12<31:07,  2.02s/it, lr: 1.0e-04 loss: 6.306e-01]
windy_storm:  69%|######9   | 2075/3000 [1:02:12<25:55,  1.68s/it, lr: 1.0e-04 loss: 6.306e-01]
windy_storm:  69%|######9   | 2075/3000 [1:02:12<25:55,  1.68s/it, lr: 1.0e-04 loss: 6.306e-01]
windy_storm:  69%|######9   | 2075/3000 [1:02:13<25:55,  1.68s/it, lr: 1.0e-04 loss: 7.171e-01]
windy_storm:  69%|######9   | 2075/3000 [1:02:13<25:55,  1.68s/it, lr: 1.0e-04 loss: 7.171e-01]
windy_storm:  69%|######9   | 2076/3000 [1:02:13<22:07,  1.44s/it, lr: 1.0e-04 loss: 7.171e-01]
windy_storm:  69%|######9   | 2076/3000 [1:02:13<22:07,  1.44s/it, lr: 1.0e-04 loss: 7.171e-01]
windy_storm:  69%|######9   | 2076/3000 [1:02:15<22:07,  1.44s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  69%|######9   | 2076/3000 [1:02:15<22:07,  1.44s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  69%|######9   | 2077/3000 [1:02:15<22:46,  1.48s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  69%|######9   | 2077/3000 [1:02:15<22:46,  1.48s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  69%|######9   | 2077/3000 [1:02:18<22:46,  1.48s/it, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  69%|######9   | 2077/3000 [1:02:18<22:46,  1.48s/it, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  69%|######9   | 2078/3000 [1:02:18<29:14,  1.90s/it, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  69%|######9   | 2078/3000 [1:02:18<29:14,  1.90s/it, lr: 1.0e-04 loss: 4.650e-01]
windy_storm:  69%|######9   | 2078/3000 [1:02:19<29:14,  1.90s/it, lr: 1.0e-04 loss: 5.056e-01]
windy_storm:  69%|######9   | 2078/3000 [1:02:19<29:14,  1.90s/it, lr: 1.0e-04 loss: 5.056e-01]
windy_storm:  69%|######9   | 2079/3000 [1:02:19<27:37,  1.80s/it, lr: 1.0e-04 loss: 5.056e-01]
windy_storm:  69%|######9   | 2079/3000 [1:02:19<27:37,  1.80s/it, lr: 1.0e-04 loss: 5.056e-01]
windy_storm:  69%|######9   | 2079/3000 [1:02:22<27:37,  1.80s/it, lr: 1.0e-04 loss: 1.992e-01]
windy_storm:  69%|######9   | 2079/3000 [1:02:22<27:37,  1.80s/it, lr: 1.0e-04 loss: 1.992e-01]
windy_storm:  69%|######9   | 2080/3000 [1:02:23<27:35,  1.80s/it, lr: 1.0e-04 loss: 3.749e-01]
windy_storm:  69%|######9   | 2080/3000 [1:02:23<27:35,  1.80s/it, lr: 1.0e-04 loss: 3.749e-01]
windy_storm:  69%|######9   | 2081/3000 [1:02:23<17:49,  1.16s/it, lr: 1.0e-04 loss: 3.749e-01]
windy_storm:  69%|######9   | 2081/3000 [1:02:23<17:49,  1.16s/it, lr: 1.0e-04 loss: 3.749e-01]
windy_storm:  69%|######9   | 2081/3000 [1:02:26<17:49,  1.16s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  69%|######9   | 2081/3000 [1:02:26<17:49,  1.16s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  69%|######9   | 2082/3000 [1:02:26<24:29,  1.60s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  69%|######9   | 2082/3000 [1:02:26<24:29,  1.60s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  69%|######9   | 2082/3000 [1:02:29<24:29,  1.60s/it, lr: 1.0e-04 loss: 3.394e-01]
windy_storm:  69%|######9   | 2082/3000 [1:02:29<24:29,  1.60s/it, lr: 1.0e-04 loss: 3.394e-01]
windy_storm:  69%|######9   | 2083/3000 [1:02:29<30:11,  1.98s/it, lr: 1.0e-04 loss: 3.394e-01]
windy_storm:  69%|######9   | 2083/3000 [1:02:29<30:11,  1.98s/it, lr: 1.0e-04 loss: 3.394e-01]
windy_storm:  69%|######9   | 2083/3000 [1:02:31<30:11,  1.98s/it, lr: 1.0e-04 loss: 6.397e-02]
windy_storm:  69%|######9   | 2083/3000 [1:02:31<30:11,  1.98s/it, lr: 1.0e-04 loss: 6.397e-02]
windy_storm:  69%|######9   | 2084/3000 [1:02:31<28:18,  1.85s/it, lr: 1.0e-04 loss: 6.397e-02]
windy_storm:  69%|######9   | 2084/3000 [1:02:31<28:18,  1.85s/it, lr: 1.0e-04 loss: 6.397e-02]
windy_storm:  69%|######9   | 2084/3000 [1:02:34<28:18,  1.85s/it, lr: 1.0e-04 loss: 9.450e-02]
windy_storm:  69%|######9   | 2084/3000 [1:02:34<28:18,  1.85s/it, lr: 1.0e-04 loss: 9.450e-02]
windy_storm:  70%|######9   | 2085/3000 [1:02:34<33:10,  2.18s/it, lr: 1.0e-04 loss: 9.450e-02]
windy_storm:  70%|######9   | 2085/3000 [1:02:34<33:10,  2.18s/it, lr: 1.0e-04 loss: 9.450e-02]
windy_storm:  70%|######9   | 2085/3000 [1:02:37<33:10,  2.18s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  70%|######9   | 2085/3000 [1:02:37<33:10,  2.18s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  70%|######9   | 2086/3000 [1:02:37<36:48,  2.42s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  70%|######9   | 2086/3000 [1:02:37<36:48,  2.42s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  70%|######9   | 2086/3000 [1:02:38<36:48,  2.42s/it, lr: 1.0e-04 loss: 7.582e-02]
windy_storm:  70%|######9   | 2086/3000 [1:02:38<36:48,  2.42s/it, lr: 1.0e-04 loss: 7.582e-02]
windy_storm:  70%|######9   | 2087/3000 [1:02:38<33:07,  2.18s/it, lr: 1.0e-04 loss: 7.582e-02]
windy_storm:  70%|######9   | 2087/3000 [1:02:38<33:07,  2.18s/it, lr: 1.0e-04 loss: 7.582e-02]
windy_storm:  70%|######9   | 2087/3000 [1:02:40<33:07,  2.18s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  70%|######9   | 2087/3000 [1:02:40<33:07,  2.18s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  70%|######9   | 2088/3000 [1:02:40<30:13,  1.99s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  70%|######9   | 2088/3000 [1:02:40<30:13,  1.99s/it, lr: 1.0e-04 loss: 2.894e-01]
windy_storm:  70%|######9   | 2088/3000 [1:02:40<30:13,  1.99s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  70%|######9   | 2088/3000 [1:02:40<30:13,  1.99s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  70%|######9   | 2089/3000 [1:02:40<24:43,  1.63s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  70%|######9   | 2089/3000 [1:02:40<24:43,  1.63s/it, lr: 1.0e-04 loss: 1.165e-01]
windy_storm:  70%|######9   | 2089/3000 [1:02:41<24:43,  1.63s/it, lr: 1.0e-04 loss: 6.145e-01]
windy_storm:  70%|######9   | 2089/3000 [1:02:41<24:43,  1.63s/it, lr: 1.0e-04 loss: 6.145e-01]
windy_storm:  70%|######9   | 2090/3000 [1:02:42<24:41,  1.63s/it, lr: 1.0e-04 loss: 5.725e-01]
windy_storm:  70%|######9   | 2090/3000 [1:02:42<24:41,  1.63s/it, lr: 1.0e-04 loss: 5.725e-01]
windy_storm:  70%|######9   | 2091/3000 [1:02:42<16:14,  1.07s/it, lr: 1.0e-04 loss: 5.725e-01]
windy_storm:  70%|######9   | 2091/3000 [1:02:42<16:14,  1.07s/it, lr: 1.0e-04 loss: 5.725e-01]
windy_storm:  70%|######9   | 2091/3000 [1:02:44<16:14,  1.07s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:  70%|######9   | 2091/3000 [1:02:44<16:14,  1.07s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:  70%|######9   | 2092/3000 [1:02:44<18:09,  1.20s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:  70%|######9   | 2092/3000 [1:02:44<18:09,  1.20s/it, lr: 1.0e-04 loss: 5.474e-01]
windy_storm:  70%|######9   | 2092/3000 [1:02:45<18:09,  1.20s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  70%|######9   | 2092/3000 [1:02:45<18:09,  1.20s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  70%|######9   | 2093/3000 [1:02:45<19:44,  1.31s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  70%|######9   | 2093/3000 [1:02:45<19:44,  1.31s/it, lr: 1.0e-04 loss: 6.842e-01]
windy_storm:  70%|######9   | 2093/3000 [1:02:47<19:44,  1.31s/it, lr: 1.0e-04 loss: 2.539e-01]
windy_storm:  70%|######9   | 2093/3000 [1:02:47<19:44,  1.31s/it, lr: 1.0e-04 loss: 2.539e-01]
windy_storm:  70%|######9   | 2094/3000 [1:02:47<20:52,  1.38s/it, lr: 1.0e-04 loss: 2.539e-01]
windy_storm:  70%|######9   | 2094/3000 [1:02:47<20:52,  1.38s/it, lr: 1.0e-04 loss: 2.539e-01]
windy_storm:  70%|######9   | 2094/3000 [1:02:48<20:52,  1.38s/it, lr: 1.0e-04 loss: 3.550e-01]
windy_storm:  70%|######9   | 2094/3000 [1:02:48<20:52,  1.38s/it, lr: 1.0e-04 loss: 3.550e-01]
windy_storm:  70%|######9   | 2095/3000 [1:02:48<21:38,  1.44s/it, lr: 1.0e-04 loss: 3.550e-01]
windy_storm:  70%|######9   | 2095/3000 [1:02:48<21:38,  1.44s/it, lr: 1.0e-04 loss: 3.550e-01]
windy_storm:  70%|######9   | 2095/3000 [1:02:51<21:38,  1.44s/it, lr: 1.0e-04 loss: 1.364e-01]
windy_storm:  70%|######9   | 2095/3000 [1:02:51<21:38,  1.44s/it, lr: 1.0e-04 loss: 1.364e-01]
windy_storm:  70%|######9   | 2096/3000 [1:02:52<28:30,  1.89s/it, lr: 1.0e-04 loss: 1.364e-01]
windy_storm:  70%|######9   | 2096/3000 [1:02:52<28:30,  1.89s/it, lr: 1.0e-04 loss: 1.364e-01]
windy_storm:  70%|######9   | 2096/3000 [1:02:53<28:30,  1.89s/it, lr: 1.0e-04 loss: 5.732e-01]
windy_storm:  70%|######9   | 2096/3000 [1:02:53<28:30,  1.89s/it, lr: 1.0e-04 loss: 5.732e-01]
windy_storm:  70%|######9   | 2097/3000 [1:02:53<24:42,  1.64s/it, lr: 1.0e-04 loss: 5.732e-01]
windy_storm:  70%|######9   | 2097/3000 [1:02:53<24:42,  1.64s/it, lr: 1.0e-04 loss: 5.732e-01]
windy_storm:  70%|######9   | 2097/3000 [1:02:53<24:42,  1.64s/it, lr: 1.0e-04 loss: 2.339e-01]
windy_storm:  70%|######9   | 2097/3000 [1:02:53<24:42,  1.64s/it, lr: 1.0e-04 loss: 2.339e-01]
windy_storm:  70%|######9   | 2098/3000 [1:02:53<20:48,  1.38s/it, lr: 1.0e-04 loss: 2.339e-01]
windy_storm:  70%|######9   | 2098/3000 [1:02:53<20:48,  1.38s/it, lr: 1.0e-04 loss: 2.339e-01]
windy_storm:  70%|######9   | 2098/3000 [1:02:56<20:48,  1.38s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  70%|######9   | 2098/3000 [1:02:56<20:48,  1.38s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  70%|######9   | 2099/3000 [1:02:56<28:06,  1.87s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  70%|######9   | 2099/3000 [1:02:56<28:06,  1.87s/it, lr: 1.0e-04 loss: 6.654e-02]
windy_storm:  70%|######9   | 2099/3000 [1:02:58<28:06,  1.87s/it, lr: 1.0e-04 loss: 1.217e-01]
windy_storm:  70%|######9   | 2099/3000 [1:02:58<28:06,  1.87s/it, lr: 1.0e-04 loss: 1.217e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:11,  2.40s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:11,  2.40s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.39s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.39s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.36s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.36s/it]


Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.38s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.38s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.37s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.37s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  70%|#######   | 2100/3000 [1:02:59<28:04,  1.87s/it, lr: 1.0e-04 loss: 5.086e-01]
windy_storm:  70%|#######   | 2100/3000 [1:02:59<28:04,  1.87s/it, lr: 1.0e-04 loss: 5.086e-01]
windy_storm:  70%|#######   | 2101/3000 [1:02:59<17:54,  1.20s/it, lr: 1.0e-04 loss: 5.086e-01]
windy_storm:  70%|#######   | 2101/3000 [1:02:59<17:54,  1.20s/it, lr: 1.0e-04 loss: 5.086e-01]
windy_storm:  70%|#######   | 2101/3000 [1:02:59<17:54,  1.20s/it, lr: 1.0e-04 loss: 1.929e-01]
windy_storm:  70%|#######   | 2101/3000 [1:02:59<17:54,  1.20s/it, lr: 1.0e-04 loss: 1.929e-01]
windy_storm:  70%|#######   | 2102/3000 [1:02:59<16:30,  1.10s/it, lr: 1.0e-04 loss: 1.929e-01]
windy_storm:  70%|#######   | 2102/3000 [1:02:59<16:30,  1.10s/it, lr: 1.0e-04 loss: 1.929e-01]
windy_storm:  70%|#######   | 2102/3000 [1:03:00<16:30,  1.10s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  70%|#######   | 2102/3000 [1:03:00<16:30,  1.10s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  70%|#######   | 2103/3000 [1:03:00<15:12,  1.02s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  70%|#######   | 2103/3000 [1:03:00<15:12,  1.02s/it, lr: 1.0e-04 loss: 2.993e-01]
windy_storm:  70%|#######   | 2103/3000 [1:03:03<15:12,  1.02s/it, lr: 1.0e-04 loss: 1.925e-02]
windy_storm:  70%|#######   | 2103/3000 [1:03:03<15:12,  1.02s/it, lr: 1.0e-04 loss: 1.925e-02]
windy_storm:  70%|#######   | 2104/3000 [1:03:03<22:57,  1.54s/it, lr: 1.0e-04 loss: 1.925e-02]
windy_storm:  70%|#######   | 2104/3000 [1:03:03<22:57,  1.54s/it, lr: 1.0e-04 loss: 1.925e-02]
windy_storm:  70%|#######   | 2104/3000 [1:03:06<22:57,  1.54s/it, lr: 1.0e-04 loss: 2.053e-01]
windy_storm:  70%|#######   | 2104/3000 [1:03:06<22:57,  1.54s/it, lr: 1.0e-04 loss: 2.053e-01]
windy_storm:  70%|#######   | 2105/3000 [1:03:06<28:36,  1.92s/it, lr: 1.0e-04 loss: 2.053e-01]
windy_storm:  70%|#######   | 2105/3000 [1:03:06<28:36,  1.92s/it, lr: 1.0e-04 loss: 2.053e-01]
windy_storm:  70%|#######   | 2105/3000 [1:03:09<28:36,  1.92s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  70%|#######   | 2105/3000 [1:03:09<28:36,  1.92s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  70%|#######   | 2106/3000 [1:03:09<32:47,  2.20s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  70%|#######   | 2106/3000 [1:03:09<32:47,  2.20s/it, lr: 1.0e-04 loss: 6.060e-01]
windy_storm:  70%|#######   | 2106/3000 [1:03:11<32:47,  2.20s/it, lr: 1.0e-04 loss: 4.958e-01]
windy_storm:  70%|#######   | 2106/3000 [1:03:11<32:47,  2.20s/it, lr: 1.0e-04 loss: 4.958e-01]
windy_storm:  70%|#######   | 2107/3000 [1:03:11<30:06,  2.02s/it, lr: 1.0e-04 loss: 4.958e-01]
windy_storm:  70%|#######   | 2107/3000 [1:03:11<30:06,  2.02s/it, lr: 1.0e-04 loss: 4.958e-01]
windy_storm:  70%|#######   | 2107/3000 [1:03:11<30:06,  2.02s/it, lr: 1.0e-04 loss: 2.532e-01]
windy_storm:  70%|#######   | 2107/3000 [1:03:11<30:06,  2.02s/it, lr: 1.0e-04 loss: 2.532e-01]
windy_storm:  70%|#######   | 2108/3000 [1:03:11<24:47,  1.67s/it, lr: 1.0e-04 loss: 2.532e-01]
windy_storm:  70%|#######   | 2108/3000 [1:03:11<24:47,  1.67s/it, lr: 1.0e-04 loss: 2.532e-01]
windy_storm:  70%|#######   | 2108/3000 [1:03:12<24:47,  1.67s/it, lr: 1.0e-04 loss: 6.262e-01]
windy_storm:  70%|#######   | 2108/3000 [1:03:12<24:47,  1.67s/it, lr: 1.0e-04 loss: 6.262e-01]
windy_storm:  70%|#######   | 2109/3000 [1:03:12<20:46,  1.40s/it, lr: 1.0e-04 loss: 6.262e-01]
windy_storm:  70%|#######   | 2109/3000 [1:03:12<20:46,  1.40s/it, lr: 1.0e-04 loss: 6.262e-01]
windy_storm:  70%|#######   | 2109/3000 [1:03:13<20:46,  1.40s/it, lr: 1.0e-04 loss: 5.281e-01]
windy_storm:  70%|#######   | 2109/3000 [1:03:13<20:46,  1.40s/it, lr: 1.0e-04 loss: 5.281e-01]
windy_storm:  70%|#######   | 2110/3000 [1:03:14<20:45,  1.40s/it, lr: 1.0e-04 loss: 1.995e-01]
windy_storm:  70%|#######   | 2110/3000 [1:03:14<20:45,  1.40s/it, lr: 1.0e-04 loss: 1.995e-01]
windy_storm:  70%|#######   | 2111/3000 [1:03:14<13:51,  1.07it/s, lr: 1.0e-04 loss: 1.995e-01]
windy_storm:  70%|#######   | 2111/3000 [1:03:14<13:51,  1.07it/s, lr: 1.0e-04 loss: 1.995e-01]
windy_storm:  70%|#######   | 2111/3000 [1:03:15<13:51,  1.07it/s, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  70%|#######   | 2111/3000 [1:03:15<13:51,  1.07it/s, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  70%|#######   | 2112/3000 [1:03:15<13:27,  1.10it/s, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  70%|#######   | 2112/3000 [1:03:15<13:27,  1.10it/s, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  70%|#######   | 2112/3000 [1:03:18<13:27,  1.10it/s, lr: 1.0e-04 loss: 2.015e-01]
windy_storm:  70%|#######   | 2112/3000 [1:03:18<13:27,  1.10it/s, lr: 1.0e-04 loss: 2.015e-01]
windy_storm:  70%|#######   | 2113/3000 [1:03:18<21:47,  1.47s/it, lr: 1.0e-04 loss: 2.015e-01]
windy_storm:  70%|#######   | 2113/3000 [1:03:18<21:47,  1.47s/it, lr: 1.0e-04 loss: 2.015e-01]
windy_storm:  70%|#######   | 2113/3000 [1:03:21<21:47,  1.47s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  70%|#######   | 2113/3000 [1:03:21<21:47,  1.47s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  70%|#######   | 2114/3000 [1:03:21<27:29,  1.86s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  70%|#######   | 2114/3000 [1:03:21<27:29,  1.86s/it, lr: 1.0e-04 loss: 2.453e-01]
windy_storm:  70%|#######   | 2114/3000 [1:03:22<27:29,  1.86s/it, lr: 1.0e-04 loss: 6.867e-01]
windy_storm:  70%|#######   | 2114/3000 [1:03:22<27:29,  1.86s/it, lr: 1.0e-04 loss: 6.867e-01]
windy_storm:  70%|#######   | 2115/3000 [1:03:22<26:16,  1.78s/it, lr: 1.0e-04 loss: 6.867e-01]
windy_storm:  70%|#######   | 2115/3000 [1:03:22<26:16,  1.78s/it, lr: 1.0e-04 loss: 6.867e-01]
windy_storm:  70%|#######   | 2115/3000 [1:03:25<26:16,  1.78s/it, lr: 1.0e-04 loss: 5.186e-01]
windy_storm:  70%|#######   | 2115/3000 [1:03:25<26:16,  1.78s/it, lr: 1.0e-04 loss: 5.186e-01]
windy_storm:  71%|#######   | 2116/3000 [1:03:25<31:15,  2.12s/it, lr: 1.0e-04 loss: 5.186e-01]
windy_storm:  71%|#######   | 2116/3000 [1:03:25<31:15,  2.12s/it, lr: 1.0e-04 loss: 5.186e-01]
windy_storm:  71%|#######   | 2116/3000 [1:03:27<31:15,  2.12s/it, lr: 1.0e-04 loss: 3.954e-01]
windy_storm:  71%|#######   | 2116/3000 [1:03:27<31:15,  2.12s/it, lr: 1.0e-04 loss: 3.954e-01]
windy_storm:  71%|#######   | 2117/3000 [1:03:27<28:45,  1.95s/it, lr: 1.0e-04 loss: 3.954e-01]
windy_storm:  71%|#######   | 2117/3000 [1:03:27<28:45,  1.95s/it, lr: 1.0e-04 loss: 3.954e-01]
windy_storm:  71%|#######   | 2117/3000 [1:03:30<28:45,  1.95s/it, lr: 1.0e-04 loss: 4.067e-02]
windy_storm:  71%|#######   | 2117/3000 [1:03:30<28:45,  1.95s/it, lr: 1.0e-04 loss: 4.067e-02]
windy_storm:  71%|#######   | 2118/3000 [1:03:30<33:08,  2.25s/it, lr: 1.0e-04 loss: 4.067e-02]
windy_storm:  71%|#######   | 2118/3000 [1:03:30<33:08,  2.25s/it, lr: 1.0e-04 loss: 4.067e-02]
windy_storm:  71%|#######   | 2118/3000 [1:03:33<33:08,  2.25s/it, lr: 1.0e-04 loss: 4.566e-01]
windy_storm:  71%|#######   | 2118/3000 [1:03:33<33:08,  2.25s/it, lr: 1.0e-04 loss: 4.566e-01]
windy_storm:  71%|#######   | 2119/3000 [1:03:33<36:01,  2.45s/it, lr: 1.0e-04 loss: 4.566e-01]
windy_storm:  71%|#######   | 2119/3000 [1:03:33<36:01,  2.45s/it, lr: 1.0e-04 loss: 4.566e-01]
windy_storm:  71%|#######   | 2119/3000 [1:03:34<36:01,  2.45s/it, lr: 1.0e-04 loss: 5.852e-02]
windy_storm:  71%|#######   | 2119/3000 [1:03:34<36:01,  2.45s/it, lr: 1.0e-04 loss: 5.852e-02]
windy_storm:  71%|#######   | 2120/3000 [1:03:36<35:58,  2.45s/it, lr: 1.0e-04 loss: 1.884e-01]
windy_storm:  71%|#######   | 2120/3000 [1:03:36<35:58,  2.45s/it, lr: 1.0e-04 loss: 1.884e-01]
windy_storm:  71%|#######   | 2121/3000 [1:03:36<24:45,  1.69s/it, lr: 1.0e-04 loss: 1.884e-01]
windy_storm:  71%|#######   | 2121/3000 [1:03:36<24:45,  1.69s/it, lr: 1.0e-04 loss: 1.884e-01]
windy_storm:  71%|#######   | 2121/3000 [1:03:39<24:45,  1.69s/it, lr: 1.0e-04 loss: 9.979e-02]
windy_storm:  71%|#######   | 2121/3000 [1:03:39<24:45,  1.69s/it, lr: 1.0e-04 loss: 9.979e-02]
windy_storm:  71%|#######   | 2122/3000 [1:03:39<29:10,  1.99s/it, lr: 1.0e-04 loss: 9.979e-02]
windy_storm:  71%|#######   | 2122/3000 [1:03:39<29:10,  1.99s/it, lr: 1.0e-04 loss: 9.979e-02]
windy_storm:  71%|#######   | 2122/3000 [1:03:41<29:10,  1.99s/it, lr: 1.0e-04 loss: 6.493e-01]
windy_storm:  71%|#######   | 2122/3000 [1:03:41<29:10,  1.99s/it, lr: 1.0e-04 loss: 6.493e-01]
windy_storm:  71%|#######   | 2123/3000 [1:03:41<32:37,  2.23s/it, lr: 1.0e-04 loss: 6.493e-01]
windy_storm:  71%|#######   | 2123/3000 [1:03:41<32:37,  2.23s/it, lr: 1.0e-04 loss: 6.493e-01]
windy_storm:  71%|#######   | 2123/3000 [1:03:44<32:37,  2.23s/it, lr: 1.0e-04 loss: 9.199e-02]
windy_storm:  71%|#######   | 2123/3000 [1:03:44<32:37,  2.23s/it, lr: 1.0e-04 loss: 9.199e-02]
windy_storm:  71%|#######   | 2124/3000 [1:03:44<35:32,  2.43s/it, lr: 1.0e-04 loss: 9.199e-02]
windy_storm:  71%|#######   | 2124/3000 [1:03:44<35:32,  2.43s/it, lr: 1.0e-04 loss: 9.199e-02]
windy_storm:  71%|#######   | 2124/3000 [1:03:45<35:32,  2.43s/it, lr: 1.0e-04 loss: 5.811e-01]
windy_storm:  71%|#######   | 2124/3000 [1:03:45<35:32,  2.43s/it, lr: 1.0e-04 loss: 5.811e-01]
windy_storm:  71%|#######   | 2125/3000 [1:03:45<28:38,  1.96s/it, lr: 1.0e-04 loss: 5.811e-01]
windy_storm:  71%|#######   | 2125/3000 [1:03:45<28:38,  1.96s/it, lr: 1.0e-04 loss: 5.811e-01]
windy_storm:  71%|#######   | 2125/3000 [1:03:47<28:38,  1.96s/it, lr: 1.0e-04 loss: 7.154e-02]
windy_storm:  71%|#######   | 2125/3000 [1:03:47<28:38,  1.96s/it, lr: 1.0e-04 loss: 7.154e-02]
windy_storm:  71%|#######   | 2126/3000 [1:03:47<26:56,  1.85s/it, lr: 1.0e-04 loss: 7.154e-02]
windy_storm:  71%|#######   | 2126/3000 [1:03:47<26:56,  1.85s/it, lr: 1.0e-04 loss: 7.154e-02]
windy_storm:  71%|#######   | 2126/3000 [1:03:48<26:56,  1.85s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  71%|#######   | 2126/3000 [1:03:48<26:56,  1.85s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  71%|#######   | 2127/3000 [1:03:48<25:44,  1.77s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  71%|#######   | 2127/3000 [1:03:48<25:44,  1.77s/it, lr: 1.0e-04 loss: 5.461e-01]
windy_storm:  71%|#######   | 2127/3000 [1:03:51<25:44,  1.77s/it, lr: 1.0e-04 loss: 3.339e-02]
windy_storm:  71%|#######   | 2127/3000 [1:03:51<25:44,  1.77s/it, lr: 1.0e-04 loss: 3.339e-02]
windy_storm:  71%|#######   | 2128/3000 [1:03:51<31:14,  2.15s/it, lr: 1.0e-04 loss: 3.339e-02]
windy_storm:  71%|#######   | 2128/3000 [1:03:51<31:14,  2.15s/it, lr: 1.0e-04 loss: 3.339e-02]
windy_storm:  71%|#######   | 2128/3000 [1:03:52<31:14,  2.15s/it, lr: 1.0e-04 loss: 6.147e-01]
windy_storm:  71%|#######   | 2128/3000 [1:03:52<31:14,  2.15s/it, lr: 1.0e-04 loss: 6.147e-01]
windy_storm:  71%|#######   | 2129/3000 [1:03:52<25:28,  1.75s/it, lr: 1.0e-04 loss: 6.147e-01]
windy_storm:  71%|#######   | 2129/3000 [1:03:52<25:28,  1.75s/it, lr: 1.0e-04 loss: 6.147e-01]
windy_storm:  71%|#######   | 2129/3000 [1:03:54<25:28,  1.75s/it, lr: 1.0e-04 loss: 5.178e-01]
windy_storm:  71%|#######   | 2129/3000 [1:03:54<25:28,  1.75s/it, lr: 1.0e-04 loss: 5.178e-01]
windy_storm:  71%|#######1  | 2130/3000 [1:03:55<25:26,  1.75s/it, lr: 1.0e-04 loss: 1.036e-02]
windy_storm:  71%|#######1  | 2130/3000 [1:03:55<25:26,  1.75s/it, lr: 1.0e-04 loss: 1.036e-02]
windy_storm:  71%|#######1  | 2131/3000 [1:03:55<16:30,  1.14s/it, lr: 1.0e-04 loss: 1.036e-02]
windy_storm:  71%|#######1  | 2131/3000 [1:03:55<16:30,  1.14s/it, lr: 1.0e-04 loss: 1.036e-02]
windy_storm:  71%|#######1  | 2131/3000 [1:03:57<16:30,  1.14s/it, lr: 1.0e-04 loss: 2.790e-01]
windy_storm:  71%|#######1  | 2131/3000 [1:03:57<16:30,  1.14s/it, lr: 1.0e-04 loss: 2.790e-01]
windy_storm:  71%|#######1  | 2132/3000 [1:03:57<22:35,  1.56s/it, lr: 1.0e-04 loss: 2.790e-01]
windy_storm:  71%|#######1  | 2132/3000 [1:03:57<22:35,  1.56s/it, lr: 1.0e-04 loss: 2.790e-01]
windy_storm:  71%|#######1  | 2132/3000 [1:04:00<22:35,  1.56s/it, lr: 1.0e-04 loss: 6.090e-01]
windy_storm:  71%|#######1  | 2132/3000 [1:04:00<22:35,  1.56s/it, lr: 1.0e-04 loss: 6.090e-01]
windy_storm:  71%|#######1  | 2133/3000 [1:04:00<27:52,  1.93s/it, lr: 1.0e-04 loss: 6.090e-01]
windy_storm:  71%|#######1  | 2133/3000 [1:04:00<27:52,  1.93s/it, lr: 1.0e-04 loss: 6.090e-01]
windy_storm:  71%|#######1  | 2133/3000 [1:04:03<27:52,  1.93s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  71%|#######1  | 2133/3000 [1:04:03<27:52,  1.93s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  71%|#######1  | 2134/3000 [1:04:03<31:56,  2.21s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  71%|#######1  | 2134/3000 [1:04:03<31:56,  2.21s/it, lr: 1.0e-04 loss: 1.195e-01]
windy_storm:  71%|#######1  | 2134/3000 [1:04:04<31:56,  2.21s/it, lr: 1.0e-04 loss: 4.425e-01]
windy_storm:  71%|#######1  | 2134/3000 [1:04:04<31:56,  2.21s/it, lr: 1.0e-04 loss: 4.425e-01]
windy_storm:  71%|#######1  | 2135/3000 [1:04:04<26:15,  1.82s/it, lr: 1.0e-04 loss: 4.425e-01]
windy_storm:  71%|#######1  | 2135/3000 [1:04:04<26:15,  1.82s/it, lr: 1.0e-04 loss: 4.425e-01]
windy_storm:  71%|#######1  | 2135/3000 [1:04:06<26:15,  1.82s/it, lr: 1.0e-04 loss: 5.117e-01]
windy_storm:  71%|#######1  | 2135/3000 [1:04:06<26:15,  1.82s/it, lr: 1.0e-04 loss: 5.117e-01]
windy_storm:  71%|#######1  | 2136/3000 [1:04:06<25:16,  1.75s/it, lr: 1.0e-04 loss: 5.117e-01]
windy_storm:  71%|#######1  | 2136/3000 [1:04:06<25:16,  1.75s/it, lr: 1.0e-04 loss: 5.117e-01]
windy_storm:  71%|#######1  | 2136/3000 [1:04:07<25:16,  1.75s/it, lr: 1.0e-04 loss: 5.158e-01]
windy_storm:  71%|#######1  | 2136/3000 [1:04:07<25:16,  1.75s/it, lr: 1.0e-04 loss: 5.158e-01]
windy_storm:  71%|#######1  | 2137/3000 [1:04:07<21:21,  1.48s/it, lr: 1.0e-04 loss: 5.158e-01]
windy_storm:  71%|#######1  | 2137/3000 [1:04:07<21:21,  1.48s/it, lr: 1.0e-04 loss: 5.158e-01]
windy_storm:  71%|#######1  | 2137/3000 [1:04:07<21:21,  1.48s/it, lr: 1.0e-04 loss: 5.330e-01]
windy_storm:  71%|#######1  | 2137/3000 [1:04:07<21:21,  1.48s/it, lr: 1.0e-04 loss: 5.330e-01]
windy_storm:  71%|#######1  | 2138/3000 [1:04:07<18:31,  1.29s/it, lr: 1.0e-04 loss: 5.330e-01]
windy_storm:  71%|#######1  | 2138/3000 [1:04:07<18:31,  1.29s/it, lr: 1.0e-04 loss: 5.330e-01]
windy_storm:  71%|#######1  | 2138/3000 [1:04:08<18:31,  1.29s/it, lr: 1.0e-04 loss: 6.891e-01]
windy_storm:  71%|#######1  | 2138/3000 [1:04:08<18:31,  1.29s/it, lr: 1.0e-04 loss: 6.891e-01]
windy_storm:  71%|#######1  | 2139/3000 [1:04:08<16:33,  1.15s/it, lr: 1.0e-04 loss: 6.891e-01]
windy_storm:  71%|#######1  | 2139/3000 [1:04:08<16:33,  1.15s/it, lr: 1.0e-04 loss: 6.891e-01]
windy_storm:  71%|#######1  | 2139/3000 [1:04:09<16:33,  1.15s/it, lr: 1.0e-04 loss: 4.755e-01]
windy_storm:  71%|#######1  | 2139/3000 [1:04:09<16:33,  1.15s/it, lr: 1.0e-04 loss: 4.755e-01]
windy_storm:  71%|#######1  | 2140/3000 [1:04:12<16:32,  1.15s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  71%|#######1  | 2140/3000 [1:04:12<16:32,  1.15s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  71%|#######1  | 2141/3000 [1:04:12<18:41,  1.31s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  71%|#######1  | 2141/3000 [1:04:12<18:41,  1.31s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  71%|#######1  | 2141/3000 [1:04:15<18:41,  1.31s/it, lr: 1.0e-04 loss: 1.788e-01]
windy_storm:  71%|#######1  | 2141/3000 [1:04:15<18:41,  1.31s/it, lr: 1.0e-04 loss: 1.788e-01]
windy_storm:  71%|#######1  | 2142/3000 [1:04:15<25:05,  1.76s/it, lr: 1.0e-04 loss: 1.788e-01]
windy_storm:  71%|#######1  | 2142/3000 [1:04:15<25:05,  1.76s/it, lr: 1.0e-04 loss: 1.788e-01]
windy_storm:  71%|#######1  | 2142/3000 [1:04:17<25:05,  1.76s/it, lr: 1.0e-04 loss: 2.200e-01]
windy_storm:  71%|#######1  | 2142/3000 [1:04:17<25:05,  1.76s/it, lr: 1.0e-04 loss: 2.200e-01]
windy_storm:  71%|#######1  | 2143/3000 [1:04:17<24:16,  1.70s/it, lr: 1.0e-04 loss: 2.200e-01]
windy_storm:  71%|#######1  | 2143/3000 [1:04:17<24:16,  1.70s/it, lr: 1.0e-04 loss: 2.200e-01]
windy_storm:  71%|#######1  | 2143/3000 [1:04:18<24:16,  1.70s/it, lr: 1.0e-04 loss: 9.566e-02]
windy_storm:  71%|#######1  | 2143/3000 [1:04:18<24:16,  1.70s/it, lr: 1.0e-04 loss: 9.566e-02]
windy_storm:  71%|#######1  | 2144/3000 [1:04:18<23:48,  1.67s/it, lr: 1.0e-04 loss: 9.566e-02]
windy_storm:  71%|#######1  | 2144/3000 [1:04:18<23:48,  1.67s/it, lr: 1.0e-04 loss: 9.566e-02]
windy_storm:  71%|#######1  | 2144/3000 [1:04:20<23:48,  1.67s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  71%|#######1  | 2144/3000 [1:04:20<23:48,  1.67s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  72%|#######1  | 2145/3000 [1:04:20<23:22,  1.64s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  72%|#######1  | 2145/3000 [1:04:20<23:22,  1.64s/it, lr: 1.0e-04 loss: 4.673e-01]
windy_storm:  72%|#######1  | 2145/3000 [1:04:23<23:22,  1.64s/it, lr: 1.0e-04 loss: 5.864e-01]
windy_storm:  72%|#######1  | 2145/3000 [1:04:23<23:22,  1.64s/it, lr: 1.0e-04 loss: 5.864e-01]
windy_storm:  72%|#######1  | 2146/3000 [1:04:23<28:30,  2.00s/it, lr: 1.0e-04 loss: 5.864e-01]
windy_storm:  72%|#######1  | 2146/3000 [1:04:23<28:30,  2.00s/it, lr: 1.0e-04 loss: 5.864e-01]
windy_storm:  72%|#######1  | 2146/3000 [1:04:24<28:30,  2.00s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  72%|#######1  | 2146/3000 [1:04:24<28:30,  2.00s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  72%|#######1  | 2147/3000 [1:04:24<26:45,  1.88s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  72%|#######1  | 2147/3000 [1:04:24<26:45,  1.88s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  72%|#######1  | 2147/3000 [1:04:25<26:45,  1.88s/it, lr: 1.0e-04 loss: 6.473e-01]
windy_storm:  72%|#######1  | 2147/3000 [1:04:25<26:45,  1.88s/it, lr: 1.0e-04 loss: 6.473e-01]
windy_storm:  72%|#######1  | 2148/3000 [1:04:25<22:15,  1.57s/it, lr: 1.0e-04 loss: 6.473e-01]
windy_storm:  72%|#######1  | 2148/3000 [1:04:25<22:15,  1.57s/it, lr: 1.0e-04 loss: 6.473e-01]
windy_storm:  72%|#######1  | 2148/3000 [1:04:26<22:15,  1.57s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  72%|#######1  | 2148/3000 [1:04:26<22:15,  1.57s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  72%|#######1  | 2149/3000 [1:04:26<19:09,  1.35s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  72%|#######1  | 2149/3000 [1:04:26<19:09,  1.35s/it, lr: 1.0e-04 loss: 4.534e-01]
windy_storm:  72%|#######1  | 2149/3000 [1:04:29<19:09,  1.35s/it, lr: 1.0e-04 loss: 4.020e-01]
windy_storm:  72%|#######1  | 2149/3000 [1:04:29<19:09,  1.35s/it, lr: 1.0e-04 loss: 4.020e-01]
windy_storm:  72%|#######1  | 2150/3000 [1:04:30<19:08,  1.35s/it, lr: 1.0e-04 loss: 2.877e-01]
windy_storm:  72%|#######1  | 2150/3000 [1:04:30<19:08,  1.35s/it, lr: 1.0e-04 loss: 2.877e-01]
windy_storm:  72%|#######1  | 2151/3000 [1:04:30<12:50,  1.10it/s, lr: 1.0e-04 loss: 2.877e-01]
windy_storm:  72%|#######1  | 2151/3000 [1:04:30<12:50,  1.10it/s, lr: 1.0e-04 loss: 2.877e-01]
windy_storm:  72%|#######1  | 2151/3000 [1:04:31<12:50,  1.10it/s, lr: 1.0e-04 loss: 5.160e-01]
windy_storm:  72%|#######1  | 2151/3000 [1:04:31<12:50,  1.10it/s, lr: 1.0e-04 loss: 5.160e-01]
windy_storm:  72%|#######1  | 2152/3000 [1:04:31<15:06,  1.07s/it, lr: 1.0e-04 loss: 5.160e-01]
windy_storm:  72%|#######1  | 2152/3000 [1:04:31<15:06,  1.07s/it, lr: 1.0e-04 loss: 5.160e-01]
windy_storm:  72%|#######1  | 2152/3000 [1:04:33<15:06,  1.07s/it, lr: 1.0e-04 loss: 7.014e-02]
windy_storm:  72%|#######1  | 2152/3000 [1:04:33<15:06,  1.07s/it, lr: 1.0e-04 loss: 7.014e-02]
windy_storm:  72%|#######1  | 2153/3000 [1:04:33<16:55,  1.20s/it, lr: 1.0e-04 loss: 7.014e-02]
windy_storm:  72%|#######1  | 2153/3000 [1:04:33<16:55,  1.20s/it, lr: 1.0e-04 loss: 7.014e-02]
windy_storm:  72%|#######1  | 2153/3000 [1:04:34<16:55,  1.20s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  72%|#######1  | 2153/3000 [1:04:34<16:55,  1.20s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  72%|#######1  | 2154/3000 [1:04:34<15:14,  1.08s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  72%|#######1  | 2154/3000 [1:04:34<15:14,  1.08s/it, lr: 1.0e-04 loss: 4.737e-01]
windy_storm:  72%|#######1  | 2154/3000 [1:04:37<15:14,  1.08s/it, lr: 1.0e-04 loss: 6.133e-01]
windy_storm:  72%|#######1  | 2154/3000 [1:04:37<15:14,  1.08s/it, lr: 1.0e-04 loss: 6.133e-01]
windy_storm:  72%|#######1  | 2155/3000 [1:04:37<23:34,  1.67s/it, lr: 1.0e-04 loss: 6.133e-01]
windy_storm:  72%|#######1  | 2155/3000 [1:04:37<23:34,  1.67s/it, lr: 1.0e-04 loss: 6.133e-01]
windy_storm:  72%|#######1  | 2155/3000 [1:04:38<23:34,  1.67s/it, lr: 1.0e-04 loss: 4.759e-02]
windy_storm:  72%|#######1  | 2155/3000 [1:04:38<23:34,  1.67s/it, lr: 1.0e-04 loss: 4.759e-02]
windy_storm:  72%|#######1  | 2156/3000 [1:04:38<19:52,  1.41s/it, lr: 1.0e-04 loss: 4.759e-02]
windy_storm:  72%|#######1  | 2156/3000 [1:04:38<19:52,  1.41s/it, lr: 1.0e-04 loss: 4.759e-02]
windy_storm:  72%|#######1  | 2156/3000 [1:04:38<19:52,  1.41s/it, lr: 1.0e-04 loss: 6.910e-02]
windy_storm:  72%|#######1  | 2156/3000 [1:04:38<19:52,  1.41s/it, lr: 1.0e-04 loss: 6.910e-02]
windy_storm:  72%|#######1  | 2157/3000 [1:04:38<17:22,  1.24s/it, lr: 1.0e-04 loss: 6.910e-02]
windy_storm:  72%|#######1  | 2157/3000 [1:04:38<17:22,  1.24s/it, lr: 1.0e-04 loss: 6.910e-02]
windy_storm:  72%|#######1  | 2157/3000 [1:04:40<17:22,  1.24s/it, lr: 1.0e-04 loss: 6.042e-01]
windy_storm:  72%|#######1  | 2157/3000 [1:04:40<17:22,  1.24s/it, lr: 1.0e-04 loss: 6.042e-01]
windy_storm:  72%|#######1  | 2158/3000 [1:04:40<18:42,  1.33s/it, lr: 1.0e-04 loss: 6.042e-01]
windy_storm:  72%|#######1  | 2158/3000 [1:04:40<18:42,  1.33s/it, lr: 1.0e-04 loss: 6.042e-01]
windy_storm:  72%|#######1  | 2158/3000 [1:04:41<18:42,  1.33s/it, lr: 1.0e-04 loss: 8.102e-02]
windy_storm:  72%|#######1  | 2158/3000 [1:04:41<18:42,  1.33s/it, lr: 1.0e-04 loss: 8.102e-02]
windy_storm:  72%|#######1  | 2159/3000 [1:04:41<19:31,  1.39s/it, lr: 1.0e-04 loss: 8.102e-02]
windy_storm:  72%|#######1  | 2159/3000 [1:04:41<19:31,  1.39s/it, lr: 1.0e-04 loss: 8.102e-02]
windy_storm:  72%|#######1  | 2159/3000 [1:04:43<19:31,  1.39s/it, lr: 1.0e-04 loss: 4.517e-01]
windy_storm:  72%|#######1  | 2159/3000 [1:04:43<19:31,  1.39s/it, lr: 1.0e-04 loss: 4.517e-01]
windy_storm:  72%|#######2  | 2160/3000 [1:04:44<19:29,  1.39s/it, lr: 1.0e-04 loss: 3.807e-01]
windy_storm:  72%|#######2  | 2160/3000 [1:04:44<19:29,  1.39s/it, lr: 1.0e-04 loss: 3.807e-01]
windy_storm:  72%|#######2  | 2161/3000 [1:04:44<13:01,  1.07it/s, lr: 1.0e-04 loss: 3.807e-01]
windy_storm:  72%|#######2  | 2161/3000 [1:04:44<13:01,  1.07it/s, lr: 1.0e-04 loss: 3.807e-01]
windy_storm:  72%|#######2  | 2161/3000 [1:04:47<13:01,  1.07it/s, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  72%|#######2  | 2161/3000 [1:04:47<13:01,  1.07it/s, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  72%|#######2  | 2162/3000 [1:04:47<19:54,  1.43s/it, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  72%|#######2  | 2162/3000 [1:04:47<19:54,  1.43s/it, lr: 1.0e-04 loss: 6.387e-01]
windy_storm:  72%|#######2  | 2162/3000 [1:04:50<19:54,  1.43s/it, lr: 1.0e-04 loss: 4.794e-01]
windy_storm:  72%|#######2  | 2162/3000 [1:04:50<19:54,  1.43s/it, lr: 1.0e-04 loss: 4.794e-01]
windy_storm:  72%|#######2  | 2163/3000 [1:04:50<25:36,  1.84s/it, lr: 1.0e-04 loss: 4.794e-01]
windy_storm:  72%|#######2  | 2163/3000 [1:04:50<25:36,  1.84s/it, lr: 1.0e-04 loss: 4.794e-01]
windy_storm:  72%|#######2  | 2163/3000 [1:04:53<25:36,  1.84s/it, lr: 1.0e-04 loss: 1.593e-01]
windy_storm:  72%|#######2  | 2163/3000 [1:04:53<25:36,  1.84s/it, lr: 1.0e-04 loss: 1.593e-01]
windy_storm:  72%|#######2  | 2164/3000 [1:04:53<29:57,  2.15s/it, lr: 1.0e-04 loss: 1.593e-01]
windy_storm:  72%|#######2  | 2164/3000 [1:04:53<29:57,  2.15s/it, lr: 1.0e-04 loss: 1.593e-01]
windy_storm:  72%|#######2  | 2164/3000 [1:04:56<29:57,  2.15s/it, lr: 1.0e-04 loss: 6.767e-01]
windy_storm:  72%|#######2  | 2164/3000 [1:04:56<29:57,  2.15s/it, lr: 1.0e-04 loss: 6.767e-01]
windy_storm:  72%|#######2  | 2165/3000 [1:04:56<32:55,  2.37s/it, lr: 1.0e-04 loss: 6.767e-01]
windy_storm:  72%|#######2  | 2165/3000 [1:04:56<32:55,  2.37s/it, lr: 1.0e-04 loss: 6.767e-01]
windy_storm:  72%|#######2  | 2165/3000 [1:04:58<32:55,  2.37s/it, lr: 1.0e-04 loss: 4.368e-01]
windy_storm:  72%|#######2  | 2165/3000 [1:04:58<32:55,  2.37s/it, lr: 1.0e-04 loss: 4.368e-01]
windy_storm:  72%|#######2  | 2166/3000 [1:04:58<29:47,  2.14s/it, lr: 1.0e-04 loss: 4.368e-01]
windy_storm:  72%|#######2  | 2166/3000 [1:04:58<29:47,  2.14s/it, lr: 1.0e-04 loss: 4.368e-01]
windy_storm:  72%|#######2  | 2166/3000 [1:05:01<29:47,  2.14s/it, lr: 1.0e-04 loss: 2.659e-02]
windy_storm:  72%|#######2  | 2166/3000 [1:05:01<29:47,  2.14s/it, lr: 1.0e-04 loss: 2.659e-02]
windy_storm:  72%|#######2  | 2167/3000 [1:05:01<32:54,  2.37s/it, lr: 1.0e-04 loss: 2.659e-02]
windy_storm:  72%|#######2  | 2167/3000 [1:05:01<32:54,  2.37s/it, lr: 1.0e-04 loss: 2.659e-02]
windy_storm:  72%|#######2  | 2167/3000 [1:05:02<32:54,  2.37s/it, lr: 1.0e-04 loss: 1.495e-01]
windy_storm:  72%|#######2  | 2167/3000 [1:05:02<32:54,  2.37s/it, lr: 1.0e-04 loss: 1.495e-01]
windy_storm:  72%|#######2  | 2168/3000 [1:05:02<27:53,  2.01s/it, lr: 1.0e-04 loss: 1.495e-01]
windy_storm:  72%|#######2  | 2168/3000 [1:05:02<27:53,  2.01s/it, lr: 1.0e-04 loss: 1.495e-01]
windy_storm:  72%|#######2  | 2168/3000 [1:05:03<27:53,  2.01s/it, lr: 1.0e-04 loss: 1.535e-01]
windy_storm:  72%|#######2  | 2168/3000 [1:05:03<27:53,  2.01s/it, lr: 1.0e-04 loss: 1.535e-01]
windy_storm:  72%|#######2  | 2169/3000 [1:05:03<22:58,  1.66s/it, lr: 1.0e-04 loss: 1.535e-01]
windy_storm:  72%|#######2  | 2169/3000 [1:05:03<22:58,  1.66s/it, lr: 1.0e-04 loss: 1.535e-01]
windy_storm:  72%|#######2  | 2169/3000 [1:05:04<22:58,  1.66s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:  72%|#######2  | 2169/3000 [1:05:04<22:58,  1.66s/it, lr: 1.0e-04 loss: 1.079e-01]
windy_storm:  72%|#######2  | 2170/3000 [1:05:07<22:56,  1.66s/it, lr: 1.0e-04 loss: 8.272e-02]
windy_storm:  72%|#######2  | 2170/3000 [1:05:07<22:56,  1.66s/it, lr: 1.0e-04 loss: 8.272e-02]
windy_storm:  72%|#######2  | 2171/3000 [1:05:07<21:53,  1.58s/it, lr: 1.0e-04 loss: 8.272e-02]
windy_storm:  72%|#######2  | 2171/3000 [1:05:07<21:53,  1.58s/it, lr: 1.0e-04 loss: 8.272e-02]
windy_storm:  72%|#######2  | 2171/3000 [1:05:09<21:53,  1.58s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  72%|#######2  | 2171/3000 [1:05:09<21:53,  1.58s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  72%|#######2  | 2172/3000 [1:05:09<21:37,  1.57s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  72%|#######2  | 2172/3000 [1:05:09<21:37,  1.57s/it, lr: 1.0e-04 loss: 1.297e-01]
windy_storm:  72%|#######2  | 2172/3000 [1:05:09<21:37,  1.57s/it, lr: 1.0e-04 loss: 5.218e-01]
windy_storm:  72%|#######2  | 2172/3000 [1:05:09<21:37,  1.57s/it, lr: 1.0e-04 loss: 5.218e-01]
windy_storm:  72%|#######2  | 2173/3000 [1:05:09<18:54,  1.37s/it, lr: 1.0e-04 loss: 5.218e-01]
windy_storm:  72%|#######2  | 2173/3000 [1:05:09<18:54,  1.37s/it, lr: 1.0e-04 loss: 5.218e-01]
windy_storm:  72%|#######2  | 2173/3000 [1:05:10<18:54,  1.37s/it, lr: 1.0e-04 loss: 5.031e-02]
windy_storm:  72%|#######2  | 2173/3000 [1:05:10<18:54,  1.37s/it, lr: 1.0e-04 loss: 5.031e-02]
windy_storm:  72%|#######2  | 2174/3000 [1:05:10<16:50,  1.22s/it, lr: 1.0e-04 loss: 5.031e-02]
windy_storm:  72%|#######2  | 2174/3000 [1:05:10<16:50,  1.22s/it, lr: 1.0e-04 loss: 5.031e-02]
windy_storm:  72%|#######2  | 2174/3000 [1:05:11<16:50,  1.22s/it, lr: 1.0e-04 loss: 2.818e-01]
windy_storm:  72%|#######2  | 2174/3000 [1:05:11<16:50,  1.22s/it, lr: 1.0e-04 loss: 2.818e-01]
windy_storm:  72%|#######2  | 2175/3000 [1:05:11<15:01,  1.09s/it, lr: 1.0e-04 loss: 2.818e-01]
windy_storm:  72%|#######2  | 2175/3000 [1:05:11<15:01,  1.09s/it, lr: 1.0e-04 loss: 2.818e-01]
windy_storm:  72%|#######2  | 2175/3000 [1:05:13<15:01,  1.09s/it, lr: 1.0e-04 loss: 1.453e-01]
windy_storm:  72%|#######2  | 2175/3000 [1:05:13<15:01,  1.09s/it, lr: 1.0e-04 loss: 1.453e-01]
windy_storm:  73%|#######2  | 2176/3000 [1:05:13<16:58,  1.24s/it, lr: 1.0e-04 loss: 1.453e-01]
windy_storm:  73%|#######2  | 2176/3000 [1:05:13<16:58,  1.24s/it, lr: 1.0e-04 loss: 1.453e-01]
windy_storm:  73%|#######2  | 2176/3000 [1:05:14<16:58,  1.24s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  73%|#######2  | 2176/3000 [1:05:14<16:58,  1.24s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  73%|#######2  | 2177/3000 [1:05:14<18:19,  1.34s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  73%|#######2  | 2177/3000 [1:05:14<18:19,  1.34s/it, lr: 1.0e-04 loss: 1.747e-01]
windy_storm:  73%|#######2  | 2177/3000 [1:05:15<18:19,  1.34s/it, lr: 1.0e-04 loss: 3.011e-02]
windy_storm:  73%|#######2  | 2177/3000 [1:05:15<18:19,  1.34s/it, lr: 1.0e-04 loss: 3.011e-02]
windy_storm:  73%|#######2  | 2178/3000 [1:05:15<16:01,  1.17s/it, lr: 1.0e-04 loss: 3.011e-02]
windy_storm:  73%|#######2  | 2178/3000 [1:05:15<16:01,  1.17s/it, lr: 1.0e-04 loss: 3.011e-02]
windy_storm:  73%|#######2  | 2178/3000 [1:05:17<16:01,  1.17s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  73%|#######2  | 2178/3000 [1:05:17<16:01,  1.17s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  73%|#######2  | 2179/3000 [1:05:17<17:39,  1.29s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  73%|#######2  | 2179/3000 [1:05:17<17:39,  1.29s/it, lr: 1.0e-04 loss: 6.789e-01]
windy_storm:  73%|#######2  | 2179/3000 [1:05:19<17:39,  1.29s/it, lr: 1.0e-04 loss: 5.546e-01]
windy_storm:  73%|#######2  | 2179/3000 [1:05:19<17:39,  1.29s/it, lr: 1.0e-04 loss: 5.546e-01]
windy_storm:  73%|#######2  | 2180/3000 [1:05:21<17:38,  1.29s/it, lr: 1.0e-04 loss: 1.394e-01]
windy_storm:  73%|#######2  | 2180/3000 [1:05:21<17:38,  1.29s/it, lr: 1.0e-04 loss: 1.394e-01]
windy_storm:  73%|#######2  | 2181/3000 [1:05:21<14:24,  1.06s/it, lr: 1.0e-04 loss: 1.394e-01]
windy_storm:  73%|#######2  | 2181/3000 [1:05:21<14:24,  1.06s/it, lr: 1.0e-04 loss: 1.394e-01]
windy_storm:  73%|#######2  | 2181/3000 [1:05:23<14:24,  1.06s/it, lr: 1.0e-04 loss: 6.965e-02]
windy_storm:  73%|#######2  | 2181/3000 [1:05:23<14:24,  1.06s/it, lr: 1.0e-04 loss: 6.965e-02]
windy_storm:  73%|#######2  | 2182/3000 [1:05:23<16:03,  1.18s/it, lr: 1.0e-04 loss: 6.965e-02]
windy_storm:  73%|#######2  | 2182/3000 [1:05:23<16:03,  1.18s/it, lr: 1.0e-04 loss: 6.965e-02]
windy_storm:  73%|#######2  | 2182/3000 [1:05:24<16:03,  1.18s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  73%|#######2  | 2182/3000 [1:05:24<16:03,  1.18s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  73%|#######2  | 2183/3000 [1:05:24<15:20,  1.13s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  73%|#######2  | 2183/3000 [1:05:24<15:20,  1.13s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  73%|#######2  | 2183/3000 [1:05:27<15:20,  1.13s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  73%|#######2  | 2183/3000 [1:05:27<15:20,  1.13s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  73%|#######2  | 2184/3000 [1:05:27<21:56,  1.61s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  73%|#######2  | 2184/3000 [1:05:27<21:56,  1.61s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  73%|#######2  | 2184/3000 [1:05:27<21:56,  1.61s/it, lr: 1.0e-04 loss: 5.859e-01]
windy_storm:  73%|#######2  | 2184/3000 [1:05:27<21:56,  1.61s/it, lr: 1.0e-04 loss: 5.859e-01]
windy_storm:  73%|#######2  | 2185/3000 [1:05:27<18:55,  1.39s/it, lr: 1.0e-04 loss: 5.859e-01]
windy_storm:  73%|#######2  | 2185/3000 [1:05:27<18:55,  1.39s/it, lr: 1.0e-04 loss: 5.859e-01]
windy_storm:  73%|#######2  | 2185/3000 [1:05:28<18:55,  1.39s/it, lr: 1.0e-04 loss: 3.069e-01]
windy_storm:  73%|#######2  | 2185/3000 [1:05:28<18:55,  1.39s/it, lr: 1.0e-04 loss: 3.069e-01]
windy_storm:  73%|#######2  | 2186/3000 [1:05:28<16:30,  1.22s/it, lr: 1.0e-04 loss: 3.069e-01]
windy_storm:  73%|#######2  | 2186/3000 [1:05:28<16:30,  1.22s/it, lr: 1.0e-04 loss: 3.069e-01]
windy_storm:  73%|#######2  | 2186/3000 [1:05:31<16:30,  1.22s/it, lr: 1.0e-04 loss: 3.634e-01]
windy_storm:  73%|#######2  | 2186/3000 [1:05:31<16:30,  1.22s/it, lr: 1.0e-04 loss: 3.634e-01]
windy_storm:  73%|#######2  | 2187/3000 [1:05:31<23:21,  1.72s/it, lr: 1.0e-04 loss: 3.634e-01]
windy_storm:  73%|#######2  | 2187/3000 [1:05:31<23:21,  1.72s/it, lr: 1.0e-04 loss: 3.634e-01]
windy_storm:  73%|#######2  | 2187/3000 [1:05:32<23:21,  1.72s/it, lr: 1.0e-04 loss: 3.014e-01]
windy_storm:  73%|#######2  | 2187/3000 [1:05:32<23:21,  1.72s/it, lr: 1.0e-04 loss: 3.014e-01]
windy_storm:  73%|#######2  | 2188/3000 [1:05:32<19:31,  1.44s/it, lr: 1.0e-04 loss: 3.014e-01]
windy_storm:  73%|#######2  | 2188/3000 [1:05:32<19:31,  1.44s/it, lr: 1.0e-04 loss: 3.014e-01]
windy_storm:  73%|#######2  | 2188/3000 [1:05:35<19:31,  1.44s/it, lr: 1.0e-04 loss: 5.239e-01]
windy_storm:  73%|#######2  | 2188/3000 [1:05:35<19:31,  1.44s/it, lr: 1.0e-04 loss: 5.239e-01]
windy_storm:  73%|#######2  | 2189/3000 [1:05:35<25:49,  1.91s/it, lr: 1.0e-04 loss: 5.239e-01]
windy_storm:  73%|#######2  | 2189/3000 [1:05:35<25:49,  1.91s/it, lr: 1.0e-04 loss: 5.239e-01]
windy_storm:  73%|#######2  | 2189/3000 [1:05:37<25:49,  1.91s/it, lr: 1.0e-04 loss: 6.260e-01]
windy_storm:  73%|#######2  | 2189/3000 [1:05:37<25:49,  1.91s/it, lr: 1.0e-04 loss: 6.260e-01]
windy_storm:  73%|#######3  | 2190/3000 [1:05:38<25:48,  1.91s/it, lr: 1.0e-04 loss: 6.421e-01]
windy_storm:  73%|#######3  | 2190/3000 [1:05:38<25:48,  1.91s/it, lr: 1.0e-04 loss: 6.421e-01]
windy_storm:  73%|#######3  | 2191/3000 [1:05:38<18:57,  1.41s/it, lr: 1.0e-04 loss: 6.421e-01]
windy_storm:  73%|#######3  | 2191/3000 [1:05:38<18:57,  1.41s/it, lr: 1.0e-04 loss: 6.421e-01]
windy_storm:  73%|#######3  | 2191/3000 [1:05:40<18:57,  1.41s/it, lr: 1.0e-04 loss: 7.790e-02]
windy_storm:  73%|#######3  | 2191/3000 [1:05:40<18:57,  1.41s/it, lr: 1.0e-04 loss: 7.790e-02]
windy_storm:  73%|#######3  | 2192/3000 [1:05:40<19:37,  1.46s/it, lr: 1.0e-04 loss: 7.790e-02]
windy_storm:  73%|#######3  | 2192/3000 [1:05:40<19:37,  1.46s/it, lr: 1.0e-04 loss: 7.790e-02]
windy_storm:  73%|#######3  | 2192/3000 [1:05:43<19:37,  1.46s/it, lr: 1.0e-04 loss: 6.062e-01]
windy_storm:  73%|#######3  | 2192/3000 [1:05:43<19:37,  1.46s/it, lr: 1.0e-04 loss: 6.062e-01]
windy_storm:  73%|#######3  | 2193/3000 [1:05:43<25:10,  1.87s/it, lr: 1.0e-04 loss: 6.062e-01]
windy_storm:  73%|#######3  | 2193/3000 [1:05:43<25:10,  1.87s/it, lr: 1.0e-04 loss: 6.062e-01]
windy_storm:  73%|#######3  | 2193/3000 [1:05:46<25:10,  1.87s/it, lr: 1.0e-04 loss: 1.044e-01]
windy_storm:  73%|#######3  | 2193/3000 [1:05:46<25:10,  1.87s/it, lr: 1.0e-04 loss: 1.044e-01]
windy_storm:  73%|#######3  | 2194/3000 [1:05:46<29:22,  2.19s/it, lr: 1.0e-04 loss: 1.044e-01]
windy_storm:  73%|#######3  | 2194/3000 [1:05:46<29:22,  2.19s/it, lr: 1.0e-04 loss: 1.044e-01]
windy_storm:  73%|#######3  | 2194/3000 [1:05:47<29:22,  2.19s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  73%|#######3  | 2194/3000 [1:05:47<29:22,  2.19s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  73%|#######3  | 2195/3000 [1:05:47<27:13,  2.03s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  73%|#######3  | 2195/3000 [1:05:47<27:13,  2.03s/it, lr: 1.0e-04 loss: 6.403e-01]
windy_storm:  73%|#######3  | 2195/3000 [1:05:50<27:13,  2.03s/it, lr: 1.0e-04 loss: 1.370e-01]
windy_storm:  73%|#######3  | 2195/3000 [1:05:50<27:13,  2.03s/it, lr: 1.0e-04 loss: 1.370e-01]
windy_storm:  73%|#######3  | 2196/3000 [1:05:50<30:48,  2.30s/it, lr: 1.0e-04 loss: 1.370e-01]
windy_storm:  73%|#######3  | 2196/3000 [1:05:50<30:48,  2.30s/it, lr: 1.0e-04 loss: 1.370e-01]
windy_storm:  73%|#######3  | 2196/3000 [1:05:52<30:48,  2.30s/it, lr: 1.0e-04 loss: 6.686e-01]
windy_storm:  73%|#######3  | 2196/3000 [1:05:52<30:48,  2.30s/it, lr: 1.0e-04 loss: 6.686e-01]
windy_storm:  73%|#######3  | 2197/3000 [1:05:52<26:11,  1.96s/it, lr: 1.0e-04 loss: 6.686e-01]
windy_storm:  73%|#######3  | 2197/3000 [1:05:52<26:11,  1.96s/it, lr: 1.0e-04 loss: 6.686e-01]
windy_storm:  73%|#######3  | 2197/3000 [1:05:55<26:11,  1.96s/it, lr: 1.0e-04 loss: 4.196e-01]
windy_storm:  73%|#######3  | 2197/3000 [1:05:55<26:11,  1.96s/it, lr: 1.0e-04 loss: 4.196e-01]
windy_storm:  73%|#######3  | 2198/3000 [1:05:55<30:24,  2.28s/it, lr: 1.0e-04 loss: 4.196e-01]
windy_storm:  73%|#######3  | 2198/3000 [1:05:55<30:24,  2.28s/it, lr: 1.0e-04 loss: 4.196e-01]
windy_storm:  73%|#######3  | 2198/3000 [1:05:55<30:24,  2.28s/it, lr: 1.0e-04 loss: 2.227e-01]
windy_storm:  73%|#######3  | 2198/3000 [1:05:55<30:24,  2.28s/it, lr: 1.0e-04 loss: 2.227e-01]
windy_storm:  73%|#######3  | 2199/3000 [1:05:55<24:27,  1.83s/it, lr: 1.0e-04 loss: 2.227e-01]
windy_storm:  73%|#######3  | 2199/3000 [1:05:55<24:27,  1.83s/it, lr: 1.0e-04 loss: 2.227e-01]
windy_storm:  73%|#######3  | 2199/3000 [1:05:58<24:27,  1.83s/it, lr: 1.0e-04 loss: 6.544e-01]
windy_storm:  73%|#######3  | 2199/3000 [1:05:58<24:27,  1.83s/it, lr: 1.0e-04 loss: 6.544e-01]
windy_storm:  73%|#######3  | 2200/3000 [1:06:00<24:25,  1.83s/it, lr: 1.0e-04 loss: 3.939e-01]
windy_storm:  73%|#######3  | 2200/3000 [1:06:00<24:25,  1.83s/it, lr: 1.0e-04 loss: 3.939e-01]
windy_storm:  73%|#######3  | 2201/3000 [1:06:00<18:05,  1.36s/it, lr: 1.0e-04 loss: 3.939e-01]
windy_storm:  73%|#######3  | 2201/3000 [1:06:00<18:05,  1.36s/it, lr: 1.0e-04 loss: 3.939e-01]
windy_storm:  73%|#######3  | 2201/3000 [1:06:01<18:05,  1.36s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  73%|#######3  | 2201/3000 [1:06:01<18:05,  1.36s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  73%|#######3  | 2202/3000 [1:06:01<16:10,  1.22s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  73%|#######3  | 2202/3000 [1:06:01<16:10,  1.22s/it, lr: 1.0e-04 loss: 5.100e-01]
windy_storm:  73%|#######3  | 2202/3000 [1:06:04<16:10,  1.22s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  73%|#######3  | 2202/3000 [1:06:04<16:10,  1.22s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  73%|#######3  | 2203/3000 [1:06:04<22:23,  1.69s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  73%|#######3  | 2203/3000 [1:06:04<22:23,  1.69s/it, lr: 1.0e-04 loss: 5.850e-01]
windy_storm:  73%|#######3  | 2203/3000 [1:06:05<22:23,  1.69s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  73%|#######3  | 2203/3000 [1:06:05<22:23,  1.69s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  73%|#######3  | 2204/3000 [1:06:05<19:16,  1.45s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  73%|#######3  | 2204/3000 [1:06:05<19:16,  1.45s/it, lr: 1.0e-04 loss: 4.491e-01]
windy_storm:  73%|#######3  | 2204/3000 [1:06:06<19:16,  1.45s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  73%|#######3  | 2204/3000 [1:06:06<19:16,  1.45s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  74%|#######3  | 2205/3000 [1:06:06<19:45,  1.49s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  74%|#######3  | 2205/3000 [1:06:06<19:45,  1.49s/it, lr: 1.0e-04 loss: 5.007e-01]
windy_storm:  74%|#######3  | 2205/3000 [1:06:08<19:45,  1.49s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  74%|#######3  | 2205/3000 [1:06:08<19:45,  1.49s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  74%|#######3  | 2206/3000 [1:06:08<20:00,  1.51s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  74%|#######3  | 2206/3000 [1:06:08<20:00,  1.51s/it, lr: 1.0e-04 loss: 5.445e-01]
windy_storm:  74%|#######3  | 2206/3000 [1:06:08<20:00,  1.51s/it, lr: 1.0e-04 loss: 3.757e-01]
windy_storm:  74%|#######3  | 2206/3000 [1:06:08<20:00,  1.51s/it, lr: 1.0e-04 loss: 3.757e-01]
windy_storm:  74%|#######3  | 2207/3000 [1:06:08<17:10,  1.30s/it, lr: 1.0e-04 loss: 3.757e-01]
windy_storm:  74%|#######3  | 2207/3000 [1:06:08<17:10,  1.30s/it, lr: 1.0e-04 loss: 3.757e-01]
windy_storm:  74%|#######3  | 2207/3000 [1:06:10<17:10,  1.30s/it, lr: 1.0e-04 loss: 5.880e-01]
windy_storm:  74%|#######3  | 2207/3000 [1:06:10<17:10,  1.30s/it, lr: 1.0e-04 loss: 5.880e-01]
windy_storm:  74%|#######3  | 2208/3000 [1:06:10<18:33,  1.41s/it, lr: 1.0e-04 loss: 5.880e-01]
windy_storm:  74%|#######3  | 2208/3000 [1:06:10<18:33,  1.41s/it, lr: 1.0e-04 loss: 5.880e-01]
windy_storm:  74%|#######3  | 2208/3000 [1:06:13<18:33,  1.41s/it, lr: 1.0e-04 loss: 3.262e-01]
windy_storm:  74%|#######3  | 2208/3000 [1:06:13<18:33,  1.41s/it, lr: 1.0e-04 loss: 3.262e-01]
windy_storm:  74%|#######3  | 2209/3000 [1:06:13<24:33,  1.86s/it, lr: 1.0e-04 loss: 3.262e-01]
windy_storm:  74%|#######3  | 2209/3000 [1:06:13<24:33,  1.86s/it, lr: 1.0e-04 loss: 3.262e-01]
windy_storm:  74%|#######3  | 2209/3000 [1:06:15<24:33,  1.86s/it, lr: 1.0e-04 loss: 5.175e-01]
windy_storm:  74%|#######3  | 2209/3000 [1:06:15<24:33,  1.86s/it, lr: 1.0e-04 loss: 5.175e-01]
windy_storm:  74%|#######3  | 2210/3000 [1:06:17<24:31,  1.86s/it, lr: 1.0e-04 loss: 3.697e-01]
windy_storm:  74%|#######3  | 2210/3000 [1:06:17<24:31,  1.86s/it, lr: 1.0e-04 loss: 3.697e-01]
windy_storm:  74%|#######3  | 2211/3000 [1:06:17<18:03,  1.37s/it, lr: 1.0e-04 loss: 3.697e-01]
windy_storm:  74%|#######3  | 2211/3000 [1:06:17<18:03,  1.37s/it, lr: 1.0e-04 loss: 3.697e-01]
windy_storm:  74%|#######3  | 2211/3000 [1:06:17<18:03,  1.37s/it, lr: 1.0e-04 loss: 1.166e-01]
windy_storm:  74%|#######3  | 2211/3000 [1:06:17<18:03,  1.37s/it, lr: 1.0e-04 loss: 1.166e-01]
windy_storm:  74%|#######3  | 2212/3000 [1:06:17<16:04,  1.22s/it, lr: 1.0e-04 loss: 1.166e-01]
windy_storm:  74%|#######3  | 2212/3000 [1:06:17<16:04,  1.22s/it, lr: 1.0e-04 loss: 1.166e-01]
windy_storm:  74%|#######3  | 2212/3000 [1:06:20<16:04,  1.22s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:  74%|#######3  | 2212/3000 [1:06:20<16:04,  1.22s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:  74%|#######3  | 2213/3000 [1:06:20<22:10,  1.69s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:  74%|#######3  | 2213/3000 [1:06:20<22:10,  1.69s/it, lr: 1.0e-04 loss: 3.273e-02]
windy_storm:  74%|#######3  | 2213/3000 [1:06:23<22:10,  1.69s/it, lr: 1.0e-04 loss: 3.779e-01]
windy_storm:  74%|#######3  | 2213/3000 [1:06:23<22:10,  1.69s/it, lr: 1.0e-04 loss: 3.779e-01]
windy_storm:  74%|#######3  | 2214/3000 [1:06:23<26:32,  2.03s/it, lr: 1.0e-04 loss: 3.779e-01]
windy_storm:  74%|#######3  | 2214/3000 [1:06:23<26:32,  2.03s/it, lr: 1.0e-04 loss: 3.779e-01]
windy_storm:  74%|#######3  | 2214/3000 [1:06:24<26:32,  2.03s/it, lr: 1.0e-04 loss: 1.802e-01]
windy_storm:  74%|#######3  | 2214/3000 [1:06:24<26:32,  2.03s/it, lr: 1.0e-04 loss: 1.802e-01]
windy_storm:  74%|#######3  | 2215/3000 [1:06:24<22:07,  1.69s/it, lr: 1.0e-04 loss: 1.802e-01]
windy_storm:  74%|#######3  | 2215/3000 [1:06:24<22:07,  1.69s/it, lr: 1.0e-04 loss: 1.802e-01]
windy_storm:  74%|#######3  | 2215/3000 [1:06:27<22:07,  1.69s/it, lr: 1.0e-04 loss: 1.697e-01]
windy_storm:  74%|#######3  | 2215/3000 [1:06:27<22:07,  1.69s/it, lr: 1.0e-04 loss: 1.697e-01]
windy_storm:  74%|#######3  | 2216/3000 [1:06:27<26:46,  2.05s/it, lr: 1.0e-04 loss: 1.697e-01]
windy_storm:  74%|#######3  | 2216/3000 [1:06:27<26:46,  2.05s/it, lr: 1.0e-04 loss: 1.697e-01]
windy_storm:  74%|#######3  | 2216/3000 [1:06:29<26:46,  2.05s/it, lr: 1.0e-04 loss: 2.507e-01]
windy_storm:  74%|#######3  | 2216/3000 [1:06:29<26:46,  2.05s/it, lr: 1.0e-04 loss: 2.507e-01]
windy_storm:  74%|#######3  | 2217/3000 [1:06:29<24:58,  1.91s/it, lr: 1.0e-04 loss: 2.507e-01]
windy_storm:  74%|#######3  | 2217/3000 [1:06:29<24:58,  1.91s/it, lr: 1.0e-04 loss: 2.507e-01]
windy_storm:  74%|#######3  | 2217/3000 [1:06:29<24:58,  1.91s/it, lr: 1.0e-04 loss: 8.910e-02]
windy_storm:  74%|#######3  | 2217/3000 [1:06:29<24:58,  1.91s/it, lr: 1.0e-04 loss: 8.910e-02]
windy_storm:  74%|#######3  | 2218/3000 [1:06:29<20:47,  1.59s/it, lr: 1.0e-04 loss: 8.910e-02]
windy_storm:  74%|#######3  | 2218/3000 [1:06:29<20:47,  1.59s/it, lr: 1.0e-04 loss: 8.910e-02]
windy_storm:  74%|#######3  | 2218/3000 [1:06:32<20:47,  1.59s/it, lr: 1.0e-04 loss: 5.887e-02]
windy_storm:  74%|#######3  | 2218/3000 [1:06:32<20:47,  1.59s/it, lr: 1.0e-04 loss: 5.887e-02]
windy_storm:  74%|#######3  | 2219/3000 [1:06:32<25:51,  1.99s/it, lr: 1.0e-04 loss: 5.887e-02]
windy_storm:  74%|#######3  | 2219/3000 [1:06:32<25:51,  1.99s/it, lr: 1.0e-04 loss: 5.887e-02]
windy_storm:  74%|#######3  | 2219/3000 [1:06:33<25:51,  1.99s/it, lr: 1.0e-04 loss: 6.337e-01]
windy_storm:  74%|#######3  | 2219/3000 [1:06:33<25:51,  1.99s/it, lr: 1.0e-04 loss: 6.337e-01]
windy_storm:  74%|#######4  | 2220/3000 [1:06:35<25:49,  1.99s/it, lr: 1.0e-04 loss: 1.303e-01]
windy_storm:  74%|#######4  | 2220/3000 [1:06:35<25:49,  1.99s/it, lr: 1.0e-04 loss: 1.303e-01]
windy_storm:  74%|#######4  | 2221/3000 [1:06:35<18:41,  1.44s/it, lr: 1.0e-04 loss: 1.303e-01]
windy_storm:  74%|#######4  | 2221/3000 [1:06:35<18:41,  1.44s/it, lr: 1.0e-04 loss: 1.303e-01]
windy_storm:  74%|#######4  | 2221/3000 [1:06:38<18:41,  1.44s/it, lr: 1.0e-04 loss: 2.907e-01]
windy_storm:  74%|#######4  | 2221/3000 [1:06:38<18:41,  1.44s/it, lr: 1.0e-04 loss: 2.907e-01]
windy_storm:  74%|#######4  | 2222/3000 [1:06:38<23:14,  1.79s/it, lr: 1.0e-04 loss: 2.907e-01]
windy_storm:  74%|#######4  | 2222/3000 [1:06:38<23:14,  1.79s/it, lr: 1.0e-04 loss: 2.907e-01]
windy_storm:  74%|#######4  | 2222/3000 [1:06:39<23:14,  1.79s/it, lr: 1.0e-04 loss: 9.534e-02]
windy_storm:  74%|#######4  | 2222/3000 [1:06:39<23:14,  1.79s/it, lr: 1.0e-04 loss: 9.534e-02]
windy_storm:  74%|#######4  | 2223/3000 [1:06:39<22:56,  1.77s/it, lr: 1.0e-04 loss: 9.534e-02]
windy_storm:  74%|#######4  | 2223/3000 [1:06:39<22:56,  1.77s/it, lr: 1.0e-04 loss: 9.534e-02]
windy_storm:  74%|#######4  | 2223/3000 [1:06:40<22:56,  1.77s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  74%|#######4  | 2223/3000 [1:06:40<22:56,  1.77s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  74%|#######4  | 2224/3000 [1:06:40<19:38,  1.52s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  74%|#######4  | 2224/3000 [1:06:40<19:38,  1.52s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  74%|#######4  | 2224/3000 [1:06:43<19:38,  1.52s/it, lr: 1.0e-04 loss: 2.950e-01]
windy_storm:  74%|#######4  | 2224/3000 [1:06:43<19:38,  1.52s/it, lr: 1.0e-04 loss: 2.950e-01]
windy_storm:  74%|#######4  | 2225/3000 [1:06:43<24:41,  1.91s/it, lr: 1.0e-04 loss: 2.950e-01]
windy_storm:  74%|#######4  | 2225/3000 [1:06:43<24:41,  1.91s/it, lr: 1.0e-04 loss: 2.950e-01]
windy_storm:  74%|#######4  | 2225/3000 [1:06:45<24:41,  1.91s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  74%|#######4  | 2225/3000 [1:06:45<24:41,  1.91s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  74%|#######4  | 2226/3000 [1:06:45<23:18,  1.81s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  74%|#######4  | 2226/3000 [1:06:45<23:18,  1.81s/it, lr: 1.0e-04 loss: 5.969e-01]
windy_storm:  74%|#######4  | 2226/3000 [1:06:45<23:18,  1.81s/it, lr: 1.0e-04 loss: 5.430e-01]
windy_storm:  74%|#######4  | 2226/3000 [1:06:45<23:18,  1.81s/it, lr: 1.0e-04 loss: 5.430e-01]
windy_storm:  74%|#######4  | 2227/3000 [1:06:45<19:37,  1.52s/it, lr: 1.0e-04 loss: 5.430e-01]
windy_storm:  74%|#######4  | 2227/3000 [1:06:45<19:37,  1.52s/it, lr: 1.0e-04 loss: 5.430e-01]
windy_storm:  74%|#######4  | 2227/3000 [1:06:46<19:37,  1.52s/it, lr: 1.0e-04 loss: 4.393e-01]
windy_storm:  74%|#######4  | 2227/3000 [1:06:46<19:37,  1.52s/it, lr: 1.0e-04 loss: 4.393e-01]
windy_storm:  74%|#######4  | 2228/3000 [1:06:46<16:57,  1.32s/it, lr: 1.0e-04 loss: 4.393e-01]
windy_storm:  74%|#######4  | 2228/3000 [1:06:46<16:57,  1.32s/it, lr: 1.0e-04 loss: 4.393e-01]
windy_storm:  74%|#######4  | 2228/3000 [1:06:48<16:57,  1.32s/it, lr: 1.0e-04 loss: 6.435e-01]
windy_storm:  74%|#######4  | 2228/3000 [1:06:48<16:57,  1.32s/it, lr: 1.0e-04 loss: 6.435e-01]
windy_storm:  74%|#######4  | 2229/3000 [1:06:48<17:58,  1.40s/it, lr: 1.0e-04 loss: 6.435e-01]
windy_storm:  74%|#######4  | 2229/3000 [1:06:48<17:58,  1.40s/it, lr: 1.0e-04 loss: 6.435e-01]
windy_storm:  74%|#######4  | 2229/3000 [1:06:49<17:58,  1.40s/it, lr: 1.0e-04 loss: 1.957e-01]
windy_storm:  74%|#######4  | 2229/3000 [1:06:49<17:58,  1.40s/it, lr: 1.0e-04 loss: 1.957e-01]
windy_storm:  74%|#######4  | 2230/3000 [1:06:52<17:57,  1.40s/it, lr: 1.0e-04 loss: 5.881e-01]
windy_storm:  74%|#######4  | 2230/3000 [1:06:52<17:57,  1.40s/it, lr: 1.0e-04 loss: 5.881e-01]
windy_storm:  74%|#######4  | 2231/3000 [1:06:52<18:22,  1.43s/it, lr: 1.0e-04 loss: 5.881e-01]
windy_storm:  74%|#######4  | 2231/3000 [1:06:52<18:22,  1.43s/it, lr: 1.0e-04 loss: 5.881e-01]
windy_storm:  74%|#######4  | 2231/3000 [1:06:54<18:22,  1.43s/it, lr: 1.0e-04 loss: 6.234e-01]
windy_storm:  74%|#######4  | 2231/3000 [1:06:54<18:22,  1.43s/it, lr: 1.0e-04 loss: 6.234e-01]
windy_storm:  74%|#######4  | 2232/3000 [1:06:54<18:48,  1.47s/it, lr: 1.0e-04 loss: 6.234e-01]
windy_storm:  74%|#######4  | 2232/3000 [1:06:54<18:48,  1.47s/it, lr: 1.0e-04 loss: 6.234e-01]
windy_storm:  74%|#######4  | 2232/3000 [1:06:55<18:48,  1.47s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  74%|#######4  | 2232/3000 [1:06:55<18:48,  1.47s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  74%|#######4  | 2233/3000 [1:06:55<16:26,  1.29s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  74%|#######4  | 2233/3000 [1:06:55<16:26,  1.29s/it, lr: 1.0e-04 loss: 1.641e-01]
windy_storm:  74%|#######4  | 2233/3000 [1:06:56<16:26,  1.29s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  74%|#######4  | 2233/3000 [1:06:56<16:26,  1.29s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  74%|#######4  | 2234/3000 [1:06:56<14:43,  1.15s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  74%|#######4  | 2234/3000 [1:06:56<14:43,  1.15s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  74%|#######4  | 2234/3000 [1:06:56<14:43,  1.15s/it, lr: 1.0e-04 loss: 1.063e-02]
windy_storm:  74%|#######4  | 2234/3000 [1:06:56<14:43,  1.15s/it, lr: 1.0e-04 loss: 1.063e-02]
windy_storm:  74%|#######4  | 2235/3000 [1:06:56<13:32,  1.06s/it, lr: 1.0e-04 loss: 1.063e-02]
windy_storm:  74%|#######4  | 2235/3000 [1:06:56<13:32,  1.06s/it, lr: 1.0e-04 loss: 1.063e-02]
windy_storm:  74%|#######4  | 2235/3000 [1:06:59<13:32,  1.06s/it, lr: 1.0e-04 loss: 3.006e-01]
windy_storm:  74%|#######4  | 2235/3000 [1:06:59<13:32,  1.06s/it, lr: 1.0e-04 loss: 3.006e-01]
windy_storm:  75%|#######4  | 2236/3000 [1:06:59<20:35,  1.62s/it, lr: 1.0e-04 loss: 3.006e-01]
windy_storm:  75%|#######4  | 2236/3000 [1:06:59<20:35,  1.62s/it, lr: 1.0e-04 loss: 3.006e-01]
windy_storm:  75%|#######4  | 2236/3000 [1:07:02<20:35,  1.62s/it, lr: 1.0e-04 loss: 2.207e-01]
windy_storm:  75%|#######4  | 2236/3000 [1:07:02<20:35,  1.62s/it, lr: 1.0e-04 loss: 2.207e-01]
windy_storm:  75%|#######4  | 2237/3000 [1:07:02<25:38,  2.02s/it, lr: 1.0e-04 loss: 2.207e-01]
windy_storm:  75%|#######4  | 2237/3000 [1:07:02<25:38,  2.02s/it, lr: 1.0e-04 loss: 2.207e-01]
windy_storm:  75%|#######4  | 2237/3000 [1:07:05<25:38,  2.02s/it, lr: 1.0e-04 loss: 4.315e-01]
windy_storm:  75%|#######4  | 2237/3000 [1:07:05<25:38,  2.02s/it, lr: 1.0e-04 loss: 4.315e-01]
windy_storm:  75%|#######4  | 2238/3000 [1:07:05<29:30,  2.32s/it, lr: 1.0e-04 loss: 4.315e-01]
windy_storm:  75%|#######4  | 2238/3000 [1:07:05<29:30,  2.32s/it, lr: 1.0e-04 loss: 4.315e-01]
windy_storm:  75%|#######4  | 2238/3000 [1:07:08<29:30,  2.32s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:  75%|#######4  | 2238/3000 [1:07:08<29:30,  2.32s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:  75%|#######4  | 2239/3000 [1:07:08<32:03,  2.53s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:  75%|#######4  | 2239/3000 [1:07:08<32:03,  2.53s/it, lr: 1.0e-04 loss: 6.041e-01]
windy_storm:  75%|#######4  | 2239/3000 [1:07:09<32:03,  2.53s/it, lr: 1.0e-04 loss: 6.002e-01]
windy_storm:  75%|#######4  | 2239/3000 [1:07:09<32:03,  2.53s/it, lr: 1.0e-04 loss: 6.002e-01]
windy_storm:  75%|#######4  | 2240/3000 [1:07:10<32:00,  2.53s/it, lr: 1.0e-04 loss: 5.605e-01]
windy_storm:  75%|#######4  | 2240/3000 [1:07:10<32:00,  2.53s/it, lr: 1.0e-04 loss: 5.605e-01]
windy_storm:  75%|#######4  | 2241/3000 [1:07:10<19:35,  1.55s/it, lr: 1.0e-04 loss: 5.605e-01]
windy_storm:  75%|#######4  | 2241/3000 [1:07:10<19:35,  1.55s/it, lr: 1.0e-04 loss: 5.605e-01]
windy_storm:  75%|#######4  | 2241/3000 [1:07:11<19:35,  1.55s/it, lr: 1.0e-04 loss: 7.177e-01]
windy_storm:  75%|#######4  | 2241/3000 [1:07:11<19:35,  1.55s/it, lr: 1.0e-04 loss: 7.177e-01]
windy_storm:  75%|#######4  | 2242/3000 [1:07:11<17:09,  1.36s/it, lr: 1.0e-04 loss: 7.177e-01]
windy_storm:  75%|#######4  | 2242/3000 [1:07:11<17:09,  1.36s/it, lr: 1.0e-04 loss: 7.177e-01]
windy_storm:  75%|#######4  | 2242/3000 [1:07:12<17:09,  1.36s/it, lr: 1.0e-04 loss: 2.032e-01]
windy_storm:  75%|#######4  | 2242/3000 [1:07:12<17:09,  1.36s/it, lr: 1.0e-04 loss: 2.032e-01]
windy_storm:  75%|#######4  | 2243/3000 [1:07:12<17:57,  1.42s/it, lr: 1.0e-04 loss: 2.032e-01]
windy_storm:  75%|#######4  | 2243/3000 [1:07:12<17:57,  1.42s/it, lr: 1.0e-04 loss: 2.032e-01]
windy_storm:  75%|#######4  | 2243/3000 [1:07:13<17:57,  1.42s/it, lr: 1.0e-04 loss: 4.778e-01]
windy_storm:  75%|#######4  | 2243/3000 [1:07:13<17:57,  1.42s/it, lr: 1.0e-04 loss: 4.778e-01]
windy_storm:  75%|#######4  | 2244/3000 [1:07:13<15:44,  1.25s/it, lr: 1.0e-04 loss: 4.778e-01]
windy_storm:  75%|#######4  | 2244/3000 [1:07:13<15:44,  1.25s/it, lr: 1.0e-04 loss: 4.778e-01]
windy_storm:  75%|#######4  | 2244/3000 [1:07:15<15:44,  1.25s/it, lr: 1.0e-04 loss: 3.143e-01]
windy_storm:  75%|#######4  | 2244/3000 [1:07:15<15:44,  1.25s/it, lr: 1.0e-04 loss: 3.143e-01]
windy_storm:  75%|#######4  | 2245/3000 [1:07:15<16:54,  1.34s/it, lr: 1.0e-04 loss: 3.143e-01]
windy_storm:  75%|#######4  | 2245/3000 [1:07:15<16:54,  1.34s/it, lr: 1.0e-04 loss: 3.143e-01]
windy_storm:  75%|#######4  | 2245/3000 [1:07:16<16:54,  1.34s/it, lr: 1.0e-04 loss: 4.446e-01]
windy_storm:  75%|#######4  | 2245/3000 [1:07:16<16:54,  1.34s/it, lr: 1.0e-04 loss: 4.446e-01]
windy_storm:  75%|#######4  | 2246/3000 [1:07:16<17:38,  1.40s/it, lr: 1.0e-04 loss: 4.446e-01]
windy_storm:  75%|#######4  | 2246/3000 [1:07:16<17:38,  1.40s/it, lr: 1.0e-04 loss: 4.446e-01]
windy_storm:  75%|#######4  | 2246/3000 [1:07:17<17:38,  1.40s/it, lr: 1.0e-04 loss: 6.287e-01]
windy_storm:  75%|#######4  | 2246/3000 [1:07:17<17:38,  1.40s/it, lr: 1.0e-04 loss: 6.287e-01]
windy_storm:  75%|#######4  | 2247/3000 [1:07:17<15:31,  1.24s/it, lr: 1.0e-04 loss: 6.287e-01]
windy_storm:  75%|#######4  | 2247/3000 [1:07:17<15:31,  1.24s/it, lr: 1.0e-04 loss: 6.287e-01]
windy_storm:  75%|#######4  | 2247/3000 [1:07:19<15:31,  1.24s/it, lr: 1.0e-04 loss: 3.355e-01]
windy_storm:  75%|#######4  | 2247/3000 [1:07:19<15:31,  1.24s/it, lr: 1.0e-04 loss: 3.355e-01]
windy_storm:  75%|#######4  | 2248/3000 [1:07:19<16:44,  1.34s/it, lr: 1.0e-04 loss: 3.355e-01]
windy_storm:  75%|#######4  | 2248/3000 [1:07:19<16:44,  1.34s/it, lr: 1.0e-04 loss: 3.355e-01]
windy_storm:  75%|#######4  | 2248/3000 [1:07:20<16:44,  1.34s/it, lr: 1.0e-04 loss: 5.671e-01]
windy_storm:  75%|#######4  | 2248/3000 [1:07:20<16:44,  1.34s/it, lr: 1.0e-04 loss: 5.671e-01]
windy_storm:  75%|#######4  | 2249/3000 [1:07:20<17:34,  1.40s/it, lr: 1.0e-04 loss: 5.671e-01]
windy_storm:  75%|#######4  | 2249/3000 [1:07:20<17:34,  1.40s/it, lr: 1.0e-04 loss: 5.671e-01]
windy_storm:  75%|#######4  | 2249/3000 [1:07:22<17:34,  1.40s/it, lr: 1.0e-04 loss: 2.806e-01]
windy_storm:  75%|#######4  | 2249/3000 [1:07:22<17:34,  1.40s/it, lr: 1.0e-04 loss: 2.806e-01]
Saving at step 2250
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000002250.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000001250.safetensors

windy_storm:  75%|#######5  | 2250/3000 [1:07:23<17:33,  1.40s/it, lr: 1.0e-04 loss: 7.019e-01]
windy_storm:  75%|#######5  | 2250/3000 [1:07:23<17:33,  1.40s/it, lr: 1.0e-04 loss: 7.019e-01]
windy_storm:  75%|#######5  | 2251/3000 [1:07:23<12:31,  1.00s/it, lr: 1.0e-04 loss: 7.019e-01]
windy_storm:  75%|#######5  | 2251/3000 [1:07:23<12:31,  1.00s/it, lr: 1.0e-04 loss: 7.019e-01]
windy_storm:  75%|#######5  | 2251/3000 [1:07:26<12:31,  1.00s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  75%|#######5  | 2251/3000 [1:07:26<12:31,  1.00s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  75%|#######5  | 2252/3000 [1:07:26<18:29,  1.48s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  75%|#######5  | 2252/3000 [1:07:26<18:29,  1.48s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  75%|#######5  | 2252/3000 [1:07:28<18:29,  1.48s/it, lr: 1.0e-04 loss: 5.898e-01]
windy_storm:  75%|#######5  | 2252/3000 [1:07:28<18:29,  1.48s/it, lr: 1.0e-04 loss: 5.898e-01]
windy_storm:  75%|#######5  | 2253/3000 [1:07:28<18:53,  1.52s/it, lr: 1.0e-04 loss: 5.898e-01]
windy_storm:  75%|#######5  | 2253/3000 [1:07:28<18:53,  1.52s/it, lr: 1.0e-04 loss: 5.898e-01]
windy_storm:  75%|#######5  | 2253/3000 [1:07:31<18:53,  1.52s/it, lr: 1.0e-04 loss: 5.358e-02]
windy_storm:  75%|#######5  | 2253/3000 [1:07:31<18:53,  1.52s/it, lr: 1.0e-04 loss: 5.358e-02]
windy_storm:  75%|#######5  | 2254/3000 [1:07:31<23:44,  1.91s/it, lr: 1.0e-04 loss: 5.358e-02]
windy_storm:  75%|#######5  | 2254/3000 [1:07:31<23:44,  1.91s/it, lr: 1.0e-04 loss: 5.358e-02]
windy_storm:  75%|#######5  | 2254/3000 [1:07:32<23:44,  1.91s/it, lr: 1.0e-04 loss: 6.801e-01]
windy_storm:  75%|#######5  | 2254/3000 [1:07:32<23:44,  1.91s/it, lr: 1.0e-04 loss: 6.801e-01]
windy_storm:  75%|#######5  | 2255/3000 [1:07:32<22:36,  1.82s/it, lr: 1.0e-04 loss: 6.801e-01]
windy_storm:  75%|#######5  | 2255/3000 [1:07:32<22:36,  1.82s/it, lr: 1.0e-04 loss: 6.801e-01]
windy_storm:  75%|#######5  | 2255/3000 [1:07:34<22:36,  1.82s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  75%|#######5  | 2255/3000 [1:07:34<22:36,  1.82s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  75%|#######5  | 2256/3000 [1:07:34<21:56,  1.77s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  75%|#######5  | 2256/3000 [1:07:34<21:56,  1.77s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  75%|#######5  | 2256/3000 [1:07:35<21:56,  1.77s/it, lr: 1.0e-04 loss: 6.202e-01]
windy_storm:  75%|#######5  | 2256/3000 [1:07:35<21:56,  1.77s/it, lr: 1.0e-04 loss: 6.202e-01]
windy_storm:  75%|#######5  | 2257/3000 [1:07:35<18:19,  1.48s/it, lr: 1.0e-04 loss: 6.202e-01]
windy_storm:  75%|#######5  | 2257/3000 [1:07:35<18:19,  1.48s/it, lr: 1.0e-04 loss: 6.202e-01]
windy_storm:  75%|#######5  | 2257/3000 [1:07:38<18:19,  1.48s/it, lr: 1.0e-04 loss: 3.080e-01]
windy_storm:  75%|#######5  | 2257/3000 [1:07:38<18:19,  1.48s/it, lr: 1.0e-04 loss: 3.080e-01]
windy_storm:  75%|#######5  | 2258/3000 [1:07:38<23:58,  1.94s/it, lr: 1.0e-04 loss: 3.080e-01]
windy_storm:  75%|#######5  | 2258/3000 [1:07:38<23:58,  1.94s/it, lr: 1.0e-04 loss: 3.080e-01]
windy_storm:  75%|#######5  | 2258/3000 [1:07:41<23:58,  1.94s/it, lr: 1.0e-04 loss: 7.798e-02]
windy_storm:  75%|#######5  | 2258/3000 [1:07:41<23:58,  1.94s/it, lr: 1.0e-04 loss: 7.798e-02]
windy_storm:  75%|#######5  | 2259/3000 [1:07:41<27:55,  2.26s/it, lr: 1.0e-04 loss: 7.798e-02]
windy_storm:  75%|#######5  | 2259/3000 [1:07:41<27:55,  2.26s/it, lr: 1.0e-04 loss: 7.798e-02]
windy_storm:  75%|#######5  | 2259/3000 [1:07:42<27:55,  2.26s/it, lr: 1.0e-04 loss: 7.328e-01]
windy_storm:  75%|#######5  | 2259/3000 [1:07:42<27:55,  2.26s/it, lr: 1.0e-04 loss: 7.328e-01]
windy_storm:  75%|#######5  | 2260/3000 [1:07:44<27:53,  2.26s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  75%|#######5  | 2260/3000 [1:07:44<27:53,  2.26s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  75%|#######5  | 2261/3000 [1:07:44<19:31,  1.59s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  75%|#######5  | 2261/3000 [1:07:44<19:31,  1.59s/it, lr: 1.0e-04 loss: 6.334e-01]
windy_storm:  75%|#######5  | 2261/3000 [1:07:45<19:31,  1.59s/it, lr: 1.0e-04 loss: 6.472e-02]
windy_storm:  75%|#######5  | 2261/3000 [1:07:45<19:31,  1.59s/it, lr: 1.0e-04 loss: 6.472e-02]
windy_storm:  75%|#######5  | 2262/3000 [1:07:45<19:27,  1.58s/it, lr: 1.0e-04 loss: 6.472e-02]
windy_storm:  75%|#######5  | 2262/3000 [1:07:45<19:27,  1.58s/it, lr: 1.0e-04 loss: 6.472e-02]
windy_storm:  75%|#######5  | 2262/3000 [1:07:48<19:27,  1.58s/it, lr: 1.0e-04 loss: 6.471e-01]
windy_storm:  75%|#######5  | 2262/3000 [1:07:48<19:27,  1.58s/it, lr: 1.0e-04 loss: 6.471e-01]
windy_storm:  75%|#######5  | 2263/3000 [1:07:49<24:19,  1.98s/it, lr: 1.0e-04 loss: 6.471e-01]
windy_storm:  75%|#######5  | 2263/3000 [1:07:49<24:19,  1.98s/it, lr: 1.0e-04 loss: 6.471e-01]
windy_storm:  75%|#######5  | 2263/3000 [1:07:49<24:19,  1.98s/it, lr: 1.0e-04 loss: 6.845e-01]
windy_storm:  75%|#######5  | 2263/3000 [1:07:49<24:19,  1.98s/it, lr: 1.0e-04 loss: 6.845e-01]
windy_storm:  75%|#######5  | 2264/3000 [1:07:49<20:11,  1.65s/it, lr: 1.0e-04 loss: 6.845e-01]
windy_storm:  75%|#######5  | 2264/3000 [1:07:49<20:11,  1.65s/it, lr: 1.0e-04 loss: 6.845e-01]
windy_storm:  75%|#######5  | 2264/3000 [1:07:52<20:11,  1.65s/it, lr: 1.0e-04 loss: 2.710e-01]
windy_storm:  75%|#######5  | 2264/3000 [1:07:52<20:11,  1.65s/it, lr: 1.0e-04 loss: 2.710e-01]
windy_storm:  76%|#######5  | 2265/3000 [1:07:52<24:47,  2.02s/it, lr: 1.0e-04 loss: 2.710e-01]
windy_storm:  76%|#######5  | 2265/3000 [1:07:52<24:47,  2.02s/it, lr: 1.0e-04 loss: 2.710e-01]
windy_storm:  76%|#######5  | 2265/3000 [1:07:55<24:47,  2.02s/it, lr: 1.0e-04 loss: 4.753e-01]
windy_storm:  76%|#######5  | 2265/3000 [1:07:55<24:47,  2.02s/it, lr: 1.0e-04 loss: 4.753e-01]
windy_storm:  76%|#######5  | 2266/3000 [1:07:55<28:11,  2.30s/it, lr: 1.0e-04 loss: 4.753e-01]
windy_storm:  76%|#######5  | 2266/3000 [1:07:55<28:11,  2.30s/it, lr: 1.0e-04 loss: 4.753e-01]
windy_storm:  76%|#######5  | 2266/3000 [1:07:58<28:11,  2.30s/it, lr: 1.0e-04 loss: 5.506e-01]
windy_storm:  76%|#######5  | 2266/3000 [1:07:58<28:11,  2.30s/it, lr: 1.0e-04 loss: 5.506e-01]
windy_storm:  76%|#######5  | 2267/3000 [1:07:58<30:10,  2.47s/it, lr: 1.0e-04 loss: 5.506e-01]
windy_storm:  76%|#######5  | 2267/3000 [1:07:58<30:10,  2.47s/it, lr: 1.0e-04 loss: 5.506e-01]
windy_storm:  76%|#######5  | 2267/3000 [1:07:59<30:10,  2.47s/it, lr: 1.0e-04 loss: 5.347e-01]
windy_storm:  76%|#######5  | 2267/3000 [1:07:59<30:10,  2.47s/it, lr: 1.0e-04 loss: 5.347e-01]
windy_storm:  76%|#######5  | 2268/3000 [1:07:59<24:01,  1.97s/it, lr: 1.0e-04 loss: 5.347e-01]
windy_storm:  76%|#######5  | 2268/3000 [1:07:59<24:01,  1.97s/it, lr: 1.0e-04 loss: 5.347e-01]
windy_storm:  76%|#######5  | 2268/3000 [1:08:00<24:01,  1.97s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  76%|#######5  | 2268/3000 [1:08:00<24:01,  1.97s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  76%|#######5  | 2269/3000 [1:08:00<19:39,  1.61s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  76%|#######5  | 2269/3000 [1:08:00<19:39,  1.61s/it, lr: 1.0e-04 loss: 1.338e-01]
windy_storm:  76%|#######5  | 2269/3000 [1:08:03<19:39,  1.61s/it, lr: 1.0e-04 loss: 4.651e-01]
windy_storm:  76%|#######5  | 2269/3000 [1:08:03<19:39,  1.61s/it, lr: 1.0e-04 loss: 4.651e-01]
windy_storm:  76%|#######5  | 2270/3000 [1:08:03<19:38,  1.61s/it, lr: 1.0e-04 loss: 5.757e-01]
windy_storm:  76%|#######5  | 2270/3000 [1:08:03<19:38,  1.61s/it, lr: 1.0e-04 loss: 5.757e-01]
windy_storm:  76%|#######5  | 2271/3000 [1:08:03<12:45,  1.05s/it, lr: 1.0e-04 loss: 5.757e-01]
windy_storm:  76%|#######5  | 2271/3000 [1:08:03<12:45,  1.05s/it, lr: 1.0e-04 loss: 5.757e-01]
windy_storm:  76%|#######5  | 2271/3000 [1:08:04<12:45,  1.05s/it, lr: 1.0e-04 loss: 3.491e-01]
windy_storm:  76%|#######5  | 2271/3000 [1:08:04<12:45,  1.05s/it, lr: 1.0e-04 loss: 3.491e-01]
windy_storm:  76%|#######5  | 2272/3000 [1:08:04<11:47,  1.03it/s, lr: 1.0e-04 loss: 3.491e-01]
windy_storm:  76%|#######5  | 2272/3000 [1:08:04<11:47,  1.03it/s, lr: 1.0e-04 loss: 3.491e-01]
windy_storm:  76%|#######5  | 2272/3000 [1:08:07<11:47,  1.03it/s, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  76%|#######5  | 2272/3000 [1:08:07<11:47,  1.03it/s, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  76%|#######5  | 2273/3000 [1:08:07<18:10,  1.50s/it, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  76%|#######5  | 2273/3000 [1:08:07<18:10,  1.50s/it, lr: 1.0e-04 loss: 3.658e-01]
windy_storm:  76%|#######5  | 2273/3000 [1:08:09<18:10,  1.50s/it, lr: 1.0e-04 loss: 4.487e-01]
windy_storm:  76%|#######5  | 2273/3000 [1:08:09<18:10,  1.50s/it, lr: 1.0e-04 loss: 4.487e-01]
windy_storm:  76%|#######5  | 2274/3000 [1:08:09<18:23,  1.52s/it, lr: 1.0e-04 loss: 4.487e-01]
windy_storm:  76%|#######5  | 2274/3000 [1:08:09<18:23,  1.52s/it, lr: 1.0e-04 loss: 4.487e-01]
windy_storm:  76%|#######5  | 2274/3000 [1:08:12<18:23,  1.52s/it, lr: 1.0e-04 loss: 3.914e-01]
windy_storm:  76%|#######5  | 2274/3000 [1:08:12<18:23,  1.52s/it, lr: 1.0e-04 loss: 3.914e-01]
windy_storm:  76%|#######5  | 2275/3000 [1:08:12<23:18,  1.93s/it, lr: 1.0e-04 loss: 3.914e-01]
windy_storm:  76%|#######5  | 2275/3000 [1:08:12<23:18,  1.93s/it, lr: 1.0e-04 loss: 3.914e-01]
windy_storm:  76%|#######5  | 2275/3000 [1:08:13<23:18,  1.93s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  76%|#######5  | 2275/3000 [1:08:13<23:18,  1.93s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  76%|#######5  | 2276/3000 [1:08:13<22:05,  1.83s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  76%|#######5  | 2276/3000 [1:08:13<22:05,  1.83s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  76%|#######5  | 2276/3000 [1:08:16<22:05,  1.83s/it, lr: 1.0e-04 loss: 4.384e-02]
windy_storm:  76%|#######5  | 2276/3000 [1:08:16<22:05,  1.83s/it, lr: 1.0e-04 loss: 4.384e-02]
windy_storm:  76%|#######5  | 2277/3000 [1:08:16<26:07,  2.17s/it, lr: 1.0e-04 loss: 4.384e-02]
windy_storm:  76%|#######5  | 2277/3000 [1:08:16<26:07,  2.17s/it, lr: 1.0e-04 loss: 4.384e-02]
windy_storm:  76%|#######5  | 2277/3000 [1:08:17<26:07,  2.17s/it, lr: 1.0e-04 loss: 4.118e-01]
windy_storm:  76%|#######5  | 2277/3000 [1:08:17<26:07,  2.17s/it, lr: 1.0e-04 loss: 4.118e-01]
windy_storm:  76%|#######5  | 2278/3000 [1:08:17<22:01,  1.83s/it, lr: 1.0e-04 loss: 4.118e-01]
windy_storm:  76%|#######5  | 2278/3000 [1:08:17<22:01,  1.83s/it, lr: 1.0e-04 loss: 4.118e-01]
windy_storm:  76%|#######5  | 2278/3000 [1:08:18<22:01,  1.83s/it, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  76%|#######5  | 2278/3000 [1:08:18<22:01,  1.83s/it, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  76%|#######5  | 2279/3000 [1:08:18<18:24,  1.53s/it, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  76%|#######5  | 2279/3000 [1:08:18<18:24,  1.53s/it, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  76%|#######5  | 2279/3000 [1:08:20<18:24,  1.53s/it, lr: 1.0e-04 loss: 1.609e-01]
windy_storm:  76%|#######5  | 2279/3000 [1:08:20<18:24,  1.53s/it, lr: 1.0e-04 loss: 1.609e-01]
windy_storm:  76%|#######6  | 2280/3000 [1:08:21<18:22,  1.53s/it, lr: 1.0e-04 loss: 5.246e-01]
windy_storm:  76%|#######6  | 2280/3000 [1:08:21<18:22,  1.53s/it, lr: 1.0e-04 loss: 5.246e-01]
windy_storm:  76%|#######6  | 2281/3000 [1:08:21<12:11,  1.02s/it, lr: 1.0e-04 loss: 5.246e-01]
windy_storm:  76%|#######6  | 2281/3000 [1:08:21<12:11,  1.02s/it, lr: 1.0e-04 loss: 5.246e-01]
windy_storm:  76%|#######6  | 2281/3000 [1:08:22<12:11,  1.02s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  76%|#######6  | 2281/3000 [1:08:22<12:11,  1.02s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  76%|#######6  | 2282/3000 [1:08:22<13:50,  1.16s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  76%|#######6  | 2282/3000 [1:08:22<13:50,  1.16s/it, lr: 1.0e-04 loss: 1.089e-01]
windy_storm:  76%|#######6  | 2282/3000 [1:08:25<13:50,  1.16s/it, lr: 1.0e-04 loss: 7.255e-03]
windy_storm:  76%|#######6  | 2282/3000 [1:08:25<13:50,  1.16s/it, lr: 1.0e-04 loss: 7.255e-03]
windy_storm:  76%|#######6  | 2283/3000 [1:08:25<19:20,  1.62s/it, lr: 1.0e-04 loss: 7.255e-03]
windy_storm:  76%|#######6  | 2283/3000 [1:08:25<19:20,  1.62s/it, lr: 1.0e-04 loss: 7.255e-03]
windy_storm:  76%|#######6  | 2283/3000 [1:08:28<19:20,  1.62s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  76%|#######6  | 2283/3000 [1:08:28<19:20,  1.62s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  76%|#######6  | 2284/3000 [1:08:28<23:45,  1.99s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  76%|#######6  | 2284/3000 [1:08:28<23:45,  1.99s/it, lr: 1.0e-04 loss: 6.481e-01]
windy_storm:  76%|#######6  | 2284/3000 [1:08:29<23:45,  1.99s/it, lr: 1.0e-04 loss: 2.809e-01]
windy_storm:  76%|#######6  | 2284/3000 [1:08:29<23:45,  1.99s/it, lr: 1.0e-04 loss: 2.809e-01]
windy_storm:  76%|#######6  | 2285/3000 [1:08:29<19:37,  1.65s/it, lr: 1.0e-04 loss: 2.809e-01]
windy_storm:  76%|#######6  | 2285/3000 [1:08:29<19:37,  1.65s/it, lr: 1.0e-04 loss: 2.809e-01]
windy_storm:  76%|#######6  | 2285/3000 [1:08:32<19:37,  1.65s/it, lr: 1.0e-04 loss: 9.122e-02]
windy_storm:  76%|#######6  | 2285/3000 [1:08:32<19:37,  1.65s/it, lr: 1.0e-04 loss: 9.122e-02]
windy_storm:  76%|#######6  | 2286/3000 [1:08:32<24:10,  2.03s/it, lr: 1.0e-04 loss: 9.122e-02]
windy_storm:  76%|#######6  | 2286/3000 [1:08:32<24:10,  2.03s/it, lr: 1.0e-04 loss: 9.122e-02]
windy_storm:  76%|#######6  | 2286/3000 [1:08:34<24:10,  2.03s/it, lr: 1.0e-04 loss: 6.938e-01]
windy_storm:  76%|#######6  | 2286/3000 [1:08:34<24:10,  2.03s/it, lr: 1.0e-04 loss: 6.938e-01]
windy_storm:  76%|#######6  | 2287/3000 [1:08:34<22:30,  1.89s/it, lr: 1.0e-04 loss: 6.938e-01]
windy_storm:  76%|#######6  | 2287/3000 [1:08:34<22:30,  1.89s/it, lr: 1.0e-04 loss: 6.938e-01]
windy_storm:  76%|#######6  | 2287/3000 [1:08:35<22:30,  1.89s/it, lr: 1.0e-04 loss: 4.935e-01]
windy_storm:  76%|#######6  | 2287/3000 [1:08:35<22:30,  1.89s/it, lr: 1.0e-04 loss: 4.935e-01]
windy_storm:  76%|#######6  | 2288/3000 [1:08:35<18:42,  1.58s/it, lr: 1.0e-04 loss: 4.935e-01]
windy_storm:  76%|#######6  | 2288/3000 [1:08:35<18:42,  1.58s/it, lr: 1.0e-04 loss: 4.935e-01]
windy_storm:  76%|#######6  | 2288/3000 [1:08:36<18:42,  1.58s/it, lr: 1.0e-04 loss: 1.445e-01]
windy_storm:  76%|#######6  | 2288/3000 [1:08:36<18:42,  1.58s/it, lr: 1.0e-04 loss: 1.445e-01]
windy_storm:  76%|#######6  | 2289/3000 [1:08:36<18:29,  1.56s/it, lr: 1.0e-04 loss: 1.445e-01]
windy_storm:  76%|#######6  | 2289/3000 [1:08:36<18:29,  1.56s/it, lr: 1.0e-04 loss: 1.445e-01]
windy_storm:  76%|#######6  | 2289/3000 [1:08:38<18:29,  1.56s/it, lr: 1.0e-04 loss: 9.799e-02]
windy_storm:  76%|#######6  | 2289/3000 [1:08:38<18:29,  1.56s/it, lr: 1.0e-04 loss: 9.799e-02]
windy_storm:  76%|#######6  | 2290/3000 [1:08:41<18:28,  1.56s/it, lr: 1.0e-04 loss: 4.451e-01]
windy_storm:  76%|#######6  | 2290/3000 [1:08:41<18:28,  1.56s/it, lr: 1.0e-04 loss: 4.451e-01]
windy_storm:  76%|#######6  | 2291/3000 [1:08:41<17:58,  1.52s/it, lr: 1.0e-04 loss: 4.451e-01]
windy_storm:  76%|#######6  | 2291/3000 [1:08:41<17:58,  1.52s/it, lr: 1.0e-04 loss: 4.451e-01]
windy_storm:  76%|#######6  | 2291/3000 [1:08:42<17:58,  1.52s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  76%|#######6  | 2291/3000 [1:08:42<17:58,  1.52s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  76%|#######6  | 2292/3000 [1:08:42<18:58,  1.61s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  76%|#######6  | 2292/3000 [1:08:42<18:58,  1.61s/it, lr: 1.0e-04 loss: 3.744e-01]
windy_storm:  76%|#######6  | 2292/3000 [1:08:44<18:58,  1.61s/it, lr: 1.0e-04 loss: 7.886e-02]
windy_storm:  76%|#######6  | 2292/3000 [1:08:44<18:58,  1.61s/it, lr: 1.0e-04 loss: 7.886e-02]
windy_storm:  76%|#######6  | 2293/3000 [1:08:44<18:54,  1.60s/it, lr: 1.0e-04 loss: 7.886e-02]
windy_storm:  76%|#######6  | 2293/3000 [1:08:44<18:54,  1.60s/it, lr: 1.0e-04 loss: 7.886e-02]
windy_storm:  76%|#######6  | 2293/3000 [1:08:45<18:54,  1.60s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  76%|#######6  | 2293/3000 [1:08:45<18:54,  1.60s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  76%|#######6  | 2294/3000 [1:08:45<16:11,  1.38s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  76%|#######6  | 2294/3000 [1:08:45<16:11,  1.38s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  76%|#######6  | 2294/3000 [1:08:48<16:11,  1.38s/it, lr: 1.0e-04 loss: 6.412e-01]
windy_storm:  76%|#######6  | 2294/3000 [1:08:48<16:11,  1.38s/it, lr: 1.0e-04 loss: 6.412e-01]
windy_storm:  76%|#######6  | 2295/3000 [1:08:48<21:18,  1.81s/it, lr: 1.0e-04 loss: 6.412e-01]
windy_storm:  76%|#######6  | 2295/3000 [1:08:48<21:18,  1.81s/it, lr: 1.0e-04 loss: 6.412e-01]
windy_storm:  76%|#######6  | 2295/3000 [1:08:51<21:18,  1.81s/it, lr: 1.0e-04 loss: 5.954e-01]
windy_storm:  76%|#######6  | 2295/3000 [1:08:51<21:18,  1.81s/it, lr: 1.0e-04 loss: 5.954e-01]
windy_storm:  77%|#######6  | 2296/3000 [1:08:51<24:59,  2.13s/it, lr: 1.0e-04 loss: 5.954e-01]
windy_storm:  77%|#######6  | 2296/3000 [1:08:51<24:59,  2.13s/it, lr: 1.0e-04 loss: 5.954e-01]
windy_storm:  77%|#######6  | 2296/3000 [1:08:52<24:59,  2.13s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  77%|#######6  | 2296/3000 [1:08:52<24:59,  2.13s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  77%|#######6  | 2297/3000 [1:08:52<22:57,  1.96s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  77%|#######6  | 2297/3000 [1:08:52<22:57,  1.96s/it, lr: 1.0e-04 loss: 1.206e-01]
windy_storm:  77%|#######6  | 2297/3000 [1:08:53<22:57,  1.96s/it, lr: 1.0e-04 loss: 5.905e-01]
windy_storm:  77%|#######6  | 2297/3000 [1:08:53<22:57,  1.96s/it, lr: 1.0e-04 loss: 5.905e-01]
windy_storm:  77%|#######6  | 2298/3000 [1:08:53<18:49,  1.61s/it, lr: 1.0e-04 loss: 5.905e-01]
windy_storm:  77%|#######6  | 2298/3000 [1:08:53<18:49,  1.61s/it, lr: 1.0e-04 loss: 5.905e-01]
windy_storm:  77%|#######6  | 2298/3000 [1:08:56<18:49,  1.61s/it, lr: 1.0e-04 loss: 1.751e-01]
windy_storm:  77%|#######6  | 2298/3000 [1:08:56<18:49,  1.61s/it, lr: 1.0e-04 loss: 1.751e-01]
windy_storm:  77%|#######6  | 2299/3000 [1:08:56<23:34,  2.02s/it, lr: 1.0e-04 loss: 1.751e-01]
windy_storm:  77%|#######6  | 2299/3000 [1:08:56<23:34,  2.02s/it, lr: 1.0e-04 loss: 1.751e-01]
windy_storm:  77%|#######6  | 2299/3000 [1:08:59<23:34,  2.02s/it, lr: 1.0e-04 loss: 1.125e-01]
windy_storm:  77%|#######6  | 2299/3000 [1:08:59<23:34,  2.02s/it, lr: 1.0e-04 loss: 1.125e-01]
windy_storm:  77%|#######6  | 2300/3000 [1:09:02<23:32,  2.02s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  77%|#######6  | 2300/3000 [1:09:02<23:32,  2.02s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  77%|#######6  | 2301/3000 [1:09:02<20:33,  1.77s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  77%|#######6  | 2301/3000 [1:09:02<20:33,  1.77s/it, lr: 1.0e-04 loss: 3.928e-01]
windy_storm:  77%|#######6  | 2301/3000 [1:09:05<20:33,  1.77s/it, lr: 1.0e-04 loss: 8.912e-02]
windy_storm:  77%|#######6  | 2301/3000 [1:09:05<20:33,  1.77s/it, lr: 1.0e-04 loss: 8.912e-02]
windy_storm:  77%|#######6  | 2302/3000 [1:09:05<24:04,  2.07s/it, lr: 1.0e-04 loss: 8.912e-02]
windy_storm:  77%|#######6  | 2302/3000 [1:09:05<24:04,  2.07s/it, lr: 1.0e-04 loss: 8.912e-02]
windy_storm:  77%|#######6  | 2302/3000 [1:09:06<24:04,  2.07s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  77%|#######6  | 2302/3000 [1:09:06<24:04,  2.07s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  77%|#######6  | 2303/3000 [1:09:06<22:27,  1.93s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  77%|#######6  | 2303/3000 [1:09:06<22:27,  1.93s/it, lr: 1.0e-04 loss: 4.765e-01]
windy_storm:  77%|#######6  | 2303/3000 [1:09:08<22:27,  1.93s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  77%|#######6  | 2303/3000 [1:09:08<22:27,  1.93s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  77%|#######6  | 2304/3000 [1:09:08<21:19,  1.84s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  77%|#######6  | 2304/3000 [1:09:08<21:19,  1.84s/it, lr: 1.0e-04 loss: 1.316e-01]
windy_storm:  77%|#######6  | 2304/3000 [1:09:09<21:19,  1.84s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm:  77%|#######6  | 2304/3000 [1:09:09<21:19,  1.84s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm:  77%|#######6  | 2305/3000 [1:09:09<18:48,  1.62s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm:  77%|#######6  | 2305/3000 [1:09:09<18:48,  1.62s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm:  77%|#######6  | 2305/3000 [1:09:10<18:48,  1.62s/it, lr: 1.0e-04 loss: 6.816e-01]
windy_storm:  77%|#######6  | 2305/3000 [1:09:10<18:48,  1.62s/it, lr: 1.0e-04 loss: 6.816e-01]
windy_storm:  77%|#######6  | 2306/3000 [1:09:10<16:06,  1.39s/it, lr: 1.0e-04 loss: 6.816e-01]
windy_storm:  77%|#######6  | 2306/3000 [1:09:10<16:06,  1.39s/it, lr: 1.0e-04 loss: 6.816e-01]
windy_storm:  77%|#######6  | 2306/3000 [1:09:11<16:06,  1.39s/it, lr: 1.0e-04 loss: 6.935e-01]
windy_storm:  77%|#######6  | 2306/3000 [1:09:11<16:06,  1.39s/it, lr: 1.0e-04 loss: 6.935e-01]
windy_storm:  77%|#######6  | 2307/3000 [1:09:11<16:43,  1.45s/it, lr: 1.0e-04 loss: 6.935e-01]
windy_storm:  77%|#######6  | 2307/3000 [1:09:11<16:43,  1.45s/it, lr: 1.0e-04 loss: 6.935e-01]
windy_storm:  77%|#######6  | 2307/3000 [1:09:14<16:43,  1.45s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  77%|#######6  | 2307/3000 [1:09:14<16:43,  1.45s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  77%|#######6  | 2308/3000 [1:09:14<21:42,  1.88s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  77%|#######6  | 2308/3000 [1:09:14<21:42,  1.88s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  77%|#######6  | 2308/3000 [1:09:16<21:42,  1.88s/it, lr: 1.0e-04 loss: 4.363e-01]
windy_storm:  77%|#######6  | 2308/3000 [1:09:16<21:42,  1.88s/it, lr: 1.0e-04 loss: 4.363e-01]
windy_storm:  77%|#######6  | 2309/3000 [1:09:16<20:40,  1.79s/it, lr: 1.0e-04 loss: 4.363e-01]
windy_storm:  77%|#######6  | 2309/3000 [1:09:16<20:40,  1.79s/it, lr: 1.0e-04 loss: 4.363e-01]
windy_storm:  77%|#######6  | 2309/3000 [1:09:19<20:40,  1.79s/it, lr: 1.0e-04 loss: 4.093e-01]
windy_storm:  77%|#######6  | 2309/3000 [1:09:19<20:40,  1.79s/it, lr: 1.0e-04 loss: 4.093e-01]
windy_storm:  77%|#######7  | 2310/3000 [1:09:21<20:38,  1.79s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  77%|#######7  | 2310/3000 [1:09:21<20:38,  1.79s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  77%|#######7  | 2311/3000 [1:09:21<15:10,  1.32s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  77%|#######7  | 2311/3000 [1:09:21<15:10,  1.32s/it, lr: 1.0e-04 loss: 1.326e-01]
windy_storm:  77%|#######7  | 2311/3000 [1:09:21<15:10,  1.32s/it, lr: 1.0e-04 loss: 5.359e-01]
windy_storm:  77%|#######7  | 2311/3000 [1:09:21<15:10,  1.32s/it, lr: 1.0e-04 loss: 5.359e-01]
windy_storm:  77%|#######7  | 2312/3000 [1:09:21<13:44,  1.20s/it, lr: 1.0e-04 loss: 5.359e-01]
windy_storm:  77%|#######7  | 2312/3000 [1:09:21<13:44,  1.20s/it, lr: 1.0e-04 loss: 5.359e-01]
windy_storm:  77%|#######7  | 2312/3000 [1:09:22<13:44,  1.20s/it, lr: 1.0e-04 loss: 9.473e-02]
windy_storm:  77%|#######7  | 2312/3000 [1:09:22<13:44,  1.20s/it, lr: 1.0e-04 loss: 9.473e-02]
windy_storm:  77%|#######7  | 2313/3000 [1:09:22<12:25,  1.09s/it, lr: 1.0e-04 loss: 9.473e-02]
windy_storm:  77%|#######7  | 2313/3000 [1:09:22<12:25,  1.09s/it, lr: 1.0e-04 loss: 9.473e-02]
windy_storm:  77%|#######7  | 2313/3000 [1:09:24<12:25,  1.09s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  77%|#######7  | 2313/3000 [1:09:24<12:25,  1.09s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  77%|#######7  | 2314/3000 [1:09:24<13:59,  1.22s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  77%|#######7  | 2314/3000 [1:09:24<13:59,  1.22s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  77%|#######7  | 2314/3000 [1:09:27<13:59,  1.22s/it, lr: 1.0e-04 loss: 3.992e-01]
windy_storm:  77%|#######7  | 2314/3000 [1:09:27<13:59,  1.22s/it, lr: 1.0e-04 loss: 3.992e-01]
windy_storm:  77%|#######7  | 2315/3000 [1:09:27<19:39,  1.72s/it, lr: 1.0e-04 loss: 3.992e-01]
windy_storm:  77%|#######7  | 2315/3000 [1:09:27<19:39,  1.72s/it, lr: 1.0e-04 loss: 3.992e-01]
windy_storm:  77%|#######7  | 2315/3000 [1:09:28<19:39,  1.72s/it, lr: 1.0e-04 loss: 1.151e-01]
windy_storm:  77%|#######7  | 2315/3000 [1:09:28<19:39,  1.72s/it, lr: 1.0e-04 loss: 1.151e-01]
windy_storm:  77%|#######7  | 2316/3000 [1:09:28<16:43,  1.47s/it, lr: 1.0e-04 loss: 1.151e-01]
windy_storm:  77%|#######7  | 2316/3000 [1:09:28<16:43,  1.47s/it, lr: 1.0e-04 loss: 1.151e-01]
windy_storm:  77%|#######7  | 2316/3000 [1:09:29<16:43,  1.47s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  77%|#######7  | 2316/3000 [1:09:29<16:43,  1.47s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  77%|#######7  | 2317/3000 [1:09:29<17:07,  1.50s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  77%|#######7  | 2317/3000 [1:09:29<17:07,  1.50s/it, lr: 1.0e-04 loss: 1.607e-01]
windy_storm:  77%|#######7  | 2317/3000 [1:09:31<17:07,  1.50s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  77%|#######7  | 2317/3000 [1:09:31<17:07,  1.50s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  77%|#######7  | 2318/3000 [1:09:31<17:48,  1.57s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  77%|#######7  | 2318/3000 [1:09:31<17:48,  1.57s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  77%|#######7  | 2318/3000 [1:09:34<17:48,  1.57s/it, lr: 1.0e-04 loss: 5.913e-01]
windy_storm:  77%|#######7  | 2318/3000 [1:09:34<17:48,  1.57s/it, lr: 1.0e-04 loss: 5.913e-01]
windy_storm:  77%|#######7  | 2319/3000 [1:09:34<22:39,  2.00s/it, lr: 1.0e-04 loss: 5.913e-01]
windy_storm:  77%|#######7  | 2319/3000 [1:09:34<22:39,  2.00s/it, lr: 1.0e-04 loss: 5.913e-01]
windy_storm:  77%|#######7  | 2319/3000 [1:09:35<22:39,  2.00s/it, lr: 1.0e-04 loss: 6.222e-01]
windy_storm:  77%|#######7  | 2319/3000 [1:09:35<22:39,  2.00s/it, lr: 1.0e-04 loss: 6.222e-01]
windy_storm:  77%|#######7  | 2320/3000 [1:09:38<22:37,  2.00s/it, lr: 1.0e-04 loss: 2.608e-01]
windy_storm:  77%|#######7  | 2320/3000 [1:09:38<22:37,  2.00s/it, lr: 1.0e-04 loss: 2.608e-01]
windy_storm:  77%|#######7  | 2321/3000 [1:09:38<19:53,  1.76s/it, lr: 1.0e-04 loss: 2.608e-01]
windy_storm:  77%|#######7  | 2321/3000 [1:09:38<19:53,  1.76s/it, lr: 1.0e-04 loss: 2.608e-01]
windy_storm:  77%|#######7  | 2321/3000 [1:09:39<19:53,  1.76s/it, lr: 1.0e-04 loss: 1.609e-01]
windy_storm:  77%|#######7  | 2321/3000 [1:09:39<19:53,  1.76s/it, lr: 1.0e-04 loss: 1.609e-01]
windy_storm:  77%|#######7  | 2322/3000 [1:09:39<17:01,  1.51s/it, lr: 1.0e-04 loss: 1.609e-01]
windy_storm:  77%|#######7  | 2322/3000 [1:09:39<17:01,  1.51s/it, lr: 1.0e-04 loss: 1.609e-01]
windy_storm:  77%|#######7  | 2322/3000 [1:09:42<17:01,  1.51s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  77%|#######7  | 2322/3000 [1:09:42<17:01,  1.51s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  77%|#######7  | 2323/3000 [1:09:42<21:15,  1.88s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  77%|#######7  | 2323/3000 [1:09:42<21:15,  1.88s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  77%|#######7  | 2323/3000 [1:09:43<21:15,  1.88s/it, lr: 1.0e-04 loss: 5.394e-01]
windy_storm:  77%|#######7  | 2323/3000 [1:09:43<21:15,  1.88s/it, lr: 1.0e-04 loss: 5.394e-01]
windy_storm:  77%|#######7  | 2324/3000 [1:09:43<17:48,  1.58s/it, lr: 1.0e-04 loss: 5.394e-01]
windy_storm:  77%|#######7  | 2324/3000 [1:09:43<17:48,  1.58s/it, lr: 1.0e-04 loss: 5.394e-01]
windy_storm:  77%|#######7  | 2324/3000 [1:09:44<17:48,  1.58s/it, lr: 1.0e-04 loss: 7.588e-02]
windy_storm:  77%|#######7  | 2324/3000 [1:09:44<17:48,  1.58s/it, lr: 1.0e-04 loss: 7.588e-02]
windy_storm:  78%|#######7  | 2325/3000 [1:09:44<15:11,  1.35s/it, lr: 1.0e-04 loss: 7.588e-02]
windy_storm:  78%|#######7  | 2325/3000 [1:09:44<15:11,  1.35s/it, lr: 1.0e-04 loss: 7.588e-02]
windy_storm:  78%|#######7  | 2325/3000 [1:09:47<15:11,  1.35s/it, lr: 1.0e-04 loss: 5.444e-02]
windy_storm:  78%|#######7  | 2325/3000 [1:09:47<15:11,  1.35s/it, lr: 1.0e-04 loss: 5.444e-02]
windy_storm:  78%|#######7  | 2326/3000 [1:09:47<20:19,  1.81s/it, lr: 1.0e-04 loss: 5.444e-02]
windy_storm:  78%|#######7  | 2326/3000 [1:09:47<20:19,  1.81s/it, lr: 1.0e-04 loss: 5.444e-02]
windy_storm:  78%|#######7  | 2326/3000 [1:09:48<20:19,  1.81s/it, lr: 1.0e-04 loss: 6.796e-01]
windy_storm:  78%|#######7  | 2326/3000 [1:09:48<20:19,  1.81s/it, lr: 1.0e-04 loss: 6.796e-01]
windy_storm:  78%|#######7  | 2327/3000 [1:09:48<19:35,  1.75s/it, lr: 1.0e-04 loss: 6.796e-01]
windy_storm:  78%|#######7  | 2327/3000 [1:09:48<19:35,  1.75s/it, lr: 1.0e-04 loss: 6.796e-01]
windy_storm:  78%|#######7  | 2327/3000 [1:09:49<19:35,  1.75s/it, lr: 1.0e-04 loss: 1.505e-01]
windy_storm:  78%|#######7  | 2327/3000 [1:09:49<19:35,  1.75s/it, lr: 1.0e-04 loss: 1.505e-01]
windy_storm:  78%|#######7  | 2328/3000 [1:09:49<16:31,  1.48s/it, lr: 1.0e-04 loss: 1.505e-01]
windy_storm:  78%|#######7  | 2328/3000 [1:09:49<16:31,  1.48s/it, lr: 1.0e-04 loss: 1.505e-01]
windy_storm:  78%|#######7  | 2328/3000 [1:09:51<16:31,  1.48s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:  78%|#######7  | 2328/3000 [1:09:51<16:31,  1.48s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:  78%|#######7  | 2329/3000 [1:09:51<16:50,  1.51s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:  78%|#######7  | 2329/3000 [1:09:51<16:50,  1.51s/it, lr: 1.0e-04 loss: 6.319e-01]
windy_storm:  78%|#######7  | 2329/3000 [1:09:52<16:50,  1.51s/it, lr: 1.0e-04 loss: 6.082e-01]
windy_storm:  78%|#######7  | 2329/3000 [1:09:52<16:50,  1.51s/it, lr: 1.0e-04 loss: 6.082e-01]
windy_storm:  78%|#######7  | 2330/3000 [1:09:54<16:48,  1.51s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  78%|#######7  | 2330/3000 [1:09:54<16:48,  1.51s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  78%|#######7  | 2331/3000 [1:09:54<13:10,  1.18s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  78%|#######7  | 2331/3000 [1:09:54<13:10,  1.18s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  78%|#######7  | 2331/3000 [1:09:55<13:10,  1.18s/it, lr: 1.0e-04 loss: 7.317e-02]
windy_storm:  78%|#######7  | 2331/3000 [1:09:55<13:10,  1.18s/it, lr: 1.0e-04 loss: 7.317e-02]
windy_storm:  78%|#######7  | 2332/3000 [1:09:55<12:01,  1.08s/it, lr: 1.0e-04 loss: 7.317e-02]
windy_storm:  78%|#######7  | 2332/3000 [1:09:55<12:01,  1.08s/it, lr: 1.0e-04 loss: 7.317e-02]
windy_storm:  78%|#######7  | 2332/3000 [1:09:56<12:01,  1.08s/it, lr: 1.0e-04 loss: 1.527e-01]
windy_storm:  78%|#######7  | 2332/3000 [1:09:56<12:01,  1.08s/it, lr: 1.0e-04 loss: 1.527e-01]
windy_storm:  78%|#######7  | 2333/3000 [1:09:56<13:59,  1.26s/it, lr: 1.0e-04 loss: 1.527e-01]
windy_storm:  78%|#######7  | 2333/3000 [1:09:56<13:59,  1.26s/it, lr: 1.0e-04 loss: 1.527e-01]
windy_storm:  78%|#######7  | 2333/3000 [1:09:57<13:59,  1.26s/it, lr: 1.0e-04 loss: 2.244e-01]
windy_storm:  78%|#######7  | 2333/3000 [1:09:57<13:59,  1.26s/it, lr: 1.0e-04 loss: 2.244e-01]
windy_storm:  78%|#######7  | 2334/3000 [1:09:57<12:30,  1.13s/it, lr: 1.0e-04 loss: 2.244e-01]
windy_storm:  78%|#######7  | 2334/3000 [1:09:57<12:30,  1.13s/it, lr: 1.0e-04 loss: 2.244e-01]
windy_storm:  78%|#######7  | 2334/3000 [1:09:59<12:30,  1.13s/it, lr: 1.0e-04 loss: 5.125e-01]
windy_storm:  78%|#######7  | 2334/3000 [1:09:59<12:30,  1.13s/it, lr: 1.0e-04 loss: 5.125e-01]
windy_storm:  78%|#######7  | 2335/3000 [1:09:59<13:50,  1.25s/it, lr: 1.0e-04 loss: 5.125e-01]
windy_storm:  78%|#######7  | 2335/3000 [1:09:59<13:50,  1.25s/it, lr: 1.0e-04 loss: 5.125e-01]
windy_storm:  78%|#######7  | 2335/3000 [1:10:00<13:50,  1.25s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  78%|#######7  | 2335/3000 [1:10:00<13:50,  1.25s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  78%|#######7  | 2336/3000 [1:10:00<14:56,  1.35s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  78%|#######7  | 2336/3000 [1:10:00<14:56,  1.35s/it, lr: 1.0e-04 loss: 2.089e-01]
windy_storm:  78%|#######7  | 2336/3000 [1:10:01<14:56,  1.35s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:  78%|#######7  | 2336/3000 [1:10:01<14:56,  1.35s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:  78%|#######7  | 2337/3000 [1:10:01<13:15,  1.20s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:  78%|#######7  | 2337/3000 [1:10:01<13:15,  1.20s/it, lr: 1.0e-04 loss: 4.687e-01]
windy_storm:  78%|#######7  | 2337/3000 [1:10:04<13:15,  1.20s/it, lr: 1.0e-04 loss: 6.839e-01]
windy_storm:  78%|#######7  | 2337/3000 [1:10:04<13:15,  1.20s/it, lr: 1.0e-04 loss: 6.839e-01]
windy_storm:  78%|#######7  | 2338/3000 [1:10:04<18:53,  1.71s/it, lr: 1.0e-04 loss: 6.839e-01]
windy_storm:  78%|#######7  | 2338/3000 [1:10:04<18:53,  1.71s/it, lr: 1.0e-04 loss: 6.839e-01]
windy_storm:  78%|#######7  | 2338/3000 [1:10:06<18:53,  1.71s/it, lr: 1.0e-04 loss: 1.817e-01]
windy_storm:  78%|#######7  | 2338/3000 [1:10:06<18:53,  1.71s/it, lr: 1.0e-04 loss: 1.817e-01]
windy_storm:  78%|#######7  | 2339/3000 [1:10:06<18:31,  1.68s/it, lr: 1.0e-04 loss: 1.817e-01]
windy_storm:  78%|#######7  | 2339/3000 [1:10:06<18:31,  1.68s/it, lr: 1.0e-04 loss: 1.817e-01]
windy_storm:  78%|#######7  | 2339/3000 [1:10:09<18:31,  1.68s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  78%|#######7  | 2339/3000 [1:10:09<18:31,  1.68s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  78%|#######8  | 2340/3000 [1:10:12<18:29,  1.68s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  78%|#######8  | 2340/3000 [1:10:12<18:29,  1.68s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  78%|#######8  | 2341/3000 [1:10:12<17:35,  1.60s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  78%|#######8  | 2341/3000 [1:10:12<17:35,  1.60s/it, lr: 1.0e-04 loss: 1.875e-01]
windy_storm:  78%|#######8  | 2341/3000 [1:10:12<17:35,  1.60s/it, lr: 1.0e-04 loss: 6.259e-01]
windy_storm:  78%|#######8  | 2341/3000 [1:10:12<17:35,  1.60s/it, lr: 1.0e-04 loss: 6.259e-01]
windy_storm:  78%|#######8  | 2342/3000 [1:10:12<15:28,  1.41s/it, lr: 1.0e-04 loss: 6.259e-01]
windy_storm:  78%|#######8  | 2342/3000 [1:10:12<15:28,  1.41s/it, lr: 1.0e-04 loss: 6.259e-01]
windy_storm:  78%|#######8  | 2342/3000 [1:10:15<15:28,  1.41s/it, lr: 1.0e-04 loss: 4.325e-01]
windy_storm:  78%|#######8  | 2342/3000 [1:10:15<15:28,  1.41s/it, lr: 1.0e-04 loss: 4.325e-01]
windy_storm:  78%|#######8  | 2343/3000 [1:10:15<19:49,  1.81s/it, lr: 1.0e-04 loss: 4.325e-01]
windy_storm:  78%|#######8  | 2343/3000 [1:10:15<19:49,  1.81s/it, lr: 1.0e-04 loss: 4.325e-01]
windy_storm:  78%|#######8  | 2343/3000 [1:10:16<19:49,  1.81s/it, lr: 1.0e-04 loss: 2.671e-01]
windy_storm:  78%|#######8  | 2343/3000 [1:10:16<19:49,  1.81s/it, lr: 1.0e-04 loss: 2.671e-01]
windy_storm:  78%|#######8  | 2344/3000 [1:10:16<16:42,  1.53s/it, lr: 1.0e-04 loss: 2.671e-01]
windy_storm:  78%|#######8  | 2344/3000 [1:10:16<16:42,  1.53s/it, lr: 1.0e-04 loss: 2.671e-01]
windy_storm:  78%|#######8  | 2344/3000 [1:10:17<16:42,  1.53s/it, lr: 1.0e-04 loss: 6.028e-01]
windy_storm:  78%|#######8  | 2344/3000 [1:10:17<16:42,  1.53s/it, lr: 1.0e-04 loss: 6.028e-01]
windy_storm:  78%|#######8  | 2345/3000 [1:10:17<14:22,  1.32s/it, lr: 1.0e-04 loss: 6.028e-01]
windy_storm:  78%|#######8  | 2345/3000 [1:10:17<14:22,  1.32s/it, lr: 1.0e-04 loss: 6.028e-01]
windy_storm:  78%|#######8  | 2345/3000 [1:10:19<14:22,  1.32s/it, lr: 1.0e-04 loss: 4.304e-01]
windy_storm:  78%|#######8  | 2345/3000 [1:10:19<14:22,  1.32s/it, lr: 1.0e-04 loss: 4.304e-01]
windy_storm:  78%|#######8  | 2346/3000 [1:10:19<15:13,  1.40s/it, lr: 1.0e-04 loss: 4.304e-01]
windy_storm:  78%|#######8  | 2346/3000 [1:10:19<15:13,  1.40s/it, lr: 1.0e-04 loss: 4.304e-01]
windy_storm:  78%|#######8  | 2346/3000 [1:10:20<15:13,  1.40s/it, lr: 1.0e-04 loss: 2.811e-01]
windy_storm:  78%|#######8  | 2346/3000 [1:10:20<15:13,  1.40s/it, lr: 1.0e-04 loss: 2.811e-01]
windy_storm:  78%|#######8  | 2347/3000 [1:10:20<13:54,  1.28s/it, lr: 1.0e-04 loss: 2.811e-01]
windy_storm:  78%|#######8  | 2347/3000 [1:10:20<13:54,  1.28s/it, lr: 1.0e-04 loss: 2.811e-01]
windy_storm:  78%|#######8  | 2347/3000 [1:10:20<13:54,  1.28s/it, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  78%|#######8  | 2347/3000 [1:10:20<13:54,  1.28s/it, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  78%|#######8  | 2348/3000 [1:10:20<12:16,  1.13s/it, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  78%|#######8  | 2348/3000 [1:10:20<12:16,  1.13s/it, lr: 1.0e-04 loss: 3.924e-01]
windy_storm:  78%|#######8  | 2348/3000 [1:10:23<12:16,  1.13s/it, lr: 1.0e-04 loss: 8.809e-02]
windy_storm:  78%|#######8  | 2348/3000 [1:10:23<12:16,  1.13s/it, lr: 1.0e-04 loss: 8.809e-02]
windy_storm:  78%|#######8  | 2349/3000 [1:10:23<18:20,  1.69s/it, lr: 1.0e-04 loss: 8.809e-02]
windy_storm:  78%|#######8  | 2349/3000 [1:10:23<18:20,  1.69s/it, lr: 1.0e-04 loss: 8.809e-02]
windy_storm:  78%|#######8  | 2349/3000 [1:10:24<18:20,  1.69s/it, lr: 1.0e-04 loss: 6.826e-01]
windy_storm:  78%|#######8  | 2349/3000 [1:10:24<18:20,  1.69s/it, lr: 1.0e-04 loss: 6.826e-01]
windy_storm:  78%|#######8  | 2350/3000 [1:10:27<18:19,  1.69s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  78%|#######8  | 2350/3000 [1:10:27<18:19,  1.69s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  78%|#######8  | 2351/3000 [1:10:27<17:25,  1.61s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  78%|#######8  | 2351/3000 [1:10:27<17:25,  1.61s/it, lr: 1.0e-04 loss: 4.783e-01]
windy_storm:  78%|#######8  | 2351/3000 [1:10:28<17:25,  1.61s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  78%|#######8  | 2351/3000 [1:10:28<17:25,  1.61s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  78%|#######8  | 2352/3000 [1:10:28<15:17,  1.42s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  78%|#######8  | 2352/3000 [1:10:28<15:17,  1.42s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  78%|#######8  | 2352/3000 [1:10:31<15:17,  1.42s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:  78%|#######8  | 2352/3000 [1:10:31<15:17,  1.42s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:  78%|#######8  | 2353/3000 [1:10:31<19:38,  1.82s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:  78%|#######8  | 2353/3000 [1:10:31<19:38,  1.82s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:  78%|#######8  | 2353/3000 [1:10:33<19:38,  1.82s/it, lr: 1.0e-04 loss: 4.238e-01]
windy_storm:  78%|#######8  | 2353/3000 [1:10:33<19:38,  1.82s/it, lr: 1.0e-04 loss: 4.238e-01]
windy_storm:  78%|#######8  | 2354/3000 [1:10:33<18:58,  1.76s/it, lr: 1.0e-04 loss: 4.238e-01]
windy_storm:  78%|#######8  | 2354/3000 [1:10:33<18:58,  1.76s/it, lr: 1.0e-04 loss: 4.238e-01]
windy_storm:  78%|#######8  | 2354/3000 [1:10:36<18:58,  1.76s/it, lr: 1.0e-04 loss: 5.299e-01]
windy_storm:  78%|#######8  | 2354/3000 [1:10:36<18:58,  1.76s/it, lr: 1.0e-04 loss: 5.299e-01]
windy_storm:  78%|#######8  | 2355/3000 [1:10:36<22:46,  2.12s/it, lr: 1.0e-04 loss: 5.299e-01]
windy_storm:  78%|#######8  | 2355/3000 [1:10:36<22:46,  2.12s/it, lr: 1.0e-04 loss: 5.299e-01]
windy_storm:  78%|#######8  | 2355/3000 [1:10:36<22:46,  2.12s/it, lr: 1.0e-04 loss: 1.579e-01]
windy_storm:  78%|#######8  | 2355/3000 [1:10:36<22:46,  2.12s/it, lr: 1.0e-04 loss: 1.579e-01]
windy_storm:  79%|#######8  | 2356/3000 [1:10:36<18:47,  1.75s/it, lr: 1.0e-04 loss: 1.579e-01]
windy_storm:  79%|#######8  | 2356/3000 [1:10:36<18:47,  1.75s/it, lr: 1.0e-04 loss: 1.579e-01]
windy_storm:  79%|#######8  | 2356/3000 [1:10:38<18:47,  1.75s/it, lr: 1.0e-04 loss: 3.465e-01]
windy_storm:  79%|#######8  | 2356/3000 [1:10:38<18:47,  1.75s/it, lr: 1.0e-04 loss: 3.465e-01]
windy_storm:  79%|#######8  | 2357/3000 [1:10:38<18:12,  1.70s/it, lr: 1.0e-04 loss: 3.465e-01]
windy_storm:  79%|#######8  | 2357/3000 [1:10:38<18:12,  1.70s/it, lr: 1.0e-04 loss: 3.465e-01]
windy_storm:  79%|#######8  | 2357/3000 [1:10:41<18:12,  1.70s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  79%|#######8  | 2357/3000 [1:10:41<18:12,  1.70s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  79%|#######8  | 2358/3000 [1:10:41<22:20,  2.09s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  79%|#######8  | 2358/3000 [1:10:41<22:20,  2.09s/it, lr: 1.0e-04 loss: 4.397e-01]
windy_storm:  79%|#######8  | 2358/3000 [1:10:43<22:20,  2.09s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:  79%|#######8  | 2358/3000 [1:10:43<22:20,  2.09s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:  79%|#######8  | 2359/3000 [1:10:43<20:40,  1.94s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:  79%|#######8  | 2359/3000 [1:10:43<20:40,  1.94s/it, lr: 1.0e-04 loss: 3.907e-01]
windy_storm:  79%|#######8  | 2359/3000 [1:10:46<20:40,  1.94s/it, lr: 1.0e-04 loss: 4.797e-01]
windy_storm:  79%|#######8  | 2359/3000 [1:10:46<20:40,  1.94s/it, lr: 1.0e-04 loss: 4.797e-01]
windy_storm:  79%|#######8  | 2360/3000 [1:10:47<20:38,  1.94s/it, lr: 1.0e-04 loss: 2.467e-01]
windy_storm:  79%|#######8  | 2360/3000 [1:10:47<20:38,  1.94s/it, lr: 1.0e-04 loss: 2.467e-01]
windy_storm:  79%|#######8  | 2361/3000 [1:10:47<15:03,  1.41s/it, lr: 1.0e-04 loss: 2.467e-01]
windy_storm:  79%|#######8  | 2361/3000 [1:10:47<15:03,  1.41s/it, lr: 1.0e-04 loss: 2.467e-01]
windy_storm:  79%|#######8  | 2361/3000 [1:10:50<15:03,  1.41s/it, lr: 1.0e-04 loss: 4.585e-02]
windy_storm:  79%|#######8  | 2361/3000 [1:10:50<15:03,  1.41s/it, lr: 1.0e-04 loss: 4.585e-02]
windy_storm:  79%|#######8  | 2362/3000 [1:10:50<19:05,  1.80s/it, lr: 1.0e-04 loss: 4.585e-02]
windy_storm:  79%|#######8  | 2362/3000 [1:10:50<19:05,  1.80s/it, lr: 1.0e-04 loss: 4.585e-02]
windy_storm:  79%|#######8  | 2362/3000 [1:10:52<19:05,  1.80s/it, lr: 1.0e-04 loss: 3.146e-01]
windy_storm:  79%|#######8  | 2362/3000 [1:10:52<19:05,  1.80s/it, lr: 1.0e-04 loss: 3.146e-01]
windy_storm:  79%|#######8  | 2363/3000 [1:10:52<18:25,  1.74s/it, lr: 1.0e-04 loss: 3.146e-01]
windy_storm:  79%|#######8  | 2363/3000 [1:10:52<18:25,  1.74s/it, lr: 1.0e-04 loss: 3.146e-01]
windy_storm:  79%|#######8  | 2363/3000 [1:10:53<18:25,  1.74s/it, lr: 1.0e-04 loss: 2.666e-01]
windy_storm:  79%|#######8  | 2363/3000 [1:10:53<18:25,  1.74s/it, lr: 1.0e-04 loss: 2.666e-01]
windy_storm:  79%|#######8  | 2364/3000 [1:10:53<15:45,  1.49s/it, lr: 1.0e-04 loss: 2.666e-01]
windy_storm:  79%|#######8  | 2364/3000 [1:10:53<15:45,  1.49s/it, lr: 1.0e-04 loss: 2.666e-01]
windy_storm:  79%|#######8  | 2364/3000 [1:10:54<15:45,  1.49s/it, lr: 1.0e-04 loss: 5.783e-01]
windy_storm:  79%|#######8  | 2364/3000 [1:10:54<15:45,  1.49s/it, lr: 1.0e-04 loss: 5.783e-01]
windy_storm:  79%|#######8  | 2365/3000 [1:10:54<13:36,  1.29s/it, lr: 1.0e-04 loss: 5.783e-01]
windy_storm:  79%|#######8  | 2365/3000 [1:10:54<13:36,  1.29s/it, lr: 1.0e-04 loss: 5.783e-01]
windy_storm:  79%|#######8  | 2365/3000 [1:10:55<13:36,  1.29s/it, lr: 1.0e-04 loss: 1.213e-01]
windy_storm:  79%|#######8  | 2365/3000 [1:10:55<13:36,  1.29s/it, lr: 1.0e-04 loss: 1.213e-01]
windy_storm:  79%|#######8  | 2366/3000 [1:10:55<14:26,  1.37s/it, lr: 1.0e-04 loss: 1.213e-01]
windy_storm:  79%|#######8  | 2366/3000 [1:10:55<14:26,  1.37s/it, lr: 1.0e-04 loss: 1.213e-01]
windy_storm:  79%|#######8  | 2366/3000 [1:10:57<14:26,  1.37s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  79%|#######8  | 2366/3000 [1:10:57<14:26,  1.37s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  79%|#######8  | 2367/3000 [1:10:57<14:59,  1.42s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  79%|#######8  | 2367/3000 [1:10:57<14:59,  1.42s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  79%|#######8  | 2367/3000 [1:10:57<14:59,  1.42s/it, lr: 1.0e-04 loss: 2.942e-01]
windy_storm:  79%|#######8  | 2367/3000 [1:10:57<14:59,  1.42s/it, lr: 1.0e-04 loss: 2.942e-01]
windy_storm:  79%|#######8  | 2368/3000 [1:10:57<12:54,  1.23s/it, lr: 1.0e-04 loss: 2.942e-01]
windy_storm:  79%|#######8  | 2368/3000 [1:10:57<12:54,  1.23s/it, lr: 1.0e-04 loss: 2.942e-01]
windy_storm:  79%|#######8  | 2368/3000 [1:10:58<12:54,  1.23s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  79%|#######8  | 2368/3000 [1:10:58<12:54,  1.23s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  79%|#######8  | 2369/3000 [1:10:58<11:39,  1.11s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  79%|#######8  | 2369/3000 [1:10:58<11:39,  1.11s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm:  79%|#######8  | 2369/3000 [1:10:59<11:39,  1.11s/it, lr: 1.0e-04 loss: 5.195e-01]
windy_storm:  79%|#######8  | 2369/3000 [1:10:59<11:39,  1.11s/it, lr: 1.0e-04 loss: 5.195e-01]
windy_storm:  79%|#######9  | 2370/3000 [1:11:02<11:38,  1.11s/it, lr: 1.0e-04 loss: 3.929e-02]
windy_storm:  79%|#######9  | 2370/3000 [1:11:02<11:38,  1.11s/it, lr: 1.0e-04 loss: 3.929e-02]
windy_storm:  79%|#######9  | 2371/3000 [1:11:02<13:16,  1.27s/it, lr: 1.0e-04 loss: 3.929e-02]
windy_storm:  79%|#######9  | 2371/3000 [1:11:02<13:16,  1.27s/it, lr: 1.0e-04 loss: 3.929e-02]
windy_storm:  79%|#######9  | 2371/3000 [1:11:03<13:16,  1.27s/it, lr: 1.0e-04 loss: 5.014e-01]
windy_storm:  79%|#######9  | 2371/3000 [1:11:03<13:16,  1.27s/it, lr: 1.0e-04 loss: 5.014e-01]
windy_storm:  79%|#######9  | 2372/3000 [1:11:03<12:05,  1.15s/it, lr: 1.0e-04 loss: 5.014e-01]
windy_storm:  79%|#######9  | 2372/3000 [1:11:03<12:05,  1.15s/it, lr: 1.0e-04 loss: 5.014e-01]
windy_storm:  79%|#######9  | 2372/3000 [1:11:06<12:05,  1.15s/it, lr: 1.0e-04 loss: 6.032e-01]
windy_storm:  79%|#######9  | 2372/3000 [1:11:06<12:05,  1.15s/it, lr: 1.0e-04 loss: 6.032e-01]
windy_storm:  79%|#######9  | 2373/3000 [1:11:06<17:22,  1.66s/it, lr: 1.0e-04 loss: 6.032e-01]
windy_storm:  79%|#######9  | 2373/3000 [1:11:06<17:22,  1.66s/it, lr: 1.0e-04 loss: 6.032e-01]
windy_storm:  79%|#######9  | 2373/3000 [1:11:07<17:22,  1.66s/it, lr: 1.0e-04 loss: 1.450e-01]
windy_storm:  79%|#######9  | 2373/3000 [1:11:07<17:22,  1.66s/it, lr: 1.0e-04 loss: 1.450e-01]
windy_storm:  79%|#######9  | 2374/3000 [1:11:08<17:10,  1.65s/it, lr: 1.0e-04 loss: 1.450e-01]
windy_storm:  79%|#######9  | 2374/3000 [1:11:08<17:10,  1.65s/it, lr: 1.0e-04 loss: 1.450e-01]
windy_storm:  79%|#######9  | 2374/3000 [1:11:09<17:10,  1.65s/it, lr: 1.0e-04 loss: 2.705e-01]
windy_storm:  79%|#######9  | 2374/3000 [1:11:09<17:10,  1.65s/it, lr: 1.0e-04 loss: 2.705e-01]
windy_storm:  79%|#######9  | 2375/3000 [1:11:09<16:56,  1.63s/it, lr: 1.0e-04 loss: 2.705e-01]
windy_storm:  79%|#######9  | 2375/3000 [1:11:09<16:56,  1.63s/it, lr: 1.0e-04 loss: 2.705e-01]
windy_storm:  79%|#######9  | 2375/3000 [1:11:11<16:56,  1.63s/it, lr: 1.0e-04 loss: 4.649e-01]
windy_storm:  79%|#######9  | 2375/3000 [1:11:11<16:56,  1.63s/it, lr: 1.0e-04 loss: 4.649e-01]
windy_storm:  79%|#######9  | 2376/3000 [1:11:11<16:46,  1.61s/it, lr: 1.0e-04 loss: 4.649e-01]
windy_storm:  79%|#######9  | 2376/3000 [1:11:11<16:46,  1.61s/it, lr: 1.0e-04 loss: 4.649e-01]
windy_storm:  79%|#######9  | 2376/3000 [1:11:14<16:46,  1.61s/it, lr: 1.0e-04 loss: 1.905e-01]
windy_storm:  79%|#######9  | 2376/3000 [1:11:14<16:46,  1.61s/it, lr: 1.0e-04 loss: 1.905e-01]
windy_storm:  79%|#######9  | 2377/3000 [1:11:14<20:53,  2.01s/it, lr: 1.0e-04 loss: 1.905e-01]
windy_storm:  79%|#######9  | 2377/3000 [1:11:14<20:53,  2.01s/it, lr: 1.0e-04 loss: 1.905e-01]
windy_storm:  79%|#######9  | 2377/3000 [1:11:17<20:53,  2.01s/it, lr: 1.0e-04 loss: 6.384e-01]
windy_storm:  79%|#######9  | 2377/3000 [1:11:17<20:53,  2.01s/it, lr: 1.0e-04 loss: 6.384e-01]
windy_storm:  79%|#######9  | 2378/3000 [1:11:17<23:49,  2.30s/it, lr: 1.0e-04 loss: 6.384e-01]
windy_storm:  79%|#######9  | 2378/3000 [1:11:17<23:49,  2.30s/it, lr: 1.0e-04 loss: 6.384e-01]
windy_storm:  79%|#######9  | 2378/3000 [1:11:17<23:49,  2.30s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  79%|#######9  | 2378/3000 [1:11:17<23:49,  2.30s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  79%|#######9  | 2379/3000 [1:11:17<19:04,  1.84s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  79%|#######9  | 2379/3000 [1:11:17<19:04,  1.84s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  79%|#######9  | 2379/3000 [1:11:20<19:04,  1.84s/it, lr: 1.0e-04 loss: 3.360e-01]
windy_storm:  79%|#######9  | 2379/3000 [1:11:20<19:04,  1.84s/it, lr: 1.0e-04 loss: 3.360e-01]
windy_storm:  79%|#######9  | 2380/3000 [1:11:23<19:02,  1.84s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  79%|#######9  | 2380/3000 [1:11:23<19:02,  1.84s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  79%|#######9  | 2381/3000 [1:11:23<17:23,  1.69s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  79%|#######9  | 2381/3000 [1:11:23<17:23,  1.69s/it, lr: 1.0e-04 loss: 2.534e-01]
windy_storm:  79%|#######9  | 2381/3000 [1:11:26<17:23,  1.69s/it, lr: 1.0e-04 loss: 4.492e-01]
windy_storm:  79%|#######9  | 2381/3000 [1:11:26<17:23,  1.69s/it, lr: 1.0e-04 loss: 4.492e-01]
windy_storm:  79%|#######9  | 2382/3000 [1:11:26<20:27,  1.99s/it, lr: 1.0e-04 loss: 4.492e-01]
windy_storm:  79%|#######9  | 2382/3000 [1:11:26<20:27,  1.99s/it, lr: 1.0e-04 loss: 4.492e-01]
windy_storm:  79%|#######9  | 2382/3000 [1:11:27<20:27,  1.99s/it, lr: 1.0e-04 loss: 1.934e-02]
windy_storm:  79%|#######9  | 2382/3000 [1:11:27<20:27,  1.99s/it, lr: 1.0e-04 loss: 1.934e-02]
windy_storm:  79%|#######9  | 2383/3000 [1:11:27<17:04,  1.66s/it, lr: 1.0e-04 loss: 1.934e-02]
windy_storm:  79%|#######9  | 2383/3000 [1:11:27<17:04,  1.66s/it, lr: 1.0e-04 loss: 1.934e-02]
windy_storm:  79%|#######9  | 2383/3000 [1:11:29<17:04,  1.66s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  79%|#######9  | 2383/3000 [1:11:29<17:04,  1.66s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  79%|#######9  | 2384/3000 [1:11:29<16:47,  1.64s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  79%|#######9  | 2384/3000 [1:11:29<16:47,  1.64s/it, lr: 1.0e-04 loss: 4.561e-01]
windy_storm:  79%|#######9  | 2384/3000 [1:11:29<16:47,  1.64s/it, lr: 1.0e-04 loss: 5.458e-01]
windy_storm:  79%|#######9  | 2384/3000 [1:11:29<16:47,  1.64s/it, lr: 1.0e-04 loss: 5.458e-01]
windy_storm:  80%|#######9  | 2385/3000 [1:11:29<14:19,  1.40s/it, lr: 1.0e-04 loss: 5.458e-01]
windy_storm:  80%|#######9  | 2385/3000 [1:11:29<14:19,  1.40s/it, lr: 1.0e-04 loss: 5.458e-01]
windy_storm:  80%|#######9  | 2385/3000 [1:11:30<14:19,  1.40s/it, lr: 1.0e-04 loss: 2.126e-01]
windy_storm:  80%|#######9  | 2385/3000 [1:11:30<14:19,  1.40s/it, lr: 1.0e-04 loss: 2.126e-01]
windy_storm:  80%|#######9  | 2386/3000 [1:11:30<12:35,  1.23s/it, lr: 1.0e-04 loss: 2.126e-01]
windy_storm:  80%|#######9  | 2386/3000 [1:11:30<12:35,  1.23s/it, lr: 1.0e-04 loss: 2.126e-01]
windy_storm:  80%|#######9  | 2386/3000 [1:11:32<12:35,  1.23s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  80%|#######9  | 2386/3000 [1:11:32<12:35,  1.23s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  80%|#######9  | 2387/3000 [1:11:32<13:35,  1.33s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  80%|#######9  | 2387/3000 [1:11:32<13:35,  1.33s/it, lr: 1.0e-04 loss: 6.584e-01]
windy_storm:  80%|#######9  | 2387/3000 [1:11:33<13:35,  1.33s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  80%|#######9  | 2387/3000 [1:11:33<13:35,  1.33s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  80%|#######9  | 2388/3000 [1:11:33<12:46,  1.25s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  80%|#######9  | 2388/3000 [1:11:33<12:46,  1.25s/it, lr: 1.0e-04 loss: 6.324e-01]
windy_storm:  80%|#######9  | 2388/3000 [1:11:34<12:46,  1.25s/it, lr: 1.0e-04 loss: 4.246e-01]
windy_storm:  80%|#######9  | 2388/3000 [1:11:34<12:46,  1.25s/it, lr: 1.0e-04 loss: 4.246e-01]
windy_storm:  80%|#######9  | 2389/3000 [1:11:34<11:16,  1.11s/it, lr: 1.0e-04 loss: 4.246e-01]
windy_storm:  80%|#######9  | 2389/3000 [1:11:34<11:16,  1.11s/it, lr: 1.0e-04 loss: 4.246e-01]
windy_storm:  80%|#######9  | 2389/3000 [1:11:35<11:16,  1.11s/it, lr: 1.0e-04 loss: 2.172e-01]
windy_storm:  80%|#######9  | 2389/3000 [1:11:35<11:16,  1.11s/it, lr: 1.0e-04 loss: 2.172e-01]
windy_storm:  80%|#######9  | 2390/3000 [1:11:36<11:15,  1.11s/it, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  80%|#######9  | 2390/3000 [1:11:36<11:15,  1.11s/it, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  80%|#######9  | 2391/3000 [1:11:36<07:48,  1.30it/s, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  80%|#######9  | 2391/3000 [1:11:36<07:48,  1.30it/s, lr: 1.0e-04 loss: 2.580e-01]
windy_storm:  80%|#######9  | 2391/3000 [1:11:37<07:48,  1.30it/s, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  80%|#######9  | 2391/3000 [1:11:37<07:48,  1.30it/s, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  80%|#######9  | 2392/3000 [1:11:37<07:45,  1.31it/s, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  80%|#######9  | 2392/3000 [1:11:37<07:45,  1.31it/s, lr: 1.0e-04 loss: 6.499e-01]
windy_storm:  80%|#######9  | 2392/3000 [1:11:40<07:45,  1.31it/s, lr: 1.0e-04 loss: 4.598e-01]
windy_storm:  80%|#######9  | 2392/3000 [1:11:40<07:45,  1.31it/s, lr: 1.0e-04 loss: 4.598e-01]
windy_storm:  80%|#######9  | 2393/3000 [1:11:40<13:41,  1.35s/it, lr: 1.0e-04 loss: 4.598e-01]
windy_storm:  80%|#######9  | 2393/3000 [1:11:40<13:41,  1.35s/it, lr: 1.0e-04 loss: 4.598e-01]
windy_storm:  80%|#######9  | 2393/3000 [1:11:43<13:41,  1.35s/it, lr: 1.0e-04 loss: 7.119e-01]
windy_storm:  80%|#######9  | 2393/3000 [1:11:43<13:41,  1.35s/it, lr: 1.0e-04 loss: 7.119e-01]
windy_storm:  80%|#######9  | 2394/3000 [1:11:43<17:58,  1.78s/it, lr: 1.0e-04 loss: 7.119e-01]
windy_storm:  80%|#######9  | 2394/3000 [1:11:43<17:58,  1.78s/it, lr: 1.0e-04 loss: 7.119e-01]
windy_storm:  80%|#######9  | 2394/3000 [1:11:43<17:58,  1.78s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  80%|#######9  | 2394/3000 [1:11:43<17:58,  1.78s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  80%|#######9  | 2395/3000 [1:11:43<14:59,  1.49s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  80%|#######9  | 2395/3000 [1:11:43<14:59,  1.49s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  80%|#######9  | 2395/3000 [1:11:45<14:59,  1.49s/it, lr: 1.0e-04 loss: 1.060e-01]
windy_storm:  80%|#######9  | 2395/3000 [1:11:45<14:59,  1.49s/it, lr: 1.0e-04 loss: 1.060e-01]
windy_storm:  80%|#######9  | 2396/3000 [1:11:45<15:09,  1.51s/it, lr: 1.0e-04 loss: 1.060e-01]
windy_storm:  80%|#######9  | 2396/3000 [1:11:45<15:09,  1.51s/it, lr: 1.0e-04 loss: 1.060e-01]
windy_storm:  80%|#######9  | 2396/3000 [1:11:48<15:09,  1.51s/it, lr: 1.0e-04 loss: 7.239e-01]
windy_storm:  80%|#######9  | 2396/3000 [1:11:48<15:09,  1.51s/it, lr: 1.0e-04 loss: 7.239e-01]
windy_storm:  80%|#######9  | 2397/3000 [1:11:48<19:24,  1.93s/it, lr: 1.0e-04 loss: 7.239e-01]
windy_storm:  80%|#######9  | 2397/3000 [1:11:48<19:24,  1.93s/it, lr: 1.0e-04 loss: 7.239e-01]
windy_storm:  80%|#######9  | 2397/3000 [1:11:51<19:24,  1.93s/it, lr: 1.0e-04 loss: 4.427e-02]
windy_storm:  80%|#######9  | 2397/3000 [1:11:51<19:24,  1.93s/it, lr: 1.0e-04 loss: 4.427e-02]
windy_storm:  80%|#######9  | 2398/3000 [1:11:51<22:17,  2.22s/it, lr: 1.0e-04 loss: 4.427e-02]
windy_storm:  80%|#######9  | 2398/3000 [1:11:51<22:17,  2.22s/it, lr: 1.0e-04 loss: 4.427e-02]
windy_storm:  80%|#######9  | 2398/3000 [1:11:54<22:17,  2.22s/it, lr: 1.0e-04 loss: 1.454e-01]
windy_storm:  80%|#######9  | 2398/3000 [1:11:54<22:17,  2.22s/it, lr: 1.0e-04 loss: 1.454e-01]
windy_storm:  80%|#######9  | 2399/3000 [1:11:54<24:31,  2.45s/it, lr: 1.0e-04 loss: 1.454e-01]
windy_storm:  80%|#######9  | 2399/3000 [1:11:54<24:31,  2.45s/it, lr: 1.0e-04 loss: 1.454e-01]
windy_storm:  80%|#######9  | 2399/3000 [1:11:55<24:31,  2.45s/it, lr: 1.0e-04 loss: 6.156e-01]
windy_storm:  80%|#######9  | 2399/3000 [1:11:55<24:31,  2.45s/it, lr: 1.0e-04 loss: 6.156e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.42s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.42s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.39s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.39s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.39s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.39s/it]


Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.38s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.38s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.37s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.37s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  80%|########  | 2400/3000 [1:11:58<24:29,  2.45s/it, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  80%|########  | 2400/3000 [1:11:58<24:29,  2.45s/it, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  80%|########  | 2401/3000 [1:11:58<20:08,  2.02s/it, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  80%|########  | 2401/3000 [1:11:58<20:08,  2.02s/it, lr: 1.0e-04 loss: 6.390e-01]
windy_storm:  80%|########  | 2401/3000 [1:11:59<20:08,  2.02s/it, lr: 1.0e-04 loss: 1.830e-01]
windy_storm:  80%|########  | 2401/3000 [1:11:59<20:08,  2.02s/it, lr: 1.0e-04 loss: 1.830e-01]
windy_storm:  80%|########  | 2402/3000 [1:11:59<17:09,  1.72s/it, lr: 1.0e-04 loss: 1.830e-01]
windy_storm:  80%|########  | 2402/3000 [1:11:59<17:09,  1.72s/it, lr: 1.0e-04 loss: 1.830e-01]
windy_storm:  80%|########  | 2402/3000 [1:12:00<17:09,  1.72s/it, lr: 1.0e-04 loss: 3.156e-01]
windy_storm:  80%|########  | 2402/3000 [1:12:00<17:09,  1.72s/it, lr: 1.0e-04 loss: 3.156e-01]
windy_storm:  80%|########  | 2403/3000 [1:12:00<14:39,  1.47s/it, lr: 1.0e-04 loss: 3.156e-01]
windy_storm:  80%|########  | 2403/3000 [1:12:00<14:39,  1.47s/it, lr: 1.0e-04 loss: 3.156e-01]
windy_storm:  80%|########  | 2403/3000 [1:12:00<14:39,  1.47s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  80%|########  | 2403/3000 [1:12:00<14:39,  1.47s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  80%|########  | 2404/3000 [1:12:00<12:51,  1.30s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  80%|########  | 2404/3000 [1:12:00<12:51,  1.30s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  80%|########  | 2404/3000 [1:12:03<12:51,  1.30s/it, lr: 1.0e-04 loss: 3.951e-01]
windy_storm:  80%|########  | 2404/3000 [1:12:03<12:51,  1.30s/it, lr: 1.0e-04 loss: 3.951e-01]
windy_storm:  80%|########  | 2405/3000 [1:12:03<17:24,  1.75s/it, lr: 1.0e-04 loss: 3.951e-01]
windy_storm:  80%|########  | 2405/3000 [1:12:03<17:24,  1.75s/it, lr: 1.0e-04 loss: 3.951e-01]
windy_storm:  80%|########  | 2405/3000 [1:12:05<17:24,  1.75s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  80%|########  | 2405/3000 [1:12:05<17:24,  1.75s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  80%|########  | 2406/3000 [1:12:05<16:52,  1.70s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  80%|########  | 2406/3000 [1:12:05<16:52,  1.70s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  80%|########  | 2406/3000 [1:12:06<16:52,  1.70s/it, lr: 1.0e-04 loss: 5.840e-01]
windy_storm:  80%|########  | 2406/3000 [1:12:06<16:52,  1.70s/it, lr: 1.0e-04 loss: 5.840e-01]
windy_storm:  80%|########  | 2407/3000 [1:12:06<16:24,  1.66s/it, lr: 1.0e-04 loss: 5.840e-01]
windy_storm:  80%|########  | 2407/3000 [1:12:06<16:24,  1.66s/it, lr: 1.0e-04 loss: 5.840e-01]
windy_storm:  80%|########  | 2407/3000 [1:12:07<16:24,  1.66s/it, lr: 1.0e-04 loss: 6.317e-01]
windy_storm:  80%|########  | 2407/3000 [1:12:07<16:24,  1.66s/it, lr: 1.0e-04 loss: 6.317e-01]
windy_storm:  80%|########  | 2408/3000 [1:12:07<13:45,  1.39s/it, lr: 1.0e-04 loss: 6.317e-01]
windy_storm:  80%|########  | 2408/3000 [1:12:07<13:45,  1.39s/it, lr: 1.0e-04 loss: 6.317e-01]
windy_storm:  80%|########  | 2408/3000 [1:12:10<13:45,  1.39s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  80%|########  | 2408/3000 [1:12:10<13:45,  1.39s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  80%|########  | 2409/3000 [1:12:10<18:23,  1.87s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  80%|########  | 2409/3000 [1:12:10<18:23,  1.87s/it, lr: 1.0e-04 loss: 1.360e-01]
windy_storm:  80%|########  | 2409/3000 [1:12:11<18:23,  1.87s/it, lr: 1.0e-04 loss: 1.534e-01]
windy_storm:  80%|########  | 2409/3000 [1:12:11<18:23,  1.87s/it, lr: 1.0e-04 loss: 1.534e-01]
windy_storm:  80%|########  | 2410/3000 [1:12:13<18:21,  1.87s/it, lr: 1.0e-04 loss: 4.415e-01]
windy_storm:  80%|########  | 2410/3000 [1:12:13<18:21,  1.87s/it, lr: 1.0e-04 loss: 4.415e-01]
windy_storm:  80%|########  | 2411/3000 [1:12:13<13:30,  1.38s/it, lr: 1.0e-04 loss: 4.415e-01]
windy_storm:  80%|########  | 2411/3000 [1:12:13<13:30,  1.38s/it, lr: 1.0e-04 loss: 4.415e-01]
windy_storm:  80%|########  | 2411/3000 [1:12:16<13:30,  1.38s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  80%|########  | 2411/3000 [1:12:16<13:30,  1.38s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  80%|########  | 2412/3000 [1:12:16<17:24,  1.78s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  80%|########  | 2412/3000 [1:12:16<17:24,  1.78s/it, lr: 1.0e-04 loss: 2.684e-01]
windy_storm:  80%|########  | 2412/3000 [1:12:19<17:24,  1.78s/it, lr: 1.0e-04 loss: 5.866e-01]
windy_storm:  80%|########  | 2412/3000 [1:12:19<17:24,  1.78s/it, lr: 1.0e-04 loss: 5.866e-01]
windy_storm:  80%|########  | 2413/3000 [1:12:19<20:36,  2.11s/it, lr: 1.0e-04 loss: 5.866e-01]
windy_storm:  80%|########  | 2413/3000 [1:12:19<20:36,  2.11s/it, lr: 1.0e-04 loss: 5.866e-01]
windy_storm:  80%|########  | 2413/3000 [1:12:22<20:36,  2.11s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  80%|########  | 2413/3000 [1:12:22<20:36,  2.11s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  80%|########  | 2414/3000 [1:12:22<23:00,  2.36s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  80%|########  | 2414/3000 [1:12:22<23:00,  2.36s/it, lr: 1.0e-04 loss: 2.012e-01]
windy_storm:  80%|########  | 2414/3000 [1:12:23<23:00,  2.36s/it, lr: 1.0e-04 loss: 3.957e-01]
windy_storm:  80%|########  | 2414/3000 [1:12:23<23:00,  2.36s/it, lr: 1.0e-04 loss: 3.957e-01]
windy_storm:  80%|########  | 2415/3000 [1:12:23<20:51,  2.14s/it, lr: 1.0e-04 loss: 3.957e-01]
windy_storm:  80%|########  | 2415/3000 [1:12:23<20:51,  2.14s/it, lr: 1.0e-04 loss: 3.957e-01]
windy_storm:  80%|########  | 2415/3000 [1:12:26<20:51,  2.14s/it, lr: 1.0e-04 loss: 6.078e-01]
windy_storm:  80%|########  | 2415/3000 [1:12:26<20:51,  2.14s/it, lr: 1.0e-04 loss: 6.078e-01]
windy_storm:  81%|########  | 2416/3000 [1:12:26<23:14,  2.39s/it, lr: 1.0e-04 loss: 6.078e-01]
windy_storm:  81%|########  | 2416/3000 [1:12:26<23:14,  2.39s/it, lr: 1.0e-04 loss: 6.078e-01]
windy_storm:  81%|########  | 2416/3000 [1:12:27<23:14,  2.39s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:  81%|########  | 2416/3000 [1:12:27<23:14,  2.39s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:  81%|########  | 2417/3000 [1:12:27<18:41,  1.92s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:  81%|########  | 2417/3000 [1:12:27<18:41,  1.92s/it, lr: 1.0e-04 loss: 4.263e-01]
windy_storm:  81%|########  | 2417/3000 [1:12:28<18:41,  1.92s/it, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  81%|########  | 2417/3000 [1:12:28<18:41,  1.92s/it, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  81%|########  | 2418/3000 [1:12:28<15:32,  1.60s/it, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  81%|########  | 2418/3000 [1:12:28<15:32,  1.60s/it, lr: 1.0e-04 loss: 6.192e-01]
windy_storm:  81%|########  | 2418/3000 [1:12:29<15:32,  1.60s/it, lr: 1.0e-04 loss: 7.121e-02]
windy_storm:  81%|########  | 2418/3000 [1:12:29<15:32,  1.60s/it, lr: 1.0e-04 loss: 7.121e-02]
windy_storm:  81%|########  | 2419/3000 [1:12:29<13:07,  1.36s/it, lr: 1.0e-04 loss: 7.121e-02]
windy_storm:  81%|########  | 2419/3000 [1:12:29<13:07,  1.36s/it, lr: 1.0e-04 loss: 7.121e-02]
windy_storm:  81%|########  | 2419/3000 [1:12:30<13:07,  1.36s/it, lr: 1.0e-04 loss: 4.359e-01]
windy_storm:  81%|########  | 2419/3000 [1:12:30<13:07,  1.36s/it, lr: 1.0e-04 loss: 4.359e-01]
windy_storm:  81%|########  | 2420/3000 [1:12:31<13:06,  1.36s/it, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  81%|########  | 2420/3000 [1:12:31<13:06,  1.36s/it, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  81%|########  | 2421/3000 [1:12:31<08:55,  1.08it/s, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  81%|########  | 2421/3000 [1:12:31<08:55,  1.08it/s, lr: 1.0e-04 loss: 5.821e-01]
windy_storm:  81%|########  | 2421/3000 [1:12:34<08:55,  1.08it/s, lr: 1.0e-04 loss: 3.718e-01]
windy_storm:  81%|########  | 2421/3000 [1:12:34<08:55,  1.08it/s, lr: 1.0e-04 loss: 3.718e-01]
windy_storm:  81%|########  | 2422/3000 [1:12:34<13:50,  1.44s/it, lr: 1.0e-04 loss: 3.718e-01]
windy_storm:  81%|########  | 2422/3000 [1:12:34<13:50,  1.44s/it, lr: 1.0e-04 loss: 3.718e-01]
windy_storm:  81%|########  | 2422/3000 [1:12:35<13:50,  1.44s/it, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  81%|########  | 2422/3000 [1:12:35<13:50,  1.44s/it, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  81%|########  | 2423/3000 [1:12:35<12:09,  1.26s/it, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  81%|########  | 2423/3000 [1:12:35<12:09,  1.26s/it, lr: 1.0e-04 loss: 2.320e-01]
windy_storm:  81%|########  | 2423/3000 [1:12:36<12:09,  1.26s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  81%|########  | 2423/3000 [1:12:36<12:09,  1.26s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  81%|########  | 2424/3000 [1:12:36<11:02,  1.15s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  81%|########  | 2424/3000 [1:12:36<11:02,  1.15s/it, lr: 1.0e-04 loss: 6.707e-01]
windy_storm:  81%|########  | 2424/3000 [1:12:37<11:02,  1.15s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:  81%|########  | 2424/3000 [1:12:37<11:02,  1.15s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:  81%|########  | 2425/3000 [1:12:37<12:11,  1.27s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:  81%|########  | 2425/3000 [1:12:37<12:11,  1.27s/it, lr: 1.0e-04 loss: 4.051e-01]
windy_storm:  81%|########  | 2425/3000 [1:12:38<12:11,  1.27s/it, lr: 1.0e-04 loss: 6.226e-01]
windy_storm:  81%|########  | 2425/3000 [1:12:38<12:11,  1.27s/it, lr: 1.0e-04 loss: 6.226e-01]
windy_storm:  81%|########  | 2426/3000 [1:12:38<10:50,  1.13s/it, lr: 1.0e-04 loss: 6.226e-01]
windy_storm:  81%|########  | 2426/3000 [1:12:38<10:50,  1.13s/it, lr: 1.0e-04 loss: 6.226e-01]
windy_storm:  81%|########  | 2426/3000 [1:12:40<10:50,  1.13s/it, lr: 1.0e-04 loss: 5.105e-01]
windy_storm:  81%|########  | 2426/3000 [1:12:40<10:50,  1.13s/it, lr: 1.0e-04 loss: 5.105e-01]
windy_storm:  81%|########  | 2427/3000 [1:12:40<12:00,  1.26s/it, lr: 1.0e-04 loss: 5.105e-01]
windy_storm:  81%|########  | 2427/3000 [1:12:40<12:00,  1.26s/it, lr: 1.0e-04 loss: 5.105e-01]
windy_storm:  81%|########  | 2427/3000 [1:12:43<12:00,  1.26s/it, lr: 1.0e-04 loss: 4.867e-01]
windy_storm:  81%|########  | 2427/3000 [1:12:43<12:00,  1.26s/it, lr: 1.0e-04 loss: 4.867e-01]
windy_storm:  81%|########  | 2428/3000 [1:12:43<17:11,  1.80s/it, lr: 1.0e-04 loss: 4.867e-01]
windy_storm:  81%|########  | 2428/3000 [1:12:43<17:11,  1.80s/it, lr: 1.0e-04 loss: 4.867e-01]
windy_storm:  81%|########  | 2428/3000 [1:12:46<17:11,  1.80s/it, lr: 1.0e-04 loss: 5.924e-01]
windy_storm:  81%|########  | 2428/3000 [1:12:46<17:11,  1.80s/it, lr: 1.0e-04 loss: 5.924e-01]
windy_storm:  81%|########  | 2429/3000 [1:12:46<20:35,  2.16s/it, lr: 1.0e-04 loss: 5.924e-01]
windy_storm:  81%|########  | 2429/3000 [1:12:46<20:35,  2.16s/it, lr: 1.0e-04 loss: 5.924e-01]
windy_storm:  81%|########  | 2429/3000 [1:12:49<20:35,  2.16s/it, lr: 1.0e-04 loss: 3.496e-01]
windy_storm:  81%|########  | 2429/3000 [1:12:49<20:35,  2.16s/it, lr: 1.0e-04 loss: 3.496e-01]
windy_storm:  81%|########1 | 2430/3000 [1:12:50<20:33,  2.16s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  81%|########1 | 2430/3000 [1:12:50<20:33,  2.16s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  81%|########1 | 2431/3000 [1:12:50<14:39,  1.54s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  81%|########1 | 2431/3000 [1:12:50<14:39,  1.54s/it, lr: 1.0e-04 loss: 4.418e-01]
windy_storm:  81%|########1 | 2431/3000 [1:12:52<14:39,  1.54s/it, lr: 1.0e-04 loss: 1.280e-01]
windy_storm:  81%|########1 | 2431/3000 [1:12:52<14:39,  1.54s/it, lr: 1.0e-04 loss: 1.280e-01]
windy_storm:  81%|########1 | 2432/3000 [1:12:52<14:46,  1.56s/it, lr: 1.0e-04 loss: 1.280e-01]
windy_storm:  81%|########1 | 2432/3000 [1:12:52<14:46,  1.56s/it, lr: 1.0e-04 loss: 1.280e-01]
windy_storm:  81%|########1 | 2432/3000 [1:12:53<14:46,  1.56s/it, lr: 1.0e-04 loss: 2.427e-01]
windy_storm:  81%|########1 | 2432/3000 [1:12:53<14:46,  1.56s/it, lr: 1.0e-04 loss: 2.427e-01]
windy_storm:  81%|########1 | 2433/3000 [1:12:53<12:43,  1.35s/it, lr: 1.0e-04 loss: 2.427e-01]
windy_storm:  81%|########1 | 2433/3000 [1:12:53<12:43,  1.35s/it, lr: 1.0e-04 loss: 2.427e-01]
windy_storm:  81%|########1 | 2433/3000 [1:12:56<12:43,  1.35s/it, lr: 1.0e-04 loss: 3.792e-01]
windy_storm:  81%|########1 | 2433/3000 [1:12:56<12:43,  1.35s/it, lr: 1.0e-04 loss: 3.792e-01]
windy_storm:  81%|########1 | 2434/3000 [1:12:56<16:50,  1.79s/it, lr: 1.0e-04 loss: 3.792e-01]
windy_storm:  81%|########1 | 2434/3000 [1:12:56<16:50,  1.79s/it, lr: 1.0e-04 loss: 3.792e-01]
windy_storm:  81%|########1 | 2434/3000 [1:12:59<16:50,  1.79s/it, lr: 1.0e-04 loss: 1.080e-01]
windy_storm:  81%|########1 | 2434/3000 [1:12:59<16:50,  1.79s/it, lr: 1.0e-04 loss: 1.080e-01]
windy_storm:  81%|########1 | 2435/3000 [1:12:59<20:06,  2.13s/it, lr: 1.0e-04 loss: 1.080e-01]
windy_storm:  81%|########1 | 2435/3000 [1:12:59<20:06,  2.13s/it, lr: 1.0e-04 loss: 1.080e-01]
windy_storm:  81%|########1 | 2435/3000 [1:13:00<20:06,  2.13s/it, lr: 1.0e-04 loss: 1.760e-01]
windy_storm:  81%|########1 | 2435/3000 [1:13:00<20:06,  2.13s/it, lr: 1.0e-04 loss: 1.760e-01]
windy_storm:  81%|########1 | 2436/3000 [1:13:00<18:36,  1.98s/it, lr: 1.0e-04 loss: 1.760e-01]
windy_storm:  81%|########1 | 2436/3000 [1:13:00<18:36,  1.98s/it, lr: 1.0e-04 loss: 1.760e-01]
windy_storm:  81%|########1 | 2436/3000 [1:13:03<18:36,  1.98s/it, lr: 1.0e-04 loss: 3.518e-01]
windy_storm:  81%|########1 | 2436/3000 [1:13:03<18:36,  1.98s/it, lr: 1.0e-04 loss: 3.518e-01]
windy_storm:  81%|########1 | 2437/3000 [1:13:03<21:12,  2.26s/it, lr: 1.0e-04 loss: 3.518e-01]
windy_storm:  81%|########1 | 2437/3000 [1:13:03<21:12,  2.26s/it, lr: 1.0e-04 loss: 3.518e-01]
windy_storm:  81%|########1 | 2437/3000 [1:13:05<21:12,  2.26s/it, lr: 1.0e-04 loss: 6.318e-01]
windy_storm:  81%|########1 | 2437/3000 [1:13:05<21:12,  2.26s/it, lr: 1.0e-04 loss: 6.318e-01]
windy_storm:  81%|########1 | 2438/3000 [1:13:05<19:19,  2.06s/it, lr: 1.0e-04 loss: 6.318e-01]
windy_storm:  81%|########1 | 2438/3000 [1:13:05<19:19,  2.06s/it, lr: 1.0e-04 loss: 6.318e-01]
windy_storm:  81%|########1 | 2438/3000 [1:13:08<19:19,  2.06s/it, lr: 1.0e-04 loss: 6.332e-01]
windy_storm:  81%|########1 | 2438/3000 [1:13:08<19:19,  2.06s/it, lr: 1.0e-04 loss: 6.332e-01]
windy_storm:  81%|########1 | 2439/3000 [1:13:08<21:55,  2.34s/it, lr: 1.0e-04 loss: 6.332e-01]
windy_storm:  81%|########1 | 2439/3000 [1:13:08<21:55,  2.34s/it, lr: 1.0e-04 loss: 6.332e-01]
windy_storm:  81%|########1 | 2439/3000 [1:13:09<21:55,  2.34s/it, lr: 1.0e-04 loss: 1.005e-01]
windy_storm:  81%|########1 | 2439/3000 [1:13:09<21:55,  2.34s/it, lr: 1.0e-04 loss: 1.005e-01]
windy_storm:  81%|########1 | 2440/3000 [1:13:10<21:53,  2.34s/it, lr: 1.0e-04 loss: 9.928e-02]
windy_storm:  81%|########1 | 2440/3000 [1:13:10<21:53,  2.34s/it, lr: 1.0e-04 loss: 9.928e-02]
windy_storm:  81%|########1 | 2441/3000 [1:13:10<13:36,  1.46s/it, lr: 1.0e-04 loss: 9.928e-02]
windy_storm:  81%|########1 | 2441/3000 [1:13:10<13:36,  1.46s/it, lr: 1.0e-04 loss: 9.928e-02]
windy_storm:  81%|########1 | 2441/3000 [1:13:13<13:36,  1.46s/it, lr: 1.0e-04 loss: 5.449e-01]
windy_storm:  81%|########1 | 2441/3000 [1:13:13<13:36,  1.46s/it, lr: 1.0e-04 loss: 5.449e-01]
windy_storm:  81%|########1 | 2442/3000 [1:13:13<17:17,  1.86s/it, lr: 1.0e-04 loss: 5.449e-01]
windy_storm:  81%|########1 | 2442/3000 [1:13:13<17:17,  1.86s/it, lr: 1.0e-04 loss: 5.449e-01]
windy_storm:  81%|########1 | 2442/3000 [1:13:14<17:17,  1.86s/it, lr: 1.0e-04 loss: 5.525e-01]
windy_storm:  81%|########1 | 2442/3000 [1:13:14<17:17,  1.86s/it, lr: 1.0e-04 loss: 5.525e-01]
windy_storm:  81%|########1 | 2443/3000 [1:13:14<14:35,  1.57s/it, lr: 1.0e-04 loss: 5.525e-01]
windy_storm:  81%|########1 | 2443/3000 [1:13:14<14:35,  1.57s/it, lr: 1.0e-04 loss: 5.525e-01]
windy_storm:  81%|########1 | 2443/3000 [1:13:17<14:35,  1.57s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  81%|########1 | 2443/3000 [1:13:17<14:35,  1.57s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  81%|########1 | 2444/3000 [1:13:17<18:09,  1.96s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  81%|########1 | 2444/3000 [1:13:17<18:09,  1.96s/it, lr: 1.0e-04 loss: 3.497e-01]
windy_storm:  81%|########1 | 2444/3000 [1:13:20<18:09,  1.96s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  81%|########1 | 2444/3000 [1:13:20<18:09,  1.96s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  82%|########1 | 2445/3000 [1:13:20<20:34,  2.22s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  82%|########1 | 2445/3000 [1:13:20<20:34,  2.22s/it, lr: 1.0e-04 loss: 5.724e-01]
windy_storm:  82%|########1 | 2445/3000 [1:13:21<20:34,  2.22s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  82%|########1 | 2445/3000 [1:13:21<20:34,  2.22s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  82%|########1 | 2446/3000 [1:13:21<16:41,  1.81s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  82%|########1 | 2446/3000 [1:13:21<16:41,  1.81s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  82%|########1 | 2446/3000 [1:13:22<16:41,  1.81s/it, lr: 1.0e-04 loss: 2.281e-01]
windy_storm:  82%|########1 | 2446/3000 [1:13:22<16:41,  1.81s/it, lr: 1.0e-04 loss: 2.281e-01]
windy_storm:  82%|########1 | 2447/3000 [1:13:22<16:00,  1.74s/it, lr: 1.0e-04 loss: 2.281e-01]
windy_storm:  82%|########1 | 2447/3000 [1:13:22<16:00,  1.74s/it, lr: 1.0e-04 loss: 2.281e-01]
windy_storm:  82%|########1 | 2447/3000 [1:13:23<16:00,  1.74s/it, lr: 1.0e-04 loss: 5.512e-02]
windy_storm:  82%|########1 | 2447/3000 [1:13:23<16:00,  1.74s/it, lr: 1.0e-04 loss: 5.512e-02]
windy_storm:  82%|########1 | 2448/3000 [1:13:23<13:21,  1.45s/it, lr: 1.0e-04 loss: 5.512e-02]
windy_storm:  82%|########1 | 2448/3000 [1:13:23<13:21,  1.45s/it, lr: 1.0e-04 loss: 5.512e-02]
windy_storm:  82%|########1 | 2448/3000 [1:13:24<13:21,  1.45s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  82%|########1 | 2448/3000 [1:13:24<13:21,  1.45s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  82%|########1 | 2449/3000 [1:13:24<11:23,  1.24s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  82%|########1 | 2449/3000 [1:13:24<11:23,  1.24s/it, lr: 1.0e-04 loss: 6.616e-01]
windy_storm:  82%|########1 | 2449/3000 [1:13:25<11:23,  1.24s/it, lr: 1.0e-04 loss: 3.332e-01]
windy_storm:  82%|########1 | 2449/3000 [1:13:25<11:23,  1.24s/it, lr: 1.0e-04 loss: 3.332e-01]
windy_storm:  82%|########1 | 2450/3000 [1:13:28<11:22,  1.24s/it, lr: 1.0e-04 loss: 2.168e-01]
windy_storm:  82%|########1 | 2450/3000 [1:13:28<11:22,  1.24s/it, lr: 1.0e-04 loss: 2.168e-01]
windy_storm:  82%|########1 | 2451/3000 [1:13:28<12:16,  1.34s/it, lr: 1.0e-04 loss: 2.168e-01]
windy_storm:  82%|########1 | 2451/3000 [1:13:28<12:16,  1.34s/it, lr: 1.0e-04 loss: 2.168e-01]
windy_storm:  82%|########1 | 2451/3000 [1:13:29<12:16,  1.34s/it, lr: 1.0e-04 loss: 8.686e-02]
windy_storm:  82%|########1 | 2451/3000 [1:13:29<12:16,  1.34s/it, lr: 1.0e-04 loss: 8.686e-02]
windy_storm:  82%|########1 | 2452/3000 [1:13:29<10:55,  1.20s/it, lr: 1.0e-04 loss: 8.686e-02]
windy_storm:  82%|########1 | 2452/3000 [1:13:29<10:55,  1.20s/it, lr: 1.0e-04 loss: 8.686e-02]
windy_storm:  82%|########1 | 2452/3000 [1:13:31<10:55,  1.20s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  82%|########1 | 2452/3000 [1:13:31<10:55,  1.20s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  82%|########1 | 2453/3000 [1:13:31<11:40,  1.28s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  82%|########1 | 2453/3000 [1:13:31<11:40,  1.28s/it, lr: 1.0e-04 loss: 2.093e-01]
windy_storm:  82%|########1 | 2453/3000 [1:13:31<11:40,  1.28s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  82%|########1 | 2453/3000 [1:13:31<11:40,  1.28s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  82%|########1 | 2454/3000 [1:13:31<10:21,  1.14s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  82%|########1 | 2454/3000 [1:13:31<10:21,  1.14s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  82%|########1 | 2454/3000 [1:13:35<10:21,  1.14s/it, lr: 1.0e-04 loss: 6.721e-01]
windy_storm:  82%|########1 | 2454/3000 [1:13:35<10:21,  1.14s/it, lr: 1.0e-04 loss: 6.721e-01]
windy_storm:  82%|########1 | 2455/3000 [1:13:35<15:26,  1.70s/it, lr: 1.0e-04 loss: 6.721e-01]
windy_storm:  82%|########1 | 2455/3000 [1:13:35<15:26,  1.70s/it, lr: 1.0e-04 loss: 6.721e-01]
windy_storm:  82%|########1 | 2455/3000 [1:13:36<15:26,  1.70s/it, lr: 1.0e-04 loss: 2.101e-01]
windy_storm:  82%|########1 | 2455/3000 [1:13:36<15:26,  1.70s/it, lr: 1.0e-04 loss: 2.101e-01]
windy_storm:  82%|########1 | 2456/3000 [1:13:36<15:04,  1.66s/it, lr: 1.0e-04 loss: 2.101e-01]
windy_storm:  82%|########1 | 2456/3000 [1:13:36<15:04,  1.66s/it, lr: 1.0e-04 loss: 2.101e-01]
windy_storm:  82%|########1 | 2456/3000 [1:13:38<15:04,  1.66s/it, lr: 1.0e-04 loss: 4.641e-01]
windy_storm:  82%|########1 | 2456/3000 [1:13:38<15:04,  1.66s/it, lr: 1.0e-04 loss: 4.641e-01]
windy_storm:  82%|########1 | 2457/3000 [1:13:38<14:50,  1.64s/it, lr: 1.0e-04 loss: 4.641e-01]
windy_storm:  82%|########1 | 2457/3000 [1:13:38<14:50,  1.64s/it, lr: 1.0e-04 loss: 4.641e-01]
windy_storm:  82%|########1 | 2457/3000 [1:13:39<14:50,  1.64s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  82%|########1 | 2457/3000 [1:13:39<14:50,  1.64s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  82%|########1 | 2458/3000 [1:13:39<12:38,  1.40s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  82%|########1 | 2458/3000 [1:13:39<12:38,  1.40s/it, lr: 1.0e-04 loss: 3.537e-01]
windy_storm:  82%|########1 | 2458/3000 [1:13:42<12:38,  1.40s/it, lr: 1.0e-04 loss: 4.732e-02]
windy_storm:  82%|########1 | 2458/3000 [1:13:42<12:38,  1.40s/it, lr: 1.0e-04 loss: 4.732e-02]
windy_storm:  82%|########1 | 2459/3000 [1:13:42<16:51,  1.87s/it, lr: 1.0e-04 loss: 4.732e-02]
windy_storm:  82%|########1 | 2459/3000 [1:13:42<16:51,  1.87s/it, lr: 1.0e-04 loss: 4.732e-02]
windy_storm:  82%|########1 | 2459/3000 [1:13:45<16:51,  1.87s/it, lr: 1.0e-04 loss: 4.360e-01]
windy_storm:  82%|########1 | 2459/3000 [1:13:45<16:51,  1.87s/it, lr: 1.0e-04 loss: 4.360e-01]
windy_storm:  82%|########2 | 2460/3000 [1:13:47<16:49,  1.87s/it, lr: 1.0e-04 loss: 5.533e-01]
windy_storm:  82%|########2 | 2460/3000 [1:13:47<16:49,  1.87s/it, lr: 1.0e-04 loss: 5.533e-01]
windy_storm:  82%|########2 | 2461/3000 [1:13:48<15:15,  1.70s/it, lr: 1.0e-04 loss: 5.533e-01]
windy_storm:  82%|########2 | 2461/3000 [1:13:48<15:15,  1.70s/it, lr: 1.0e-04 loss: 5.533e-01]
windy_storm:  82%|########2 | 2461/3000 [1:13:49<15:15,  1.70s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  82%|########2 | 2461/3000 [1:13:49<15:15,  1.70s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  82%|########2 | 2462/3000 [1:13:49<14:55,  1.66s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  82%|########2 | 2462/3000 [1:13:49<14:55,  1.66s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  82%|########2 | 2462/3000 [1:13:51<14:55,  1.66s/it, lr: 1.0e-04 loss: 6.556e-01]
windy_storm:  82%|########2 | 2462/3000 [1:13:51<14:55,  1.66s/it, lr: 1.0e-04 loss: 6.556e-01]
windy_storm:  82%|########2 | 2463/3000 [1:13:51<14:42,  1.64s/it, lr: 1.0e-04 loss: 6.556e-01]
windy_storm:  82%|########2 | 2463/3000 [1:13:51<14:42,  1.64s/it, lr: 1.0e-04 loss: 6.556e-01]
windy_storm:  82%|########2 | 2463/3000 [1:13:52<14:42,  1.64s/it, lr: 1.0e-04 loss: 6.464e-01]
windy_storm:  82%|########2 | 2463/3000 [1:13:52<14:42,  1.64s/it, lr: 1.0e-04 loss: 6.464e-01]
windy_storm:  82%|########2 | 2464/3000 [1:13:52<14:27,  1.62s/it, lr: 1.0e-04 loss: 6.464e-01]
windy_storm:  82%|########2 | 2464/3000 [1:13:52<14:27,  1.62s/it, lr: 1.0e-04 loss: 6.464e-01]
windy_storm:  82%|########2 | 2464/3000 [1:13:54<14:27,  1.62s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  82%|########2 | 2464/3000 [1:13:54<14:27,  1.62s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  82%|########2 | 2465/3000 [1:13:54<14:18,  1.60s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  82%|########2 | 2465/3000 [1:13:54<14:18,  1.60s/it, lr: 1.0e-04 loss: 1.391e-01]
windy_storm:  82%|########2 | 2465/3000 [1:13:55<14:18,  1.60s/it, lr: 1.0e-04 loss: 1.145e-01]
windy_storm:  82%|########2 | 2465/3000 [1:13:55<14:18,  1.60s/it, lr: 1.0e-04 loss: 1.145e-01]
windy_storm:  82%|########2 | 2466/3000 [1:13:55<14:08,  1.59s/it, lr: 1.0e-04 loss: 1.145e-01]
windy_storm:  82%|########2 | 2466/3000 [1:13:55<14:08,  1.59s/it, lr: 1.0e-04 loss: 1.145e-01]
windy_storm:  82%|########2 | 2466/3000 [1:13:58<14:08,  1.59s/it, lr: 1.0e-04 loss: 6.153e-01]
windy_storm:  82%|########2 | 2466/3000 [1:13:58<14:08,  1.59s/it, lr: 1.0e-04 loss: 6.153e-01]
windy_storm:  82%|########2 | 2467/3000 [1:13:58<17:43,  1.99s/it, lr: 1.0e-04 loss: 6.153e-01]
windy_storm:  82%|########2 | 2467/3000 [1:13:58<17:43,  1.99s/it, lr: 1.0e-04 loss: 6.153e-01]
windy_storm:  82%|########2 | 2467/3000 [1:13:59<17:43,  1.99s/it, lr: 1.0e-04 loss: 6.364e-02]
windy_storm:  82%|########2 | 2467/3000 [1:13:59<17:43,  1.99s/it, lr: 1.0e-04 loss: 6.364e-02]
windy_storm:  82%|########2 | 2468/3000 [1:13:59<15:16,  1.72s/it, lr: 1.0e-04 loss: 6.364e-02]
windy_storm:  82%|########2 | 2468/3000 [1:13:59<15:16,  1.72s/it, lr: 1.0e-04 loss: 6.364e-02]
windy_storm:  82%|########2 | 2468/3000 [1:14:02<15:16,  1.72s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:  82%|########2 | 2468/3000 [1:14:02<15:16,  1.72s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:  82%|########2 | 2469/3000 [1:14:02<18:33,  2.10s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:  82%|########2 | 2469/3000 [1:14:02<18:33,  2.10s/it, lr: 1.0e-04 loss: 5.480e-01]
windy_storm:  82%|########2 | 2469/3000 [1:14:04<18:33,  2.10s/it, lr: 1.0e-04 loss: 6.945e-01]
windy_storm:  82%|########2 | 2469/3000 [1:14:04<18:33,  2.10s/it, lr: 1.0e-04 loss: 6.945e-01]
windy_storm:  82%|########2 | 2470/3000 [1:14:05<18:31,  2.10s/it, lr: 1.0e-04 loss: 4.192e-01]
windy_storm:  82%|########2 | 2470/3000 [1:14:05<18:31,  2.10s/it, lr: 1.0e-04 loss: 4.192e-01]
windy_storm:  82%|########2 | 2471/3000 [1:14:05<13:09,  1.49s/it, lr: 1.0e-04 loss: 4.192e-01]
windy_storm:  82%|########2 | 2471/3000 [1:14:05<13:09,  1.49s/it, lr: 1.0e-04 loss: 4.192e-01]
windy_storm:  82%|########2 | 2471/3000 [1:14:06<13:09,  1.49s/it, lr: 1.0e-04 loss: 5.537e-01]
windy_storm:  82%|########2 | 2471/3000 [1:14:06<13:09,  1.49s/it, lr: 1.0e-04 loss: 5.537e-01]
windy_storm:  82%|########2 | 2472/3000 [1:14:06<11:39,  1.32s/it, lr: 1.0e-04 loss: 5.537e-01]
windy_storm:  82%|########2 | 2472/3000 [1:14:06<11:39,  1.32s/it, lr: 1.0e-04 loss: 5.537e-01]
windy_storm:  82%|########2 | 2472/3000 [1:14:09<11:39,  1.32s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  82%|########2 | 2472/3000 [1:14:09<11:39,  1.32s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  82%|########2 | 2473/3000 [1:14:09<15:17,  1.74s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  82%|########2 | 2473/3000 [1:14:09<15:17,  1.74s/it, lr: 1.0e-04 loss: 3.398e-01]
windy_storm:  82%|########2 | 2473/3000 [1:14:10<15:17,  1.74s/it, lr: 1.0e-04 loss: 2.348e-01]
windy_storm:  82%|########2 | 2473/3000 [1:14:10<15:17,  1.74s/it, lr: 1.0e-04 loss: 2.348e-01]
windy_storm:  82%|########2 | 2474/3000 [1:14:10<12:51,  1.47s/it, lr: 1.0e-04 loss: 2.348e-01]
windy_storm:  82%|########2 | 2474/3000 [1:14:10<12:51,  1.47s/it, lr: 1.0e-04 loss: 2.348e-01]
windy_storm:  82%|########2 | 2474/3000 [1:14:11<12:51,  1.47s/it, lr: 1.0e-04 loss: 1.946e-01]
windy_storm:  82%|########2 | 2474/3000 [1:14:11<12:51,  1.47s/it, lr: 1.0e-04 loss: 1.946e-01]
windy_storm:  82%|########2 | 2475/3000 [1:14:11<11:13,  1.28s/it, lr: 1.0e-04 loss: 1.946e-01]
windy_storm:  82%|########2 | 2475/3000 [1:14:11<11:13,  1.28s/it, lr: 1.0e-04 loss: 1.946e-01]
windy_storm:  82%|########2 | 2475/3000 [1:14:12<11:13,  1.28s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  82%|########2 | 2475/3000 [1:14:12<11:13,  1.28s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  83%|########2 | 2476/3000 [1:14:12<11:56,  1.37s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  83%|########2 | 2476/3000 [1:14:12<11:56,  1.37s/it, lr: 1.0e-04 loss: 1.544e-01]
windy_storm:  83%|########2 | 2476/3000 [1:14:15<11:56,  1.37s/it, lr: 1.0e-04 loss: 6.846e-01]
windy_storm:  83%|########2 | 2476/3000 [1:14:15<11:56,  1.37s/it, lr: 1.0e-04 loss: 6.846e-01]
windy_storm:  83%|########2 | 2477/3000 [1:14:15<15:59,  1.83s/it, lr: 1.0e-04 loss: 6.846e-01]
windy_storm:  83%|########2 | 2477/3000 [1:14:15<15:59,  1.83s/it, lr: 1.0e-04 loss: 6.846e-01]
windy_storm:  83%|########2 | 2477/3000 [1:14:16<15:59,  1.83s/it, lr: 1.0e-04 loss: 2.038e-01]
windy_storm:  83%|########2 | 2477/3000 [1:14:16<15:59,  1.83s/it, lr: 1.0e-04 loss: 2.038e-01]
windy_storm:  83%|########2 | 2478/3000 [1:14:16<13:12,  1.52s/it, lr: 1.0e-04 loss: 2.038e-01]
windy_storm:  83%|########2 | 2478/3000 [1:14:16<13:12,  1.52s/it, lr: 1.0e-04 loss: 2.038e-01]
windy_storm:  83%|########2 | 2478/3000 [1:14:18<13:12,  1.52s/it, lr: 1.0e-04 loss: 4.975e-01]
windy_storm:  83%|########2 | 2478/3000 [1:14:18<13:12,  1.52s/it, lr: 1.0e-04 loss: 4.975e-01]
windy_storm:  83%|########2 | 2479/3000 [1:14:18<13:19,  1.53s/it, lr: 1.0e-04 loss: 4.975e-01]
windy_storm:  83%|########2 | 2479/3000 [1:14:18<13:19,  1.53s/it, lr: 1.0e-04 loss: 4.975e-01]
windy_storm:  83%|########2 | 2479/3000 [1:14:18<13:19,  1.53s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:  83%|########2 | 2479/3000 [1:14:18<13:19,  1.53s/it, lr: 1.0e-04 loss: 1.285e-01]
windy_storm:  83%|########2 | 2480/3000 [1:14:19<13:17,  1.53s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  83%|########2 | 2480/3000 [1:14:19<13:17,  1.53s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  83%|########2 | 2481/3000 [1:14:19<08:40,  1.00s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  83%|########2 | 2481/3000 [1:14:19<08:40,  1.00s/it, lr: 1.0e-04 loss: 6.241e-01]
windy_storm:  83%|########2 | 2481/3000 [1:14:22<08:40,  1.00s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  83%|########2 | 2481/3000 [1:14:22<08:40,  1.00s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  83%|########2 | 2482/3000 [1:14:22<12:45,  1.48s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  83%|########2 | 2482/3000 [1:14:22<12:45,  1.48s/it, lr: 1.0e-04 loss: 3.800e-01]
windy_storm:  83%|########2 | 2482/3000 [1:14:24<12:45,  1.48s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  83%|########2 | 2482/3000 [1:14:24<12:45,  1.48s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  83%|########2 | 2483/3000 [1:14:24<13:11,  1.53s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  83%|########2 | 2483/3000 [1:14:24<13:11,  1.53s/it, lr: 1.0e-04 loss: 6.775e-01]
windy_storm:  83%|########2 | 2483/3000 [1:14:25<13:11,  1.53s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  83%|########2 | 2483/3000 [1:14:25<13:11,  1.53s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  83%|########2 | 2484/3000 [1:14:25<13:12,  1.54s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  83%|########2 | 2484/3000 [1:14:25<13:12,  1.54s/it, lr: 1.0e-04 loss: 0.000e+00]
windy_storm:  83%|########2 | 2484/3000 [1:14:28<13:12,  1.54s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  83%|########2 | 2484/3000 [1:14:28<13:12,  1.54s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  83%|########2 | 2485/3000 [1:14:28<16:30,  1.92s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  83%|########2 | 2485/3000 [1:14:28<16:30,  1.92s/it, lr: 1.0e-04 loss: 4.658e-01]
windy_storm:  83%|########2 | 2485/3000 [1:14:29<16:30,  1.92s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  83%|########2 | 2485/3000 [1:14:29<16:30,  1.92s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  83%|########2 | 2486/3000 [1:14:29<13:45,  1.61s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  83%|########2 | 2486/3000 [1:14:29<13:45,  1.61s/it, lr: 1.0e-04 loss: 5.149e-01]
windy_storm:  83%|########2 | 2486/3000 [1:14:32<13:45,  1.61s/it, lr: 1.0e-04 loss: 6.354e-01]
windy_storm:  83%|########2 | 2486/3000 [1:14:32<13:45,  1.61s/it, lr: 1.0e-04 loss: 6.354e-01]
windy_storm:  83%|########2 | 2487/3000 [1:14:32<17:00,  1.99s/it, lr: 1.0e-04 loss: 6.354e-01]
windy_storm:  83%|########2 | 2487/3000 [1:14:32<17:00,  1.99s/it, lr: 1.0e-04 loss: 6.354e-01]
windy_storm:  83%|########2 | 2487/3000 [1:14:35<17:00,  1.99s/it, lr: 1.0e-04 loss: 1.767e-01]
windy_storm:  83%|########2 | 2487/3000 [1:14:35<17:00,  1.99s/it, lr: 1.0e-04 loss: 1.767e-01]
windy_storm:  83%|########2 | 2488/3000 [1:14:35<19:19,  2.27s/it, lr: 1.0e-04 loss: 1.767e-01]
windy_storm:  83%|########2 | 2488/3000 [1:14:35<19:19,  2.27s/it, lr: 1.0e-04 loss: 1.767e-01]
windy_storm:  83%|########2 | 2488/3000 [1:14:36<19:19,  2.27s/it, lr: 1.0e-04 loss: 7.143e-01]
windy_storm:  83%|########2 | 2488/3000 [1:14:36<19:19,  2.27s/it, lr: 1.0e-04 loss: 7.143e-01]
windy_storm:  83%|########2 | 2489/3000 [1:14:36<17:32,  2.06s/it, lr: 1.0e-04 loss: 7.143e-01]
windy_storm:  83%|########2 | 2489/3000 [1:14:36<17:32,  2.06s/it, lr: 1.0e-04 loss: 7.143e-01]
windy_storm:  83%|########2 | 2489/3000 [1:14:39<17:32,  2.06s/it, lr: 1.0e-04 loss: 5.769e-02]
windy_storm:  83%|########2 | 2489/3000 [1:14:39<17:32,  2.06s/it, lr: 1.0e-04 loss: 5.769e-02]
windy_storm:  83%|########2 | 2490/3000 [1:14:41<17:30,  2.06s/it, lr: 1.0e-04 loss: 4.879e-01]
windy_storm:  83%|########2 | 2490/3000 [1:14:41<17:30,  2.06s/it, lr: 1.0e-04 loss: 4.879e-01]
windy_storm:  83%|########3 | 2491/3000 [1:14:41<12:33,  1.48s/it, lr: 1.0e-04 loss: 4.879e-01]
windy_storm:  83%|########3 | 2491/3000 [1:14:41<12:33,  1.48s/it, lr: 1.0e-04 loss: 4.879e-01]
windy_storm:  83%|########3 | 2491/3000 [1:14:44<12:33,  1.48s/it, lr: 1.0e-04 loss: 3.015e-01]
windy_storm:  83%|########3 | 2491/3000 [1:14:44<12:33,  1.48s/it, lr: 1.0e-04 loss: 3.015e-01]
windy_storm:  83%|########3 | 2492/3000 [1:14:44<15:29,  1.83s/it, lr: 1.0e-04 loss: 3.015e-01]
windy_storm:  83%|########3 | 2492/3000 [1:14:44<15:29,  1.83s/it, lr: 1.0e-04 loss: 3.015e-01]
windy_storm:  83%|########3 | 2492/3000 [1:14:45<15:29,  1.83s/it, lr: 1.0e-04 loss: 2.523e-01]
windy_storm:  83%|########3 | 2492/3000 [1:14:45<15:29,  1.83s/it, lr: 1.0e-04 loss: 2.523e-01]
windy_storm:  83%|########3 | 2493/3000 [1:14:45<14:47,  1.75s/it, lr: 1.0e-04 loss: 2.523e-01]
windy_storm:  83%|########3 | 2493/3000 [1:14:45<14:47,  1.75s/it, lr: 1.0e-04 loss: 2.523e-01]
windy_storm:  83%|########3 | 2493/3000 [1:14:48<14:47,  1.75s/it, lr: 1.0e-04 loss: 6.242e-02]
windy_storm:  83%|########3 | 2493/3000 [1:14:48<14:47,  1.75s/it, lr: 1.0e-04 loss: 6.242e-02]
windy_storm:  83%|########3 | 2494/3000 [1:14:48<17:26,  2.07s/it, lr: 1.0e-04 loss: 6.242e-02]
windy_storm:  83%|########3 | 2494/3000 [1:14:48<17:26,  2.07s/it, lr: 1.0e-04 loss: 6.242e-02]
windy_storm:  83%|########3 | 2494/3000 [1:14:49<17:26,  2.07s/it, lr: 1.0e-04 loss: 5.823e-01]
windy_storm:  83%|########3 | 2494/3000 [1:14:49<17:26,  2.07s/it, lr: 1.0e-04 loss: 5.823e-01]
windy_storm:  83%|########3 | 2495/3000 [1:14:49<14:27,  1.72s/it, lr: 1.0e-04 loss: 5.823e-01]
windy_storm:  83%|########3 | 2495/3000 [1:14:49<14:27,  1.72s/it, lr: 1.0e-04 loss: 5.823e-01]
windy_storm:  83%|########3 | 2495/3000 [1:14:50<14:27,  1.72s/it, lr: 1.0e-04 loss: 4.292e-01]
windy_storm:  83%|########3 | 2495/3000 [1:14:50<14:27,  1.72s/it, lr: 1.0e-04 loss: 4.292e-01]
windy_storm:  83%|########3 | 2496/3000 [1:14:50<12:05,  1.44s/it, lr: 1.0e-04 loss: 4.292e-01]
windy_storm:  83%|########3 | 2496/3000 [1:14:50<12:05,  1.44s/it, lr: 1.0e-04 loss: 4.292e-01]
windy_storm:  83%|########3 | 2496/3000 [1:14:53<12:05,  1.44s/it, lr: 1.0e-04 loss: 6.748e-01]
windy_storm:  83%|########3 | 2496/3000 [1:14:53<12:05,  1.44s/it, lr: 1.0e-04 loss: 6.748e-01]
windy_storm:  83%|########3 | 2497/3000 [1:14:53<16:11,  1.93s/it, lr: 1.0e-04 loss: 6.748e-01]
windy_storm:  83%|########3 | 2497/3000 [1:14:53<16:11,  1.93s/it, lr: 1.0e-04 loss: 6.748e-01]
windy_storm:  83%|########3 | 2497/3000 [1:14:55<16:11,  1.93s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  83%|########3 | 2497/3000 [1:14:55<16:11,  1.93s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  83%|########3 | 2498/3000 [1:14:55<15:07,  1.81s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  83%|########3 | 2498/3000 [1:14:55<15:07,  1.81s/it, lr: 1.0e-04 loss: 3.195e-01]
windy_storm:  83%|########3 | 2498/3000 [1:14:55<15:07,  1.81s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  83%|########3 | 2498/3000 [1:14:55<15:07,  1.81s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  83%|########3 | 2499/3000 [1:14:55<12:41,  1.52s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  83%|########3 | 2499/3000 [1:14:55<12:41,  1.52s/it, lr: 1.0e-04 loss: 5.678e-01]
windy_storm:  83%|########3 | 2499/3000 [1:14:58<12:41,  1.52s/it, lr: 1.0e-04 loss: 6.902e-01]
windy_storm:  83%|########3 | 2499/3000 [1:14:58<12:41,  1.52s/it, lr: 1.0e-04 loss: 6.902e-01]
Saving at step 2500
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000002500.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000001500.safetensors

windy_storm:  83%|########3 | 2500/3000 [1:15:00<12:39,  1.52s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:  83%|########3 | 2500/3000 [1:15:00<12:39,  1.52s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:  83%|########3 | 2501/3000 [1:15:00<10:13,  1.23s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:  83%|########3 | 2501/3000 [1:15:00<10:13,  1.23s/it, lr: 1.0e-04 loss: 4.437e-01]
windy_storm:  83%|########3 | 2501/3000 [1:15:03<10:13,  1.23s/it, lr: 1.0e-04 loss: 6.477e-01]
windy_storm:  83%|########3 | 2501/3000 [1:15:03<10:13,  1.23s/it, lr: 1.0e-04 loss: 6.477e-01]
windy_storm:  83%|########3 | 2502/3000 [1:15:03<13:41,  1.65s/it, lr: 1.0e-04 loss: 6.477e-01]
windy_storm:  83%|########3 | 2502/3000 [1:15:03<13:41,  1.65s/it, lr: 1.0e-04 loss: 6.477e-01]
windy_storm:  83%|########3 | 2502/3000 [1:15:04<13:41,  1.65s/it, lr: 1.0e-04 loss: 5.688e-01]
windy_storm:  83%|########3 | 2502/3000 [1:15:04<13:41,  1.65s/it, lr: 1.0e-04 loss: 5.688e-01]
windy_storm:  83%|########3 | 2503/3000 [1:15:04<11:51,  1.43s/it, lr: 1.0e-04 loss: 5.688e-01]
windy_storm:  83%|########3 | 2503/3000 [1:15:04<11:51,  1.43s/it, lr: 1.0e-04 loss: 5.688e-01]
windy_storm:  83%|########3 | 2503/3000 [1:15:05<11:51,  1.43s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  83%|########3 | 2503/3000 [1:15:05<11:51,  1.43s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  83%|########3 | 2504/3000 [1:15:05<12:09,  1.47s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  83%|########3 | 2504/3000 [1:15:05<12:09,  1.47s/it, lr: 1.0e-04 loss: 5.841e-01]
windy_storm:  83%|########3 | 2504/3000 [1:15:06<12:09,  1.47s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  83%|########3 | 2504/3000 [1:15:06<12:09,  1.47s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  84%|########3 | 2505/3000 [1:15:06<10:28,  1.27s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  84%|########3 | 2505/3000 [1:15:06<10:28,  1.27s/it, lr: 1.0e-04 loss: 4.290e-01]
windy_storm:  84%|########3 | 2505/3000 [1:15:08<10:28,  1.27s/it, lr: 1.0e-04 loss: 6.137e-01]
windy_storm:  84%|########3 | 2505/3000 [1:15:08<10:28,  1.27s/it, lr: 1.0e-04 loss: 6.137e-01]
windy_storm:  84%|########3 | 2506/3000 [1:15:08<11:12,  1.36s/it, lr: 1.0e-04 loss: 6.137e-01]
windy_storm:  84%|########3 | 2506/3000 [1:15:08<11:12,  1.36s/it, lr: 1.0e-04 loss: 6.137e-01]
windy_storm:  84%|########3 | 2506/3000 [1:15:09<11:12,  1.36s/it, lr: 1.0e-04 loss: 2.778e-01]
windy_storm:  84%|########3 | 2506/3000 [1:15:09<11:12,  1.36s/it, lr: 1.0e-04 loss: 2.778e-01]
windy_storm:  84%|########3 | 2507/3000 [1:15:09<11:38,  1.42s/it, lr: 1.0e-04 loss: 2.778e-01]
windy_storm:  84%|########3 | 2507/3000 [1:15:09<11:38,  1.42s/it, lr: 1.0e-04 loss: 2.778e-01]
windy_storm:  84%|########3 | 2507/3000 [1:15:10<11:38,  1.42s/it, lr: 1.0e-04 loss: 5.999e-01]
windy_storm:  84%|########3 | 2507/3000 [1:15:10<11:38,  1.42s/it, lr: 1.0e-04 loss: 5.999e-01]
windy_storm:  84%|########3 | 2508/3000 [1:15:10<10:10,  1.24s/it, lr: 1.0e-04 loss: 5.999e-01]
windy_storm:  84%|########3 | 2508/3000 [1:15:10<10:10,  1.24s/it, lr: 1.0e-04 loss: 5.999e-01]
windy_storm:  84%|########3 | 2508/3000 [1:15:11<10:10,  1.24s/it, lr: 1.0e-04 loss: 5.327e-01]
windy_storm:  84%|########3 | 2508/3000 [1:15:11<10:10,  1.24s/it, lr: 1.0e-04 loss: 5.327e-01]
windy_storm:  84%|########3 | 2509/3000 [1:15:11<08:59,  1.10s/it, lr: 1.0e-04 loss: 5.327e-01]
windy_storm:  84%|########3 | 2509/3000 [1:15:11<08:59,  1.10s/it, lr: 1.0e-04 loss: 5.327e-01]
windy_storm:  84%|########3 | 2509/3000 [1:15:12<08:59,  1.10s/it, lr: 1.0e-04 loss: 1.614e-02]
windy_storm:  84%|########3 | 2509/3000 [1:15:12<08:59,  1.10s/it, lr: 1.0e-04 loss: 1.614e-02]
windy_storm:  84%|########3 | 2510/3000 [1:15:14<08:57,  1.10s/it, lr: 1.0e-04 loss: 3.354e-01]
windy_storm:  84%|########3 | 2510/3000 [1:15:14<08:57,  1.10s/it, lr: 1.0e-04 loss: 3.354e-01]
windy_storm:  84%|########3 | 2511/3000 [1:15:14<07:46,  1.05it/s, lr: 1.0e-04 loss: 3.354e-01]
windy_storm:  84%|########3 | 2511/3000 [1:15:14<07:46,  1.05it/s, lr: 1.0e-04 loss: 3.354e-01]
windy_storm:  84%|########3 | 2511/3000 [1:15:17<07:46,  1.05it/s, lr: 1.0e-04 loss: 1.678e-01]
windy_storm:  84%|########3 | 2511/3000 [1:15:17<07:46,  1.05it/s, lr: 1.0e-04 loss: 1.678e-01]
windy_storm:  84%|########3 | 2512/3000 [1:15:17<11:51,  1.46s/it, lr: 1.0e-04 loss: 1.678e-01]
windy_storm:  84%|########3 | 2512/3000 [1:15:17<11:51,  1.46s/it, lr: 1.0e-04 loss: 1.678e-01]
windy_storm:  84%|########3 | 2512/3000 [1:15:18<11:51,  1.46s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  84%|########3 | 2512/3000 [1:15:18<11:51,  1.46s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  84%|########3 | 2513/3000 [1:15:18<10:57,  1.35s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  84%|########3 | 2513/3000 [1:15:18<10:57,  1.35s/it, lr: 1.0e-04 loss: 4.730e-01]
windy_storm:  84%|########3 | 2513/3000 [1:15:20<10:57,  1.35s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:  84%|########3 | 2513/3000 [1:15:20<10:57,  1.35s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:  84%|########3 | 2514/3000 [1:15:20<11:21,  1.40s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:  84%|########3 | 2514/3000 [1:15:20<11:21,  1.40s/it, lr: 1.0e-04 loss: 5.300e-01]
windy_storm:  84%|########3 | 2514/3000 [1:15:20<11:21,  1.40s/it, lr: 1.0e-04 loss: 9.718e-02]
windy_storm:  84%|########3 | 2514/3000 [1:15:20<11:21,  1.40s/it, lr: 1.0e-04 loss: 9.718e-02]
windy_storm:  84%|########3 | 2515/3000 [1:15:20<09:49,  1.22s/it, lr: 1.0e-04 loss: 9.718e-02]
windy_storm:  84%|########3 | 2515/3000 [1:15:20<09:49,  1.22s/it, lr: 1.0e-04 loss: 9.718e-02]
windy_storm:  84%|########3 | 2515/3000 [1:15:23<09:49,  1.22s/it, lr: 1.0e-04 loss: 3.926e-01]
windy_storm:  84%|########3 | 2515/3000 [1:15:23<09:49,  1.22s/it, lr: 1.0e-04 loss: 3.926e-01]
windy_storm:  84%|########3 | 2516/3000 [1:15:23<13:54,  1.72s/it, lr: 1.0e-04 loss: 3.926e-01]
windy_storm:  84%|########3 | 2516/3000 [1:15:23<13:54,  1.72s/it, lr: 1.0e-04 loss: 3.926e-01]
windy_storm:  84%|########3 | 2516/3000 [1:15:25<13:54,  1.72s/it, lr: 1.0e-04 loss: 3.087e-01]
windy_storm:  84%|########3 | 2516/3000 [1:15:25<13:54,  1.72s/it, lr: 1.0e-04 loss: 3.087e-01]
windy_storm:  84%|########3 | 2517/3000 [1:15:25<13:27,  1.67s/it, lr: 1.0e-04 loss: 3.087e-01]
windy_storm:  84%|########3 | 2517/3000 [1:15:25<13:27,  1.67s/it, lr: 1.0e-04 loss: 3.087e-01]
windy_storm:  84%|########3 | 2517/3000 [1:15:26<13:27,  1.67s/it, lr: 1.0e-04 loss: 4.780e-01]
windy_storm:  84%|########3 | 2517/3000 [1:15:26<13:27,  1.67s/it, lr: 1.0e-04 loss: 4.780e-01]
windy_storm:  84%|########3 | 2518/3000 [1:15:26<11:18,  1.41s/it, lr: 1.0e-04 loss: 4.780e-01]
windy_storm:  84%|########3 | 2518/3000 [1:15:26<11:18,  1.41s/it, lr: 1.0e-04 loss: 4.780e-01]
windy_storm:  84%|########3 | 2518/3000 [1:15:29<11:18,  1.41s/it, lr: 1.0e-04 loss: 2.965e-01]
windy_storm:  84%|########3 | 2518/3000 [1:15:29<11:18,  1.41s/it, lr: 1.0e-04 loss: 2.965e-01]
windy_storm:  84%|########3 | 2519/3000 [1:15:29<15:04,  1.88s/it, lr: 1.0e-04 loss: 2.965e-01]
windy_storm:  84%|########3 | 2519/3000 [1:15:29<15:04,  1.88s/it, lr: 1.0e-04 loss: 2.965e-01]
windy_storm:  84%|########3 | 2519/3000 [1:15:31<15:04,  1.88s/it, lr: 1.0e-04 loss: 1.471e-01]
windy_storm:  84%|########3 | 2519/3000 [1:15:31<15:04,  1.88s/it, lr: 1.0e-04 loss: 1.471e-01]
windy_storm:  84%|########4 | 2520/3000 [1:15:32<15:02,  1.88s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  84%|########4 | 2520/3000 [1:15:32<15:02,  1.88s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  84%|########4 | 2521/3000 [1:15:32<11:01,  1.38s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  84%|########4 | 2521/3000 [1:15:32<11:01,  1.38s/it, lr: 1.0e-04 loss: 6.418e-01]
windy_storm:  84%|########4 | 2521/3000 [1:15:34<11:01,  1.38s/it, lr: 1.0e-04 loss: 4.531e-01]
windy_storm:  84%|########4 | 2521/3000 [1:15:34<11:01,  1.38s/it, lr: 1.0e-04 loss: 4.531e-01]
windy_storm:  84%|########4 | 2522/3000 [1:15:34<11:22,  1.43s/it, lr: 1.0e-04 loss: 4.531e-01]
windy_storm:  84%|########4 | 2522/3000 [1:15:34<11:22,  1.43s/it, lr: 1.0e-04 loss: 4.531e-01]
windy_storm:  84%|########4 | 2522/3000 [1:15:35<11:22,  1.43s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  84%|########4 | 2522/3000 [1:15:35<11:22,  1.43s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  84%|########4 | 2523/3000 [1:15:35<10:00,  1.26s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  84%|########4 | 2523/3000 [1:15:35<10:00,  1.26s/it, lr: 1.0e-04 loss: 6.463e-01]
windy_storm:  84%|########4 | 2523/3000 [1:15:35<10:00,  1.26s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  84%|########4 | 2523/3000 [1:15:35<10:00,  1.26s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  84%|########4 | 2524/3000 [1:15:35<08:56,  1.13s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  84%|########4 | 2524/3000 [1:15:35<08:56,  1.13s/it, lr: 1.0e-04 loss: 6.515e-01]
windy_storm:  84%|########4 | 2524/3000 [1:15:36<08:56,  1.13s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  84%|########4 | 2524/3000 [1:15:36<08:56,  1.13s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  84%|########4 | 2525/3000 [1:15:36<08:08,  1.03s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  84%|########4 | 2525/3000 [1:15:36<08:08,  1.03s/it, lr: 1.0e-04 loss: 3.472e-01]
windy_storm:  84%|########4 | 2525/3000 [1:15:39<08:08,  1.03s/it, lr: 1.0e-04 loss: 4.155e-01]
windy_storm:  84%|########4 | 2525/3000 [1:15:39<08:08,  1.03s/it, lr: 1.0e-04 loss: 4.155e-01]
windy_storm:  84%|########4 | 2526/3000 [1:15:39<12:25,  1.57s/it, lr: 1.0e-04 loss: 4.155e-01]
windy_storm:  84%|########4 | 2526/3000 [1:15:39<12:25,  1.57s/it, lr: 1.0e-04 loss: 4.155e-01]
windy_storm:  84%|########4 | 2526/3000 [1:15:41<12:25,  1.57s/it, lr: 1.0e-04 loss: 1.408e-01]
windy_storm:  84%|########4 | 2526/3000 [1:15:41<12:25,  1.57s/it, lr: 1.0e-04 loss: 1.408e-01]
windy_storm:  84%|########4 | 2527/3000 [1:15:41<12:26,  1.58s/it, lr: 1.0e-04 loss: 1.408e-01]
windy_storm:  84%|########4 | 2527/3000 [1:15:41<12:26,  1.58s/it, lr: 1.0e-04 loss: 1.408e-01]
windy_storm:  84%|########4 | 2527/3000 [1:15:42<12:26,  1.58s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  84%|########4 | 2527/3000 [1:15:42<12:26,  1.58s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  84%|########4 | 2528/3000 [1:15:42<11:25,  1.45s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  84%|########4 | 2528/3000 [1:15:42<11:25,  1.45s/it, lr: 1.0e-04 loss: 6.323e-01]
windy_storm:  84%|########4 | 2528/3000 [1:15:43<11:25,  1.45s/it, lr: 1.0e-04 loss: 6.749e-02]
windy_storm:  84%|########4 | 2528/3000 [1:15:43<11:25,  1.45s/it, lr: 1.0e-04 loss: 6.749e-02]
windy_storm:  84%|########4 | 2529/3000 [1:15:43<11:45,  1.50s/it, lr: 1.0e-04 loss: 6.749e-02]
windy_storm:  84%|########4 | 2529/3000 [1:15:43<11:45,  1.50s/it, lr: 1.0e-04 loss: 6.749e-02]
windy_storm:  84%|########4 | 2529/3000 [1:15:44<11:45,  1.50s/it, lr: 1.0e-04 loss: 6.011e-01]
windy_storm:  84%|########4 | 2529/3000 [1:15:44<11:45,  1.50s/it, lr: 1.0e-04 loss: 6.011e-01]
windy_storm:  84%|########4 | 2530/3000 [1:15:47<11:44,  1.50s/it, lr: 1.0e-04 loss: 7.253e-01]
windy_storm:  84%|########4 | 2530/3000 [1:15:47<11:44,  1.50s/it, lr: 1.0e-04 loss: 7.253e-01]
windy_storm:  84%|########4 | 2531/3000 [1:15:47<11:46,  1.51s/it, lr: 1.0e-04 loss: 7.253e-01]
windy_storm:  84%|########4 | 2531/3000 [1:15:47<11:46,  1.51s/it, lr: 1.0e-04 loss: 7.253e-01]
windy_storm:  84%|########4 | 2531/3000 [1:15:48<11:46,  1.51s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  84%|########4 | 2531/3000 [1:15:48<11:46,  1.51s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  84%|########4 | 2532/3000 [1:15:48<10:16,  1.32s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  84%|########4 | 2532/3000 [1:15:48<10:16,  1.32s/it, lr: 1.0e-04 loss: 7.046e-01]
windy_storm:  84%|########4 | 2532/3000 [1:15:51<10:16,  1.32s/it, lr: 1.0e-04 loss: 4.557e-01]
windy_storm:  84%|########4 | 2532/3000 [1:15:51<10:16,  1.32s/it, lr: 1.0e-04 loss: 4.557e-01]
windy_storm:  84%|########4 | 2533/3000 [1:15:51<13:44,  1.77s/it, lr: 1.0e-04 loss: 4.557e-01]
windy_storm:  84%|########4 | 2533/3000 [1:15:51<13:44,  1.77s/it, lr: 1.0e-04 loss: 4.557e-01]
windy_storm:  84%|########4 | 2533/3000 [1:15:54<13:44,  1.77s/it, lr: 1.0e-04 loss: 1.029e-01]
windy_storm:  84%|########4 | 2533/3000 [1:15:54<13:44,  1.77s/it, lr: 1.0e-04 loss: 1.029e-01]
windy_storm:  84%|########4 | 2534/3000 [1:15:54<16:23,  2.11s/it, lr: 1.0e-04 loss: 1.029e-01]
windy_storm:  84%|########4 | 2534/3000 [1:15:54<16:23,  2.11s/it, lr: 1.0e-04 loss: 1.029e-01]
windy_storm:  84%|########4 | 2534/3000 [1:15:56<16:23,  2.11s/it, lr: 1.0e-04 loss: 6.644e-02]
windy_storm:  84%|########4 | 2534/3000 [1:15:56<16:23,  2.11s/it, lr: 1.0e-04 loss: 6.644e-02]
windy_storm:  84%|########4 | 2535/3000 [1:15:56<15:10,  1.96s/it, lr: 1.0e-04 loss: 6.644e-02]
windy_storm:  84%|########4 | 2535/3000 [1:15:56<15:10,  1.96s/it, lr: 1.0e-04 loss: 6.644e-02]
windy_storm:  84%|########4 | 2535/3000 [1:15:56<15:10,  1.96s/it, lr: 1.0e-04 loss: 6.587e-01]
windy_storm:  84%|########4 | 2535/3000 [1:15:56<15:10,  1.96s/it, lr: 1.0e-04 loss: 6.587e-01]
windy_storm:  85%|########4 | 2536/3000 [1:15:56<12:30,  1.62s/it, lr: 1.0e-04 loss: 6.587e-01]
windy_storm:  85%|########4 | 2536/3000 [1:15:56<12:30,  1.62s/it, lr: 1.0e-04 loss: 6.587e-01]
windy_storm:  85%|########4 | 2536/3000 [1:15:58<12:30,  1.62s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  85%|########4 | 2536/3000 [1:15:58<12:30,  1.62s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  85%|########4 | 2537/3000 [1:15:58<12:26,  1.61s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  85%|########4 | 2537/3000 [1:15:58<12:26,  1.61s/it, lr: 1.0e-04 loss: 1.438e-01]
windy_storm:  85%|########4 | 2537/3000 [1:16:00<12:26,  1.61s/it, lr: 1.0e-04 loss: 2.805e-01]
windy_storm:  85%|########4 | 2537/3000 [1:16:00<12:26,  1.61s/it, lr: 1.0e-04 loss: 2.805e-01]
windy_storm:  85%|########4 | 2538/3000 [1:16:00<12:21,  1.61s/it, lr: 1.0e-04 loss: 2.805e-01]
windy_storm:  85%|########4 | 2538/3000 [1:16:00<12:21,  1.61s/it, lr: 1.0e-04 loss: 2.805e-01]
windy_storm:  85%|########4 | 2538/3000 [1:16:03<12:21,  1.61s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########4 | 2538/3000 [1:16:03<12:21,  1.61s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########4 | 2539/3000 [1:16:03<15:25,  2.01s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########4 | 2539/3000 [1:16:03<15:25,  2.01s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########4 | 2539/3000 [1:16:05<15:25,  2.01s/it, lr: 1.0e-04 loss: 4.870e-01]
windy_storm:  85%|########4 | 2539/3000 [1:16:05<15:25,  2.01s/it, lr: 1.0e-04 loss: 4.870e-01]
windy_storm:  85%|########4 | 2540/3000 [1:16:08<15:23,  2.01s/it, lr: 1.0e-04 loss: 8.860e-02]
windy_storm:  85%|########4 | 2540/3000 [1:16:08<15:23,  2.01s/it, lr: 1.0e-04 loss: 8.860e-02]
windy_storm:  85%|########4 | 2541/3000 [1:16:08<13:28,  1.76s/it, lr: 1.0e-04 loss: 8.860e-02]
windy_storm:  85%|########4 | 2541/3000 [1:16:08<13:28,  1.76s/it, lr: 1.0e-04 loss: 8.860e-02]
windy_storm:  85%|########4 | 2541/3000 [1:16:10<13:28,  1.76s/it, lr: 1.0e-04 loss: 2.739e-01]
windy_storm:  85%|########4 | 2541/3000 [1:16:10<13:28,  1.76s/it, lr: 1.0e-04 loss: 2.739e-01]
windy_storm:  85%|########4 | 2542/3000 [1:16:10<12:11,  1.60s/it, lr: 1.0e-04 loss: 2.739e-01]
windy_storm:  85%|########4 | 2542/3000 [1:16:10<12:11,  1.60s/it, lr: 1.0e-04 loss: 2.739e-01]
windy_storm:  85%|########4 | 2542/3000 [1:16:12<12:11,  1.60s/it, lr: 1.0e-04 loss: 4.241e-01]
windy_storm:  85%|########4 | 2542/3000 [1:16:12<12:11,  1.60s/it, lr: 1.0e-04 loss: 4.241e-01]
windy_storm:  85%|########4 | 2543/3000 [1:16:13<14:51,  1.95s/it, lr: 1.0e-04 loss: 4.241e-01]
windy_storm:  85%|########4 | 2543/3000 [1:16:13<14:51,  1.95s/it, lr: 1.0e-04 loss: 4.241e-01]
windy_storm:  85%|########4 | 2543/3000 [1:16:15<14:51,  1.95s/it, lr: 1.0e-04 loss: 2.742e-02]
windy_storm:  85%|########4 | 2543/3000 [1:16:15<14:51,  1.95s/it, lr: 1.0e-04 loss: 2.742e-02]
windy_storm:  85%|########4 | 2544/3000 [1:16:15<16:51,  2.22s/it, lr: 1.0e-04 loss: 2.742e-02]
windy_storm:  85%|########4 | 2544/3000 [1:16:15<16:51,  2.22s/it, lr: 1.0e-04 loss: 2.742e-02]
windy_storm:  85%|########4 | 2544/3000 [1:16:17<16:51,  2.22s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  85%|########4 | 2544/3000 [1:16:17<16:51,  2.22s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  85%|########4 | 2545/3000 [1:16:17<15:24,  2.03s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  85%|########4 | 2545/3000 [1:16:17<15:24,  2.03s/it, lr: 1.0e-04 loss: 4.567e-01]
windy_storm:  85%|########4 | 2545/3000 [1:16:18<15:24,  2.03s/it, lr: 1.0e-04 loss: 2.303e-01]
windy_storm:  85%|########4 | 2545/3000 [1:16:18<15:24,  2.03s/it, lr: 1.0e-04 loss: 2.303e-01]
windy_storm:  85%|########4 | 2546/3000 [1:16:18<12:46,  1.69s/it, lr: 1.0e-04 loss: 2.303e-01]
windy_storm:  85%|########4 | 2546/3000 [1:16:18<12:46,  1.69s/it, lr: 1.0e-04 loss: 2.303e-01]
windy_storm:  85%|########4 | 2546/3000 [1:16:21<12:46,  1.69s/it, lr: 1.0e-04 loss: 2.063e-01]
windy_storm:  85%|########4 | 2546/3000 [1:16:21<12:46,  1.69s/it, lr: 1.0e-04 loss: 2.063e-01]
windy_storm:  85%|########4 | 2547/3000 [1:16:21<15:27,  2.05s/it, lr: 1.0e-04 loss: 2.063e-01]
windy_storm:  85%|########4 | 2547/3000 [1:16:21<15:27,  2.05s/it, lr: 1.0e-04 loss: 2.063e-01]
windy_storm:  85%|########4 | 2547/3000 [1:16:22<15:27,  2.05s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  85%|########4 | 2547/3000 [1:16:22<15:27,  2.05s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  85%|########4 | 2548/3000 [1:16:22<14:19,  1.90s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  85%|########4 | 2548/3000 [1:16:22<14:19,  1.90s/it, lr: 1.0e-04 loss: 1.437e-01]
windy_storm:  85%|########4 | 2548/3000 [1:16:23<14:19,  1.90s/it, lr: 1.0e-04 loss: 5.409e-01]
windy_storm:  85%|########4 | 2548/3000 [1:16:23<14:19,  1.90s/it, lr: 1.0e-04 loss: 5.409e-01]
windy_storm:  85%|########4 | 2549/3000 [1:16:23<11:42,  1.56s/it, lr: 1.0e-04 loss: 5.409e-01]
windy_storm:  85%|########4 | 2549/3000 [1:16:23<11:42,  1.56s/it, lr: 1.0e-04 loss: 5.409e-01]
windy_storm:  85%|########4 | 2549/3000 [1:16:25<11:42,  1.56s/it, lr: 1.0e-04 loss: 5.878e-01]
windy_storm:  85%|########4 | 2549/3000 [1:16:25<11:42,  1.56s/it, lr: 1.0e-04 loss: 5.878e-01]
windy_storm:  85%|########5 | 2550/3000 [1:16:28<11:41,  1.56s/it, lr: 1.0e-04 loss: 3.224e-01]
windy_storm:  85%|########5 | 2550/3000 [1:16:28<11:41,  1.56s/it, lr: 1.0e-04 loss: 3.224e-01]
windy_storm:  85%|########5 | 2551/3000 [1:16:28<11:20,  1.52s/it, lr: 1.0e-04 loss: 3.224e-01]
windy_storm:  85%|########5 | 2551/3000 [1:16:28<11:20,  1.52s/it, lr: 1.0e-04 loss: 3.224e-01]
windy_storm:  85%|########5 | 2551/3000 [1:16:28<11:20,  1.52s/it, lr: 1.0e-04 loss: 5.287e-01]
windy_storm:  85%|########5 | 2551/3000 [1:16:28<11:20,  1.52s/it, lr: 1.0e-04 loss: 5.287e-01]
windy_storm:  85%|########5 | 2552/3000 [1:16:28<09:56,  1.33s/it, lr: 1.0e-04 loss: 5.287e-01]
windy_storm:  85%|########5 | 2552/3000 [1:16:28<09:56,  1.33s/it, lr: 1.0e-04 loss: 5.287e-01]
windy_storm:  85%|########5 | 2552/3000 [1:16:30<09:56,  1.33s/it, lr: 1.0e-04 loss: 6.926e-01]
windy_storm:  85%|########5 | 2552/3000 [1:16:30<09:56,  1.33s/it, lr: 1.0e-04 loss: 6.926e-01]
windy_storm:  85%|########5 | 2553/3000 [1:16:30<10:24,  1.40s/it, lr: 1.0e-04 loss: 6.926e-01]
windy_storm:  85%|########5 | 2553/3000 [1:16:30<10:24,  1.40s/it, lr: 1.0e-04 loss: 6.926e-01]
windy_storm:  85%|########5 | 2553/3000 [1:16:33<10:24,  1.40s/it, lr: 1.0e-04 loss: 4.749e-02]
windy_storm:  85%|########5 | 2553/3000 [1:16:33<10:24,  1.40s/it, lr: 1.0e-04 loss: 4.749e-02]
windy_storm:  85%|########5 | 2554/3000 [1:16:33<13:27,  1.81s/it, lr: 1.0e-04 loss: 4.749e-02]
windy_storm:  85%|########5 | 2554/3000 [1:16:33<13:27,  1.81s/it, lr: 1.0e-04 loss: 4.749e-02]
windy_storm:  85%|########5 | 2554/3000 [1:16:34<13:27,  1.81s/it, lr: 1.0e-04 loss: 3.152e-01]
windy_storm:  85%|########5 | 2554/3000 [1:16:34<13:27,  1.81s/it, lr: 1.0e-04 loss: 3.152e-01]
windy_storm:  85%|########5 | 2555/3000 [1:16:34<11:48,  1.59s/it, lr: 1.0e-04 loss: 3.152e-01]
windy_storm:  85%|########5 | 2555/3000 [1:16:34<11:48,  1.59s/it, lr: 1.0e-04 loss: 3.152e-01]
windy_storm:  85%|########5 | 2555/3000 [1:16:35<11:48,  1.59s/it, lr: 1.0e-04 loss: 4.124e-01]
windy_storm:  85%|########5 | 2555/3000 [1:16:35<11:48,  1.59s/it, lr: 1.0e-04 loss: 4.124e-01]
windy_storm:  85%|########5 | 2556/3000 [1:16:35<10:11,  1.38s/it, lr: 1.0e-04 loss: 4.124e-01]
windy_storm:  85%|########5 | 2556/3000 [1:16:35<10:11,  1.38s/it, lr: 1.0e-04 loss: 4.124e-01]
windy_storm:  85%|########5 | 2556/3000 [1:16:35<10:11,  1.38s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  85%|########5 | 2556/3000 [1:16:35<10:11,  1.38s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  85%|########5 | 2557/3000 [1:16:35<08:49,  1.19s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  85%|########5 | 2557/3000 [1:16:35<08:49,  1.19s/it, lr: 1.0e-04 loss: 2.752e-01]
windy_storm:  85%|########5 | 2557/3000 [1:16:37<08:49,  1.19s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########5 | 2557/3000 [1:16:37<08:49,  1.19s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########5 | 2558/3000 [1:16:37<09:40,  1.31s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########5 | 2558/3000 [1:16:37<09:40,  1.31s/it, lr: 1.0e-04 loss: 6.527e-01]
windy_storm:  85%|########5 | 2558/3000 [1:16:38<09:40,  1.31s/it, lr: 1.0e-04 loss: 2.085e-01]
windy_storm:  85%|########5 | 2558/3000 [1:16:38<09:40,  1.31s/it, lr: 1.0e-04 loss: 2.085e-01]
windy_storm:  85%|########5 | 2559/3000 [1:16:38<08:36,  1.17s/it, lr: 1.0e-04 loss: 2.085e-01]
windy_storm:  85%|########5 | 2559/3000 [1:16:38<08:36,  1.17s/it, lr: 1.0e-04 loss: 2.085e-01]
windy_storm:  85%|########5 | 2559/3000 [1:16:41<08:36,  1.17s/it, lr: 1.0e-04 loss: 2.174e-01]
windy_storm:  85%|########5 | 2559/3000 [1:16:41<08:36,  1.17s/it, lr: 1.0e-04 loss: 2.174e-01]
windy_storm:  85%|########5 | 2560/3000 [1:16:42<08:35,  1.17s/it, lr: 1.0e-04 loss: 7.159e-01]
windy_storm:  85%|########5 | 2560/3000 [1:16:42<08:35,  1.17s/it, lr: 1.0e-04 loss: 7.159e-01]
windy_storm:  85%|########5 | 2561/3000 [1:16:42<07:17,  1.00it/s, lr: 1.0e-04 loss: 7.159e-01]
windy_storm:  85%|########5 | 2561/3000 [1:16:42<07:17,  1.00it/s, lr: 1.0e-04 loss: 7.159e-01]
windy_storm:  85%|########5 | 2561/3000 [1:16:44<07:17,  1.00it/s, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:  85%|########5 | 2561/3000 [1:16:44<07:17,  1.00it/s, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:  85%|########5 | 2562/3000 [1:16:44<08:19,  1.14s/it, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:  85%|########5 | 2562/3000 [1:16:44<08:19,  1.14s/it, lr: 1.0e-04 loss: 6.141e-01]
windy_storm:  85%|########5 | 2562/3000 [1:16:47<08:19,  1.14s/it, lr: 1.0e-04 loss: 1.969e-01]
windy_storm:  85%|########5 | 2562/3000 [1:16:47<08:19,  1.14s/it, lr: 1.0e-04 loss: 1.969e-01]
windy_storm:  85%|########5 | 2563/3000 [1:16:47<11:50,  1.63s/it, lr: 1.0e-04 loss: 1.969e-01]
windy_storm:  85%|########5 | 2563/3000 [1:16:47<11:50,  1.63s/it, lr: 1.0e-04 loss: 1.969e-01]
windy_storm:  85%|########5 | 2563/3000 [1:16:48<11:50,  1.63s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  85%|########5 | 2563/3000 [1:16:48<11:50,  1.63s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  85%|########5 | 2564/3000 [1:16:48<10:07,  1.39s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  85%|########5 | 2564/3000 [1:16:48<10:07,  1.39s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  85%|########5 | 2564/3000 [1:16:49<10:07,  1.39s/it, lr: 1.0e-04 loss: 8.917e-02]
windy_storm:  85%|########5 | 2564/3000 [1:16:49<10:07,  1.39s/it, lr: 1.0e-04 loss: 8.917e-02]
windy_storm:  86%|########5 | 2565/3000 [1:16:49<10:25,  1.44s/it, lr: 1.0e-04 loss: 8.917e-02]
windy_storm:  86%|########5 | 2565/3000 [1:16:49<10:25,  1.44s/it, lr: 1.0e-04 loss: 8.917e-02]
windy_storm:  86%|########5 | 2565/3000 [1:16:50<10:25,  1.44s/it, lr: 1.0e-04 loss: 1.919e-01]
windy_storm:  86%|########5 | 2565/3000 [1:16:50<10:25,  1.44s/it, lr: 1.0e-04 loss: 1.919e-01]
windy_storm:  86%|########5 | 2566/3000 [1:16:50<09:08,  1.26s/it, lr: 1.0e-04 loss: 1.919e-01]
windy_storm:  86%|########5 | 2566/3000 [1:16:50<09:08,  1.26s/it, lr: 1.0e-04 loss: 1.919e-01]
windy_storm:  86%|########5 | 2566/3000 [1:16:52<09:08,  1.26s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  86%|########5 | 2566/3000 [1:16:52<09:08,  1.26s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  86%|########5 | 2567/3000 [1:16:52<09:46,  1.35s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  86%|########5 | 2567/3000 [1:16:52<09:46,  1.35s/it, lr: 1.0e-04 loss: 1.470e-01]
windy_storm:  86%|########5 | 2567/3000 [1:16:55<09:46,  1.35s/it, lr: 1.0e-04 loss: 5.897e-02]
windy_storm:  86%|########5 | 2567/3000 [1:16:55<09:46,  1.35s/it, lr: 1.0e-04 loss: 5.897e-02]
windy_storm:  86%|########5 | 2568/3000 [1:16:55<13:25,  1.86s/it, lr: 1.0e-04 loss: 5.897e-02]
windy_storm:  86%|########5 | 2568/3000 [1:16:55<13:25,  1.86s/it, lr: 1.0e-04 loss: 5.897e-02]
windy_storm:  86%|########5 | 2568/3000 [1:16:56<13:25,  1.86s/it, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  86%|########5 | 2568/3000 [1:16:56<13:25,  1.86s/it, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  86%|########5 | 2569/3000 [1:16:56<11:02,  1.54s/it, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  86%|########5 | 2569/3000 [1:16:56<11:02,  1.54s/it, lr: 1.0e-04 loss: 4.623e-01]
windy_storm:  86%|########5 | 2569/3000 [1:16:59<11:02,  1.54s/it, lr: 1.0e-04 loss: 5.090e-01]
windy_storm:  86%|########5 | 2569/3000 [1:16:59<11:02,  1.54s/it, lr: 1.0e-04 loss: 5.090e-01]
windy_storm:  86%|########5 | 2570/3000 [1:17:02<11:01,  1.54s/it, lr: 1.0e-04 loss: 5.434e-01]
windy_storm:  86%|########5 | 2570/3000 [1:17:02<11:01,  1.54s/it, lr: 1.0e-04 loss: 5.434e-01]
windy_storm:  86%|########5 | 2571/3000 [1:17:02<10:54,  1.52s/it, lr: 1.0e-04 loss: 5.434e-01]
windy_storm:  86%|########5 | 2571/3000 [1:17:02<10:54,  1.52s/it, lr: 1.0e-04 loss: 5.434e-01]
windy_storm:  86%|########5 | 2571/3000 [1:17:05<10:54,  1.52s/it, lr: 1.0e-04 loss: 1.808e-01]
windy_storm:  86%|########5 | 2571/3000 [1:17:05<10:54,  1.52s/it, lr: 1.0e-04 loss: 1.808e-01]
windy_storm:  86%|########5 | 2572/3000 [1:17:05<13:31,  1.90s/it, lr: 1.0e-04 loss: 1.808e-01]
windy_storm:  86%|########5 | 2572/3000 [1:17:05<13:31,  1.90s/it, lr: 1.0e-04 loss: 1.808e-01]
windy_storm:  86%|########5 | 2572/3000 [1:17:06<13:31,  1.90s/it, lr: 1.0e-04 loss: 3.392e-01]
windy_storm:  86%|########5 | 2572/3000 [1:17:06<13:31,  1.90s/it, lr: 1.0e-04 loss: 3.392e-01]
windy_storm:  86%|########5 | 2573/3000 [1:17:06<12:52,  1.81s/it, lr: 1.0e-04 loss: 3.392e-01]
windy_storm:  86%|########5 | 2573/3000 [1:17:06<12:52,  1.81s/it, lr: 1.0e-04 loss: 3.392e-01]
windy_storm:  86%|########5 | 2573/3000 [1:17:09<12:52,  1.81s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  86%|########5 | 2573/3000 [1:17:09<12:52,  1.81s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  86%|########5 | 2574/3000 [1:17:09<14:59,  2.11s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  86%|########5 | 2574/3000 [1:17:09<14:59,  2.11s/it, lr: 1.0e-04 loss: 6.296e-01]
windy_storm:  86%|########5 | 2574/3000 [1:17:11<14:59,  2.11s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  86%|########5 | 2574/3000 [1:17:11<14:59,  2.11s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  86%|########5 | 2575/3000 [1:17:11<13:56,  1.97s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  86%|########5 | 2575/3000 [1:17:11<13:56,  1.97s/it, lr: 1.0e-04 loss: 2.206e-01]
windy_storm:  86%|########5 | 2575/3000 [1:17:11<13:56,  1.97s/it, lr: 1.0e-04 loss: 3.458e-01]
windy_storm:  86%|########5 | 2575/3000 [1:17:11<13:56,  1.97s/it, lr: 1.0e-04 loss: 3.458e-01]
windy_storm:  86%|########5 | 2576/3000 [1:17:11<11:28,  1.62s/it, lr: 1.0e-04 loss: 3.458e-01]
windy_storm:  86%|########5 | 2576/3000 [1:17:11<11:28,  1.62s/it, lr: 1.0e-04 loss: 3.458e-01]
windy_storm:  86%|########5 | 2576/3000 [1:17:13<11:28,  1.62s/it, lr: 1.0e-04 loss: 6.079e-01]
windy_storm:  86%|########5 | 2576/3000 [1:17:13<11:28,  1.62s/it, lr: 1.0e-04 loss: 6.079e-01]
windy_storm:  86%|########5 | 2577/3000 [1:17:13<11:23,  1.62s/it, lr: 1.0e-04 loss: 6.079e-01]
windy_storm:  86%|########5 | 2577/3000 [1:17:13<11:23,  1.62s/it, lr: 1.0e-04 loss: 6.079e-01]
windy_storm:  86%|########5 | 2577/3000 [1:17:14<11:23,  1.62s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  86%|########5 | 2577/3000 [1:17:14<11:23,  1.62s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  86%|########5 | 2578/3000 [1:17:14<09:43,  1.38s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  86%|########5 | 2578/3000 [1:17:14<09:43,  1.38s/it, lr: 1.0e-04 loss: 2.083e-01]
windy_storm:  86%|########5 | 2578/3000 [1:17:15<09:43,  1.38s/it, lr: 1.0e-04 loss: 6.905e-01]
windy_storm:  86%|########5 | 2578/3000 [1:17:15<09:43,  1.38s/it, lr: 1.0e-04 loss: 6.905e-01]
windy_storm:  86%|########5 | 2579/3000 [1:17:15<08:34,  1.22s/it, lr: 1.0e-04 loss: 6.905e-01]
windy_storm:  86%|########5 | 2579/3000 [1:17:15<08:34,  1.22s/it, lr: 1.0e-04 loss: 6.905e-01]
windy_storm:  86%|########5 | 2579/3000 [1:17:15<08:34,  1.22s/it, lr: 1.0e-04 loss: 6.135e-01]
windy_storm:  86%|########5 | 2579/3000 [1:17:15<08:34,  1.22s/it, lr: 1.0e-04 loss: 6.135e-01]
windy_storm:  86%|########6 | 2580/3000 [1:17:16<08:33,  1.22s/it, lr: 1.0e-04 loss: 2.334e-01]
windy_storm:  86%|########6 | 2580/3000 [1:17:16<08:33,  1.22s/it, lr: 1.0e-04 loss: 2.334e-01]
windy_storm:  86%|########6 | 2581/3000 [1:17:16<05:48,  1.20it/s, lr: 1.0e-04 loss: 2.334e-01]
windy_storm:  86%|########6 | 2581/3000 [1:17:16<05:48,  1.20it/s, lr: 1.0e-04 loss: 2.334e-01]
windy_storm:  86%|########6 | 2581/3000 [1:17:17<05:48,  1.20it/s, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  86%|########6 | 2581/3000 [1:17:17<05:48,  1.20it/s, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  86%|########6 | 2582/3000 [1:17:17<05:47,  1.20it/s, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  86%|########6 | 2582/3000 [1:17:17<05:47,  1.20it/s, lr: 1.0e-04 loss: 2.412e-01]
windy_storm:  86%|########6 | 2582/3000 [1:17:18<05:47,  1.20it/s, lr: 1.0e-04 loss: 2.259e-01]
windy_storm:  86%|########6 | 2582/3000 [1:17:18<05:47,  1.20it/s, lr: 1.0e-04 loss: 2.259e-01]
windy_storm:  86%|########6 | 2583/3000 [1:17:18<06:06,  1.14it/s, lr: 1.0e-04 loss: 2.259e-01]
windy_storm:  86%|########6 | 2583/3000 [1:17:18<06:06,  1.14it/s, lr: 1.0e-04 loss: 2.259e-01]
windy_storm:  86%|########6 | 2583/3000 [1:17:19<06:06,  1.14it/s, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  86%|########6 | 2583/3000 [1:17:19<06:06,  1.14it/s, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  86%|########6 | 2584/3000 [1:17:19<05:58,  1.16it/s, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  86%|########6 | 2584/3000 [1:17:19<05:58,  1.16it/s, lr: 1.0e-04 loss: 3.996e-01]
windy_storm:  86%|########6 | 2584/3000 [1:17:20<05:58,  1.16it/s, lr: 1.0e-04 loss: 3.194e-01]
windy_storm:  86%|########6 | 2584/3000 [1:17:20<05:58,  1.16it/s, lr: 1.0e-04 loss: 3.194e-01]
windy_storm:  86%|########6 | 2585/3000 [1:17:20<05:45,  1.20it/s, lr: 1.0e-04 loss: 3.194e-01]
windy_storm:  86%|########6 | 2585/3000 [1:17:20<05:45,  1.20it/s, lr: 1.0e-04 loss: 3.194e-01]
windy_storm:  86%|########6 | 2585/3000 [1:17:20<05:45,  1.20it/s, lr: 1.0e-04 loss: 1.241e-01]
windy_storm:  86%|########6 | 2585/3000 [1:17:20<05:45,  1.20it/s, lr: 1.0e-04 loss: 1.241e-01]
windy_storm:  86%|########6 | 2586/3000 [1:17:20<05:43,  1.21it/s, lr: 1.0e-04 loss: 1.241e-01]
windy_storm:  86%|########6 | 2586/3000 [1:17:20<05:43,  1.21it/s, lr: 1.0e-04 loss: 1.241e-01]
windy_storm:  86%|########6 | 2586/3000 [1:17:23<05:43,  1.21it/s, lr: 1.0e-04 loss: 3.830e-01]
windy_storm:  86%|########6 | 2586/3000 [1:17:23<05:43,  1.21it/s, lr: 1.0e-04 loss: 3.830e-01]
windy_storm:  86%|########6 | 2587/3000 [1:17:23<09:58,  1.45s/it, lr: 1.0e-04 loss: 3.830e-01]
windy_storm:  86%|########6 | 2587/3000 [1:17:23<09:58,  1.45s/it, lr: 1.0e-04 loss: 3.830e-01]
windy_storm:  86%|########6 | 2587/3000 [1:17:25<09:58,  1.45s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  86%|########6 | 2587/3000 [1:17:25<09:58,  1.45s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  86%|########6 | 2588/3000 [1:17:25<10:15,  1.49s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  86%|########6 | 2588/3000 [1:17:25<10:15,  1.49s/it, lr: 1.0e-04 loss: 4.501e-01]
windy_storm:  86%|########6 | 2588/3000 [1:17:28<10:15,  1.49s/it, lr: 1.0e-04 loss: 6.377e-01]
windy_storm:  86%|########6 | 2588/3000 [1:17:28<10:15,  1.49s/it, lr: 1.0e-04 loss: 6.377e-01]
windy_storm:  86%|########6 | 2589/3000 [1:17:28<13:20,  1.95s/it, lr: 1.0e-04 loss: 6.377e-01]
windy_storm:  86%|########6 | 2589/3000 [1:17:28<13:20,  1.95s/it, lr: 1.0e-04 loss: 6.377e-01]
windy_storm:  86%|########6 | 2589/3000 [1:17:30<13:20,  1.95s/it, lr: 1.0e-04 loss: 4.144e-02]
windy_storm:  86%|########6 | 2589/3000 [1:17:30<13:20,  1.95s/it, lr: 1.0e-04 loss: 4.144e-02]
windy_storm:  86%|########6 | 2590/3000 [1:17:31<13:18,  1.95s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  86%|########6 | 2590/3000 [1:17:31<13:18,  1.95s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  86%|########6 | 2591/3000 [1:17:31<09:40,  1.42s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  86%|########6 | 2591/3000 [1:17:31<09:40,  1.42s/it, lr: 1.0e-04 loss: 1.325e-01]
windy_storm:  86%|########6 | 2591/3000 [1:17:34<09:40,  1.42s/it, lr: 1.0e-04 loss: 2.829e-01]
windy_storm:  86%|########6 | 2591/3000 [1:17:34<09:40,  1.42s/it, lr: 1.0e-04 loss: 2.829e-01]
windy_storm:  86%|########6 | 2592/3000 [1:17:34<12:13,  1.80s/it, lr: 1.0e-04 loss: 2.829e-01]
windy_storm:  86%|########6 | 2592/3000 [1:17:34<12:13,  1.80s/it, lr: 1.0e-04 loss: 2.829e-01]
windy_storm:  86%|########6 | 2592/3000 [1:17:36<12:13,  1.80s/it, lr: 1.0e-04 loss: 6.507e-01]
windy_storm:  86%|########6 | 2592/3000 [1:17:36<12:13,  1.80s/it, lr: 1.0e-04 loss: 6.507e-01]
windy_storm:  86%|########6 | 2593/3000 [1:17:36<11:48,  1.74s/it, lr: 1.0e-04 loss: 6.507e-01]
windy_storm:  86%|########6 | 2593/3000 [1:17:36<11:48,  1.74s/it, lr: 1.0e-04 loss: 6.507e-01]
windy_storm:  86%|########6 | 2593/3000 [1:17:37<11:48,  1.74s/it, lr: 1.0e-04 loss: 4.964e-01]
windy_storm:  86%|########6 | 2593/3000 [1:17:37<11:48,  1.74s/it, lr: 1.0e-04 loss: 4.964e-01]
windy_storm:  86%|########6 | 2594/3000 [1:17:37<11:34,  1.71s/it, lr: 1.0e-04 loss: 4.964e-01]
windy_storm:  86%|########6 | 2594/3000 [1:17:37<11:34,  1.71s/it, lr: 1.0e-04 loss: 4.964e-01]
windy_storm:  86%|########6 | 2594/3000 [1:17:38<11:34,  1.71s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:  86%|########6 | 2594/3000 [1:17:38<11:34,  1.71s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:  86%|########6 | 2595/3000 [1:17:38<09:45,  1.45s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:  86%|########6 | 2595/3000 [1:17:38<09:45,  1.45s/it, lr: 1.0e-04 loss: 6.491e-01]
windy_storm:  86%|########6 | 2595/3000 [1:17:41<09:45,  1.45s/it, lr: 1.0e-04 loss: 5.315e-01]
windy_storm:  86%|########6 | 2595/3000 [1:17:41<09:45,  1.45s/it, lr: 1.0e-04 loss: 5.315e-01]
windy_storm:  87%|########6 | 2596/3000 [1:17:41<12:48,  1.90s/it, lr: 1.0e-04 loss: 5.315e-01]
windy_storm:  87%|########6 | 2596/3000 [1:17:41<12:48,  1.90s/it, lr: 1.0e-04 loss: 5.315e-01]
windy_storm:  87%|########6 | 2596/3000 [1:17:44<12:48,  1.90s/it, lr: 1.0e-04 loss: 3.288e-01]
windy_storm:  87%|########6 | 2596/3000 [1:17:44<12:48,  1.90s/it, lr: 1.0e-04 loss: 3.288e-01]
windy_storm:  87%|########6 | 2597/3000 [1:17:44<15:15,  2.27s/it, lr: 1.0e-04 loss: 3.288e-01]
windy_storm:  87%|########6 | 2597/3000 [1:17:44<15:15,  2.27s/it, lr: 1.0e-04 loss: 3.288e-01]
windy_storm:  87%|########6 | 2597/3000 [1:17:46<15:15,  2.27s/it, lr: 1.0e-04 loss: 4.570e-01]
windy_storm:  87%|########6 | 2597/3000 [1:17:46<15:15,  2.27s/it, lr: 1.0e-04 loss: 4.570e-01]
windy_storm:  87%|########6 | 2598/3000 [1:17:46<13:54,  2.08s/it, lr: 1.0e-04 loss: 4.570e-01]
windy_storm:  87%|########6 | 2598/3000 [1:17:46<13:54,  2.08s/it, lr: 1.0e-04 loss: 4.570e-01]
windy_storm:  87%|########6 | 2598/3000 [1:17:47<13:54,  2.08s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  87%|########6 | 2598/3000 [1:17:47<13:54,  2.08s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  87%|########6 | 2599/3000 [1:17:47<11:18,  1.69s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  87%|########6 | 2599/3000 [1:17:47<11:18,  1.69s/it, lr: 1.0e-04 loss: 6.669e-02]
windy_storm:  87%|########6 | 2599/3000 [1:17:48<11:18,  1.69s/it, lr: 1.0e-04 loss: 6.179e-01]
windy_storm:  87%|########6 | 2599/3000 [1:17:48<11:18,  1.69s/it, lr: 1.0e-04 loss: 6.179e-01]
windy_storm:  87%|########6 | 2600/3000 [1:17:49<11:16,  1.69s/it, lr: 1.0e-04 loss: 3.553e-01]
windy_storm:  87%|########6 | 2600/3000 [1:17:49<11:16,  1.69s/it, lr: 1.0e-04 loss: 3.553e-01]
windy_storm:  87%|########6 | 2601/3000 [1:17:49<07:21,  1.11s/it, lr: 1.0e-04 loss: 3.553e-01]
windy_storm:  87%|########6 | 2601/3000 [1:17:49<07:21,  1.11s/it, lr: 1.0e-04 loss: 3.553e-01]
windy_storm:  87%|########6 | 2601/3000 [1:17:52<07:21,  1.11s/it, lr: 1.0e-04 loss: 3.366e-01]
windy_storm:  87%|########6 | 2601/3000 [1:17:52<07:21,  1.11s/it, lr: 1.0e-04 loss: 3.366e-01]
windy_storm:  87%|########6 | 2602/3000 [1:17:52<10:31,  1.59s/it, lr: 1.0e-04 loss: 3.366e-01]
windy_storm:  87%|########6 | 2602/3000 [1:17:52<10:31,  1.59s/it, lr: 1.0e-04 loss: 3.366e-01]
windy_storm:  87%|########6 | 2602/3000 [1:17:53<10:31,  1.59s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  87%|########6 | 2602/3000 [1:17:53<10:31,  1.59s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  87%|########6 | 2603/3000 [1:17:53<09:11,  1.39s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  87%|########6 | 2603/3000 [1:17:53<09:11,  1.39s/it, lr: 1.0e-04 loss: 6.581e-01]
windy_storm:  87%|########6 | 2603/3000 [1:17:54<09:11,  1.39s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  87%|########6 | 2603/3000 [1:17:54<09:11,  1.39s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  87%|########6 | 2604/3000 [1:17:54<08:09,  1.24s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  87%|########6 | 2604/3000 [1:17:54<08:09,  1.24s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  87%|########6 | 2604/3000 [1:17:57<08:09,  1.24s/it, lr: 1.0e-04 loss: 4.944e-01]
windy_storm:  87%|########6 | 2604/3000 [1:17:57<08:09,  1.24s/it, lr: 1.0e-04 loss: 4.944e-01]
windy_storm:  87%|########6 | 2605/3000 [1:17:57<11:26,  1.74s/it, lr: 1.0e-04 loss: 4.944e-01]
windy_storm:  87%|########6 | 2605/3000 [1:17:57<11:26,  1.74s/it, lr: 1.0e-04 loss: 4.944e-01]
windy_storm:  87%|########6 | 2605/3000 [1:18:00<11:26,  1.74s/it, lr: 1.0e-04 loss: 4.066e-01]
windy_storm:  87%|########6 | 2605/3000 [1:18:00<11:26,  1.74s/it, lr: 1.0e-04 loss: 4.066e-01]
windy_storm:  87%|########6 | 2606/3000 [1:18:00<13:49,  2.10s/it, lr: 1.0e-04 loss: 4.066e-01]
windy_storm:  87%|########6 | 2606/3000 [1:18:00<13:49,  2.10s/it, lr: 1.0e-04 loss: 4.066e-01]
windy_storm:  87%|########6 | 2606/3000 [1:18:01<13:49,  2.10s/it, lr: 1.0e-04 loss: 4.684e-01]
windy_storm:  87%|########6 | 2606/3000 [1:18:01<13:49,  2.10s/it, lr: 1.0e-04 loss: 4.684e-01]
windy_storm:  87%|########6 | 2607/3000 [1:18:01<12:46,  1.95s/it, lr: 1.0e-04 loss: 4.684e-01]
windy_storm:  87%|########6 | 2607/3000 [1:18:01<12:46,  1.95s/it, lr: 1.0e-04 loss: 4.684e-01]
windy_storm:  87%|########6 | 2607/3000 [1:18:03<12:46,  1.95s/it, lr: 1.0e-04 loss: 2.134e-01]
windy_storm:  87%|########6 | 2607/3000 [1:18:03<12:46,  1.95s/it, lr: 1.0e-04 loss: 2.134e-01]
windy_storm:  87%|########6 | 2608/3000 [1:18:03<12:02,  1.84s/it, lr: 1.0e-04 loss: 2.134e-01]
windy_storm:  87%|########6 | 2608/3000 [1:18:03<12:02,  1.84s/it, lr: 1.0e-04 loss: 2.134e-01]
windy_storm:  87%|########6 | 2608/3000 [1:18:05<12:02,  1.84s/it, lr: 1.0e-04 loss: 2.110e-01]
windy_storm:  87%|########6 | 2608/3000 [1:18:05<12:02,  1.84s/it, lr: 1.0e-04 loss: 2.110e-01]
windy_storm:  87%|########6 | 2609/3000 [1:18:05<11:27,  1.76s/it, lr: 1.0e-04 loss: 2.110e-01]
windy_storm:  87%|########6 | 2609/3000 [1:18:05<11:27,  1.76s/it, lr: 1.0e-04 loss: 2.110e-01]
windy_storm:  87%|########6 | 2609/3000 [1:18:06<11:27,  1.76s/it, lr: 1.0e-04 loss: 2.085e-01]
windy_storm:  87%|########6 | 2609/3000 [1:18:06<11:27,  1.76s/it, lr: 1.0e-04 loss: 2.085e-01]
windy_storm:  87%|########7 | 2610/3000 [1:18:07<11:26,  1.76s/it, lr: 1.0e-04 loss: 1.772e-01]
windy_storm:  87%|########7 | 2610/3000 [1:18:07<11:26,  1.76s/it, lr: 1.0e-04 loss: 1.772e-01]
windy_storm:  87%|########7 | 2611/3000 [1:18:07<07:20,  1.13s/it, lr: 1.0e-04 loss: 1.772e-01]
windy_storm:  87%|########7 | 2611/3000 [1:18:07<07:20,  1.13s/it, lr: 1.0e-04 loss: 1.772e-01]
windy_storm:  87%|########7 | 2611/3000 [1:18:08<07:20,  1.13s/it, lr: 1.0e-04 loss: 3.017e-01]
windy_storm:  87%|########7 | 2611/3000 [1:18:08<07:20,  1.13s/it, lr: 1.0e-04 loss: 3.017e-01]
windy_storm:  87%|########7 | 2612/3000 [1:18:08<06:50,  1.06s/it, lr: 1.0e-04 loss: 3.017e-01]
windy_storm:  87%|########7 | 2612/3000 [1:18:08<06:50,  1.06s/it, lr: 1.0e-04 loss: 3.017e-01]
windy_storm:  87%|########7 | 2612/3000 [1:18:11<06:50,  1.06s/it, lr: 1.0e-04 loss: 6.271e-01]
windy_storm:  87%|########7 | 2612/3000 [1:18:11<06:50,  1.06s/it, lr: 1.0e-04 loss: 6.271e-01]
windy_storm:  87%|########7 | 2613/3000 [1:18:11<10:06,  1.57s/it, lr: 1.0e-04 loss: 6.271e-01]
windy_storm:  87%|########7 | 2613/3000 [1:18:11<10:06,  1.57s/it, lr: 1.0e-04 loss: 6.271e-01]
windy_storm:  87%|########7 | 2613/3000 [1:18:12<10:06,  1.57s/it, lr: 1.0e-04 loss: 9.596e-02]
windy_storm:  87%|########7 | 2613/3000 [1:18:12<10:06,  1.57s/it, lr: 1.0e-04 loss: 9.596e-02]
windy_storm:  87%|########7 | 2614/3000 [1:18:12<08:40,  1.35s/it, lr: 1.0e-04 loss: 9.596e-02]
windy_storm:  87%|########7 | 2614/3000 [1:18:12<08:40,  1.35s/it, lr: 1.0e-04 loss: 9.596e-02]
windy_storm:  87%|########7 | 2614/3000 [1:18:13<08:40,  1.35s/it, lr: 1.0e-04 loss: 3.949e-01]
windy_storm:  87%|########7 | 2614/3000 [1:18:13<08:40,  1.35s/it, lr: 1.0e-04 loss: 3.949e-01]
windy_storm:  87%|########7 | 2615/3000 [1:18:13<09:05,  1.42s/it, lr: 1.0e-04 loss: 3.949e-01]
windy_storm:  87%|########7 | 2615/3000 [1:18:13<09:05,  1.42s/it, lr: 1.0e-04 loss: 3.949e-01]
windy_storm:  87%|########7 | 2615/3000 [1:18:15<09:05,  1.42s/it, lr: 1.0e-04 loss: 7.499e-02]
windy_storm:  87%|########7 | 2615/3000 [1:18:15<09:05,  1.42s/it, lr: 1.0e-04 loss: 7.499e-02]
windy_storm:  87%|########7 | 2616/3000 [1:18:15<09:19,  1.46s/it, lr: 1.0e-04 loss: 7.499e-02]
windy_storm:  87%|########7 | 2616/3000 [1:18:15<09:19,  1.46s/it, lr: 1.0e-04 loss: 7.499e-02]
windy_storm:  87%|########7 | 2616/3000 [1:18:18<09:19,  1.46s/it, lr: 1.0e-04 loss: 6.505e-01]
windy_storm:  87%|########7 | 2616/3000 [1:18:18<09:19,  1.46s/it, lr: 1.0e-04 loss: 6.505e-01]
windy_storm:  87%|########7 | 2617/3000 [1:18:18<12:10,  1.91s/it, lr: 1.0e-04 loss: 6.505e-01]
windy_storm:  87%|########7 | 2617/3000 [1:18:18<12:10,  1.91s/it, lr: 1.0e-04 loss: 6.505e-01]
windy_storm:  87%|########7 | 2617/3000 [1:18:21<12:10,  1.91s/it, lr: 1.0e-04 loss: 4.302e-01]
windy_storm:  87%|########7 | 2617/3000 [1:18:21<12:10,  1.91s/it, lr: 1.0e-04 loss: 4.302e-01]
windy_storm:  87%|########7 | 2618/3000 [1:18:21<14:11,  2.23s/it, lr: 1.0e-04 loss: 4.302e-01]
windy_storm:  87%|########7 | 2618/3000 [1:18:21<14:11,  2.23s/it, lr: 1.0e-04 loss: 4.302e-01]
windy_storm:  87%|########7 | 2618/3000 [1:18:23<14:11,  2.23s/it, lr: 1.0e-04 loss: 2.212e-01]
windy_storm:  87%|########7 | 2618/3000 [1:18:23<14:11,  2.23s/it, lr: 1.0e-04 loss: 2.212e-01]
windy_storm:  87%|########7 | 2619/3000 [1:18:23<12:58,  2.04s/it, lr: 1.0e-04 loss: 2.212e-01]
windy_storm:  87%|########7 | 2619/3000 [1:18:23<12:58,  2.04s/it, lr: 1.0e-04 loss: 2.212e-01]
windy_storm:  87%|########7 | 2619/3000 [1:18:23<12:58,  2.04s/it, lr: 1.0e-04 loss: 1.330e-01]
windy_storm:  87%|########7 | 2619/3000 [1:18:23<12:58,  2.04s/it, lr: 1.0e-04 loss: 1.330e-01]
windy_storm:  87%|########7 | 2620/3000 [1:18:26<12:55,  2.04s/it, lr: 1.0e-04 loss: 3.086e-01]
windy_storm:  87%|########7 | 2620/3000 [1:18:26<12:55,  2.04s/it, lr: 1.0e-04 loss: 3.086e-01]
windy_storm:  87%|########7 | 2621/3000 [1:18:26<11:15,  1.78s/it, lr: 1.0e-04 loss: 3.086e-01]
windy_storm:  87%|########7 | 2621/3000 [1:18:26<11:15,  1.78s/it, lr: 1.0e-04 loss: 3.086e-01]
windy_storm:  87%|########7 | 2621/3000 [1:18:27<11:15,  1.78s/it, lr: 1.0e-04 loss: 2.935e-01]
windy_storm:  87%|########7 | 2621/3000 [1:18:27<11:15,  1.78s/it, lr: 1.0e-04 loss: 2.935e-01]
windy_storm:  87%|########7 | 2622/3000 [1:18:27<09:37,  1.53s/it, lr: 1.0e-04 loss: 2.935e-01]
windy_storm:  87%|########7 | 2622/3000 [1:18:27<09:37,  1.53s/it, lr: 1.0e-04 loss: 2.935e-01]
windy_storm:  87%|########7 | 2622/3000 [1:18:30<09:37,  1.53s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  87%|########7 | 2622/3000 [1:18:30<09:37,  1.53s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  87%|########7 | 2623/3000 [1:18:30<12:11,  1.94s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  87%|########7 | 2623/3000 [1:18:30<12:11,  1.94s/it, lr: 1.0e-04 loss: 4.214e-01]
windy_storm:  87%|########7 | 2623/3000 [1:18:33<12:11,  1.94s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:  87%|########7 | 2623/3000 [1:18:33<12:11,  1.94s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:  87%|########7 | 2624/3000 [1:18:33<13:50,  2.21s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:  87%|########7 | 2624/3000 [1:18:33<13:50,  2.21s/it, lr: 1.0e-04 loss: 1.923e-01]
windy_storm:  87%|########7 | 2624/3000 [1:18:36<13:50,  2.21s/it, lr: 1.0e-04 loss: 2.689e-01]
windy_storm:  87%|########7 | 2624/3000 [1:18:36<13:50,  2.21s/it, lr: 1.0e-04 loss: 2.689e-01]
windy_storm:  88%|########7 | 2625/3000 [1:18:36<15:12,  2.43s/it, lr: 1.0e-04 loss: 2.689e-01]
windy_storm:  88%|########7 | 2625/3000 [1:18:36<15:12,  2.43s/it, lr: 1.0e-04 loss: 2.689e-01]
windy_storm:  88%|########7 | 2625/3000 [1:18:38<15:12,  2.43s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  88%|########7 | 2625/3000 [1:18:38<15:12,  2.43s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  88%|########7 | 2626/3000 [1:18:38<13:39,  2.19s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  88%|########7 | 2626/3000 [1:18:38<13:39,  2.19s/it, lr: 1.0e-04 loss: 6.054e-01]
windy_storm:  88%|########7 | 2626/3000 [1:18:39<13:39,  2.19s/it, lr: 1.0e-04 loss: 4.547e-01]
windy_storm:  88%|########7 | 2626/3000 [1:18:39<13:39,  2.19s/it, lr: 1.0e-04 loss: 4.547e-01]
windy_storm:  88%|########7 | 2627/3000 [1:18:39<12:31,  2.01s/it, lr: 1.0e-04 loss: 4.547e-01]
windy_storm:  88%|########7 | 2627/3000 [1:18:39<12:31,  2.01s/it, lr: 1.0e-04 loss: 4.547e-01]
windy_storm:  88%|########7 | 2627/3000 [1:18:42<12:31,  2.01s/it, lr: 1.0e-04 loss: 1.349e-01]
windy_storm:  88%|########7 | 2627/3000 [1:18:42<12:31,  2.01s/it, lr: 1.0e-04 loss: 1.349e-01]
windy_storm:  88%|########7 | 2628/3000 [1:18:42<14:17,  2.31s/it, lr: 1.0e-04 loss: 1.349e-01]
windy_storm:  88%|########7 | 2628/3000 [1:18:42<14:17,  2.31s/it, lr: 1.0e-04 loss: 1.349e-01]
windy_storm:  88%|########7 | 2628/3000 [1:18:43<14:17,  2.31s/it, lr: 1.0e-04 loss: 4.921e-01]
windy_storm:  88%|########7 | 2628/3000 [1:18:43<14:17,  2.31s/it, lr: 1.0e-04 loss: 4.921e-01]
windy_storm:  88%|########7 | 2629/3000 [1:18:43<11:32,  1.87s/it, lr: 1.0e-04 loss: 4.921e-01]
windy_storm:  88%|########7 | 2629/3000 [1:18:43<11:32,  1.87s/it, lr: 1.0e-04 loss: 4.921e-01]
windy_storm:  88%|########7 | 2629/3000 [1:18:46<11:32,  1.87s/it, lr: 1.0e-04 loss: 2.833e-01]
windy_storm:  88%|########7 | 2629/3000 [1:18:46<11:32,  1.87s/it, lr: 1.0e-04 loss: 2.833e-01]
windy_storm:  88%|########7 | 2630/3000 [1:18:48<11:30,  1.87s/it, lr: 1.0e-04 loss: 6.902e-02]
windy_storm:  88%|########7 | 2630/3000 [1:18:48<11:30,  1.87s/it, lr: 1.0e-04 loss: 6.902e-02]
windy_storm:  88%|########7 | 2631/3000 [1:18:48<08:24,  1.37s/it, lr: 1.0e-04 loss: 6.902e-02]
windy_storm:  88%|########7 | 2631/3000 [1:18:48<08:24,  1.37s/it, lr: 1.0e-04 loss: 6.902e-02]
windy_storm:  88%|########7 | 2631/3000 [1:18:50<08:24,  1.37s/it, lr: 1.0e-04 loss: 4.521e-01]
windy_storm:  88%|########7 | 2631/3000 [1:18:50<08:24,  1.37s/it, lr: 1.0e-04 loss: 4.521e-01]
windy_storm:  88%|########7 | 2632/3000 [1:18:51<10:45,  1.75s/it, lr: 1.0e-04 loss: 4.521e-01]
windy_storm:  88%|########7 | 2632/3000 [1:18:51<10:45,  1.75s/it, lr: 1.0e-04 loss: 4.521e-01]
windy_storm:  88%|########7 | 2632/3000 [1:18:54<10:45,  1.75s/it, lr: 1.0e-04 loss: 2.141e-01]
windy_storm:  88%|########7 | 2632/3000 [1:18:54<10:45,  1.75s/it, lr: 1.0e-04 loss: 2.141e-01]
windy_storm:  88%|########7 | 2633/3000 [1:18:54<12:44,  2.08s/it, lr: 1.0e-04 loss: 2.141e-01]
windy_storm:  88%|########7 | 2633/3000 [1:18:54<12:44,  2.08s/it, lr: 1.0e-04 loss: 2.141e-01]
windy_storm:  88%|########7 | 2633/3000 [1:18:56<12:44,  2.08s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  88%|########7 | 2633/3000 [1:18:56<12:44,  2.08s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  88%|########7 | 2634/3000 [1:18:57<14:11,  2.33s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  88%|########7 | 2634/3000 [1:18:57<14:11,  2.33s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  88%|########7 | 2634/3000 [1:19:00<14:11,  2.33s/it, lr: 1.0e-04 loss: 2.204e-01]
windy_storm:  88%|########7 | 2634/3000 [1:19:00<14:11,  2.33s/it, lr: 1.0e-04 loss: 2.204e-01]
windy_storm:  88%|########7 | 2635/3000 [1:19:00<15:18,  2.52s/it, lr: 1.0e-04 loss: 2.204e-01]
windy_storm:  88%|########7 | 2635/3000 [1:19:00<15:18,  2.52s/it, lr: 1.0e-04 loss: 2.204e-01]
windy_storm:  88%|########7 | 2635/3000 [1:19:01<15:18,  2.52s/it, lr: 1.0e-04 loss: 5.919e-01]
windy_storm:  88%|########7 | 2635/3000 [1:19:01<15:18,  2.52s/it, lr: 1.0e-04 loss: 5.919e-01]
windy_storm:  88%|########7 | 2636/3000 [1:19:01<13:45,  2.27s/it, lr: 1.0e-04 loss: 5.919e-01]
windy_storm:  88%|########7 | 2636/3000 [1:19:01<13:45,  2.27s/it, lr: 1.0e-04 loss: 5.919e-01]
windy_storm:  88%|########7 | 2636/3000 [1:19:03<13:45,  2.27s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  88%|########7 | 2636/3000 [1:19:03<13:45,  2.27s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  88%|########7 | 2637/3000 [1:19:03<12:33,  2.08s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  88%|########7 | 2637/3000 [1:19:03<12:33,  2.08s/it, lr: 1.0e-04 loss: 5.296e-01]
windy_storm:  88%|########7 | 2637/3000 [1:19:05<12:33,  2.08s/it, lr: 1.0e-04 loss: 1.401e-01]
windy_storm:  88%|########7 | 2637/3000 [1:19:05<12:33,  2.08s/it, lr: 1.0e-04 loss: 1.401e-01]
windy_storm:  88%|########7 | 2638/3000 [1:19:05<11:56,  1.98s/it, lr: 1.0e-04 loss: 1.401e-01]
windy_storm:  88%|########7 | 2638/3000 [1:19:05<11:56,  1.98s/it, lr: 1.0e-04 loss: 1.401e-01]
windy_storm:  88%|########7 | 2638/3000 [1:19:05<11:56,  1.98s/it, lr: 1.0e-04 loss: 6.619e-01]
windy_storm:  88%|########7 | 2638/3000 [1:19:05<11:56,  1.98s/it, lr: 1.0e-04 loss: 6.619e-01]
windy_storm:  88%|########7 | 2639/3000 [1:19:05<09:45,  1.62s/it, lr: 1.0e-04 loss: 6.619e-01]
windy_storm:  88%|########7 | 2639/3000 [1:19:05<09:45,  1.62s/it, lr: 1.0e-04 loss: 6.619e-01]
windy_storm:  88%|########7 | 2639/3000 [1:19:07<09:45,  1.62s/it, lr: 1.0e-04 loss: 5.586e-01]
windy_storm:  88%|########7 | 2639/3000 [1:19:07<09:45,  1.62s/it, lr: 1.0e-04 loss: 5.586e-01]
windy_storm:  88%|########8 | 2640/3000 [1:19:08<09:43,  1.62s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  88%|########8 | 2640/3000 [1:19:08<09:43,  1.62s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  88%|########8 | 2641/3000 [1:19:08<06:18,  1.05s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  88%|########8 | 2641/3000 [1:19:08<06:18,  1.05s/it, lr: 1.0e-04 loss: 2.060e-01]
windy_storm:  88%|########8 | 2641/3000 [1:19:11<06:18,  1.05s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  88%|########8 | 2641/3000 [1:19:11<06:18,  1.05s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  88%|########8 | 2642/3000 [1:19:11<09:07,  1.53s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  88%|########8 | 2642/3000 [1:19:11<09:07,  1.53s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  88%|########8 | 2642/3000 [1:19:14<09:07,  1.53s/it, lr: 1.0e-04 loss: 6.285e-01]
windy_storm:  88%|########8 | 2642/3000 [1:19:14<09:07,  1.53s/it, lr: 1.0e-04 loss: 6.285e-01]
windy_storm:  88%|########8 | 2643/3000 [1:19:14<11:19,  1.90s/it, lr: 1.0e-04 loss: 6.285e-01]
windy_storm:  88%|########8 | 2643/3000 [1:19:14<11:19,  1.90s/it, lr: 1.0e-04 loss: 6.285e-01]
windy_storm:  88%|########8 | 2643/3000 [1:19:15<11:19,  1.90s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  88%|########8 | 2643/3000 [1:19:15<11:19,  1.90s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  88%|########8 | 2644/3000 [1:19:15<09:34,  1.61s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  88%|########8 | 2644/3000 [1:19:15<09:34,  1.61s/it, lr: 1.0e-04 loss: 6.064e-01]
windy_storm:  88%|########8 | 2644/3000 [1:19:18<09:34,  1.61s/it, lr: 1.0e-04 loss: 2.421e-01]
windy_storm:  88%|########8 | 2644/3000 [1:19:18<09:34,  1.61s/it, lr: 1.0e-04 loss: 2.421e-01]
windy_storm:  88%|########8 | 2645/3000 [1:19:18<11:53,  2.01s/it, lr: 1.0e-04 loss: 2.421e-01]
windy_storm:  88%|########8 | 2645/3000 [1:19:18<11:53,  2.01s/it, lr: 1.0e-04 loss: 2.421e-01]
windy_storm:  88%|########8 | 2645/3000 [1:19:19<11:53,  2.01s/it, lr: 1.0e-04 loss: 3.360e-01]
windy_storm:  88%|########8 | 2645/3000 [1:19:19<11:53,  2.01s/it, lr: 1.0e-04 loss: 3.360e-01]
windy_storm:  88%|########8 | 2646/3000 [1:19:19<09:52,  1.67s/it, lr: 1.0e-04 loss: 3.360e-01]
windy_storm:  88%|########8 | 2646/3000 [1:19:19<09:52,  1.67s/it, lr: 1.0e-04 loss: 3.360e-01]
windy_storm:  88%|########8 | 2646/3000 [1:19:20<09:52,  1.67s/it, lr: 1.0e-04 loss: 3.208e-01]
windy_storm:  88%|########8 | 2646/3000 [1:19:20<09:52,  1.67s/it, lr: 1.0e-04 loss: 3.208e-01]
windy_storm:  88%|########8 | 2647/3000 [1:19:20<09:37,  1.64s/it, lr: 1.0e-04 loss: 3.208e-01]
windy_storm:  88%|########8 | 2647/3000 [1:19:20<09:37,  1.64s/it, lr: 1.0e-04 loss: 3.208e-01]
windy_storm:  88%|########8 | 2647/3000 [1:19:22<09:37,  1.64s/it, lr: 1.0e-04 loss: 8.626e-02]
windy_storm:  88%|########8 | 2647/3000 [1:19:22<09:37,  1.64s/it, lr: 1.0e-04 loss: 8.626e-02]
windy_storm:  88%|########8 | 2648/3000 [1:19:22<09:31,  1.62s/it, lr: 1.0e-04 loss: 8.626e-02]
windy_storm:  88%|########8 | 2648/3000 [1:19:22<09:31,  1.62s/it, lr: 1.0e-04 loss: 8.626e-02]
windy_storm:  88%|########8 | 2648/3000 [1:19:23<09:31,  1.62s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  88%|########8 | 2648/3000 [1:19:23<09:31,  1.62s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  88%|########8 | 2649/3000 [1:19:23<08:10,  1.40s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  88%|########8 | 2649/3000 [1:19:23<08:10,  1.40s/it, lr: 1.0e-04 loss: 3.008e-01]
windy_storm:  88%|########8 | 2649/3000 [1:19:24<08:10,  1.40s/it, lr: 1.0e-04 loss: 3.200e-01]
windy_storm:  88%|########8 | 2649/3000 [1:19:24<08:10,  1.40s/it, lr: 1.0e-04 loss: 3.200e-01]
windy_storm:  88%|########8 | 2650/3000 [1:19:27<08:08,  1.40s/it, lr: 1.0e-04 loss: 5.325e-01]
windy_storm:  88%|########8 | 2650/3000 [1:19:27<08:08,  1.40s/it, lr: 1.0e-04 loss: 5.325e-01]
windy_storm:  88%|########8 | 2651/3000 [1:19:27<08:27,  1.45s/it, lr: 1.0e-04 loss: 5.325e-01]
windy_storm:  88%|########8 | 2651/3000 [1:19:27<08:27,  1.45s/it, lr: 1.0e-04 loss: 5.325e-01]
windy_storm:  88%|########8 | 2651/3000 [1:19:30<08:27,  1.45s/it, lr: 1.0e-04 loss: 5.985e-01]
windy_storm:  88%|########8 | 2651/3000 [1:19:30<08:27,  1.45s/it, lr: 1.0e-04 loss: 5.985e-01]
windy_storm:  88%|########8 | 2652/3000 [1:19:31<10:51,  1.87s/it, lr: 1.0e-04 loss: 5.985e-01]
windy_storm:  88%|########8 | 2652/3000 [1:19:31<10:51,  1.87s/it, lr: 1.0e-04 loss: 5.985e-01]
windy_storm:  88%|########8 | 2652/3000 [1:19:31<10:51,  1.87s/it, lr: 1.0e-04 loss: 5.206e-01]
windy_storm:  88%|########8 | 2652/3000 [1:19:31<10:51,  1.87s/it, lr: 1.0e-04 loss: 5.206e-01]
windy_storm:  88%|########8 | 2653/3000 [1:19:31<09:09,  1.58s/it, lr: 1.0e-04 loss: 5.206e-01]
windy_storm:  88%|########8 | 2653/3000 [1:19:31<09:09,  1.58s/it, lr: 1.0e-04 loss: 5.206e-01]
windy_storm:  88%|########8 | 2653/3000 [1:19:33<09:09,  1.58s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  88%|########8 | 2653/3000 [1:19:33<09:09,  1.58s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  88%|########8 | 2654/3000 [1:19:33<09:11,  1.59s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  88%|########8 | 2654/3000 [1:19:33<09:11,  1.59s/it, lr: 1.0e-04 loss: 5.465e-01]
windy_storm:  88%|########8 | 2654/3000 [1:19:34<09:11,  1.59s/it, lr: 1.0e-04 loss: 3.649e-02]
windy_storm:  88%|########8 | 2654/3000 [1:19:34<09:11,  1.59s/it, lr: 1.0e-04 loss: 3.649e-02]
windy_storm:  88%|########8 | 2655/3000 [1:19:34<09:10,  1.60s/it, lr: 1.0e-04 loss: 3.649e-02]
windy_storm:  88%|########8 | 2655/3000 [1:19:34<09:10,  1.60s/it, lr: 1.0e-04 loss: 3.649e-02]
windy_storm:  88%|########8 | 2655/3000 [1:19:35<09:10,  1.60s/it, lr: 1.0e-04 loss: 6.780e-01]
windy_storm:  88%|########8 | 2655/3000 [1:19:35<09:10,  1.60s/it, lr: 1.0e-04 loss: 6.780e-01]
windy_storm:  89%|########8 | 2656/3000 [1:19:35<07:53,  1.38s/it, lr: 1.0e-04 loss: 6.780e-01]
windy_storm:  89%|########8 | 2656/3000 [1:19:35<07:53,  1.38s/it, lr: 1.0e-04 loss: 6.780e-01]
windy_storm:  89%|########8 | 2656/3000 [1:19:37<07:53,  1.38s/it, lr: 1.0e-04 loss: 5.074e-01]
windy_storm:  89%|########8 | 2656/3000 [1:19:37<07:53,  1.38s/it, lr: 1.0e-04 loss: 5.074e-01]
windy_storm:  89%|########8 | 2657/3000 [1:19:37<08:15,  1.44s/it, lr: 1.0e-04 loss: 5.074e-01]
windy_storm:  89%|########8 | 2657/3000 [1:19:37<08:15,  1.44s/it, lr: 1.0e-04 loss: 5.074e-01]
windy_storm:  89%|########8 | 2657/3000 [1:19:38<08:15,  1.44s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  89%|########8 | 2657/3000 [1:19:38<08:15,  1.44s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  89%|########8 | 2658/3000 [1:19:39<08:26,  1.48s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  89%|########8 | 2658/3000 [1:19:39<08:26,  1.48s/it, lr: 1.0e-04 loss: 1.504e-01]
windy_storm:  89%|########8 | 2658/3000 [1:19:40<08:26,  1.48s/it, lr: 1.0e-04 loss: 5.693e-01]
windy_storm:  89%|########8 | 2658/3000 [1:19:40<08:26,  1.48s/it, lr: 1.0e-04 loss: 5.693e-01]
windy_storm:  89%|########8 | 2659/3000 [1:19:40<08:35,  1.51s/it, lr: 1.0e-04 loss: 5.693e-01]
windy_storm:  89%|########8 | 2659/3000 [1:19:40<08:35,  1.51s/it, lr: 1.0e-04 loss: 5.693e-01]
windy_storm:  89%|########8 | 2659/3000 [1:19:41<08:35,  1.51s/it, lr: 1.0e-04 loss: 6.076e-02]
windy_storm:  89%|########8 | 2659/3000 [1:19:41<08:35,  1.51s/it, lr: 1.0e-04 loss: 6.076e-02]
windy_storm:  89%|########8 | 2660/3000 [1:19:44<08:33,  1.51s/it, lr: 1.0e-04 loss: 5.973e-01]
windy_storm:  89%|########8 | 2660/3000 [1:19:44<08:33,  1.51s/it, lr: 1.0e-04 loss: 5.973e-01]
windy_storm:  89%|########8 | 2661/3000 [1:19:44<08:23,  1.48s/it, lr: 1.0e-04 loss: 5.973e-01]
windy_storm:  89%|########8 | 2661/3000 [1:19:44<08:23,  1.48s/it, lr: 1.0e-04 loss: 5.973e-01]
windy_storm:  89%|########8 | 2661/3000 [1:19:45<08:23,  1.48s/it, lr: 1.0e-04 loss: 5.155e-01]
windy_storm:  89%|########8 | 2661/3000 [1:19:45<08:23,  1.48s/it, lr: 1.0e-04 loss: 5.155e-01]
windy_storm:  89%|########8 | 2662/3000 [1:19:45<08:27,  1.50s/it, lr: 1.0e-04 loss: 5.155e-01]
windy_storm:  89%|########8 | 2662/3000 [1:19:45<08:27,  1.50s/it, lr: 1.0e-04 loss: 5.155e-01]
windy_storm:  89%|########8 | 2662/3000 [1:19:48<08:27,  1.50s/it, lr: 1.0e-04 loss: 3.986e-01]
windy_storm:  89%|########8 | 2662/3000 [1:19:48<08:27,  1.50s/it, lr: 1.0e-04 loss: 3.986e-01]
windy_storm:  89%|########8 | 2663/3000 [1:19:48<10:30,  1.87s/it, lr: 1.0e-04 loss: 3.986e-01]
windy_storm:  89%|########8 | 2663/3000 [1:19:48<10:30,  1.87s/it, lr: 1.0e-04 loss: 3.986e-01]
windy_storm:  89%|########8 | 2663/3000 [1:19:49<10:30,  1.87s/it, lr: 1.0e-04 loss: 3.167e-01]
windy_storm:  89%|########8 | 2663/3000 [1:19:49<10:30,  1.87s/it, lr: 1.0e-04 loss: 3.167e-01]
windy_storm:  89%|########8 | 2664/3000 [1:19:49<08:48,  1.57s/it, lr: 1.0e-04 loss: 3.167e-01]
windy_storm:  89%|########8 | 2664/3000 [1:19:49<08:48,  1.57s/it, lr: 1.0e-04 loss: 3.167e-01]
windy_storm:  89%|########8 | 2664/3000 [1:19:52<08:48,  1.57s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  89%|########8 | 2664/3000 [1:19:52<08:48,  1.57s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  89%|########8 | 2665/3000 [1:19:52<11:15,  2.02s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  89%|########8 | 2665/3000 [1:19:52<11:15,  2.02s/it, lr: 1.0e-04 loss: 6.065e-01]
windy_storm:  89%|########8 | 2665/3000 [1:19:55<11:15,  2.02s/it, lr: 1.0e-04 loss: 4.235e-02]
windy_storm:  89%|########8 | 2665/3000 [1:19:55<11:15,  2.02s/it, lr: 1.0e-04 loss: 4.235e-02]
windy_storm:  89%|########8 | 2666/3000 [1:19:55<12:38,  2.27s/it, lr: 1.0e-04 loss: 4.235e-02]
windy_storm:  89%|########8 | 2666/3000 [1:19:55<12:38,  2.27s/it, lr: 1.0e-04 loss: 4.235e-02]
windy_storm:  89%|########8 | 2666/3000 [1:19:58<12:38,  2.27s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  89%|########8 | 2666/3000 [1:19:58<12:38,  2.27s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  89%|########8 | 2667/3000 [1:19:58<13:51,  2.50s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  89%|########8 | 2667/3000 [1:19:58<13:51,  2.50s/it, lr: 1.0e-04 loss: 6.731e-01]
windy_storm:  89%|########8 | 2667/3000 [1:20:01<13:51,  2.50s/it, lr: 1.0e-04 loss: 7.260e-02]
windy_storm:  89%|########8 | 2667/3000 [1:20:01<13:51,  2.50s/it, lr: 1.0e-04 loss: 7.260e-02]
windy_storm:  89%|########8 | 2668/3000 [1:20:01<14:32,  2.63s/it, lr: 1.0e-04 loss: 7.260e-02]
windy_storm:  89%|########8 | 2668/3000 [1:20:01<14:32,  2.63s/it, lr: 1.0e-04 loss: 7.260e-02]
windy_storm:  89%|########8 | 2668/3000 [1:20:03<14:32,  2.63s/it, lr: 1.0e-04 loss: 1.426e-01]
windy_storm:  89%|########8 | 2668/3000 [1:20:03<14:32,  2.63s/it, lr: 1.0e-04 loss: 1.426e-01]
windy_storm:  89%|########8 | 2669/3000 [1:20:03<12:44,  2.31s/it, lr: 1.0e-04 loss: 1.426e-01]
windy_storm:  89%|########8 | 2669/3000 [1:20:03<12:44,  2.31s/it, lr: 1.0e-04 loss: 1.426e-01]
windy_storm:  89%|########8 | 2669/3000 [1:20:04<12:44,  2.31s/it, lr: 1.0e-04 loss: 5.855e-01]
windy_storm:  89%|########8 | 2669/3000 [1:20:04<12:44,  2.31s/it, lr: 1.0e-04 loss: 5.855e-01]
windy_storm:  89%|########9 | 2670/3000 [1:20:06<12:42,  2.31s/it, lr: 1.0e-04 loss: 6.125e-01]
windy_storm:  89%|########9 | 2670/3000 [1:20:06<12:42,  2.31s/it, lr: 1.0e-04 loss: 6.125e-01]
windy_storm:  89%|########9 | 2671/3000 [1:20:06<10:33,  1.92s/it, lr: 1.0e-04 loss: 6.125e-01]
windy_storm:  89%|########9 | 2671/3000 [1:20:06<10:33,  1.92s/it, lr: 1.0e-04 loss: 6.125e-01]
windy_storm:  89%|########9 | 2671/3000 [1:20:08<10:33,  1.92s/it, lr: 1.0e-04 loss: 6.912e-01]
windy_storm:  89%|########9 | 2671/3000 [1:20:08<10:33,  1.92s/it, lr: 1.0e-04 loss: 6.912e-01]
windy_storm:  89%|########9 | 2672/3000 [1:20:08<10:01,  1.83s/it, lr: 1.0e-04 loss: 6.912e-01]
windy_storm:  89%|########9 | 2672/3000 [1:20:08<10:01,  1.83s/it, lr: 1.0e-04 loss: 6.912e-01]
windy_storm:  89%|########9 | 2672/3000 [1:20:11<10:01,  1.83s/it, lr: 1.0e-04 loss: 5.608e-01]
windy_storm:  89%|########9 | 2672/3000 [1:20:11<10:01,  1.83s/it, lr: 1.0e-04 loss: 5.608e-01]
windy_storm:  89%|########9 | 2673/3000 [1:20:11<11:37,  2.13s/it, lr: 1.0e-04 loss: 5.608e-01]
windy_storm:  89%|########9 | 2673/3000 [1:20:11<11:37,  2.13s/it, lr: 1.0e-04 loss: 5.608e-01]
windy_storm:  89%|########9 | 2673/3000 [1:20:13<11:37,  2.13s/it, lr: 1.0e-04 loss: 2.653e-01]
windy_storm:  89%|########9 | 2673/3000 [1:20:13<11:37,  2.13s/it, lr: 1.0e-04 loss: 2.653e-01]
windy_storm:  89%|########9 | 2674/3000 [1:20:13<10:43,  1.97s/it, lr: 1.0e-04 loss: 2.653e-01]
windy_storm:  89%|########9 | 2674/3000 [1:20:13<10:43,  1.97s/it, lr: 1.0e-04 loss: 2.653e-01]
windy_storm:  89%|########9 | 2674/3000 [1:20:15<10:43,  1.97s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  89%|########9 | 2674/3000 [1:20:15<10:43,  1.97s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  89%|########9 | 2675/3000 [1:20:15<12:06,  2.24s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  89%|########9 | 2675/3000 [1:20:15<12:06,  2.24s/it, lr: 1.0e-04 loss: 3.526e-01]
windy_storm:  89%|########9 | 2675/3000 [1:20:16<12:06,  2.24s/it, lr: 1.0e-04 loss: 3.985e-01]
windy_storm:  89%|########9 | 2675/3000 [1:20:16<12:06,  2.24s/it, lr: 1.0e-04 loss: 3.985e-01]
windy_storm:  89%|########9 | 2676/3000 [1:20:16<09:47,  1.81s/it, lr: 1.0e-04 loss: 3.985e-01]
windy_storm:  89%|########9 | 2676/3000 [1:20:16<09:47,  1.81s/it, lr: 1.0e-04 loss: 3.985e-01]
windy_storm:  89%|########9 | 2676/3000 [1:20:18<09:47,  1.81s/it, lr: 1.0e-04 loss: 1.762e-01]
windy_storm:  89%|########9 | 2676/3000 [1:20:18<09:47,  1.81s/it, lr: 1.0e-04 loss: 1.762e-01]
windy_storm:  89%|########9 | 2677/3000 [1:20:18<09:22,  1.74s/it, lr: 1.0e-04 loss: 1.762e-01]
windy_storm:  89%|########9 | 2677/3000 [1:20:18<09:22,  1.74s/it, lr: 1.0e-04 loss: 1.762e-01]
windy_storm:  89%|########9 | 2677/3000 [1:20:20<09:22,  1.74s/it, lr: 1.0e-04 loss: 5.659e-01]
windy_storm:  89%|########9 | 2677/3000 [1:20:20<09:22,  1.74s/it, lr: 1.0e-04 loss: 5.659e-01]
windy_storm:  89%|########9 | 2678/3000 [1:20:20<09:23,  1.75s/it, lr: 1.0e-04 loss: 5.659e-01]
windy_storm:  89%|########9 | 2678/3000 [1:20:20<09:23,  1.75s/it, lr: 1.0e-04 loss: 5.659e-01]
windy_storm:  89%|########9 | 2678/3000 [1:20:20<09:23,  1.75s/it, lr: 1.0e-04 loss: 3.057e-01]
windy_storm:  89%|########9 | 2678/3000 [1:20:20<09:23,  1.75s/it, lr: 1.0e-04 loss: 3.057e-01]
windy_storm:  89%|########9 | 2679/3000 [1:20:20<07:53,  1.48s/it, lr: 1.0e-04 loss: 3.057e-01]
windy_storm:  89%|########9 | 2679/3000 [1:20:20<07:53,  1.48s/it, lr: 1.0e-04 loss: 3.057e-01]
windy_storm:  89%|########9 | 2679/3000 [1:20:22<07:53,  1.48s/it, lr: 1.0e-04 loss: 6.462e-02]
windy_storm:  89%|########9 | 2679/3000 [1:20:22<07:53,  1.48s/it, lr: 1.0e-04 loss: 6.462e-02]
windy_storm:  89%|########9 | 2680/3000 [1:20:23<07:52,  1.48s/it, lr: 1.0e-04 loss: 4.942e-02]
windy_storm:  89%|########9 | 2680/3000 [1:20:23<07:52,  1.48s/it, lr: 1.0e-04 loss: 4.942e-02]
windy_storm:  89%|########9 | 2681/3000 [1:20:23<05:11,  1.03it/s, lr: 1.0e-04 loss: 4.942e-02]
windy_storm:  89%|########9 | 2681/3000 [1:20:23<05:11,  1.03it/s, lr: 1.0e-04 loss: 4.942e-02]
windy_storm:  89%|########9 | 2681/3000 [1:20:26<05:11,  1.03it/s, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:  89%|########9 | 2681/3000 [1:20:26<05:11,  1.03it/s, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:  89%|########9 | 2682/3000 [1:20:26<07:47,  1.47s/it, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:  89%|########9 | 2682/3000 [1:20:26<07:47,  1.47s/it, lr: 1.0e-04 loss: 5.035e-01]
windy_storm:  89%|########9 | 2682/3000 [1:20:26<07:47,  1.47s/it, lr: 1.0e-04 loss: 4.082e-01]
windy_storm:  89%|########9 | 2682/3000 [1:20:26<07:47,  1.47s/it, lr: 1.0e-04 loss: 4.082e-01]
windy_storm:  89%|########9 | 2683/3000 [1:20:26<06:47,  1.29s/it, lr: 1.0e-04 loss: 4.082e-01]
windy_storm:  89%|########9 | 2683/3000 [1:20:26<06:47,  1.29s/it, lr: 1.0e-04 loss: 4.082e-01]
windy_storm:  89%|########9 | 2683/3000 [1:20:29<06:47,  1.29s/it, lr: 1.0e-04 loss: 2.475e-01]
windy_storm:  89%|########9 | 2683/3000 [1:20:29<06:47,  1.29s/it, lr: 1.0e-04 loss: 2.475e-01]
windy_storm:  89%|########9 | 2684/3000 [1:20:29<09:06,  1.73s/it, lr: 1.0e-04 loss: 2.475e-01]
windy_storm:  89%|########9 | 2684/3000 [1:20:29<09:06,  1.73s/it, lr: 1.0e-04 loss: 2.475e-01]
windy_storm:  89%|########9 | 2684/3000 [1:20:32<09:06,  1.73s/it, lr: 1.0e-04 loss: 6.022e-01]
windy_storm:  89%|########9 | 2684/3000 [1:20:32<09:06,  1.73s/it, lr: 1.0e-04 loss: 6.022e-01]
windy_storm:  90%|########9 | 2685/3000 [1:20:32<10:55,  2.08s/it, lr: 1.0e-04 loss: 6.022e-01]
windy_storm:  90%|########9 | 2685/3000 [1:20:32<10:55,  2.08s/it, lr: 1.0e-04 loss: 6.022e-01]
windy_storm:  90%|########9 | 2685/3000 [1:20:35<10:55,  2.08s/it, lr: 1.0e-04 loss: 1.139e-01]
windy_storm:  90%|########9 | 2685/3000 [1:20:35<10:55,  2.08s/it, lr: 1.0e-04 loss: 1.139e-01]
windy_storm:  90%|########9 | 2686/3000 [1:20:35<12:14,  2.34s/it, lr: 1.0e-04 loss: 1.139e-01]
windy_storm:  90%|########9 | 2686/3000 [1:20:35<12:14,  2.34s/it, lr: 1.0e-04 loss: 1.139e-01]
windy_storm:  90%|########9 | 2686/3000 [1:20:38<12:14,  2.34s/it, lr: 1.0e-04 loss: 1.764e-01]
windy_storm:  90%|########9 | 2686/3000 [1:20:38<12:14,  2.34s/it, lr: 1.0e-04 loss: 1.764e-01]
windy_storm:  90%|########9 | 2687/3000 [1:20:38<13:10,  2.53s/it, lr: 1.0e-04 loss: 1.764e-01]
windy_storm:  90%|########9 | 2687/3000 [1:20:38<13:10,  2.53s/it, lr: 1.0e-04 loss: 1.764e-01]
windy_storm:  90%|########9 | 2687/3000 [1:20:41<13:10,  2.53s/it, lr: 1.0e-04 loss: 3.150e-01]
windy_storm:  90%|########9 | 2687/3000 [1:20:41<13:10,  2.53s/it, lr: 1.0e-04 loss: 3.150e-01]
windy_storm:  90%|########9 | 2688/3000 [1:20:41<13:49,  2.66s/it, lr: 1.0e-04 loss: 3.150e-01]
windy_storm:  90%|########9 | 2688/3000 [1:20:41<13:49,  2.66s/it, lr: 1.0e-04 loss: 3.150e-01]
windy_storm:  90%|########9 | 2688/3000 [1:20:44<13:49,  2.66s/it, lr: 1.0e-04 loss: 5.131e-01]
windy_storm:  90%|########9 | 2688/3000 [1:20:44<13:49,  2.66s/it, lr: 1.0e-04 loss: 5.131e-01]
windy_storm:  90%|########9 | 2689/3000 [1:20:44<14:12,  2.74s/it, lr: 1.0e-04 loss: 5.131e-01]
windy_storm:  90%|########9 | 2689/3000 [1:20:44<14:12,  2.74s/it, lr: 1.0e-04 loss: 5.131e-01]
windy_storm:  90%|########9 | 2689/3000 [1:20:45<14:12,  2.74s/it, lr: 1.0e-04 loss: 1.188e-01]
windy_storm:  90%|########9 | 2689/3000 [1:20:45<14:12,  2.74s/it, lr: 1.0e-04 loss: 1.188e-01]
windy_storm:  90%|########9 | 2690/3000 [1:20:46<14:09,  2.74s/it, lr: 1.0e-04 loss: 4.184e-01]
windy_storm:  90%|########9 | 2690/3000 [1:20:46<14:09,  2.74s/it, lr: 1.0e-04 loss: 4.184e-01]
windy_storm:  90%|########9 | 2691/3000 [1:20:46<08:37,  1.68s/it, lr: 1.0e-04 loss: 4.184e-01]
windy_storm:  90%|########9 | 2691/3000 [1:20:46<08:37,  1.68s/it, lr: 1.0e-04 loss: 4.184e-01]
windy_storm:  90%|########9 | 2691/3000 [1:20:47<08:37,  1.68s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:  90%|########9 | 2691/3000 [1:20:47<08:37,  1.68s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:  90%|########9 | 2692/3000 [1:20:47<08:26,  1.65s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:  90%|########9 | 2692/3000 [1:20:47<08:26,  1.65s/it, lr: 1.0e-04 loss: 1.538e-01]
windy_storm:  90%|########9 | 2692/3000 [1:20:50<08:26,  1.65s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  90%|########9 | 2692/3000 [1:20:50<08:26,  1.65s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  90%|########9 | 2693/3000 [1:20:50<10:21,  2.03s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  90%|########9 | 2693/3000 [1:20:50<10:21,  2.03s/it, lr: 1.0e-04 loss: 1.842e-01]
windy_storm:  90%|########9 | 2693/3000 [1:20:51<10:21,  2.03s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  90%|########9 | 2693/3000 [1:20:51<10:21,  2.03s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  90%|########9 | 2694/3000 [1:20:51<08:39,  1.70s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  90%|########9 | 2694/3000 [1:20:51<08:39,  1.70s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  90%|########9 | 2694/3000 [1:20:52<08:39,  1.70s/it, lr: 1.0e-04 loss: 4.440e-02]
windy_storm:  90%|########9 | 2694/3000 [1:20:52<08:39,  1.70s/it, lr: 1.0e-04 loss: 4.440e-02]
windy_storm:  90%|########9 | 2695/3000 [1:20:52<07:19,  1.44s/it, lr: 1.0e-04 loss: 4.440e-02]
windy_storm:  90%|########9 | 2695/3000 [1:20:52<07:19,  1.44s/it, lr: 1.0e-04 loss: 4.440e-02]
windy_storm:  90%|########9 | 2695/3000 [1:20:53<07:19,  1.44s/it, lr: 1.0e-04 loss: 3.578e-02]
windy_storm:  90%|########9 | 2695/3000 [1:20:53<07:19,  1.44s/it, lr: 1.0e-04 loss: 3.578e-02]
windy_storm:  90%|########9 | 2696/3000 [1:20:53<06:24,  1.26s/it, lr: 1.0e-04 loss: 3.578e-02]
windy_storm:  90%|########9 | 2696/3000 [1:20:53<06:24,  1.26s/it, lr: 1.0e-04 loss: 3.578e-02]
windy_storm:  90%|########9 | 2696/3000 [1:20:54<06:24,  1.26s/it, lr: 1.0e-04 loss: 1.617e-01]
windy_storm:  90%|########9 | 2696/3000 [1:20:54<06:24,  1.26s/it, lr: 1.0e-04 loss: 1.617e-01]
windy_storm:  90%|########9 | 2697/3000 [1:20:54<06:47,  1.35s/it, lr: 1.0e-04 loss: 1.617e-01]
windy_storm:  90%|########9 | 2697/3000 [1:20:54<06:47,  1.35s/it, lr: 1.0e-04 loss: 1.617e-01]
windy_storm:  90%|########9 | 2697/3000 [1:20:56<06:47,  1.35s/it, lr: 1.0e-04 loss: 2.186e-01]
windy_storm:  90%|########9 | 2697/3000 [1:20:56<06:47,  1.35s/it, lr: 1.0e-04 loss: 2.186e-01]
windy_storm:  90%|########9 | 2698/3000 [1:20:56<07:05,  1.41s/it, lr: 1.0e-04 loss: 2.186e-01]
windy_storm:  90%|########9 | 2698/3000 [1:20:56<07:05,  1.41s/it, lr: 1.0e-04 loss: 2.186e-01]
windy_storm:  90%|########9 | 2698/3000 [1:20:59<07:05,  1.41s/it, lr: 1.0e-04 loss: 6.804e-01]
windy_storm:  90%|########9 | 2698/3000 [1:20:59<07:05,  1.41s/it, lr: 1.0e-04 loss: 6.804e-01]
windy_storm:  90%|########9 | 2699/3000 [1:20:59<09:23,  1.87s/it, lr: 1.0e-04 loss: 6.804e-01]
windy_storm:  90%|########9 | 2699/3000 [1:20:59<09:23,  1.87s/it, lr: 1.0e-04 loss: 6.804e-01]
windy_storm:  90%|########9 | 2699/3000 [1:21:00<09:23,  1.87s/it, lr: 1.0e-04 loss: 5.738e-01]
windy_storm:  90%|########9 | 2699/3000 [1:21:00<09:23,  1.87s/it, lr: 1.0e-04 loss: 5.738e-01]Unloading assistant lora



Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]


Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.47s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:12,  2.47s/it]


Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.43s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.43s/it]


Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.40s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.40s/it]


Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.38s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.38s/it]


Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.38s/it]
Generating Images:  83%|########3 | 5/6 [00:12<00:02,  2.38s/it]


Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.40s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.40s/it]


                                                                
                                                                Loading assistant lora

windy_storm:  90%|######### | 2700/3000 [1:21:03<09:21,  1.87s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  90%|######### | 2700/3000 [1:21:03<09:21,  1.87s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  90%|######### | 2701/3000 [1:21:03<08:25,  1.69s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  90%|######### | 2701/3000 [1:21:03<08:25,  1.69s/it, lr: 1.0e-04 loss: 2.109e-01]
windy_storm:  90%|######### | 2701/3000 [1:21:04<08:25,  1.69s/it, lr: 1.0e-04 loss: 2.918e-01]
windy_storm:  90%|######### | 2701/3000 [1:21:04<08:25,  1.69s/it, lr: 1.0e-04 loss: 2.918e-01]
windy_storm:  90%|######### | 2702/3000 [1:21:04<08:14,  1.66s/it, lr: 1.0e-04 loss: 2.918e-01]
windy_storm:  90%|######### | 2702/3000 [1:21:04<08:14,  1.66s/it, lr: 1.0e-04 loss: 2.918e-01]
windy_storm:  90%|######### | 2702/3000 [1:21:05<08:14,  1.66s/it, lr: 1.0e-04 loss: 3.227e-01]
windy_storm:  90%|######### | 2702/3000 [1:21:05<08:14,  1.66s/it, lr: 1.0e-04 loss: 3.227e-01]
windy_storm:  90%|######### | 2703/3000 [1:21:05<07:08,  1.44s/it, lr: 1.0e-04 loss: 3.227e-01]
windy_storm:  90%|######### | 2703/3000 [1:21:05<07:08,  1.44s/it, lr: 1.0e-04 loss: 3.227e-01]
windy_storm:  90%|######### | 2703/3000 [1:21:07<07:08,  1.44s/it, lr: 1.0e-04 loss: 6.682e-01]
windy_storm:  90%|######### | 2703/3000 [1:21:07<07:08,  1.44s/it, lr: 1.0e-04 loss: 6.682e-01]
windy_storm:  90%|######### | 2704/3000 [1:21:07<07:17,  1.48s/it, lr: 1.0e-04 loss: 6.682e-01]
windy_storm:  90%|######### | 2704/3000 [1:21:07<07:17,  1.48s/it, lr: 1.0e-04 loss: 6.682e-01]
windy_storm:  90%|######### | 2704/3000 [1:21:08<07:17,  1.48s/it, lr: 1.0e-04 loss: 5.783e-02]
windy_storm:  90%|######### | 2704/3000 [1:21:08<07:17,  1.48s/it, lr: 1.0e-04 loss: 5.783e-02]
windy_storm:  90%|######### | 2705/3000 [1:21:08<07:24,  1.51s/it, lr: 1.0e-04 loss: 5.783e-02]
windy_storm:  90%|######### | 2705/3000 [1:21:08<07:24,  1.51s/it, lr: 1.0e-04 loss: 5.783e-02]
windy_storm:  90%|######### | 2705/3000 [1:21:09<07:24,  1.51s/it, lr: 1.0e-04 loss: 4.618e-01]
windy_storm:  90%|######### | 2705/3000 [1:21:09<07:24,  1.51s/it, lr: 1.0e-04 loss: 4.618e-01]
windy_storm:  90%|######### | 2706/3000 [1:21:09<06:20,  1.29s/it, lr: 1.0e-04 loss: 4.618e-01]
windy_storm:  90%|######### | 2706/3000 [1:21:09<06:20,  1.29s/it, lr: 1.0e-04 loss: 4.618e-01]
windy_storm:  90%|######### | 2706/3000 [1:21:10<06:20,  1.29s/it, lr: 1.0e-04 loss: 6.637e-01]
windy_storm:  90%|######### | 2706/3000 [1:21:10<06:20,  1.29s/it, lr: 1.0e-04 loss: 6.637e-01]
windy_storm:  90%|######### | 2707/3000 [1:21:10<05:34,  1.14s/it, lr: 1.0e-04 loss: 6.637e-01]
windy_storm:  90%|######### | 2707/3000 [1:21:10<05:34,  1.14s/it, lr: 1.0e-04 loss: 6.637e-01]
windy_storm:  90%|######### | 2707/3000 [1:21:13<05:34,  1.14s/it, lr: 1.0e-04 loss: 6.264e-01]
windy_storm:  90%|######### | 2707/3000 [1:21:13<05:34,  1.14s/it, lr: 1.0e-04 loss: 6.264e-01]
windy_storm:  90%|######### | 2708/3000 [1:21:13<08:11,  1.68s/it, lr: 1.0e-04 loss: 6.264e-01]
windy_storm:  90%|######### | 2708/3000 [1:21:13<08:11,  1.68s/it, lr: 1.0e-04 loss: 6.264e-01]
windy_storm:  90%|######### | 2708/3000 [1:21:14<08:11,  1.68s/it, lr: 1.0e-04 loss: 7.410e-01]
windy_storm:  90%|######### | 2708/3000 [1:21:14<08:11,  1.68s/it, lr: 1.0e-04 loss: 7.410e-01]
windy_storm:  90%|######### | 2709/3000 [1:21:14<08:01,  1.65s/it, lr: 1.0e-04 loss: 7.410e-01]
windy_storm:  90%|######### | 2709/3000 [1:21:14<08:01,  1.65s/it, lr: 1.0e-04 loss: 7.410e-01]
windy_storm:  90%|######### | 2709/3000 [1:21:17<08:01,  1.65s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:  90%|######### | 2709/3000 [1:21:17<08:01,  1.65s/it, lr: 1.0e-04 loss: 3.216e-01]
windy_storm:  90%|######### | 2710/3000 [1:21:20<07:59,  1.65s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:  90%|######### | 2710/3000 [1:21:20<07:59,  1.65s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:  90%|######### | 2711/3000 [1:21:20<07:37,  1.58s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:  90%|######### | 2711/3000 [1:21:20<07:37,  1.58s/it, lr: 1.0e-04 loss: 3.750e-01]
windy_storm:  90%|######### | 2711/3000 [1:21:22<07:37,  1.58s/it, lr: 1.0e-04 loss: 1.714e-01]
windy_storm:  90%|######### | 2711/3000 [1:21:22<07:37,  1.58s/it, lr: 1.0e-04 loss: 1.714e-01]
windy_storm:  90%|######### | 2712/3000 [1:21:22<07:35,  1.58s/it, lr: 1.0e-04 loss: 1.714e-01]
windy_storm:  90%|######### | 2712/3000 [1:21:22<07:35,  1.58s/it, lr: 1.0e-04 loss: 1.714e-01]
windy_storm:  90%|######### | 2712/3000 [1:21:23<07:35,  1.58s/it, lr: 1.0e-04 loss: 6.197e-01]
windy_storm:  90%|######### | 2712/3000 [1:21:23<07:35,  1.58s/it, lr: 1.0e-04 loss: 6.197e-01]
windy_storm:  90%|######### | 2713/3000 [1:21:23<06:49,  1.43s/it, lr: 1.0e-04 loss: 6.197e-01]
windy_storm:  90%|######### | 2713/3000 [1:21:23<06:49,  1.43s/it, lr: 1.0e-04 loss: 6.197e-01]
windy_storm:  90%|######### | 2713/3000 [1:21:24<06:49,  1.43s/it, lr: 1.0e-04 loss: 4.444e-01]
windy_storm:  90%|######### | 2713/3000 [1:21:24<06:49,  1.43s/it, lr: 1.0e-04 loss: 4.444e-01]
windy_storm:  90%|######### | 2714/3000 [1:21:24<06:01,  1.26s/it, lr: 1.0e-04 loss: 4.444e-01]
windy_storm:  90%|######### | 2714/3000 [1:21:24<06:01,  1.26s/it, lr: 1.0e-04 loss: 4.444e-01]
windy_storm:  90%|######### | 2714/3000 [1:21:24<06:01,  1.26s/it, lr: 1.0e-04 loss: 2.766e-01]
windy_storm:  90%|######### | 2714/3000 [1:21:24<06:01,  1.26s/it, lr: 1.0e-04 loss: 2.766e-01]
windy_storm:  90%|######### | 2715/3000 [1:21:24<05:19,  1.12s/it, lr: 1.0e-04 loss: 2.766e-01]
windy_storm:  90%|######### | 2715/3000 [1:21:24<05:19,  1.12s/it, lr: 1.0e-04 loss: 2.766e-01]
windy_storm:  90%|######### | 2715/3000 [1:21:26<05:19,  1.12s/it, lr: 1.0e-04 loss: 1.638e-01]
windy_storm:  90%|######### | 2715/3000 [1:21:26<05:19,  1.12s/it, lr: 1.0e-04 loss: 1.638e-01]
windy_storm:  91%|######### | 2716/3000 [1:21:26<05:56,  1.25s/it, lr: 1.0e-04 loss: 1.638e-01]
windy_storm:  91%|######### | 2716/3000 [1:21:26<05:56,  1.25s/it, lr: 1.0e-04 loss: 1.638e-01]
windy_storm:  91%|######### | 2716/3000 [1:21:29<05:56,  1.25s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  91%|######### | 2716/3000 [1:21:29<05:56,  1.25s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  91%|######### | 2717/3000 [1:21:29<08:18,  1.76s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  91%|######### | 2717/3000 [1:21:29<08:18,  1.76s/it, lr: 1.0e-04 loss: 7.023e-01]
windy_storm:  91%|######### | 2717/3000 [1:21:32<08:18,  1.76s/it, lr: 1.0e-04 loss: 5.133e-01]
windy_storm:  91%|######### | 2717/3000 [1:21:32<08:18,  1.76s/it, lr: 1.0e-04 loss: 5.133e-01]
windy_storm:  91%|######### | 2718/3000 [1:21:32<09:54,  2.11s/it, lr: 1.0e-04 loss: 5.133e-01]
windy_storm:  91%|######### | 2718/3000 [1:21:32<09:54,  2.11s/it, lr: 1.0e-04 loss: 5.133e-01]
windy_storm:  91%|######### | 2718/3000 [1:21:34<09:54,  2.11s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  91%|######### | 2718/3000 [1:21:34<09:54,  2.11s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  91%|######### | 2719/3000 [1:21:34<09:06,  1.95s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  91%|######### | 2719/3000 [1:21:34<09:06,  1.95s/it, lr: 1.0e-04 loss: 8.232e-02]
windy_storm:  91%|######### | 2719/3000 [1:21:35<09:06,  1.95s/it, lr: 1.0e-04 loss: 2.038e-01]
windy_storm:  91%|######### | 2719/3000 [1:21:35<09:06,  1.95s/it, lr: 1.0e-04 loss: 2.038e-01]
windy_storm:  91%|######### | 2720/3000 [1:21:36<09:04,  1.95s/it, lr: 1.0e-04 loss: 5.636e-01]
windy_storm:  91%|######### | 2720/3000 [1:21:36<09:04,  1.95s/it, lr: 1.0e-04 loss: 5.636e-01]
windy_storm:  91%|######### | 2721/3000 [1:21:36<05:46,  1.24s/it, lr: 1.0e-04 loss: 5.636e-01]
windy_storm:  91%|######### | 2721/3000 [1:21:36<05:46,  1.24s/it, lr: 1.0e-04 loss: 5.636e-01]
windy_storm:  91%|######### | 2721/3000 [1:21:37<05:46,  1.24s/it, lr: 1.0e-04 loss: 2.358e-01]
windy_storm:  91%|######### | 2721/3000 [1:21:37<05:46,  1.24s/it, lr: 1.0e-04 loss: 2.358e-01]
windy_storm:  91%|######### | 2722/3000 [1:21:37<05:13,  1.13s/it, lr: 1.0e-04 loss: 2.358e-01]
windy_storm:  91%|######### | 2722/3000 [1:21:37<05:13,  1.13s/it, lr: 1.0e-04 loss: 2.358e-01]
windy_storm:  91%|######### | 2722/3000 [1:21:40<05:13,  1.13s/it, lr: 1.0e-04 loss: 6.408e-01]
windy_storm:  91%|######### | 2722/3000 [1:21:40<05:13,  1.13s/it, lr: 1.0e-04 loss: 6.408e-01]
windy_storm:  91%|######### | 2723/3000 [1:21:40<07:28,  1.62s/it, lr: 1.0e-04 loss: 6.408e-01]
windy_storm:  91%|######### | 2723/3000 [1:21:40<07:28,  1.62s/it, lr: 1.0e-04 loss: 6.408e-01]
windy_storm:  91%|######### | 2723/3000 [1:21:41<07:28,  1.62s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  91%|######### | 2723/3000 [1:21:41<07:28,  1.62s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  91%|######### | 2724/3000 [1:21:41<07:25,  1.61s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  91%|######### | 2724/3000 [1:21:41<07:25,  1.61s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  91%|######### | 2724/3000 [1:21:43<07:25,  1.61s/it, lr: 1.0e-04 loss: 1.952e-01]
windy_storm:  91%|######### | 2724/3000 [1:21:43<07:25,  1.61s/it, lr: 1.0e-04 loss: 1.952e-01]
windy_storm:  91%|######### | 2725/3000 [1:21:43<07:21,  1.61s/it, lr: 1.0e-04 loss: 1.952e-01]
windy_storm:  91%|######### | 2725/3000 [1:21:43<07:21,  1.61s/it, lr: 1.0e-04 loss: 1.952e-01]
windy_storm:  91%|######### | 2725/3000 [1:21:44<07:21,  1.61s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  91%|######### | 2725/3000 [1:21:44<07:21,  1.61s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  91%|######### | 2726/3000 [1:21:44<06:16,  1.37s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  91%|######### | 2726/3000 [1:21:44<06:16,  1.37s/it, lr: 1.0e-04 loss: 5.292e-01]
windy_storm:  91%|######### | 2726/3000 [1:21:47<06:16,  1.37s/it, lr: 1.0e-04 loss: 1.920e-01]
windy_storm:  91%|######### | 2726/3000 [1:21:47<06:16,  1.37s/it, lr: 1.0e-04 loss: 1.920e-01]
windy_storm:  91%|######### | 2727/3000 [1:21:47<08:18,  1.82s/it, lr: 1.0e-04 loss: 1.920e-01]
windy_storm:  91%|######### | 2727/3000 [1:21:47<08:18,  1.82s/it, lr: 1.0e-04 loss: 1.920e-01]
windy_storm:  91%|######### | 2727/3000 [1:21:48<08:18,  1.82s/it, lr: 1.0e-04 loss: 3.153e-01]
windy_storm:  91%|######### | 2727/3000 [1:21:48<08:18,  1.82s/it, lr: 1.0e-04 loss: 3.153e-01]
windy_storm:  91%|######### | 2728/3000 [1:21:48<07:14,  1.60s/it, lr: 1.0e-04 loss: 3.153e-01]
windy_storm:  91%|######### | 2728/3000 [1:21:48<07:14,  1.60s/it, lr: 1.0e-04 loss: 3.153e-01]
windy_storm:  91%|######### | 2728/3000 [1:21:49<07:14,  1.60s/it, lr: 1.0e-04 loss: 5.270e-01]
windy_storm:  91%|######### | 2728/3000 [1:21:49<07:14,  1.60s/it, lr: 1.0e-04 loss: 5.270e-01]
windy_storm:  91%|######### | 2729/3000 [1:21:49<07:12,  1.60s/it, lr: 1.0e-04 loss: 5.270e-01]
windy_storm:  91%|######### | 2729/3000 [1:21:49<07:12,  1.60s/it, lr: 1.0e-04 loss: 5.270e-01]
windy_storm:  91%|######### | 2729/3000 [1:21:52<07:12,  1.60s/it, lr: 1.0e-04 loss: 4.994e-01]
windy_storm:  91%|######### | 2729/3000 [1:21:52<07:12,  1.60s/it, lr: 1.0e-04 loss: 4.994e-01]
windy_storm:  91%|#########1| 2730/3000 [1:21:53<07:11,  1.60s/it, lr: 1.0e-04 loss: 8.974e-02]
windy_storm:  91%|#########1| 2730/3000 [1:21:53<07:11,  1.60s/it, lr: 1.0e-04 loss: 8.974e-02]
windy_storm:  91%|#########1| 2731/3000 [1:21:53<04:43,  1.06s/it, lr: 1.0e-04 loss: 8.974e-02]
windy_storm:  91%|#########1| 2731/3000 [1:21:53<04:43,  1.06s/it, lr: 1.0e-04 loss: 8.974e-02]
windy_storm:  91%|#########1| 2731/3000 [1:21:56<04:43,  1.06s/it, lr: 1.0e-04 loss: 2.096e-01]
windy_storm:  91%|#########1| 2731/3000 [1:21:56<04:43,  1.06s/it, lr: 1.0e-04 loss: 2.096e-01]
windy_storm:  91%|#########1| 2732/3000 [1:21:56<06:54,  1.55s/it, lr: 1.0e-04 loss: 2.096e-01]
windy_storm:  91%|#########1| 2732/3000 [1:21:56<06:54,  1.55s/it, lr: 1.0e-04 loss: 2.096e-01]
windy_storm:  91%|#########1| 2732/3000 [1:21:59<06:54,  1.55s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  91%|#########1| 2732/3000 [1:21:59<06:54,  1.55s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  91%|#########1| 2733/3000 [1:21:59<08:37,  1.94s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  91%|#########1| 2733/3000 [1:21:59<08:37,  1.94s/it, lr: 1.0e-04 loss: 5.799e-01]
windy_storm:  91%|#########1| 2733/3000 [1:22:00<08:37,  1.94s/it, lr: 1.0e-04 loss: 1.352e-01]
windy_storm:  91%|#########1| 2733/3000 [1:22:00<08:37,  1.94s/it, lr: 1.0e-04 loss: 1.352e-01]
windy_storm:  91%|#########1| 2734/3000 [1:22:00<07:15,  1.64s/it, lr: 1.0e-04 loss: 1.352e-01]
windy_storm:  91%|#########1| 2734/3000 [1:22:00<07:15,  1.64s/it, lr: 1.0e-04 loss: 1.352e-01]
windy_storm:  91%|#########1| 2734/3000 [1:22:02<07:15,  1.64s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  91%|#########1| 2734/3000 [1:22:02<07:15,  1.64s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  91%|#########1| 2735/3000 [1:22:02<07:11,  1.63s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  91%|#########1| 2735/3000 [1:22:02<07:11,  1.63s/it, lr: 1.0e-04 loss: 6.069e-01]
windy_storm:  91%|#########1| 2735/3000 [1:22:03<07:11,  1.63s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  91%|#########1| 2735/3000 [1:22:03<07:11,  1.63s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  91%|#########1| 2736/3000 [1:22:03<07:07,  1.62s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  91%|#########1| 2736/3000 [1:22:03<07:07,  1.62s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  91%|#########1| 2736/3000 [1:22:04<07:07,  1.62s/it, lr: 1.0e-04 loss: 7.329e-01]
windy_storm:  91%|#########1| 2736/3000 [1:22:04<07:07,  1.62s/it, lr: 1.0e-04 loss: 7.329e-01]
windy_storm:  91%|#########1| 2737/3000 [1:22:04<06:05,  1.39s/it, lr: 1.0e-04 loss: 7.329e-01]
windy_storm:  91%|#########1| 2737/3000 [1:22:04<06:05,  1.39s/it, lr: 1.0e-04 loss: 7.329e-01]
windy_storm:  91%|#########1| 2737/3000 [1:22:05<06:05,  1.39s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  91%|#########1| 2737/3000 [1:22:05<06:05,  1.39s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  91%|#########1| 2738/3000 [1:22:05<05:15,  1.21s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  91%|#########1| 2738/3000 [1:22:05<05:15,  1.21s/it, lr: 1.0e-04 loss: 2.681e-01]
windy_storm:  91%|#########1| 2738/3000 [1:22:06<05:15,  1.21s/it, lr: 1.0e-04 loss: 5.099e-01]
windy_storm:  91%|#########1| 2738/3000 [1:22:06<05:15,  1.21s/it, lr: 1.0e-04 loss: 5.099e-01]
windy_storm:  91%|#########1| 2739/3000 [1:22:06<05:44,  1.32s/it, lr: 1.0e-04 loss: 5.099e-01]
windy_storm:  91%|#########1| 2739/3000 [1:22:06<05:44,  1.32s/it, lr: 1.0e-04 loss: 5.099e-01]
windy_storm:  91%|#########1| 2739/3000 [1:22:09<05:44,  1.32s/it, lr: 1.0e-04 loss: 1.162e-01]
windy_storm:  91%|#########1| 2739/3000 [1:22:09<05:44,  1.32s/it, lr: 1.0e-04 loss: 1.162e-01]
windy_storm:  91%|#########1| 2740/3000 [1:22:11<05:43,  1.32s/it, lr: 1.0e-04 loss: 1.142e-01]
windy_storm:  91%|#########1| 2740/3000 [1:22:11<05:43,  1.32s/it, lr: 1.0e-04 loss: 1.142e-01]
windy_storm:  91%|#########1| 2741/3000 [1:22:11<04:37,  1.07s/it, lr: 1.0e-04 loss: 1.142e-01]
windy_storm:  91%|#########1| 2741/3000 [1:22:11<04:37,  1.07s/it, lr: 1.0e-04 loss: 1.142e-01]
windy_storm:  91%|#########1| 2741/3000 [1:22:12<04:37,  1.07s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  91%|#########1| 2741/3000 [1:22:12<04:37,  1.07s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  91%|#########1| 2742/3000 [1:22:12<04:36,  1.07s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  91%|#########1| 2742/3000 [1:22:12<04:36,  1.07s/it, lr: 1.0e-04 loss: 6.675e-01]
windy_storm:  91%|#########1| 2742/3000 [1:22:14<04:36,  1.07s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  91%|#########1| 2742/3000 [1:22:14<04:36,  1.07s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  91%|#########1| 2743/3000 [1:22:14<05:10,  1.21s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  91%|#########1| 2743/3000 [1:22:14<05:10,  1.21s/it, lr: 1.0e-04 loss: 3.643e-01]
windy_storm:  91%|#########1| 2743/3000 [1:22:14<05:10,  1.21s/it, lr: 1.0e-04 loss: 6.671e-01]
windy_storm:  91%|#########1| 2743/3000 [1:22:14<05:10,  1.21s/it, lr: 1.0e-04 loss: 6.671e-01]
windy_storm:  91%|#########1| 2744/3000 [1:22:14<04:38,  1.09s/it, lr: 1.0e-04 loss: 6.671e-01]
windy_storm:  91%|#########1| 2744/3000 [1:22:14<04:38,  1.09s/it, lr: 1.0e-04 loss: 6.671e-01]
windy_storm:  91%|#########1| 2744/3000 [1:22:15<04:38,  1.09s/it, lr: 1.0e-04 loss: 9.984e-02]
windy_storm:  91%|#########1| 2744/3000 [1:22:15<04:38,  1.09s/it, lr: 1.0e-04 loss: 9.984e-02]
windy_storm:  92%|#########1| 2745/3000 [1:22:15<04:15,  1.00s/it, lr: 1.0e-04 loss: 9.984e-02]
windy_storm:  92%|#########1| 2745/3000 [1:22:15<04:15,  1.00s/it, lr: 1.0e-04 loss: 9.984e-02]
windy_storm:  92%|#########1| 2745/3000 [1:22:17<04:15,  1.00s/it, lr: 1.0e-04 loss: 3.892e-01]
windy_storm:  92%|#########1| 2745/3000 [1:22:17<04:15,  1.00s/it, lr: 1.0e-04 loss: 3.892e-01]
windy_storm:  92%|#########1| 2746/3000 [1:22:17<04:56,  1.17s/it, lr: 1.0e-04 loss: 3.892e-01]
windy_storm:  92%|#########1| 2746/3000 [1:22:17<04:56,  1.17s/it, lr: 1.0e-04 loss: 3.892e-01]
windy_storm:  92%|#########1| 2746/3000 [1:22:20<04:56,  1.17s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  92%|#########1| 2746/3000 [1:22:20<04:56,  1.17s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  92%|#########1| 2747/3000 [1:22:20<07:04,  1.68s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  92%|#########1| 2747/3000 [1:22:20<07:04,  1.68s/it, lr: 1.0e-04 loss: 4.617e-01]
windy_storm:  92%|#########1| 2747/3000 [1:22:21<07:04,  1.68s/it, lr: 1.0e-04 loss: 1.813e-01]
windy_storm:  92%|#########1| 2747/3000 [1:22:21<07:04,  1.68s/it, lr: 1.0e-04 loss: 1.813e-01]
windy_storm:  92%|#########1| 2748/3000 [1:22:21<05:56,  1.42s/it, lr: 1.0e-04 loss: 1.813e-01]
windy_storm:  92%|#########1| 2748/3000 [1:22:21<05:56,  1.42s/it, lr: 1.0e-04 loss: 1.813e-01]
windy_storm:  92%|#########1| 2748/3000 [1:22:22<05:56,  1.42s/it, lr: 1.0e-04 loss: 1.099e-01]
windy_storm:  92%|#########1| 2748/3000 [1:22:22<05:56,  1.42s/it, lr: 1.0e-04 loss: 1.099e-01]
windy_storm:  92%|#########1| 2749/3000 [1:22:22<06:06,  1.46s/it, lr: 1.0e-04 loss: 1.099e-01]
windy_storm:  92%|#########1| 2749/3000 [1:22:22<06:06,  1.46s/it, lr: 1.0e-04 loss: 1.099e-01]
windy_storm:  92%|#########1| 2749/3000 [1:22:24<06:06,  1.46s/it, lr: 1.0e-04 loss: 2.609e-01]
windy_storm:  92%|#########1| 2749/3000 [1:22:24<06:06,  1.46s/it, lr: 1.0e-04 loss: 2.609e-01]
Saving at step 2750
Saved checkpoint to /data/app/output/windy_storm/windy_storm_000002750.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt
Removing old save: /data/app/output/windy_storm/windy_storm_000001750.safetensors

windy_storm:  92%|#########1| 2750/3000 [1:22:27<06:05,  1.46s/it, lr: 1.0e-04 loss: 2.874e-01]
windy_storm:  92%|#########1| 2750/3000 [1:22:27<06:05,  1.46s/it, lr: 1.0e-04 loss: 2.874e-01]
windy_storm:  92%|#########1| 2751/3000 [1:22:27<06:23,  1.54s/it, lr: 1.0e-04 loss: 2.874e-01]
windy_storm:  92%|#########1| 2751/3000 [1:22:27<06:23,  1.54s/it, lr: 1.0e-04 loss: 2.874e-01]
windy_storm:  92%|#########1| 2751/3000 [1:22:30<06:23,  1.54s/it, lr: 1.0e-04 loss: 2.996e-01]
windy_storm:  92%|#########1| 2751/3000 [1:22:30<06:23,  1.54s/it, lr: 1.0e-04 loss: 2.996e-01]
windy_storm:  92%|#########1| 2752/3000 [1:22:30<07:52,  1.90s/it, lr: 1.0e-04 loss: 2.996e-01]
windy_storm:  92%|#########1| 2752/3000 [1:22:30<07:52,  1.90s/it, lr: 1.0e-04 loss: 2.996e-01]
windy_storm:  92%|#########1| 2752/3000 [1:22:31<07:52,  1.90s/it, lr: 1.0e-04 loss: 6.537e-01]
windy_storm:  92%|#########1| 2752/3000 [1:22:31<07:52,  1.90s/it, lr: 1.0e-04 loss: 6.537e-01]
windy_storm:  92%|#########1| 2753/3000 [1:22:31<06:40,  1.62s/it, lr: 1.0e-04 loss: 6.537e-01]
windy_storm:  92%|#########1| 2753/3000 [1:22:31<06:40,  1.62s/it, lr: 1.0e-04 loss: 6.537e-01]
windy_storm:  92%|#########1| 2753/3000 [1:22:32<06:40,  1.62s/it, lr: 1.0e-04 loss: 9.503e-02]
windy_storm:  92%|#########1| 2753/3000 [1:22:32<06:40,  1.62s/it, lr: 1.0e-04 loss: 9.503e-02]
windy_storm:  92%|#########1| 2754/3000 [1:22:32<06:35,  1.61s/it, lr: 1.0e-04 loss: 9.503e-02]
windy_storm:  92%|#########1| 2754/3000 [1:22:32<06:35,  1.61s/it, lr: 1.0e-04 loss: 9.503e-02]
windy_storm:  92%|#########1| 2754/3000 [1:22:35<06:35,  1.61s/it, lr: 1.0e-04 loss: 6.667e-01]
windy_storm:  92%|#########1| 2754/3000 [1:22:35<06:35,  1.61s/it, lr: 1.0e-04 loss: 6.667e-01]
windy_storm:  92%|#########1| 2755/3000 [1:22:35<08:04,  1.98s/it, lr: 1.0e-04 loss: 6.667e-01]
windy_storm:  92%|#########1| 2755/3000 [1:22:35<08:04,  1.98s/it, lr: 1.0e-04 loss: 6.667e-01]
windy_storm:  92%|#########1| 2755/3000 [1:22:36<08:04,  1.98s/it, lr: 1.0e-04 loss: 4.121e-01]
windy_storm:  92%|#########1| 2755/3000 [1:22:36<08:04,  1.98s/it, lr: 1.0e-04 loss: 4.121e-01]
windy_storm:  92%|#########1| 2756/3000 [1:22:36<06:42,  1.65s/it, lr: 1.0e-04 loss: 4.121e-01]
windy_storm:  92%|#########1| 2756/3000 [1:22:36<06:42,  1.65s/it, lr: 1.0e-04 loss: 4.121e-01]
windy_storm:  92%|#########1| 2756/3000 [1:22:38<06:42,  1.65s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  92%|#########1| 2756/3000 [1:22:38<06:42,  1.65s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  92%|#########1| 2757/3000 [1:22:38<06:34,  1.63s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  92%|#########1| 2757/3000 [1:22:38<06:34,  1.63s/it, lr: 1.0e-04 loss: 5.015e-01]
windy_storm:  92%|#########1| 2757/3000 [1:22:38<06:34,  1.63s/it, lr: 1.0e-04 loss: 3.955e-01]
windy_storm:  92%|#########1| 2757/3000 [1:22:38<06:34,  1.63s/it, lr: 1.0e-04 loss: 3.955e-01]
windy_storm:  92%|#########1| 2758/3000 [1:22:38<05:32,  1.37s/it, lr: 1.0e-04 loss: 3.955e-01]
windy_storm:  92%|#########1| 2758/3000 [1:22:38<05:32,  1.37s/it, lr: 1.0e-04 loss: 3.955e-01]
windy_storm:  92%|#########1| 2758/3000 [1:22:41<05:32,  1.37s/it, lr: 1.0e-04 loss: 2.430e-01]
windy_storm:  92%|#########1| 2758/3000 [1:22:41<05:32,  1.37s/it, lr: 1.0e-04 loss: 2.430e-01]
windy_storm:  92%|#########1| 2759/3000 [1:22:41<07:23,  1.84s/it, lr: 1.0e-04 loss: 2.430e-01]
windy_storm:  92%|#########1| 2759/3000 [1:22:41<07:23,  1.84s/it, lr: 1.0e-04 loss: 2.430e-01]
windy_storm:  92%|#########1| 2759/3000 [1:22:45<07:23,  1.84s/it, lr: 1.0e-04 loss: 2.149e-01]
windy_storm:  92%|#########1| 2759/3000 [1:22:45<07:23,  1.84s/it, lr: 1.0e-04 loss: 2.149e-01]
windy_storm:  92%|#########2| 2760/3000 [1:22:48<07:22,  1.84s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  92%|#########2| 2760/3000 [1:22:48<07:22,  1.84s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  92%|#########2| 2761/3000 [1:22:48<06:43,  1.69s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  92%|#########2| 2761/3000 [1:22:48<06:43,  1.69s/it, lr: 1.0e-04 loss: 5.937e-01]
windy_storm:  92%|#########2| 2761/3000 [1:22:51<06:43,  1.69s/it, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  92%|#########2| 2761/3000 [1:22:51<06:43,  1.69s/it, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  92%|#########2| 2762/3000 [1:22:51<07:59,  2.01s/it, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  92%|#########2| 2762/3000 [1:22:51<07:59,  2.01s/it, lr: 1.0e-04 loss: 5.915e-01]
windy_storm:  92%|#########2| 2762/3000 [1:22:53<07:59,  2.01s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  92%|#########2| 2762/3000 [1:22:53<07:59,  2.01s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  92%|#########2| 2763/3000 [1:22:53<07:49,  1.98s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  92%|#########2| 2763/3000 [1:22:53<07:49,  1.98s/it, lr: 1.0e-04 loss: 5.285e-01]
windy_storm:  92%|#########2| 2763/3000 [1:22:54<07:49,  1.98s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  92%|#########2| 2763/3000 [1:22:54<07:49,  1.98s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  92%|#########2| 2764/3000 [1:22:54<06:32,  1.67s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  92%|#########2| 2764/3000 [1:22:54<06:32,  1.67s/it, lr: 1.0e-04 loss: 6.555e-01]
windy_storm:  92%|#########2| 2764/3000 [1:22:57<06:32,  1.67s/it, lr: 1.0e-04 loss: 5.883e-01]
windy_storm:  92%|#########2| 2764/3000 [1:22:57<06:32,  1.67s/it, lr: 1.0e-04 loss: 5.883e-01]
windy_storm:  92%|#########2| 2765/3000 [1:22:57<07:57,  2.03s/it, lr: 1.0e-04 loss: 5.883e-01]
windy_storm:  92%|#########2| 2765/3000 [1:22:57<07:57,  2.03s/it, lr: 1.0e-04 loss: 5.883e-01]
windy_storm:  92%|#########2| 2765/3000 [1:22:57<07:57,  2.03s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  92%|#########2| 2765/3000 [1:22:57<07:57,  2.03s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  92%|#########2| 2766/3000 [1:22:57<06:34,  1.69s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  92%|#########2| 2766/3000 [1:22:57<06:34,  1.69s/it, lr: 1.0e-04 loss: 2.784e-01]
windy_storm:  92%|#########2| 2766/3000 [1:22:59<06:34,  1.69s/it, lr: 1.0e-04 loss: 4.047e-01]
windy_storm:  92%|#########2| 2766/3000 [1:22:59<06:34,  1.69s/it, lr: 1.0e-04 loss: 4.047e-01]
windy_storm:  92%|#########2| 2767/3000 [1:22:59<06:26,  1.66s/it, lr: 1.0e-04 loss: 4.047e-01]
windy_storm:  92%|#########2| 2767/3000 [1:22:59<06:26,  1.66s/it, lr: 1.0e-04 loss: 4.047e-01]
windy_storm:  92%|#########2| 2767/3000 [1:23:00<06:26,  1.66s/it, lr: 1.0e-04 loss: 4.825e-01]
windy_storm:  92%|#########2| 2767/3000 [1:23:00<06:26,  1.66s/it, lr: 1.0e-04 loss: 4.825e-01]
windy_storm:  92%|#########2| 2768/3000 [1:23:00<05:23,  1.39s/it, lr: 1.0e-04 loss: 4.825e-01]
windy_storm:  92%|#########2| 2768/3000 [1:23:00<05:23,  1.39s/it, lr: 1.0e-04 loss: 4.825e-01]
windy_storm:  92%|#########2| 2768/3000 [1:23:01<05:23,  1.39s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:  92%|#########2| 2768/3000 [1:23:01<05:23,  1.39s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:  92%|#########2| 2769/3000 [1:23:01<05:34,  1.45s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:  92%|#########2| 2769/3000 [1:23:01<05:34,  1.45s/it, lr: 1.0e-04 loss: 1.832e-01]
windy_storm:  92%|#########2| 2769/3000 [1:23:04<05:34,  1.45s/it, lr: 1.0e-04 loss: 1.878e-01]
windy_storm:  92%|#########2| 2769/3000 [1:23:04<05:34,  1.45s/it, lr: 1.0e-04 loss: 1.878e-01]
windy_storm:  92%|#########2| 2770/3000 [1:23:05<05:32,  1.45s/it, lr: 1.0e-04 loss: 8.738e-02]
windy_storm:  92%|#########2| 2770/3000 [1:23:05<05:32,  1.45s/it, lr: 1.0e-04 loss: 8.738e-02]
windy_storm:  92%|#########2| 2771/3000 [1:23:05<03:39,  1.04it/s, lr: 1.0e-04 loss: 8.738e-02]
windy_storm:  92%|#########2| 2771/3000 [1:23:05<03:39,  1.04it/s, lr: 1.0e-04 loss: 8.738e-02]
windy_storm:  92%|#########2| 2771/3000 [1:23:07<03:39,  1.04it/s, lr: 1.0e-04 loss: 1.542e-02]
windy_storm:  92%|#########2| 2771/3000 [1:23:07<03:39,  1.04it/s, lr: 1.0e-04 loss: 1.542e-02]
windy_storm:  92%|#########2| 2772/3000 [1:23:07<04:11,  1.10s/it, lr: 1.0e-04 loss: 1.542e-02]
windy_storm:  92%|#########2| 2772/3000 [1:23:07<04:11,  1.10s/it, lr: 1.0e-04 loss: 1.542e-02]
windy_storm:  92%|#########2| 2772/3000 [1:23:08<04:11,  1.10s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  92%|#########2| 2772/3000 [1:23:08<04:11,  1.10s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  92%|#########2| 2773/3000 [1:23:08<04:39,  1.23s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  92%|#########2| 2773/3000 [1:23:08<04:39,  1.23s/it, lr: 1.0e-04 loss: 6.858e-01]
windy_storm:  92%|#########2| 2773/3000 [1:23:09<04:39,  1.23s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:  92%|#########2| 2773/3000 [1:23:09<04:39,  1.23s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:  92%|#########2| 2774/3000 [1:23:09<04:13,  1.12s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:  92%|#########2| 2774/3000 [1:23:09<04:13,  1.12s/it, lr: 1.0e-04 loss: 1.684e-01]
windy_storm:  92%|#########2| 2774/3000 [1:23:10<04:13,  1.12s/it, lr: 1.0e-04 loss: 1.178e-01]
windy_storm:  92%|#########2| 2774/3000 [1:23:10<04:13,  1.12s/it, lr: 1.0e-04 loss: 1.178e-01]
windy_storm:  92%|#########2| 2775/3000 [1:23:10<03:50,  1.02s/it, lr: 1.0e-04 loss: 1.178e-01]
windy_storm:  92%|#########2| 2775/3000 [1:23:10<03:50,  1.02s/it, lr: 1.0e-04 loss: 1.178e-01]
windy_storm:  92%|#########2| 2775/3000 [1:23:13<03:50,  1.02s/it, lr: 1.0e-04 loss: 1.752e-01]
windy_storm:  92%|#########2| 2775/3000 [1:23:13<03:50,  1.02s/it, lr: 1.0e-04 loss: 1.752e-01]
windy_storm:  93%|#########2| 2776/3000 [1:23:13<05:53,  1.58s/it, lr: 1.0e-04 loss: 1.752e-01]
windy_storm:  93%|#########2| 2776/3000 [1:23:13<05:53,  1.58s/it, lr: 1.0e-04 loss: 1.752e-01]
windy_storm:  93%|#########2| 2776/3000 [1:23:14<05:53,  1.58s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:  93%|#########2| 2776/3000 [1:23:14<05:53,  1.58s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:  93%|#########2| 2777/3000 [1:23:14<05:52,  1.58s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:  93%|#########2| 2777/3000 [1:23:14<05:52,  1.58s/it, lr: 1.0e-04 loss: 6.502e-01]
windy_storm:  93%|#########2| 2777/3000 [1:23:18<05:52,  1.58s/it, lr: 1.0e-04 loss: 3.853e-01]
windy_storm:  93%|#########2| 2777/3000 [1:23:18<05:52,  1.58s/it, lr: 1.0e-04 loss: 3.853e-01]
windy_storm:  93%|#########2| 2778/3000 [1:23:18<07:31,  2.03s/it, lr: 1.0e-04 loss: 3.853e-01]
windy_storm:  93%|#########2| 2778/3000 [1:23:18<07:31,  2.03s/it, lr: 1.0e-04 loss: 3.853e-01]
windy_storm:  93%|#########2| 2778/3000 [1:23:20<07:31,  2.03s/it, lr: 1.0e-04 loss: 4.806e-01]
windy_storm:  93%|#########2| 2778/3000 [1:23:20<07:31,  2.03s/it, lr: 1.0e-04 loss: 4.806e-01]
windy_storm:  93%|#########2| 2779/3000 [1:23:20<08:26,  2.29s/it, lr: 1.0e-04 loss: 4.806e-01]
windy_storm:  93%|#########2| 2779/3000 [1:23:20<08:26,  2.29s/it, lr: 1.0e-04 loss: 4.806e-01]
windy_storm:  93%|#########2| 2779/3000 [1:23:23<08:26,  2.29s/it, lr: 1.0e-04 loss: 6.120e-01]
windy_storm:  93%|#########2| 2779/3000 [1:23:23<08:26,  2.29s/it, lr: 1.0e-04 loss: 6.120e-01]
windy_storm:  93%|#########2| 2780/3000 [1:23:25<08:24,  2.29s/it, lr: 1.0e-04 loss: 1.598e-01]
windy_storm:  93%|#########2| 2780/3000 [1:23:25<08:24,  2.29s/it, lr: 1.0e-04 loss: 1.598e-01]
windy_storm:  93%|#########2| 2781/3000 [1:23:25<05:52,  1.61s/it, lr: 1.0e-04 loss: 1.598e-01]
windy_storm:  93%|#########2| 2781/3000 [1:23:25<05:52,  1.61s/it, lr: 1.0e-04 loss: 1.598e-01]
windy_storm:  93%|#########2| 2781/3000 [1:23:27<05:52,  1.61s/it, lr: 1.0e-04 loss: 5.360e-01]
windy_storm:  93%|#########2| 2781/3000 [1:23:27<05:52,  1.61s/it, lr: 1.0e-04 loss: 5.360e-01]
windy_storm:  93%|#########2| 2782/3000 [1:23:27<05:49,  1.60s/it, lr: 1.0e-04 loss: 5.360e-01]
windy_storm:  93%|#########2| 2782/3000 [1:23:27<05:49,  1.60s/it, lr: 1.0e-04 loss: 5.360e-01]
windy_storm:  93%|#########2| 2782/3000 [1:23:27<05:49,  1.60s/it, lr: 1.0e-04 loss: 5.483e-01]
windy_storm:  93%|#########2| 2782/3000 [1:23:27<05:49,  1.60s/it, lr: 1.0e-04 loss: 5.483e-01]
windy_storm:  93%|#########2| 2783/3000 [1:23:27<05:00,  1.39s/it, lr: 1.0e-04 loss: 5.483e-01]
windy_storm:  93%|#########2| 2783/3000 [1:23:27<05:00,  1.39s/it, lr: 1.0e-04 loss: 5.483e-01]
windy_storm:  93%|#########2| 2783/3000 [1:23:28<05:00,  1.39s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  93%|#########2| 2783/3000 [1:23:28<05:00,  1.39s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  93%|#########2| 2784/3000 [1:23:28<04:23,  1.22s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  93%|#########2| 2784/3000 [1:23:28<04:23,  1.22s/it, lr: 1.0e-04 loss: 3.489e-01]
windy_storm:  93%|#########2| 2784/3000 [1:23:29<04:23,  1.22s/it, lr: 1.0e-04 loss: 4.586e-01]
windy_storm:  93%|#########2| 2784/3000 [1:23:29<04:23,  1.22s/it, lr: 1.0e-04 loss: 4.586e-01]
windy_storm:  93%|#########2| 2785/3000 [1:23:29<03:58,  1.11s/it, lr: 1.0e-04 loss: 4.586e-01]
windy_storm:  93%|#########2| 2785/3000 [1:23:29<03:58,  1.11s/it, lr: 1.0e-04 loss: 4.586e-01]
windy_storm:  93%|#########2| 2785/3000 [1:23:32<03:58,  1.11s/it, lr: 1.0e-04 loss: 1.017e-01]
windy_storm:  93%|#########2| 2785/3000 [1:23:32<03:58,  1.11s/it, lr: 1.0e-04 loss: 1.017e-01]
windy_storm:  93%|#########2| 2786/3000 [1:23:32<05:51,  1.64s/it, lr: 1.0e-04 loss: 1.017e-01]
windy_storm:  93%|#########2| 2786/3000 [1:23:32<05:51,  1.64s/it, lr: 1.0e-04 loss: 1.017e-01]
windy_storm:  93%|#########2| 2786/3000 [1:23:34<05:51,  1.64s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  93%|#########2| 2786/3000 [1:23:34<05:51,  1.64s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  93%|#########2| 2787/3000 [1:23:34<05:47,  1.63s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  93%|#########2| 2787/3000 [1:23:34<05:47,  1.63s/it, lr: 1.0e-04 loss: 5.614e-01]
windy_storm:  93%|#########2| 2787/3000 [1:23:35<05:47,  1.63s/it, lr: 1.0e-04 loss: 1.468e-01]
windy_storm:  93%|#########2| 2787/3000 [1:23:35<05:47,  1.63s/it, lr: 1.0e-04 loss: 1.468e-01]
windy_storm:  93%|#########2| 2788/3000 [1:23:35<05:42,  1.61s/it, lr: 1.0e-04 loss: 1.468e-01]
windy_storm:  93%|#########2| 2788/3000 [1:23:35<05:42,  1.61s/it, lr: 1.0e-04 loss: 1.468e-01]
windy_storm:  93%|#########2| 2788/3000 [1:23:36<05:42,  1.61s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  93%|#########2| 2788/3000 [1:23:36<05:42,  1.61s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  93%|#########2| 2789/3000 [1:23:36<04:51,  1.38s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  93%|#########2| 2789/3000 [1:23:36<04:51,  1.38s/it, lr: 1.0e-04 loss: 5.220e-01]
windy_storm:  93%|#########2| 2789/3000 [1:23:38<04:51,  1.38s/it, lr: 1.0e-04 loss: 4.889e-01]
windy_storm:  93%|#########2| 2789/3000 [1:23:38<04:51,  1.38s/it, lr: 1.0e-04 loss: 4.889e-01]
windy_storm:  93%|#########3| 2790/3000 [1:23:38<04:50,  1.38s/it, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  93%|#########3| 2790/3000 [1:23:38<04:50,  1.38s/it, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  93%|#########3| 2791/3000 [1:23:38<03:16,  1.06it/s, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  93%|#########3| 2791/3000 [1:23:38<03:16,  1.06it/s, lr: 1.0e-04 loss: 1.518e-01]
windy_storm:  93%|#########3| 2791/3000 [1:23:40<03:16,  1.06it/s, lr: 1.0e-04 loss: 5.509e-01]
windy_storm:  93%|#########3| 2791/3000 [1:23:40<03:16,  1.06it/s, lr: 1.0e-04 loss: 5.509e-01]
windy_storm:  93%|#########3| 2792/3000 [1:23:40<03:59,  1.15s/it, lr: 1.0e-04 loss: 5.509e-01]
windy_storm:  93%|#########3| 2792/3000 [1:23:40<03:59,  1.15s/it, lr: 1.0e-04 loss: 5.509e-01]
windy_storm:  93%|#########3| 2792/3000 [1:23:43<03:59,  1.15s/it, lr: 1.0e-04 loss: 1.667e-01]
windy_storm:  93%|#########3| 2792/3000 [1:23:43<03:59,  1.15s/it, lr: 1.0e-04 loss: 1.667e-01]
windy_storm:  93%|#########3| 2793/3000 [1:23:43<05:39,  1.64s/it, lr: 1.0e-04 loss: 1.667e-01]
windy_storm:  93%|#########3| 2793/3000 [1:23:43<05:39,  1.64s/it, lr: 1.0e-04 loss: 1.667e-01]
windy_storm:  93%|#########3| 2793/3000 [1:23:46<05:39,  1.64s/it, lr: 1.0e-04 loss: 4.011e-01]
windy_storm:  93%|#########3| 2793/3000 [1:23:46<05:39,  1.64s/it, lr: 1.0e-04 loss: 4.011e-01]
windy_storm:  93%|#########3| 2794/3000 [1:23:46<06:52,  2.00s/it, lr: 1.0e-04 loss: 4.011e-01]
windy_storm:  93%|#########3| 2794/3000 [1:23:46<06:52,  2.00s/it, lr: 1.0e-04 loss: 4.011e-01]
windy_storm:  93%|#########3| 2794/3000 [1:23:48<06:52,  2.00s/it, lr: 1.0e-04 loss: 5.034e-01]
windy_storm:  93%|#########3| 2794/3000 [1:23:48<06:52,  2.00s/it, lr: 1.0e-04 loss: 5.034e-01]
windy_storm:  93%|#########3| 2795/3000 [1:23:48<06:26,  1.89s/it, lr: 1.0e-04 loss: 5.034e-01]
windy_storm:  93%|#########3| 2795/3000 [1:23:48<06:26,  1.89s/it, lr: 1.0e-04 loss: 5.034e-01]
windy_storm:  93%|#########3| 2795/3000 [1:23:49<06:26,  1.89s/it, lr: 1.0e-04 loss: 6.666e-01]
windy_storm:  93%|#########3| 2795/3000 [1:23:49<06:26,  1.89s/it, lr: 1.0e-04 loss: 6.666e-01]
windy_storm:  93%|#########3| 2796/3000 [1:23:49<05:18,  1.56s/it, lr: 1.0e-04 loss: 6.666e-01]
windy_storm:  93%|#########3| 2796/3000 [1:23:49<05:18,  1.56s/it, lr: 1.0e-04 loss: 6.666e-01]
windy_storm:  93%|#########3| 2796/3000 [1:23:52<05:18,  1.56s/it, lr: 1.0e-04 loss: 6.088e-01]
windy_storm:  93%|#########3| 2796/3000 [1:23:52<05:18,  1.56s/it, lr: 1.0e-04 loss: 6.088e-01]
windy_storm:  93%|#########3| 2797/3000 [1:23:52<06:43,  1.99s/it, lr: 1.0e-04 loss: 6.088e-01]
windy_storm:  93%|#########3| 2797/3000 [1:23:52<06:43,  1.99s/it, lr: 1.0e-04 loss: 6.088e-01]
windy_storm:  93%|#########3| 2797/3000 [1:23:52<06:43,  1.99s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  93%|#########3| 2797/3000 [1:23:52<06:43,  1.99s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  93%|#########3| 2798/3000 [1:23:52<05:30,  1.63s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  93%|#########3| 2798/3000 [1:23:52<05:30,  1.63s/it, lr: 1.0e-04 loss: 1.267e-01]
windy_storm:  93%|#########3| 2798/3000 [1:23:55<05:30,  1.63s/it, lr: 1.0e-04 loss: 1.843e-01]
windy_storm:  93%|#########3| 2798/3000 [1:23:55<05:30,  1.63s/it, lr: 1.0e-04 loss: 1.843e-01]
windy_storm:  93%|#########3| 2799/3000 [1:23:55<06:47,  2.03s/it, lr: 1.0e-04 loss: 1.843e-01]
windy_storm:  93%|#########3| 2799/3000 [1:23:55<06:47,  2.03s/it, lr: 1.0e-04 loss: 1.843e-01]
windy_storm:  93%|#########3| 2799/3000 [1:23:57<06:47,  2.03s/it, lr: 1.0e-04 loss: 3.987e-01]
windy_storm:  93%|#########3| 2799/3000 [1:23:57<06:47,  2.03s/it, lr: 1.0e-04 loss: 3.987e-01]
windy_storm:  93%|#########3| 2800/3000 [1:23:58<06:45,  2.03s/it, lr: 1.0e-04 loss: 7.290e-03]
windy_storm:  93%|#########3| 2800/3000 [1:23:58<06:45,  2.03s/it, lr: 1.0e-04 loss: 7.290e-03]
windy_storm:  93%|#########3| 2801/3000 [1:23:58<04:14,  1.28s/it, lr: 1.0e-04 loss: 7.290e-03]
windy_storm:  93%|#########3| 2801/3000 [1:23:58<04:14,  1.28s/it, lr: 1.0e-04 loss: 7.290e-03]
windy_storm:  93%|#########3| 2801/3000 [1:23:58<04:14,  1.28s/it, lr: 1.0e-04 loss: 6.330e-01]
windy_storm:  93%|#########3| 2801/3000 [1:23:58<04:14,  1.28s/it, lr: 1.0e-04 loss: 6.330e-01]
windy_storm:  93%|#########3| 2802/3000 [1:23:58<03:49,  1.16s/it, lr: 1.0e-04 loss: 6.330e-01]
windy_storm:  93%|#########3| 2802/3000 [1:23:58<03:49,  1.16s/it, lr: 1.0e-04 loss: 6.330e-01]
windy_storm:  93%|#########3| 2802/3000 [1:23:59<03:49,  1.16s/it, lr: 1.0e-04 loss: 5.740e-01]
windy_storm:  93%|#########3| 2802/3000 [1:23:59<03:49,  1.16s/it, lr: 1.0e-04 loss: 5.740e-01]
windy_storm:  93%|#########3| 2803/3000 [1:23:59<03:31,  1.07s/it, lr: 1.0e-04 loss: 5.740e-01]
windy_storm:  93%|#########3| 2803/3000 [1:23:59<03:31,  1.07s/it, lr: 1.0e-04 loss: 5.740e-01]
windy_storm:  93%|#########3| 2803/3000 [1:24:02<03:31,  1.07s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:  93%|#########3| 2803/3000 [1:24:02<03:31,  1.07s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:  93%|#########3| 2804/3000 [1:24:02<05:09,  1.58s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:  93%|#########3| 2804/3000 [1:24:02<05:09,  1.58s/it, lr: 1.0e-04 loss: 3.147e-01]
windy_storm:  93%|#########3| 2804/3000 [1:24:05<05:09,  1.58s/it, lr: 1.0e-04 loss: 6.697e-01]
windy_storm:  93%|#########3| 2804/3000 [1:24:05<05:09,  1.58s/it, lr: 1.0e-04 loss: 6.697e-01]
windy_storm:  94%|#########3| 2805/3000 [1:24:05<06:34,  2.02s/it, lr: 1.0e-04 loss: 6.697e-01]
windy_storm:  94%|#########3| 2805/3000 [1:24:05<06:34,  2.02s/it, lr: 1.0e-04 loss: 6.697e-01]
windy_storm:  94%|#########3| 2805/3000 [1:24:07<06:34,  2.02s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  94%|#########3| 2805/3000 [1:24:07<06:34,  2.02s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  94%|#########3| 2806/3000 [1:24:07<06:07,  1.89s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  94%|#########3| 2806/3000 [1:24:07<06:07,  1.89s/it, lr: 1.0e-04 loss: 4.281e-01]
windy_storm:  94%|#########3| 2806/3000 [1:24:08<06:07,  1.89s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  94%|#########3| 2806/3000 [1:24:08<06:07,  1.89s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  94%|#########3| 2807/3000 [1:24:08<05:02,  1.57s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  94%|#########3| 2807/3000 [1:24:08<05:02,  1.57s/it, lr: 1.0e-04 loss: 3.473e-01]
windy_storm:  94%|#########3| 2807/3000 [1:24:09<05:02,  1.57s/it, lr: 1.0e-04 loss: 1.129e-01]
windy_storm:  94%|#########3| 2807/3000 [1:24:09<05:02,  1.57s/it, lr: 1.0e-04 loss: 1.129e-01]
windy_storm:  94%|#########3| 2808/3000 [1:24:09<05:01,  1.57s/it, lr: 1.0e-04 loss: 1.129e-01]
windy_storm:  94%|#########3| 2808/3000 [1:24:09<05:01,  1.57s/it, lr: 1.0e-04 loss: 1.129e-01]
windy_storm:  94%|#########3| 2808/3000 [1:24:10<05:01,  1.57s/it, lr: 1.0e-04 loss: 2.573e-01]
windy_storm:  94%|#########3| 2808/3000 [1:24:10<05:01,  1.57s/it, lr: 1.0e-04 loss: 2.573e-01]
windy_storm:  94%|#########3| 2809/3000 [1:24:10<04:15,  1.34s/it, lr: 1.0e-04 loss: 2.573e-01]
windy_storm:  94%|#########3| 2809/3000 [1:24:10<04:15,  1.34s/it, lr: 1.0e-04 loss: 2.573e-01]
windy_storm:  94%|#########3| 2809/3000 [1:24:11<04:15,  1.34s/it, lr: 1.0e-04 loss: 2.796e-01]
windy_storm:  94%|#########3| 2809/3000 [1:24:11<04:15,  1.34s/it, lr: 1.0e-04 loss: 2.796e-01]
windy_storm:  94%|#########3| 2810/3000 [1:24:12<04:14,  1.34s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:  94%|#########3| 2810/3000 [1:24:12<04:14,  1.34s/it, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:  94%|#########3| 2811/3000 [1:24:12<02:53,  1.09it/s, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:  94%|#########3| 2811/3000 [1:24:12<02:53,  1.09it/s, lr: 1.0e-04 loss: 6.764e-01]
windy_storm:  94%|#########3| 2811/3000 [1:24:15<02:53,  1.09it/s, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  94%|#########3| 2811/3000 [1:24:15<02:53,  1.09it/s, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  94%|#########3| 2812/3000 [1:24:15<04:25,  1.41s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  94%|#########3| 2812/3000 [1:24:15<04:25,  1.41s/it, lr: 1.0e-04 loss: 1.342e-01]
windy_storm:  94%|#########3| 2812/3000 [1:24:16<04:25,  1.41s/it, lr: 1.0e-04 loss: 1.174e-01]
windy_storm:  94%|#########3| 2812/3000 [1:24:16<04:25,  1.41s/it, lr: 1.0e-04 loss: 1.174e-01]
windy_storm:  94%|#########3| 2813/3000 [1:24:16<04:31,  1.45s/it, lr: 1.0e-04 loss: 1.174e-01]
windy_storm:  94%|#########3| 2813/3000 [1:24:16<04:31,  1.45s/it, lr: 1.0e-04 loss: 1.174e-01]
windy_storm:  94%|#########3| 2813/3000 [1:24:17<04:31,  1.45s/it, lr: 1.0e-04 loss: 3.891e-01]
windy_storm:  94%|#########3| 2813/3000 [1:24:17<04:31,  1.45s/it, lr: 1.0e-04 loss: 3.891e-01]
windy_storm:  94%|#########3| 2814/3000 [1:24:17<03:54,  1.26s/it, lr: 1.0e-04 loss: 3.891e-01]
windy_storm:  94%|#########3| 2814/3000 [1:24:17<03:54,  1.26s/it, lr: 1.0e-04 loss: 3.891e-01]
windy_storm:  94%|#########3| 2814/3000 [1:24:20<03:54,  1.26s/it, lr: 1.0e-04 loss: 2.496e-01]
windy_storm:  94%|#########3| 2814/3000 [1:24:20<03:54,  1.26s/it, lr: 1.0e-04 loss: 2.496e-01]
windy_storm:  94%|#########3| 2815/3000 [1:24:20<05:22,  1.74s/it, lr: 1.0e-04 loss: 2.496e-01]
windy_storm:  94%|#########3| 2815/3000 [1:24:20<05:22,  1.74s/it, lr: 1.0e-04 loss: 2.496e-01]
windy_storm:  94%|#########3| 2815/3000 [1:24:21<05:22,  1.74s/it, lr: 1.0e-04 loss: 3.971e-01]
windy_storm:  94%|#########3| 2815/3000 [1:24:21<05:22,  1.74s/it, lr: 1.0e-04 loss: 3.971e-01]
windy_storm:  94%|#########3| 2816/3000 [1:24:21<04:32,  1.48s/it, lr: 1.0e-04 loss: 3.971e-01]
windy_storm:  94%|#########3| 2816/3000 [1:24:21<04:32,  1.48s/it, lr: 1.0e-04 loss: 3.971e-01]
windy_storm:  94%|#########3| 2816/3000 [1:24:24<04:32,  1.48s/it, lr: 1.0e-04 loss: 3.305e-01]
windy_storm:  94%|#########3| 2816/3000 [1:24:24<04:32,  1.48s/it, lr: 1.0e-04 loss: 3.305e-01]
windy_storm:  94%|#########3| 2817/3000 [1:24:24<05:50,  1.92s/it, lr: 1.0e-04 loss: 3.305e-01]
windy_storm:  94%|#########3| 2817/3000 [1:24:24<05:50,  1.92s/it, lr: 1.0e-04 loss: 3.305e-01]
windy_storm:  94%|#########3| 2817/3000 [1:24:26<05:50,  1.92s/it, lr: 1.0e-04 loss: 7.174e-01]
windy_storm:  94%|#########3| 2817/3000 [1:24:26<05:50,  1.92s/it, lr: 1.0e-04 loss: 7.174e-01]
windy_storm:  94%|#########3| 2818/3000 [1:24:26<05:39,  1.86s/it, lr: 1.0e-04 loss: 7.174e-01]
windy_storm:  94%|#########3| 2818/3000 [1:24:26<05:39,  1.86s/it, lr: 1.0e-04 loss: 7.174e-01]
windy_storm:  94%|#########3| 2818/3000 [1:24:27<05:39,  1.86s/it, lr: 1.0e-04 loss: 3.109e-01]
windy_storm:  94%|#########3| 2818/3000 [1:24:27<05:39,  1.86s/it, lr: 1.0e-04 loss: 3.109e-01]
windy_storm:  94%|#########3| 2819/3000 [1:24:27<05:20,  1.77s/it, lr: 1.0e-04 loss: 3.109e-01]
windy_storm:  94%|#########3| 2819/3000 [1:24:27<05:20,  1.77s/it, lr: 1.0e-04 loss: 3.109e-01]
windy_storm:  94%|#########3| 2819/3000 [1:24:28<05:20,  1.77s/it, lr: 1.0e-04 loss: 3.546e-01]
windy_storm:  94%|#########3| 2819/3000 [1:24:28<05:20,  1.77s/it, lr: 1.0e-04 loss: 3.546e-01]
windy_storm:  94%|#########3| 2820/3000 [1:24:29<05:18,  1.77s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  94%|#########3| 2820/3000 [1:24:29<05:18,  1.77s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  94%|#########4| 2821/3000 [1:24:29<03:56,  1.32s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  94%|#########4| 2821/3000 [1:24:29<03:56,  1.32s/it, lr: 1.0e-04 loss: 6.483e-01]
windy_storm:  94%|#########4| 2821/3000 [1:24:32<03:56,  1.32s/it, lr: 1.0e-04 loss: 6.355e-01]
windy_storm:  94%|#########4| 2821/3000 [1:24:32<03:56,  1.32s/it, lr: 1.0e-04 loss: 6.355e-01]
windy_storm:  94%|#########4| 2822/3000 [1:24:32<05:08,  1.73s/it, lr: 1.0e-04 loss: 6.355e-01]
windy_storm:  94%|#########4| 2822/3000 [1:24:32<05:08,  1.73s/it, lr: 1.0e-04 loss: 6.355e-01]
windy_storm:  94%|#########4| 2822/3000 [1:24:34<05:08,  1.73s/it, lr: 1.0e-04 loss: 2.150e-01]
windy_storm:  94%|#########4| 2822/3000 [1:24:34<05:08,  1.73s/it, lr: 1.0e-04 loss: 2.150e-01]
windy_storm:  94%|#########4| 2823/3000 [1:24:34<04:59,  1.69s/it, lr: 1.0e-04 loss: 2.150e-01]
windy_storm:  94%|#########4| 2823/3000 [1:24:34<04:59,  1.69s/it, lr: 1.0e-04 loss: 2.150e-01]
windy_storm:  94%|#########4| 2823/3000 [1:24:36<04:59,  1.69s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  94%|#########4| 2823/3000 [1:24:36<04:59,  1.69s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  94%|#########4| 2824/3000 [1:24:36<04:51,  1.65s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  94%|#########4| 2824/3000 [1:24:36<04:51,  1.65s/it, lr: 1.0e-04 loss: 6.911e-01]
windy_storm:  94%|#########4| 2824/3000 [1:24:37<04:51,  1.65s/it, lr: 1.0e-04 loss: 3.234e-01]
windy_storm:  94%|#########4| 2824/3000 [1:24:37<04:51,  1.65s/it, lr: 1.0e-04 loss: 3.234e-01]
windy_storm:  94%|#########4| 2825/3000 [1:24:37<04:42,  1.61s/it, lr: 1.0e-04 loss: 3.234e-01]
windy_storm:  94%|#########4| 2825/3000 [1:24:37<04:42,  1.61s/it, lr: 1.0e-04 loss: 3.234e-01]
windy_storm:  94%|#########4| 2825/3000 [1:24:39<04:42,  1.61s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  94%|#########4| 2825/3000 [1:24:39<04:42,  1.61s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  94%|#########4| 2826/3000 [1:24:39<04:38,  1.60s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  94%|#########4| 2826/3000 [1:24:39<04:38,  1.60s/it, lr: 1.0e-04 loss: 2.073e-01]
windy_storm:  94%|#########4| 2826/3000 [1:24:42<04:38,  1.60s/it, lr: 1.0e-04 loss: 6.715e-01]
windy_storm:  94%|#########4| 2826/3000 [1:24:42<04:38,  1.60s/it, lr: 1.0e-04 loss: 6.715e-01]
windy_storm:  94%|#########4| 2827/3000 [1:24:42<05:43,  1.98s/it, lr: 1.0e-04 loss: 6.715e-01]
windy_storm:  94%|#########4| 2827/3000 [1:24:42<05:43,  1.98s/it, lr: 1.0e-04 loss: 6.715e-01]
windy_storm:  94%|#########4| 2827/3000 [1:24:44<05:43,  1.98s/it, lr: 1.0e-04 loss: 7.949e-02]
windy_storm:  94%|#########4| 2827/3000 [1:24:44<05:43,  1.98s/it, lr: 1.0e-04 loss: 7.949e-02]
windy_storm:  94%|#########4| 2828/3000 [1:24:44<06:28,  2.26s/it, lr: 1.0e-04 loss: 7.949e-02]
windy_storm:  94%|#########4| 2828/3000 [1:24:44<06:28,  2.26s/it, lr: 1.0e-04 loss: 7.949e-02]
windy_storm:  94%|#########4| 2828/3000 [1:24:45<06:28,  2.26s/it, lr: 1.0e-04 loss: 4.190e-01]
windy_storm:  94%|#########4| 2828/3000 [1:24:45<06:28,  2.26s/it, lr: 1.0e-04 loss: 4.190e-01]
windy_storm:  94%|#########4| 2829/3000 [1:24:45<05:10,  1.82s/it, lr: 1.0e-04 loss: 4.190e-01]
windy_storm:  94%|#########4| 2829/3000 [1:24:45<05:10,  1.82s/it, lr: 1.0e-04 loss: 4.190e-01]
windy_storm:  94%|#########4| 2829/3000 [1:24:48<05:10,  1.82s/it, lr: 1.0e-04 loss: 1.481e-01]
windy_storm:  94%|#########4| 2829/3000 [1:24:48<05:10,  1.82s/it, lr: 1.0e-04 loss: 1.481e-01]
windy_storm:  94%|#########4| 2830/3000 [1:24:50<05:08,  1.82s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:  94%|#########4| 2830/3000 [1:24:50<05:08,  1.82s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:  94%|#########4| 2831/3000 [1:24:50<03:47,  1.34s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:  94%|#########4| 2831/3000 [1:24:50<03:47,  1.34s/it, lr: 1.0e-04 loss: 3.551e-01]
windy_storm:  94%|#########4| 2831/3000 [1:24:51<03:47,  1.34s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  94%|#########4| 2831/3000 [1:24:51<03:47,  1.34s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  94%|#########4| 2832/3000 [1:24:51<03:55,  1.40s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  94%|#########4| 2832/3000 [1:24:51<03:55,  1.40s/it, lr: 1.0e-04 loss: 4.715e-01]
windy_storm:  94%|#########4| 2832/3000 [1:24:54<03:55,  1.40s/it, lr: 1.0e-04 loss: 5.262e-01]
windy_storm:  94%|#########4| 2832/3000 [1:24:54<03:55,  1.40s/it, lr: 1.0e-04 loss: 5.262e-01]
windy_storm:  94%|#########4| 2833/3000 [1:24:54<05:02,  1.81s/it, lr: 1.0e-04 loss: 5.262e-01]
windy_storm:  94%|#########4| 2833/3000 [1:24:54<05:02,  1.81s/it, lr: 1.0e-04 loss: 5.262e-01]
windy_storm:  94%|#########4| 2833/3000 [1:24:55<05:02,  1.81s/it, lr: 1.0e-04 loss: 4.171e-01]
windy_storm:  94%|#########4| 2833/3000 [1:24:55<05:02,  1.81s/it, lr: 1.0e-04 loss: 4.171e-01]
windy_storm:  94%|#########4| 2834/3000 [1:24:55<04:15,  1.54s/it, lr: 1.0e-04 loss: 4.171e-01]
windy_storm:  94%|#########4| 2834/3000 [1:24:55<04:15,  1.54s/it, lr: 1.0e-04 loss: 4.171e-01]
windy_storm:  94%|#########4| 2834/3000 [1:24:56<04:15,  1.54s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  94%|#########4| 2834/3000 [1:24:56<04:15,  1.54s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  94%|#########4| 2835/3000 [1:24:56<03:40,  1.34s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  94%|#########4| 2835/3000 [1:24:56<03:40,  1.34s/it, lr: 1.0e-04 loss: 4.423e-01]
windy_storm:  94%|#########4| 2835/3000 [1:24:57<03:40,  1.34s/it, lr: 1.0e-04 loss: 6.139e-01]
windy_storm:  94%|#########4| 2835/3000 [1:24:57<03:40,  1.34s/it, lr: 1.0e-04 loss: 6.139e-01]
windy_storm:  95%|#########4| 2836/3000 [1:24:57<03:14,  1.19s/it, lr: 1.0e-04 loss: 6.139e-01]
windy_storm:  95%|#########4| 2836/3000 [1:24:57<03:14,  1.19s/it, lr: 1.0e-04 loss: 6.139e-01]
windy_storm:  95%|#########4| 2836/3000 [1:24:58<03:14,  1.19s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:  95%|#########4| 2836/3000 [1:24:58<03:14,  1.19s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:  95%|#########4| 2837/3000 [1:24:58<03:32,  1.30s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:  95%|#########4| 2837/3000 [1:24:58<03:32,  1.30s/it, lr: 1.0e-04 loss: 5.450e-01]
windy_storm:  95%|#########4| 2837/3000 [1:25:01<03:32,  1.30s/it, lr: 1.0e-04 loss: 3.311e-01]
windy_storm:  95%|#########4| 2837/3000 [1:25:01<03:32,  1.30s/it, lr: 1.0e-04 loss: 3.311e-01]
windy_storm:  95%|#########4| 2838/3000 [1:25:01<04:51,  1.80s/it, lr: 1.0e-04 loss: 3.311e-01]
windy_storm:  95%|#########4| 2838/3000 [1:25:01<04:51,  1.80s/it, lr: 1.0e-04 loss: 3.311e-01]
windy_storm:  95%|#########4| 2838/3000 [1:25:04<04:51,  1.80s/it, lr: 1.0e-04 loss: 2.748e-01]
windy_storm:  95%|#########4| 2838/3000 [1:25:04<04:51,  1.80s/it, lr: 1.0e-04 loss: 2.748e-01]
windy_storm:  95%|#########4| 2839/3000 [1:25:04<05:45,  2.15s/it, lr: 1.0e-04 loss: 2.748e-01]
windy_storm:  95%|#########4| 2839/3000 [1:25:04<05:45,  2.15s/it, lr: 1.0e-04 loss: 2.748e-01]
windy_storm:  95%|#########4| 2839/3000 [1:25:07<05:45,  2.15s/it, lr: 1.0e-04 loss: 5.228e-01]
windy_storm:  95%|#########4| 2839/3000 [1:25:07<05:45,  2.15s/it, lr: 1.0e-04 loss: 5.228e-01]
windy_storm:  95%|#########4| 2840/3000 [1:25:10<05:43,  2.15s/it, lr: 1.0e-04 loss: 4.401e-01]
windy_storm:  95%|#########4| 2840/3000 [1:25:10<05:43,  2.15s/it, lr: 1.0e-04 loss: 4.401e-01]
windy_storm:  95%|#########4| 2841/3000 [1:25:10<04:52,  1.84s/it, lr: 1.0e-04 loss: 4.401e-01]
windy_storm:  95%|#########4| 2841/3000 [1:25:10<04:52,  1.84s/it, lr: 1.0e-04 loss: 4.401e-01]
windy_storm:  95%|#########4| 2841/3000 [1:25:11<04:52,  1.84s/it, lr: 1.0e-04 loss: 6.096e-01]
windy_storm:  95%|#########4| 2841/3000 [1:25:11<04:52,  1.84s/it, lr: 1.0e-04 loss: 6.096e-01]
windy_storm:  95%|#########4| 2842/3000 [1:25:11<04:10,  1.58s/it, lr: 1.0e-04 loss: 6.096e-01]
windy_storm:  95%|#########4| 2842/3000 [1:25:11<04:10,  1.58s/it, lr: 1.0e-04 loss: 6.096e-01]
windy_storm:  95%|#########4| 2842/3000 [1:25:13<04:10,  1.58s/it, lr: 1.0e-04 loss: 5.775e-02]
windy_storm:  95%|#########4| 2842/3000 [1:25:13<04:10,  1.58s/it, lr: 1.0e-04 loss: 5.775e-02]
windy_storm:  95%|#########4| 2843/3000 [1:25:13<04:08,  1.58s/it, lr: 1.0e-04 loss: 5.775e-02]
windy_storm:  95%|#########4| 2843/3000 [1:25:13<04:08,  1.58s/it, lr: 1.0e-04 loss: 5.775e-02]
windy_storm:  95%|#########4| 2843/3000 [1:25:14<04:08,  1.58s/it, lr: 1.0e-04 loss: 5.684e-01]
windy_storm:  95%|#########4| 2843/3000 [1:25:14<04:08,  1.58s/it, lr: 1.0e-04 loss: 5.684e-01]
windy_storm:  95%|#########4| 2844/3000 [1:25:14<04:05,  1.57s/it, lr: 1.0e-04 loss: 5.684e-01]
windy_storm:  95%|#########4| 2844/3000 [1:25:14<04:05,  1.57s/it, lr: 1.0e-04 loss: 5.684e-01]
windy_storm:  95%|#########4| 2844/3000 [1:25:16<04:05,  1.57s/it, lr: 1.0e-04 loss: 3.455e-01]
windy_storm:  95%|#########4| 2844/3000 [1:25:16<04:05,  1.57s/it, lr: 1.0e-04 loss: 3.455e-01]
windy_storm:  95%|#########4| 2845/3000 [1:25:16<04:03,  1.57s/it, lr: 1.0e-04 loss: 3.455e-01]
windy_storm:  95%|#########4| 2845/3000 [1:25:16<04:03,  1.57s/it, lr: 1.0e-04 loss: 3.455e-01]
windy_storm:  95%|#########4| 2845/3000 [1:25:17<04:03,  1.57s/it, lr: 1.0e-04 loss: 6.319e-02]
windy_storm:  95%|#########4| 2845/3000 [1:25:17<04:03,  1.57s/it, lr: 1.0e-04 loss: 6.319e-02]
windy_storm:  95%|#########4| 2846/3000 [1:25:17<03:25,  1.34s/it, lr: 1.0e-04 loss: 6.319e-02]
windy_storm:  95%|#########4| 2846/3000 [1:25:17<03:25,  1.34s/it, lr: 1.0e-04 loss: 6.319e-02]
windy_storm:  95%|#########4| 2846/3000 [1:25:18<03:25,  1.34s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  95%|#########4| 2846/3000 [1:25:18<03:25,  1.34s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  95%|#########4| 2847/3000 [1:25:18<03:12,  1.26s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  95%|#########4| 2847/3000 [1:25:18<03:12,  1.26s/it, lr: 1.0e-04 loss: 1.930e-01]
windy_storm:  95%|#########4| 2847/3000 [1:25:18<03:12,  1.26s/it, lr: 1.0e-04 loss: 5.642e-01]
windy_storm:  95%|#########4| 2847/3000 [1:25:18<03:12,  1.26s/it, lr: 1.0e-04 loss: 5.642e-01]
windy_storm:  95%|#########4| 2848/3000 [1:25:18<02:51,  1.13s/it, lr: 1.0e-04 loss: 5.642e-01]
windy_storm:  95%|#########4| 2848/3000 [1:25:18<02:51,  1.13s/it, lr: 1.0e-04 loss: 5.642e-01]
windy_storm:  95%|#########4| 2848/3000 [1:25:20<02:51,  1.13s/it, lr: 1.0e-04 loss: 1.768e-01]
windy_storm:  95%|#########4| 2848/3000 [1:25:20<02:51,  1.13s/it, lr: 1.0e-04 loss: 1.768e-01]
windy_storm:  95%|#########4| 2849/3000 [1:25:20<03:10,  1.26s/it, lr: 1.0e-04 loss: 1.768e-01]
windy_storm:  95%|#########4| 2849/3000 [1:25:20<03:10,  1.26s/it, lr: 1.0e-04 loss: 1.768e-01]
windy_storm:  95%|#########4| 2849/3000 [1:25:22<03:10,  1.26s/it, lr: 1.0e-04 loss: 3.494e-02]
windy_storm:  95%|#########4| 2849/3000 [1:25:22<03:10,  1.26s/it, lr: 1.0e-04 loss: 3.494e-02]
windy_storm:  95%|#########5| 2850/3000 [1:25:23<03:09,  1.26s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  95%|#########5| 2850/3000 [1:25:23<03:09,  1.26s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  95%|#########5| 2851/3000 [1:25:23<02:35,  1.04s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  95%|#########5| 2851/3000 [1:25:23<02:35,  1.04s/it, lr: 1.0e-04 loss: 2.006e-01]
windy_storm:  95%|#########5| 2851/3000 [1:25:26<02:35,  1.04s/it, lr: 1.0e-04 loss: 4.768e-01]
windy_storm:  95%|#########5| 2851/3000 [1:25:26<02:35,  1.04s/it, lr: 1.0e-04 loss: 4.768e-01]
windy_storm:  95%|#########5| 2852/3000 [1:25:26<03:41,  1.50s/it, lr: 1.0e-04 loss: 4.768e-01]
windy_storm:  95%|#########5| 2852/3000 [1:25:26<03:41,  1.50s/it, lr: 1.0e-04 loss: 4.768e-01]
windy_storm:  95%|#########5| 2852/3000 [1:25:29<03:41,  1.50s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  95%|#########5| 2852/3000 [1:25:29<03:41,  1.50s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  95%|#########5| 2853/3000 [1:25:29<04:34,  1.87s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  95%|#########5| 2853/3000 [1:25:29<04:34,  1.87s/it, lr: 1.0e-04 loss: 6.077e-01]
windy_storm:  95%|#########5| 2853/3000 [1:25:30<04:34,  1.87s/it, lr: 1.0e-04 loss: 7.048e-01]
windy_storm:  95%|#########5| 2853/3000 [1:25:30<04:34,  1.87s/it, lr: 1.0e-04 loss: 7.048e-01]
windy_storm:  95%|#########5| 2854/3000 [1:25:30<04:21,  1.79s/it, lr: 1.0e-04 loss: 7.048e-01]
windy_storm:  95%|#########5| 2854/3000 [1:25:30<04:21,  1.79s/it, lr: 1.0e-04 loss: 7.048e-01]
windy_storm:  95%|#########5| 2854/3000 [1:25:32<04:21,  1.79s/it, lr: 1.0e-04 loss: 6.533e-01]
windy_storm:  95%|#########5| 2854/3000 [1:25:32<04:21,  1.79s/it, lr: 1.0e-04 loss: 6.533e-01]
windy_storm:  95%|#########5| 2855/3000 [1:25:32<04:10,  1.72s/it, lr: 1.0e-04 loss: 6.533e-01]
windy_storm:  95%|#########5| 2855/3000 [1:25:32<04:10,  1.72s/it, lr: 1.0e-04 loss: 6.533e-01]
windy_storm:  95%|#########5| 2855/3000 [1:25:33<04:10,  1.72s/it, lr: 1.0e-04 loss: 2.498e-01]
windy_storm:  95%|#########5| 2855/3000 [1:25:33<04:10,  1.72s/it, lr: 1.0e-04 loss: 2.498e-01]
windy_storm:  95%|#########5| 2856/3000 [1:25:33<03:31,  1.47s/it, lr: 1.0e-04 loss: 2.498e-01]
windy_storm:  95%|#########5| 2856/3000 [1:25:33<03:31,  1.47s/it, lr: 1.0e-04 loss: 2.498e-01]
windy_storm:  95%|#########5| 2856/3000 [1:25:36<03:31,  1.47s/it, lr: 1.0e-04 loss: 2.362e-01]
windy_storm:  95%|#########5| 2856/3000 [1:25:36<03:31,  1.47s/it, lr: 1.0e-04 loss: 2.362e-01]
windy_storm:  95%|#########5| 2857/3000 [1:25:36<04:33,  1.91s/it, lr: 1.0e-04 loss: 2.362e-01]
windy_storm:  95%|#########5| 2857/3000 [1:25:36<04:33,  1.91s/it, lr: 1.0e-04 loss: 2.362e-01]
windy_storm:  95%|#########5| 2857/3000 [1:25:37<04:33,  1.91s/it, lr: 1.0e-04 loss: 2.191e-01]
windy_storm:  95%|#########5| 2857/3000 [1:25:37<04:33,  1.91s/it, lr: 1.0e-04 loss: 2.191e-01]
windy_storm:  95%|#########5| 2858/3000 [1:25:37<04:17,  1.81s/it, lr: 1.0e-04 loss: 2.191e-01]
windy_storm:  95%|#########5| 2858/3000 [1:25:37<04:17,  1.81s/it, lr: 1.0e-04 loss: 2.191e-01]
windy_storm:  95%|#########5| 2858/3000 [1:25:38<04:17,  1.81s/it, lr: 1.0e-04 loss: 2.230e-02]
windy_storm:  95%|#########5| 2858/3000 [1:25:38<04:17,  1.81s/it, lr: 1.0e-04 loss: 2.230e-02]
windy_storm:  95%|#########5| 2859/3000 [1:25:38<03:31,  1.50s/it, lr: 1.0e-04 loss: 2.230e-02]
windy_storm:  95%|#########5| 2859/3000 [1:25:38<03:31,  1.50s/it, lr: 1.0e-04 loss: 2.230e-02]
windy_storm:  95%|#########5| 2859/3000 [1:25:39<03:31,  1.50s/it, lr: 1.0e-04 loss: 5.651e-01]
windy_storm:  95%|#########5| 2859/3000 [1:25:39<03:31,  1.50s/it, lr: 1.0e-04 loss: 5.651e-01]
windy_storm:  95%|#########5| 2860/3000 [1:25:42<03:30,  1.50s/it, lr: 1.0e-04 loss: 3.052e-01]
windy_storm:  95%|#########5| 2860/3000 [1:25:42<03:30,  1.50s/it, lr: 1.0e-04 loss: 3.052e-01]
windy_storm:  95%|#########5| 2861/3000 [1:25:42<03:26,  1.49s/it, lr: 1.0e-04 loss: 3.052e-01]
windy_storm:  95%|#########5| 2861/3000 [1:25:42<03:26,  1.49s/it, lr: 1.0e-04 loss: 3.052e-01]
windy_storm:  95%|#########5| 2861/3000 [1:25:43<03:26,  1.49s/it, lr: 1.0e-04 loss: 5.957e-01]
windy_storm:  95%|#########5| 2861/3000 [1:25:43<03:26,  1.49s/it, lr: 1.0e-04 loss: 5.957e-01]
windy_storm:  95%|#########5| 2862/3000 [1:25:43<03:02,  1.32s/it, lr: 1.0e-04 loss: 5.957e-01]
windy_storm:  95%|#########5| 2862/3000 [1:25:43<03:02,  1.32s/it, lr: 1.0e-04 loss: 5.957e-01]
windy_storm:  95%|#########5| 2862/3000 [1:25:44<03:02,  1.32s/it, lr: 1.0e-04 loss: 2.133e-01]
windy_storm:  95%|#########5| 2862/3000 [1:25:44<03:02,  1.32s/it, lr: 1.0e-04 loss: 2.133e-01]
windy_storm:  95%|#########5| 2863/3000 [1:25:44<02:41,  1.18s/it, lr: 1.0e-04 loss: 2.133e-01]
windy_storm:  95%|#########5| 2863/3000 [1:25:44<02:41,  1.18s/it, lr: 1.0e-04 loss: 2.133e-01]
windy_storm:  95%|#########5| 2863/3000 [1:25:45<02:41,  1.18s/it, lr: 1.0e-04 loss: 7.076e-01]
windy_storm:  95%|#########5| 2863/3000 [1:25:45<02:41,  1.18s/it, lr: 1.0e-04 loss: 7.076e-01]
windy_storm:  95%|#########5| 2864/3000 [1:25:45<02:24,  1.07s/it, lr: 1.0e-04 loss: 7.076e-01]
windy_storm:  95%|#########5| 2864/3000 [1:25:45<02:24,  1.07s/it, lr: 1.0e-04 loss: 7.076e-01]
windy_storm:  95%|#########5| 2864/3000 [1:25:47<02:24,  1.07s/it, lr: 1.0e-04 loss: 5.518e-01]
windy_storm:  95%|#########5| 2864/3000 [1:25:47<02:24,  1.07s/it, lr: 1.0e-04 loss: 5.518e-01]
windy_storm:  96%|#########5| 2865/3000 [1:25:47<03:33,  1.58s/it, lr: 1.0e-04 loss: 5.518e-01]
windy_storm:  96%|#########5| 2865/3000 [1:25:47<03:33,  1.58s/it, lr: 1.0e-04 loss: 5.518e-01]
windy_storm:  96%|#########5| 2865/3000 [1:25:49<03:33,  1.58s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  96%|#########5| 2865/3000 [1:25:49<03:33,  1.58s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  96%|#########5| 2866/3000 [1:25:49<03:31,  1.58s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  96%|#########5| 2866/3000 [1:25:49<03:31,  1.58s/it, lr: 1.0e-04 loss: 3.138e-01]
windy_storm:  96%|#########5| 2866/3000 [1:25:50<03:31,  1.58s/it, lr: 1.0e-04 loss: 5.824e-01]
windy_storm:  96%|#########5| 2866/3000 [1:25:50<03:31,  1.58s/it, lr: 1.0e-04 loss: 5.824e-01]
windy_storm:  96%|#########5| 2867/3000 [1:25:50<03:00,  1.36s/it, lr: 1.0e-04 loss: 5.824e-01]
windy_storm:  96%|#########5| 2867/3000 [1:25:50<03:00,  1.36s/it, lr: 1.0e-04 loss: 5.824e-01]
windy_storm:  96%|#########5| 2867/3000 [1:25:51<03:00,  1.36s/it, lr: 1.0e-04 loss: 1.487e-01]
windy_storm:  96%|#########5| 2867/3000 [1:25:51<03:00,  1.36s/it, lr: 1.0e-04 loss: 1.487e-01]
windy_storm:  96%|#########5| 2868/3000 [1:25:51<02:36,  1.19s/it, lr: 1.0e-04 loss: 1.487e-01]
windy_storm:  96%|#########5| 2868/3000 [1:25:51<02:36,  1.19s/it, lr: 1.0e-04 loss: 1.487e-01]
windy_storm:  96%|#########5| 2868/3000 [1:25:54<02:36,  1.19s/it, lr: 1.0e-04 loss: 1.666e-02]
windy_storm:  96%|#########5| 2868/3000 [1:25:54<02:36,  1.19s/it, lr: 1.0e-04 loss: 1.666e-02]
windy_storm:  96%|#########5| 2869/3000 [1:25:54<03:44,  1.72s/it, lr: 1.0e-04 loss: 1.666e-02]
windy_storm:  96%|#########5| 2869/3000 [1:25:54<03:44,  1.72s/it, lr: 1.0e-04 loss: 1.666e-02]
windy_storm:  96%|#########5| 2869/3000 [1:25:55<03:44,  1.72s/it, lr: 1.0e-04 loss: 6.767e-01]
windy_storm:  96%|#########5| 2869/3000 [1:25:55<03:44,  1.72s/it, lr: 1.0e-04 loss: 6.767e-01]
windy_storm:  96%|#########5| 2870/3000 [1:25:58<03:43,  1.72s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  96%|#########5| 2870/3000 [1:25:58<03:43,  1.72s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  96%|#########5| 2871/3000 [1:25:58<03:28,  1.62s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  96%|#########5| 2871/3000 [1:25:58<03:28,  1.62s/it, lr: 1.0e-04 loss: 5.894e-01]
windy_storm:  96%|#########5| 2871/3000 [1:26:01<03:28,  1.62s/it, lr: 1.0e-04 loss: 6.039e-01]
windy_storm:  96%|#########5| 2871/3000 [1:26:01<03:28,  1.62s/it, lr: 1.0e-04 loss: 6.039e-01]
windy_storm:  96%|#########5| 2872/3000 [1:26:01<04:08,  1.94s/it, lr: 1.0e-04 loss: 6.039e-01]
windy_storm:  96%|#########5| 2872/3000 [1:26:01<04:08,  1.94s/it, lr: 1.0e-04 loss: 6.039e-01]
windy_storm:  96%|#########5| 2872/3000 [1:26:04<04:08,  1.94s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:  96%|#########5| 2872/3000 [1:26:04<04:08,  1.94s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:  96%|#########5| 2873/3000 [1:26:04<04:43,  2.23s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:  96%|#########5| 2873/3000 [1:26:04<04:43,  2.23s/it, lr: 1.0e-04 loss: 2.232e-01]
windy_storm:  96%|#########5| 2873/3000 [1:26:06<04:43,  2.23s/it, lr: 1.0e-04 loss: 1.991e-01]
windy_storm:  96%|#########5| 2873/3000 [1:26:06<04:43,  2.23s/it, lr: 1.0e-04 loss: 1.991e-01]
windy_storm:  96%|#########5| 2874/3000 [1:26:06<04:18,  2.05s/it, lr: 1.0e-04 loss: 1.991e-01]
windy_storm:  96%|#########5| 2874/3000 [1:26:06<04:18,  2.05s/it, lr: 1.0e-04 loss: 1.991e-01]
windy_storm:  96%|#########5| 2874/3000 [1:26:09<04:18,  2.05s/it, lr: 1.0e-04 loss: 1.034e-01]
windy_storm:  96%|#########5| 2874/3000 [1:26:09<04:18,  2.05s/it, lr: 1.0e-04 loss: 1.034e-01]
windy_storm:  96%|#########5| 2875/3000 [1:26:09<04:50,  2.32s/it, lr: 1.0e-04 loss: 1.034e-01]
windy_storm:  96%|#########5| 2875/3000 [1:26:09<04:50,  2.32s/it, lr: 1.0e-04 loss: 1.034e-01]
windy_storm:  96%|#########5| 2875/3000 [1:26:10<04:50,  2.32s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  96%|#########5| 2875/3000 [1:26:10<04:50,  2.32s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  96%|#########5| 2876/3000 [1:26:10<04:21,  2.11s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  96%|#########5| 2876/3000 [1:26:10<04:21,  2.11s/it, lr: 1.0e-04 loss: 6.553e-01]
windy_storm:  96%|#########5| 2876/3000 [1:26:13<04:21,  2.11s/it, lr: 1.0e-04 loss: 2.241e-01]
windy_storm:  96%|#########5| 2876/3000 [1:26:13<04:21,  2.11s/it, lr: 1.0e-04 loss: 2.241e-01]
windy_storm:  96%|#########5| 2877/3000 [1:26:13<04:51,  2.37s/it, lr: 1.0e-04 loss: 2.241e-01]
windy_storm:  96%|#########5| 2877/3000 [1:26:13<04:51,  2.37s/it, lr: 1.0e-04 loss: 2.241e-01]
windy_storm:  96%|#########5| 2877/3000 [1:26:16<04:51,  2.37s/it, lr: 1.0e-04 loss: 6.327e-02]
windy_storm:  96%|#########5| 2877/3000 [1:26:16<04:51,  2.37s/it, lr: 1.0e-04 loss: 6.327e-02]
windy_storm:  96%|#########5| 2878/3000 [1:26:16<05:11,  2.56s/it, lr: 1.0e-04 loss: 6.327e-02]
windy_storm:  96%|#########5| 2878/3000 [1:26:16<05:11,  2.56s/it, lr: 1.0e-04 loss: 6.327e-02]
windy_storm:  96%|#########5| 2878/3000 [1:26:17<05:11,  2.56s/it, lr: 1.0e-04 loss: 5.182e-01]
windy_storm:  96%|#########5| 2878/3000 [1:26:17<05:11,  2.56s/it, lr: 1.0e-04 loss: 5.182e-01]
windy_storm:  96%|#########5| 2879/3000 [1:26:17<04:05,  2.03s/it, lr: 1.0e-04 loss: 5.182e-01]
windy_storm:  96%|#########5| 2879/3000 [1:26:17<04:05,  2.03s/it, lr: 1.0e-04 loss: 5.182e-01]
windy_storm:  96%|#########5| 2879/3000 [1:26:18<04:05,  2.03s/it, lr: 1.0e-04 loss: 8.630e-02]
windy_storm:  96%|#########5| 2879/3000 [1:26:18<04:05,  2.03s/it, lr: 1.0e-04 loss: 8.630e-02]
windy_storm:  96%|#########6| 2880/3000 [1:26:19<04:03,  2.03s/it, lr: 1.0e-04 loss: 5.702e-01]
windy_storm:  96%|#########6| 2880/3000 [1:26:19<04:03,  2.03s/it, lr: 1.0e-04 loss: 5.702e-01]
windy_storm:  96%|#########6| 2881/3000 [1:26:19<02:31,  1.28s/it, lr: 1.0e-04 loss: 5.702e-01]
windy_storm:  96%|#########6| 2881/3000 [1:26:19<02:31,  1.28s/it, lr: 1.0e-04 loss: 5.702e-01]
windy_storm:  96%|#########6| 2881/3000 [1:26:20<02:31,  1.28s/it, lr: 1.0e-04 loss: 1.669e-01]
windy_storm:  96%|#########6| 2881/3000 [1:26:20<02:31,  1.28s/it, lr: 1.0e-04 loss: 1.669e-01]
windy_storm:  96%|#########6| 2882/3000 [1:26:20<02:15,  1.15s/it, lr: 1.0e-04 loss: 1.669e-01]
windy_storm:  96%|#########6| 2882/3000 [1:26:20<02:15,  1.15s/it, lr: 1.0e-04 loss: 1.669e-01]
windy_storm:  96%|#########6| 2882/3000 [1:26:21<02:15,  1.15s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  96%|#########6| 2882/3000 [1:26:21<02:15,  1.15s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  96%|#########6| 2883/3000 [1:26:21<02:02,  1.04s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  96%|#########6| 2883/3000 [1:26:21<02:02,  1.04s/it, lr: 1.0e-04 loss: 1.179e-01]
windy_storm:  96%|#########6| 2883/3000 [1:26:22<02:02,  1.04s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  96%|#########6| 2883/3000 [1:26:22<02:02,  1.04s/it, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  96%|#########6| 2884/3000 [1:26:22<01:54,  1.01it/s, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  96%|#########6| 2884/3000 [1:26:22<01:54,  1.01it/s, lr: 1.0e-04 loss: 3.452e-01]
windy_storm:  96%|#########6| 2884/3000 [1:26:23<01:54,  1.01it/s, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  96%|#########6| 2884/3000 [1:26:23<01:54,  1.01it/s, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  96%|#########6| 2885/3000 [1:26:23<02:12,  1.15s/it, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  96%|#########6| 2885/3000 [1:26:23<02:12,  1.15s/it, lr: 1.0e-04 loss: 6.160e-01]
windy_storm:  96%|#########6| 2885/3000 [1:26:26<02:12,  1.15s/it, lr: 1.0e-04 loss: 6.841e-01]
windy_storm:  96%|#########6| 2885/3000 [1:26:26<02:12,  1.15s/it, lr: 1.0e-04 loss: 6.841e-01]
windy_storm:  96%|#########6| 2886/3000 [1:26:26<03:10,  1.67s/it, lr: 1.0e-04 loss: 6.841e-01]
windy_storm:  96%|#########6| 2886/3000 [1:26:26<03:10,  1.67s/it, lr: 1.0e-04 loss: 6.841e-01]
windy_storm:  96%|#########6| 2886/3000 [1:26:28<03:10,  1.67s/it, lr: 1.0e-04 loss: 2.650e-01]
windy_storm:  96%|#########6| 2886/3000 [1:26:28<03:10,  1.67s/it, lr: 1.0e-04 loss: 2.650e-01]
windy_storm:  96%|#########6| 2887/3000 [1:26:28<03:06,  1.65s/it, lr: 1.0e-04 loss: 2.650e-01]
windy_storm:  96%|#########6| 2887/3000 [1:26:28<03:06,  1.65s/it, lr: 1.0e-04 loss: 2.650e-01]
windy_storm:  96%|#########6| 2887/3000 [1:26:31<03:06,  1.65s/it, lr: 1.0e-04 loss: 4.526e-01]
windy_storm:  96%|#########6| 2887/3000 [1:26:31<03:06,  1.65s/it, lr: 1.0e-04 loss: 4.526e-01]
windy_storm:  96%|#########6| 2888/3000 [1:26:31<03:54,  2.10s/it, lr: 1.0e-04 loss: 4.526e-01]
windy_storm:  96%|#########6| 2888/3000 [1:26:31<03:54,  2.10s/it, lr: 1.0e-04 loss: 4.526e-01]
windy_storm:  96%|#########6| 2888/3000 [1:26:34<03:54,  2.10s/it, lr: 1.0e-04 loss: 2.581e-01]
windy_storm:  96%|#########6| 2888/3000 [1:26:34<03:54,  2.10s/it, lr: 1.0e-04 loss: 2.581e-01]
windy_storm:  96%|#########6| 2889/3000 [1:26:34<04:23,  2.37s/it, lr: 1.0e-04 loss: 2.581e-01]
windy_storm:  96%|#########6| 2889/3000 [1:26:34<04:23,  2.37s/it, lr: 1.0e-04 loss: 2.581e-01]
windy_storm:  96%|#########6| 2889/3000 [1:26:35<04:23,  2.37s/it, lr: 1.0e-04 loss: 6.713e-02]
windy_storm:  96%|#########6| 2889/3000 [1:26:35<04:23,  2.37s/it, lr: 1.0e-04 loss: 6.713e-02]
windy_storm:  96%|#########6| 2890/3000 [1:26:38<04:21,  2.37s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  96%|#########6| 2890/3000 [1:26:38<04:21,  2.37s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  96%|#########6| 2891/3000 [1:26:38<03:36,  1.98s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  96%|#########6| 2891/3000 [1:26:38<03:36,  1.98s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  96%|#########6| 2891/3000 [1:26:39<03:36,  1.98s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2891/3000 [1:26:39<03:36,  1.98s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2892/3000 [1:26:39<03:23,  1.88s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2892/3000 [1:26:39<03:23,  1.88s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2892/3000 [1:26:40<03:23,  1.88s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  96%|#########6| 2892/3000 [1:26:40<03:23,  1.88s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  96%|#########6| 2893/3000 [1:26:40<02:50,  1.59s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  96%|#########6| 2893/3000 [1:26:40<02:50,  1.59s/it, lr: 1.0e-04 loss: 6.155e-01]
windy_storm:  96%|#########6| 2893/3000 [1:26:42<02:50,  1.59s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2893/3000 [1:26:42<02:50,  1.59s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2894/3000 [1:26:42<02:48,  1.59s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2894/3000 [1:26:42<02:48,  1.59s/it, lr: 1.0e-04 loss: 1.484e-01]
windy_storm:  96%|#########6| 2894/3000 [1:26:45<02:48,  1.59s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  96%|#########6| 2894/3000 [1:26:45<02:48,  1.59s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  96%|#########6| 2895/3000 [1:26:45<03:27,  1.97s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  96%|#########6| 2895/3000 [1:26:45<03:27,  1.97s/it, lr: 1.0e-04 loss: 6.312e-01]
windy_storm:  96%|#########6| 2895/3000 [1:26:45<03:27,  1.97s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  96%|#########6| 2895/3000 [1:26:45<03:27,  1.97s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  97%|#########6| 2896/3000 [1:26:45<02:50,  1.64s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  97%|#########6| 2896/3000 [1:26:45<02:50,  1.64s/it, lr: 1.0e-04 loss: 6.159e-01]
windy_storm:  97%|#########6| 2896/3000 [1:26:47<02:50,  1.64s/it, lr: 1.0e-04 loss: 3.834e-01]
windy_storm:  97%|#########6| 2896/3000 [1:26:47<02:50,  1.64s/it, lr: 1.0e-04 loss: 3.834e-01]
windy_storm:  97%|#########6| 2897/3000 [1:26:47<02:49,  1.64s/it, lr: 1.0e-04 loss: 3.834e-01]
windy_storm:  97%|#########6| 2897/3000 [1:26:47<02:49,  1.64s/it, lr: 1.0e-04 loss: 3.834e-01]
windy_storm:  97%|#########6| 2897/3000 [1:26:48<02:49,  1.64s/it, lr: 1.0e-04 loss: 4.345e-01]
windy_storm:  97%|#########6| 2897/3000 [1:26:48<02:49,  1.64s/it, lr: 1.0e-04 loss: 4.345e-01]
windy_storm:  97%|#########6| 2898/3000 [1:26:48<02:23,  1.40s/it, lr: 1.0e-04 loss: 4.345e-01]
windy_storm:  97%|#########6| 2898/3000 [1:26:48<02:23,  1.40s/it, lr: 1.0e-04 loss: 4.345e-01]
windy_storm:  97%|#########6| 2898/3000 [1:26:49<02:23,  1.40s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  97%|#########6| 2898/3000 [1:26:49<02:23,  1.40s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  97%|#########6| 2899/3000 [1:26:49<02:27,  1.46s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  97%|#########6| 2899/3000 [1:26:49<02:27,  1.46s/it, lr: 1.0e-04 loss: 6.659e-01]
windy_storm:  97%|#########6| 2899/3000 [1:26:50<02:27,  1.46s/it, lr: 1.0e-04 loss: 2.444e-01]
windy_storm:  97%|#########6| 2899/3000 [1:26:50<02:27,  1.46s/it, lr: 1.0e-04 loss: 2.444e-01]
windy_storm:  97%|#########6| 2900/3000 [1:26:53<02:25,  1.46s/it, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  97%|#########6| 2900/3000 [1:26:53<02:25,  1.46s/it, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  97%|#########6| 2901/3000 [1:26:53<02:25,  1.47s/it, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  97%|#########6| 2901/3000 [1:26:53<02:25,  1.47s/it, lr: 1.0e-04 loss: 4.285e-01]
windy_storm:  97%|#########6| 2901/3000 [1:26:55<02:25,  1.47s/it, lr: 1.0e-04 loss: 2.645e-01]
windy_storm:  97%|#########6| 2901/3000 [1:26:55<02:25,  1.47s/it, lr: 1.0e-04 loss: 2.645e-01]
windy_storm:  97%|#########6| 2902/3000 [1:26:55<02:32,  1.55s/it, lr: 1.0e-04 loss: 2.645e-01]
windy_storm:  97%|#########6| 2902/3000 [1:26:55<02:32,  1.55s/it, lr: 1.0e-04 loss: 2.645e-01]
windy_storm:  97%|#########6| 2902/3000 [1:26:57<02:32,  1.55s/it, lr: 1.0e-04 loss: 2.813e-01]
windy_storm:  97%|#########6| 2902/3000 [1:26:57<02:32,  1.55s/it, lr: 1.0e-04 loss: 2.813e-01]
windy_storm:  97%|#########6| 2903/3000 [1:26:57<02:31,  1.56s/it, lr: 1.0e-04 loss: 2.813e-01]
windy_storm:  97%|#########6| 2903/3000 [1:26:57<02:31,  1.56s/it, lr: 1.0e-04 loss: 2.813e-01]
windy_storm:  97%|#########6| 2903/3000 [1:26:59<02:31,  1.56s/it, lr: 1.0e-04 loss: 9.364e-02]
windy_storm:  97%|#########6| 2903/3000 [1:26:59<02:31,  1.56s/it, lr: 1.0e-04 loss: 9.364e-02]
windy_storm:  97%|#########6| 2904/3000 [1:26:59<03:05,  1.93s/it, lr: 1.0e-04 loss: 9.364e-02]
windy_storm:  97%|#########6| 2904/3000 [1:26:59<03:05,  1.93s/it, lr: 1.0e-04 loss: 9.364e-02]
windy_storm:  97%|#########6| 2904/3000 [1:27:00<03:05,  1.93s/it, lr: 1.0e-04 loss: 6.365e-01]
windy_storm:  97%|#########6| 2904/3000 [1:27:00<03:05,  1.93s/it, lr: 1.0e-04 loss: 6.365e-01]
windy_storm:  97%|#########6| 2905/3000 [1:27:00<02:34,  1.62s/it, lr: 1.0e-04 loss: 6.365e-01]
windy_storm:  97%|#########6| 2905/3000 [1:27:00<02:34,  1.62s/it, lr: 1.0e-04 loss: 6.365e-01]
windy_storm:  97%|#########6| 2905/3000 [1:27:03<02:34,  1.62s/it, lr: 1.0e-04 loss: 5.956e-01]
windy_storm:  97%|#########6| 2905/3000 [1:27:03<02:34,  1.62s/it, lr: 1.0e-04 loss: 5.956e-01]
windy_storm:  97%|#########6| 2906/3000 [1:27:03<03:09,  2.02s/it, lr: 1.0e-04 loss: 5.956e-01]
windy_storm:  97%|#########6| 2906/3000 [1:27:03<03:09,  2.02s/it, lr: 1.0e-04 loss: 5.956e-01]
windy_storm:  97%|#########6| 2906/3000 [1:27:06<03:09,  2.02s/it, lr: 1.0e-04 loss: 1.816e-01]
windy_storm:  97%|#########6| 2906/3000 [1:27:06<03:09,  2.02s/it, lr: 1.0e-04 loss: 1.816e-01]
windy_storm:  97%|#########6| 2907/3000 [1:27:06<03:34,  2.30s/it, lr: 1.0e-04 loss: 1.816e-01]
windy_storm:  97%|#########6| 2907/3000 [1:27:06<03:34,  2.30s/it, lr: 1.0e-04 loss: 1.816e-01]
windy_storm:  97%|#########6| 2907/3000 [1:27:08<03:34,  2.30s/it, lr: 1.0e-04 loss: 6.380e-01]
windy_storm:  97%|#########6| 2907/3000 [1:27:08<03:34,  2.30s/it, lr: 1.0e-04 loss: 6.380e-01]
windy_storm:  97%|#########6| 2908/3000 [1:27:08<03:12,  2.10s/it, lr: 1.0e-04 loss: 6.380e-01]
windy_storm:  97%|#########6| 2908/3000 [1:27:08<03:12,  2.10s/it, lr: 1.0e-04 loss: 6.380e-01]
windy_storm:  97%|#########6| 2908/3000 [1:27:11<03:12,  2.10s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  97%|#########6| 2908/3000 [1:27:11<03:12,  2.10s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  97%|#########6| 2909/3000 [1:27:11<03:35,  2.36s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  97%|#########6| 2909/3000 [1:27:11<03:35,  2.36s/it, lr: 1.0e-04 loss: 5.980e-01]
windy_storm:  97%|#########6| 2909/3000 [1:27:12<03:35,  2.36s/it, lr: 1.0e-04 loss: 1.106e-01]
windy_storm:  97%|#########6| 2909/3000 [1:27:12<03:35,  2.36s/it, lr: 1.0e-04 loss: 1.106e-01]
windy_storm:  97%|#########7| 2910/3000 [1:27:13<03:32,  2.36s/it, lr: 1.0e-04 loss: 6.034e-01]
windy_storm:  97%|#########7| 2910/3000 [1:27:13<03:32,  2.36s/it, lr: 1.0e-04 loss: 6.034e-01]
windy_storm:  97%|#########7| 2911/3000 [1:27:13<02:26,  1.65s/it, lr: 1.0e-04 loss: 6.034e-01]
windy_storm:  97%|#########7| 2911/3000 [1:27:13<02:26,  1.65s/it, lr: 1.0e-04 loss: 6.034e-01]
windy_storm:  97%|#########7| 2911/3000 [1:27:14<02:26,  1.65s/it, lr: 1.0e-04 loss: 3.696e-02]
windy_storm:  97%|#########7| 2911/3000 [1:27:14<02:26,  1.65s/it, lr: 1.0e-04 loss: 3.696e-02]
windy_storm:  97%|#########7| 2912/3000 [1:27:14<02:05,  1.43s/it, lr: 1.0e-04 loss: 3.696e-02]
windy_storm:  97%|#########7| 2912/3000 [1:27:14<02:05,  1.43s/it, lr: 1.0e-04 loss: 3.696e-02]
windy_storm:  97%|#########7| 2912/3000 [1:27:15<02:05,  1.43s/it, lr: 1.0e-04 loss: 2.310e-01]
windy_storm:  97%|#########7| 2912/3000 [1:27:15<02:05,  1.43s/it, lr: 1.0e-04 loss: 2.310e-01]
windy_storm:  97%|#########7| 2913/3000 [1:27:15<01:50,  1.27s/it, lr: 1.0e-04 loss: 2.310e-01]
windy_storm:  97%|#########7| 2913/3000 [1:27:15<01:50,  1.27s/it, lr: 1.0e-04 loss: 2.310e-01]
windy_storm:  97%|#########7| 2913/3000 [1:27:16<01:50,  1.27s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  97%|#########7| 2913/3000 [1:27:16<01:50,  1.27s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  97%|#########7| 2914/3000 [1:27:16<01:54,  1.34s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  97%|#########7| 2914/3000 [1:27:16<01:54,  1.34s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  97%|#########7| 2914/3000 [1:27:17<01:54,  1.34s/it, lr: 1.0e-04 loss: 3.510e-01]
windy_storm:  97%|#########7| 2914/3000 [1:27:17<01:54,  1.34s/it, lr: 1.0e-04 loss: 3.510e-01]
windy_storm:  97%|#########7| 2915/3000 [1:27:17<01:47,  1.26s/it, lr: 1.0e-04 loss: 3.510e-01]
windy_storm:  97%|#########7| 2915/3000 [1:27:17<01:47,  1.26s/it, lr: 1.0e-04 loss: 3.510e-01]
windy_storm:  97%|#########7| 2915/3000 [1:27:20<01:47,  1.26s/it, lr: 1.0e-04 loss: 6.142e-01]
windy_storm:  97%|#########7| 2915/3000 [1:27:20<01:47,  1.26s/it, lr: 1.0e-04 loss: 6.142e-01]
windy_storm:  97%|#########7| 2916/3000 [1:27:20<02:27,  1.76s/it, lr: 1.0e-04 loss: 6.142e-01]
windy_storm:  97%|#########7| 2916/3000 [1:27:20<02:27,  1.76s/it, lr: 1.0e-04 loss: 6.142e-01]
windy_storm:  97%|#########7| 2916/3000 [1:27:21<02:27,  1.76s/it, lr: 1.0e-04 loss: 2.926e-01]
windy_storm:  97%|#########7| 2916/3000 [1:27:21<02:27,  1.76s/it, lr: 1.0e-04 loss: 2.926e-01]
windy_storm:  97%|#########7| 2917/3000 [1:27:21<02:03,  1.49s/it, lr: 1.0e-04 loss: 2.926e-01]
windy_storm:  97%|#########7| 2917/3000 [1:27:21<02:03,  1.49s/it, lr: 1.0e-04 loss: 2.926e-01]
windy_storm:  97%|#########7| 2917/3000 [1:27:23<02:03,  1.49s/it, lr: 1.0e-04 loss: 1.782e-01]
windy_storm:  97%|#########7| 2917/3000 [1:27:23<02:03,  1.49s/it, lr: 1.0e-04 loss: 1.782e-01]
windy_storm:  97%|#########7| 2918/3000 [1:27:23<02:03,  1.51s/it, lr: 1.0e-04 loss: 1.782e-01]
windy_storm:  97%|#########7| 2918/3000 [1:27:23<02:03,  1.51s/it, lr: 1.0e-04 loss: 1.782e-01]
windy_storm:  97%|#########7| 2918/3000 [1:27:26<02:03,  1.51s/it, lr: 1.0e-04 loss: 5.542e-01]
windy_storm:  97%|#########7| 2918/3000 [1:27:26<02:03,  1.51s/it, lr: 1.0e-04 loss: 5.542e-01]
windy_storm:  97%|#########7| 2919/3000 [1:27:26<02:36,  1.93s/it, lr: 1.0e-04 loss: 5.542e-01]
windy_storm:  97%|#########7| 2919/3000 [1:27:26<02:36,  1.93s/it, lr: 1.0e-04 loss: 5.542e-01]
windy_storm:  97%|#########7| 2919/3000 [1:27:27<02:36,  1.93s/it, lr: 1.0e-04 loss: 6.210e-01]
windy_storm:  97%|#########7| 2919/3000 [1:27:27<02:36,  1.93s/it, lr: 1.0e-04 loss: 6.210e-01]
windy_storm:  97%|#########7| 2920/3000 [1:27:30<02:34,  1.93s/it, lr: 1.0e-04 loss: 9.194e-02]
windy_storm:  97%|#########7| 2920/3000 [1:27:30<02:34,  1.93s/it, lr: 1.0e-04 loss: 9.194e-02]
windy_storm:  97%|#########7| 2921/3000 [1:27:30<02:15,  1.72s/it, lr: 1.0e-04 loss: 9.194e-02]
windy_storm:  97%|#########7| 2921/3000 [1:27:30<02:15,  1.72s/it, lr: 1.0e-04 loss: 9.194e-02]
windy_storm:  97%|#########7| 2921/3000 [1:27:33<02:15,  1.72s/it, lr: 1.0e-04 loss: 3.249e-01]
windy_storm:  97%|#########7| 2921/3000 [1:27:33<02:15,  1.72s/it, lr: 1.0e-04 loss: 3.249e-01]
windy_storm:  97%|#########7| 2922/3000 [1:27:33<02:37,  2.01s/it, lr: 1.0e-04 loss: 3.249e-01]
windy_storm:  97%|#########7| 2922/3000 [1:27:33<02:37,  2.01s/it, lr: 1.0e-04 loss: 3.249e-01]
windy_storm:  97%|#########7| 2922/3000 [1:27:35<02:37,  2.01s/it, lr: 1.0e-04 loss: 6.884e-01]
windy_storm:  97%|#########7| 2922/3000 [1:27:35<02:37,  2.01s/it, lr: 1.0e-04 loss: 6.884e-01]
windy_storm:  97%|#########7| 2923/3000 [1:27:35<02:26,  1.90s/it, lr: 1.0e-04 loss: 6.884e-01]
windy_storm:  97%|#########7| 2923/3000 [1:27:35<02:26,  1.90s/it, lr: 1.0e-04 loss: 6.884e-01]
windy_storm:  97%|#########7| 2923/3000 [1:27:38<02:26,  1.90s/it, lr: 1.0e-04 loss: 6.633e-01]
windy_storm:  97%|#########7| 2923/3000 [1:27:38<02:26,  1.90s/it, lr: 1.0e-04 loss: 6.633e-01]
windy_storm:  97%|#########7| 2924/3000 [1:27:38<02:47,  2.20s/it, lr: 1.0e-04 loss: 6.633e-01]
windy_storm:  97%|#########7| 2924/3000 [1:27:38<02:47,  2.20s/it, lr: 1.0e-04 loss: 6.633e-01]
windy_storm:  97%|#########7| 2924/3000 [1:27:39<02:47,  2.20s/it, lr: 1.0e-04 loss: 7.126e-01]
windy_storm:  97%|#########7| 2924/3000 [1:27:39<02:47,  2.20s/it, lr: 1.0e-04 loss: 7.126e-01]
windy_storm:  98%|#########7| 2925/3000 [1:27:39<02:32,  2.03s/it, lr: 1.0e-04 loss: 7.126e-01]
windy_storm:  98%|#########7| 2925/3000 [1:27:39<02:32,  2.03s/it, lr: 1.0e-04 loss: 7.126e-01]
windy_storm:  98%|#########7| 2925/3000 [1:27:40<02:32,  2.03s/it, lr: 1.0e-04 loss: 3.573e-01]
windy_storm:  98%|#########7| 2925/3000 [1:27:40<02:32,  2.03s/it, lr: 1.0e-04 loss: 3.573e-01]
windy_storm:  98%|#########7| 2926/3000 [1:27:40<02:03,  1.67s/it, lr: 1.0e-04 loss: 3.573e-01]
windy_storm:  98%|#########7| 2926/3000 [1:27:40<02:03,  1.67s/it, lr: 1.0e-04 loss: 3.573e-01]
windy_storm:  98%|#########7| 2926/3000 [1:27:42<02:03,  1.67s/it, lr: 1.0e-04 loss: 7.066e-01]
windy_storm:  98%|#########7| 2926/3000 [1:27:42<02:03,  1.67s/it, lr: 1.0e-04 loss: 7.066e-01]
windy_storm:  98%|#########7| 2927/3000 [1:27:42<01:59,  1.63s/it, lr: 1.0e-04 loss: 7.066e-01]
windy_storm:  98%|#########7| 2927/3000 [1:27:42<01:59,  1.63s/it, lr: 1.0e-04 loss: 7.066e-01]
windy_storm:  98%|#########7| 2927/3000 [1:27:43<01:59,  1.63s/it, lr: 1.0e-04 loss: 1.001e-01]
windy_storm:  98%|#########7| 2927/3000 [1:27:43<01:59,  1.63s/it, lr: 1.0e-04 loss: 1.001e-01]
windy_storm:  98%|#########7| 2928/3000 [1:27:43<01:45,  1.46s/it, lr: 1.0e-04 loss: 1.001e-01]
windy_storm:  98%|#########7| 2928/3000 [1:27:43<01:45,  1.46s/it, lr: 1.0e-04 loss: 1.001e-01]
windy_storm:  98%|#########7| 2928/3000 [1:27:44<01:45,  1.46s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  98%|#########7| 2928/3000 [1:27:44<01:45,  1.46s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  98%|#########7| 2929/3000 [1:27:44<01:46,  1.50s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  98%|#########7| 2929/3000 [1:27:44<01:46,  1.50s/it, lr: 1.0e-04 loss: 1.934e-01]
windy_storm:  98%|#########7| 2929/3000 [1:27:46<01:46,  1.50s/it, lr: 1.0e-04 loss: 6.906e-02]
windy_storm:  98%|#########7| 2929/3000 [1:27:46<01:46,  1.50s/it, lr: 1.0e-04 loss: 6.906e-02]
windy_storm:  98%|#########7| 2930/3000 [1:27:47<01:44,  1.50s/it, lr: 1.0e-04 loss: 4.532e-02]
windy_storm:  98%|#########7| 2930/3000 [1:27:47<01:44,  1.50s/it, lr: 1.0e-04 loss: 4.532e-02]
windy_storm:  98%|#########7| 2931/3000 [1:27:47<01:07,  1.02it/s, lr: 1.0e-04 loss: 4.532e-02]
windy_storm:  98%|#########7| 2931/3000 [1:27:47<01:07,  1.02it/s, lr: 1.0e-04 loss: 4.532e-02]
windy_storm:  98%|#########7| 2931/3000 [1:27:47<01:07,  1.02it/s, lr: 1.0e-04 loss: 6.497e-01]
windy_storm:  98%|#########7| 2931/3000 [1:27:47<01:07,  1.02it/s, lr: 1.0e-04 loss: 6.497e-01]
windy_storm:  98%|#########7| 2932/3000 [1:27:47<01:03,  1.08it/s, lr: 1.0e-04 loss: 6.497e-01]
windy_storm:  98%|#########7| 2932/3000 [1:27:47<01:03,  1.08it/s, lr: 1.0e-04 loss: 6.497e-01]
windy_storm:  98%|#########7| 2932/3000 [1:27:50<01:03,  1.08it/s, lr: 1.0e-04 loss: 1.251e-01]
windy_storm:  98%|#########7| 2932/3000 [1:27:50<01:03,  1.08it/s, lr: 1.0e-04 loss: 1.251e-01]
windy_storm:  98%|#########7| 2933/3000 [1:27:50<01:38,  1.47s/it, lr: 1.0e-04 loss: 1.251e-01]
windy_storm:  98%|#########7| 2933/3000 [1:27:50<01:38,  1.47s/it, lr: 1.0e-04 loss: 1.251e-01]
windy_storm:  98%|#########7| 2933/3000 [1:27:52<01:38,  1.47s/it, lr: 1.0e-04 loss: 7.436e-03]
windy_storm:  98%|#########7| 2933/3000 [1:27:52<01:38,  1.47s/it, lr: 1.0e-04 loss: 7.436e-03]
windy_storm:  98%|#########7| 2934/3000 [1:27:52<01:38,  1.50s/it, lr: 1.0e-04 loss: 7.436e-03]
windy_storm:  98%|#########7| 2934/3000 [1:27:52<01:38,  1.50s/it, lr: 1.0e-04 loss: 7.436e-03]
windy_storm:  98%|#########7| 2934/3000 [1:27:53<01:38,  1.50s/it, lr: 1.0e-04 loss: 2.291e-01]
windy_storm:  98%|#########7| 2934/3000 [1:27:53<01:38,  1.50s/it, lr: 1.0e-04 loss: 2.291e-01]
windy_storm:  98%|#########7| 2935/3000 [1:27:53<01:38,  1.51s/it, lr: 1.0e-04 loss: 2.291e-01]
windy_storm:  98%|#########7| 2935/3000 [1:27:53<01:38,  1.51s/it, lr: 1.0e-04 loss: 2.291e-01]
windy_storm:  98%|#########7| 2935/3000 [1:27:56<01:38,  1.51s/it, lr: 1.0e-04 loss: 3.328e-01]
windy_storm:  98%|#########7| 2935/3000 [1:27:56<01:38,  1.51s/it, lr: 1.0e-04 loss: 3.328e-01]
windy_storm:  98%|#########7| 2936/3000 [1:27:56<02:03,  1.94s/it, lr: 1.0e-04 loss: 3.328e-01]
windy_storm:  98%|#########7| 2936/3000 [1:27:56<02:03,  1.94s/it, lr: 1.0e-04 loss: 3.328e-01]
windy_storm:  98%|#########7| 2936/3000 [1:27:57<02:03,  1.94s/it, lr: 1.0e-04 loss: 1.108e-01]
windy_storm:  98%|#########7| 2936/3000 [1:27:57<02:03,  1.94s/it, lr: 1.0e-04 loss: 1.108e-01]
windy_storm:  98%|#########7| 2937/3000 [1:27:57<01:41,  1.61s/it, lr: 1.0e-04 loss: 1.108e-01]
windy_storm:  98%|#########7| 2937/3000 [1:27:57<01:41,  1.61s/it, lr: 1.0e-04 loss: 1.108e-01]
windy_storm:  98%|#########7| 2937/3000 [1:27:58<01:41,  1.61s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  98%|#########7| 2937/3000 [1:27:58<01:41,  1.61s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  98%|#########7| 2938/3000 [1:27:58<01:25,  1.39s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  98%|#########7| 2938/3000 [1:27:58<01:25,  1.39s/it, lr: 1.0e-04 loss: 5.022e-01]
windy_storm:  98%|#########7| 2938/3000 [1:28:00<01:25,  1.39s/it, lr: 1.0e-04 loss: 4.614e-01]
windy_storm:  98%|#########7| 2938/3000 [1:28:00<01:25,  1.39s/it, lr: 1.0e-04 loss: 4.614e-01]
windy_storm:  98%|#########7| 2939/3000 [1:28:00<01:27,  1.44s/it, lr: 1.0e-04 loss: 4.614e-01]
windy_storm:  98%|#########7| 2939/3000 [1:28:00<01:27,  1.44s/it, lr: 1.0e-04 loss: 4.614e-01]
windy_storm:  98%|#########7| 2939/3000 [1:28:03<01:27,  1.44s/it, lr: 1.0e-04 loss: 7.556e-02]
windy_storm:  98%|#########7| 2939/3000 [1:28:03<01:27,  1.44s/it, lr: 1.0e-04 loss: 7.556e-02]
windy_storm:  98%|#########8| 2940/3000 [1:28:04<01:26,  1.44s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  98%|#########8| 2940/3000 [1:28:04<01:26,  1.44s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  98%|#########8| 2941/3000 [1:28:04<01:07,  1.15s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  98%|#########8| 2941/3000 [1:28:04<01:07,  1.15s/it, lr: 1.0e-04 loss: 4.627e-01]
windy_storm:  98%|#########8| 2941/3000 [1:28:07<01:07,  1.15s/it, lr: 1.0e-04 loss: 5.282e-02]
windy_storm:  98%|#########8| 2941/3000 [1:28:07<01:07,  1.15s/it, lr: 1.0e-04 loss: 5.282e-02]
windy_storm:  98%|#########8| 2942/3000 [1:28:07<01:31,  1.59s/it, lr: 1.0e-04 loss: 5.282e-02]
windy_storm:  98%|#########8| 2942/3000 [1:28:07<01:31,  1.59s/it, lr: 1.0e-04 loss: 5.282e-02]
windy_storm:  98%|#########8| 2942/3000 [1:28:10<01:31,  1.59s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  98%|#########8| 2942/3000 [1:28:10<01:31,  1.59s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  98%|#########8| 2943/3000 [1:28:10<01:52,  1.97s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  98%|#########8| 2943/3000 [1:28:10<01:52,  1.97s/it, lr: 1.0e-04 loss: 4.279e-01]
windy_storm:  98%|#########8| 2943/3000 [1:28:11<01:52,  1.97s/it, lr: 1.0e-04 loss: 6.481e-02]
windy_storm:  98%|#########8| 2943/3000 [1:28:11<01:52,  1.97s/it, lr: 1.0e-04 loss: 6.481e-02]
windy_storm:  98%|#########8| 2944/3000 [1:28:11<01:31,  1.64s/it, lr: 1.0e-04 loss: 6.481e-02]
windy_storm:  98%|#########8| 2944/3000 [1:28:11<01:31,  1.64s/it, lr: 1.0e-04 loss: 6.481e-02]
windy_storm:  98%|#########8| 2944/3000 [1:28:14<01:31,  1.64s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  98%|#########8| 2944/3000 [1:28:14<01:31,  1.64s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  98%|#########8| 2945/3000 [1:28:14<01:50,  2.01s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  98%|#########8| 2945/3000 [1:28:14<01:50,  2.01s/it, lr: 1.0e-04 loss: 5.563e-01]
windy_storm:  98%|#########8| 2945/3000 [1:28:17<01:50,  2.01s/it, lr: 1.0e-04 loss: 3.857e-01]
windy_storm:  98%|#########8| 2945/3000 [1:28:17<01:50,  2.01s/it, lr: 1.0e-04 loss: 3.857e-01]
windy_storm:  98%|#########8| 2946/3000 [1:28:17<02:04,  2.30s/it, lr: 1.0e-04 loss: 3.857e-01]
windy_storm:  98%|#########8| 2946/3000 [1:28:17<02:04,  2.30s/it, lr: 1.0e-04 loss: 3.857e-01]
windy_storm:  98%|#########8| 2946/3000 [1:28:18<02:04,  2.30s/it, lr: 1.0e-04 loss: 6.173e-02]
windy_storm:  98%|#########8| 2946/3000 [1:28:18<02:04,  2.30s/it, lr: 1.0e-04 loss: 6.173e-02]
windy_storm:  98%|#########8| 2947/3000 [1:28:18<01:39,  1.88s/it, lr: 1.0e-04 loss: 6.173e-02]
windy_storm:  98%|#########8| 2947/3000 [1:28:18<01:39,  1.88s/it, lr: 1.0e-04 loss: 6.173e-02]
windy_storm:  98%|#########8| 2947/3000 [1:28:19<01:39,  1.88s/it, lr: 1.0e-04 loss: 4.113e-01]
windy_storm:  98%|#########8| 2947/3000 [1:28:19<01:39,  1.88s/it, lr: 1.0e-04 loss: 4.113e-01]
windy_storm:  98%|#########8| 2948/3000 [1:28:19<01:21,  1.57s/it, lr: 1.0e-04 loss: 4.113e-01]
windy_storm:  98%|#########8| 2948/3000 [1:28:19<01:21,  1.57s/it, lr: 1.0e-04 loss: 4.113e-01]
windy_storm:  98%|#########8| 2948/3000 [1:28:20<01:21,  1.57s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  98%|#########8| 2948/3000 [1:28:20<01:21,  1.57s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  98%|#########8| 2949/3000 [1:28:20<01:20,  1.58s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  98%|#########8| 2949/3000 [1:28:20<01:20,  1.58s/it, lr: 1.0e-04 loss: 1.092e-01]
windy_storm:  98%|#########8| 2949/3000 [1:28:23<01:20,  1.58s/it, lr: 1.0e-04 loss: 6.801e-02]
windy_storm:  98%|#########8| 2949/3000 [1:28:23<01:20,  1.58s/it, lr: 1.0e-04 loss: 6.801e-02]
windy_storm:  98%|#########8| 2950/3000 [1:28:25<01:18,  1.58s/it, lr: 1.0e-04 loss: 2.229e-01]
windy_storm:  98%|#########8| 2950/3000 [1:28:25<01:18,  1.58s/it, lr: 1.0e-04 loss: 2.229e-01]
windy_storm:  98%|#########8| 2951/3000 [1:28:25<01:00,  1.23s/it, lr: 1.0e-04 loss: 2.229e-01]
windy_storm:  98%|#########8| 2951/3000 [1:28:25<01:00,  1.23s/it, lr: 1.0e-04 loss: 2.229e-01]
windy_storm:  98%|#########8| 2951/3000 [1:28:28<01:00,  1.23s/it, lr: 1.0e-04 loss: 4.086e-01]
windy_storm:  98%|#########8| 2951/3000 [1:28:28<01:00,  1.23s/it, lr: 1.0e-04 loss: 4.086e-01]
windy_storm:  98%|#########8| 2952/3000 [1:28:28<01:20,  1.67s/it, lr: 1.0e-04 loss: 4.086e-01]
windy_storm:  98%|#########8| 2952/3000 [1:28:28<01:20,  1.67s/it, lr: 1.0e-04 loss: 4.086e-01]
windy_storm:  98%|#########8| 2952/3000 [1:28:31<01:20,  1.67s/it, lr: 1.0e-04 loss: 3.426e-01]
windy_storm:  98%|#########8| 2952/3000 [1:28:31<01:20,  1.67s/it, lr: 1.0e-04 loss: 3.426e-01]
windy_storm:  98%|#########8| 2953/3000 [1:28:31<01:35,  2.03s/it, lr: 1.0e-04 loss: 3.426e-01]
windy_storm:  98%|#########8| 2953/3000 [1:28:31<01:35,  2.03s/it, lr: 1.0e-04 loss: 3.426e-01]
windy_storm:  98%|#########8| 2953/3000 [1:28:32<01:35,  2.03s/it, lr: 1.0e-04 loss: 3.995e-01]
windy_storm:  98%|#########8| 2953/3000 [1:28:32<01:35,  2.03s/it, lr: 1.0e-04 loss: 3.995e-01]
windy_storm:  98%|#########8| 2954/3000 [1:28:32<01:18,  1.70s/it, lr: 1.0e-04 loss: 3.995e-01]
windy_storm:  98%|#########8| 2954/3000 [1:28:32<01:18,  1.70s/it, lr: 1.0e-04 loss: 3.995e-01]
windy_storm:  98%|#########8| 2954/3000 [1:28:35<01:18,  1.70s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  98%|#########8| 2954/3000 [1:28:35<01:18,  1.70s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  98%|#########8| 2955/3000 [1:28:35<01:32,  2.06s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  98%|#########8| 2955/3000 [1:28:35<01:32,  2.06s/it, lr: 1.0e-04 loss: 1.345e-01]
windy_storm:  98%|#########8| 2955/3000 [1:28:36<01:32,  2.06s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  98%|#########8| 2955/3000 [1:28:36<01:32,  2.06s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  99%|#########8| 2956/3000 [1:28:36<01:14,  1.69s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  99%|#########8| 2956/3000 [1:28:36<01:14,  1.69s/it, lr: 1.0e-04 loss: 7.191e-02]
windy_storm:  99%|#########8| 2956/3000 [1:28:37<01:14,  1.69s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  99%|#########8| 2956/3000 [1:28:37<01:14,  1.69s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  99%|#########8| 2957/3000 [1:28:37<01:05,  1.51s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  99%|#########8| 2957/3000 [1:28:37<01:05,  1.51s/it, lr: 1.0e-04 loss: 1.703e-01]
windy_storm:  99%|#########8| 2957/3000 [1:28:40<01:05,  1.51s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  99%|#########8| 2957/3000 [1:28:40<01:05,  1.51s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  99%|#########8| 2958/3000 [1:28:40<01:21,  1.93s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  99%|#########8| 2958/3000 [1:28:40<01:21,  1.93s/it, lr: 1.0e-04 loss: 2.456e-01]
windy_storm:  99%|#########8| 2958/3000 [1:28:41<01:21,  1.93s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  99%|#########8| 2958/3000 [1:28:41<01:21,  1.93s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  99%|#########8| 2959/3000 [1:28:41<01:14,  1.82s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  99%|#########8| 2959/3000 [1:28:41<01:14,  1.82s/it, lr: 1.0e-04 loss: 2.251e-01]
windy_storm:  99%|#########8| 2959/3000 [1:28:43<01:14,  1.82s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  99%|#########8| 2959/3000 [1:28:43<01:14,  1.82s/it, lr: 1.0e-04 loss: 6.404e-01]
windy_storm:  99%|#########8| 2960/3000 [1:28:43<01:12,  1.82s/it, lr: 1.0e-04 loss: 8.465e-02]
windy_storm:  99%|#########8| 2960/3000 [1:28:43<01:12,  1.82s/it, lr: 1.0e-04 loss: 8.465e-02]
windy_storm:  99%|#########8| 2961/3000 [1:28:43<00:45,  1.16s/it, lr: 1.0e-04 loss: 8.465e-02]
windy_storm:  99%|#########8| 2961/3000 [1:28:43<00:45,  1.16s/it, lr: 1.0e-04 loss: 8.465e-02]
windy_storm:  99%|#########8| 2961/3000 [1:28:45<00:45,  1.16s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  99%|#########8| 2961/3000 [1:28:45<00:45,  1.16s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  99%|#########8| 2962/3000 [1:28:45<00:48,  1.26s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  99%|#########8| 2962/3000 [1:28:45<00:48,  1.26s/it, lr: 1.0e-04 loss: 1.314e-01]
windy_storm:  99%|#########8| 2962/3000 [1:28:46<00:48,  1.26s/it, lr: 1.0e-04 loss: 2.065e-01]
windy_storm:  99%|#########8| 2962/3000 [1:28:46<00:48,  1.26s/it, lr: 1.0e-04 loss: 2.065e-01]
windy_storm:  99%|#########8| 2963/3000 [1:28:46<00:42,  1.15s/it, lr: 1.0e-04 loss: 2.065e-01]
windy_storm:  99%|#########8| 2963/3000 [1:28:46<00:42,  1.15s/it, lr: 1.0e-04 loss: 2.065e-01]
windy_storm:  99%|#########8| 2963/3000 [1:28:47<00:42,  1.15s/it, lr: 1.0e-04 loss: 6.501e-01]
windy_storm:  99%|#########8| 2963/3000 [1:28:47<00:42,  1.15s/it, lr: 1.0e-04 loss: 6.501e-01]
windy_storm:  99%|#########8| 2964/3000 [1:28:47<00:45,  1.26s/it, lr: 1.0e-04 loss: 6.501e-01]
windy_storm:  99%|#########8| 2964/3000 [1:28:47<00:45,  1.26s/it, lr: 1.0e-04 loss: 6.501e-01]
windy_storm:  99%|#########8| 2964/3000 [1:28:48<00:45,  1.26s/it, lr: 1.0e-04 loss: 5.310e-01]
windy_storm:  99%|#########8| 2964/3000 [1:28:48<00:45,  1.26s/it, lr: 1.0e-04 loss: 5.310e-01]
windy_storm:  99%|#########8| 2965/3000 [1:28:48<00:39,  1.14s/it, lr: 1.0e-04 loss: 5.310e-01]
windy_storm:  99%|#########8| 2965/3000 [1:28:48<00:39,  1.14s/it, lr: 1.0e-04 loss: 5.310e-01]
windy_storm:  99%|#########8| 2965/3000 [1:28:49<00:39,  1.14s/it, lr: 1.0e-04 loss: 3.231e-01]
windy_storm:  99%|#########8| 2965/3000 [1:28:49<00:39,  1.14s/it, lr: 1.0e-04 loss: 3.231e-01]
windy_storm:  99%|#########8| 2966/3000 [1:28:49<00:35,  1.05s/it, lr: 1.0e-04 loss: 3.231e-01]
windy_storm:  99%|#########8| 2966/3000 [1:28:49<00:35,  1.05s/it, lr: 1.0e-04 loss: 3.231e-01]
windy_storm:  99%|#########8| 2966/3000 [1:28:50<00:35,  1.05s/it, lr: 1.0e-04 loss: 6.722e-02]
windy_storm:  99%|#########8| 2966/3000 [1:28:50<00:35,  1.05s/it, lr: 1.0e-04 loss: 6.722e-02]
windy_storm:  99%|#########8| 2967/3000 [1:28:50<00:32,  1.01it/s, lr: 1.0e-04 loss: 6.722e-02]
windy_storm:  99%|#########8| 2967/3000 [1:28:50<00:32,  1.01it/s, lr: 1.0e-04 loss: 6.722e-02]
windy_storm:  99%|#########8| 2967/3000 [1:28:51<00:32,  1.01it/s, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  99%|#########8| 2967/3000 [1:28:51<00:32,  1.01it/s, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  99%|#########8| 2968/3000 [1:28:51<00:30,  1.07it/s, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  99%|#########8| 2968/3000 [1:28:51<00:30,  1.07it/s, lr: 1.0e-04 loss: 5.595e-01]
windy_storm:  99%|#########8| 2968/3000 [1:28:54<00:30,  1.07it/s, lr: 1.0e-04 loss: 1.686e-01]
windy_storm:  99%|#########8| 2968/3000 [1:28:54<00:30,  1.07it/s, lr: 1.0e-04 loss: 1.686e-01]
windy_storm:  99%|#########8| 2969/3000 [1:28:54<00:47,  1.53s/it, lr: 1.0e-04 loss: 1.686e-01]
windy_storm:  99%|#########8| 2969/3000 [1:28:54<00:47,  1.53s/it, lr: 1.0e-04 loss: 1.686e-01]
windy_storm:  99%|#########8| 2969/3000 [1:28:55<00:47,  1.53s/it, lr: 1.0e-04 loss: 2.854e-01]
windy_storm:  99%|#########8| 2969/3000 [1:28:55<00:47,  1.53s/it, lr: 1.0e-04 loss: 2.854e-01]
windy_storm:  99%|#########9| 2970/3000 [1:28:56<00:45,  1.53s/it, lr: 1.0e-04 loss: 5.989e-02]
windy_storm:  99%|#########9| 2970/3000 [1:28:56<00:45,  1.53s/it, lr: 1.0e-04 loss: 5.989e-02]
windy_storm:  99%|#########9| 2971/3000 [1:28:56<00:34,  1.18s/it, lr: 1.0e-04 loss: 5.989e-02]
windy_storm:  99%|#########9| 2971/3000 [1:28:56<00:34,  1.18s/it, lr: 1.0e-04 loss: 5.989e-02]
windy_storm:  99%|#########9| 2971/3000 [1:28:59<00:34,  1.18s/it, lr: 1.0e-04 loss: 3.479e-01]
windy_storm:  99%|#########9| 2971/3000 [1:28:59<00:34,  1.18s/it, lr: 1.0e-04 loss: 3.479e-01]
windy_storm:  99%|#########9| 2972/3000 [1:28:59<00:45,  1.61s/it, lr: 1.0e-04 loss: 3.479e-01]
windy_storm:  99%|#########9| 2972/3000 [1:28:59<00:45,  1.61s/it, lr: 1.0e-04 loss: 3.479e-01]
windy_storm:  99%|#########9| 2972/3000 [1:29:01<00:45,  1.61s/it, lr: 1.0e-04 loss: 6.343e-02]
windy_storm:  99%|#########9| 2972/3000 [1:29:01<00:45,  1.61s/it, lr: 1.0e-04 loss: 6.343e-02]
windy_storm:  99%|#########9| 2973/3000 [1:29:01<00:43,  1.60s/it, lr: 1.0e-04 loss: 6.343e-02]
windy_storm:  99%|#########9| 2973/3000 [1:29:01<00:43,  1.60s/it, lr: 1.0e-04 loss: 6.343e-02]
windy_storm:  99%|#########9| 2973/3000 [1:29:01<00:43,  1.60s/it, lr: 1.0e-04 loss: 5.607e-01]
windy_storm:  99%|#########9| 2973/3000 [1:29:01<00:43,  1.60s/it, lr: 1.0e-04 loss: 5.607e-01]
windy_storm:  99%|#########9| 2974/3000 [1:29:01<00:35,  1.38s/it, lr: 1.0e-04 loss: 5.607e-01]
windy_storm:  99%|#########9| 2974/3000 [1:29:01<00:35,  1.38s/it, lr: 1.0e-04 loss: 5.607e-01]
windy_storm:  99%|#########9| 2974/3000 [1:29:04<00:35,  1.38s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  99%|#########9| 2974/3000 [1:29:04<00:35,  1.38s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  99%|#########9| 2975/3000 [1:29:04<00:45,  1.83s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  99%|#########9| 2975/3000 [1:29:04<00:45,  1.83s/it, lr: 1.0e-04 loss: 3.318e-01]
windy_storm:  99%|#########9| 2975/3000 [1:29:06<00:45,  1.83s/it, lr: 1.0e-04 loss: 4.546e-01]
windy_storm:  99%|#########9| 2975/3000 [1:29:06<00:45,  1.83s/it, lr: 1.0e-04 loss: 4.546e-01]
windy_storm:  99%|#########9| 2976/3000 [1:29:06<00:42,  1.76s/it, lr: 1.0e-04 loss: 4.546e-01]
windy_storm:  99%|#########9| 2976/3000 [1:29:06<00:42,  1.76s/it, lr: 1.0e-04 loss: 4.546e-01]
windy_storm:  99%|#########9| 2976/3000 [1:29:07<00:42,  1.76s/it, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  99%|#########9| 2976/3000 [1:29:07<00:42,  1.76s/it, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  99%|#########9| 2977/3000 [1:29:07<00:34,  1.49s/it, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  99%|#########9| 2977/3000 [1:29:07<00:34,  1.49s/it, lr: 1.0e-04 loss: 6.793e-01]
windy_storm:  99%|#########9| 2977/3000 [1:29:08<00:34,  1.49s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  99%|#########9| 2977/3000 [1:29:08<00:34,  1.49s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  99%|#########9| 2978/3000 [1:29:08<00:33,  1.52s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  99%|#########9| 2978/3000 [1:29:08<00:33,  1.52s/it, lr: 1.0e-04 loss: 9.328e-02]
windy_storm:  99%|#########9| 2978/3000 [1:29:10<00:33,  1.52s/it, lr: 1.0e-04 loss: 5.752e-01]
windy_storm:  99%|#########9| 2978/3000 [1:29:10<00:33,  1.52s/it, lr: 1.0e-04 loss: 5.752e-01]
windy_storm:  99%|#########9| 2979/3000 [1:29:10<00:32,  1.53s/it, lr: 1.0e-04 loss: 5.752e-01]
windy_storm:  99%|#########9| 2979/3000 [1:29:10<00:32,  1.53s/it, lr: 1.0e-04 loss: 5.752e-01]
windy_storm:  99%|#########9| 2979/3000 [1:29:12<00:32,  1.53s/it, lr: 1.0e-04 loss: 1.094e-01]
windy_storm:  99%|#########9| 2979/3000 [1:29:12<00:32,  1.53s/it, lr: 1.0e-04 loss: 1.094e-01]
windy_storm:  99%|#########9| 2980/3000 [1:29:13<00:30,  1.53s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  99%|#########9| 2980/3000 [1:29:13<00:30,  1.53s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  99%|#########9| 2981/3000 [1:29:13<00:22,  1.18s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  99%|#########9| 2981/3000 [1:29:13<00:22,  1.18s/it, lr: 1.0e-04 loss: 5.769e-01]
windy_storm:  99%|#########9| 2981/3000 [1:29:15<00:22,  1.18s/it, lr: 1.0e-04 loss: 1.156e-01]
windy_storm:  99%|#########9| 2981/3000 [1:29:15<00:22,  1.18s/it, lr: 1.0e-04 loss: 1.156e-01]
windy_storm:  99%|#########9| 2982/3000 [1:29:15<00:23,  1.28s/it, lr: 1.0e-04 loss: 1.156e-01]
windy_storm:  99%|#########9| 2982/3000 [1:29:15<00:23,  1.28s/it, lr: 1.0e-04 loss: 1.156e-01]
windy_storm:  99%|#########9| 2982/3000 [1:29:18<00:23,  1.28s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  99%|#########9| 2982/3000 [1:29:18<00:23,  1.28s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  99%|#########9| 2983/3000 [1:29:18<00:29,  1.73s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  99%|#########9| 2983/3000 [1:29:18<00:29,  1.73s/it, lr: 1.0e-04 loss: 1.756e-01]
windy_storm:  99%|#########9| 2983/3000 [1:29:19<00:29,  1.73s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  99%|#########9| 2983/3000 [1:29:19<00:29,  1.73s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  99%|#########9| 2984/3000 [1:29:19<00:26,  1.68s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  99%|#########9| 2984/3000 [1:29:19<00:26,  1.68s/it, lr: 1.0e-04 loss: 5.892e-01]
windy_storm:  99%|#########9| 2984/3000 [1:29:22<00:26,  1.68s/it, lr: 1.0e-04 loss: 6.025e-01]
windy_storm:  99%|#########9| 2984/3000 [1:29:22<00:26,  1.68s/it, lr: 1.0e-04 loss: 6.025e-01]
windy_storm: 100%|#########9| 2985/3000 [1:29:22<00:30,  2.02s/it, lr: 1.0e-04 loss: 6.025e-01]
windy_storm: 100%|#########9| 2985/3000 [1:29:22<00:30,  2.02s/it, lr: 1.0e-04 loss: 6.025e-01]
windy_storm: 100%|#########9| 2985/3000 [1:29:25<00:30,  2.02s/it, lr: 1.0e-04 loss: 6.538e-01]
windy_storm: 100%|#########9| 2985/3000 [1:29:25<00:30,  2.02s/it, lr: 1.0e-04 loss: 6.538e-01]
windy_storm: 100%|#########9| 2986/3000 [1:29:25<00:31,  2.28s/it, lr: 1.0e-04 loss: 6.538e-01]
windy_storm: 100%|#########9| 2986/3000 [1:29:25<00:31,  2.28s/it, lr: 1.0e-04 loss: 6.538e-01]
windy_storm: 100%|#########9| 2986/3000 [1:29:27<00:31,  2.28s/it, lr: 1.0e-04 loss: 4.135e-01]
windy_storm: 100%|#########9| 2986/3000 [1:29:27<00:31,  2.28s/it, lr: 1.0e-04 loss: 4.135e-01]
windy_storm: 100%|#########9| 2987/3000 [1:29:27<00:26,  2.06s/it, lr: 1.0e-04 loss: 4.135e-01]
windy_storm: 100%|#########9| 2987/3000 [1:29:27<00:26,  2.06s/it, lr: 1.0e-04 loss: 4.135e-01]
windy_storm: 100%|#########9| 2987/3000 [1:29:30<00:26,  2.06s/it, lr: 1.0e-04 loss: 3.283e-01]
windy_storm: 100%|#########9| 2987/3000 [1:29:30<00:26,  2.06s/it, lr: 1.0e-04 loss: 3.283e-01]
windy_storm: 100%|#########9| 2988/3000 [1:29:30<00:27,  2.33s/it, lr: 1.0e-04 loss: 3.283e-01]
windy_storm: 100%|#########9| 2988/3000 [1:29:30<00:27,  2.33s/it, lr: 1.0e-04 loss: 3.283e-01]
windy_storm: 100%|#########9| 2988/3000 [1:29:30<00:27,  2.33s/it, lr: 1.0e-04 loss: 3.115e-01]
windy_storm: 100%|#########9| 2988/3000 [1:29:30<00:27,  2.33s/it, lr: 1.0e-04 loss: 3.115e-01]
windy_storm: 100%|#########9| 2989/3000 [1:29:30<00:20,  1.86s/it, lr: 1.0e-04 loss: 3.115e-01]
windy_storm: 100%|#########9| 2989/3000 [1:29:30<00:20,  1.86s/it, lr: 1.0e-04 loss: 3.115e-01]
windy_storm: 100%|#########9| 2989/3000 [1:29:32<00:20,  1.86s/it, lr: 1.0e-04 loss: 8.293e-02]
windy_storm: 100%|#########9| 2989/3000 [1:29:32<00:20,  1.86s/it, lr: 1.0e-04 loss: 8.293e-02]
windy_storm: 100%|#########9| 2990/3000 [1:29:35<00:18,  1.86s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm: 100%|#########9| 2990/3000 [1:29:35<00:18,  1.86s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm: 100%|#########9| 2991/3000 [1:29:35<00:15,  1.69s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm: 100%|#########9| 2991/3000 [1:29:35<00:15,  1.69s/it, lr: 1.0e-04 loss: 6.286e-01]
windy_storm: 100%|#########9| 2991/3000 [1:29:36<00:15,  1.69s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm: 100%|#########9| 2991/3000 [1:29:36<00:15,  1.69s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm: 100%|#########9| 2992/3000 [1:29:36<00:13,  1.66s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm: 100%|#########9| 2992/3000 [1:29:36<00:13,  1.66s/it, lr: 1.0e-04 loss: 6.567e-01]
windy_storm: 100%|#########9| 2992/3000 [1:29:39<00:13,  1.66s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm: 100%|#########9| 2992/3000 [1:29:39<00:13,  1.66s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm: 100%|#########9| 2993/3000 [1:29:39<00:13,  1.97s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm: 100%|#########9| 2993/3000 [1:29:39<00:13,  1.97s/it, lr: 1.0e-04 loss: 5.626e-01]
windy_storm: 100%|#########9| 2993/3000 [1:29:42<00:13,  1.97s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm: 100%|#########9| 2993/3000 [1:29:42<00:13,  1.97s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm: 100%|#########9| 2994/3000 [1:29:42<00:13,  2.24s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm: 100%|#########9| 2994/3000 [1:29:42<00:13,  2.24s/it, lr: 1.0e-04 loss: 1.064e-01]
windy_storm: 100%|#########9| 2994/3000 [1:29:45<00:13,  2.24s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm: 100%|#########9| 2994/3000 [1:29:45<00:13,  2.24s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm: 100%|#########9| 2995/3000 [1:29:45<00:12,  2.45s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm: 100%|#########9| 2995/3000 [1:29:45<00:12,  2.45s/it, lr: 1.0e-04 loss: 2.274e-01]
windy_storm: 100%|#########9| 2995/3000 [1:29:48<00:12,  2.45s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm: 100%|#########9| 2995/3000 [1:29:48<00:12,  2.45s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm: 100%|#########9| 2996/3000 [1:29:48<00:10,  2.57s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm: 100%|#########9| 2996/3000 [1:29:48<00:10,  2.57s/it, lr: 1.0e-04 loss: 1.594e-01]
windy_storm: 100%|#########9| 2996/3000 [1:29:49<00:10,  2.57s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm: 100%|#########9| 2996/3000 [1:29:49<00:10,  2.57s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm: 100%|#########9| 2997/3000 [1:29:49<00:06,  2.05s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm: 100%|#########9| 2997/3000 [1:29:49<00:06,  2.05s/it, lr: 1.0e-04 loss: 4.792e-02]
windy_storm: 100%|#########9| 2997/3000 [1:29:52<00:06,  2.05s/it, lr: 1.0e-04 loss: 6.900e-01]
windy_storm: 100%|#########9| 2997/3000 [1:29:52<00:06,  2.05s/it, lr: 1.0e-04 loss: 6.900e-01]
windy_storm: 100%|#########9| 2998/3000 [1:29:52<00:04,  2.32s/it, lr: 1.0e-04 loss: 6.900e-01]
windy_storm: 100%|#########9| 2998/3000 [1:29:52<00:04,  2.32s/it, lr: 1.0e-04 loss: 6.900e-01]
windy_storm: 100%|#########9| 2998/3000 [1:29:53<00:04,  2.32s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm: 100%|#########9| 2998/3000 [1:29:53<00:04,  2.32s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm: 100%|#########9| 2999/3000 [1:29:53<00:01,  1.88s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm: 100%|#########9| 2999/3000 [1:29:53<00:01,  1.88s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm: 100%|#########9| 2999/3000 [1:29:53<00:01,  1.80s/it, lr: 1.0e-04 loss: 3.600e-01]
windy_storm: 100%|#########9| 2999/3000 [1:29:53<00:01,  1.80s/it, lr: 1.0e-04 loss: 3.600e-01]

Unloading assistant lora

Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/6 [00:00<?, ?it/s]
Generating Images:  17%|#6        | 1/6 [00:02<00:11,  2.39s/it]
Generating Images:  17%|#6        | 1/6 [00:02<00:11,  2.39s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.37s/it]
Generating Images:  33%|###3      | 2/6 [00:04<00:09,  2.37s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]
Generating Images:  50%|#####     | 3/6 [00:07<00:07,  2.37s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.39s/it]
Generating Images:  67%|######6   | 4/6 [00:09<00:04,  2.39s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.39s/it]
Generating Images:  83%|########3 | 5/6 [00:11<00:02,  2.39s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.38s/it]
Generating Images: 100%|##########| 6/6 [00:14<00:00,  2.38s/it]
                                                                
                                                                

Loading assistant lora

Saved checkpoint to /data/app/output/windy_storm/windy_storm.safetensors
Saved optimizer to /data/app/output/windy_storm/optimizer.pt