job: extension
config:
  name: kontext_xianxia
  process:
  - type: sd_trainer
    training_folder: output
    device: cuda:0
    network:
      type: lora
      linear: 64
      linear_alpha: 64
    save:
      dtype: float16
      save_every: 250
      max_step_saves_to_keep: 20
      push_to_hub: false
    datasets:
    - folder_path: datasets/xianxia_train/images
      control_path: datasets/xianxia_train/controls
      caption_ext: txt
      caption_dropout_rate: 0.05
      shuffle_tokens: false
      cache_latents_to_disk: true
      resolution:
      - 512
      - 768
      - 1024
    train:
      batch_size: 1
      steps: 6000
      gradient_accumulation_steps: 1
      train_unet: true
      train_text_encoder: false
      gradient_checkpointing: true
      noise_scheduler: flowmatch
      optimizer: adamw8bit
      lr: 0.0001
      timestep_type: weighted
      ema_config:
        use_ema: true
        ema_decay: 0.99
      dtype: bf16
    model:
      name_or_path: black-forest-labs/FLUX.1-Kontext-dev
      arch: flux_kontext
      quantize: true
    sample:
      sampler: flowmatch
      sample_every: 250
      width: 1024
      height: 1024
      prompts:
      - turn the woman in the picture into a beautiful young woman, wearing a fairy-like
        long dress with white and light green interwoven, with lightly flowing sleeves,
        long hair like ink, adorned with delicate hair accessories, and holding a
        jade staff in an elegant posture. She stands in a fairyland with misty clouds,
        the atmosphere is beautiful and ethereal, and her eyes are clear and resolute,
        like a fairy in the fairyland. The overall picture is beautiful and delicate,
        surrounded by fairy spirit. Keep the facial features unchanged.  --ctrl_img
        datasets/xianxia_train/controls/object_02.png
      - turn the man in the picture into a handsome young man wearing a white, fairy-style
        robe with flowing sleeves and exquisite embroidery. His long hair is tied
        up high like a waterfall, and he holds a long sword in his hand, posing in
        a chic and majestic posture. The background is a fairyland shrouded in clouds
        and mist, the light and shadow are dreamy, and the temperament is extraordinary,
        like a sword immortal descending from the sky. The picture details are exquisite,
        the texture of the cloth is clear, and it is full of fairy spirit. Keep the
        facial features unchanged. She stands in a fairyland with misty clouds, the
        atmosphere is beautiful and ethereal, and her eyes are clear and resolute,
        like a fairy in the fairyland. The overall picture is beautiful and delicate,
        surrounded by fairy spirit. Keep the facial features unchanged.  --ctrl_img
        datasets/xianxia_train/controls/object_33.png
      neg: ''
      seed: 42
      walk_seed: true
      guidance_scale: 4
      sample_steps: 20
meta:
  name: kontext_xianxia
  version: '1.0'