Simo76 commited on
Commit
c9ed3b1
·
1 Parent(s): a073377

Update unified_lora.py

Browse files
Files changed (1) hide show
  1. unified_lora.py +4 -9
unified_lora.py CHANGED
@@ -1,11 +1,8 @@
1
  """
2
- Legacy Adaptive LoRA (Gradient-based)
3
- ====================================
4
 
5
- Early experimental version of adaptive LoRA using gradient-based rank updates.
6
-
7
- This approach adjusts rank per-layer based on gradient norm dynamics.
8
- However, it suffers from instability and does not provide consistent benefits.
9
 
10
  Replaced by:
11
  - NestedLoRA (shared orbital architecture)
@@ -13,7 +10,5 @@ Replaced by:
13
 
14
  This file is kept for reference only.
15
 
16
- Status: deprecated / legacy
17
  """
18
-
19
-
 
1
  """
2
+ Legacy Adaptive LoRA (Deprecated)
3
+ ================================
4
 
5
+ Early gradient-based adaptive rank prototype.
 
 
 
6
 
7
  Replaced by:
8
  - NestedLoRA (shared orbital architecture)
 
10
 
11
  This file is kept for reference only.
12
 
13
+ Status: deprecated
14
  """