File size: 2,794 Bytes
6b03dac
 
 
d9bbcc5
 
 
 
6b03dac
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
---
license: apache-2.0
tags:
- motion-inbetweening
- keypose-extraction
- character-animation
- adaptive-interpolation-synthesis
---

## Model Description

This is the AIS-BiLSTM model accompanying the paper:

https://arxiv.org/abs/2605.02742

> Raël et al., "Adaptive Interpolation-Synthesis for Motion In-Betweening on Keyframe-Based Animation",
> SIGGRAPH 2026 Conference Papers (2026)

The AIS-BiLSTM model takes as input a tensor of shape N×(D+1), where N is the number of frames in the sequence and D=596 is the pose dimension. The K input keyposes are placed at their target frame indices in the first D channels, with all other frames zero-filled. The last channel is a binary mask flagging the K keypose positions. The model predicts the full N×D pose sequence.

## Model Details

| Property                 | Value                                                        |
| ------------------------ | ------------------------------------------------------------ |
| Framework                | PyTorch Lightning                                            |
| Checkpoint format        | `.safetensors`                                               |
| Input                    | Masked sequence of shape N×(D+1)                             |
| Output                   | Completed sequence of shape N×D                              |
| Pose dimensionality      | D = 596                                                      |
| Training sequence length | N=224 frames (fixed); variable length supported at inference |
| Frame rate               | 24 fps                                                       |

## Usage

See the [GitHub repository](https://github.com/animaj-lab/mib-ais)

## Training Data

Trained on the `train` split of the [mib_rig_controllers_values](https://huggingface.co/datasets/AnimajSAS/mib_rig_controllers_values) dataset, comprising ~8.1 hours of professionally handcrafted animation at 24 fps.

## Test Data

Evaluated on three test splits of the [mib_rig_controllers_values](https://huggingface.co/datasets/AnimajSAS/mib_rig_controllers_values) dataset:

| Split                       | Schedule       | Description                                                                        |
| --------------------------- | -------------- | ---------------------------------------------------------------------------------- |
| `test_held_out_algorithmic` | DBA            | Held-Out set with a deterministic keypose schedule from the domain-based algorithm |
| `test_held_out_random`      | Random (r=0.9) | Held-Out set with a random keypose schedule                                        |
| `test_production`           | Block          | 5 min production data with ground-truth block keyposes                             |

## License

Apache 2.0