Commit ·
af38fad
1
Parent(s): 25ab447
Day 2 push logs — 299 more stubs (600 total, ~136 remaining)
Browse files- logs/README.md +18 -0
- logs/push_bulk_parallel_day2.log +0 -0
logs/README.md
CHANGED
|
@@ -37,3 +37,21 @@ python scripts/push_metadata_stubs.py --all --skip-existing --workers 12
|
|
| 37 |
- `EEGDash/*` dataset repos live: **299** (plus the `catalog` Space).
|
| 38 |
- Remaining to push: **~437**.
|
| 39 |
- HF rate-limit window resets 24 h after the first repo creation of the day.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
- `EEGDash/*` dataset repos live: **299** (plus the `catalog` Space).
|
| 38 |
- Remaining to push: **~437**.
|
| 39 |
- HF rate-limit window resets 24 h after the first repo creation of the day.
|
| 40 |
+
|
| 41 |
+
## Session: 2026-04-20
|
| 42 |
+
|
| 43 |
+
### `push_bulk_parallel_day2.log`
|
| 44 |
+
|
| 45 |
+
Second bulk run, kicked off after the 24h reset. Same command, same 12 workers.
|
| 46 |
+
|
| 47 |
+
- Attempted: 435 remaining (after day 1's 299 + a probe push).
|
| 48 |
+
- **Pushed: 299**. Hit the 300/day quota again (probe earlier in day burned one slot).
|
| 49 |
+
- Wall clock: ~6 min (12 workers, ~1.2 s/push thread).
|
| 50 |
+
|
| 51 |
+
## Totals after day 2
|
| 52 |
+
|
| 53 |
+
- `EEGDash/*` dataset repos live: **600**.
|
| 54 |
+
- Remaining: **~136**.
|
| 55 |
+
- A recurring cron (`10 */6 * * *`, job id kept in session state) retries the
|
| 56 |
+
same command until all are pushed; `--skip-existing` makes each attempt
|
| 57 |
+
idempotent.
|
logs/push_bulk_parallel_day2.log
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|