Deep CFR status 문서 갱신
This commit is contained in:
@@ -84,6 +84,10 @@ Implemented:
|
|||||||
11. Self-play league snapshots.
|
11. Self-play league snapshots.
|
||||||
12. Self-play league opponent selection from stored snapshots.
|
12. Self-play league opponent selection from stored snapshots.
|
||||||
13. Safe-heuristic anchor opponent path.
|
13. Safe-heuristic anchor opponent path.
|
||||||
|
14. Weighted current/recent/older/anchor self-play league buckets.
|
||||||
|
15. Safe-heuristic imitation pretraining.
|
||||||
|
16. Policy-gradient fine-tuning.
|
||||||
|
17. Single-vs-multiprocessing benchmark comparison.
|
||||||
|
|
||||||
## Remaining Differences From Legacy coolrl
|
## Remaining Differences From Legacy coolrl
|
||||||
|
|
||||||
@@ -96,19 +100,11 @@ Still smaller than legacy:
|
|||||||
1. Config is a single `DeepCFRConfig` dataclass rather than a deeply nested
|
1. Config is a single `DeepCFRConfig` dataclass rather than a deeply nested
|
||||||
YAML-first config tree.
|
YAML-first config tree.
|
||||||
2. Multiprocessing exists, but it is intentionally simple:
|
2. Multiprocessing exists, but it is intentionally simple:
|
||||||
- no auto worker-count resolver
|
|
||||||
- no progress callback per worker batch
|
- no progress callback per worker batch
|
||||||
- no hotspot timing profile
|
- no hotspot timing profile
|
||||||
3. Metrics logging exists, but no plotting/status command exists yet.
|
3. Metrics logging exists, but no plotting/status command exists yet.
|
||||||
4. Checkpoint artifacts are local only; W&B artifact integration is not added.
|
4. Checkpoint artifacts are local only; W&B artifact integration is not added.
|
||||||
5. Self-play league is simpler than legacy:
|
5. Legacy visualization helpers are not ported.
|
||||||
- snapshot sampling exists
|
|
||||||
- safe anchor path exists
|
|
||||||
- weighted recent/older/current buckets are not implemented
|
|
||||||
6. Legacy side experiments are not ported:
|
|
||||||
- imitation/pretraining commands
|
|
||||||
- policy-gradient fine-tuning commands
|
|
||||||
- legacy visualization helpers
|
|
||||||
|
|
||||||
These remaining items are not blockers for running and iterating on Deep CFR v0.
|
These remaining items are not blockers for running and iterating on Deep CFR v0.
|
||||||
|
|
||||||
@@ -116,6 +112,5 @@ These remaining items are not blockers for running and iterating on Deep CFR v0.
|
|||||||
|
|
||||||
1. Add W&B/JSONL tracker abstraction on top of the existing local run files.
|
1. Add W&B/JSONL tracker abstraction on top of the existing local run files.
|
||||||
2. Add a status/plot command that reads `metrics.jsonl`.
|
2. Add a status/plot command that reads `metrics.jsonl`.
|
||||||
3. Add richer benchmark output comparing single-process and multiprocessing.
|
3. Add worker progress logging and hotspot timing profile.
|
||||||
4. Add weighted self-play league bucket selection if experiments need it.
|
4. Add W&B checkpoint artifacts after checkpoint quality is stable.
|
||||||
5. Add W&B checkpoint artifacts after checkpoint quality is stable.
|
|
||||||
|
|||||||
Reference in New Issue
Block a user