Skip to content
Open
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions examples/api/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,5 +10,6 @@ These JSON files demonstrate individual Cortex Training request bodies:
| `fwd-bwd.json` | Submit a readable forward/backward batch |
| `generate.json` | Submit prompts for generation |
| `glm-sampling.json` | Create a GLM sampling sub-job |
| `glm-5.3-sampling.json` | Create a GLM-5.3 sampling sub-job with an fp8 KV cache and a reasoning parser |

They are wire-format examples, not end-to-end training recipes.
18 changes: 18 additions & 0 deletions examples/api/glm-5.3-sampling.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
{
"sub_job_configs": [
{
"inference_config": {
"max_seq_len": 32768,
"n_gpus": 8,
"vllm_config": {
"gpu_memory_utilization": 0.85,
"kv_cache_dtype": "fp8",
"reasoning_parser": "glm45",
"tensor_parallel_size": 8
}
},
"job_type": "sampling",
"model_name": "zai-org/GLM-5.3"
}
]
}