Current limitations
Uploading, listing, downloading, deleting, attaching, and detaching mapping files work today, and a simulation created from a configuration with a mapping file attached records it inappliedMappingFile. A simulation cannot yet run to completion with a mapping file:
- Tracesets you upload. Attaching a mapping file requires the configuration’s traceset to have a rank count. A traceset you upload reports its rank count as
rankCountDerivedonGET /api/v1/tracesets/{id}; when that field is present, the traceset has a rank count. An upload of trace files declares its rank count inworkloadMetadata, asshape.rankCountor as parallelism degrees (dp,tp,sp,ep,pp, multiplied together, with an absent degree counting as 1), andPOST /api/v1/tracesets/upload-urlrefuses one that declares neither. A traceset uploaded before rank counts were declared may report no rank count. Behind an uploaded traceset with no rank count, the mapping-file attach answers422UNPROCESSABLE_ENTITY, and retrying does not change the answer: upload the traces again with a declaration. The traceset attach refuses the same traceset with the same422, although a configuration create or update can still name it asactiveTraceset. - The platform’s own Chakra tracesets (coming soon). These have a rank count, so a mapping file attaches to a configuration that uses one. A simulation created from that configuration currently fails before the simulator starts, with the
failureReasonMapping file <name> (<id>) could not be delivered, until an update to the platform’s simulation hosts is in service.
The file format
A mapping file is plain text with one required section and one optional section.- Everything from a
#to the end of its line is a comment. Blank lines are ignored. - Fields are separated by spaces, commas, or any run of both. Tabs are not separators, and the file must use Unix (LF) line endings, not Windows (CRLF).
- A line may carry at most 127 bytes before its first comment, and at most 4,096 bytes in total.
- A comment block at the top of the file must use
#. A line starting with@is reserved for Section II.
Section I: rank placement
Section I lists one rank per line, with exactly two or exactly four fields:
All fields are non-negative base-10 integers that fit in 32 bits, and
4294967295 is not accepted as a serverId. The ids must cover the contiguous range 0 through rankCount - 1, each exactly once, and no two ranks may name the same serverId. A rank with no scale-up fields belongs to no group, and all of its traffic uses the scale-out network.
Section II: scale-up group parameters (optional)
Section II begins at the first line that starts with@, after at least one Section I entry. Every line starting with @ is a comment, so the marker line can carry a heading, and inside Section II both # and @ start a comment anywhere in a line. Each remaining line declares one group, with exactly four fields:
Every group a Section I entry names must have a Section II line. Hexadecimal and non-finite values are not accepted. If the file has no scale-up groups, leave Section II out.
Examples
An 8-rank file with no scale-up groups, placing the ranks in reverse order. The comment on each row is free-form; here it records where the server sits in the topology:When each rule is checked
Every rule above is checked when the upload completes. A file that breaks one is refused with422 MAPPING_FILE_INVALID, the message names the first offending line (line <n>: <reason>) or the first missing rank, and nothing is stored.
Two things depend on a configuration, so they are checked later:
- Rank count. Attach requires the file’s
rankCountto equal the rank count of the configuration’s traceset. - Chakra-capable servers. Whether each
serverIdnames a Chakra-capable server is a fact about the topology. A file that names another server uploads and attaches, and the simulation fails when the simulator starts, with the simulator’s error naming theserverId.
Upload, attach, and simulate
1. Set up your environment
2. Request upload URLs
Send the file’s size in bytes and the workspace it belongs to.name is optional and defaults to chakra-mapping.txt. It must be 1 to 255 bytes of A-Z, a-z, 0-9, ., _ and -, must not be ., and must not contain .. anywhere. sizeBytes is an upper bound of at most 64,000,000 bytes (the 64 MB per-file limit), and description holds at most 2,048 characters. The name is display metadata only: inside the simulator the file is always called chakra-mapping.txt.
3. Upload the bytes
PUT each part to its presigned URL and keep the ETag response header of each one.
4. Complete the upload
Send the upload id and each part’s number and ETag. The platform validates the file, derivesrankCount and scaleUpGroupCount, stores the file, and answers 201 with the new mapping file. sizeBytes in the response is the stored file’s actual length.
200 with that existing file and duplicateOfExisting set to true. Uploading the bytes of a deleted file creates a new mapping file with a new id; a deleted file is never revived.
5. Attach it to a configuration
- a configuration outside the template workspace (
400otherwise); - at least one application with
trafficTypechakra(422MAPPING_REQUIRES_CHAKRA_APP); - an attached traceset (
409MAPPING_REQUIRES_TRACESET) that has a rank count: a traceset without one is answered422UNPROCESSABLE_ENTITY, attach changes nothing, and retrying does not change the answer; - a mapping file in the configuration’s own workspace that has not been deleted (
404otherwise); - a mapping file whose
rankCountequals the traceset’s rank count (422MAPPING_RANK_COUNT_MISMATCH, naming both counts and the missing or extra ranks).
If-Match is optional. The configuration’s ETag is its version number in quotes, and a stale one answers 412. Attaching writes a new configuration version whose activeMappingFile names the file (excerpt):
UseMapping to true and MappingFileName to chakra-mapping.txt in every Chakra application’s ChakraConfiguration parameters. While the file is attached, the platform owns those two parameters: a configuration update, an application-parameter update, or a new Chakra application that would change them is refused with 422 MAPPING_PARAMS_LOCKED. A traceset with a different rank count is refused with 409 TRACESET_CONFLICTS_WITH_MAPPING. A configuration update whose body carries activeMappingFile is refused with 400: attach and detach are the only ways to set it. To make any of these changes, detach the mapping file, make the change, and attach it again.
One mapping file can be attached to any number of configurations in its workspace, and each configuration holds its own reference.
6. Create a simulation
Every simulation created from the configuration is launched with the attached file (see Current limitations).appliedMappingFile from the moment it is created, and keeps naming it after the file is deleted, with deleted reporting that state. A simulation just created (excerpt):
appliedMappingFile, and its ranks are placed in order.
Creating a simulation is refused, and no simulation is created, when:
- the attached mapping file has been deleted:
409MAPPING_FILE_DELETED_REFERENCE, naming the file. Detach it, or attach another, and create again; - the attached mapping file’s name contains
..or a shell metacharacter:400VALIDATION_ERROR, naming the field. Upload rejects such names, but a file stored before that rule keeps its name; upload it again under another name and attach it in place of the old one.
failureReason reads Mapping file <name> (<id>) could not be delivered. On some runs a long <name> is shortened and ends in …; the id is always given in full. A failure the platform does not attribute to the mapping file, such as a storage or infrastructure fault while staging it, reports a general failure reason instead.
7. Check the placement the run used
When a mapped run completes, the simulator has written the placement it applied to one CSV result file whose name contains-chakra-mapping-. List the run’s CSV results, find that file by name (page through with next if needed), and download it through its downloadUrl or the download-url endpoint:
ChakraId,Hostname,NicNodeID,ServerNodeID,ServerID,Core,IPAddress, plus ScaleUpGroupId,ScaleUpSubgroupId when the run uses scale-up groups. The first column is the rank and the fifth is the serverId it ran on, so each row can be compared with the Section I entry you uploaded. Rows are not in rank order. See Simulation Output Files for downloading result files.
Browse, download, and delete
List the live mapping files in a workspace, newest first.workspaceId is required, and limit is at least 1:
hasMore is true, pass the returned nextCursor as the next query parameter to fetch the following page.
Fetch one mapping file’s details, or a presigned URL (url, valid until expiresAt) that serves its exact uploaded bytes:
204 whether or not a configuration refers to the file; deleting it again answers 404:
- Simulations already created are unaffected. They keep the file they were created with, and their
appliedMappingFilereadsdeleted: true. - A configuration that refers to the file keeps its
activeMappingFile, which readsdeleted: true, and creating a simulation from it is refused until you detach the file or attach another. - Fetching the file or its download URL answers
410MAPPING_FILE_DELETED.
Errors
All errors use the shared error shape: