You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* A single test case that describes the audio reference, expected transcriptions, test case weight etc. Each annotation object must have at least expectedTranscription or, uploadId and filePathInUpload in pair. In any case, filePathInUpload and uploadId must be present or missing in pair.
* This the payload schema for annotation set contents. Note that 'audioAsset' is always included in the returned annotation set content payload in case the payload content type is 'application/json'. For 'text/csv' annotation set content type, 'audioAssetDownloadUrl' and 'audioAssetDownloadUrlExpiryTime' are included in the csv headers for representing the audio download url and the expiry time of the presigned audio download url.
2921
+
* This is the payload schema for annotation set contents. Note that when uploadId and filePathInUpload is present, and the payload content type is 'application/json', audioAsset is included in the returned annotation set content payload. For 'text/csv' annotation set content type, audioAssetDownloadUrl and audioAssetDownloadUrlExpiryTime are included in the csv headers for representing the audio download url and the expiry time of the presigned audio download.
"description": "This the payload schema for annotation set contents. Note that 'audioAsset' is always included in the returned annotation set content payload in case the payload content type is 'application/json'. For 'text/csv' annotation set content type, 'audioAssetDownloadUrl' and 'audioAssetDownloadUrlExpiryTime' are included in the csv headers for representing the audio download url and the expiry time of the presigned audio download url.\n"
22320
+
"description": "This is the payload schema for annotation set contents. Note that when uploadId and filePathInUpload is present, and the payload content type is 'application/json', audioAsset is included in the returned annotation set content payload. For 'text/csv' annotation set content type, audioAssetDownloadUrl and audioAssetDownloadUrlExpiryTime are included in the csv headers for representing the audio download url and the expiry time of the presigned audio download.\n"
"description": "object containing annotation content and audio file download information."
22360
+
"description": "Object containing annotation content and audio file download information."
22364
22361
},
22365
22362
"v1.skill.asr.annotationSets.Annotation": {
22366
22363
"type": "object",
22367
-
"required": [
22368
-
"evaluationWeight",
22369
-
"expectedTranscription",
22370
-
"filePathInUpload",
22371
-
"uploadId"
22372
-
],
22373
22364
"properties": {
22374
22365
"uploadId": {
22375
22366
"type": "string",
22376
-
"description": "upload id obtained when developer creates an upload using catalog API"
22367
+
"description": "Upload id obtained when developer creates an upload using catalog API. Required to be present when expectedTranscription is missing. When uploadId is present, filePathInUpload must also be present."
22377
22368
},
22378
22369
"filePathInUpload": {
22379
22370
"type": "string",
22380
-
"description": "file path in the uploaded zip file. For example, a zip containing a folder named 'a' and there is an audio b.mp3 in that folder. The file path is a/b.mp3. Notice that forward slash ('/') should be used to concatenate directories."
22371
+
"description": "File path in the uploaded zip file. For example, a zip containing a folder named 'a' and there is an audio b.mp3 in that folder. The file path is a/b.mp3. Notice that forward slash ('/') should be used to concatenate directories. Required to be present when expectedTranscription is missing. When filePathInUpload is present, uploadId must also be present."
22381
22372
},
22382
22373
"evaluationWeight": {
22383
22374
"type": "number",
22384
-
"description": "weight of the test case in an evaluation, the value would be used for calculating metrics such as overall error rate. The acceptable values are from 1 - 1000. 1 means least significant, 1000 means mot significant. Here is how weight impact the `OVERALL_ERROR_RATE` calculation: For example, an annotation set consists of 3 annotations and they have weight of 8, 1, 1. The evaluation results show that only the first annotation test case passed while the rest of the test cases failed. In this case, the overall error rate is (8 / (8 + 1 + 1)) = 0.8\n",
22375
+
"description": "Weight of the test case in an evaluation, the value would be used for calculating metrics such as overall error rate. The acceptable values are from 1 - 1000. 1 means least significant, 1000 means mot significant. Here is how weight impact the `OVERALL_ERROR_RATE` calculation: For example, an annotation set consists of 3 annotations and they have weight of 8, 1, 1. The evaluation results show that only the first annotation test case passed while the rest of the test cases failed. In this case, the overall error rate is (8 / (8 + 1 + 1)) = 0.8\n",
22385
22376
"minimum": 1,
22386
22377
"maximum": 1000
22387
22378
},
22388
22379
"expectedTranscription": {
22389
22380
"type": "string",
22390
-
"description": "expected transcription text for the input audio. The acceptable length of the string is between 1 and 500 Unicode characters"
22381
+
"description": "Expected transcription text for the input audio. The acceptable length of the string is between 1 and 500 Unicode characters. Required to be present when uploadId and filePathInUpload are missing."
22391
22382
}
22392
-
}
22383
+
},
22384
+
"description": "A single test case that describes the audio reference, expected transcriptions, test case weight etc. Each annotation object must have at least expectedTranscription or, uploadId and filePathInUpload in pair. In any case, filePathInUpload and uploadId must be present or missing in pair."
"description": "The timestamp for the most recent update of ASR annotation set"
22426
+
},
22427
+
"eligibleForEvaluation": {
22428
+
"type": "boolean",
22429
+
"description": "Indicates if the annotation set is eligible for evaluation. A set is not eligible for evaluation if any annotation within the set has a missing uploadId, filePathInUpload, expectedTranscription, or evaluationWeight."
0 commit comments