[BUG] "Pausing CURL read for upload handle x" without new upload handle ready

[bachtran02]

Media pipeline:

• Media source: getFrame() from camera SDK which continuously returns h264 frames are then passed to putKinesisVideoFrame(), I-type frames marked as FRAME_FLAG_KEY_FRAME
• Media type: video, no audio
• Codec information: h264 frames
• Intermittent/continuous streaming: continuous streaming

Logging

2024-07-30T05:32:30.639-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:55.207 INFO    getStreamData(): [store-1-cam-2] Indicating an EOS after last persisted ACK is received for stream upload handle 39
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     Authorization: AWS4-HMAC-SHA256 Credential=ABCDE/12345/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=abcde
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     connection: keep-alive
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     content-type: application/json
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     host: a-abcde.kinesisvideo.us-west-2.amazonaws.com
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     transfer-encoding: chunked
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:55.207 INFO    postReadCallback(): Reported end-of-stream for stream store-1-cam-2. Upload handle: 39
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:56.581 WARN    curlCompleteSync(): [store-1-cam-2] HTTP Error 0 : Response: (null)
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:56.581 WARN    curlCompleteSync(): [store-1-cam-2] curl perform failed for url https://a-abcde.kinesisvideo.us-west-2.amazonaws.com/putMedia with result Timeout was reached: Connection time-out
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: Request Headers:
2024-07-30T05:32:30.640-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: Request URL: https://a-abcde.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     X-Amz-Date: 20240730T114251Z
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     user-agent: AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.2.0 Linux/4.14.255-axis8 aarch64
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     x-amz-security-token: abcde
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     x-amzn-fragment-acknowledgment-required: 1
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     x-amzn-fragment-timecode-type: ABSOLUTE
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     x-amzn-producer-start-timestamp: 1722339771.566
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]:     x-amzn-stream-name: store-1-cam-2
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:56.581 INFO    kinesisVideoStreamTerminated(): Stream 0x55b76e4930 terminated upload handle 40 with service call result 599.
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:56.581 INFO    putStreamResultEvent(): Put stream result event. New upload handle 41
2024-07-30T05:32:30.643-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:56.581 WARN    putStreamCurlHandler(): [store-1-cam-2] Stream with streamHandle 368149678384 uploadHandle 40 has exited without triggering end-of-stream. Service call result: 599
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:42:56.591 WARN    notifyDataAvailable(): [store-1-cam-2] Failed to un-pause curl with error: 43. Curl object 0x55b77cdb50
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 11:43:04.194 INFO    writeHeaderCallback(): RequestId: e378c362-0058-7130-bc5a-177e2b9959c3
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:48.603 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:48.603 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:48.604 INFO    putStreamResultEvent(): Put stream result event. New upload handle 42
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:48.772 INFO    writeHeaderCallback(): RequestId: dd0097b6-2c10-0edd-8222-4b0f65073c0a
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:52.077 INFO    getStreamData(): [store-1-cam-2] Handle 41 waiting for last persisted ack with ts 17223413967340000
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:52.307 INFO    getStreamData(): [store-1-cam-2] Indicating an EOS after last persisted ACK is received for stream upload handle 41
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:19:52.307 INFO    postReadCallback(): Reported end-of-stream for stream store-1-cam-2. Upload handle: 41
2024-07-30T05:32:30.646-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[25813]: 2024-07-30 12:32:30.633 INFO    writeHeaderCallback(): RequestId: e4f14ab1-8918-456e-8877-ab5a7ccaaf72
2024-07-30T05:33:44.580-07:00 axis-b8a44f677c6d [ ERR     ] KvsAxisStreaming[25813]: Kinesis Producer SDK failed: status=0x16000001

Describe the bug
The bug occurred roughly 12 hours after the app started. Everything was working fine before. There was a few curl issues (status=0x16000001) here and there but were not breaking errors. This one breaks the application.

SDK version number
v1.5.2

Screenshot

To Reproduce
N/A

Expected behavior
The bug to not occur and the stream continues to work.

Desktop (please complete the following information):

• OS: Axis OS (camera OS)
• Architecture: aarch64
• Browser N/A
• Version N/A

Additional context
The app runs on Axis camera and streams to AWS Kinesis
Code Summary:

• create Kinesis client default callback with IoT certificates
• create Kinesis stream callback
• add stream callback to client callback (only 1 stream on this client)
• create Kinesis video client
• create Kinesis video stream sync
• create vdostream which is responsible for accessing h264 frames from camera livestream
• create loop that continuously fetches h264 frames from vdostream, construct Kinesis Frame with the data and send to putKinesisVideoFrame()

OpenSSL and Curl are both cross-compiled for aarch64.

• curl version: 8.8.0
• openssl version: 3.0.0

[niyatim23]

Hi @bachtran02, can you please share verbose logs demonstrating this issue? What credential provider are you using? What is the exact frequency of this issue?

[niyatim23]

I ran a long running test using the kvssink sample application with IoT credentials that has been running since yesterday. It was intermittently disconnected from the internet multiple times until this morning and it is still running. I'm able to playback the media on the viewer as well.

[TRACE] [01-08-2024 17:13:54:651.940 UTC] postReadCallback(): [kvs_example_camera_stream] Get Stream data returned: buffer size: 65524 written bytes: 4080 for upload handle: 1441 current stream handle: 4907416112
[DEBUG] [01-08-2024 17:13:54:651.989 UTC] postReadCallback(): [kvs_example_camera_stream] Wrote 4080 bytes to Kinesis Video. Upload stream handle: 1441
[TRACE] [01-08-2024 17:13:54:652.240 UTC] postWriteCallback(): postBodyStreamingWriteFunc (curl callback) invoked
[DEBUG] [01-08-2024 17:13:54:652.266 UTC] postWriteCallback(): Curl post body write function for stream with handle: kvs_example_camera_stream and upload handle: 1441 returned: {"EventType":"PERSISTED","FragmentTimecode":1722473940620,"FragmentNumber":"91343852333181974080580932846715637125476401821"}

Successful IoT credentials rotation:

[DEBUG] [01-08-2024 17:16:03:578.100 UTC] setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
[DEBUG] [01-08-2024 17:16:03:578.171 UTC] setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> kvs_example_camera_stream
[TRACE] [01-08-2024 17:16:03:779.220 UTC] convertTimestampToEpoch(): Expiration timestamp conversion into tm structure  124-7-1T18:16:3
[DEBUG] [01-08-2024 17:16:03:779.556 UTC] convertTimestampToEpoch(): Difference between current time and iot expiration is 3600
[DEBUG] [01-08-2024 17:16:03:779.656 UTC] parseIotResponse(): [kvs_example_camera_stream] Iot credential expiration time 1722536163
[INFO ] [01-08-2024 17:16:03:779.774 UTC] getStreamingTokenResultEvent(): Get streaming token result event.

There are no problems disconnecting and reconnecting to the internet while using Producer C with IoT credentials. We have not been able to reproduce the reported issue with our sample application.

[bachtran02]

That is one tricky thing about the bug. I wasn't able to consistently reproduce it either, but it tends to happen several hours after running. Here is a different example of debug log of the problem. I wasn't able to get verbose log because the camera running the KVS app doesn't have sufficient storage but I can really try to get that if more info is needed.

One thing I noticed from the log is

• Total number of active streaming sessions: 22
• Total number of streaming sessions: 32
  even though I only run one stream in the client. I wonder if this contributes to the problem.

2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Allocated storage byte size: 44299
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Available storage byte size: 20927221
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1208
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 145248 (141 Kbps)
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Total view allocation byte size: 1601360
2024-07-31T20:04:18.238-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-2
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 6952764091
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 145248 (141 Kbps)
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 23124
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of Received ACKs: 23121
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Overall view byte size: 24533
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 28913607
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 22
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 32
2024-07-31T20:04:18.240-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Total transferred bytes: 856923967
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 23120
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of dropped frames: 237
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of skipped frames: 12
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-07-31T20:04:18.247-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Number of stream staleness events: 149
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	API Call Retry Count : 4
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.040000
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 40
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 24.000038
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.167 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 24.000038
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.176 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 18311 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.237 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 290 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:18.249-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.237 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-2 and upload handle: 31 returned: {"EventType":"RECEIVED","FragmentTimecode":1722481098310,"FragmentNumber":"91343852333182328908858513136679393210652533989"}
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.237 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-2 and upload handle: 31 returned: {"EventType":"BUFFERING","FragmentTimecode":1722481099518,"FragmentNumber":"91343852333182328913810273293820914631014656920"}
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.258 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 206 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.318 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 176 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.339 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 169 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.339 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-2 and upload handle: 31 returned: {"EventType":"PERSISTED","FragmentTimecode":1722481098310,"FragmentNumber":"91343852333182328908858513136679393210652533989"}
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.399 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 178 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.419 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 172 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.480 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 182 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.540 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 180 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.169-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.561 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 193 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.621 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 202 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.642 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 200 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.702 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 184 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.723 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 239 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.783 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 223 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.804 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 215 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.864 DEBUG   postReadCallback(): [store-1-cam-2] Wrote 232 bytes to Kinesis Video. Upload stream handle: 31
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 DEBUG   defaultStreamStateTransitionHook():
2024-07-31T20:04:24.172-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 5
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 DEBUG   defaultStreamStateTransitionHook():
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 6
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-2
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:18.881 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:23.911 DEBUG   defaultStreamStateTransitionHook():
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:23.911 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 7
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:23.911 ERROR   blockingCurlCall(): Curl perform failed for url https://acde.credentials.iot.us-west-2.amazonaws.com/role-aliases/camera-role-alias/credentials with result Timeout was reached : Resolving timed out after 5001 milliseconds
2024-07-31T20:04:24.180-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:23.911 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]:  KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:23.912 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:23.912 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-2
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.165 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 3622
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.165 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 367693179184
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.165 DEBUG   parseIotResponse(): [store-1-cam-2] Iot credential expiration time 1722485086
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.165 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.2.0 Linux/4.14.255-axis8 aarch64
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-2
2024-07-31T20:04:24.182-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: App exiting...
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ ERR     ] KvsAxisStreaming[200559]: Kinesis Producer SDK failed: status=0x16000001
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240801T030424Z
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: host -> s-02ab8d15.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1722481464.165
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 INFO    putStreamResultEvent(): Put stream result event. New upload handle 32
2024-07-31T20:04:24.184-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 367693179184. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 367693179184. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ABCDE/20240801/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=ad7ad027f2acec32ebcde94f96d812f3e8b243518eae620af77ff70ac6a67a30
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 ERROR   getStreamingEndpointResultEvent(): operation returned status code: 0x16000001
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-07-31T20:04:24.216-07:00 axis-b8a44f677c6d [ INFO    ] KvsAxisStreaming[200559]: 2024-08-01 03:04:24.166 WARN    putKinesisVideoFrame(): [store-1-cam-2] Failed to submit frame to Kinesis Video client. status: 0x16000001 decoding timestamp: 17224811002270778 presentation timestamp: 17224811002270778

As you can see the app ran fine for 11 hours since 9:20AM before finally stopped working at 8:04PM as reflected in the log.

[niyatim23]

Thanks for sharing the details. Is the network on your device stable? The error is a curl failure which could have been a result of no connectivity too as it was successful the first time you were able to connect

[bachtran02]

I would say the camera's network is quite stable. However, in the event that the network is indeed unstable how should I handle the error and keep retrying to connect?

[bachtran02]

Hi @niyatim23 !

I would like to follow up on this discussion. Upon further inspection of the logs, I have understood the error a bit more. I think the issue I really encountered was with Pausing CURL read for upload handle x but without any other upload handle running it its place. From my understanding, this causes the program to stop sending frames to Kinesis and also stop trying to reconnect.

As upload handle switching happens every time the credentials are updated using AWS IoT, I initially thought the errors were with AWS IoT.

Here are the logs (sorry I still can't find a way to get verbose logs because of camera storage) of upload handle switching working normally and not working properly. I'm aware that the core issue could still be with bad network but I hope I could get some help on how to handle this error or if it is possible for the producer library to handle this error.

Upload handle switched normally from handle 3 to 4

2024-08-21 13:31:10.369 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 422 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.390 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 387 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.450 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 329 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.471 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 378 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.531 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 318 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.552 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 314 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.612 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 302 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.633 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 389 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.693 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 354 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.713 INFO    writeHeaderCallback(): RequestId: a919bf47-a51c-4108-88d0-326e556ec8ff
2024-08-21 13:31:10.714 DEBUG   getStreamingEndpointCurlHandler(): [store-1-cam-1] GetStreamingEndpoint API response: {"DataEndpoint":"https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com"}
2024-08-21 13:31:10.714 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 350 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:10.715 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 13:31:10.715 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-08-21 13:31:10.715 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-08-21 13:31:10.980 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 3639
2024-08-21 13:31:10.980 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 13:31:10.980 DEBUG   parseIotResponse(): [store-1-cam-1] Iot credential expiration time 1724250709
2024-08-21 13:31:10.980 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724247070.980
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZHVDGHGOP/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=a9467aadd3b24547e6897baa99f8cee33d12d981177bf454915a307b9803a60e
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T133110Z
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 13:31:10.981 INFO    putStreamResultEvent(): Put stream result event. New upload handle 4
2024-08-21 13:31:10.981 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG4aCXVzLXdlc3QtMiJHMEUCIFgWPCIzilUAyPSHR/97OgHAbXKCUUuQ6Pw4T2ykuLrkAiEA4tIlsK0DKXrl3x9khb0QSl28+r1ypD/SgECf4asID7Qq6gMIdxAAGgw2Mzc0MjMzNDM5ODYiDA//7m4ML6HGFAlioSrHA79NWpdqt3wEC5L1eLT2xrnl3OrzwujaxHjGusrcFSh8Ye1JYO2FWEeY0ngWYvFUssHA/zPMxJ1DutlT0hVOykb1PWUMlbeJNqGK1Zt15+3deIFmRSnQKaW8KGc2JVJSDp0ZCXo6YdSm8GFkJcXZT7O3idxAsy0Jkxrfdw9Gydbpdyjlel3i35Q0d8Qk9nQUNJg1RT7E+LT5RuYQTCmlOR1j6+3YVtTQ5ysmwocInhowKnLzAzNOOyMurHowJiM6XT7aKbWsETuqN3FL3q8B4Rj/XJmixTNbCxoN3PQn84K3yP2y2sPmWbkS0KzaU1wcnxqA51sVojVGpsuc6+hUnfuyF5lcixs70CTmtJQZO/AAHxdwqgHaFATE8BVMMr+gcqMT2JIjxeYXRMHB4iiWS5hPdhuna710SR7Pnek1FJEcpZ2hVZduwAyq/tOAbbUzznrqKV3pwj4Yn8EBiKcnVymV/qQyetqYzUXzU3H3sTmbYVP7HBwgHBlxZmIXBwxL62g4xv2sW4O0QSjkqYZDXxq6LEImKbqOrFppCB54mWACnX1+u/YGkuLF052mJFRYQm7gzt5YIIMPb3uMpdqLmvwWJvwmwUbBMMXYl7YGOpoBHzeY3M4njdQvqxz0IQ7Fqm2DMRnA33/j1PjEDVBdCIYBsWSpccmsrFx5iTl+UFc8urJxAg+OLoLWPEm967/n830si7nshMRm+lTWKWq4CeZD1btpGgpPOcMqg3Nt8PqMpiAEmaR0CwkkAGY8UhqHxJbTD8OFySXlVhlFgQQVwXXhM2AiGCkMHOM2E9GnECKpZSmmoJt9W37kQQ==
2024-08-21 13:31:11.021 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 275 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Allocated storage byte size: 161276
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Available storage byte size: 20810244
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1125
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 497792 (486 Kbps)
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Total view allocation byte size: 1601360
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Overall view byte size: 86657
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 2496322361
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 497792 (486 Kbps)
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 4910
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 4909
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of Received ACKs: 4909
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 6136992
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 4
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 5
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Total transferred bytes: 402395481
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 26
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of dropped frames: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of skipped frames: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	API Call Retry Count : 1
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.010000
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 24.000038
2024-08-21 13:31:11.032 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 24.000038
2024-08-21 13:31:11.041 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.044 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 7751 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.104 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1678 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.105 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"BUFFERING","FragmentTimecode":1724246973453,"FragmentNumber":"91343852333185793492032379873796542235411021491"}
2024-08-21 13:31:11.105 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"RECEIVED","FragmentTimecode":1724246972328,"FragmentNumber":"91343852333185793487080619716655020770164386809"}
2024-08-21 13:31:11.125 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1020 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.165 INFO    writeHeaderCallback(): RequestId: d0104dfc-0efa-50ec-8f2f-a3796fda6fd7
2024-08-21 13:31:11.185 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 690 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.206 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 621 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.266 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 646 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.266 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"PERSISTED","FragmentTimecode":1724246972328,"FragmentNumber":"91343852333185793487080619716655020770164386809"}
2024-08-21 13:31:11.287 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 532 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.347 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 512 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.408 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 478 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.428 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 538 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.489 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 454 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.509 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 454 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.570 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 421 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.590 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 453 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.650 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 426 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.671 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 366 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.731 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 358 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.751 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 455 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.812 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 366 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.833 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 319 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.893 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 359 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.953 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 384 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:11.974 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 329 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.035 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 322 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.055 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 333 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.115 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 350 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.136 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 333 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Allocated storage byte size: 160959
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Available storage byte size: 20810561
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1125
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 525752 (513 Kbps)
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Total view allocation byte size: 1601360
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 2496322361
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 525752 (513 Kbps)
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 4911
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of Received ACKs: 4910
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Overall view byte size: 86472
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 6138137
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 4
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 5
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Total transferred bytes: 402481953
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 4910
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of dropped frames: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of skipped frames: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	API Call Retry Count : 1
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.010000
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 26
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 24.000038
2024-08-21 13:31:12.177 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 24.000038
2024-08-21 13:31:12.196 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.197 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 7619 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.258 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1493 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.258 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"RECEIVED","FragmentTimecode":1724246973453,"FragmentNumber":"91343852333185793492032379873796542235411021491"}
2024-08-21 13:31:12.258 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"BUFFERING","FragmentTimecode":1724246974578,"FragmentNumber":"91343852333185793496984140030938063644869236156"}
2024-08-21 13:31:12.278 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 968 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.339 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 879 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.339 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"PERSISTED","FragmentTimecode":1724246973453,"FragmentNumber":"91343852333185793492032379873796542235411021491"}
2024-08-21 13:31:12.359 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 610 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.420 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 528 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.440 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 514 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.501 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 587 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.521 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 515 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.582 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 459 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.602 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 410 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.662 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 550 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.683 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 508 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.743 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 410 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.804 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 422 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.824 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 536 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.885 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 403 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.905 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 378 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.965 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 384 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:12.986 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 413 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.046 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 418 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.067 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 359 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.127 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 350 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.147 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 413 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.208 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 345 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.229 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 377 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.289 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 373 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.350 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 396 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.370 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 321 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Available storage byte size: 20808962
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Allocated storage byte size: 162558
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 504736 (492 Kbps)
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Overall view byte size: 87462
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1208
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 6139365
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 504736 (492 Kbps)
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Total transferred bytes: 402569415
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Total view allocation byte size: 1601360
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 2496322361
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 4912
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 4911
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of Received ACKs: 4911
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of dropped frames: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of skipped frames: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 4
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 5
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	API Call Retry Count : 1
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 26
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 24.000038
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 24.000038
2024-08-21 13:31:13.405 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.010000
2024-08-21 13:31:13.431 INFO    getStreamData(): [store-1-cam-1] Handle 3 waiting for last persisted ack with ts 17242469745780000
2024-08-21 13:31:13.441 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 84 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.442 DEBUG   postReadCallback(): [store-1-cam-1] Pausing CURL read for upload handle: 3 waiting for last ack.
2024-08-21 13:31:13.468 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"RECEIVED","FragmentTimecode":1724246974578,"FragmentNumber":"91343852333185793496984140030938063644869236156"}
2024-08-21 13:31:13.679 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 3 returned: {"EventType":"PERSISTED","FragmentTimecode":1724246974578,"FragmentNumber":"91343852333185793496984140030938063644869236156"}
2024-08-21 13:31:13.690 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 0 bytes to Kinesis Video. Upload stream handle: 3
2024-08-21 13:31:13.690 INFO    getStreamData(): [store-1-cam-1] Indicating an EOS after last persisted ACK is received for stream upload handle 3
2024-08-21 13:31:13.690 INFO    postReadCallback(): Reported end-of-stream for stream store-1-cam-1. Upload handle: 3
2024-08-21 13:31:14.099 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.127 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1024 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.157 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 17131 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.180 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 398 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.180 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 4 returned: {"EventType":"BUFFERING","FragmentTimecode":1724246975787,"FragmentNumber":"91343852333185794893380504344847014248374994200"}
2024-08-21 13:31:14.241 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 351 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.262 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 412 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.322 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 468 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.343 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 468 bytes to Kinesis Video. Upload stream handle: 4
2024-08-21 13:31:14.403 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 442 bytes to Kinesis Video. Upload stream handle: 4

Upload handle failed to switch and Pausing CURL read for upload handle: 11 but there was no upload handle 12.

2024-08-21 14:30:58.284 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1018 bytes to Kinesis Video. Upload stream handle: 6
2024-08-21 14:30:58.344 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1067 bytes to Kinesis Video. Upload stream handle: 6
2024-08-21 14:30:58.365 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1117 bytes to Kinesis Video. Upload stream handle: 6
2024-08-21 14:30:58.405 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 3
 KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
 KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-08-21 14:30:58.406 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:30:58.406 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:30:58.406 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 1
2024-08-21 14:30:58.406 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-08-21 14:30:58.406 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-08-21 14:30:58.406 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 14:31:03.421 ERROR   blockingCurlCall(): Curl perform failed for url https://ctzgs1unuh7q2.credentials.iot.us-west-2.amazonaws.com/role-aliases/camera-role-alias/credentials with result Timeout was reached : Resolving timed out after 5001 milliseconds
2024-08-21 14:31:03.421 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:31:03.421 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:31:03.421 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 2
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-08-21 14:31:03.421 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-08-21 14:31:03.421 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-08-21 14:31:03.690 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 3639
2024-08-21 14:31:03.690 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 14:31:03.690 DEBUG   parseIotResponse(): [store-1-cam-1] Iot credential expiration time 1724254302
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724250663.690
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 14:31:03.690 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 14:31:03.690 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 14:31:03.690 INFO    putStreamResultEvent(): Put stream result event. New upload handle 7
2024-08-21 14:31:03.690 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-08-21 14:31:03.691 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 548078239248. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-08-21 14:31:03.691 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143103Z
2024-08-21 14:31:03.691 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:31:03.691 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
2024-08-21 14:31:03.691 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 548078239248. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-08-21 14:31:03.691 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=e1ac8f2588aa785f49c4ab635f76fcf27e627c3ba3ee48f94efd5d1a3d80c1d0
2024-08-21 14:31:03.691 ERROR   getStreamingEndpointResultEvent(): operation returned status code: 0x16000001
2024-08-21 14:31:03.691 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-08-21 14:31:03.691 WARN    putKinesisVideoFrame(): [store-1-cam-1] Failed to submit frame to Kinesis Video client. status: 0x16000001 decoding timestamp: 17242505010314478 presentation timestamp: 17242505010314478
2024-08-21 14:31:03.691 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
2024-08-21 14:31:03.845 INFO    stopKinesisVideoStreamSync(): Synchronously stopping Kinesis Video Stream 0000007f9c023e10.
2024-08-21 14:31:03.867 INFO    writeHeaderCallback(): RequestId: c125c6a7-3d29-fd14-9e1a-3a291904f3af
2024-08-21 14:31:03.931 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 84 bytes to Kinesis Video. Upload stream handle: 6
2024-08-21 14:31:03.931 INFO    getStreamData(): [store-1-cam-1] Handle 6 waiting for last persisted ack with ts 17242505002810000
2024-08-21 14:31:13.895 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 14:31:13.895 DEBUG   defaultStreamShutdownCallback(): Reported streamShutdown callback for stream handle 548078239248
2024-08-21 14:31:13.895 INFO    describeStreamResultEvent(): Describe stream result event.
2024-08-21 14:31:13.895 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 14:31:13.895 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724250673.895
2024-08-21 14:31:13.896 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 14:31:13.896 INFO    putStreamResultEvent(): Put stream result event. New upload handle 8
2024-08-21 14:31:13.906 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 14:31:13.906 WARN    notifyDataAvailable(): [store-1-cam-1] Failed to un-pause curl with error: 43. Curl object 0x55910d0dc0
2024-08-21 14:31:13.906 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=892250dac9e2ea7a6f10f92bef5ae8cb065e8ab8af8b5b0f0bcb89321aa38238
2024-08-21 14:31:13.906 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143113Z
2024-08-21 14:31:13.906 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
    Authorization: AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=892250dac9e2ea7a6f10f92bef5ae8cb065e8ab8af8b5b0f0bcb89321aa38238
    connection: keep-alive
    content-type: application/json
2024-08-21 14:31:13.906 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
2024-08-21 14:31:14.693 DEBUG   postReadCallback(): [store-1-cam-1] Pausing CURL read for upload handle: 8
2024-08-21 14:31:14.694 INFO    writeHeaderCallback(): RequestId: f13d2f4d-20ff-e593-ae02-d3d504f17c4f
2024-08-21 14:31:44.073 WARN    curlCompleteSync(): [store-1-cam-1] HTTP Error 0 : Response: (null)
2024-08-21 14:31:44.073 WARN    curlCompleteSync(): [store-1-cam-1] curl perform failed for url https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
Request Headers:
Request URL: https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
    X-Amz-Date: 20240821T143113Z
    host: s-8e923eff.kinesisvideo.us-west-2.amazonaws.com
    transfer-encoding: chunked
    user-agent: AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
    x-amz-security-token: IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
    x-amzn-fragment-acknowledgment-required: 1
    x-amzn-fragment-timecode-type: ABSOLUTE
    x-amzn-producer-start-timestamp: 1724250673.895
    x-amzn-stream-name: store-1-cam-1
2024-08-21 14:31:44.073 DEBUG   putStreamCurlHandler(): Network thread for Kinesis Video stream: store-1-cam-1 with upload handle: 8 exited. http status: 0
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-08-21 14:31:44.074 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:31:44.074 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 3
2024-08-21 14:31:44.074 INFO    kinesisVideoStreamTerminated(): Stream 0x7f9c023e10 terminated upload handle 8 with service call result 10006.
2024-08-21 14:31:44.074 WARN    putStreamCurlHandler(): [store-1-cam-1] Stream with streamHandle 548078239248 uploadHandle 8 has exited without triggering end-of-stream. Service call result: 10006
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-08-21 14:31:44.074 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 14:31:44.074 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:31:44.074 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 4
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724250704.74
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 14:31:44.074 INFO    describeStreamResultEvent(): Describe stream result event.
2024-08-21 14:31:44.074 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 14:31:44.074 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 14:31:44.074 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 14:31:44.074 INFO    putStreamResultEvent(): Put stream result event. New upload handle 9
2024-08-21 14:31:44.085 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=9f11817a9190635da616fc0565a0509e1cf095b1b5b5b2f6f56243bb234dcdef
2024-08-21 14:31:44.085 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143144Z
2024-08-21 14:31:44.085 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:31:44.085 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 14:31:44.085 WARN    notifyDataAvailable(): [store-1-cam-1] Failed to un-pause curl with error: 43. Curl object 0x7f9c0e6fa0
    Authorization: AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=9f11817a9190635da616fc0565a0509e1cf095b1b5b5b2f6f56243bb234dcdef
    connection: keep-alive
    content-type: application/json
2024-08-21 14:31:44.085 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
2024-08-21 14:31:44.869 DEBUG   postReadCallback(): [store-1-cam-1] Pausing CURL read for upload handle: 9
2024-08-21 14:31:44.869 INFO    writeHeaderCallback(): RequestId: e3e4732c-bff9-6682-bcdb-8f9a9bc10a23
2024-08-21 14:32:14.248 WARN    curlCompleteSync(): [store-1-cam-1] HTTP Error 0 : Response: (null)
2024-08-21 14:32:14.248 WARN    curlCompleteSync(): [store-1-cam-1] curl perform failed for url https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
Request Headers:
Request URL: https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
    X-Amz-Date: 20240821T143144Z
    host: s-8e923eff.kinesisvideo.us-west-2.amazonaws.com
    transfer-encoding: chunked
    user-agent: AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
    x-amz-security-token: IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
    x-amzn-fragment-acknowledgment-required: 1
    x-amzn-fragment-timecode-type: ABSOLUTE
    x-amzn-producer-start-timestamp: 1724250704.74
    x-amzn-stream-name: store-1-cam-1
2024-08-21 14:32:14.248 DEBUG   putStreamCurlHandler(): Network thread for Kinesis Video stream: store-1-cam-1 with upload handle: 9 exited. http status: 0
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-08-21 14:32:14.249 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:32:14.249 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:32:14.249 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 5
2024-08-21 14:32:14.249 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 6
2024-08-21 14:32:14.249 INFO    describeStreamResultEvent(): Describe stream result event.
2024-08-21 14:32:14.249 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 14:32:14.249 INFO    kinesisVideoStreamTerminated(): Stream 0x7f9c023e10 terminated upload handle 9 with service call result 10006.
2024-08-21 14:32:14.249 WARN    putStreamCurlHandler(): [store-1-cam-1] Stream with streamHandle 548078239248 uploadHandle 9 has exited without triggering end-of-stream. Service call result: 10006
2024-08-21 14:32:14.249 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724250734.249
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 14:32:14.249 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 14:32:14.249 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 14:32:14.249 INFO    putStreamResultEvent(): Put stream result event. New upload handle 10
2024-08-21 14:32:14.260 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=eb03f10500e9746f93bc1a26b67e82cc3f7b8834d914c247b5c297bfa1136bb6
2024-08-21 14:32:14.260 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143214Z
2024-08-21 14:32:14.260 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:32:14.260 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 14:32:14.260 WARN    notifyDataAvailable(): [store-1-cam-1] Failed to un-pause curl with error: 43. Curl object 0x7f9c110420
    Authorization: AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=eb03f10500e9746f93bc1a26b67e82cc3f7b8834d914c247b5c297bfa1136bb6
    connection: keep-alive
    content-type: application/json
2024-08-21 14:32:14.260 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
2024-08-21 14:32:15.048 DEBUG   postReadCallback(): [store-1-cam-1] Pausing CURL read for upload handle: 10
2024-08-21 14:32:15.048 INFO    writeHeaderCallback(): RequestId: e448fd32-c027-f2b0-bb77-01e69ab27be9
2024-08-21 14:32:44.427 WARN    curlCompleteSync(): [store-1-cam-1] HTTP Error 0 : Response: (null)
2024-08-21 14:32:44.427 WARN    curlCompleteSync(): [store-1-cam-1] curl perform failed for url https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia with result Transferred a partial file: transfer closed with outstanding read data remaining
Request Headers:
Request URL: https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
    X-Amz-Date: 20240821T143214Z
    host: s-8e923eff.kinesisvideo.us-west-2.amazonaws.com
    transfer-encoding: chunked
    user-agent: AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
    x-amz-security-token: IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
    x-amzn-fragment-acknowledgment-required: 1
    x-amzn-fragment-timecode-type: ABSOLUTE
    x-amzn-producer-start-timestamp: 1724250734.249
    x-amzn-stream-name: store-1-cam-1
2024-08-21 14:32:44.428 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:32:44.428 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 7
2024-08-21 14:32:44.428 DEBUG   putStreamCurlHandler(): Network thread for Kinesis Video stream: store-1-cam-1 with upload handle: 10 exited. http status: 0
2024-08-21 14:32:44.428 INFO    kinesisVideoStreamTerminated(): Stream 0x7f9c023e10 terminated upload handle 10 with service call result 10006.
2024-08-21 14:32:44.428 WARN    putStreamCurlHandler(): [store-1-cam-1] Stream with streamHandle 548078239248 uploadHandle 10 has exited without triggering end-of-stream. Service call result: 10006
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
 KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-08-21 14:32:44.428 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 14:32:44.428 DEBUG   defaultStreamStateTransitionHook():
2024-08-21 14:32:44.428 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 8
2024-08-21 14:32:44.428 INFO    describeStreamResultEvent(): Describe stream result event.
2024-08-21 14:32:44.428 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 14:32:44.428 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 14:32:44.429 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724250764.429
2024-08-21 14:32:44.429 INFO    putStreamResultEvent(): Put stream result event. New upload handle 11
2024-08-21 14:32:44.439 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143244Z
2024-08-21 14:32:44.439 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:32:44.439 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 14:32:44.439 WARN    notifyDataAvailable(): [store-1-cam-1] Failed to un-pause curl with error: 43. Curl object 0x55910c4c00
2024-08-21 14:32:44.440 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZMUWPFCNQ/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=28691f7d6ea1a87eb7a810d436f9fdc35b29594d5f565b8181c136f7cfb5f865
2024-08-21 14:32:44.440 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJHMEUCIElsQkP9TAWQ/NHMFiWnfQuUfvFQ26SMtb4vm9umatoFAiEA8NaU7PvPf2HLx1tVURvKnmw1r6cy2kaa2bSqiryHhGYq6gMIeBAAGgw2Mzc0MjMzNDM5ODYiDFrKh6VcO1f5kp9QYirHA0mif2hmKmNrlRlAKBQ66+m9E7QAlr8jKpyXGxxqsc7cja/FLxWTDH4l6rwLscc/VN3qTz6d07C+xEt/YGzVo4I4uge8xNamo74ASzc1/jf69mlTNXTooS7LAvc8cqLHaWZHNlTeqK60EbqyPq/e0ar3zxNbwaboP+vOtf39TFXJx4yNOmMK4NFGTpefyF5zyQOWXsvZZlflyoFi7Idl4VBoE8ubWcgMa7WKN8+DzFzXPLlQHqE+9LawQOX4Hc9rj5//ANZLkHi93mTUeakRhRIkXUr25jqdyH0JpImKLAZoG4Kd/xQ/MpfluDUNEWzpS1EiN/2cSbOyazA0k7SlezQWvUNFK8oUx77UOSmueXEzGs/uew39/K9ROxGtijRBmNgys3L/O1h24AIjUiqWdF1MGznqSKqCTKIrckWAybTxqiWTe+0hUjN3NdUF1SasFImI84L+EjjUotguvAu8W0SQyqVwkHXgW0k5iu0sIvpgt14XoY2ycixEwvQzciatugKgI+RFGrJD02LWolIcsE+5DiaHR55XLZayvof5pXMiqtRBEYF+Jwta6lG8amgeI+YoQrBCv+dDjo+2fR/78u/z9IFhVPQdMM70l7YGOpoBUQDAQxaF6j2//UQOjrCjzT646cp0R/rnvKgaWOmCUwKgmN+ckV0g1Kpgy3FIsnASB+GjodE3//saoPcX+IsmHV/+G6hgjpabBLP1/DndPdMi7EO+V0brOQndpTxcIkHQ8NE/OLjWUpBjB/WLaid/wNsiSjqrzPNdtkt3o2JhUP+/FopqIhHwBnNJmcJIeBckNrJfTCbD5oEQcw==
2024-08-21 14:32:45.236 DEBUG   postReadCallback(): [store-1-cam-1] Pausing CURL read for upload handle: 11
2024-08-21 14:32:45.236 INFO    writeHeaderCallback(): RequestId: e3918090-0377-6036-bcae-7c62276bd1ed

I don't know if the next part of the log is necessary but in my current code if putKinesisVideoFrame() returns a failed status then I manually call stopKinesisVideoStreamSync() to end the current stream and create a new one.

2024-08-21 14:33:03.891 ERROR   stopKinesisVideoStreamSync(): operation returned status code: 0x0000000f
2024-08-21 14:33:03.891 ERROR   stopStreamSync(): [store-1-cam-1] Failed to stop Kinesis Video Stream - timed out.
2024-08-21 14:33:03.891 INFO    freeKinesisVideoStream(): Freeing Kinesis Video stream.
2024-08-21 14:33:03.891 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
2024-08-21 14:33:03.891 DEBUG   freeStream(): [store-1-cam-1] Freeing stream
2024-08-21 14:33:04.592 DEBUG   defaultStreamShutdownCallback(): Reported streamShutdown callback for stream handle 548078239248
2024-08-21 14:33:04.593 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
2024-08-21 14:33:04.593 DEBUG   freeStream(): [store-1-cam-1] Completed freeing stream
2024-08-21 14:33:04.593 INFO    freeKinesisVideoClient(): Freeing Kinesis Video Client
2024-08-21 14:33:04.994 DEBUG   freeKinesisVideoClientInternal(): Total allocated memory 0
2024-08-21 14:33:04.994 WARN    curlApiCallbacksShutdown(): curlApiCallbacksShutdown called when already in progress of shutting down
2024-08-21 14:33:19.995 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-08-21 14:33:19.995 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-08-21 14:33:20.260 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 3638
2024-08-21 14:33:20.260 DEBUG   parseIotResponse(): [store-1-cam-1] Iot credential expiration time 1724254438
2024-08-21 14:33:20.260 INFO    createKinesisVideoClient(): Creating Kinesis Video Client
2024-08-21 14:33:20.260 INFO    heapInitialize(): Creating AIV heap.
2024-08-21 14:33:20.260 INFO    heapInitialize(): Initializing native heap with limit size 20971520, spill ratio 0% and flags 0x00000001
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): Kinesis Video Stream Info
2024-08-21 14:33:20.261 INFO    createDeviceResultEvent(): Create device result event.
2024-08-21 14:33:20.261 INFO    createKinesisVideoStream(): Creating Kinesis Video Stream.
2024-08-21 14:33:20.261 INFO    heapInitialize(): Heap is initialized OK
2024-08-21 14:33:20.261 INFO    logStreamInfo(): SDK version: 3e519b7670e39031375d227f983ad2cde888078e
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Stream name: store-1-cam-1
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Streaming type: STREAMING_TYPE_REALTIME
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Absolute frame timecodes: Yes
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Average bandwidth (bps): 2097152
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Buffer duration (100ns): 2780000000
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Content type: video/h264
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Fragment duration (100ns): 20000000
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Framerate: 120
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Key frame fragmentation: Yes
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Max latency (100ns): 2363000000
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Nal adaptation flags: 40
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Use frame timecodes: Yes
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Allow stream creation: Yes
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Connection Staleness duration (100ns): 50000000
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Frame ordering mode: 0
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Replay duration (100ns): 1390000000
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Segment UUID: NULL
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Store Pressure Policy: 1
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Track id: 1
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Track name: kvs_video_track
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	View Overflow Policy: 1
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): Track list
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Codec id: V_MPEG4/ISO/AVC
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Track cpd: NULL
2024-08-21 14:33:20.261 DEBUG   logStreamInfo(): 	Track type: TRACK_INFO_TYPE_VIDEO
2024-08-21 14:33:20.261 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143320Z
2024-08-21 14:33:20.261 DEBUG   setRequestHeader(): Appending header to request: content-length -> 34
2024-08-21 14:33:20.261 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:33:20.261 DEBUG   setRequestHeader(): Appending header to request: host -> kinesisvideo.us-west-2.amazonaws.com/describeStream
2024-08-21 14:33:20.261 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:33:20.262 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZISKS3OUG/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=host;user-agent;x-amz-date, Signature=03b6d34a1f6d94a77ca6e1fae1d83e3a6b3b20444f0582400f819149b88014cf
2024-08-21 14:33:20.262 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJIMEYCIQC3jY9SpptpmLatyCGmsNnVhT7e4RYPvW/qqFzZ9CZGGgIhAM1CZsWbSt7K50u7xkhhU5SrdggPaU+ejoZ4BaBBAAQZKuoDCHgQABoMNjM3NDIzMzQzOTg2IgzigRQcXF8vq8fmp/8qxwOcuPJu543ey2DIT0G2vqA072/98kO403/wxFn6paoSx/i9hH09yBsQPdijF7Jb1oR8mX/WPbRzRLt7nBAf5EkxObjmohGqPi5s3X2WsuR/zxL/IaCRdxv3TQYN8q3bXunRxg5Jx2dRX44qx0nq3upTDsd4fVBCIdV4SEVlN5lfmX8D/Dk7vSauONxa0cCTQFVPyABvizHFc9Sit4y2bd0Upy0kDy55L5jZh9YRIXhS5vkpOsw1Xft7uHwg52jYCAIpqEO7ksXcw0SG8oSPa6+aRMTUxjJtfb9SeO3awueKFZMxGXWxPT4S/lW01fXuhFneGn1u3NchCZ9pyPwhpzQxRoZHpq/iIX9sKnG1+0Rs/WjLUZn1i59UZSGVu5OQTbrl7ylOPd35CoTJwoPwsOaqnThYZMTg2D0s47RCfbS9omkKwy2r+bAQTY0PC++7VDXr5exXtWOK78TQTkg2qbwSLkRRcpegwtDs5aq9sEwVsS4nMJnpioLbOdoq+cZ7p+0xUposJEa88L9oa1pIpbpCgTxitE6GeiM5yO9E7Yy3Oz0Zd/C87RDqmWKv59NNwVdFe+9wfiNqRFsiZx/O5gz0WKolGuMhATDW9Ze2BjqZAVeAczZj0Wh1yJMFWuKf3QH060kksDnO7U68gXBQZKVteRr69Q8QW3EAaeutclvMKc7Nxm9YyieAXzOFUh6QMffqbADpSHi9waDhXL3Fl9+8q0s6t66D86sHiYCaGQEBsm1Aghtumlx/j9IbXn0DJEvxmy2nQaHeuYpXhw4mME1xfjMKqrYoYtDJgFBruFXpN/QjnGr5zBZZnA==
2024-08-21 14:33:20.412 INFO    writeHeaderCallback(): RequestId: 4fbfddf4-7822-4a22-8719-e82dba4ff612
2024-08-21 14:33:20.412 DEBUG   describeStreamCurlHandler(): [store-1-cam-1] DescribeStream API response: {"StreamInfo":{"CreationTime":1.721868869167E9,"DataRetentionInHours":24,"DeviceName":null,"IngestionConfiguration":null,"KmsKeyId":"arn:aws:kms:us-west-2:637423343986:alias/aws/kinesisvideo","MediaType":null,"Status":"ACTIVE","StreamARN":"arn:aws:kinesisvideo:us-west-2:637423343986:stream/store-1-cam-1/1721868869167","StreamName":"store-1-cam-1","Version":"DjhamIXrOl0fAyGmGzTU"}}
2024-08-21 14:33:20.413 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:33:20.413 INFO    describeStreamResultEvent(): Describe stream result event.
2024-08-21 14:33:20.413 WARN    describeStreamResult(): Content type returned from the DescribeStream(null) call doesn't match the one specified in the StreamInfo(video/h264)
2024-08-21 14:33:20.413 WARN    describeStreamResult(): Retention period returned from the DescribeStream call doesn't match the one specified in the StreamInfo
2024-08-21 14:33:20.413 WARN    describeStreamResult(): [store-1-cam-1] Content type returned from the DescribeStream call doesn't match the one specified in the StreamInfo
2024-08-21 14:33:20.413 WARN    describeStreamResult(): [store-1-cam-1] Retention period returned from the DescribeStream call doesn't match the one specified in the StreamInfo
2024-08-21 14:33:20.414 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZISKS3OUG/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=host;user-agent;x-amz-date, Signature=9a8cb12cfa1282dd4dc0b63a1e4eb09ad0a878b8a9ce1614937e35fe0a8101a2
2024-08-21 14:33:20.414 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143320Z
2024-08-21 14:33:20.414 DEBUG   setRequestHeader(): Appending header to request: content-length -> 59
2024-08-21 14:33:20.414 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:33:20.414 DEBUG   setRequestHeader(): Appending header to request: host -> kinesisvideo.us-west-2.amazonaws.com/getDataEndpoint
2024-08-21 14:33:20.414 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJIMEYCIQC3jY9SpptpmLatyCGmsNnVhT7e4RYPvW/qqFzZ9CZGGgIhAM1CZsWbSt7K50u7xkhhU5SrdggPaU+ejoZ4BaBBAAQZKuoDCHgQABoMNjM3NDIzMzQzOTg2IgzigRQcXF8vq8fmp/8qxwOcuPJu543ey2DIT0G2vqA072/98kO403/wxFn6paoSx/i9hH09yBsQPdijF7Jb1oR8mX/WPbRzRLt7nBAf5EkxObjmohGqPi5s3X2WsuR/zxL/IaCRdxv3TQYN8q3bXunRxg5Jx2dRX44qx0nq3upTDsd4fVBCIdV4SEVlN5lfmX8D/Dk7vSauONxa0cCTQFVPyABvizHFc9Sit4y2bd0Upy0kDy55L5jZh9YRIXhS5vkpOsw1Xft7uHwg52jYCAIpqEO7ksXcw0SG8oSPa6+aRMTUxjJtfb9SeO3awueKFZMxGXWxPT4S/lW01fXuhFneGn1u3NchCZ9pyPwhpzQxRoZHpq/iIX9sKnG1+0Rs/WjLUZn1i59UZSGVu5OQTbrl7ylOPd35CoTJwoPwsOaqnThYZMTg2D0s47RCfbS9omkKwy2r+bAQTY0PC++7VDXr5exXtWOK78TQTkg2qbwSLkRRcpegwtDs5aq9sEwVsS4nMJnpioLbOdoq+cZ7p+0xUposJEa88L9oa1pIpbpCgTxitE6GeiM5yO9E7Yy3Oz0Zd/C87RDqmWKv59NNwVdFe+9wfiNqRFsiZx/O5gz0WKolGuMhATDW9Ze2BjqZAVeAczZj0Wh1yJMFWuKf3QH060kksDnO7U68gXBQZKVteRr69Q8QW3EAaeutclvMKc7Nxm9YyieAXzOFUh6QMffqbADpSHi9waDhXL3Fl9+8q0s6t66D86sHiYCaGQEBsm1Aghtumlx/j9IbXn0DJEvxmy2nQaHeuYpXhw4mME1xfjMKqrYoYtDJgFBruFXpN/QjnGr5zBZZnA==
2024-08-21 14:33:20.563 DEBUG   getStreamingEndpointCurlHandler(): [store-1-cam-1] GetStreamingEndpoint API response: {"DataEndpoint":"https://s-8e923eff.kinesisvideo.us-west-2.amazonaws.com"}
2024-08-21 14:33:20.563 INFO    writeHeaderCallback(): RequestId: 2f54f237-e614-4a7b-8961-b6f503d047a1
2024-08-21 14:33:20.564 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-08-21 14:33:20.564 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-08-21 14:33:20.564 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 548078239248
2024-08-21 14:33:20.768 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-08-21 14:33:20.768 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-08-21 14:33:20.768 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1724250800.768
2024-08-21 14:33:20.775 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-08-21 14:33:20.775 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-08-21 14:33:20.775 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-08-21 14:33:20.775 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-08-21 14:33:20.775 INFO    putStreamResultEvent(): Put stream result event. New upload handle 0
2024-08-21 14:33:20.785 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240821T143320Z
2024-08-21 14:33:20.785 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-08-21 14:33:20.785 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-08-21 14:33:20.785 WARN    notifyDataAvailable(): [store-1-cam-1] Failed to un-pause curl with error: 43. Curl object 0x7f9c0e5e20
2024-08-21 14:33:20.786 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZISKS3OUG/20240821/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=f2263240616ad51cfd356c7bd813a210e3831f88cb46a4cf311aa59cc5338ac9
2024-08-21 14:33:20.786 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEG8aCXVzLXdlc3QtMiJIMEYCIQC3jY9SpptpmLatyCGmsNnVhT7e4RYPvW/qqFzZ9CZGGgIhAM1CZsWbSt7K50u7xkhhU5SrdggPaU+ejoZ4BaBBAAQZKuoDCHgQABoMNjM3NDIzMzQzOTg2IgzigRQcXF8vq8fmp/8qxwOcuPJu543ey2DIT0G2vqA072/98kO403/wxFn6paoSx/i9hH09yBsQPdijF7Jb1oR8mX/WPbRzRLt7nBAf5EkxObjmohGqPi5s3X2WsuR/zxL/IaCRdxv3TQYN8q3bXunRxg5Jx2dRX44qx0nq3upTDsd4fVBCIdV4SEVlN5lfmX8D/Dk7vSauONxa0cCTQFVPyABvizHFc9Sit4y2bd0Upy0kDy55L5jZh9YRIXhS5vkpOsw1Xft7uHwg52jYCAIpqEO7ksXcw0SG8oSPa6+aRMTUxjJtfb9SeO3awueKFZMxGXWxPT4S/lW01fXuhFneGn1u3NchCZ9pyPwhpzQxRoZHpq/iIX9sKnG1+0Rs/WjLUZn1i59UZSGVu5OQTbrl7ylOPd35CoTJwoPwsOaqnThYZMTg2D0s47RCfbS9omkKwy2r+bAQTY0PC++7VDXr5exXtWOK78TQTkg2qbwSLkRRcpegwtDs5aq9sEwVsS4nMJnpioLbOdoq+cZ7p+0xUposJEa88L9oa1pIpbpCgTxitE6GeiM5yO9E7Yy3Oz0Zd/C87RDqmWKv59NNwVdFe+9wfiNqRFsiZx/O5gz0WKolGuMhATDW9Ze2BjqZAVeAczZj0Wh1yJMFWuKf3QH060kksDnO7U68gXBQZKVteRr69Q8QW3EAaeutclvMKc7Nxm9YyieAXzOFUh6QMffqbADpSHi9waDhXL3Fl9+8q0s6t66D86sHiYCaGQEBsm1Aghtumlx/j9IbXn0DJEvxmy2nQaHeuYpXhw4mME1xfjMKqrYoYtDJgFBruFXpN/QjnGr5zBZZnA==
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Allocated storage byte size: 158922
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Available storage byte size: 20812598
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Overall view duration (ms): 0
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 16777216 (16384 Kbps)
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Total view allocation byte size: 1601360
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 16777216 (16384 Kbps)
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-08-21 14:33:20.805 DEBUG   logStreamMetric(): 	Overall view byte size: 0
2024-08-21 14:33:20.806 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 544
2024-08-21 14:33:20.806 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 0
2024-08-21 14:33:20.806 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 1
2024-08-21 14:33:20.806 DEBUG   logStreamMetric(): 	Total transferred bytes: 0
2024-08-21 14:33:20.806 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of Received ACKs: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of dropped frames: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of skipped frames: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	API Call Retry Count : 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.000000
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 14
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 120.000000
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-08-21 14:33:20.808 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 120.000000
2024-08-21 14:33:20.955 INFO    writeHeaderCallback(): RequestId: e137fbef-7ad5-6497-be08-06f812ef70a4
2024-08-21 14:33:20.956 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 0
2024-08-21 14:33:20.983 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1024 bytes to Kinesis Video. Upload stream handle: 0
2024-08-21 14:33:21.012 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 0
2024-08-21 14:33:21.016 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 0 returned: {"EventType":"BUFFERING","FragmentTimecode":1724250800764,"FragmentNumber":"91343852333185819652181290052453512667512710423"}
2024-08-21 14:33:21.019 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1024 bytes to Kinesis Video. Upload stream handle: 0
2024-08-21 14:33:21.042 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 31713 bytes to Kinesis Video. Upload stream handle: 0
2024-08-21 14:33:21.072 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 1080 bytes to Kinesis Video. Upload stream handle: 0
2024-08-21 14:33:21.133 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 969 bytes to Kinesis Video. Upload stream handle: 0

As you can see after the stream was manually restarted it started working again.

Please let me know if my current understanding of the issue is correct or if there is any additional information I can provide!

[stefankiesz]

Hi Peter, can you please tell me are you able to reproduce this issue using our sample applications? Also wondering, is there a gap between the stopKinesisVideoStreamSync() call and the previous code block in the above logs? Seems that there is as they are ~18s apart. Could you please include those logs too?

[bachtran02]

Noted. I will get back to you on this ASAP.

[bachtran02]

Hi @stefankiesz

My apologies for the belated response!

Also wondering, is there a gap between the stopKinesisVideoStreamSync() call and the previous code block in the above logs? Seems that there is as they are ~18s apart.

The two log lines come directly after each other. I don't think there is any gap in between!

can you please tell me are you able to reproduce this issue using our sample applications?

I have been testing this KVS sample app on the camera (aarch64) for the past couple days and were able to reproduce the error.

While the error messages are not completely the same, the patterns I noticed are similar: the error usually comes during or shortly after the IoT credentials rotating process, which causes the app to stop sending stream and logging. The app also didn't exit after encountering the error.

Additionally, I was able to reproduce the error much faster after reducing the AWS IoT credential duration.
If before it was 3600 seconds, the error would usually happen 12 hours into streaming, I now set it to 900 second and the error occurs around 1 hour into streaming. I wonder if this information is helpful.

Here are the logs of 3 error instances. Due to the storage capacity of the camera, I wasn't able to get VERBOSE logs.

Here is the Google Drive URL to the three full log files if you want to look into them more.
(my apologies the files are too large to upload here)
https://drive.google.com/drive/folders/1cSWfYvq9KGV6pNu3Hc3ANiwKFVJDKyn4?usp=sharing

0911

2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.951 DEBUG   main(): Adding metadata! frameIndex: 160574
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.951 DEBUG   readFrameData(): Key frame file lib//h264SampleFrames/frame-181.h264, size 103189
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Allocated storage byte size: 1030592
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Available storage byte size: 19940928
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 3892072 (3800 Kbps)
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Total view allocation byte size: 213200
2024-09-11T17:56:46.973-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-09-11T17:56:46.975-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 3892072 (3800 Kbps)
2024-09-11T17:56:46.975-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-09-11T17:56:46.975-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-09-11T17:56:46.975-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Overall view byte size: 924372
2024-09-11T17:56:46.975-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1800
2024-09-11T17:56:46.975-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 6681495
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.964 DEBUG   logStreamMetric(): 	Total transferred bytes: 3253443341
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 2561545624
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 3585
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 3584
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of Received ACKs: 3584
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of dropped frames: 27
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of skipped frames: 17
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 11
2024-09-11T17:56:47.174-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 12
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	API Call Retry Count : 1
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 199
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 25.000000
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-09-11T17:56:47.176-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.010000
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:46.965 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 25.000000
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.004 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 11
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.005 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 38488 bytes to Kinesis Video. Upload stream handle: 11
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.026 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 24330 bytes to Kinesis Video. Upload stream handle: 11
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.087 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 22046 bytes to Kinesis Video. Upload stream handle: 11
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.087 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 11 returned: {"EventType":"RECEIVED","FragmentTimecode":1726102346929,"FragmentNumber":"91343852333187949102167507035542752762977638955"}
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.088 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 11 returned: {"EventType":"BUFFERING","FragmentTimecode":1726102348729,"FragmentNumber":"91343852333187949107119267192684274374384890968"}
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.108 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 20514 bytes to Kinesis Video. Upload stream handle: 11
2024-09-11T17:56:47.179-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.168 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 17175 bytes to Kinesis Video. Upload stream handle: 11
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.169 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 11 returned: {"EventType":"PERSISTED","FragmentTimecode":1726102346929,"FragmentNumber":"91343852333187949102167507035542752762977638955"}
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 DEBUG   defaultStreamStateTransitionHook():
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 DEBUG   defaultStreamStateTransitionHook():
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 2
2024-09-11T17:56:47.181-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 3
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]:  KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:47.172 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.188 DEBUG   defaultStreamStateTransitionHook():
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.188 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 4
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.188 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.188 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.188 ERROR   blockingCurlCall(): Curl perform failed for url https://ctzgs1unuh7q2.credentials.iot.us-west-2.amazonaws.com/role-aliases/camera-role-alias/credentials with result Timeout was reached : Resolving timed out after 5000 milliseconds
2024-09-11T17:56:52.465-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.188 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 941
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 367104440432
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   parseIotResponse(): [store-1-cam-1] Iot credential expiration time 1726103553
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1726102612.459
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-09-11T17:56:52.469-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 367104440432. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 367104440432. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240912T005652Z
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 ERROR   getStreamingEndpointResultEvent(): operation returned status code: 0x16000001
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 INFO    putStreamResultEvent(): Put stream result event. New upload handle 12
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-09-11T17:56:52.470-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-09-11T17:56:52.472-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[379070]: 2024-09-12 00:56:52.459 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty

0910

2024-09-10T09:51:25.160-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.145 DEBUG   readFrameData(): Key frame file lib//h264SampleFrames/frame-361.h264, size 101227
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.145 DEBUG   main(): Adding metadata! frameIndex: 21316
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Allocated storage byte size: 1005558
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Available storage byte size: 19965962
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1800
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 3848600 (3758 Kbps)
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Total view allocation byte size: 213200
2024-09-10T09:51:25.163-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 426393835
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 3848600 (3758 Kbps)
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Overall view byte size: 901310
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 891548
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 2
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 2
2024-09-10T09:51:25.166-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Total transferred bytes: 432012909
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 476
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 475
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of Received ACKs: 475
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of dropped frames: 0
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of skipped frames: 0
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-09-10T09:51:25.660-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	API Call Retry Count : 1
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.010000
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 229
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 25.000000
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.157 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 25.000000
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.167 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.663-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.169 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 36516 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.230 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 18812 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.231 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 1 returned: {"EventType":"BUFFERING","FragmentTimecode":1725987051762,"FragmentNumber":"91343852333187894528818815178807703998165633313"}
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.231 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 1 returned: {"EventType":"RECEIVED","FragmentTimecode":1725987049962,"FragmentNumber":"91343852333187894523867055021666182400467747040"}
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.252 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15356 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.312 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 13685 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.333 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15253 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.394 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 16879 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.394 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 1 returned: {"EventType":"PERSISTED","FragmentTimecode":1725987049962,"FragmentNumber":"91343852333187894523867055021666182400467747040"}
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.415 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15076 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.669-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.475 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 13808 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.671-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.496 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19480 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.671-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.556 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 16057 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.671-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.577 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 17338 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:25.671-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.638 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19317 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.658 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19562 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.719 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19797 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.740 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19041 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.800 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 18989 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.821 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 18896 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.882 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 17085 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.902 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15649 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.963 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15719 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:25.984 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 16197 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.621-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.044 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15686 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.065 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 17175 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.126 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 17373 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.146 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19643 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.207 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 20694 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.228 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 19398 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.289 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 21064 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.350 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 20666 bytes to Kinesis Video. Upload stream handle: 1
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 DEBUG   defaultStreamStateTransitionHook():
2024-09-10T09:51:31.624-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 2
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 DEBUG   defaultStreamStateTransitionHook():
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 3
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:26.351 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.366 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 4
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.366 ERROR   blockingCurlCall(): Curl perform failed for url https://ctzgs1unuh7q2.credentials.iot.us-west-2.amazonaws.com/role-aliases/camera-role-alias/credentials with result Timeout was reached : Resolving timed out after 5000 milliseconds
2024-09-10T09:51:31.628-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.366 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-09-10T09:51:31.633-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.366 DEBUG   defaultStreamStateTransitionHook():
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]:  KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.366 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.366 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.618 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 940
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.618 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 366750988400
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.618 DEBUG   parseIotResponse(): [store-1-cam-1] Iot credential expiration time 1725988031
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.618 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1725987091.619
2024-09-10T09:51:31.634-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 366750988400. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240910T165131Z
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 INFO    putStreamResultEvent(): Put stream result event. New upload handle 2
2024-09-10T09:51:31.637-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 366750988400. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   freeStream(): [store-1-cam-1] Freeing stream
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZGYUO3ZAU/20240910/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=fd066d89c1ae070bd19d045651ac54bde1b9ae3c45d61fc6b2c8817c11dbbf8d
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 ERROR   getStreamingEndpointResultEvent(): operation returned status code: 0x16000001
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 ERROR   main(): Failed with status 0x16000001
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 INFO    freeKinesisVideoStream(): Freeing Kinesis Video stream.
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 WARN    putKinesisVideoFrame(): [store-1-cam-1] Failed to submit frame to Kinesis Video client. status: 0x16000001 decoding timestamp: 17259870529220868 presentation timestamp: 17259870529220868
2024-09-10T09:51:31.640-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 WARN    shutdownStreamCurl(): shutdownStreamCurl called when already in progress of shutting down
2024-09-10T16:11:07.180-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[266168]: 2024-09-10 16:51:31.619 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEFEaCXVzLXdlc3QtMiJHMEUCIQCdkG3cdGNjp2Q8REOuJE1lgg+hW3WwTtbQerIkIIEghQIgObev1wUnTR2MH5cm7Mplchv0WHoXiGozeEw2ZeHZeI4q6gMIehAAGgw2Mzc0MjMzNDM5ODYiDFE0Rc7r9VWdrD7/jirHA9IhmryZNjnruO79+cQYc2Jymvc64BZTEX73SOfvkp/1pJ9L4ErogCckVP+pO9YjSSw5iYGmm9/s3VlJutwYXEge5IYFUaVGz0/h/G7hWYYTzy/CeDKrES8IJAmXzwaWki52enPwEz1nk292zlVScC+cxAv0y/djH+wpA7bqMyaumAi1X9htkTUqjNjWWRGzeshBKnMhZSqS9r9VXaKR1deugX1bfCJGq8uCnSlH5f9ybpo80PoyCQYRk+pE0SQYm97ZQZBP01CrGFcN78JkHSCa

0909

2024-09-09T17:29:13.720-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.696 DEBUG   main(): Adding metadata! frameIndex: 78452
2024-09-09T17:29:13.720-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.696 DEBUG   readFrameData(): Key frame file lib//h264SampleFrames/frame-271.h264, size 102821
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.708 DEBUG   logStreamMetric(): Kinesis Video client and stream metrics for stream store-1-cam-1
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Allocated storage byte size: 1015710
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Available storage byte size: 19955810
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Current view byte size: 0
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Current view duration (ms): 0
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Overall storage byte size: 20971520
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Overall view byte size: 909868
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Overall view duration (ms): 1800
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Total streams transfer rate (bps): 3878064 (3787 Kbps)
2024-09-09T17:29:13.833-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Total view allocation byte size: 213200
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Average streaming sessions duration: 1169125153
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Current transfer rate (bps): 3878064 (3787 Kbps)
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of Buffered ACKs: 1752
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of Error ACKs: 0
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of Persisted ACKs: 1751
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of Received ACKs: 1751
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Stream uptime in (ms): 3262233
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Total number of active streaming sessions: 5
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Total number of streaming sessions: 5
2024-09-09T17:29:13.836-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Total transferred bytes: 1589987385
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Average Control Plane API latency (ms): 20
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Average Data Plane API latency (ms): 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of Put Frame errors: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of buffer pressure events: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of dropped frames: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of latency pressure events: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of skipped frames: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of storage pressure events: 0
2024-09-09T17:29:13.839-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Number of stream staleness events: 0
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	API Call Retry Count : 1
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Average API call retry count for client: 0.010000
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Current elementary frame rate (fps): 25.000000
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.709 DEBUG   logStreamMetric(): 	Total elementary frame rate (fps): 25.000000
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.749 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 65524 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.750 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 58181 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.811 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 16658 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.812 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 4 returned: {"EventType":"BUFFERING","FragmentTimecode":1725928029867,"FragmentNumber":"91343852333187866665264410943452657048156905088"}
2024-09-09T17:29:13.842-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.812 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 4 returned: {"EventType":"RECEIVED","FragmentTimecode":1725928028067,"FragmentNumber":"91343852333187866660312650786311135437896852060"}
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.833 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 18639 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.894 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15737 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.915 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 13580 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.975 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15628 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:13.997 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 13046 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.058 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 15853 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.118 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 16002 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.119 DEBUG   postWriteCallback(): Curl post body write function for stream with handle: store-1-cam-1 and upload handle: 4 returned: {"EventType":"PERSISTED","FragmentTimecode":1725928028067,"FragmentNumber":"91343852333187866660312650786311135437896852060"}
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.139 DEBUG   postReadCallback(): [store-1-cam-1] Wrote 18763 bytes to Kinesis Video. Upload stream handle: 4
2024-09-09T17:29:19.435-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 2
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]:  KinesisVideoStream base result is [10401]. Executing KVS retry handler of retry strategy type [1]
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 DEBUG   defaultStreamStateTransitionHook():
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 DEBUG   defaultStreamStateTransitionHook():
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 1
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:14.161 INFO    getStreamingEndpointResultEvent(): Get streaming endpoint result event.
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.181 ERROR   blockingCurlCall(): Curl perform failed for url https://ctzgs1unuh7q2.credentials.iot.us-west-2.amazonaws.com/role-aliases/camera-role-alias/credentials with result Timeout was reached : Resolving timed out after 5000 milliseconds
2024-09-09T17:29:19.440-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.181 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]:  KinesisVideoStream base result is [10006]. Executing KVS retry handler of retry strategy type [1]
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.181 DEBUG   defaultStreamStateTransitionHook():
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.181 DEBUG   defaultStreamStateTransitionHook(): Stream state machine retry count: 2
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.181 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-SDK-KVS
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.181 DEBUG   setRequestHeader(): Appending header to request: x-amzn-iot-thingname -> store-1-cam-1
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.432 DEBUG   convertTimestampToEpoch(): Difference between current time and iot expiration is 939
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.432 DEBUG   parseIotResponse(): [store-1-cam-1] Iot credential expiration time 1725929098
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   defaultStreamReadyCallback(): Reported streamReady callback for stream handle 368021334128
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   setRequestHeader(): Appending header to request: user-agent -> AWS-PRODUCER-SDK-KVS/1.5.2 GCC/11.4.0 Linux/4.14.255-axis8 aarch64
2024-09-09T17:29:19.444-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 INFO    getStreamingTokenResultEvent(): Get streaming token result event.
2024-09-09T17:29:19.446-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-acknowledgment-required -> 1
2024-09-09T17:29:19.446-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   setRequestHeader(): Appending header to request: x-amzn-fragment-timecode-type -> ABSOLUTE
2024-09-09T17:29:19.446-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   setRequestHeader(): Appending header to request: x-amzn-producer-start-timestamp -> 1725928159.433
2024-09-09T17:29:19.446-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   setRequestHeader(): Appending header to request: x-amzn-stream-name -> store-1-cam-1
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.433 DEBUG   setRequestHeader(): Appending header to request: transfer-encoding -> chunked
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.434 DEBUG   setRequestHeader(): Appending header to request: connection -> keep-alive
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 368021334128. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   setRequestHeader(): Appending header to request: X-Amz-Date -> 20240910T002919Z
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   setRequestHeader(): Appending header to request: content-type -> application/json
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   setRequestHeader(): Appending header to request: host -> s-8e923eff.kinesisvideo.us-west-2.amazonaws.com/putMedia
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 ERROR   getStreamingEndpointResultEvent(): operation returned status code: 0x16000001
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 INFO    putStreamResultEvent(): Put stream result event. New upload handle 5
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-09-09T17:29:29.643-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 WARN    continuousRetryStreamErrorReportHandler(): Reporting stream error. Errored timecode: 0 Status: 0x16000001
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   curlApiCallbacksShutdownActiveRequests(): pActiveRequests hashtable is empty
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   defaultStreamErrorReportCallback(): Reported streamError callback for stream handle 368021334128. Upload handle 18446744073709551615. Fragment timecode in 100ns: 0. Error status: 0x16000001
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   freeStream(): [store-1-cam-1] Freeing stream
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   setRequestHeader(): Appending header to request: Authorization -> AWS4-HMAC-SHA256 Credential=ASIAZI2LELFZCNWAV4JL/20240910/us-west-2/kinesisvideo/aws4_request, SignedHeaders=connection;host;transfer-encoding;user-agent;x-amz-date;x-amzn-fragment-acknowledgment-required;x-amzn-fragment-timecode-type;x-amzn-producer-start-timestamp;x-amzn-stream-name, Signature=55d90ea42211987702bda1b2a06ac00fbba46964ce6bd7bfe3b2212b79b4bc24
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 DEBUG   setRequestHeader(): Appending header to request: x-amz-security-token -> IQoJb3JpZ2luX2VjEEEaCXVzLXdlc3QtMiJHMEUCIBKi2HR9d5eQ1wP/gxnAJtPKdq8YfMpUQp7hLfpgCV0FAiEAi+u1vyKzdQVwFrj/Wew2lroaS6vAqzO22S14Ny9lE+Uq6gMIahAAGgw2Mzc0MjMzNDM5ODYiDFyFbgmZedcyCOQSqirHA9LZaVmLTtqVAQQ/ejUPWGNrx3M2n3FvJGYKpjWEB2+XKRT97MKe2TTgCA52IMgzq9pDbA5PDEDo3emfxhLqX9azNNdtcgex7OFltPoZxO0znr7rXpi3Opi6Pmcffzmt/5w5h4V+13jOuZNMRlSOLR8kr7QsIOtoa9924nX/NfiLCEkaF8TLvYp8FNTNPpUe4esSuhCIhpgfA6U7POHqI4EWuJA4o5DPGRdHKcEuRXmu3TRR1DD/ZlPg1AmCnQIqoUMl3Qn7hNrsJuUgHg5SxPXACEmb8xQ3X/OR7Bam34pd25yRU9fwX+f/+N3JCELqMmJGXhRANl8C9ZD/5S0MorsleJAKhkVOvc0Z3LV6X7C7hLSOwQPGIXiYL4se+I/j5fzA0hcB9oL5DnVkdsm2Gr7YdrKeUQLSSzkO2nyXveaFJ6Eie44iykAn6pLKq6Nh4Po2CQvNYTuZNl+2gxURxOZrAa3yE/AmNeQQ4llJGaIwHl7VP77smkSuSq+gMHR0K7EsoNAtCRG/aQYpHWou8IIibhUAHX+cjrfSXLCy6rvrT3anXtTJJCXwELt25ZWeriamGc1+zfWxXwCPzPW60McV9E+3bYH3MIam/rYGOpoBTjdCXy++8Tv4F+gVutNxSMgOvKe4plHLtFVJnDB903GE8gkZ0lmrmoZvRqtFnJ0gY0r7fqpxMeVzCmGiAEMarVeF/NEJKogVLLe5DcfHYGjx1TQgUHzMktlMnlY9qcdI+nlMHt3KA/Tr/kADfqBt6pdpm0Ch1OHvrh45i9aTY/iWRu2jOIo/RHRDI/xIkh4qlyUW0/diHwhvHA==
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 ERROR   main(): Failed with status 0x16000001
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 INFO    freeKinesisVideoStream(): Freeing Kinesis Video stream.
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 WARN    putKinesisVideoFrame(): [store-1-cam-1] Failed to submit frame to Kinesis Video client. status: 0x16000001 decoding timestamp: 17259280303073752 presentation timestamp: 17259280303073752
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.435 WARN    shutdownStreamCurl(): shutdownStreamCurl called when already in progress of shutting down
2024-09-09T17:29:29.646-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.603 INFO    writeHeaderCallback(): RequestId: e8367f16-636e-262b-b76f-ea508eac7568
2024-09-09T17:29:29.649-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:19.995 DEBUG   postReadCallback(): [store-1-cam-1] Pausing CURL read for upload handle: 4
2024-09-09T17:29:29.649-07:00 axis-b8a44f677c6d [ INFO    ] lexiusapp[201998]: 2024-09-10 00:29:29.641 DEBUG   defaultStreamShutdownCallback(): Reported streamShutdown callback for stream handle 368021334128

Please let me know if you want to know anything more on this!

[niyatim23]

Hi @bachtran02, are you able to reproduce this while using the curl bundled with the SDK? I see that you mentioned that you're using curl version: 8.8.0. I would recommend using all the dependencies bundled with the SDK and report back if you're able to reproduce the issue