Welcome to the Panopto Community

Please note: All new registrants to the Panopto Community Forum must be approved by a forum moderator or admin. As such, if you navigate to a feature that is members-only, you may receive an error page if your registration has not yet been approved. We apologize for any inconvenience and are approving new members as quickly as possible.

When is a session file uploaded?

Tim HarperTim Harper Tyro
in API

I am using the REST API to upload video files. For each file I create the manifest.xml, upload it and then upload the file. The sessions status call returns these status values.

UPLOAD_CREATED = 0
UPLOAD_COMPLETE = 1
UPLOAD_CANCELLED = 2
UPLOAD_PROCESSING = 3
UPLOAD_READY = 4
UPLOAD_ERROR = 5
UPLOAD_DELETING_FILE = 6
UPLOAD_DELETED = 7
UPLOAD_DELETION_ERROR = 8

I have noticed the log for the files e.g."

2021-03-08 07:28:16 AM: Completed Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:27:50 AM: Processing Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06055d71b67b88c5f)

2021-03-08 07:27:49 AM: Parsing task data Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06055d71b67b88c5f)

2021-03-08 07:27:49 AM: Checked out Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06055d71b67b88c5f)

2021-03-08 07:27:42 AM: Completed Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:27:09 AM: Completed Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:27:09 AM: EventTarget e1dd0451-3ee7-44b5-82f6-ace500cd3676 created.

2021-03-08 07:26:23 AM: Processing Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06e5d36db96603b2a)

2021-03-08 07:24:25 AM: Parsing task data Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06e5d36db96603b2a)

2021-03-08 07:24:25 AM: Checked out Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06e5d36db96603b2a)

2021-03-08 07:24:07 AM: Completed Machine Transcription Task: 4dea6595-9921-4ef9-8cc8-ace500cb2752 session: 6f791a68-5b5c-4063-8478-ace500c46f0a transcription request: 2c974b59-05b9-455e-9573-ace500cb2721

2021-03-08 07:24:05 AM: EventTarget ffd235c7-d9d5-4bd7-8ad3-ace500cc5e85 created.

2021-03-08 07:23:22 AM: Completed Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:23:22 AM: Results published Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:23:05 AM: Processing Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:45 AM: Processing Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:16 AM: Processing Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-082b72cd9bd262b8c)

2021-03-08 07:22:13 AM: Initializing worker with task metadata Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:12 AM: Metadata collected by task processor. Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:12 AM: Checked out Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:21:59 AM: Performing fast podcast encode alongside viewer encode for 90930549-9f8a-4498-ac67-ace500c46f11.

2021-03-08 07:21:59 AM: Created Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:21:58 AM: Completed Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:21:58 AM: Results published Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:21:53 AM: Parsing task data Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-082b72cd9bd262b8c)

2021-03-08 07:21:53 AM: Checked out Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-082b72cd9bd262b8c)

2021-03-08 07:20:18 AM: Processing Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:20:05 AM: Initializing worker with task metadata Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:20:04 AM: Metadata collected by task processor. Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:20:04 AM: Checked out Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:19:54 AM: Checked out Machine Transcription Task: 4dea6595-9921-4ef9-8cc8-ace500cb2752 session: 6f791a68-5b5c-4063-8478-ace500c46f0a transcription request: 2c974b59-05b9-455e-9573-ace500cb2721 (i-0b211efb69a1ee3fc)

2021-03-08 07:19:51 AM: Completed Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:50 AM: Session marked for repackaging and re-encoding. (sessionId=6f791a68-5b5c-4063-8478-ace500c46f0a, user=).

2021-03-08 07:19:50 AM: Created Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:50 AM: Canceled Media Storage Optimization: 497d69d1-843a-4d9b-8bbf-ace500cb26dd session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:49 AM: Processing Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-03f07f7ccd3ef7022)

2021-03-08 07:19:49 AM: Parsing task data Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-03f07f7ccd3ef7022)

2021-03-08 07:19:49 AM: Checked out Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-03f07f7ccd3ef7022)

2021-03-08 07:19:39 AM: Human transcription request created

2021-03-08 07:19:39 AM: Session closed. (sessionId=6f791a68-5b5c-4063-8478-ace500c46f0a, user=).

2021-03-08 07:19:38 AM: Completed Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:38 AM: Results published Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:38 AM: Stream 1a3c0790-5376-464d-8ed7-ace500c46f71 created.

2021-03-08 06:56:05 AM: Processing Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:52 AM: Initializing worker with task metadata Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:52 AM: Metadata collected by task processor. Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:52 AM: Checked out Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:47 AM: Queued for import processing.

2021-03-08 06:55:47 AM: Job 251a7d28-41d3-4b24-a6c6-ace500c46f92 import upload complete.

2021-03-08 06:55:12 AM: Job 251a7d28-41d3-4b24-a6c6-ace500c46f92 import upload.

2021-03-08 06:55:11 AM: EventTarget 89fe4051-223d-4fc7-902b-ace500c46f33 created.

2021-03-08 06:55:11 AM: Session 6f791a68-5b5c-4063-8478-ace500c46f0a created.

I am uploaded over 1000 files per run of my API script so I would like to upload as fast as possible and not wait for the re encoding, captioning or other processes before I start a new upload. What will be my indicator that the uploaded of the file data is complete. I am using multipart upload code. I need to confirm upload status along with multipart code completion:

def upload_media(self):
    source_file = open(self.input_file, 'rb')
    key_name = self.target.file_key(self.dest_filename)
    upload_id = self.s3.create_multipart_upload(
        Bucket=self.target.bucket_name, Key=key_name)['UploadId']

    parts = []
    chunk_size = 13107200
    source_size = os.stat(self.input_file).st_size
    chunk_count = int(math.ceil(source_size / float(chunk_size)))

    for i in range(chunk_count):
        offset = chunk_size * i
        byte_count = min(chunk_size, source_size - offset)

        data = source_file.read(byte_count)
        part = self.s3.upload_part(
            Bucket=self.target.bucket_name, Body=data, Key=key_name,
            UploadId=upload_id, PartNumber=i)
        parts.append({'PartNumber': i, 'ETag': part['ETag']})

    self.s3.complete_multipart_upload(
        Bucket=self.target.bucket_name,
        Key=key_name,
        UploadId=upload_id,
        MultipartUpload={'Parts': parts})

    source_file.close()


Answers

  • Charles BarbourCharles Barbour Superstar

    I'm pretty sure that once a session is Processing, you are done with the upload and creation process and can safely move on to uploading a new one. When just dragging and dropping files into Panopto or using the Watch Folder upload service, that's what happens. The session won't be ready to play/download until the value comes back as Ready, but you can certainly move on while Panopto does all the encoding in the background. They certainly do.

    I am curious how this field relates or compares to the Session State field exposed by the SOAP API.

    https://support.panopto.com/resource/APIDocumentation/Help/html/962f983d-c096-dc15-0047-d8c982d7061d.htm

    Created 0 The session has just been created

    Scheduled 1 The session is scheduled to be recorded

    Recording 2 The session is currently recording

    Broadcasting 3 The session is currently broadcasting

    Processing 4 The session is done being recorded and is being processed by the server

    Complete 5 The session has been recorded and processed and can now be viewed

  • Tim HarperTim Harper Tyro
    edited March 2021

    Thanks Charles!!

    BTW - I had already moved 250,000 zoom videos to Office 365 SharePoint backup. Fun huh?

    This should only be about 26K vids total. When I finish this 150 GB test run. I will be able to automate the lot running screen on RHEL8. fingers crossed! Looks like about 6 TB total

Sign In or Register to comment.