Welcome to the Panopto Community

Please note: All new registrants to the Panopto Community Forum must be approved by a forum moderator or admin. As such, if you navigate to a feature that is members-only, you may receive an error page if your registration has not yet been approved. We apologize for any inconvenience and are approving new members as quickly as possible.
Options

When is a session file uploaded?

Tim HarperTim Harper Tyro
in API

I am using the REST API to upload video files. For each file I create the manifest.xml, upload it and then upload the file. The sessions status call returns these status values.

UPLOAD_CREATED = 0
UPLOAD_COMPLETE = 1
UPLOAD_CANCELLED = 2
UPLOAD_PROCESSING = 3
UPLOAD_READY = 4
UPLOAD_ERROR = 5
UPLOAD_DELETING_FILE = 6
UPLOAD_DELETED = 7
UPLOAD_DELETION_ERROR = 8

I have noticed the log for the files e.g."

2021-03-08 07:28:16 AM: Completed Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:27:50 AM: Processing Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06055d71b67b88c5f)

2021-03-08 07:27:49 AM: Parsing task data Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06055d71b67b88c5f)

2021-03-08 07:27:49 AM: Checked out Delete Encodings Task: 75bc9b1b-2d1b-42ba-be87-ace500cd5db7 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06055d71b67b88c5f)

2021-03-08 07:27:42 AM: Completed Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:27:09 AM: Completed Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:27:09 AM: EventTarget e1dd0451-3ee7-44b5-82f6-ace500cd3676 created.

2021-03-08 07:26:23 AM: Processing Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06e5d36db96603b2a)

2021-03-08 07:24:25 AM: Parsing task data Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06e5d36db96603b2a)

2021-03-08 07:24:25 AM: Checked out Embed Transcript Task: b7cdb454-bffa-4775-9e2a-ace500cc6182 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-06e5d36db96603b2a)

2021-03-08 07:24:07 AM: Completed Machine Transcription Task: 4dea6595-9921-4ef9-8cc8-ace500cb2752 session: 6f791a68-5b5c-4063-8478-ace500c46f0a transcription request: 2c974b59-05b9-455e-9573-ace500cb2721

2021-03-08 07:24:05 AM: EventTarget ffd235c7-d9d5-4bd7-8ad3-ace500cc5e85 created.

2021-03-08 07:23:22 AM: Completed Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:23:22 AM: Results published Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:23:05 AM: Processing Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:45 AM: Processing Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:16 AM: Processing Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-082b72cd9bd262b8c)

2021-03-08 07:22:13 AM: Initializing worker with task metadata Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:12 AM: Metadata collected by task processor. Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:22:12 AM: Checked out Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11 (i-02e699b5fefe448e7)

2021-03-08 07:21:59 AM: Performing fast podcast encode alongside viewer encode for 90930549-9f8a-4498-ac67-ace500c46f11.

2021-03-08 07:21:59 AM: Created Fast path viewer encode task (core): a7e0d538-f82d-49e7-9204-ace500cbcb01 session: 6f791a68-5b5c-4063-8478-ace500c46f0a delivery: 90930549-9f8a-4498-ac67-ace500c46f11

2021-03-08 07:21:58 AM: Completed Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:21:58 AM: Results published Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:21:53 AM: Parsing task data Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-082b72cd9bd262b8c)

2021-03-08 07:21:53 AM: Checked out Optical Character Recognition: e597aebc-9ccb-40aa-bc7e-ace500cb270a session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-082b72cd9bd262b8c)

2021-03-08 07:20:18 AM: Processing Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:20:05 AM: Initializing worker with task metadata Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:20:04 AM: Metadata collected by task processor. Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:20:04 AM: Checked out Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0b5ac953bc2ec9786)

2021-03-08 07:19:54 AM: Checked out Machine Transcription Task: 4dea6595-9921-4ef9-8cc8-ace500cb2752 session: 6f791a68-5b5c-4063-8478-ace500c46f0a transcription request: 2c974b59-05b9-455e-9573-ace500cb2721 (i-0b211efb69a1ee3fc)

2021-03-08 07:19:51 AM: Completed Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:50 AM: Session marked for repackaging and re-encoding. (sessionId=6f791a68-5b5c-4063-8478-ace500c46f0a, user=).

2021-03-08 07:19:50 AM: Created Media packaging task (core): ceb6c7d4-2582-48cf-8757-ace500cb342b session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:50 AM: Canceled Media Storage Optimization: 497d69d1-843a-4d9b-8bbf-ace500cb26dd session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:49 AM: Processing Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-03f07f7ccd3ef7022)

2021-03-08 07:19:49 AM: Parsing task data Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-03f07f7ccd3ef7022)

2021-03-08 07:19:49 AM: Checked out Complete session Upload Task: f5b4974b-7f38-4a3a-b805-ace500cb26cc session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-03f07f7ccd3ef7022)

2021-03-08 07:19:39 AM: Human transcription request created

2021-03-08 07:19:39 AM: Session closed. (sessionId=6f791a68-5b5c-4063-8478-ace500c46f0a, user=).

2021-03-08 07:19:38 AM: Completed Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:38 AM: Results published Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a

2021-03-08 07:19:38 AM: Stream 1a3c0790-5376-464d-8ed7-ace500c46f71 created.

2021-03-08 06:56:05 AM: Processing Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:52 AM: Initializing worker with task metadata Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:52 AM: Metadata collected by task processor. Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:52 AM: Checked out Media import task (core): 251a7d28-41d3-4b24-a6c6-ace500c46f92 session: 6f791a68-5b5c-4063-8478-ace500c46f0a (i-0e64b25dd58e27889)

2021-03-08 06:55:47 AM: Queued for import processing.

2021-03-08 06:55:47 AM: Job 251a7d28-41d3-4b24-a6c6-ace500c46f92 import upload complete.

2021-03-08 06:55:12 AM: Job 251a7d28-41d3-4b24-a6c6-ace500c46f92 import upload.

2021-03-08 06:55:11 AM: EventTarget 89fe4051-223d-4fc7-902b-ace500c46f33 created.

2021-03-08 06:55:11 AM: Session 6f791a68-5b5c-4063-8478-ace500c46f0a created.

I am uploaded over 1000 files per run of my API script so I would like to upload as fast as possible and not wait for the re encoding, captioning or other processes before I start a new upload. What will be my indicator that the uploaded of the file data is complete. I am using multipart upload code. I need to confirm upload status along with multipart code completion:

def upload_media(self):
    source_file = open(self.input_file, 'rb')
    key_name = self.target.file_key(self.dest_filename)
    upload_id = self.s3.create_multipart_upload(
        Bucket=self.target.bucket_name, Key=key_name)['UploadId']

    parts = []
    chunk_size = 13107200
    source_size = os.stat(self.input_file).st_size
    chunk_count = int(math.ceil(source_size / float(chunk_size)))

    for i in range(chunk_count):
        offset = chunk_size * i
        byte_count = min(chunk_size, source_size - offset)

        data = source_file.read(byte_count)
        part = self.s3.upload_part(
            Bucket=self.target.bucket_name, Body=data, Key=key_name,
            UploadId=upload_id, PartNumber=i)
        parts.append({'PartNumber': i, 'ETag': part['ETag']})

    self.s3.complete_multipart_upload(
        Bucket=self.target.bucket_name,
        Key=key_name,
        UploadId=upload_id,
        MultipartUpload={'Parts': parts})

    source_file.close()


Answers

  • Options
    Chaz BarbourChaz Barbour Superstar

    I'm pretty sure that once a session is Processing, you are done with the upload and creation process and can safely move on to uploading a new one. When just dragging and dropping files into Panopto or using the Watch Folder upload service, that's what happens. The session won't be ready to play/download until the value comes back as Ready, but you can certainly move on while Panopto does all the encoding in the background. They certainly do.

    I am curious how this field relates or compares to the Session State field exposed by the SOAP API.

    https://support.panopto.com/resource/APIDocumentation/Help/html/962f983d-c096-dc15-0047-d8c982d7061d.htm

    Created 0 The session has just been created

    Scheduled 1 The session is scheduled to be recorded

    Recording 2 The session is currently recording

    Broadcasting 3 The session is currently broadcasting

    Processing 4 The session is done being recorded and is being processed by the server

    Complete 5 The session has been recorded and processed and can now be viewed

  • Options
    Tim HarperTim Harper Tyro
    edited March 2021

    Thanks Charles!!

    BTW - I had already moved 250,000 zoom videos to Office 365 SharePoint backup. Fun huh?

    This should only be about 26K vids total. When I finish this 150 GB test run. I will be able to automate the lot running screen on RHEL8. fingers crossed! Looks like about 6 TB total

Sign In or Register to comment.