Content are not displayed in the portal after published is done

[tsprasath]

Created content by uploading content-->eTextbook-->uploaded pdf file content--> submitted for review.

logged in as a content reviewer and reviewed and published the content --> content is published and published content is not displayed in the portal

Able to verify content do id is present in the elastic search. while trying read the content via API following is the response

Read API

curl --location -g --request GET '{{host}}/api/content/v1/read/do_21380767817085747215' \
--header 'Content-Type: application/json' \
--header 'Authorization: {{kong_api_key}}' \
--header 'X-Authenticated-User-token: {{keycloak_access_token}}' \
--data-raw ''

Response

{
    "id": "api.content.read",
    "ver": "1.0",
    "ts": "2023-05-31T04:41:58.655Z",
    "params": {
        "resmsgid": "7a4a20f0-ff6d-11ed-9db3-f7a99120f095",
        "msgid": "7a45b420-ff6d-11ed-bab7-a1a7d1668f20",
        "status": "successful",
        "err": null,
        "errmsg": null
    },
    "responseCode": "OK",
    "result": {
        "content": {
            "ownershipType": [
                "createdBy"
            ],
            "copyright": "Sunbird Org",
            "code": "dc6de108-52dd-4815-992e-32deeb9ca47e",
            "interceptionPoints": {},
            "publishError": "isValidUrl: Error while checking mimeType ",
            "credentials": {
                "enabled": "No"
            },
            "channel": "0137972723324682240",
            "downloadUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/assets/do_21380767817085747215/dummy.pdf",
            "organisation": [
                "Sunbird Org"
            ],
            "description": "PS31 Testing",
            "language": [
                "English"
            ],
            "mimeType": "application/pdf",
            "idealScreenSize": "normal",
            "createdOn": "2023-05-31T04:33:09.226+0000",
            "objectType": "Content",
            "primaryCategory": "eTextbook",
            "contentDisposition": "inline",
            "lastUpdatedOn": "2023-05-31T04:35:18.362+0000",
            "contentEncoding": "identity",
            "artifactUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/assets/do_21380767817085747215/dummy.pdf",
            "lockKey": "1e6ba79a-bd8d-4047-830b-22754b915bdf",
            "contentType": "Resource",
            "dialcodeRequired": "No",
            "lastUpdatedBy": "4f2bcb07-6d8e-4022-9866-6e54f1222514",
            "identifier": "do_21380767817085747215",
            "lastStatusChangedOn": "2023-05-31T04:35:18.362+0000",
            "createdFor": [
                "0137972723324682240"
            ],
            "audience": [
                "Student"
            ],
            "creator": "SunbirdOrgAdmin4",
            "os": [
                "All"
            ],
            "visibility": "Default",
            "discussionForum": {
                "enabled": "No"
            },
            "mediaType": "content",
            "osId": "org.ekstep.quiz.app",
            "languageCode": [
                "en"
            ],
            "version": 2,
            "pkgVersion": 1,
            "versionKey": "1685507618180",
            "license": "CC BY 4.0",
            "idealScreenDensity": "hdpi",
            "framework": "sunbird_k-12",
            "size": 13264,
            "lastSubmittedOn": "2023-05-31T04:33:38.169+0000",
            "createdBy": "4f2bcb07-6d8e-4022-9866-6e54f1222514",
            "compatibilityLevel": 1,
            "name": "PS31 Testing",
            "resourceType": "Learn",
            "status": "Failed"
        }
    }
}

content Service Logs

2023-05-31 04:41:58,649 CSPMetaUtil ::: updateAbsolutePath util.Map[String, AnyRef] ::: data before url rep
lace :: {ownershipType=[Ljava.lang.String;@3bc6420f, copyright=Sunbird Org, code=dc6de108-52dd-4815-992e-32
deeb9ca47e, interceptionPoints={}, publishError=isValidUrl: Error while checking mimeType , credentials={"e
nabled":"No"}, downloadUrl=CONTENT_STORAGE_BASE_PATH/content/assets/do_21380767817085747215/dummy.pdf, chan
nel=0137972723324682240, organisation=[Ljava.lang.String;@6a703491, description=PS31 Testing, language=[Lja
va.lang.String;@2d19b1c0, mimeType=application/pdf, idealScreenSize=normal, createdOn=2023-05-31T04:33:09.2
26+0000, primaryCategory=eTextbook, contentDisposition=inline, artifactUrl=CONTENT_STORAGE_BASE_PATH/conten
t/assets/do_21380767817085747215/dummy.pdf, contentEncoding=identity, lastUpdatedOn=2023-05-31T04:35:18.362
+0000, lockKey=1e6ba79a-bd8d-4047-830b-22754b915bdf, contentType=Resource, dialcodeRequired=No, lastUpdated
By=4f2bcb07-6d8e-4022-9866-6e54f1222514, audience=[Ljava.lang.String;@2c0fd18a, creator=SunbirdOrgAdmin4, c
reatedFor=[Ljava.lang.String;@25d0283e, lastStatusChangedOn=2023-05-31T04:35:18.362+0000, visibility=Defaul
t, os=[Ljava.lang.String;@4eef54a9, discussionForum={"enabled":"No"}, mediaType=content, osId=org.ekstep.qu
iz.app, version=2, pkgVersion=1.0, versionKey=1685507618180, license=CC BY 4.0, idealScreenDensity=hdpi, fr
amework=sunbird_k-12, size=13264.0, lastSubmittedOn=2023-05-31T04:33:38.169+0000, createdBy=4f2bcb07-6d8e-4
022-9866-6e54f1222514, compatibilityLevel=1, name=PS31 Testing, status=Failed, resourceType=Learn

[tsprasath]

Retried again got kafka error in content service

2023-05-31 11:41:44,786 Error registering AppInfo mbean                                                    
javax.management.InstanceAlreadyExistsException: kafka.consumer:type=app-info,id=KafkaClientConsumer       
    at java.management/com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:436)                    
    at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(Default
MBeanServerInterceptor.java:1855)                                                                          
    at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMB
eanServerInterceptor.java:955)                                                                             
    at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanSer
verInterceptor.java:890)                                                                                   
    at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServ
erInterceptor.java:320)                                                                                    
    at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)       
    at org.apache.kafka.common.utils.AppInfoParser.registerAppInfo(AppInfoParser.java:62)                  
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:773)                      
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:635)                      
    at org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:617)                      
    at org.sunbird.kafka.client.KafkaClient.createConsumer(KafkaClient.scala:50)                           
    at org.sunbird.kafka.client.KafkaClient.<init>(KafkaClient.scala:16)                                   
    at org.sunbird.content.publish.mgr.PublishManager$.<init>(PublishManager.scala:20)                     
    at org.sunbird.content.publish.mgr.PublishManager$.<clinit>(PublishManager.scala)                      
    at org.sunbird.content.actors.ContentActor$$anonfun$publishContent$1.apply(ContentActor.scala:219)     
    at org.sunbird.content.actors.ContentActor$$anonfun$publishContent$1.apply(ContentActor.scala:213)     
    at scala.util.Success$$anonfun$map$1.apply(Try.scala:237)                                              
    at scala.util.Try$.apply(Try.scala:192) 
        at scala.util.Success.map(Try.scala:237)                                                               
    at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:237)                                      
    at scala.concurrent.Future$$anonfun$map$1.apply(Future.scala:237)                                      
    at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)                                        
    at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)                
    at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:92)
    at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:92)       
    at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:92)       
    at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)                              
    at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:91)                        
    at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40)                                       
    at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:
49)                                                                                                        
    at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)                                   
    at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)                       
    at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)                               
    at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
    2023-05-31 11:41:44,808 {"eid":"LOG","ets":1685533304808,"ver":"3.0","mid":"LP.1685533304808.4933ab88-200b-
40aa-9ba7-f3360976df87","actor":{"id":"org.sunbird.learning.platform","type":"System"},"context":{"channel"
:"in.ekstep","pdata":{"id":"staging.sunbird.portal","pid":"","ver":"1.0"},"env":"content","sid":"RiVifjX-Sg
fo1z3MyPnoVfswPVw7aPOy","did":"971bf88842d5fecf67069d71d4832aca"},"edata":{"level":"INFO","type":"api_acces
s","message":"","params":[{"duration":57},{"protocol":"http"},{"size":361},{"method":"POST"},{"uip":"192.16
8.1.61"},{"url":"/content/v3/publish/do_21380788725566668811"},{"status":200}]},"syncts":1685533304808}    
2023-05-31 11:41:44,808 {"eid":"LOG","ets":1685533304808,"ver":"3.0","mid":"LP.1685533304808.4933ab88-200b-
40aa-9ba7-f3360976df87","actor":{"id":"org.sunbird.learning.platform","type":"System"},"context":{"channel"
:"in.ekstep","pdata":{"id":"staging.sunbird.portal","pid":"","ver":"1.0"},"env":"content","sid":"RiVifjX-Sg
fo1z3MyPnoVfswPVw7aPOy","did":"971bf88842d5fecf67069d71d4832aca"},"edata":{"level":"INFO","type":"api_acces
s","message":"","params":[{"duration":57},{"protocol":"http"},{"size":361},{"method":"POST"},{"uip":"192.16
8.1.61"},{"url":"/content/v3/publish/do_21380788725566668811"},{"status":200}]},"syncts":1685533304808}

@maheshkumargangula, @vrayulu, @Krishnaj20,@pallakartheekreddy, @gandham-santhosh, @rajeevsathish

[tsprasath]

Above error is fix

1. publishError=isValidUrl: Error while checking mimeType

Changed the content service variables in the configmap

kafka {
        topics.instruction : "learning.job.request"
        publish.request.topic : "dev.publish.job.request"
    }

# Content Import API Config
    import {
        output_topic_name : "sunbirdstaging.knowlg.auto.creation.job.request"

Changed the content publish service variables in the configmap

cloudstorage {
      metadata.replace_absolute_path= true
      relative_path_prefix="CONTENT_STORAGE_BASE_PATH"
      metadata.list=["appIcon","posterImage","artifactUrl","downloadUrl","variants","previewUrl","pdfUrl", "streamingUrl", "toc_url"]
      read_base_path="https://{{ .Values.cloud_storage_key }}.blob.core.windows.net"
      write_base_path=["https://{{ .Values.cloud_storage_key }}.blob.core.windows.net","https://{{ .Values.cloud_storage_key }}.blob.core.windows.net"]    
      }

After creating new content --> reviewed by the reviewer and content got published.

to verify content got publish

curl --location -g --request GET '{{host}}/api/content/v1/read/{{do_id}}' \
--header 'Content-Type: application/json' \
--header 'Authorization: {{kong_api_key}}' \
--header 'X-Authenticated-User-token: {{keycloak_access_token}}' \
--data-raw ''

response

{
    "id": "api.content.read",
    "ver": "1.0",
    "ts": "2023-05-31T14:16:25.950Z",
    "params": {
        "resmsgid": "ba65f7e0-ffbd-11ed-9db3-f7a99120f095",
        "msgid": "ba33eb60-ffbd-11ed-bab7-a1a7d1668f20",
        "status": "successful",
        "err": null,
        "errmsg": null
    },
    "responseCode": "OK",
    "result": {
        "content": {
            "ownershipType": [
                "createdBy"
            ],
            "copyright": "Sunbird Org",
            "previewUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/assets/do_21380796327723827215/dummy.pdf",
            "channel": "0137972723324682240",
            "downloadUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/do_21380796327723827215/ps-31-test3_1685542518675_do_21380796327723827215_1.ecar",
            "organisation": [
                "Sunbird Org"
            ],
            "language": [
                "English"
            ],
            "mimeType": "application/pdf",
            "variants": {
                "full": {
                    "ecarUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/do_21380796327723827215/ps-31-test3_1685542518675_do_21380796327723827215_1.ecar",
                    "size": "14821"
                },
                "spine": {
                    "ecarUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/do_21380796327723827215/ps-31-test3_1685542518807_do_21380796327723827215_1_SPINE.ecar",
                    "size": "2369"
                }
            },
            "objectType": "Content",
            "appIcon": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/do_21380796327723827215/artifact/do_21380796354929459216_1685542425739_sample_user_icon.thumb.png",
            "primaryCategory": "eTextbook",
            "contentEncoding": "identity",
            "artifactUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/assets/do_21380796327723827215/dummy.pdf",
            "lockKey": "c011e2aa-c423-42aa-a39a-883c29ac9a95",
            "contentType": "Resource",
            "identifier": "do_21380796327723827215",
            "lastUpdatedBy": "4f2bcb07-6d8e-4022-9866-6e54f1222514",
            "audience": [
                "Student"
            ],
            "visibility": "Default",
            "discussionForum": {
                "enabled": "No"
            },
            "mediaType": "content",
            "osId": "org.ekstep.quiz.app",
            "languageCode": [
                "en"
            ],
            "lastPublishedBy": "f381d62a-dcda-4831-9920-b13f708b64a8",
            "version": 2,
            "pragma": [
                "external"
            ],
            "license": "CC BY 4.0",
            "prevState": "Review",
            "size": 13264,
            "lastPublishedOn": "2023-05-31T14:15:18.529+0000",
            "name": "PS-31-Test3",
            "status": "Live",
            "code": "3eec61c3-6438-4b49-944e-7ecd60c7278c",
            "interceptionPoints": {},
            "credentials": {
                "enabled": "No"
            },
            "prevStatus": "Processing",
            "description": "PS-31-Test3",
            "streamingUrl": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/assets/do_21380796327723827215/dummy.pdf",
            "posterImage": "https://easyinstaller.blob.core.windows.net/sunbird-contents-dev/content/do_21380796354929459216/artifact/do_21380796354929459216_1685542425739_sample_user_icon.png",
            "idealScreenSize": "normal",
            "createdOn": "2023-05-31T14:13:12.249+0000",
            "contentDisposition": "inline",
            "lastUpdatedOn": "2023-05-31T14:15:18.938+0000",
            "dialcodeRequired": "No",
            "lastStatusChangedOn": "2023-05-31T14:15:18.938+0000",
            "createdFor": [
                "0137972723324682240"
            ],
            "creator": "SunbirdOrgAdmin4",
            "os": [
                "All"
            ],
            "se_FWIds": [
                "sunbird_k-12"
            ],
            "pkgVersion": 1,
            "versionKey": "1685542428151",
            "idealScreenDensity": "hdpi",
            "framework": "sunbird_k-12",
            "lastSubmittedOn": "2023-05-31T14:13:48.142+0000",
            "createdBy": "4f2bcb07-6d8e-4022-9866-6e54f1222514",
            "compatibilityLevel": 4,
            "resourceType": "Learn"
        }
    }
}