How to recreate the initial Opik project, which is one's account Username at sign-up time ...

[nmvega]

Hello Friends:

I accidentally deleted the Project tied to my account username: jdoe (Fictitious username).

It (jdoe) is not visible in the Workspaces area of the Admin Dashboard, yet when I try to create it, I receive the error:

• Workspace names must be unique. The workspace jdoe already exists, please enter another name.

How can I re-create it or make it visible again?

Thank you!

[jverre]

Hi @nmvega,

Opik Cloud has the concept of both workspace and project, I think here you tried to re-create the workspace rather than project. The hierarchy is:

1. Workspace: Workspaces contain a list of projects and experiments, typically each team has one workspace shared between users
2. Projects: Projects contain a list of traces, typically each use-case or LLM application has a different project
   In this case, you are trying to re-create a workspace instead of project.

To re-create the demo project, you can actually re-run the generation script that is stored in the Github repo:

# Clone the repo
git clone git@github.com:comet-ml/opik.git

# Navigate to the demo data folder
cd sdks/python/examples

# IMPORTANT - Update the `demo_data_generator.py` file so it includes your information:
# base_url = "https://www.comet.com/opik/api"
# workspace_name = "jdoe" # Replace with your workspace name, this is typically the same as your username
# comet_api_key = "your Opik api key"

# Once the file is updated, you can run it to generate the demo project again
python demo_data_generator.py

I was able to log the demo data again so the steps above should work, you might need to delete the demo dataset as well though

[nmvega]

Hi @jverre Thank you for the delightfully comprehensive reply. ☺️ Your Workspace and Project descriptions align with my understanding too (and, in fact, I initially documented that in a Jupyter Notebook once I caught onto the design).

I'm typing from a tiny phone at the moment, but will try your instructions once I get home (taking care to edit in my details first ). Thank you again. ☺️

[nmvega]

@jverre

Thank again for your help. By the way, this isn't urgent. 😊

Below is what was emitted when I edited and ran the script you referred to. Mostly HTTP/500 with an occassional HTTP/429

I got here simply through exploration and learning. I was trying to determine how to create Projects and Workspaces programmatically rather than using the UI; and to determine which of these entities (if any) are automatically created when named in an opik statement; and to determine which defaults are used if not specified in a opik statement; and to understand the immutable behavior of the opik client - its inability to change certain properties after an opik transaction occurs. From my observations yesterday - not only with my account’s Workspace but also with several I created programmatically - I noticed that they seem to get created or remain behind the scenes even if deleted, albeit not visible. This might explain the exceptions encountered. It was through experimentation that I arrived here. 😊

I used jdoe below and before, but the account is nmvega.

PS: In the meantime, I created and use nmvega-workspace as my "Default Workspace", including specifying it in my ~/.opik.config file. Although I use other Workspaces corresponding to work they're intended for.

(pyvenv.d) nmvega@ollama$ python3 ./demo_data_generator.py
OPIK: Started logging traces to the "Demo evaluation" project at https://www.comet.com/opik/jdoe/redirect/projects?name=Demo%20evaluation.
OPIK: Started logging traces to the "Demo chatbot 🤖" project at https://www.comet.com/opik/jdoe/redirect/projects?name=Demo%20chatbot%20%F0%9F%A4%96.
OPIK: Failed to process AddTraceFeedbackScoresBatchMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process AddTraceFeedbackScoresBatchMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process AddTraceFeedbackScoresBatchMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
Traceback (most recent call last):
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
  File "/home/nmvega/WORKSPACES.d/AGENTIC.GEN.AI.d/SELF.HOSTED.PLATFORMS.d/OPIK.COMET.d/sdks/python/examples/./demo_data_generator.py", line 162, in <module>
    create_demo_data(base_url, workspace_name, comet_api_key)
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nmvega/WORKSPACES.d/AGENTIC.GEN.AI.d/SELF.HOSTED.PLATFORMS.d/OPIK.COMET.d/sdks/python/examples/./demo_data_generator.py", line 80, in create_demo_data
    client.create_prompt(
    ~~~~~~~~~~~~~~~~~~~~^
        name="Q&A Prompt",
        ^^^^^^^^^^^^^^^^^^
    ...<3 lines>...
    """,
    ^^^^
    )
    ^
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/opik/api_objects/opik_client.py", line 759, in create_prompt
    return prompt_client.create_prompt(name=name, prompt=prompt, metadata=metadata)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/opik/api_objects/prompt/client.py", line 30, in create_prompt
    prompt_version = self._get_latest_version(name)
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/opik/api_objects/prompt/client.py", line 75, in _get_latest_version
    raise e
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/opik/api_objects/prompt/client.py", line 69, in _get_latest_version
    prompt_latest_version = self._rest_client.prompts.retrieve_prompt_version(
        name=name
    )
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/tenacity/__init__.py", line 330, in wrapped_f
    return self(f, *args, **kw)
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/tenacity/__init__.py", line 467, in __call__
    do = self.iter(retry_state=retry_state)
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/tenacity/__init__.py", line 368, in iter
    result = action(retry_state)
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/tenacity/__init__.py", line 390, in <lambda>
    self._add_action_func(lambda rs: rs.outcome.result())
                                     ~~~~~~~~~~~~~~~~~^^
  File "/usr/lib64/python3.13/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ~~~~~~~~~~~~~~~~~^^
  File "/usr/lib64/python3.13/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/tenacity/__init__.py", line 470, in __call__
    result = fn(*args, **kwargs)
  File "/home/nmvega/WORKSPACES.d/pyvenv.d/lib64/python3.13/site-packages/opik/rest_api/prompts/client.py", line 756, in retrieve_prompt_version
    raise ApiError(status_code=_response.status_code, body=_response_json)
opik.rest_api.core.api_error.ApiError: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateTraceMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 429, body: <html>
<head><title>429 Too Many Requests</title></head>
<body>
<center><h1>429 Too Many Requests</h1></center>
<hr><center>nginx</center>
</body>
</html>

OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}
OPIK: Failed to process CreateSpanMessage. Error: status_code: 500, body: {'code': 500, 'message': 'HTTP 500 Internal Server Error'}