[Bug]: Streams not logged to Opik when using LLamaIndex integration

[Pratham271]

What component(s) are affected?

• Python SDK
• Opik UI
• Opik Server
• Documentation

Opik version

• Opik version: 1.6.12

Describe the problem

I am using the following code to log the traces of my llama app
but it logs the traces for .chat method of llama but not for stream_chat function it is showing me nothing in the output for that

Reproduction steps and code snippets

this is how I am setting up configuration for llama and opik:

@asynccontextmanager
async def app_lifespan(_app: FastAPI):
    from bson import ObjectId

    # Encodes `ObjectId` class as `str`
    ENCODERS_BY_TYPE.update({ObjectId: str})

    # Configure Opik to Log traces and prompt management
    opik.configure()
    opik_callback_handler = LlamaIndexCallbackHandler()
    Settings.callback_manager = CallbackManager([opik_callback_handler])
    yield

Error logs or stack trace

No response

Healthcheck results

No response

[jverre]

@Lothiraldan Can you take a look

[Lothiraldan]

Hi @Pratham271, I was able to reproduce the bug and I'm working on fixing it. Thank you for opening an issue!

[Pratham271]

@Lothiraldan any update on this

[Lothiraldan]

@Pratham271 Yes, I've been able to understand the root cause of the issue. Solving it turns out to be a bit more complicated than anticipated but we have a clear plan now. I'm hoping to have it finished by tomorrow.

[Pratham271]

@Lothiraldan Thank you

[Lothiraldan]

@Pratham271 I just merged a PR to add support for it, can you give it a try? You will need to install the Python SDK from a Git checkout or wait for the next release, let me know if you need help with instructions

[Pratham271]

@Lothiraldan I will try it and let you know.