Skip to content

Commit 4449c51

Browse files
Align data types in example benchmark (#205)
1 parent 98c6688 commit 4449c51

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

examples/benchmark.ipynb

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -253,11 +253,11 @@
253253
"\n",
254254
" if is_vanilla_llm:\n",
255255
" llm = agent\n",
256-
" answer = llm([{\"role\": \"user\", \"content\": question}])\n",
257-
" token_count = llm.last_input_token_count + llm.last_output_token_count\n",
258-
" intermediate_steps = []\n",
256+
" answer = str(llm([{\"role\": \"user\", \"content\": question}]))\n",
257+
" token_count = {\"input\": llm.last_input_token_count, \"output\": llm.last_output_token_count}\n",
258+
" intermediate_steps = str([])\n",
259259
" else:\n",
260-
" answer = agent.run(question)\n",
260+
" answer = str(agent.run(question))\n",
261261
" token_count = agent.monitor.get_total_token_counts()\n",
262262
" intermediate_steps = str(agent.logs)\n",
263263
" # Remove memory from logs to make them more compact.\n",

0 commit comments

Comments
 (0)