Skip to content

Commit 71cceac

Browse files
committed
refactor: adjusted system propmt examples
1 parent 41cf185 commit 71cceac

File tree

1 file changed

+7
-7
lines changed
  • src/rai_bench/rai_bench/tool_calling_agent/tasks

1 file changed

+7
-7
lines changed

src/rai_bench/rai_bench/tool_calling_agent/tasks/spatial.py

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -25,24 +25,24 @@
2525

2626
loggers_type = logging.Logger
2727

28-
SPATIAL_REASONING_SYSTEM_PROMPT_0_SHOT = """You are a helpful and knowledgeable AI assistant that specializes in interpreting and analyzing visual content. Your task is to answer questions based on the images provided to you. Please response with the use of the provided tools."""
28+
SPATIAL_REASONING_SYSTEM_PROMPT_0_SHOT = """You are a helpful and knowledgeable AI assistant that specializes
29+
in interpreting and analyzing visual content. Your task is to answer questions based
30+
on the images provided to you. Please response with the use of the provided tools."""
31+
# NOTE (jmatejcz) In this case we are using only one tool so there is no difference bettween 2 and 5 shot
32+
# so I made 1 example in '2 shot' and 2 examples in '5 shot' prompt
2933

3034
SPATIAL_REASONING_SYSTEM_PROMPT_2_SHOT = (
3135
SPATIAL_REASONING_SYSTEM_PROMPT_0_SHOT
3236
+ """
3337
3438
Example of tool calls:
35-
- return_bool_response, args: {'response': True}
36-
- return_bool_response, args: {'response': False}"""
39+
- return_bool_response, args: {'response': True}"""
3740
)
3841

39-
# NOTE (jmatejcz) In this case we are using only one tool so there is no difference bettween 2 and 5 shot
4042
SPATIAL_REASONING_SYSTEM_PROMPT_5_SHOT = (
4143
SPATIAL_REASONING_SYSTEM_PROMPT_2_SHOT
4244
+ """
43-
- return_bool_response, args: {'response': True} # When object is clearly visible
44-
- return_bool_response, args: {'response': False} # When object is not present
45-
- return_bool_response, args: {'response': True} # When spatial relationship is correct"""
45+
- return_bool_response, args: {'response': False}"""
4646
)
4747

4848

0 commit comments

Comments
 (0)