Optimizer ToolsĀ¶

Configuration File: optimizer_tools.json Tool Type: Local Tools Count: 5

This page contains all tools defined in the optimizer_tools.json configuration file.

Available ToolsĀ¶

ArgumentDescriptionOptimizer (Type: AgenticTool)Ā¶

Optimizes the descriptions of tool arguments/parameters based on test case results and actual usaā€¦

ArgumentDescriptionOptimizer tool specification

Tool Information:

  • Name: ArgumentDescriptionOptimizer

  • Type: AgenticTool

  • Description: Optimizes the descriptions of tool arguments/parameters based on test case results and actual usage patterns. Provides improved descriptions that are more accurate and user-friendly.

Parameters:

  • parameter_schema (string) (required) JSON string of the original parameter schema with properties and descriptions.

  • test_results (string) (required) A JSON string containing test case input/output pairs showing parameter usage.

Example Usage:

query = {
    "name": "ArgumentDescriptionOptimizer",
    "arguments": {
        "parameter_schema": "example_value",
        "test_results": "example_value"
    }
}
result = tu.run(query)

DescriptionAnalyzer (Type: AgenticTool)Ā¶

Analyzes a toolā€™s original description and the results of multiple test cases, then suggests an iā€¦

DescriptionAnalyzer tool specification

Tool Information:

  • Name: DescriptionAnalyzer

  • Type: AgenticTool

  • Description: Analyzes a toolā€™s original description and the results of multiple test cases, then suggests an improved description that is more accurate, comprehensive, and user-friendly. Optionally provides a rationale for the changes.

Parameters:

  • original_description (string) (required) The original description of the tool.

  • test_results (string) (required) A JSON string containing a list of test case input/output pairs.

Example Usage:

query = {
    "name": "DescriptionAnalyzer",
    "arguments": {
        "original_description": "example_value",
        "test_results": "example_value"
    }
}
result = tu.run(query)

DescriptionQualityEvaluator (Type: AgenticTool)Ā¶

Evaluates the quality of tool descriptions and parameter descriptions, providing a score and specā€¦

DescriptionQualityEvaluator tool specification

Tool Information:

  • Name: DescriptionQualityEvaluator

  • Type: AgenticTool

  • Description: Evaluates the quality of tool descriptions and parameter descriptions, providing a score and specific feedback for improvements.

Parameters:

  • tool_description (string) (required) The tool description to evaluate.

  • parameter_descriptions (string) (required) JSON string of parameter names and their descriptions.

  • test_results (string) (required) JSON string containing test case results.

Example Usage:

query = {
    "name": "DescriptionQualityEvaluator",
    "arguments": {
        "tool_description": "example_value",
        "parameter_descriptions": "example_value",
        "test_results": "example_value"
    }
}
result = tu.run(query)

TestCaseGenerator (Type: AgenticTool)Ā¶

Generates diverse and representative ToolUniverse tool call dictionaries for a given tool based oā€¦

TestCaseGenerator tool specification

Tool Information:

  • Name: TestCaseGenerator

  • Type: AgenticTool

  • Description: Generates diverse and representative ToolUniverse tool call dictionaries for a given tool based on its parameter schema. Each tool call should be a JSON object with ā€˜nameā€™ (the toolā€™s name) and ā€˜argumentsā€™ (a dict of input arguments), covering different parameter combinations, edge cases, and typical usage. Can generate targeted test cases based on previous optimization feedback.

Parameters:

  • tool_config (object) (required) The full configuration of the tool to generate test cases for. May include ā€˜_optimization_feedbackā€™ and ā€˜_iterationā€™ fields for feedback-driven test generation.

Example Usage:

query = {
    "name": "TestCaseGenerator",
    "arguments": {
        "tool_config": "example_value"
    }
}
result = tu.run(query)

ToolDescriptionOptimizer (Type: ComposeTool)Ā¶

Optimizes a toolā€™s description and parameter descriptions by generating test cases, executing theā€¦

ToolDescriptionOptimizer tool specification

Tool Information:

  • Name: ToolDescriptionOptimizer

  • Type: ComposeTool

  • Description: Optimizes a toolā€™s description and parameter descriptions by generating test cases, executing them, analyzing the results, and suggesting improved descriptions for both the tool and its arguments. Optionally saves a comprehensive optimization report to a file without overwriting the original.

Parameters:

  • tool_config (object) (required) The full configuration of the tool to optimize.

  • save_to_file (boolean) (required) If true, save the optimized description to a file (do not overwrite the original).

  • output_file (string) (required) Optional file path to save the optimized description. If not provided, use ā€˜<tool_name>_optimized_description.txtā€™.

  • max_iterations (integer) (required) Maximum number of optimization rounds to perform.

  • satisfaction_threshold (number) (required) Quality score threshold (1-10) to consider optimization satisfactory.

Example Usage:

query = {
    "name": "ToolDescriptionOptimizer",
    "arguments": {
        "tool_config": "example_value",
        "save_to_file": true,
        "output_file": "example_value",
        "max_iterations": 10,
        "satisfaction_threshold": "example_value"
    }
}
result = tu.run(query)