TokenizeBaseClass.
More...
#include <tokenize_base_class.hpp>
TokenizeBaseClass.
This class implements a base class for RESTful prompt plugins. It provides a common interface for sending prompts and receiving responses
◆ TokenizeBaseClass()
| prompt::TokenizeBaseClass::TokenizeBaseClass |
( |
| ) |
|
|
inline |
◆ ~TokenizeBaseClass()
| virtual prompt::TokenizeBaseClass::~TokenizeBaseClass |
( |
| ) |
|
|
virtualdefault |
◆ get_tokens()
get_tokens sends a text to a token provider
- Parameters
-
| req | The token request containing the text and options. |
- Returns
- const TokenResponse
Reimplemented from prompt::BaseClass.
◆ initialize_tokenize_base()
| virtual void prompt::TokenizeBaseClass::initialize_tokenize_base |
( |
rclcpp::Node::SharedPtr |
node, |
|
|
std::string |
plugin_name = "TokenizeBaseClass" |
|
) |
| |
|
inlinevirtual |
Initialize the REST base class.
This method initializes the REST base class with parameters from the ROS parameter server.
- Parameters
-
| node | rclcpp::Node::SharedPtr ROS node |
| plugin_name | std::string Name of the plugin, used for parameter names |
- Exceptions
-
| prompt::EmbedException | if there is an error during initialization |
◆ process()
Process a tokenize request.
This method processes the tokenize request and returns a TokenResponse. Should be implemented by derived classes.
- Parameters
-
| input | The tokenize request to convert |
- Returns
- A TokenResponse containing the tokens and options
Implemented in prompt::OpenAITokenize.
◆ required_options_
Model options.
This is the model options used by the prompt provider by default in case model options are not provided in the request
The documentation for this class was generated from the following file: