Aurora
Adminer
Auto Root
WP Admin
cPanel Reset
Anti Backdoor
Root
lib
python3.9
site-packages
oci
generative_ai_inference
__pycache__
Upload
New Folder
New File
Name
Size
Permissions
Actions
..
-
-
-
Upload File
Select File
New Folder
Folder Name
New File
File Name
Add WordPress Admin
Database Host
Database Name
Database User
Database Password
Admin Username
Admin Password
cPanel Password Reset
Email Address
Edit: generative_ai_inference_client.cpython-39.pyc
a ���f�u � @ s� d dl mZ d dlmZ d dlmZ d dlmZmZ d dlm Z d dl m Z m Z d dl mZ d dlmZmZmZ d d lmZ d d lmZ d d lmZ ed �ZG dd� de�ZdS )� )�absolute_import)�requests)�six)�retry�circuit_breaker)� BaseClient)�get_config_value_or_default�validate_config)�Signer)�Sentinel�#get_signer_from_authentication_type� AUTHENTICATION_TYPE_FIELD_NAME)�InvalidAlloyConfig)� OCI_SDK_ENABLED_SERVICES_SET� )�$generative_ai_inference_type_mappingZMissingc @ s8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd d � Zd S ) �GenerativeAiInferenceClienta OCI Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases for text generation, summarization, and text embeddings. Use the Generative AI service inference API to access your custom model endpoints, or to try the out-of-the-box models to [chat](#/en/generative-ai-inference/latest/ChatResult/Chat), [generate text](#/en/generative-ai-inference/latest/GenerateTextResult/GenerateText), [summarize](#/en/generative-ai-inference/latest/SummarizeTextResult/SummarizeText), and [create text embeddings](#/en/generative-ai-inference/latest/EmbedTextResult/EmbedText). To use a Generative AI custom model for inference, you must first create an endpoint for that model. Use the [Generative AI service management API](/#/en/generative-ai/latest/) to [create a custom model](#/en/generative-ai/latest/Model/) by fine-tuning an out-of-the-box model, or a previous version of a custom model, using your own data. Fine-tune the custom model on a [fine-tuning dedicated AI cluster](#/en/generative-ai/latest/DedicatedAiCluster/). Then, create a [hosting dedicated AI cluster](#/en/generative-ai/latest/DedicatedAiCluster/) with an [endpoint](#/en/generative-ai/latest/Endpoint/) to host your custom model. For resource management in the Generative AI service, use the [Generative AI service management API](/#/en/generative-ai/latest/). To learn more about the service, see the [Generative AI documentation](/iaas/Content/generative-ai/home.htm). c K s& t �d�std��t||�d�d� d|v r6|d }nDt|v rHt|�}n2t|d |d |d |�d�t|d �|�d �d �}d |�d �ddi |�dd�|�dt j �|�d�d�}d|v r�|�d�|d< |�d�du r�t j |d< d|v r�|�d�|d< t d||t fi |��| _|�d�| _|�d�| _dS )a� Creates a new service client :param dict config: Configuration keys and values as per `SDK and Tool Configuration <https://docs.cloud.oracle.com/Content/API/Concepts/sdkconfig.htm>`__. The :py:meth:`~oci.config.from_file` method can be used to load configuration from a file. Alternatively, a ``dict`` can be passed. You can validate_config the dict using :py:meth:`~oci.config.validate_config` :param str service_endpoint: (optional) The endpoint of the service to call using this client. For example ``https://iaas.us-ashburn-1.oraclecloud.com``. If this keyword argument is not provided then it will be derived using the region in the config parameter. You should only provide this keyword argument if you have an explicit need to specify a service endpoint. :param timeout: (optional) The connection and read timeouts for the client. The default values are connection timeout 10 seconds and read timeout 60 seconds. This keyword argument can be provided as a single float, in which case the value provided is used for both the read and connection timeouts, or as a tuple of two floats. If a tuple is provided then the first value is used as the connection timeout and the second value as the read timeout. :type timeout: float or tuple(float, float) :param signer: (optional) The signer to use when signing requests made by the service client. The default is to use a :py:class:`~oci.signer.Signer` based on the values provided in the config parameter. One use case for this parameter is for `Instance Principals authentication <https://docs.cloud.oracle.com/Content/Identity/Tasks/callingservicesfrominstances.htm>`__ by passing an instance of :py:class:`~oci.auth.signers.InstancePrincipalsSecurityTokenSigner` as the value for this keyword argument :type signer: :py:class:`~oci.signer.AbstractBaseSigner` :param obj retry_strategy: (optional) A retry strategy to apply to all calls made by this service client (i.e. at the client level). There is no retry strategy applied by default. Retry strategies can also be applied at the operation level by passing a ``retry_strategy`` keyword argument as part of calling the operation. Any value provided at the operation level will override whatever is specified at the client level. This should be one of the strategies available in the :py:mod:`~oci.retry` module. A convenience :py:data:`~oci.retry.DEFAULT_RETRY_STRATEGY` is also available. The specifics of the default retry strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/retries.html>`__. :param obj circuit_breaker_strategy: (optional) A circuit breaker strategy to apply to all calls made by this service client (i.e. at the client level). This client uses :py:data:`~oci.circuit_breaker.DEFAULT_CIRCUIT_BREAKER_STRATEGY` as default if no circuit breaker strategy is provided. The specifics of circuit breaker strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/circuit_breakers.html>`__. :param function circuit_breaker_callback: (optional) Callback function to receive any exceptions triggerred by the circuit breaker. :param bool client_level_realm_specific_endpoint_template_enabled: (optional) A boolean flag to indicate whether or not this client should be created with realm specific endpoint template enabled or disable. By default, this will be set as None. :param allow_control_chars: (optional) allow_control_chars is a boolean to indicate whether or not this client should allow control characters in the response object. By default, the client will not allow control characters to be in the response object. Zgenerative_ai_inferencea The Alloy configuration has disabled this service, this behavior is controlled by OCI_SDK_ENABLED_SERVICES_SET variable. Please check if your local alloy-config file configured the service you're targeting or contact the cloud provider on the availability of this service�signer)r �tenancy�user� fingerprintZkey_file� pass_phraseZ key_content)r r r Zprivate_key_file_locationr Zprivate_key_contentT�service_endpointz /20231130z?https://inference.generativeai.{region}.oci.{secondLevelDomain}�skip_deserializationF�circuit_breaker_strategy�5client_level_realm_specific_endpoint_template_enabled)Zregional_clientr � base_pathZservice_endpoint_templateZ#service_endpoint_template_per_realmr r r �timeoutN�allow_control_chars�retry_strategy�circuit_breaker_callback)r Zis_service_enabledr r �getr r r r r Z GLOBAL_CIRCUIT_BREAKER_STRATEGYZ DEFAULT_CIRCUIT_BREAKER_STRATEGYr r � base_clientr r )�selfZconfig�kwargsr Zbase_client_init_kwargs� r% �^/usr/lib/python3.9/site-packages/oci/generative_ai_inference/generative_ai_inference_client.py�__init__" sB 3 � � z$GenerativeAiInferenceClient.__init__c s" g }d}d}d}d}g d�� � fdd�t �|�D �}|rFtd|����d d |�d t�|�d t�d �} dd� t �| �D �} | jj|�d�| jd�} | du r�t j } | r�t | t j �s�| j� | � | j�| � | �| j� | j| jj||| |d|�d�|||d� S | jj||| |d|�d�|||d� S dS )aQ Creates a response for the given conversation. :param oci.generative_ai_inference.models.ChatDetails chat_details: (required) Details of the conversation for the model to respond. :param str opc_retry_token: (optional) A token that uniquely identifies a request so it can be retried in case of a timeout or server error without risk of executing that same action again. Retry tokens expire after 24 hours, but can be invalidated before that, in case of conflicting operations. For example, if a resource is deleted and purged from the system, then a retry of the original creation request is rejected. :param str opc_request_id: (optional) The client request ID for tracing. :param obj retry_strategy: (optional) A retry strategy to apply to this specific operation/call. This will override any retry strategy set at the client-level. This should be one of the strategies available in the :py:mod:`~oci.retry` module. This operation uses :py:data:`~oci.retry.DEFAULT_RETRY_STRATEGY` as default if no retry strategy is provided. The specifics of the default retry strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/retries.html>`__. To have this operation explicitly not perform any retries, pass an instance of :py:class:`~oci.retry.NoneRetryStrategy`. :param bool allow_control_chars: (optional) allow_control_chars is a boolean to indicate whether or not this request should allow control characters in the response object. By default, the response will not allow control characters in strings :return: A :class:`~oci.response.Response` object with data of type :class:`~oci.generative_ai_inference.models.ChatResult` :rtype: :class:`~oci.response.Response` :example: Click `here <https://docs.cloud.oracle.com/en-us/iaas/tools/python-sdk-examples/latest/generativeaiinference/chat.py.html>`__ to see an example of how to use chat API. z /actions/chat�POST�chatzVhttps://docs.oracle.com/iaas/api/#/en/generative-ai-inference/20231130/ChatResult/Chat�r r �opc_retry_token�opc_request_idc s g | ]}|� vr|�qS r% r% ��.0Z_key�Zexpected_kwargsr% r& � <listcomp>� � z4GenerativeAiInferenceClient.chat.<locals>.<listcomp>zchat got unknown kwargs: �#application/json, text/event-stream�application/jsonr+ r, �Zacceptz content-typezopc-retry-tokenzopc-request-idc S s& i | ] \}}|t ur|d ur||�qS �N��missing�r. �k�vr% r% r& � <dictcomp>� r1 z4GenerativeAiInferenceClient.chat.<locals>.<dictcomp>r �Zoperation_retry_strategyZclient_retry_strategyNZ ChatResultr � � resource_path�method� header_params�bodyZ response_typer �operation_name�api_reference_link�required_arguments�r Ziterkeys� ValueErrorr! r7 Z iteritemsr" Z get_preferred_retry_strategyr r ZDEFAULT_RETRY_STRATEGY� isinstanceZNoneRetryStrategyZ add_opc_retry_token_if_neededZ add_opc_client_retries_headerZ add_circuit_breaker_callbackr Zmake_retrying_callZcall_api) r# Z chat_detailsr$ rD r> r? rB rC � extra_kwargsr@ r r% r/ r& r) } sf $� �� � �z GenerativeAiInferenceClient.chatc s" g }d}d}d}d}g d�� � fdd�t �|�D �}|rFtd|����d d |�d t�|�d t�d �} d d� t �| �D �} | jj|�d�| jd�} | du r�t j } | r�t | t j �s�| j� | � | j�| � | �| j� | j| jj||| |d|�d�|||d� S | jj||| |d|�d�|||d� S dS )a� Produces embeddings for the inputs. An embedding is numeric representation of a piece of text. This text can be a phrase, a sentence, or one or more paragraphs. The Generative AI embedding model transforms each phrase, sentence, or paragraph that you input, into an array with 1024 numbers. You can use these embeddings for finding similarity in your input text such as finding phrases that are similar in context or category. Embeddings are mostly used for semantic searches where the search function focuses on the meaning of the text that it's searching through rather than finding results based on keywords. :param oci.generative_ai_inference.models.EmbedTextDetails embed_text_details: (required) Details for generating the embed response. :param str opc_retry_token: (optional) A token that uniquely identifies a request so it can be retried in case of a timeout or server error without risk of executing that same action again. Retry tokens expire after 24 hours, but can be invalidated before that, in case of conflicting operations. For example, if a resource is deleted and purged from the system, then a retry of the original creation request is rejected. :param str opc_request_id: (optional) The client request ID for tracing. :param obj retry_strategy: (optional) A retry strategy to apply to this specific operation/call. This will override any retry strategy set at the client-level. This should be one of the strategies available in the :py:mod:`~oci.retry` module. This operation uses :py:data:`~oci.retry.DEFAULT_RETRY_STRATEGY` as default if no retry strategy is provided. The specifics of the default retry strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/retries.html>`__. To have this operation explicitly not perform any retries, pass an instance of :py:class:`~oci.retry.NoneRetryStrategy`. :param bool allow_control_chars: (optional) allow_control_chars is a boolean to indicate whether or not this request should allow control characters in the response object. By default, the response will not allow control characters in strings :return: A :class:`~oci.response.Response` object with data of type :class:`~oci.generative_ai_inference.models.EmbedTextResult` :rtype: :class:`~oci.response.Response` :example: Click `here <https://docs.cloud.oracle.com/en-us/iaas/tools/python-sdk-examples/latest/generativeaiinference/embed_text.py.html>`__ to see an example of how to use embed_text API. z/actions/embedTextr( � embed_textz`https://docs.oracle.com/iaas/api/#/en/generative-ai-inference/20231130/EmbedTextResult/EmbedTextr* c s g | ]}|� vr|�qS r% r% r- r/ r% r& r0 r1 z:GenerativeAiInferenceClient.embed_text.<locals>.<listcomp>z embed_text got unknown kwargs: r3 r+ r, r4 c S s& i | ] \}}|t ur|d ur||�qS r5 r6 r8 r% r% r& r; r1 z:GenerativeAiInferenceClient.embed_text.<locals>.<dictcomp>r r< NZEmbedTextResultr r= rE ) r# Zembed_text_detailsr$ rD r> r? rB rC rH r@ r r% r/ r& rI � sf &� �� � �z&GenerativeAiInferenceClient.embed_textc s" g }d}d}d}d}g d�� � fdd�t �|�D �}|rFtd|����d d |�d t�|�d t�d �} dd� t �| �D �} | jj|�d�| jd�} | du r�t j } | r�t | t j �s�| j� | � | j�| � | �| j� | j| jj||| |d|�d�|||d� S | jj||| |d|�d�|||d� S dS )au Generates a text response based on the user prompt. :param oci.generative_ai_inference.models.GenerateTextDetails generate_text_details: (required) Details for generating the text response. :param str opc_retry_token: (optional) A token that uniquely identifies a request so it can be retried in case of a timeout or server error without risk of executing that same action again. Retry tokens expire after 24 hours, but can be invalidated before that, in case of conflicting operations. For example, if a resource is deleted and purged from the system, then a retry of the original creation request is rejected. :param str opc_request_id: (optional) The client request ID for tracing. :param obj retry_strategy: (optional) A retry strategy to apply to this specific operation/call. This will override any retry strategy set at the client-level. This should be one of the strategies available in the :py:mod:`~oci.retry` module. This operation uses :py:data:`~oci.retry.DEFAULT_RETRY_STRATEGY` as default if no retry strategy is provided. The specifics of the default retry strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/retries.html>`__. To have this operation explicitly not perform any retries, pass an instance of :py:class:`~oci.retry.NoneRetryStrategy`. :param bool allow_control_chars: (optional) allow_control_chars is a boolean to indicate whether or not this request should allow control characters in the response object. By default, the response will not allow control characters in strings :return: A :class:`~oci.response.Response` object with data of type :class:`~oci.generative_ai_inference.models.GenerateTextResult` :rtype: :class:`~oci.response.Response` :example: Click `here <https://docs.cloud.oracle.com/en-us/iaas/tools/python-sdk-examples/latest/generativeaiinference/generate_text.py.html>`__ to see an example of how to use generate_text API. z/actions/generateTextr( � generate_textzfhttps://docs.oracle.com/iaas/api/#/en/generative-ai-inference/20231130/GenerateTextResult/GenerateTextr* c s g | ]}|� vr|�qS r% r% r- r/ r% r& r0 r r1 z=GenerativeAiInferenceClient.generate_text.<locals>.<listcomp>z"generate_text got unknown kwargs: r2 r3 r+ r, r4 c S s& i | ] \}}|t ur|d ur||�qS r5 r6 r8 r% r% r& r; } r1 z=GenerativeAiInferenceClient.generate_text.<locals>.<dictcomp>r r< NZGenerateTextResultr r= rE ) r# Zgenerate_text_detailsr$ rD r> r? rB rC rH r@ r r% r/ r& rJ A sf $� �� � �z)GenerativeAiInferenceClient.generate_textc s" g }d}d}d}d}g d�� � fdd�t �|�D �}|rFtd|����d d |�d t�|�d t�d �} d d� t �| �D �} | jj|�d�| jd�} | du r�t j } | r�t | t j �s�| j� | � | j�| � | �| j� | j| jj||| |d|�d�|||d� S | jj||| |d|�d�|||d� S dS )aY Summarizes the input text. :param oci.generative_ai_inference.models.SummarizeTextDetails summarize_text_details: (required) Details for summarizing the text. :param str opc_retry_token: (optional) A token that uniquely identifies a request so it can be retried in case of a timeout or server error without risk of executing that same action again. Retry tokens expire after 24 hours, but can be invalidated before that, in case of conflicting operations. For example, if a resource is deleted and purged from the system, then a retry of the original creation request is rejected. :param str opc_request_id: (optional) The client request ID for tracing. :param obj retry_strategy: (optional) A retry strategy to apply to this specific operation/call. This will override any retry strategy set at the client-level. This should be one of the strategies available in the :py:mod:`~oci.retry` module. This operation uses :py:data:`~oci.retry.DEFAULT_RETRY_STRATEGY` as default if no retry strategy is provided. The specifics of the default retry strategy are described `here <https://docs.oracle.com/en-us/iaas/tools/python/latest/sdk_behaviors/retries.html>`__. To have this operation explicitly not perform any retries, pass an instance of :py:class:`~oci.retry.NoneRetryStrategy`. :param bool allow_control_chars: (optional) allow_control_chars is a boolean to indicate whether or not this request should allow control characters in the response object. By default, the response will not allow control characters in strings :return: A :class:`~oci.response.Response` object with data of type :class:`~oci.generative_ai_inference.models.SummarizeTextResult` :rtype: :class:`~oci.response.Response` :example: Click `here <https://docs.cloud.oracle.com/en-us/iaas/tools/python-sdk-examples/latest/generativeaiinference/summarize_text.py.html>`__ to see an example of how to use summarize_text API. z/actions/summarizeTextr( �summarize_textzhhttps://docs.oracle.com/iaas/api/#/en/generative-ai-inference/20231130/SummarizeTextResult/SummarizeTextr* c s g | ]}|� vr|�qS r% r% r- r/ r% r& r0 � r1 z>GenerativeAiInferenceClient.summarize_text.<locals>.<listcomp>z#summarize_text got unknown kwargs: r3 r+ r, r4 c S s& i | ] \}}|t ur|d ur||�qS r5 r6 r8 r% r% r& r; � r1 z>GenerativeAiInferenceClient.summarize_text.<locals>.<dictcomp>r r< NZSummarizeTextResultr r= rE ) r# Zsummarize_text_detailsr$ rD r> r? rB rC rH r@ r r% r/ r& rK � sf $� �� � �z*GenerativeAiInferenceClient.summarize_textN) �__name__� __module__� __qualname__�__doc__r' r) rI rJ rK r% r% r% r& r s [acar N) Z __future__r Z oci._vendorr r Zocir r Zoci.base_clientr Z oci.configr r Z oci.signerr Zoci.utilr r r Zoci.exceptionsr Z oci.alloyr Zmodelsr r7 �objectr r% r% r% r& �<module> s