Class GoogleCloudAiplatformV1beta1SpeculativeDecodingSpec

Configuration for Speculative Decoding.

Inheritance

object

GoogleCloudAiplatformV1beta1SpeculativeDecodingSpec

Implements

IDirectResponseSchema

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Google.Apis.Aiplatform.v1beta1.Data

Assembly: Google.Apis.Aiplatform.v1beta1.dll

Syntax

public class GoogleCloudAiplatformV1beta1SpeculativeDecodingSpec : IDirectResponseSchema

Properties

DraftModelSpeculation

draft model speculation.

Declaration

[JsonProperty("draftModelSpeculation")]
public virtual GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation DraftModelSpeculation { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
string

NgramSpeculation

N-Gram speculation.

Declaration

[JsonProperty("ngramSpeculation")]
public virtual GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecNgramSpeculation NgramSpeculation { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecNgramSpeculation

SpeculativeTokenCount

The number of speculative tokens to generate at each step.

Declaration

[JsonProperty("speculativeTokenCount")]
public virtual int? SpeculativeTokenCount { get; set; }

Property Value

Type	Description
int?

Implements

IDirectResponseSchema