Class GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecNgramSpeculation

N-Gram speculation works by trying to find matching tokens in the previous prompt sequence and use those as speculation for generating new tokens.

Inheritance

object

GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecNgramSpeculation

Implements

IDirectResponseSchema

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Google.Apis.Aiplatform.v1beta1.Data

Assembly: Google.Apis.Aiplatform.v1beta1.dll

Syntax

public class GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecNgramSpeculation : IDirectResponseSchema

Properties

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
string

NgramSize

The number of last N input tokens used as ngram to search/match against the previous prompt sequence. This is equal to the N in N-Gram. The default value is 3 if not specified.

Declaration

[JsonProperty("ngramSize")]
public virtual int? NgramSize { get; set; }

Property Value

Type	Description
int?

Implements

IDirectResponseSchema