Code

Dynatemp ooba hf#1

Code

Open

kalomaze wants to merge 29 commits intomainkalomaze/text-generation-webui:mainfrom dynatemp-ooba-hfkalomaze/text-generation-webui:dynatemp-ooba-hfCopy head branch name to clipboard

+184-8

Commits

Commits on Jan 5, 2024

• WIP dynamic temp ooba HF support

  Show description for fad6d37
  kalomaze

  committed
  fad6d37

Commits on Jan 6, 2024

• update max

  Show description for 07929de
  kalomaze

  committed
  07929de

• Initiate float to store temp + preliminary fixes

  kalomaze

  committed
  00ed020

• oops

  kalomaze

  committed
  31c671b

• ok the last 2 commits broke idk why

  Show description for 501ba08
  kalomaze

  committed
  501ba08

• Remove irrelevant copypaste init bits

  Show description for 3672b53
  kalomaze

  committed
  3672b53

• Make it use the dynatemp range value properly

  kalomaze

  committed
  e33acf4

• Fix mirostat (?) and Max Entropy calculation

  kalomaze

  committed
  939bf05

• Remove nonsensical comments and return old ones

  kalomaze

  committed
  31d3824

• Fix whitespace and remove irrelevant comment

  kalomaze

  committed
  5788ad8

• Initialize Dynamic Temp value for OAI extension

  kalomaze

  committed
  ae9461e

• Ensure min_temp has a maximum of zero

  kalomaze

  committed
  6c70dc7

• Guard against div by zero for both entropy calcs

  kalomaze

  committed
  4f3264c

• Properly ensure div by zero for max entropy calc

  Show description for 25f3cab
  kalomaze

  committed
  25f3cab

• Update UI description

  kalomaze

  committed
  ae476d6

• Fix tiny merge conflict

  kalomaze

  committed
  529daac

• Sync Dynatemp branch with latest mainline ooba

  kalomaze

  authored
  85828d8

• Attempt to fix duplicated Temperature logic

  kalomaze

  committed
  1cc7a14

Commits on Jan 7, 2024

• Lint

  oobabooga

  committed
  44e8a92

• Use a single warper for temperature and dynamic temperature

  oobabooga

  committed
  941d257

• Comment the debug statements

  oobabooga

  committed
  33821b0

• Various minor changes

  oobabooga

  committed
  4849c57

• Minor changes

  oobabooga

  committed
  951b268

• Always replace temperature with TemperatureLogitsWarperWithDynatemp

  oobabooga

  committed
  4023be2

• Add an extension for dynamic temperature with range

  oobabooga

  committed
  2fc441f

• Fix silent exception when temperature is int

  oobabooga

  committed
  6306927

• Fix a logits issue with llamacpp_HF

  oobabooga

  committed
  ba65b3c

• Add a Dynamic Temperature preset

  oobabooga

  committed
  aa78dfd

• Document the new extension

  oobabooga

  committed
  09d5dd7